Lyon:Hardware: Difference between revisions
		
		
		
		
		
		Jump to navigation
		Jump to search
		
				
		
		
	
No edit summary  | 
				No edit summary  | 
				||
| Line 6: | Line 6: | ||
= Summary =  | = Summary =  | ||
* 9 clusters  | * 9 clusters  | ||
*   | * 68 nodes  | ||
*   | * 1544 CPU cores  | ||
* 107 GPUs  | * 107 GPUs  | ||
*   | * 9.99 TiB RAM  | ||
* 34 SSDs and   | * 34 SSDs and 59 HDDs on nodes (total: 99.14 TB)  | ||
*   | * 43.8 TFLOPS (excluding GPUs)  | ||
= Clusters =  | = Clusters =  | ||
| Line 41: | Line 41: | ||
|[[#sagittaire|sagittaire]]||||2006-07-01||10||2 x AMD Opteron 250||1 core/CPU||2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps ||  | |[[#sagittaire|sagittaire]]||||2006-07-01||10||2 x AMD Opteron 250||1 core/CPU||2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps ||  | ||
|-  | |-  | ||
|[[#sirius|sirius]]||  | |[[#sirius|sirius]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2021-11-18||1||2 x AMD EPYC 7742||64 cores/CPU||1.0 TiB||data-sort-value="17880"|<b>1 x 1.92 TB SSD</b> + 1 x 1.92 TB SSD + 4 x 3.84 TB SSD||data-sort-value="1000"|1 Gbps ||8 x Nvidia A100 (40 GiB)  | ||
|-  | |-  | ||
|[[#taurus|taurus]]||||2012-09-14||  | |[[#taurus|taurus]]||||2012-09-14||12||2 x Intel Xeon E5-2630||6 cores/CPU||32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||  | ||
|}  | |}  | ||
| Line 344: | Line 344: | ||
|-  | |-  | ||
|}  | |}  | ||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sirius%20only sirius] ==  | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sirius%20only sirius] ==  | ||
| Line 389: | Line 351: | ||
'''Reservation example:'''  | '''Reservation example:'''  | ||
{{Term|location=flyon|cmd=<code class="command">oarsub  | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p sirius</code> <code>-I</code>}}  | ||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''  | ||
|   | | exotic job type<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
| Line 434: | Line 396: | ||
| 8 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/>  | | 8 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/>  | ||
|-  | |-  | ||
|}''<small>Last generated from the Grid'5000 Reference API on 2022-  | |}  | ||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=taurus%20only taurus] ==  | |||
'''12 nodes, 24 cpus, 144 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p taurus</code> <code>-I</code>}}  | |||
{|  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | |||
| Dell PowerEdge R720<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | |||
| 2012-09-14<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | |||
| Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU)<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | |||
| 32 GiB<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | |||
|  disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0</code>)  (primary disk)<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | |||
|   | |||
* eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br />  | |||
* <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />  | |||
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | |||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | |||
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | |||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>  | |||
|-  | |||
|}''<small>Last generated from the Grid'5000 Reference API on 2022-05-09 ([https://github.com/grid5000/reference-repository/commit/ef812ae635 commit ef812ae635])</small>''  | |||
Revision as of 18:28, 9 May 2022
See also: Network topology for Lyon
Summary
- 9 clusters
 - 68 nodes
 - 1544 CPU cores
 - 107 GPUs
 - 9.99 TiB RAM
 - 34 SSDs and 59 HDDs on nodes (total: 99.14 TB)
 - 43.8 TFLOPS (excluding GPUs)
 
Clusters
| Cluster | Access Condition | Date of arrival | Nodes | CPU | Cores | Memory | Storage | Network | Accelerators | 
|---|---|---|---|---|---|---|---|---|---|
| gemini | exotic job type | 2019-09-01 | 2 | 2 x Intel Xeon E5-2698 v4 | 20 cores/CPU | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD* | 10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand | 8 x Nvidia Tesla V100 (32 GiB) | 
| hercule | 2012-10-02 | 4 | 2 x Intel Xeon E5-2620 | 6 cores/CPU | 32 GiB | 1 x 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps (SR‑IOV) | ||
| neowise | exotic job type | 2021-05-17 | 10 | AMD EPYC 7642 | 48 cores/CPU | 512 GiB | 1.92 TB SSD | 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand | 8 x AMD MI50 (32 GiB) | 
| nova | 2016-12-01 | 22 | 2 x Intel Xeon E5-2620 v4 | 8 cores/CPU | 64 GiB | 598 GB HDD | 10 Gbps (SR‑IOV) | ||
| orion | 2012-09-14 | 3 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | Nvidia Tesla M2075 (5 GiB) | |
| pyxis | exotic job type | 2020-01-06 | 4 | 2 x ARM ThunderX2 99xx | 32 cores/CPU | 256 GiB | 1 x 250 GB SSD + 1 x 250 GB SSD | 10 Gbps (SR‑IOV) + 100 Gbps InfiniBand | |
| sagittaire | 2006-07-01 | 10 | 2 x AMD Opteron 250 | 1 core/CPU | 2 GiB | 73 GB HDD | 1 Gbps | ||
| sirius | exotic job type | 2021-11-18 | 1 | 2 x AMD EPYC 7742 | 64 cores/CPU | 1.0 TiB | 1 x 1.92 TB SSD + 1 x 1.92 TB SSD + 4 x 3.84 TB SSD | 1 Gbps | 8 x Nvidia A100 (40 GiB) | 
| taurus | 2012-09-14 | 12 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | 
*: disk is reservable
Clusters in the default queue
gemini
2 nodes, 4 cpus, 80 cores (json)
Reservation example:
| Access condition: | exotic job type | 
| Model: | Nvidia DGX-1 | 
| Date of arrival: | 2019-09-01 | 
| CPU: | Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU) | 
| Memory: | 512 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
| GPU: | 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB) Compute capability: 7.0  | 
hercule
4 nodes, 8 cpus, 48 cores (json)
Reservation example:
| Model: | Dell PowerEdge C6220 | 
| Date of arrival: | 2012-10-02 | 
| CPU: | Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU) | 
| Memory: | 32 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
neowise
10 nodes, 10 cpus, 480 cores (json)
Reservation example:
| Access condition: | exotic job type | 
| Model: | AMD-Penguin Computing | 
| Date of arrival: | 2021-05-17 | 
| CPU: | AMD EPYC 7642 (Zen 2, 1 CPU/node, 48 cores/CPU) | 
| Memory: | 512 GiB | 
| Storage: | disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:82:00.0-nvme-1)  (primary disk) | 
| Network: | 
  | 
| GPU: | 8 x AMD Radeon Instinct MI50 32GB (32 GiB) | 
nova
22 nodes, 44 cpus, 352 cores (json)
Reservation example:
| Model: | Dell PowerEdge R430 | 
| Date of arrival: | 2016-12-01 | 
| CPU: | Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2 CPUs/node, 8 cores/CPU) | 
| Memory: | 64 GiB | 
| Storage: | disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0)  (primary disk) | 
| Network: | 
  | 
orion
3 nodes, 6 cpus, 36 cores (json)
Reservation example:
| Model: | Dell PowerEdge R720 | 
| Date of arrival: | 2012-09-14 | 
| CPU: | Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU) | 
| Memory: | 32 GiB | 
| Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)  (primary disk) | 
| Network: | 
  | 
| GPU: | Nvidia Tesla M2075 (5 GiB) Compute capability: 2.0  | 
pyxis
4 nodes, 8 cpus, 256 cores (json)
Reservation example:
| Access condition: | exotic job type | 
| Model: | R181-T92-00 | 
| Date of arrival: | 2020-01-06 | 
| CPU: | ThunderX2 99xx (Vulcan, 2 CPUs/node, 32 cores/CPU) | 
| Memory: | 256 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
sagittaire
10 nodes, 20 cpus, 20 cores, split as follows due to differences between nodes (json)
Reservation example:
- sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
 
| Model: | Sun Fire V20z | 
| Date of arrival: | 2006-07-01 | 
| CPU: | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU) | 
| Memory: | 2 GiB | 
| Storage: | disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)  (primary disk) | 
| Network: | 
  | 
- sagittaire-[2-5,
13-16] (8 nodes, 16 cpus, 16 cores)  
| Model: | Sun Fire V20z | 
| Date of arrival: | 2006-07-01 | 
| CPU: | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU) | 
| Memory: | 2 GiB | 
| Storage: | disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)  (primary disk) | 
| Network: | 
  | 
sirius
1 node, 2 cpus, 128 cores (json)
Reservation example:
| Access condition: | exotic job type | 
| Model: | NVidia DGX A100 | 
| Date of arrival: | 2021-11-18 | 
| CPU: | AMD EPYC 7742 (Zen 2, 2 CPUs/node, 64 cores/CPU) | 
| Memory: | 1.0 TiB | 
| Storage: | 
  | 
| Network: | 
  | 
| GPU: | 8 x Nvidia A100-SXM4-40GB (40 GiB) Compute capability: 8.0  | 
taurus
12 nodes, 24 cpus, 144 cores (json)
Reservation example:
| Model: | Dell PowerEdge R720 | 
| Date of arrival: | 2012-09-14 | 
| CPU: | Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU) | 
| Memory: | 32 GiB | 
| Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)  (primary disk) | 
| Network: | 
  | 
Last generated from the Grid'5000 Reference API on 2022-05-09 (commit ef812ae635)