Lyon:Hardware: Difference between revisions
No edit summary |
Lpouilloux (talk | contribs) No edit summary |
||
Line 5: | Line 5: | ||
= Summary = | = Summary = | ||
* 9 clusters | * 9 clusters | ||
* | * 66 nodes | ||
* | * 1512 CPU cores | ||
* 107 GPUs | * 107 GPUs | ||
* 548160 GPUs cores | * 548160 GPUs cores | ||
* 9. | * 9.86 TiB RAM | ||
* 34 SSDs and | * 34 SSDs and 57 HDDs on nodes (total: 97.94 TB) | ||
* | * 42.7 TFLOPS (excluding GPUs) | ||
= Clusters summary = | = Clusters summary = | ||
Line 33: | Line 33: | ||
|- | |- | ||
|[[#gemini|gemini]]||<b>[[Exotic#Lyon:_gemini|exotic]]</b> job type||2019-09-01||2019-06-12||2||2||Intel Xeon E5-2698 v4||20 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="7599"|<b>480 GB SSD</b> + 4 x 1.92 TB SSD[[Disk_reservation|*]]||data-sort-value=" | |[[#gemini|gemini]]||<b>[[Exotic#Lyon:_gemini|exotic]]</b> job type||2019-09-01||2019-06-12||2||2||Intel Xeon E5-2698 v4||20 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="7599"|<b>480 GB SSD</b> + 4 x 1.92 TB SSD[[Disk_reservation|*]]||data-sort-value="10000"|10 Gbps (SR‑IOV) ||8 x Nvidia Tesla V100 (32 GiB) | ||
|- | |- | ||
|[[#hercule|hercule]]||||2012-10-02||2012-07-19||4||2||Intel Xeon E5-2620||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="5589"|<b>2.0 TB HDD</b> + 2 x 2.0 TB HDD||data-sort-value="10000"|10 Gbps (SR‑IOV) || | |[[#hercule|hercule]]||||2012-10-02||2012-07-19||4||2||Intel Xeon E5-2620||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="5589"|<b>2.0 TB HDD</b> + 2 x 2.0 TB HDD||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
Line 39: | Line 39: | ||
|[[#neowise|neowise]]||<b>[[Exotic#Lyon:_neowise|exotic]]</b> job type||2021-05-17||2021-05-17||10||1||AMD EPYC 7642||48 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="1788"|<b>1.92 TB SSD</b>||data-sort-value="220000"|2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand||8 x AMD MI50 (32 GiB) | |[[#neowise|neowise]]||<b>[[Exotic#Lyon:_neowise|exotic]]</b> job type||2021-05-17||2021-05-17||10||1||AMD EPYC 7642||48 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="1788"|<b>1.92 TB SSD</b>||data-sort-value="220000"|2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand||8 x AMD MI50 (32 GiB) | ||
|- | |- | ||
|[[#nova|nova]]||||2016-12-01||2016-10-28|| | |[[#nova|nova]]||||2016-12-01||2016-10-28||20||2||Intel Xeon E5-2620 v4||8 cores/CPU||x86_64||data-sort-value="68719476736"|64 GiB||data-sort-value="557"|<b>598 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
|- | |- | ||
|[[#orion|orion]]||||2012-09-14||2012-07-16||3||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||<s>Nvidia Tesla M2075 (5 GiB)</s>** | |[[#orion|orion]]||||2012-09-14||2012-07-16||3||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||<s>Nvidia Tesla M2075 (5 GiB)</s>** | ||
|- | |- | ||
|[[#pyxis|pyxis]]||<b>[[Exotic#Lyon:_pyxis|exotic]]</b> job type||2020-01-06||2019-11-07||4||2||Cavium ThunderX2 99xx||32 cores/CPU||aarch64||data-sort-value="274877906944"|256 GiB||data-sort-value="464"|<b>250 GB SSD</b> + 250 GB SSD||data-sort-value=" | |[[#pyxis|pyxis]]||<b>[[Exotic#Lyon:_pyxis|exotic]]</b> job type||2020-01-06||2019-11-07||4||2||Cavium ThunderX2 99xx||32 cores/CPU||aarch64||data-sort-value="274877906944"|256 GiB||data-sort-value="464"|<b>250 GB SSD</b> + 250 GB SSD||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
|- | |- | ||
|[[#sagittaire|sagittaire]]||||2006-07-01||2006-07-01||10||2||AMD Opteron 250||1 core/CPU||x86_64||data-sort-value="2147483648"|2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps || | |[[#sagittaire|sagittaire]]||||2006-07-01||2006-07-01||10||2||AMD Opteron 250||1 core/CPU||x86_64||data-sort-value="2147483648"|2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps || | ||
Line 97: | Line 97: | ||
* eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe, SR-IOV enabled<br /> | * eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe, SR-IOV enabled<br /> | ||
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br /> | ||
* ib0, InfiniBand | * <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br /> | ||
* ib1, InfiniBand | * <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br /> | ||
* ib2, InfiniBand | * <span style="color:grey">ib2, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br /> | ||
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | * <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | ||
|- | |- | ||
Line 196: | Line 196: | ||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=nova%20only nova] == | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=nova%20only nova] == | ||
''' | '''20 nodes, 40 cpus, 320 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/nova/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | '''Reservation example:''' | ||
Line 312: | Line 312: | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede, SR-IOV enabled<br /> | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede, SR-IOV enabled<br /> | ||
* <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br /> | ||
* ib0, InfiniBand | * <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br/> | ||
|- | |- | ||
|} | |} | ||
Line 478: | Line 478: | ||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on 2024- | |}''<small>Last generated from the Grid'5000 Reference API on 2024-10-31 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/a3b75a4b44 commit a3b75a4b44])</small>'' |
Revision as of 08:25, 31 October 2024
See also: Network topology for Lyon
Summary
- 9 clusters
- 66 nodes
- 1512 CPU cores
- 107 GPUs
- 548160 GPUs cores
- 9.86 TiB RAM
- 34 SSDs and 57 HDDs on nodes (total: 97.94 TB)
- 42.7 TFLOPS (excluding GPUs)
Clusters summary
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
gemini | exotic job type | 2019-09-01 | 2019-06-12 | 2 | 2 | Intel Xeon E5-2698 v4 | 20 cores/CPU | x86_64 | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD* | 10 Gbps (SR‑IOV) | 8 x Nvidia Tesla V100 (32 GiB) |
hercule | 2012-10-02 | 2012-07-19 | 4 | 2 | Intel Xeon E5-2620 | 6 cores/CPU | x86_64 | 32 GiB | 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps (SR‑IOV) | ||
neowise | exotic job type | 2021-05-17 | 2021-05-17 | 10 | 1 | AMD EPYC 7642 | 48 cores/CPU | x86_64 | 512 GiB | 1.92 TB SSD | 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand | 8 x AMD MI50 (32 GiB) |
nova | 2016-12-01 | 2016-10-28 | 20 | 2 | Intel Xeon E5-2620 v4 | 8 cores/CPU | x86_64 | 64 GiB | 598 GB HDD | 10 Gbps (SR‑IOV) | ||
orion | 2012-09-14 | 2012-07-16 | 3 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | ||
pyxis | exotic job type | 2020-01-06 | 2019-11-07 | 4 | 2 | Cavium ThunderX2 99xx | 32 cores/CPU | aarch64 | 256 GiB | 250 GB SSD + 250 GB SSD | 10 Gbps (SR‑IOV) | |
sagittaire | 2006-07-01 | 2006-07-01 | 10 | 2 | AMD Opteron 250 | 1 core/CPU | x86_64 | 2 GiB | 73 GB HDD | 1 Gbps | ||
sirius | exotic job type | 2021-11-18 | 2021-11-24 | 1 | 2 | AMD EPYC 7742 | 64 cores/CPU | x86_64 | 1.0 TiB | 1.92 TB SSD + 1.92 TB SSD + 4 x 3.84 TB SSD | 100 Gbps | 8 x Nvidia A100 (40 GiB) |
taurus | 2012-09-14 | 2012-07-16 | 12 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) |
*: disk is reservable
**: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the default queue
gemini
2 nodes, 4 cpus, 80 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Nvidia DGX-1 |
Manufacturing date: | 2019-06-12 |
Date of arrival: | 2019-09-01 |
CPU: | Intel Xeon E5-2698 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 20 cores/CPU |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB) Compute capability: 7.0 |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
hercule
4 nodes, 8 cpus, 48 cores (json)
Reservation example:
Model: | Dell PowerEdge C6220 |
Manufacturing date: | 2012-07-19 |
Date of arrival: | 2012-10-02 |
CPU: | Intel Xeon E5-2620 (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: |
|
Network: |
|
neowise
10 nodes, 10 cpus, 480 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | AMD-Penguin Computing |
Manufacturing date: | 2021-05-17 |
Date of arrival: | 2021-05-17 |
CPU: | AMD EPYC 7642 (Zen 2), x86_64, 1 CPU/node, 48 cores/CPU |
Memory: | 512 GiB |
Storage: | disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk0 ) (primary disk) |
Network: |
|
GPU: | 8 x AMD Radeon Instinct MI50 32GB (32 GiB) |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
nova
20 nodes, 40 cpus, 320 cores (json)
Reservation example:
Model: | Dell PowerEdge R430 |
Manufacturing date: | 2016-10-28 |
Date of arrival: | 2016-12-01 |
CPU: | Intel Xeon E5-2620 v4 (Broadwell), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 64 GiB |
Storage: | disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: /dev/disk0 ) (primary disk) |
Network: |
|
orion
3 nodes, 6 cpus, 36 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Manufacturing date: | 2012-07-16 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 ) (primary disk) |
Network: |
|
GPU: | Compute capability: 2.0 not supported by Grid'5000 default environments |
pyxis
4 nodes, 8 cpus, 256 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Gigabyte R181-T92-00 |
Manufacturing date: | 2019-11-07 |
Date of arrival: | 2020-01-06 |
CPU: | Cavium ThunderX2 99xx (Vulcan), aarch64, 2 CPUs/node, 32 cores/CPU |
Memory: | 256 GiB |
Storage: |
|
Network: |
|
Note: This cluster is defined as exotic. Please read the exotic page for more information.
sagittaire
10 nodes, 20 cpus, 20 cores, split as follows due to differences between nodes (json)
Reservation example:
- sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: | Sun Fire V20z |
Manufacturing date: | 2006-07-01 |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: /dev/disk0 ) (primary disk) |
Network: |
|
- sagittaire-[2-5,
13-16] (8 nodes, 16 cpus, 16 cores)
Model: | Sun Fire V20z |
Manufacturing date: | 2006-07-01 |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: /dev/disk0 ) (primary disk) |
Network: |
|
sirius
1 node, 2 cpus, 128 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | NVidia DGX A100 |
Manufacturing date: | 2021-11-24 |
Date of arrival: | 2021-11-18 |
CPU: | AMD EPYC 7742 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU |
Memory: | 1.0 TiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia A100-SXM4-40GB (40 GiB) Compute capability: 8.0 |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
taurus
12 nodes, 24 cpus, 144 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Manufacturing date: | 2012-07-16 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 ) (primary disk) |
Network: |
|
Last generated from the Grid'5000 Reference API on 2024-10-31 (commit a3b75a4b44)