Lyon:Hardware: Difference between revisions
No edit summary |
No edit summary |
||
(One intermediate revision by one other user not shown) | |||
Line 5: | Line 5: | ||
= Summary = | = Summary = | ||
* 9 clusters | * 9 clusters | ||
* | * 65 nodes | ||
* | * 1510 CPU cores | ||
* 107 GPUs | * 107 GPUs | ||
* 548160 GPUs cores | * 548160 GPUs cores | ||
* 9. | * 9.86 TiB RAM | ||
* 34 SSDs and | * 34 SSDs and 56 HDDs on nodes (total: 97.87 TB) | ||
* | * 42.7 TFLOPS (excluding GPUs) | ||
= Clusters summary = | = Clusters summary = | ||
Line 33: | Line 33: | ||
|- | |- | ||
|[[#gemini|gemini]]||<b>[[Exotic#Lyon:_gemini|exotic]]</b> job type||2019-09-01||2019-06-12||2||2||Intel Xeon E5-2698 v4||20 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="7599"|<b>480 GB SSD</b> + 4 x 1.92 TB SSD[[Disk_reservation|*]]||data-sort-value=" | |[[#gemini|gemini]]||<b>[[Exotic#Lyon:_gemini|exotic]]</b> job type||2019-09-01||2019-06-12||2||2||Intel Xeon E5-2698 v4||20 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="7599"|<b>480 GB SSD</b> + 4 x 1.92 TB SSD[[Disk_reservation|*]]||data-sort-value="10000"|10 Gbps (SR‑IOV) ||8 x Nvidia Tesla V100 (32 GiB) | ||
|- | |- | ||
|[[#hercule|hercule]]||||2012-10-02||2012-07-19||4||2||Intel Xeon E5-2620||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="5589"|<b>2.0 TB HDD</b> + 2 x 2.0 TB HDD||data-sort-value="10000"|10 Gbps (SR‑IOV) || | |[[#hercule|hercule]]||||2012-10-02||2012-07-19||4||2||Intel Xeon E5-2620||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="5589"|<b>2.0 TB HDD</b> + 2 x 2.0 TB HDD||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
Line 39: | Line 39: | ||
|[[#neowise|neowise]]||<b>[[Exotic#Lyon:_neowise|exotic]]</b> job type||2021-05-17||2021-05-17||10||1||AMD EPYC 7642||48 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="1788"|<b>1.92 TB SSD</b>||data-sort-value="220000"|2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand||8 x AMD MI50 (32 GiB) | |[[#neowise|neowise]]||<b>[[Exotic#Lyon:_neowise|exotic]]</b> job type||2021-05-17||2021-05-17||10||1||AMD EPYC 7642||48 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="1788"|<b>1.92 TB SSD</b>||data-sort-value="220000"|2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand||8 x AMD MI50 (32 GiB) | ||
|- | |- | ||
|[[#nova|nova]]||||2016-12-01||2016-10-28|| | |[[#nova|nova]]||||2016-12-01||2016-10-28||20||2||Intel Xeon E5-2620 v4||8 cores/CPU||x86_64||data-sort-value="68719476736"|64 GiB||data-sort-value="557"|<b>598 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
|- | |- | ||
|[[#orion|orion]]||||2012-09-14||2012-07-16||3||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||<s>Nvidia Tesla M2075 (5 GiB)</s>** | |[[#orion|orion]]||||2012-09-14||2012-07-16||3||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||<s>Nvidia Tesla M2075 (5 GiB)</s>** | ||
|- | |- | ||
|[[#pyxis|pyxis]]||<b>[[Exotic#Lyon:_pyxis|exotic]]</b> job type||2020-01-06||2019-11-07||4||2||Cavium ThunderX2 99xx||32 cores/CPU||aarch64||data-sort-value="274877906944"|256 GiB||data-sort-value="464"|<b>250 GB SSD</b> + 250 GB SSD||data-sort-value=" | |[[#pyxis|pyxis]]||<b>[[Exotic#Lyon:_pyxis|exotic]]</b> job type||2020-01-06||2019-11-07||4||2||Cavium ThunderX2 99xx||32 cores/CPU||aarch64||data-sort-value="274877906944"|256 GiB||data-sort-value="464"|<b>250 GB SSD</b> + 250 GB SSD||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
|- | |- | ||
|[[#sagittaire|sagittaire]]||||2006-07-01||2006-07-01|| | |[[#sagittaire|sagittaire]]||||2006-07-01||2006-07-01||9||2||AMD Opteron 250||1 core/CPU||x86_64||data-sort-value="2147483648"|2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps || | ||
|- | |- | ||
|[[#sirius|sirius]]||<b>[[Exotic#Lyon:_sirius|exotic]]</b> job type||2021-11-18||2021-11-24||1||2||AMD EPYC 7742||64 cores/CPU||x86_64||data-sort-value="1099511627776"|1.0 TiB||data-sort-value="17880"|<b>1.92 TB SSD</b> + 1.92 TB SSD + 4 x 3.84 TB SSD||data-sort-value="100000"|100 Gbps ||8 x Nvidia A100 (40 GiB) | |[[#sirius|sirius]]||<b>[[Exotic#Lyon:_sirius|exotic]]</b> job type||2021-11-18||2021-11-24||1||2||AMD EPYC 7742||64 cores/CPU||x86_64||data-sort-value="1099511627776"|1.0 TiB||data-sort-value="17880"|<b>1.92 TB SSD</b> + 1.92 TB SSD + 4 x 3.84 TB SSD||data-sort-value="100000"|100 Gbps ||8 x Nvidia A100 (40 GiB) | ||
Line 97: | Line 97: | ||
* eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe, SR-IOV enabled<br /> | * eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe, SR-IOV enabled<br /> | ||
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br /> | ||
* ib0, InfiniBand | * <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br /> | ||
* ib1, InfiniBand | * <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br /> | ||
* ib2, InfiniBand | * <span style="color:grey">ib2, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br /> | ||
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | * <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | ||
|- | |- | ||
Line 196: | Line 196: | ||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=nova%20only nova] == | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=nova%20only nova] == | ||
''' | '''20 nodes, 40 cpus, 320 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/nova/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | '''Reservation example:''' | ||
Line 312: | Line 312: | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede, SR-IOV enabled<br /> | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede, SR-IOV enabled<br /> | ||
* <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br /> | ||
* ib0, InfiniBand | * <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br/> | ||
|- | |- | ||
|} | |} | ||
Line 320: | Line 320: | ||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sagittaire%20only sagittaire] == | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sagittaire%20only sagittaire] == | ||
''' | '''9 nodes, 18 cpus, 18 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | '''Reservation example:''' | ||
Line 355: | Line 355: | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
; sagittaire-[ | ; sagittaire-[3-5,<wbr>13-16] (7 nodes, 14 cpus, 14 cores) | ||
{| | {| | ||
|- | |- | ||
Line 478: | Line 478: | ||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on 2024- | |}''<small>Last generated from the Grid'5000 Reference API on 2024-11-06 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/1185e863a7 commit 1185e863a7])</small>'' |
Latest revision as of 16:15, 6 November 2024
See also: Network topology for Lyon
Summary
- 9 clusters
- 65 nodes
- 1510 CPU cores
- 107 GPUs
- 548160 GPUs cores
- 9.86 TiB RAM
- 34 SSDs and 56 HDDs on nodes (total: 97.87 TB)
- 42.7 TFLOPS (excluding GPUs)
Clusters summary
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
gemini | exotic job type | 2019-09-01 | 2019-06-12 | 2 | 2 | Intel Xeon E5-2698 v4 | 20 cores/CPU | x86_64 | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD* | 10 Gbps (SR‑IOV) | 8 x Nvidia Tesla V100 (32 GiB) |
hercule | 2012-10-02 | 2012-07-19 | 4 | 2 | Intel Xeon E5-2620 | 6 cores/CPU | x86_64 | 32 GiB | 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps (SR‑IOV) | ||
neowise | exotic job type | 2021-05-17 | 2021-05-17 | 10 | 1 | AMD EPYC 7642 | 48 cores/CPU | x86_64 | 512 GiB | 1.92 TB SSD | 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand | 8 x AMD MI50 (32 GiB) |
nova | 2016-12-01 | 2016-10-28 | 20 | 2 | Intel Xeon E5-2620 v4 | 8 cores/CPU | x86_64 | 64 GiB | 598 GB HDD | 10 Gbps (SR‑IOV) | ||
orion | 2012-09-14 | 2012-07-16 | 3 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | ||
pyxis | exotic job type | 2020-01-06 | 2019-11-07 | 4 | 2 | Cavium ThunderX2 99xx | 32 cores/CPU | aarch64 | 256 GiB | 250 GB SSD + 250 GB SSD | 10 Gbps (SR‑IOV) | |
sagittaire | 2006-07-01 | 2006-07-01 | 9 | 2 | AMD Opteron 250 | 1 core/CPU | x86_64 | 2 GiB | 73 GB HDD | 1 Gbps | ||
sirius | exotic job type | 2021-11-18 | 2021-11-24 | 1 | 2 | AMD EPYC 7742 | 64 cores/CPU | x86_64 | 1.0 TiB | 1.92 TB SSD + 1.92 TB SSD + 4 x 3.84 TB SSD | 100 Gbps | 8 x Nvidia A100 (40 GiB) |
taurus | 2012-09-14 | 2012-07-16 | 12 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) |
*: disk is reservable
**: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the default queue
gemini
2 nodes, 4 cpus, 80 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Nvidia DGX-1 |
Manufacturing date: | 2019-06-12 |
Date of arrival: | 2019-09-01 |
CPU: | Intel Xeon E5-2698 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 20 cores/CPU |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB) Compute capability: 7.0 |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
hercule
4 nodes, 8 cpus, 48 cores (json)
Reservation example:
Model: | Dell PowerEdge C6220 |
Manufacturing date: | 2012-07-19 |
Date of arrival: | 2012-10-02 |
CPU: | Intel Xeon E5-2620 (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: |
|
Network: |
|
neowise
10 nodes, 10 cpus, 480 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | AMD-Penguin Computing |
Manufacturing date: | 2021-05-17 |
Date of arrival: | 2021-05-17 |
CPU: | AMD EPYC 7642 (Zen 2), x86_64, 1 CPU/node, 48 cores/CPU |
Memory: | 512 GiB |
Storage: | disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk0 ) (primary disk) |
Network: |
|
GPU: | 8 x AMD Radeon Instinct MI50 32GB (32 GiB) |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
nova
20 nodes, 40 cpus, 320 cores (json)
Reservation example:
Model: | Dell PowerEdge R430 |
Manufacturing date: | 2016-10-28 |
Date of arrival: | 2016-12-01 |
CPU: | Intel Xeon E5-2620 v4 (Broadwell), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 64 GiB |
Storage: | disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: /dev/disk0 ) (primary disk) |
Network: |
|
orion
3 nodes, 6 cpus, 36 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Manufacturing date: | 2012-07-16 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 ) (primary disk) |
Network: |
|
GPU: | Compute capability: 2.0 not supported by Grid'5000 default environments |
pyxis
4 nodes, 8 cpus, 256 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Gigabyte R181-T92-00 |
Manufacturing date: | 2019-11-07 |
Date of arrival: | 2020-01-06 |
CPU: | Cavium ThunderX2 99xx (Vulcan), aarch64, 2 CPUs/node, 32 cores/CPU |
Memory: | 256 GiB |
Storage: |
|
Network: |
|
Note: This cluster is defined as exotic. Please read the exotic page for more information.
sagittaire
9 nodes, 18 cpus, 18 cores, split as follows due to differences between nodes (json)
Reservation example:
- sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: | Sun Fire V20z |
Manufacturing date: | 2006-07-01 |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: /dev/disk0 ) (primary disk) |
Network: |
|
- sagittaire-[3-5,
13-16] (7 nodes, 14 cpus, 14 cores)
Model: | Sun Fire V20z |
Manufacturing date: | 2006-07-01 |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: /dev/disk0 ) (primary disk) |
Network: |
|
sirius
1 node, 2 cpus, 128 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | NVidia DGX A100 |
Manufacturing date: | 2021-11-24 |
Date of arrival: | 2021-11-18 |
CPU: | AMD EPYC 7742 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU |
Memory: | 1.0 TiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia A100-SXM4-40GB (40 GiB) Compute capability: 8.0 |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
taurus
12 nodes, 24 cpus, 144 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Manufacturing date: | 2012-07-16 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 ) (primary disk) |
Network: |
|
Last generated from the Grid'5000 Reference API on 2024-11-06 (commit 1185e863a7)