Lyon:Hardware: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
Line 6: | Line 6: | ||
= Summary = | = Summary = | ||
''' | '''9 clusters, 74 nodes, 1590 cores, 44.8 TFLOPS''' | ||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
Line 32: | Line 32: | ||
|[[#pyxis|pyxis]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2020-01-06||4||2 x ARM ThunderX2 99xx||32 cores/CPU||256 GiB||data-sort-value="464"|<b>1 x 250 GB SSD</b> + 1 x 250 GB SSD||data-sort-value="110000"|10 Gbps (SR‑IOV) + 100 Gbps InfiniBand|| | |[[#pyxis|pyxis]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2020-01-06||4||2 x ARM ThunderX2 99xx||32 cores/CPU||256 GiB||data-sort-value="464"|<b>1 x 250 GB SSD</b> + 1 x 250 GB SSD||data-sort-value="110000"|10 Gbps (SR‑IOV) + 100 Gbps InfiniBand|| | ||
|- | |- | ||
|[[#sagittaire|sagittaire]]||||2006-07-01|| | |[[#sagittaire|sagittaire]]||||2006-07-01||13||2 x AMD Opteron 250||1 core/CPU||2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps || | ||
|- | |||
|[[#sirius|sirius]]||<b>testing</b> queue||2021-11-18||1||2 x AMD EPYC 7742||64 cores/CPU||1.0 TiB||data-sort-value="17880"|<b>1 x 1.92 TB SSD</b> + 1 x 1.92 TB SSD + 4 x 3.84 TB SSD||data-sort-value="31000"|1 Gbps + 3 x 10 Gbps InfiniBand|| | |||
|- | |- | ||
|[[#taurus|taurus]]||||2012-09-14||13||2 x Intel Xeon E5-2630||6 cores/CPU||32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) || | |[[#taurus|taurus]]||||2012-09-14||13||2 x Intel Xeon E5-2630||6 cores/CPU||32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
Line 279: | Line 281: | ||
== sagittaire == | == sagittaire == | ||
''' | '''13 nodes, 26 cpus, 26 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | '''Reservation example:''' | ||
Line 311: | Line 313: | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
; sagittaire-[2-6,<wbr>13-16,<wbr>18 | ; sagittaire-[2-6,<wbr>13-16,<wbr>18] (10 nodes, 20 cpus, 20 cores) | ||
{| | {| | ||
|- | |- | ||
Line 396: | Line 398: | ||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on 2021-12- | |} | ||
= Clusters in testing queue = | |||
== sirius == | |||
'''1 node, 2 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sirius/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p "cluster='sirius'"</code> <code>-I</code>}} | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| testing queue<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| NVidia DGX A100<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2021-11-18<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| AMD EPYC 7742 (Zen 2, 2 CPUs/node, 64 cores/CPU)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 1.0 TiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:22:00.0-nvme-1</code>) (primary disk)<br /> | |||
* disk1, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:23:00.0-nvme-1</code>) <br /> | |||
* disk2, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:09:00.0-nvme-1</code>) <br /> | |||
* disk3, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk3</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:52:00.0-nvme-1</code>) <br /> | |||
* disk4, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:ca:00.0-nvme-1</code>) <br /> | |||
* disk5, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:8a:00.0-nvme-1</code>) <br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0, Ethernet, configured rate: 1 Gbps, model: Intel I210 Gigabit Network Connection, driver: igb - no KaVLAN<br /> | |||
* <span style="color:grey">eth1, Ethernet, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth2, Ethernet, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | |||
* ib0, InfiniBand, configured rate: 10 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br /> | |||
* ib1, InfiniBand, configured rate: 10 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br /> | |||
* ib2, InfiniBand, configured rate: 10 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br /> | |||
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | |||
* <span style="color:grey">ib4, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | |||
* <span style="color:grey">ib5, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | |||
* <span style="color:grey">ib6, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | |||
* <span style="color:grey">ib7, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br/> | |||
|- | |||
|}''<small>Last generated from the Grid'5000 Reference API on 2021-12-21 ([https://github.com/grid5000/reference-repository/commit/19dded246f commit 19dded246f])</small>'' |
Revision as of 10:48, 21 December 2021
See also: Network topology for Lyon
Summary
9 clusters, 74 nodes, 1590 cores, 44.8 TFLOPS
Cluster | Access Condition | Date of arrival | Nodes | CPU | Cores | Memory | Storage | Network | Accelerators |
---|---|---|---|---|---|---|---|---|---|
gemini | exotic job type | 2019-09-01 | 2 | 2 x Intel Xeon E5-2698 v4 | 20 cores/CPU | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD* | 10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand | 8 x Nvidia Tesla V100 (32 GiB) |
hercule | 2012-10-02 | 4 | 2 x Intel Xeon E5-2620 | 6 cores/CPU | 32 GiB | 1 x 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps (SR‑IOV) | ||
neowise | exotic job type | 2021-05-17 | 10 | AMD EPYC 7642 | 48 cores/CPU | 512 GiB | 1.92 TB SSD | 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand | 8 x AMD MI50 (32 GiB) |
nova | 2016-12-01 | 23 | 2 x Intel Xeon E5-2620 v4 | 8 cores/CPU | 64 GiB | 598 GB HDD | 10 Gbps (SR‑IOV) | ||
orion | 2012-09-14 | 4 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | Nvidia Tesla M2075 (5 GiB) | |
pyxis | exotic job type | 2020-01-06 | 4 | 2 x ARM ThunderX2 99xx | 32 cores/CPU | 256 GiB | 1 x 250 GB SSD + 1 x 250 GB SSD | 10 Gbps (SR‑IOV) + 100 Gbps InfiniBand | |
sagittaire | 2006-07-01 | 13 | 2 x AMD Opteron 250 | 1 core/CPU | 2 GiB | 73 GB HDD | 1 Gbps | ||
sirius | testing queue | 2021-11-18 | 1 | 2 x AMD EPYC 7742 | 64 cores/CPU | 1.0 TiB | 1 x 1.92 TB SSD + 1 x 1.92 TB SSD + 4 x 3.84 TB SSD | 1 Gbps + 3 x 10 Gbps InfiniBand | |
taurus | 2012-09-14 | 13 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) |
*: disk is reservable
Clusters in default queue
gemini
2 nodes, 4 cpus, 80 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Nvidia DGX-1 |
Date of arrival: | 2019-09-01 |
CPU: | Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU) |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB) Compute capability: 7.0 |
hercule
4 nodes, 8 cpus, 48 cores (json)
Reservation example:
Model: | Dell PowerEdge C6220 |
Date of arrival: | 2012-10-02 |
CPU: | Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU) |
Memory: | 32 GiB |
Storage: |
|
Network: |
|
neowise
10 nodes, 10 cpus, 480 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | AMD-Penguin Computing |
Date of arrival: | 2021-05-17 |
CPU: | AMD EPYC 7642 (Zen 2, 1 CPU/node, 48 cores/CPU) |
Memory: | 512 GiB |
Storage: | disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:82:00.0-nvme-1 ) (primary disk) |
Network: |
|
GPU: | 8 x AMD Radeon Instinct MI50 32GB (32 GiB) |
nova
23 nodes, 46 cpus, 368 cores (json)
Reservation example:
Model: | Dell PowerEdge R430 |
Date of arrival: | 2016-12-01 |
CPU: | Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 64 GiB |
Storage: | disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
orion
4 nodes, 8 cpus, 48 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU) |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
GPU: | Nvidia Tesla M2075 (5 GiB) Compute capability: 2.0 |
pyxis
4 nodes, 8 cpus, 256 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | R181-T92-00 |
Date of arrival: | 2020-01-06 |
CPU: | ThunderX2 99xx (Vulcan, 2 CPUs/node, 32 cores/CPU) |
Memory: | 256 GiB |
Storage: |
|
Network: |
|
sagittaire
13 nodes, 26 cpus, 26 cores, split as follows due to differences between nodes (json)
Reservation example:
- sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: | Sun Fire V20z |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU) |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0 ) (primary disk) |
Network: |
|
- sagittaire-[2-6,
13-16, 18] (10 nodes, 20 cpus, 20 cores)
Model: | Sun Fire V20z |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU) |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0 ) (primary disk) |
Network: |
|
- sagittaire-17 (1 node, 2 cpus, 2 cores)
Model: | Sun Fire V20z |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU) |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Fujitsu MAT3073NC (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0 ) (primary disk) |
Network: |
|
taurus
13 nodes, 26 cpus, 156 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU) |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
Clusters in testing queue
sirius
1 node, 2 cpus, 128 cores (json)
Reservation example:
Access condition: | testing queue |
Model: | NVidia DGX A100 |
Date of arrival: | 2021-11-18 |
CPU: | AMD EPYC 7742 (Zen 2, 2 CPUs/node, 64 cores/CPU) |
Memory: | 1.0 TiB |
Storage: |
|
Network: |
|
Last generated from the Grid'5000 Reference API on 2021-12-21 (commit 19dded246f)