Lyon:Hardware: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
(13 intermediate revisions by 6 users not shown) | |||
Line 5: | Line 5: | ||
= Summary = | = Summary = | ||
''' | '''7 clusters, 72 nodes, 1010 cores, 24.6 TFLOPS''' | ||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
!|Cluster | !|Cluster | ||
!| | !|Access Condition | ||
!|Date of arrival | !|Date of arrival | ||
!data-sort-type="number"|Nodes | !data-sort-type="number"|Nodes | ||
Line 19: | Line 19: | ||
!|Accelerators | !|Accelerators | ||
|- | |- | ||
|[[# | |[[#gemini|gemini]]||||2019-09-01||2||2 x Intel Xeon E5-2698 v4||20 cores/CPU||512 GiB||data-sort-value="7599"|<b>480 GB SSD</b> + 4 x 1.92 TB SSD||data-sort-value="110000"|10 Gbps + 100 Gbps InfiniBand||8 x Nvidia Tesla V100 | ||
|- | |- | ||
|[[#hercule|hercule]]|| | |[[#hercule|hercule]]||||2012-10-02||4||2 x Intel Xeon E5-2620||6 cores/CPU||32 GiB||data-sort-value="5589"|<b>1 x 2.0 TB HDD</b> + 2 x 2.0 TB HDD||data-sort-value="10000"|10 Gbps || | ||
|- | |- | ||
|[[#nova|nova]]|| | |[[#nova|nova]]||||2016-12-01||23||2 x Intel Xeon E5-2620 v4||8 cores/CPU||64 GiB||data-sort-value="557"|<b>598 GB HDD</b>||data-sort-value="10000"|10 Gbps || | ||
|- | |- | ||
|[[#orion|orion]]|| | |[[#orion|orion]]||||2012-09-14||4||2 x Intel Xeon E5-2630||6 cores/CPU||32 GiB||data-sort-value="557"|<b>598 GB HDD</b>||data-sort-value="10000"|10 Gbps ||Nvidia Tesla M2075 | ||
|- | |- | ||
|[[# | |[[#pyxis_.28testing_queue.29|pyxis]]||<b>testing</b> queue,<br/><b>exotic</b> job type||2020-01-06||4||2 x ThunderX2 99xx||32 cores/CPU||256 GiB||data-sort-value="464"|<b>1 x 250 GB HDD</b> + 1 x 250 GB HDD||data-sort-value="110000"|10 Gbps + 100 Gbps InfiniBand|| | ||
|- | |- | ||
|[[#taurus|taurus]]|| | |[[#sagittaire|sagittaire]]||||2006-07-01||21||2 x AMD Opteron 250||1 core/CPU||2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps || | ||
|- | |||
|[[#taurus|taurus]]||||2012-09-14||14||2 x Intel Xeon E5-2630||6 cores/CPU||32 GiB||data-sort-value="557"|<b>598 GB HDD</b>||data-sort-value="10000"|10 Gbps || | |||
|} | |} | ||
Line 35: | Line 37: | ||
= Cluster details = | = Cluster details = | ||
== gemini | == gemini == | ||
'''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json]) | |||
{| | {| | ||
|- | |- | ||
Line 90: | Line 56: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 480 GB SSD SAS Samsung SAMSUNG MZ7KM480 ( | * 480 GB SSD SAS Samsung SAMSUNG MZ7KM480 (path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0) (primary disk)<br /> | ||
* 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 ( | * 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 ( | * 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 ( | * 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 ( | * 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0) [[Disk_reservation|(reservable)]] <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 100: | Line 66: | ||
* eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe<br /> | * eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe<br /> | ||
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br /> | ||
* ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], <br/> | * ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br /> | ||
* <span style="color:grey">ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br /> | |||
* <span style="color:grey">ib2, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br /> | |||
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
Line 126: | Line 95: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 ( | * 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1) (primary disk)<br /> | ||
* 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 ( | * 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (path: /dev/disk/by-path/pci-0000:00:1f.2-ata-2) <br /> | ||
* 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 ( | * 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (path: /dev/disk/by-path/pci-0000:00:1f.2-ata-3) <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 157: | Line 126: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| 598 GB HDD SCSI Dell (Raid) PERC H330 Mini ( | | 598 GB HDD SCSI Dell (Raid) PERC H330 Mini (path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 188: | Line 157: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| 598 GB HDD SCSI Dell (Raid) PERC H710 ( | | 598 GB HDD SCSI Dell (Raid) PERC H710 (path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 201: | Line 170: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| Nvidia Tesla M2075<br/> | | Nvidia Tesla M2075<br/> | ||
|- | |||
|} | |||
== pyxis (testing queue, exotic job type) == | |||
'''4 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/pyxis/nodes.json?pretty=1 json]) | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| R181-T92-00<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2020-01-06<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| ThunderX2 99xx (Vulcan, 2 CPUs/node, 32 cores/CPU)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 256 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* 250 GB HDD SAS Samsung Samsung SSD 860 (path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy2-lun-0) (primary disk)<br /> | |||
* 250 GB HDD SAS Samsung Samsung SSD 860 (path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy3-lun-0) <br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede<br /> | |||
* <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br /> | |||
* ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/> | |||
|- | |- | ||
|} | |} | ||
Line 206: | Line 205: | ||
== sagittaire == | == sagittaire == | ||
''' | '''21 nodes, 42 cpus, 42 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json]) | ||
; sagittaire-[1 | ; sagittaire-[1,<wbr>17,<wbr>24] (3 nodes, 6 cpus, 6 cores) | ||
{| | {| | ||
|- | |- | ||
Line 223: | Line 222: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| 73 GB HDD SCSI Fujitsu MAT3073NC ( | | 73 GB HDD SCSI Fujitsu MAT3073NC (path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 249: | Line 248: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| 73 GB HDD SCSI Seagate ST373307LC ( | | 73 GB HDD SCSI Seagate ST373307LC (path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 259: | Line 258: | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
; sagittaire-[2-6,<wbr>13-16,<wbr>18-20,<wbr>27,<wbr>29-31 | ; sagittaire-[2-6,<wbr>13-16,<wbr>18-20,<wbr>27,<wbr>29-31] (16 nodes, 32 cpus, 32 cores) | ||
{| | {| | ||
|- | |- | ||
Line 275: | Line 274: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| 73 GB HDD SCSI Seagate ST373207LC ( | | 73 GB HDD SCSI Seagate ST373207LC (path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 302: | Line 301: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| 598 GB HDD SCSI Dell (Raid) PERC H710 ( | | 598 GB HDD SCSI Dell (Raid) PERC H710 (path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 313: | Line 312: | ||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on | |}''<small>Last generated from the Grid'5000 Reference API on 2020-07-22 ([https://github.com/grid5000/reference-repository/commit/a1171d3aa commit a1171d3aa])</small>'' |
Revision as of 10:47, 22 July 2020
Summary
7 clusters, 72 nodes, 1010 cores, 24.6 TFLOPS
Cluster | Access Condition | Date of arrival | Nodes | CPU | Cores | Memory | Storage | Network | Accelerators |
---|---|---|---|---|---|---|---|---|---|
gemini | 2019-09-01 | 2 | 2 x Intel Xeon E5-2698 v4 | 20 cores/CPU | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD | 10 Gbps + 100 Gbps InfiniBand | 8 x Nvidia Tesla V100 | |
hercule | 2012-10-02 | 4 | 2 x Intel Xeon E5-2620 | 6 cores/CPU | 32 GiB | 1 x 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps | ||
nova | 2016-12-01 | 23 | 2 x Intel Xeon E5-2620 v4 | 8 cores/CPU | 64 GiB | 598 GB HDD | 10 Gbps | ||
orion | 2012-09-14 | 4 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 598 GB HDD | 10 Gbps | Nvidia Tesla M2075 | |
pyxis | testing queue, exotic job type |
2020-01-06 | 4 | 2 x ThunderX2 99xx | 32 cores/CPU | 256 GiB | 1 x 250 GB HDD + 1 x 250 GB HDD | 10 Gbps + 100 Gbps InfiniBand | |
sagittaire | 2006-07-01 | 21 | 2 x AMD Opteron 250 | 1 core/CPU | 2 GiB | 73 GB HDD | 1 Gbps | ||
taurus | 2012-09-14 | 14 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 598 GB HDD | 10 Gbps |
Cluster details
gemini
2 nodes, 4 cpus, 80 cores (json)
Model: | Nvidia DGX-1 |
Date of arrival: | 2019-09-01 |
CPU: | Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU) |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia Tesla V100 |
hercule
4 nodes, 8 cpus, 48 cores (json)
Model: | Dell PowerEdge C6220 |
Date of arrival: | 2012-10-02 |
CPU: | Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU) |
Memory: | 32 GiB |
Storage: |
|
Network: |
|
nova
23 nodes, 46 cpus, 368 cores (json)
Model: | Dell PowerEdge R430 |
Date of arrival: | 2016-12-01 |
CPU: | Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 64 GiB |
Storage: | 598 GB HDD SCSI Dell (Raid) PERC H330 Mini (path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0) (primary disk) |
Network: |
|
orion
4 nodes, 8 cpus, 48 cores (json)
Model: | Dell PowerEdge R720 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU) |
Memory: | 32 GiB |
Storage: | 598 GB HDD SCSI Dell (Raid) PERC H710 (path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0) (primary disk) |
Network: |
|
GPU: | Nvidia Tesla M2075 |
pyxis (testing queue, exotic job type)
4 nodes, 8 cpus, 256 cores (json)
Model: | R181-T92-00 |
Date of arrival: | 2020-01-06 |
CPU: | ThunderX2 99xx (Vulcan, 2 CPUs/node, 32 cores/CPU) |
Memory: | 256 GiB |
Storage: |
|
Network: |
|
sagittaire
21 nodes, 42 cpus, 42 cores, split as follows due to differences between nodes (json)
- sagittaire-[1,
17, 24] (3 nodes, 6 cpus, 6 cores)
Model: | Sun Fire V20z |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU) |
Memory: | 2 GiB |
Storage: | 73 GB HDD SCSI Fujitsu MAT3073NC (path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk) |
Network: |
|
- sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: | Sun Fire V20z |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU) |
Memory: | 2 GiB |
Storage: | 73 GB HDD SCSI Seagate ST373307LC (path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk) |
Network: |
|
- sagittaire-[2-6,
13-16, 18-20, 27, 29-31] (16 nodes, 32 cpus, 32 cores)
Model: | Sun Fire V20z |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU) |
Memory: | 2 GiB |
Storage: | 73 GB HDD SCSI Seagate ST373207LC (path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk) |
Network: |
|
taurus
14 nodes, 28 cpus, 168 cores (json)
Model: | Dell PowerEdge R720 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU) |
Memory: | 32 GiB |
Storage: | 598 GB HDD SCSI Dell (Raid) PERC H710 (path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0) (primary disk) |
Network: |
|
Last generated from the Grid'5000 Reference API on 2020-07-22 (commit a1171d3aa)