Lyon:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
← Older editNewer edit →
No edit summary
No edit summary
Line 5: Line 5:


= Summary =
= Summary =
'''6 clusters, 69 nodes, 756 cores, 10.8 TFLOPS'''
'''6 clusters, 70 nodes, 768 cores, 10.9 TFLOPS'''
{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
Line 29: Line 29:
|[[#sagittaire|sagittaire]]||default||2006-07-01||22||2 x AMD Opteron 250||1 core/CPU||2 GiB||data-sort-value="68"|73 GB HDD||data-sort-value="1000"|1 Gbps ||
|[[#sagittaire|sagittaire]]||default||2006-07-01||22||2 x AMD Opteron 250||1 core/CPU||2 GiB||data-sort-value="68"|73 GB HDD||data-sort-value="1000"|1 Gbps ||
|-
|-
|[[#taurus|taurus]]||default||2012-09-14||14||2 x Intel Xeon E5-2630||6 cores/CPU||32 GiB||data-sort-value="557"|598 GB HDD||data-sort-value="10000"|10 Gbps ||
|[[#taurus|taurus]]||default||2012-09-14||15||2 x Intel Xeon E5-2630||6 cores/CPU||32 GiB||data-sort-value="557"|598 GB HDD||data-sort-value="10000"|10 Gbps ||


|}
|}
Line 37: Line 37:
== gemini ==
== gemini ==


'''2 nodes, 4 cpus, 80 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json])
'''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json])
; gemini-1 (1 node, 2 cpus, 40 cores)
{|
{|
|-
|-
Line 56: Line 55:
|  
|  
* 480&nbsp;GB SSD SAS Samsung SAMSUNG MZ7KM480  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0) <br />
* 480&nbsp;GB SSD SAS Samsung SAMSUNG MZ7KM480  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0) <br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0) [[Disk_reservation|(reservable)]]<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0) [[Disk_reservation|(reservable)]]<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0) [[Disk_reservation|(reservable)]]<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0) [[Disk_reservation|(reservable)]]<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br />
* <span style="color:grey">ib1, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib2, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib3, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 8&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100<br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
; gemini-2 (1 node, 2 cpus, 40 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Nvidia DGX-1<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2019-09-01<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2&nbsp;CPUs/node, 20&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 512&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* 480&nbsp;GB SSD SAS Samsung SAMSUNG MZ7KM480  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0) <br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0) [[Disk_reservation|(reservable)]]<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0) [[Disk_reservation|(reservable)]]<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0) [[Disk_reservation|(reservable)]]<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0) [[Disk_reservation|(reservable)]]<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0) [[Disk_reservation|(reservable)]]<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0) [[Disk_reservation|(reservable)]]<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0) [[Disk_reservation|(reservable)]]<br/>
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0) [[Disk_reservation|(reservable)]]<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 106: Line 67:
* <span style="color:grey">ib1, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib1, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib2, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib2, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib3, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/>
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
Line 292: Line 253:
== taurus ==
== taurus ==


'''14 nodes, 28 cpus, 168 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json])
'''15 nodes, 30 cpus, 180 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json])
{|
{|
|-
|-
Line 319: Line 280:
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2019-11-12 ([https://github.com/grid5000/reference-repository/commit/818dcf770 commit 818dcf770])</small>''
|}''<small>Last generated from the Grid'5000 Reference API on 2019-12-05 ([https://github.com/grid5000/reference-repository/commit/58a5ed7f6 commit 58a5ed7f6])</small>''

Revision as of 13:32, 5 December 2019

Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia

Summary

6 clusters, 70 nodes, 768 cores, 10.9 TFLOPS

Cluster Queue Date of arrival Nodes CPU Cores Memory Storage Network Accelerators
gemini default 2019-09-01 2 2 x Intel Xeon E5-2698 v4 20 cores/CPU 512 GiB 480 GB SSD + 4 x 1.92 TB SSD 10 Gbps + 100 Gbps InfiniBand 8 x Nvidia Tesla V100
hercule default 2012-10-02 4 2 x Intel Xeon E5-2620 6 cores/CPU 32 GiB 3 x 2.0 TB HDD 10 Gbps 
nova default 2016-12-01 23 2 x Intel Xeon E5-2620 v4 8 cores/CPU 64 GiB 598 GB HDD 10 Gbps 
orion default 2012-09-14 4 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps  Nvidia Tesla M2075
sagittaire default 2006-07-01 22 2 x AMD Opteron 250 1 core/CPU 2 GiB 73 GB HDD 1 Gbps 
taurus default 2012-09-14 15 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps 

Cluster details

gemini

2 nodes, 4 cpus, 80 cores (json)

Model: Nvidia DGX-1
Date of arrival: 2019-09-01
CPU: Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU)
Memory: 512 GiB
Storage:
  • 480 GB SSD SAS Samsung SAMSUNG MZ7KM480 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0) (reservable)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0) (reservable)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0) (reservable)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0) (reservable)
Network:
  • eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe
  • eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment
  • ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
  • ib2, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
  • ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 8 x Nvidia Tesla V100

hercule

4 nodes, 8 cpus, 48 cores (json)

Model: Dell PowerEdge C6220
Date of arrival: 2012-10-02
CPU: Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage:
  • 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)
  • 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-2)
  • 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-3)
Network:
  • eth0/enp130s0f0, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment
  • eth1/enp130s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

nova

23 nodes, 46 cpus, 368 cores (json)

Model: Dell PowerEdge R430
Date of arrival: 2016-12-01
CPU: Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2 CPUs/node, 8 cores/CPU)
Memory: 64 GiB
Storage: 598 GB HDD SCSI Dell (Raid) PERC H330 Mini (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0)
Network:
  • eth0/enp5s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe
  • eth1/enp5s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth3/eno2, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth4/eno3, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/eno4, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment

orion

4 nodes, 8 cpus, 48 cores (json)

Model: Dell PowerEdge R720
Date of arrival: 2012-09-14
CPU: Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage: 598 GB HDD SCSI Dell (Raid) PERC H710 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)
Network:
  • eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe
  • eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: Nvidia Tesla M2075

sagittaire

22 nodes, 44 cpus, 44 cores, split as follows due to differences between nodes (json)

sagittaire-[1,7,17,24] (4 nodes, 8 cpus, 8 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: 73 GB HDD SCSI Fujitsu MAT3073NC (driver: mptspi, path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3
sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: 73 GB HDD SCSI Seagate ST373307LC (driver: mptspi, path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3
sagittaire-[2-6,13-16,18-20,27,29-31] (16 nodes, 32 cpus, 32 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: 73 GB HDD SCSI Seagate ST373207LC (driver: mptspi, path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3

taurus

15 nodes, 30 cpus, 180 cores (json)

Model: Dell PowerEdge R720
Date of arrival: 2012-09-14
CPU: Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage: 598 GB HDD SCSI Dell (Raid) PERC H710 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)
Network:
  • eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe
  • eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

Last generated from the Grid'5000 Reference API on 2019-12-05 (commit 58a5ed7f6)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Lyon:Hardware&oldid=82542"