Difference between revisions of "Lyon:Hardware"

From Grid5000
Jump to: navigation, search
Line 19: Line 19:
 
!|Accelerators
 
!|Accelerators
 
|-
 
|-
|[[#gemini_.28testing_queue.29|gemini]]||testing||2019-09-01||2||2 x Intel Xeon E5-2698 v4||20 cores/CPU||512 GiB||data-sort-value="7597"|479 GB HDD + 7.68 TB HDD||data-sort-value="10000"|10 Gbps ||8 x Nvidia Tesla V100
+
|[[#gemini_.28testing_queue.29|gemini]]||testing||2019-09-01||2||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2698&nbsp;v4||20&nbsp;cores/CPU||512&nbsp;GiB||data-sort-value="7599"|480&nbsp;GB&nbsp;SSD +&nbsp;4&nbsp;x&nbsp;1.92&nbsp;TB&nbsp;SSD||data-sort-value="10000"|1: InfiniBand+&nbsp;10&nbsp;Gbps&nbsp;<br />2: 10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||8&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100
 
|-
 
|-
 
|[[#hercule|hercule]]||default||2012-10-02||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620||6&nbsp;cores/CPU||32&nbsp;GiB||data-sort-value="5589"|3&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
 
|[[#hercule|hercule]]||default||2012-10-02||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620||6&nbsp;cores/CPU||32&nbsp;GiB||data-sort-value="5589"|3&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
Line 37: Line 37:
 
== gemini (testing queue) ==
 
== gemini (testing queue) ==
  
'''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json])
+
'''2 nodes, 4 cpus, 80 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json])
 +
; gemini-1 (1 node, 2 cpus, 40 cores)
 
{|
 
{|
 
|-
 
|-
Line 54: Line 55:
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
|  
 
|  
* 479&nbsp;GB HDD SCSI Avago MRROMB (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:2:0:0)<br />
+
* 480&nbsp;GB SSD SAS Samsung SAMSUNG MZ7KM480 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0)<br />
* 7.68&nbsp;TB HDD SCSI Avago MRROMB (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:2:1:0)<br/>
+
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0)<br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0)<br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0)<br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 
|  
 
|  
 
* eth0/enp1s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe<br />
 
* eth0/enp1s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br/>
+
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br />
 +
* ib0, InfiniBand, configured rate: , model: N/A, <br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
 +
| 8&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100<br/>
 +
|-
 +
|}
 +
<hr style="height:10pt; visibility:hidden;" />
 +
 
 +
; gemini-2 (1 node, 2 cpus, 40 cores)
 +
{|
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
 +
| Nvidia DGX-1<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
 +
| 2019-09-01<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 +
| Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2&nbsp;CPUs/node, 20&nbsp;cores/CPU)<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 +
| 512&nbsp;GiB<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 +
|
 +
* 480&nbsp;GB SSD SAS Samsung SAMSUNG MZ7KM480  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0)<br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0)<br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0)<br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0)<br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0)<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 +
|
 +
* eth0/enp1s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe<br />
 +
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br />
 +
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], <br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
Line 273: Line 313:
 
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
 
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
 
|-
 
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2019-10-14 ([https://github.com/grid5000/reference-repository/commit/c8a793501 commit c8a793501])</small>''
+
|}''<small>Last generated from the Grid'5000 Reference API on 2019-10-16 ([https://github.com/grid5000/reference-repository/commit/046776314 commit 046776314])</small>''

Revision as of 17:58, 16 October 2019

Summary

6 clusters, 78 nodes, 774 cores, 9.8 TFLOPS

Cluster Queue Date of arrival Nodes CPU Cores Memory Storage Network Accelerators
gemini testing 2019-09-01 2 2 x Intel Xeon E5-2698 v4 20 cores/CPU 512 GiB 480 GB SSD + 4 x 1.92 TB SSD 1: InfiniBand+ 10 Gbps 
2: 10 Gbps + 100 Gbps InfiniBand
8 x Nvidia Tesla V100
hercule default 2012-10-02 4 2 x Intel Xeon E5-2620 6 cores/CPU 32 GiB 3 x 2.0 TB HDD 10 Gbps 
nova default 2016-12-01 23 2 x Intel Xeon E5-2620 v4 8 cores/CPU 64 GiB 598 GB HDD 10 Gbps 
orion default 2012-09-14 4 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps  Nvidia Tesla M2075
sagittaire default 2006-07-01 31 2 x AMD Opteron 250 1 core/CPU 2 GiB 73 GB HDD 1 Gbps 
taurus default 2012-09-14 14 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps 

Cluster details

gemini (testing queue)

2 nodes, 4 cpus, 80 cores, split as follows due to differences between nodes (json)

gemini-1 (1 node, 2 cpus, 40 cores)
Model: Nvidia DGX-1
Date of arrival: 2019-09-01
CPU: Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU)
Memory: 512 GiB
Storage:
  • 480 GB SSD SAS Samsung SAMSUNG MZ7KM480 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0)
Network:
  • eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe
  • eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment
  • ib0, InfiniBand, configured rate: , model: N/A,
GPU: 8 x Nvidia Tesla V100

gemini-2 (1 node, 2 cpus, 40 cores)
Model: Nvidia DGX-1
Date of arrival: 2019-09-01
CPU: Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU)
Memory: 512 GiB
Storage:
  • 480 GB SSD SAS Samsung SAMSUNG MZ7KM480 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0)
Network:
  • eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe
  • eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment
  • ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5],
GPU: 8 x Nvidia Tesla V100

hercule

4 nodes, 8 cpus, 48 cores (json)

Model: Dell PowerEdge C6220
Date of arrival: 2012-10-02
CPU: Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage:
  • 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)
  • 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-2)
  • 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-3)
Network:
  • eth0/enp130s0f0, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment
  • eth1/enp130s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

nova

23 nodes, 46 cpus, 368 cores (json)

Model: Dell PowerEdge R430
Date of arrival: 2016-12-01
CPU: Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2 CPUs/node, 8 cores/CPU)
Memory: 64 GiB
Storage: 598 GB HDD SCSI Dell (Raid) PERC H330 Mini (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0)
Network:
  • eth0/enp5s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe
  • eth1/enp5s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth3/eno2, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth4/eno3, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/eno4, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment

orion

4 nodes, 8 cpus, 48 cores (json)

Model: Dell PowerEdge R720
Date of arrival: 2012-09-14
CPU: Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage: 598 GB HDD SCSI Dell (Raid) PERC H710 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)
Network:
  • eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe
  • eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: Nvidia Tesla M2075

sagittaire

31 nodes, 62 cpus, 62 cores, split as follows due to differences between nodes (json)

sagittaire-[1,7,17,24,32-34,44,48] (9 nodes, 18 cpus, 18 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: 73 GB HDD SCSI Fujitsu MAT3073NC (driver: mptspi, path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3

sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: 73 GB HDD SCSI Seagate ST373307LC (driver: mptspi, path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3

sagittaire-[2-6,13-16,18-20,27,29-31,43,49-51] (20 nodes, 40 cpus, 40 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: 73 GB HDD SCSI Seagate ST373207LC (driver: mptspi, path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3

taurus

14 nodes, 28 cpus, 168 cores (json)

Model: Dell PowerEdge R720
Date of arrival: 2012-09-14
CPU: Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage: 598 GB HDD SCSI Dell (Raid) PERC H710 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)
Network:
  • eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe
  • eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
Last generated from the Grid'5000 Reference API on 2019-10-16 (commit 046776314)