Difference between revisions of "Lyon:Hardware"

From Grid5000
Jump to: navigation, search
 
(30 intermediate revisions by 9 users not shown)
Line 1: Line 1:
 
__NOTOC__
 
__NOTOC__
 
__NOEDITSECTION__
 
__NOEDITSECTION__
 +
{{Portal|User}}
 
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>
 
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>
  
 
= Summary =
 
= Summary =
'''5 clusters, 79 nodes, 720 cores, 10.1 TFLOPS'''
+
'''7 clusters, 72 nodes, 1010 cores, 24.6 TFLOPS'''
 
{|class="wikitable sortable"
 
{|class="wikitable sortable"
 
|-
 
|-
 
!|Cluster
 
!|Cluster
!|Queue
+
!|Access Condition
 
!|Date of arrival
 
!|Date of arrival
 
!data-sort-type="number"|Nodes
 
!data-sort-type="number"|Nodes
Line 18: Line 19:
 
!|Accelerators
 
!|Accelerators
 
|-
 
|-
|[[#hercule|hercule]]||default||2012-10-02||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620||6&nbsp;cores/CPU||32&nbsp;GB||data-sort-value="5589"|3&nbsp;x&nbsp;1.819&nbsp;TB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
+
|[[#gemini|gemini]]||||2019-09-01||2||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2698&nbsp;v4||20&nbsp;cores/CPU||512&nbsp;GiB||data-sort-value="7599"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;4&nbsp;x&nbsp;1.92&nbsp;TB&nbsp;SSD[[Disk_reservation|*]]||data-sort-value="310000"|10&nbsp;Gbps&nbsp;+&nbsp;3&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||8&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100
 
|-
 
|-
|[[#nova|nova]]||default||2016-12-01||23||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620&nbsp;v4||8&nbsp;cores/CPU||64&nbsp;GB||data-sort-value="557"|557&nbsp;GB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
+
|[[#hercule|hercule]]||||2012-10-02||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620||6&nbsp;cores/CPU||32&nbsp;GiB||data-sort-value="5589"|<b>1&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD</b> +&nbsp;2&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
 
|-
 
|-
|[[#orion|orion]]||default||2012-09-14||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2630||6&nbsp;cores/CPU||32&nbsp;GB||data-sort-value="557"|557&nbsp;GB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||Nvidia Tesla&nbsp;M2075
+
|[[#nova|nova]]||||2016-12-01||23||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620&nbsp;v4||8&nbsp;cores/CPU||64&nbsp;GiB||data-sort-value="557"|<b>598&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
 
|-
 
|-
|[[#sagittaire|sagittaire]]||default||2006-07-01||32||2&nbsp;x&nbsp;AMD&nbsp;Opteron&nbsp;250||1&nbsp;core/CPU||2&nbsp;GB||data-sort-value="68"|68&nbsp;GB&nbsp;HDD||data-sort-value="1000"|1&nbsp;Gbps&nbsp;||
+
|[[#orion|orion]]||||2012-09-14||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2630||6&nbsp;cores/CPU||32&nbsp;GiB||data-sort-value="557"|<b>598&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||Nvidia Tesla&nbsp;M2075
 
|-
 
|-
|[[#taurus|taurus]]||default||2012-09-14||16||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2630||6&nbsp;cores/CPU||32&nbsp;GB||data-sort-value="557"|557&nbsp;GB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
+
|[[#pyxis|pyxis]]||<b>exotic</b>&nbsp;job&nbsp;type||2020-01-06||4||2&nbsp;x&nbsp;ThunderX2&nbsp;99xx||32&nbsp;cores/CPU||256&nbsp;GiB||data-sort-value="464"|<b>1&nbsp;x&nbsp;250&nbsp;GB&nbsp;HDD</b> +&nbsp;1&nbsp;x&nbsp;250&nbsp;GB&nbsp;HDD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||
 +
|-
 +
|[[#sagittaire|sagittaire]]||||2006-07-01||21||2&nbsp;x&nbsp;AMD&nbsp;Opteron&nbsp;250||1&nbsp;core/CPU||2&nbsp;GiB||data-sort-value="68"|<b>73&nbsp;GB&nbsp;HDD</b>||data-sort-value="1000"|1&nbsp;Gbps&nbsp;||
 +
|-
 +
|[[#taurus|taurus]]||||2012-09-14||14||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2630||6&nbsp;cores/CPU||32&nbsp;GiB||data-sort-value="557"|<b>598&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
  
 
|}
 
|}
 +
''*: disk is [[Disk_reservation|reservable]]''
 +
= Cluster details =
 +
 +
== gemini ==
  
= Cluster details =
+
'''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json])
 +
{|
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
 +
| Nvidia DGX-1<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
 +
| 2019-09-01<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 +
| Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2&nbsp;CPUs/node, 20&nbsp;cores/CPU)<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 +
| 512&nbsp;GiB<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 +
|
 +
* 480&nbsp;GB SSD SAS Samsung SAMSUNG MZ7KM480 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0)  (primary disk)<br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0) [[Disk_reservation|(reservable)]] <br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0) [[Disk_reservation|(reservable)]] <br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0) [[Disk_reservation|(reservable)]] <br />
 +
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0) [[Disk_reservation|(reservable)]] <br />
 +
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 +
|
 +
* eth0/enp1s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe<br />
 +
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br />
 +
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br />
 +
* ib1, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br />
 +
* ib2, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br />
 +
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
 +
| 8&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100-SXM2-32GB<br/>
 +
|-
 +
|}
  
 
== hercule ==
 
== hercule ==
Line 44: Line 89:
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5-2620 Sandy Bridge 2.00GHz (2&nbsp;CPUs/node, 6&nbsp;cores/CPU)<br/>
+
| Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2&nbsp;CPUs/node, 6&nbsp;cores/CPU)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 32&nbsp;GB<br/>
+
| 32&nbsp;GiB<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
|  
 
|  
* 1.819&nbsp;TB HDD SATA WDC WD2003FYYS-1 (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br />
+
* 2.0&nbsp;TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)  (primary disk)<br />
* 1.819&nbsp;TB HDD SATA WDC WD2003FYYS-1 (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-2)<br />
+
* 2.0&nbsp;TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-2) <br />
* 1.819&nbsp;TB HDD SATA WDC WD2003FYYS-1 (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-3)<br/>
+
* 2.0&nbsp;TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/sdc, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-3) <br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 76: Line 121:
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5-2620 v4 Broadwell 2.10GHz (2&nbsp;CPUs/node, 8&nbsp;cores/CPU)<br/>
+
| Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2&nbsp;CPUs/node, 8&nbsp;cores/CPU)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 64&nbsp;GB<br/>
+
| 64&nbsp;GiB<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
557&nbsp;GB HDD SCSI PERC H330 Mini (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0)<br/>
+
598&nbsp;GB HDD SCSI Dell (Raid) PERC H330 Mini (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0)  (primary disk)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 107: Line 152:
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5-2630 Sandy Bridge 2.30GHz (2&nbsp;CPUs/node, 6&nbsp;cores/CPU)<br/>
+
| Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2&nbsp;CPUs/node, 6&nbsp;cores/CPU)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 32&nbsp;GB<br/>
+
| 32&nbsp;GiB<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
557&nbsp;GB HDD SCSI PERC H710 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)<br/>
+
598&nbsp;GB HDD SCSI Dell (Raid) PERC H710 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)  (primary disk)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 126: Line 171:
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
 
| Nvidia Tesla&nbsp;M2075<br/>
 
| Nvidia Tesla&nbsp;M2075<br/>
 +
|-
 +
|}
 +
 +
== pyxis (exotic job type) ==
 +
 +
'''4 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/pyxis/nodes.json?pretty=1 json])
 +
{|
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
 +
| R181-T92-00<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
 +
| 2020-01-06<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 +
| ThunderX2 99xx (Vulcan, 2&nbsp;CPUs/node, 32&nbsp;cores/CPU)<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 +
| 256&nbsp;GiB<br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 +
|
 +
* 250&nbsp;GB HDD SAS Samsung Samsung SSD 860 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy2-lun-0)  (primary disk)<br />
 +
* 250&nbsp;GB HDD SAS Samsung Samsung SSD 860 (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy3-lun-0)  <br/>
 +
|-
 +
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 +
|
 +
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede<br />
 +
* <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br />
 +
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/>
 
|-
 
|-
 
|}
 
|}
Line 131: Line 206:
 
== sagittaire ==
 
== sagittaire ==
  
'''32 nodes, 64 cpus, 64 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json])
+
'''21 nodes, 42 cpus, 42 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json])
; sagittaire-[1,<wbr>7,<wbr>17,<wbr>24,<wbr>32-34,<wbr>44,<wbr>48] (9 nodes, 18 cpus, 18 cores)
+
; sagittaire-[1,<wbr>17,<wbr>24] (3 nodes, 6 cpus, 6 cores)
 
{|
 
{|
 
|-
 
|-
Line 142: Line 217:
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD Opteron 250 K8 (2&nbsp;CPUs/node, 1&nbsp;core/CPU)<br/>
+
| AMD Opteron 250 (K8, 2&nbsp;CPUs/node, 1&nbsp;core/CPU)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 2&nbsp;GB<br/>
+
| 2&nbsp;GiB<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
68&nbsp;GB HDD SCSI MAT3073NC (driver: mptspi, path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)<br/>
+
73&nbsp;GB HDD SCSI Fujitsu MAT3073NC (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)  (primary disk)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 168: Line 243:
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD Opteron 250 K8 (2&nbsp;CPUs/node, 1&nbsp;core/CPU)<br/>
+
| AMD Opteron 250 (K8, 2&nbsp;CPUs/node, 1&nbsp;core/CPU)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 2&nbsp;GB<br/>
+
| 2&nbsp;GiB<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
68&nbsp;GB HDD SCSI ST373307LC (driver: mptspi, path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)<br/>
+
73&nbsp;GB HDD SCSI Seagate ST373307LC (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)  (primary disk)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 184: Line 259:
 
<hr style="height:10pt; visibility:hidden;" />
 
<hr style="height:10pt; visibility:hidden;" />
  
; sagittaire-[2-6,<wbr>13-16,<wbr>18-20,<wbr>27,<wbr>29-31,<wbr>43,<wbr>47,<wbr>49-51] (21 nodes, 42 cpus, 42 cores)
+
; sagittaire-[2-6,<wbr>13-16,<wbr>18-20,<wbr>27,<wbr>29-31] (16 nodes, 32 cpus, 32 cores)
 
{|
 
{|
 
|-
 
|-
Line 194: Line 269:
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD Opteron 250 K8 (2&nbsp;CPUs/node, 1&nbsp;core/CPU)<br/>
+
| AMD Opteron 250 (K8, 2&nbsp;CPUs/node, 1&nbsp;core/CPU)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 2&nbsp;GB<br/>
+
| 2&nbsp;GiB<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
68&nbsp;GB HDD SCSI ST373207LC (driver: mptspi, path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)<br/>
+
73&nbsp;GB HDD SCSI Seagate ST373207LC (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)  (primary disk)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 211: Line 286:
 
== taurus ==
 
== taurus ==
  
'''16 nodes, 32 cpus, 192 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json])
+
'''14 nodes, 28 cpus, 168 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json])
 
{|
 
{|
 
|-
 
|-
Line 221: Line 296:
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5-2630 Sandy Bridge 2.30GHz (2&nbsp;CPUs/node, 6&nbsp;cores/CPU)<br/>
+
| Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2&nbsp;CPUs/node, 6&nbsp;cores/CPU)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 32&nbsp;GB<br/>
+
| 32&nbsp;GiB<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
557&nbsp;GB HDD SCSI PERC H710 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)<br/>
+
598&nbsp;GB HDD SCSI Dell (Raid) PERC H710 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)  (primary disk)<br/>
 
|-
 
|-
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
 
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 238: Line 313:
 
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
 
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
 
|-
 
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2018-06-13 ([https://github.com/grid5000/reference-repository/commit/6f2c1f77b commit 6f2c1f77b])</small>''
+
|}''<small>Last generated from the Grid'5000 Reference API on 2020-11-24 ([https://github.com/grid5000/reference-repository/commit/beb59ebee commit beb59ebee])</small>''

Latest revision as of 19:48, 24 November 2020

Summary

7 clusters, 72 nodes, 1010 cores, 24.6 TFLOPS

Cluster Access Condition Date of arrival Nodes CPU Cores Memory Storage Network Accelerators
gemini 2019-09-01 2 2 x Intel Xeon E5-2698 v4 20 cores/CPU 512 GiB 480 GB SSD + 4 x 1.92 TB SSD* 10 Gbps + 3 x 100 Gbps InfiniBand 8 x Nvidia Tesla V100
hercule 2012-10-02 4 2 x Intel Xeon E5-2620 6 cores/CPU 32 GiB 1 x 2.0 TB HDD + 2 x 2.0 TB HDD 10 Gbps 
nova 2016-12-01 23 2 x Intel Xeon E5-2620 v4 8 cores/CPU 64 GiB 598 GB HDD 10 Gbps 
orion 2012-09-14 4 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps  Nvidia Tesla M2075
pyxis exotic job type 2020-01-06 4 2 x ThunderX2 99xx 32 cores/CPU 256 GiB 1 x 250 GB HDD + 1 x 250 GB HDD 10 Gbps + 100 Gbps InfiniBand
sagittaire 2006-07-01 21 2 x AMD Opteron 250 1 core/CPU 2 GiB 73 GB HDD 1 Gbps 
taurus 2012-09-14 14 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps 

*: disk is reservable

Cluster details

gemini

2 nodes, 4 cpus, 80 cores (json)

Model: Nvidia DGX-1
Date of arrival: 2019-09-01
CPU: Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU)
Memory: 512 GiB
Storage:
  • 480 GB SSD SAS Samsung SAMSUNG MZ7KM480 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0) (primary disk)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0) (reservable)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0) (reservable)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0) (reservable)
  • 1.92 TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0) (reservable)

*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier

Network:
  • eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe
  • eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment
  • ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • ib2, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 8 x Nvidia Tesla V100-SXM2-32GB

hercule

4 nodes, 8 cpus, 48 cores (json)

Model: Dell PowerEdge C6220
Date of arrival: 2012-10-02
CPU: Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage:
  • 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1) (primary disk)
  • 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-2)
  • 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/sdc, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-3)
Network:
  • eth0/enp130s0f0, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment
  • eth1/enp130s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

nova

23 nodes, 46 cpus, 368 cores (json)

Model: Dell PowerEdge R430
Date of arrival: 2016-12-01
CPU: Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2 CPUs/node, 8 cores/CPU)
Memory: 64 GiB
Storage: 598 GB HDD SCSI Dell (Raid) PERC H330 Mini (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0) (primary disk)
Network:
  • eth0/enp5s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe
  • eth1/enp5s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth3/eno2, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth4/eno3, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/eno4, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment

orion

4 nodes, 8 cpus, 48 cores (json)

Model: Dell PowerEdge R720
Date of arrival: 2012-09-14
CPU: Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage: 598 GB HDD SCSI Dell (Raid) PERC H710 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0) (primary disk)
Network:
  • eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe
  • eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: Nvidia Tesla M2075

pyxis (exotic job type)

4 nodes, 8 cpus, 256 cores (json)

Model: R181-T92-00
Date of arrival: 2020-01-06
CPU: ThunderX2 99xx (Vulcan, 2 CPUs/node, 32 cores/CPU)
Memory: 256 GiB
Storage:
  • 250 GB HDD SAS Samsung Samsung SSD 860 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy2-lun-0) (primary disk)
  • 250 GB HDD SAS Samsung Samsung SSD 860 (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy3-lun-0)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede
  • eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment
  • ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core

sagittaire

21 nodes, 42 cpus, 42 cores, split as follows due to differences between nodes (json)

sagittaire-[1,17,24] (3 nodes, 6 cpus, 6 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: 73 GB HDD SCSI Fujitsu MAT3073NC (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3

sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: 73 GB HDD SCSI Seagate ST373307LC (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3

sagittaire-[2-6,13-16,18-20,27,29-31] (16 nodes, 32 cpus, 32 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: 73 GB HDD SCSI Seagate ST373207LC (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3

taurus

14 nodes, 28 cpus, 168 cores (json)

Model: Dell PowerEdge R720
Date of arrival: 2012-09-14
CPU: Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage: 598 GB HDD SCSI Dell (Raid) PERC H710 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0) (primary disk)
Network:
  • eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe
  • eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
Last generated from the Grid'5000 Reference API on 2020-11-24 (commit beb59ebee)