Grenoble:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
(30 intermediate revisions by 11 users not shown)
Line 1: Line 1:
__NOTOC__
__NOTOC__
__NOEDITSECTION__
__NOEDITSECTION__
{{Portal|User}}
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>


= Summary =
= Summary =
'''3 clusters, 103 nodes, 1048 cores, 5.3 TFLOPS'''
'''3 clusters, 40 nodes, 1408 cores, 19.0 TFLOPS'''
{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
!|Cluster
!|Cluster
!|Queue
!|Access Condition
!|Date of arrival
!|Date of arrival
!data-sort-type="number"|Nodes
!data-sort-type="number"|Nodes
Line 17: Line 18:
!data-sort-type="number"|Network
!data-sort-type="number"|Network
|-
|-
|[[#edel|edel]]||default||2008-10-03||68||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5520||4&nbsp;cores/CPU||24&nbsp;GB||data-sort-value="119"|[1,<wbr>5-6,<wbr>8-9,<wbr>12,<wbr>15-16,<wbr>19,<wbr>21,<wbr>23-25,<wbr>28-29,<wbr>32,<wbr>35,<wbr>37,<wbr>39-43,<wbr>46,<wbr>48-50,<wbr>52,<wbr>55-57,<wbr>59,<wbr>62-63,<wbr>65-72]: 119&nbsp;GB&nbsp;SSD<br />[2-4,<wbr>7,<wbr>10-11,<wbr>13-14,<wbr>17-18,<wbr>20,<wbr>22,<wbr>26,<wbr>30-31,<wbr>33-34,<wbr>36,<wbr>38,<wbr>44,<wbr>47,<wbr>51,<wbr>53,<wbr>58,<wbr>60,<wbr>64]: 59&nbsp;GB&nbsp;SSD||data-sort-value="41000"|1&nbsp;Gbps&nbsp;+&nbsp;40&nbsp;Gbps&nbsp;InfiniBand
|[[#dahu|dahu]]||||2018-03-22||32||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;Gold&nbsp;6130||16&nbsp;cores/CPU||192&nbsp;GiB||data-sort-value="4396"|<b>240&nbsp;GB&nbsp;SSD</b> +&nbsp;480&nbsp;GB&nbsp;SSD +&nbsp;4.0&nbsp;TB&nbsp;HDD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path
|-
|-
|[[#genepi|genepi]]||default||2008-10-01||31||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5420||4&nbsp;cores/CPU||8&nbsp;GB||data-sort-value="153"|153&nbsp;GB&nbsp;HDD||data-sort-value="21000"|1&nbsp;Gbps&nbsp;+&nbsp;20&nbsp;Gbps&nbsp;InfiniBand
|[[#troll|troll]]||||2019-12-23||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;Gold&nbsp;5218||16&nbsp;cores/CPU||384&nbsp;GiB + 1.5&nbsp;TiB PMEM||data-sort-value="1937"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path
|-
|-
|[[#yeti_.28testing_queue.29|yeti]]||testing||2018-01-16||4||4&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;Gold&nbsp;6130||16&nbsp;cores/CPU||768&nbsp;GB||data-sort-value="6032"|446&nbsp;GB&nbsp;SSD +&nbsp;3&nbsp;x&nbsp;1.819&nbsp;TB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;
|[[#yeti|yeti]]||||2018-01-16||4||4&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;Gold&nbsp;6130||16&nbsp;cores/CPU||768&nbsp;GiB||data-sort-value="7526"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;3&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD +&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path


|}
|}
Line 27: Line 28:
= Cluster details =
= Cluster details =


== edel ==
== dahu ==


'''68 nodes, 136 cpus, 544 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/edel/nodes.json?pretty=1 json])
'''32 nodes, 64 cpus, 1024 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/dahu/nodes.json?pretty=1 json])
; edel-[1,<wbr>5-6,<wbr>16,<wbr>37,<wbr>42] (6 nodes, 12 cpus, 48 cores)
{|
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
| Dell PowerEdge C6420<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
| 2018-03-22<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 Nehalem  2.27GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
| 192&nbsp;GiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  119&nbsp;GB SSD SATA C400-MTFDDAA128M  (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* 240&nbsp;GB SSD SATA Samsung MZ7KM240HMHQ0D3  (path: /dev/disk/by-path/pci-0000:00:11.5-ata-3)  (primary disk)<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, configured rate: n/c, model: Intel 82576 Gigabit Network Connection, driver: igb- unavailable for experiment</span><br />
* 480&nbsp;GB SSD SATA Samsung MZ7KM480HMHQ0D3  (path: /dev/disk/by-path/pci-0000:00:11.5-ata-4) <br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* 4.0&nbsp;TB HDD SATA Seagate ST4000NM0265-2DC (path: /dev/disk/by-path/pci-0000:00:11.5-ata-5) <br/>
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, driver: mlx4_core- unavailable for experiment</span><br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
 
; edel-[2] (1 node, 2 cpus, 8 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 Nehalem  2.27GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C400-MTFDDAA064M (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, configured rate: n/c, model: Intel 82576 Gigabit Network Connection, driver: igb- unavailable for experiment</span><br />
* <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, driver: mlx4_core- unavailable for experiment</span><br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />


; edel-[3,<wbr>7,<wbr>10-11,<wbr>13-14,<wbr>22,<wbr>26,<wbr>30,<wbr>36,<wbr>38,<wbr>44,<wbr>47,<wbr>51,<wbr>53,<wbr>58,<wbr>60,<wbr>64] (18 nodes, 36 cpus, 144 cores)
== troll ==
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 Nehalem  2.27GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C400-MTFDDAA064M  (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, configured rate: n/c, model: Intel 82576 Gigabit Network Connection, driver: igb- unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core- unavailable for experiment</span><br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />


; edel-[8-9,<wbr>12,<wbr>15,<wbr>19,<wbr>21,<wbr>23,<wbr>28-29,<wbr>32,<wbr>39-40,<wbr>43,<wbr>48-49,<wbr>52,<wbr>55-57,<wbr>59,<wbr>62,<wbr>65-69,<wbr>71] (27 nodes, 54 cpus, 216 cores)
'''4 nodes, 8 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/troll/nodes.json?pretty=1 json])
{|
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
| Dell PowerEdge R640<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
| 2019-12-23<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 Nehalem  2.27GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 5218 (Cascade Lake-SP, 2.30GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
| 384&nbsp;GiB + 1.5&nbsp;TiB PMEM<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  119&nbsp;GB SSD SATA C400-MTFDDAA128M  (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* 480&nbsp;GB SSD SATA Micron MTFDDAK480TDN  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0)  (primary disk)<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, configured rate: n/c, model: Intel 82576 Gigabit Network Connection, driver: igb- unavailable for experiment</span><br />
* 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (path: /dev/disk/by-path/pci-0000:d8:00.0-nvme-1) <br/>
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core- unavailable for experiment</span><br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
 
; edel-[17,<wbr>34] (2 nodes, 4 cpus, 16 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 Nehalem 2.27GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C300-MTFDDAA064M (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, configured rate: n/c, model: Intel 82576 Gigabit Network Connection, driver: igb- unavailable for experiment</span><br />
* <span style="color:grey">eth1/eno2, Ethernet, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core- unavailable for experiment</span><br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />


; edel-[4,<wbr>18,<wbr>31,<wbr>33] (4 nodes, 8 cpus, 32 cores)
== yeti ==
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 Nehalem  2.27GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C400-MTFDDAA064M  (driver: ahci, path: node-was-not-available-to-retrieve-this-value)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, configured rate: n/c, model: Intel 82576 Gigabit Network Connection, driver: igb- unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: N/A N/A, driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, driver: mlx4_core- unavailable for experiment</span><br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />


; edel-[20] (1 node, 2 cpus, 8 cores)
'''4 nodes, 16 cpus, 256 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/yeti/nodes.json?pretty=1 json])
; yeti-[1-2,<wbr>4] (3 nodes, 12 cpus, 192 cores)
{|
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
| Dell PowerEdge R940<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
| 2018-01-16<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 Nehalem  2.27GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
| 768&nbsp;GiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C400-MTFDDAA064M  (driver: ahci, path: /dev/disk/by-id/wwn-0x500a07510202c04b)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* 480&nbsp;GB SSD SAS Intel SSDSC2KG480G7R  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0)  (primary disk)<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, configured rate: n/c, model: Intel 82576 Gigabit Network Connection, driver: igb- unavailable for experiment</span><br />
* 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br />
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core- unavailable for experiment</span><br/>
* 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br />
|-
* 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (path: /dev/disk/by-path/pci-0000:6d:00.0-nvme-1) <br/>
|}
<hr style="height:10pt; visibility:hidden;" />
 
; edel-[24,<wbr>41,<wbr>70] (3 nodes, 6 cpus, 24 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 Nehalem  2.27GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  119&nbsp;GB SSD SATA C400-MTFDDAA128M (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, configured rate: n/c, model: Intel 82576 Gigabit Network Connection, driver: igb- unavailable for experiment</span><br />
* <span style="color:grey">eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: N/A N/A, driver: mlx4_core<br />
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, driver: mlx4_core- unavailable for experiment</span><br/>
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />
<hr style="height:10pt; visibility:hidden;" />


; edel-[25,<wbr>35,<wbr>46,<wbr>50,<wbr>63,<wbr>72] (6 nodes, 12 cpus, 48 cores)
; yeti-3 (1 node, 4 cpus, 64 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 Nehalem  2.27GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  119&nbsp;GB SSD SATA C400-MTFDDAA128M  (driver: ahci, path: node-was-not-available-to-retrieve-this-value)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, configured rate: n/c, model: Intel 82576 Gigabit Network Connection, driver: igb- unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: N/A N/A, driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, driver: mlx4_core- unavailable for experiment</span><br/>
|-
|}
 
== genepi ==
 
'''31 nodes, 62 cpus, 248 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/genepi/nodes.json?pretty=1 json])
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull R422-E1<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-01<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5420 Harpertown  2.50GHz (2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 8&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  153&nbsp;GB HDD SATA WDC WD1600YS-01S  (driver: ata_piix, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* <span style="color:grey">eth0/enp5s0f0, Ethernet, configured rate: n/c, model: Intel 80003ES2LAN Gigabit Ethernet Controller (Copper), driver: e1000e- unavailable for experiment</span><br />
* eth1/enp5s0f1, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 80003ES2LAN Gigabit Ethernet Controller (Copper), driver: e1000e<br />
* ib0, InfiniBand, configured rate: 20&nbsp;Gbps, model: Mellanox Technologies MT26418 [ConnectX VPI PCIe 2.0 5GT/s - IB DDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand, configured rate: n/c, model: Mellanox Technologies MT26418 [ConnectX VPI PCIe 2.0 5GT/s - IB DDR / 10GigE], driver: mlx4_core- unavailable for experiment</span><br/>
|-
|}
 
== yeti (testing queue) ==
 
'''4 nodes, 16 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/yeti/nodes.json?pretty=1 json])
{|
{|
|-
|-
Line 322: Line 136:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 Skylake 2.10GHz (4&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 768&nbsp;GB<br/>
| 768&nbsp;GiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* 446&nbsp;GB SSD SAS PERC H740P Adp (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:2:0:0)<br />
* 480&nbsp;GB SSD SAS Intel SSDSC2KG480G8R (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0)  (primary disk)<br />
* 1.819&nbsp;TB HDD SAS PERC H740P Adp (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:2:1:0)<br />
* 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br />
* 1.819&nbsp;TB HDD SAS PERC H740P Adp (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:2:2:0)<br />
* 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br />
* 1.819&nbsp;TB HDD SAS PERC H740P Adp (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:2:3:0)<br/>
* 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br />
* 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC  (path: /dev/disk/by-path/pci-0000:6d:00.0-nvme-1)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/eno113, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/eno114, Ethernet, configured rate: n/c, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e- unavailable for experiment</span><br />
* <span style="color:grey">eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno115, Ethernet, configured rate: n/c, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e- unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno116, Ethernet, configured rate: n/c, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e- unavailable for experiment</span><br/>
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2018-05-19 ([https://github.com/grid5000/reference-repository/commit/6cc091305 commit 6cc091305])</small>''
|}''<small>Last generated from the Grid'5000 Reference API on 2020-06-15 ([https://github.com/grid5000/reference-repository/commit/001f4d421 commit 001f4d421])</small>''

Revision as of 15:56, 15 June 2020

Summary

3 clusters, 40 nodes, 1408 cores, 19.0 TFLOPS

Cluster Access Condition Date of arrival Nodes CPU Cores Memory Storage Network
dahu 2018-03-22 32 2 x Intel Xeon Gold 6130 16 cores/CPU 192 GiB 240 GB SSD + 480 GB SSD + 4.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
troll 2019-12-23 4 2 x Intel Xeon Gold 5218 16 cores/CPU 384 GiB + 1.5 TiB PMEM 480 GB SSD + 1.6 TB SSD 10 Gbps + 100 Gbps Omni-Path
yeti 2018-01-16 4 4 x Intel Xeon Gold 6130 16 cores/CPU 768 GiB 480 GB SSD + 3 x 2.0 TB HDD + 1.6 TB SSD 10 Gbps + 100 Gbps Omni-Path

Cluster details

dahu

32 nodes, 64 cpus, 1024 cores (json)

Model: Dell PowerEdge C6420
Date of arrival: 2018-03-22
CPU: Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2 CPUs/node, 16 cores/CPU)
Memory: 192 GiB
Storage:
  • 240 GB SSD SATA Samsung MZ7KM240HMHQ0D3 (path: /dev/disk/by-path/pci-0000:00:11.5-ata-3) (primary disk)
  • 480 GB SSD SATA Samsung MZ7KM480HMHQ0D3 (path: /dev/disk/by-path/pci-0000:00:11.5-ata-4)
  • 4.0 TB HDD SATA Seagate ST4000NM0265-2DC (path: /dev/disk/by-path/pci-0000:00:11.5-ata-5)
Network:
  • eth0/enp24s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

troll

4 nodes, 8 cpus, 128 cores (json)

Model: Dell PowerEdge R640
Date of arrival: 2019-12-23
CPU: Intel Xeon Gold 5218 (Cascade Lake-SP, 2.30GHz, 2 CPUs/node, 16 cores/CPU)
Memory: 384 GiB + 1.5 TiB PMEM
Storage:
  • 480 GB SSD SATA Micron MTFDDAK480TDN (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (path: /dev/disk/by-path/pci-0000:d8:00.0-nvme-1)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core
  • eth1/eno2, Ethernet, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

yeti

4 nodes, 16 cpus, 256 cores, split as follows due to differences between nodes (json)

yeti-[1-2,4] (3 nodes, 12 cpus, 192 cores)
Model: Dell PowerEdge R940
Date of arrival: 2018-01-16
CPU: Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4 CPUs/node, 16 cores/CPU)
Memory: 768 GiB
Storage:
  • 480 GB SSD SAS Intel SSDSC2KG480G7R (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • 2.0 TB HDD SAS Seagate ST2000NX0463 (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • 2.0 TB HDD SAS Seagate ST2000NX0463 (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • 2.0 TB HDD SAS Seagate ST2000NX0463 (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (path: /dev/disk/by-path/pci-0000:6d:00.0-nvme-1)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

yeti-3 (1 node, 4 cpus, 64 cores)
Model: Dell PowerEdge R940
Date of arrival: 2018-01-16
CPU: Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4 CPUs/node, 16 cores/CPU)
Memory: 768 GiB
Storage:
  • 480 GB SSD SAS Intel SSDSC2KG480G8R (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • 2.0 TB HDD SAS Seagate ST2000NX0463 (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • 2.0 TB HDD SAS Seagate ST2000NX0463 (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • 2.0 TB HDD SAS Seagate ST2000NX0463 (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (path: /dev/disk/by-path/pci-0000:6d:00.0-nvme-1)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

Last generated from the Grid'5000 Reference API on 2020-06-15 (commit 001f4d421)