Grenoble:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
(97 intermediate revisions by 15 users not shown)
Line 1: Line 1:
__NOTOC__
__NOTOC__
__NOEDITSECTION__
__NOEDITSECTION__
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>
{{Portal|User}}
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>
'''See also:''' [[Grenoble:Network|Network topology for Grenoble]]
= Summary =
* 5 clusters
* 54 nodes
* 1744 CPU cores
* 48 GPUs
* 12.25&nbsp;TiB RAM + 6.0&nbsp;TiB PMEM
* 88 SSDs and 68 HDDs on nodes (total: 228.53&nbsp;TB)
* 101.9 TFLOPS (excluding GPUs)


= Summary =
= Clusters =
'''4 clusters, 175 nodes, 3352 cores, 5.3 TFLOPS'''
{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
!|Cluster
!rowspan=2|Cluster
!|Queue
!rowspan=2|Access Condition
!|Date of arrival
!rowspan=2|Date of arrival
!data-sort-type="number"|Nodes
!data-sort-type="number" rowspan=2|Nodes
!|CPU
!colspan=4|CPU
!data-sort-type="number" rowspan=2|Memory
!data-sort-type="number" rowspan=2|Storage
!data-sort-type="number" rowspan=2|Network
!rowspan=2|Accelerators
|-
!data-sort-type="number"|#
!|Name
!data-sort-type="number"|Cores
!data-sort-type="number"|Cores
!data-sort-type="number"|Memory
!|Architecture
!data-sort-type="number"|Storage
!data-sort-type="number"|Network
|-
|-
|[[#dahu_.28testing_queue.29|dahu]]||testing||2018-03-22||72||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;Gold&nbsp;6130||16&nbsp;cores/CPU||192&nbsp;GB||data-sort-value="4396"|[1-68]: 223&nbsp;GB&nbsp;HDD +&nbsp;447&nbsp;GB&nbsp;HDD +&nbsp;3.639&nbsp;TB&nbsp;HDD<br />[69-72]: 2&nbsp;x&nbsp;447&nbsp;GB&nbsp;HDD +&nbsp;3.639&nbsp;TB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;
 
|[[#dahu|dahu]]||||2018-03-22||32||2||Intel Xeon Gold 6130||16&nbsp;cores/CPU||x86_64||192&nbsp;GiB||data-sort-value="4396"|<b>240&nbsp;GB&nbsp;SSD</b> +&nbsp;480&nbsp;GB&nbsp;SSD +&nbsp;4.0&nbsp;TB&nbsp;HDD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|-
|-
|[[#edel|edel]]||default||2008-10-03||68||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5520||4&nbsp;cores/CPU||24&nbsp;GB||data-sort-value="119"|[1,<wbr>5-6,<wbr>8-9,<wbr>12,<wbr>15-16,<wbr>19,<wbr>21,<wbr>23-25,<wbr>28-29,<wbr>32,<wbr>35,<wbr>37,<wbr>39-43,<wbr>46,<wbr>48-50,<wbr>52,<wbr>55-57,<wbr>59,<wbr>62-63,<wbr>65-72]: 119&nbsp;GB&nbsp;SSD<br />[2-4,<wbr>7,<wbr>10-11,<wbr>13-14,<wbr>17-18,<wbr>20,<wbr>22,<wbr>26,<wbr>30-31,<wbr>33-34,<wbr>36,<wbr>38,<wbr>44,<wbr>47,<wbr>51,<wbr>53,<wbr>58,<wbr>60,<wbr>64]: 59&nbsp;GB&nbsp;SSD||data-sort-value="41000"|1&nbsp;Gbps&nbsp;+&nbsp;40&nbsp;Gbps&nbsp;InfiniBand
|[[#drac|drac]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2020-10-05||12||2||POWER8NVL 1.0||10&nbsp;cores/CPU||ppc64le||128&nbsp;GiB||data-sort-value="1862"|<b>1.0&nbsp;TB&nbsp;HDD</b> +&nbsp;1.0&nbsp;TB&nbsp;HDD||data-sort-value="210000"|10&nbsp;Gbps&nbsp;+&nbsp;2&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||4&nbsp;x&nbsp;Nvidia Tesla&nbsp;P100&nbsp;(16&nbsp;GiB)
|-
|-
|[[#genepi|genepi]]||default||2008-10-01||31||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5420||4&nbsp;cores/CPU||8&nbsp;GB||data-sort-value="153"|153&nbsp;GB&nbsp;HDD||data-sort-value="21000"|1&nbsp;Gbps&nbsp;+&nbsp;20&nbsp;Gbps&nbsp;InfiniBand
|[[#servan|servan]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2021-12-15||2||2||AMD EPYC 7352||24&nbsp;cores/CPU||x86_64||128&nbsp;GiB||data-sort-value="2980"|<b>1.6&nbsp;TB&nbsp;SSD</b> +&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="225000"|25&nbsp;Gbps&nbsp;+&nbsp;2&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;Ethernet-FPGA||Xilinx Alveo&nbsp;U200
|-
|-
|[[#yeti_.28testing_queue.29|yeti]]||testing||2018-01-16||4||4&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;Gold&nbsp;6130||16&nbsp;cores/CPU||768&nbsp;GB||data-sort-value="6032"|446&nbsp;GB&nbsp;SSD +&nbsp;3&nbsp;x&nbsp;1.819&nbsp;TB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;
|[[#troll|troll]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2019-12-23||4||2||Intel Xeon Gold 5218||16&nbsp;cores/CPU||x86_64||384&nbsp;GiB + 1.5&nbsp;TiB [[PMEM]]||data-sort-value="1937"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="125000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|-
|[[#yeti|yeti]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2018-01-16||4||4||Intel Xeon Gold 6130||16&nbsp;cores/CPU||x86_64||768&nbsp;GiB||data-sort-value="9016"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;3&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]] +&nbsp;2&nbsp;x&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|-
|}
''*: disk is [[Disk_reservation|reservable]]''
= Clusters in the [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/ default queue] =
 
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=dahu%20only dahu] ==


|}
'''32 nodes, 64 cpus, 1024 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/dahu/nodes.json?pretty=1 json])


= Cluster details =
'''Reservation example:'''


== dahu (testing queue) ==
{{Term|location=fgrenoble|cmd=<code class="command">oarsub</code> <code class="env">-p dahu</code> <code>-I</code>}}


'''72 nodes, 144 cpus, 2304 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/dahu/nodes.json?pretty=1 json])
; dahu-[1-9,<wbr>11-16,<wbr>18-27,<wbr>29,<wbr>31-55,<wbr>61-65,<wbr>67-68] (58 nodes, 116 cpus, 1856 cores)
{|
{|
|-
|-
Line 45: Line 66:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 192&nbsp;GB<br/>
| 192&nbsp;GiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* 223&nbsp;GB HDD SATA MZ7KM240HMHQ0D3 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-3)<br />
* disk0, 240&nbsp;GB SSD SATA Samsung MZ7KM240HMHQ0D3 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:11.5-ata-3</code>)  (primary disk)<br />
* 447&nbsp;GB HDD SATA MZ7KM480HMHQ0D3 (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-4)<br />
* disk1, 480&nbsp;GB SSD SATA Samsung MZ7KM480HMHQ0D3 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:11.5-ata-4</code>) <br />
* 3.639&nbsp;TB HDD SATA ST4000NM0265-2DC (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-5)<br/>
* disk2, 4.0&nbsp;TB HDD SATA Seagate ST4000NM0265-2DC (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:11.5-ata-5</code>) <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br/>
* <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />


; dahu-[10,<wbr>30,<wbr>56,<wbr>66] (4 nodes, 8 cpus, 128 cores)
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=drac%20only drac] ==
 
'''12 nodes, 24 cpus, 240 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/drac/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=fgrenoble|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p drac</code> <code>-I</code>}}
 
{|
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge C6420<br/>
| IBM PowerNV S822LC (8335-GTB)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2018-03-22<br/>
| 2020-10-05<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
| POWER8NVL 1.0 (POWER8, 2&nbsp;CPUs/node, 10&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 192&nbsp;GB<br/>
| 128&nbsp;GiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* 223&nbsp;GB HDD SATA MZ7KM240HMHQ0D3  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-3)<br />
* disk0, 1.0&nbsp;TB HDD SATA Seagate ST1000NX0313 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0009:04:00.0-ata-1</code>)  (primary disk)<br />
* 447&nbsp;GB HDD SATA MZ7KM480HMHQ0D3  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-4)<br />
* disk1, 1.0&nbsp;TB HDD SATA Seagate ST1000NX0313 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0009:04:00.0-ata-2</code>) <br/>
* 3.639&nbsp;TB HDD SATA ST4000NM0265-2DC  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-5)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* enp24s0f1/enp24s0f1, Ethernet, configured rate: , model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* eth0/enP1p1s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x<br />
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br/>
* <span style="color:grey">eth1/enP1p1s0f1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x - unavailable for experiment</span><br />
* <span style="color:grey">eth2/enP1p1s0f2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x - unavailable for experiment</span><br />
* <span style="color:grey">eth3/enP1p1s0f3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x - unavailable for experiment</span><br />
* <span style="color:grey">eth4/enP9p7s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth5/enP9p7s0f1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27700 Family [ConnectX-4], driver: mlx5_core<br />
* ib1, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27700 Family [ConnectX-4], driver: mlx5_core<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 4&nbsp;x&nbsp;Nvidia Tesla&nbsp;P100-SXM2-16GB&nbsp;(16&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;6.0<br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />


; dahu-17 (1 node, 2 cpus, 32 cores)
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=servan%20only servan] ==
 
'''2 nodes, 4 cpus, 96 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/servan/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=fgrenoble|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p servan</code> <code>-I</code>}}
 
{|
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge C6420<br/>
| Dell PowerEdge R7525<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2018-03-22<br/>
| 2021-12-15<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
| AMD EPYC 7352 (Zen 2, 2&nbsp;CPUs/node, 24&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 192&nbsp;GB<br/>
| 128&nbsp;GiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* 223&nbsp;GB HDD SATA MZ7KM240HMHQ0D3  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-3)<br />
* disk0, 1.6&nbsp;TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:c3:00.0-nvme-1</code>)  (primary disk)<br />
* 447&nbsp;GB HDD SATA MZ7KM480HMHQ0D3  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-4)<br />
* disk1, 1.6&nbsp;TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:c4:00.0-nvme-1</code>) <br/>
* 3.639&nbsp;TB HDD SATA ST4000NM0265-2DC  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-5)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eno16/eno16, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel I350 Gigabit Network Connection, driver: igb<br />
* eth0/eno33, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller E810-C for SFP, driver: ice<br />
* enp24s0f1/enp24s0f1, Ethernet, configured rate: , model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/eno34, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment</span><br />
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br/>
* <span style="color:grey">eth2/eno35, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno36, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment</span><br />
* fpga0, Ethernet-FPGA, configured rate: 100&nbsp;Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: xrt<br />
* fpga1, Ethernet-FPGA, configured rate: 100&nbsp;Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: xrt<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''FPGA:'''
| Xilinx Alveo&nbsp;U200<br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />


; dahu-28 (1 node, 2 cpus, 32 cores)
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=troll%20only troll] ==
 
'''4 nodes, 8 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/troll/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=fgrenoble|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p troll</code> <code>-I</code>}}
 
{|
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge C6420<br/>
| Dell PowerEdge R640<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2018-03-22<br/>
| 2019-12-23<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 5218 (Cascade Lake-SP, 2.30GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 192&nbsp;GB<br/>
| 384&nbsp;GiB + 1.5&nbsp;TiB [[PMEM]]<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* 223&nbsp;GB HDD SATA MZ7KM240HMHQ0D3  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-3)<br />
* disk0, 480&nbsp;GB SSD SATA Micron MTFDDAK480TDN (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* 447&nbsp;GB HDD SATA MZ7KM480HMHQ0D3  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-4)<br />
* disk1, 1.6&nbsp;TB SSD NVME Dell Samsung PM1735 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:d8:00.0-nvme-1</code>) <br/>
* 3.639&nbsp;TB HDD SATA TOSHIBA MG04ACA4  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-5)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* eth0/eno1, Ethernet, configured rate: 25&nbsp;Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled<br />
* <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br/>
* <span style="color:grey">eth1/eno2, Ethernet, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core - unavailable for experiment</span><br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />


; dahu-[57-60] (4 nodes, 8 cpus, 128 cores)
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=yeti%20only yeti] ==
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge C6420<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2018-03-22<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 192&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* 223&nbsp;GB HDD SATA MZ7KM240HMHQ0D3  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-3)<br />
* 447&nbsp;GB HDD SATA SSDSC2KG480G7R  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-4)<br />
* 3.639&nbsp;TB HDD SATA TOSHIBA MG04ACA4  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-5)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />


; dahu-[69-72] (4 nodes, 8 cpus, 128 cores)
'''4 nodes, 16 cpus, 256 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/yeti/nodes.json?pretty=1 json])
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge C6420<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2018-03-22<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 192&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* 447&nbsp;GB HDD SATA MZ7KM480HMHQ0D3  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-3)<br />
* 447&nbsp;GB HDD SATA MZ7KM480HMHQ0D3  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-4)<br />
* 3.639&nbsp;TB HDD SATA ST4000NM0265-2DC  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:00:11.5-ata-5)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br/>
|-
|}


== edel ==
'''Reservation example:'''


'''68 nodes, 136 cpus, 544 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/edel/nodes.json?pretty=1 json])
{{Term|location=fgrenoble|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p yeti</code> <code>-I</code>}}
; edel-[1,<wbr>5-6,<wbr>16,<wbr>37,<wbr>41-42] (7 nodes, 14 cpus, 56 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 (Nehalem, 2.27GHz, 2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  119&nbsp;GB SSD SATA C400-MTFDDAA128M  (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel 82576 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand,  - unavailable for experiment</span><br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />


; edel-2 (1 node, 2 cpus, 8 cores)
; yeti-1 (1 node, 4 cpus, 64 cores)
{|
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| Bull bullx B500 compute blades<br/>
| exotic job type<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 (Nehalem, 2.27GHz, 2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C400-MTFDDAA064M  (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel 82576 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand,  - unavailable for experiment</span><br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
 
; edel-[3,<wbr>7,<wbr>10-11,<wbr>13-14,<wbr>22,<wbr>26,<wbr>30,<wbr>36,<wbr>38,<wbr>44,<wbr>47,<wbr>51,<wbr>53,<wbr>58,<wbr>60,<wbr>64] (18 nodes, 36 cpus, 144 cores)
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
| Dell PowerEdge R940<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
| 2018-01-16<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 (Nehalem, 2.27GHz, 2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
| 768&nbsp;GiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C400-MTFDDAA064M  (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel 82576 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* disk1, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* disk2, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core - unavailable for experiment</span><br/>
* disk3, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
|-
* disk4, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash PM1725b 1.6TB AIC (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:59:00.0-nvme-1</code>)  <br />
|}
* disk5, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:6d:00.0-nvme-1</code>) <br/>
<hr style="height:10pt; visibility:hidden;" />
 
; edel-[8-9,<wbr>12,<wbr>15,<wbr>19,<wbr>21,<wbr>23-24,<wbr>28-29,<wbr>32,<wbr>39-40,<wbr>43,<wbr>48-49,<wbr>52,<wbr>55-57,<wbr>59,<wbr>62,<wbr>65-71] (29 nodes, 58 cpus, 232 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 (Nehalem, 2.27GHz, 2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  119&nbsp;GB SSD SATA C400-MTFDDAA128M  (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel 82576 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core - unavailable for experiment</span><br/>
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />
<hr style="height:10pt; visibility:hidden;" />


; edel-[17,<wbr>34] (2 nodes, 4 cpus, 16 cores)
; yeti-[2,<wbr>4] (2 nodes, 8 cpus, 128 cores)
{|
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| Bull bullx B500 compute blades<br/>
| exotic job type<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 (Nehalem, 2.27GHz, 2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C300-MTFDDAA064M  (driver: ahci, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel 82576 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core - unavailable for experiment</span><br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
 
; edel-[4,<wbr>18,<wbr>31,<wbr>33] (4 nodes, 8 cpus, 32 cores)
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
| Dell PowerEdge R940<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
| 2018-01-16<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 (Nehalem, 2.27GHz, 2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
| 768&nbsp;GiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C400-MTFDDAA064M  (driver: ahci, path: node-was-not-available-to-retrieve-this-value)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel 82576 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* disk1, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* disk2, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core - unavailable for experiment</span><br/>
* disk3, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
|-
* disk4, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:59:00.0-nvme-1</code>)  <br />
|}
* disk5, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:6d:00.0-nvme-1</code>) <br/>
<hr style="height:10pt; visibility:hidden;" />
 
; edel-20 (1 node, 2 cpus, 8 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 (Nehalem, 2.27GHz, 2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  59&nbsp;GB SSD SATA C400-MTFDDAA064M  (driver: ahci, path: /dev/disk/by-id/wwn-0x500a07510202c04b)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel 82576 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core - unavailable for experiment</span><br/>
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />
<hr style="height:10pt; visibility:hidden;" />


; edel-[25,<wbr>35,<wbr>46,<wbr>50,<wbr>63,<wbr>72] (6 nodes, 12 cpus, 48 cores)
; yeti-3 (1 node, 4 cpus, 64 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Bull bullx B500 compute blades<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-03<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5520 (Nehalem, 2.27GHz, 2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 24&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  119&nbsp;GB SSD SATA C400-MTFDDAA128M  (driver: ahci, path: node-was-not-available-to-retrieve-this-value)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 82576 Gigabit Network Connection, driver: igb<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel 82576 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 40&nbsp;Gbps, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE], driver: mlx4_core - unavailable for experiment</span><br/>
|-
|}
 
== genepi ==
 
'''31 nodes, 62 cpus, 248 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/genepi/nodes.json?pretty=1 json])
{|
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| Bull R422-E1<br/>
| exotic job type<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2008-10-01<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5420 (Harpertown, 2.50GHz, 2&nbsp;CPUs/node, 4&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 8&nbsp;GB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  153&nbsp;GB HDD SATA WDC WD1600YS-01S  (driver: ata_piix, path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* <span style="color:grey">eth0/enp5s0f0, Ethernet, model: Intel 80003ES2LAN Gigabit Ethernet Controller (Copper), driver: e1000e - unavailable for experiment</span><br />
* eth1/enp5s0f1, Ethernet, configured rate: 1&nbsp;Gbps, model: Intel 80003ES2LAN Gigabit Ethernet Controller (Copper), driver: e1000e<br />
* ib0, InfiniBand, configured rate: 20&nbsp;Gbps, model: Mellanox Technologies MT26418 [ConnectX VPI PCIe 2.0 5GT/s - IB DDR / 10GigE], driver: mlx4_core<br />
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT26418 [ConnectX VPI PCIe 2.0 5GT/s - IB DDR / 10GigE], driver: mlx4_core - unavailable for experiment</span><br/>
|-
|}
 
== yeti (testing queue) ==
 
'''4 nodes, 16 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/yeti/nodes.json?pretty=1 json])
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
Line 476: Line 310:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 768&nbsp;GB<br/>
| 768&nbsp;GiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* 446&nbsp;GB SSD SAS PERC H740P Adp  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:2:0:0)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G8R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* 1.819&nbsp;TB HDD SAS PERC H740P Adp  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:2:1:0)<br />
* disk1, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* 1.819&nbsp;TB HDD SAS PERC H740P Adp  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:2:2:0)<br />
* disk2, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* 1.819&nbsp;TB HDD SAS PERC H740P Adp  (driver: megaraid_sas, path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:2:3:0)<br/>
* disk3, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk4, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:59:00.0-nvme-1</code>)  <br />
* disk5, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:6d:00.0-nvme-1</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/eno113, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/eno114, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* <span style="color:grey">eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno115, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno116, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br/>
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2018-06-22 ([https://github.com/grid5000/reference-repository/commit/f97667273 commit f97667273])</small>''
|}''<small>Last generated from the Grid'5000 Reference API on 2022-06-29 ([https://github.com/grid5000/reference-repository/commit/362f6514fa commit 362f6514fa])</small>''

Revision as of 17:10, 29 June 2022

See also: Network topology for Grenoble

Summary

  • 5 clusters
  • 54 nodes
  • 1744 CPU cores
  • 48 GPUs
  • 12.25 TiB RAM + 6.0 TiB PMEM
  • 88 SSDs and 68 HDDs on nodes (total: 228.53 TB)
  • 101.9 TFLOPS (excluding GPUs)

Clusters

Cluster Access Condition Date of arrival Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
dahu 2018-03-22 32 2 Intel Xeon Gold 6130 16 cores/CPU x86_64 192 GiB 240 GB SSD + 480 GB SSD + 4.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
drac exotic job type 2020-10-05 12 2 POWER8NVL 1.0 10 cores/CPU ppc64le 128 GiB 1.0 TB HDD + 1.0 TB HDD 10 Gbps + 2 x 100 Gbps InfiniBand 4 x Nvidia Tesla P100 (16 GiB)
servan exotic job type 2021-12-15 2 2 AMD EPYC 7352 24 cores/CPU x86_64 128 GiB 1.6 TB SSD + 1.6 TB SSD 25 Gbps + 2 x 100 Gbps Ethernet-FPGA Xilinx Alveo U200
troll exotic job type 2019-12-23 4 2 Intel Xeon Gold 5218 16 cores/CPU x86_64 384 GiB + 1.5 TiB PMEM 480 GB SSD + 1.6 TB SSD 25 Gbps (SR‑IOV) + 100 Gbps Omni-Path
yeti exotic job type 2018-01-16 4 4 Intel Xeon Gold 6130 16 cores/CPU x86_64 768 GiB 480 GB SSD + 3 x 2.0 TB HDD* + 2 x 1.6 TB SSD 10 Gbps + 100 Gbps Omni-Path

*: disk is reservable

Clusters in the default queue

dahu

32 nodes, 64 cpus, 1024 cores (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -p dahu -I
Model: Dell PowerEdge C6420
Date of arrival: 2018-03-22
CPU: Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2 CPUs/node, 16 cores/CPU)
Memory: 192 GiB
Storage:
  • disk0, 240 GB SSD SATA Samsung MZ7KM240HMHQ0D3 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:00:11.5-ata-3) (primary disk)
  • disk1, 480 GB SSD SATA Samsung MZ7KM480HMHQ0D3 (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:00:11.5-ata-4)
  • disk2, 4.0 TB HDD SATA Seagate ST4000NM0265-2DC (dev: /dev/disk2, by-path: /dev/disk/by-path/pci-0000:00:11.5-ata-5)
Network:
  • eth0/enp24s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

drac

12 nodes, 24 cpus, 240 cores (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -t exotic -p drac -I
Access condition: exotic job type
Model: IBM PowerNV S822LC (8335-GTB)
Date of arrival: 2020-10-05
CPU: POWER8NVL 1.0 (POWER8, 2 CPUs/node, 10 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 1.0 TB HDD SATA Seagate ST1000NX0313 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0009:04:00.0-ata-1) (primary disk)
  • disk1, 1.0 TB HDD SATA Seagate ST1000NX0313 (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0009:04:00.0-ata-2)
Network:
  • eth0/enP1p1s0f0, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x
  • eth1/enP1p1s0f1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x - unavailable for experiment
  • eth2/enP1p1s0f2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x - unavailable for experiment
  • eth3/enP1p1s0f3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x - unavailable for experiment
  • eth4/enP9p7s0f0, Ethernet, configured rate: 1 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/enP9p7s0f1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27700 Family [ConnectX-4], driver: mlx5_core
  • ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27700 Family [ConnectX-4], driver: mlx5_core
GPU: 4 x Nvidia Tesla P100-SXM2-16GB (16 GiB)
Compute capability: 6.0

servan

2 nodes, 4 cpus, 96 cores (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -t exotic -p servan -I
Access condition: exotic job type
Model: Dell PowerEdge R7525
Date of arrival: 2021-12-15
CPU: AMD EPYC 7352 (Zen 2, 2 CPUs/node, 24 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 1.6 TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:c3:00.0-nvme-1) (primary disk)
  • disk1, 1.6 TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:c4:00.0-nvme-1)
Network:
  • eth0/eno33, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller E810-C for SFP, driver: ice
  • eth1/eno34, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment
  • eth2/eno35, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment
  • eth3/eno36, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment
  • fpga0, Ethernet-FPGA, configured rate: 100 Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: xrt
  • fpga1, Ethernet-FPGA, configured rate: 100 Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: xrt
FPGA: Xilinx Alveo U200

troll

4 nodes, 8 cpus, 128 cores (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -t exotic -p troll -I
Access condition: exotic job type
Model: Dell PowerEdge R640
Date of arrival: 2019-12-23
CPU: Intel Xeon Gold 5218 (Cascade Lake-SP, 2.30GHz, 2 CPUs/node, 16 cores/CPU)
Memory: 384 GiB + 1.5 TiB PMEM
Storage:
  • disk0, 480 GB SSD SATA Micron MTFDDAK480TDN (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 1.6 TB SSD NVME Dell Samsung PM1735 (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:d8:00.0-nvme-1)
Network:
  • eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/eno2, Ethernet, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

yeti

4 nodes, 16 cpus, 256 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -t exotic -p yeti -I
yeti-1 (1 node, 4 cpus, 64 cores)
Access condition: exotic job type
Model: Dell PowerEdge R940
Date of arrival: 2018-01-16
CPU: Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4 CPUs/node, 16 cores/CPU)
Memory: 768 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 1.6 TB SSD NVME Dell Dell Express Flash PM1725b 1.6TB AIC (dev: /dev/disk4, by-path: /dev/disk/by-path/pci-0000:59:00.0-nvme-1)
  • disk5, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk5, by-path: /dev/disk/by-path/pci-0000:6d:00.0-nvme-1)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

yeti-[2,4] (2 nodes, 8 cpus, 128 cores)
Access condition: exotic job type
Model: Dell PowerEdge R940
Date of arrival: 2018-01-16
CPU: Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4 CPUs/node, 16 cores/CPU)
Memory: 768 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk4, by-path: /dev/disk/by-path/pci-0000:59:00.0-nvme-1)
  • disk5, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk5, by-path: /dev/disk/by-path/pci-0000:6d:00.0-nvme-1)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

yeti-3 (1 node, 4 cpus, 64 cores)
Access condition: exotic job type
Model: Dell PowerEdge R940
Date of arrival: 2018-01-16
CPU: Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4 CPUs/node, 16 cores/CPU)
Memory: 768 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G8R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk4, by-path: /dev/disk/by-path/pci-0000:59:00.0-nvme-1)
  • disk5, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk5, by-path: /dev/disk/by-path/pci-0000:6d:00.0-nvme-1)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

Last generated from the Grid'5000 Reference API on 2022-06-29 (commit 362f6514fa)