Grenoble:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
 
(18 intermediate revisions by 9 users not shown)
Line 1: Line 1:
__NOTOC__
__NOEDITSECTION__
__NOEDITSECTION__
{{Portal|User}}
{{Portal|User}}
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Strasbourg:Hardware|Strasbourg]] | [[Toulouse:Hardware|Toulouse]]</div>
'''See also:''' [[Grenoble:Network|Network topology for Grenoble]]
'''See also:''' [[Grenoble:Network|Network topology for Grenoble]]
= Summary =
= Summary =
* 5 clusters
* 6 clusters
* 54 nodes
* 55 nodes
* 1744 CPU cores
* 1808 CPU cores
* 48 GPUs
* 48 GPUs
* 12.25&nbsp;TiB RAM + 6.0&nbsp;TiB PMEM
* 172032 GPUs cores
* 88 SSDs and 68 HDDs on nodes (total: 228.53&nbsp;TB)
* 12.31&nbsp;TiB RAM + 6.0&nbsp;TiB PMEM
* 101.9 TFLOPS (excluding GPUs)
* 90 SSDs and 68 HDDs on nodes (total: 230.93&nbsp;TB)
* 108.9 TFLOPS (excluding GPUs)


= Clusters =
= Clusters summary =
== Default queue resources ==
{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
Line 19: Line 20:
!rowspan=2|Access Condition
!rowspan=2|Access Condition
!rowspan=2|Date of arrival
!rowspan=2|Date of arrival
!rowspan=2|Manufacturing date
!data-sort-type="number" rowspan=2|Nodes
!data-sort-type="number" rowspan=2|Nodes
!colspan=4|CPU
!colspan=4|CPU
Line 32: Line 34:
|-
|-


|[[#dahu|dahu]]||||2018-03-22||32||2||Intel Xeon Gold 6130||16&nbsp;cores/CPU||x86_64||192&nbsp;GiB||data-sort-value="4396"|<b>240&nbsp;GB&nbsp;SSD</b> +&nbsp;480&nbsp;GB&nbsp;SSD +&nbsp;4.0&nbsp;TB&nbsp;HDD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|[[#dahu|dahu]]||||2018-03-22||2017-12-12||32||2||Intel Xeon Gold 6130||16&nbsp;cores/CPU||x86_64||data-sort-value="206158430208"|192&nbsp;GiB||data-sort-value="4396"|<b>240&nbsp;GB&nbsp;SSD</b> +&nbsp;480&nbsp;GB&nbsp;SSD +&nbsp;4.0&nbsp;TB&nbsp;HDD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|-
|-
|[[#drac|drac]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2020-10-05||12||2||POWER8NVL 1.0||10&nbsp;cores/CPU||ppc64le||128&nbsp;GiB||data-sort-value="1862"|<b>1.0&nbsp;TB&nbsp;HDD</b> +&nbsp;1.0&nbsp;TB&nbsp;HDD||data-sort-value="210000"|10&nbsp;Gbps&nbsp;+&nbsp;2&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||4&nbsp;x&nbsp;Nvidia Tesla&nbsp;P100&nbsp;(16&nbsp;GiB)
|[[#drac|drac]]||<b>[[Exotic#Grenoble:_drac|exotic]]</b>&nbsp;job&nbsp;type||2020-10-05||2016-10-17||12||2||IBM POWER8NVL 1.0||10&nbsp;cores/CPU||ppc64le||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="1862"|<b>1.0&nbsp;TB&nbsp;HDD</b> +&nbsp;1.0&nbsp;TB&nbsp;HDD||data-sort-value="210000"|10&nbsp;Gbps&nbsp;+&nbsp;2&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||4&nbsp;x&nbsp;Nvidia Tesla&nbsp;P100&nbsp;(16&nbsp;GiB)
|-
|-
|[[#servan|servan]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2021-12-15||2||2||AMD EPYC 7352||24&nbsp;cores/CPU||x86_64||128&nbsp;GiB||data-sort-value="2980"|<b>1.6&nbsp;TB&nbsp;SSD</b> +&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="225000"|25&nbsp;Gbps&nbsp;+&nbsp;2&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;Ethernet-FPGA||Xilinx Alveo&nbsp;U200
|[[#servan|servan]]||<b>[[Exotic#Grenoble:_servan|exotic]]</b>&nbsp;job&nbsp;type||2021-12-15||2021-12-10||2||2||AMD EPYC 7352||24&nbsp;cores/CPU||x86_64||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="2980"|<b>1.6&nbsp;TB&nbsp;SSD</b> +&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="225000"|25&nbsp;Gbps&nbsp;+&nbsp;2&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;FPGA/Ethernet||Xilinx Alveo&nbsp;U200
|-
|-
|[[#troll|troll]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2019-12-23||4||2||Intel Xeon Gold 5218||16&nbsp;cores/CPU||x86_64||384&nbsp;GiB + 1.5&nbsp;TiB [[PMEM]]||data-sort-value="1937"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="125000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|[[#troll|troll]]||<b>[[Exotic#Grenoble:_troll|exotic]]</b>&nbsp;job&nbsp;type||2019-12-23||2019-11-21||4||2||Intel Xeon Gold 5218||16&nbsp;cores/CPU||x86_64||data-sort-value="412316860416"|384&nbsp;GiB + 1.5&nbsp;TiB [[PMEM]]||data-sort-value="1937"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="125000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|-
|-
|[[#yeti|yeti]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2018-01-16||4||4||Intel Xeon Gold 6130||16&nbsp;cores/CPU||x86_64||768&nbsp;GiB||data-sort-value="9016"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;3&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]] +&nbsp;2&nbsp;x&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|[[#yeti|yeti]]||<b>[[Exotic#Grenoble:_yeti|exotic]]</b>&nbsp;job&nbsp;type||2018-01-16||2017-12-26||4||4||Intel Xeon Gold 6130||16&nbsp;cores/CPU||x86_64||data-sort-value="824633720832"|768&nbsp;GiB||data-sort-value="9016"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;3&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]] +&nbsp;2&nbsp;x&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|-
|-
|}
|}
''*: disk is [[Disk_reservation|reservable]]''
''*: disk is [[Disk_reservation|reservable]]''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''**: crossed GPUs are not supported by Grid'5000 default environments''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment''
== Testing queue resources ==
{|class="wikitable sortable"
|-
!rowspan=2|Cluster
!rowspan=2|Access Condition
!rowspan=2|Date of arrival
!rowspan=2|Manufacturing date
!data-sort-type="number" rowspan=2|Nodes
!colspan=4|CPU
!data-sort-type="number" rowspan=2|Memory
!data-sort-type="number" rowspan=2|Storage
!data-sort-type="number" rowspan=2|Network
!rowspan=2|Accelerators
|-
!data-sort-type="number"|#
!|Name
!data-sort-type="number"|Cores
!|Architecture
|-
 
|[[#nessie|nessie]]||<b>testing</b>&nbsp;queue||2024-11-08||2024-08-19||1||2||Intel Xeon nil||32&nbsp;cores/CPU||x86_64||data-sort-value="68719476736"|64&nbsp;GiB||data-sort-value="2235"|<b>1.92&nbsp;TB&nbsp;SSD</b> +&nbsp;480&nbsp;GB&nbsp;SSD||data-sort-value="25000"|25&nbsp;Gbps&nbsp;||
|-
|}
''*: disk is [[Disk_reservation|reservable]]''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''**: crossed GPUs are not supported by Grid'5000 default environments''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment''
 
= Clusters in the [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/ default queue] =
= Clusters in the [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/ default queue] =


== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=dahu%20only dahu] ==
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=dahu%20only dahu] ==


'''32 nodes, 64 cpus, 1024 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/dahu/nodes.json?pretty=1 json])
'''32 nodes, 64 cpus, 1024 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/dahu/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''
Line 54: Line 81:
{{Term|location=fgrenoble|cmd=<code class="command">oarsub</code> <code class="env">-p dahu</code> <code>-I</code>}}
{{Term|location=fgrenoble|cmd=<code class="command">oarsub</code> <code class="env">-p dahu</code> <code>-I</code>}}


; dahu-[1,<wbr>4-32] (30 nodes, 60 cpus, 960 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge C6420<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2017-12-12<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2018-03-22<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 192&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* disk0, 240&nbsp;GB SSD SATA Samsung MZ7KM240HMHQ0D3 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 480&nbsp;GB SSD SATA Samsung MZ7KM480HMHQ0D3 (dev: <code class="file">/dev/disk1</code>)  <br />
* disk2, 4.0&nbsp;TB HDD SATA Seagate ST4000NM0265-2DC (dev: <code class="file">/dev/disk2</code>)  <br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
; dahu-2 (1 node, 2 cpus, 32 cores)
{|
{|
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge C6420<br/>
| Dell PowerEdge C6420<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2017-12-12<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
Line 63: Line 127:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 70: Line 134:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 240&nbsp;GB SSD SATA Samsung MZ7KM240HMHQ0D3 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:11.5-ata-3</code>)  (primary disk)<br />
* disk0, 240&nbsp;GB SSD SATA Samsung MZ7KM240HMHQ0D3 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 480&nbsp;GB SSD SATA Samsung MZ7KM480HMHQ0D3 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:11.5-ata-4</code>)  <br />
* disk1, 480&nbsp;GB SSD SATA Samsung MZ7KM480HMHQ0D3 (dev: <code class="file">/dev/disk1</code>)  <br />
* disk2, 4.0&nbsp;TB HDD SATA Seagate ST4000NM0265-2DC (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:11.5-ata-5</code>)  <br/>
* disk2, 4.0&nbsp;TB HDD SATA Toshiba TOSHIBA MG08ADA4 (dev: <code class="file">/dev/disk2</code>)  <br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp24s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />
* <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
 
; dahu-3 (1 node, 2 cpus, 32 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge C6420<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2017-12-12<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2018-03-22<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 192&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* disk0, 240&nbsp;GB SSD SATA Samsung MZ7KM240HMHQ0D3 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 480&nbsp;GB SSD SATA Samsung MZ7KM480HMHQ0D3 (dev: <code class="file">/dev/disk1</code>)  <br />
* disk2, 4.0&nbsp;TB HDD SATA Seagate ST4000NM018B-2TF (dev: <code class="file">/dev/disk2</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 93: Line 190:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
| [[Exotic#Grenoble:_drac|exotic]] job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| IBM PowerNV S822LC (8335-GTB)<br/>
| IBM PowerNV S822LC (8335-GTB)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2016-10-17<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
Line 102: Line 202:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| POWER8NVL 1.0 (POWER8, 2&nbsp;CPUs/node, 10&nbsp;cores/CPU)<br/>
| IBM POWER8NVL 1.0 (POWER8), ppc64le, 2&nbsp;CPUs/node, 10&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 109: Line 209:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 1.0&nbsp;TB HDD SATA Seagate ST1000NX0313 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0009:04:00.0-ata-1</code>)  (primary disk)<br />
* disk0, 1.0&nbsp;TB HDD SATA Seagate ST1000NX0313 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 1.0&nbsp;TB HDD SATA Seagate ST1000NX0313 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0009:04:00.0-ata-2</code>)  <br/>
* disk1, 1.0&nbsp;TB HDD SATA Seagate ST1000NX0313 (dev: <code class="file">/dev/disk1</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 127: Line 227:
|-
|-
|}
|}
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Grenoble:_drac|exotic]]''' page for more information.<br/>


== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=servan%20only servan] ==
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=servan%20only servan] ==
Line 139: Line 241:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
| [[Exotic#Grenoble:_servan|exotic]] job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge R7525<br/>
| Dell PowerEdge R7525<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2021-12-10<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
Line 148: Line 253:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD EPYC 7352 (Zen 2, 2&nbsp;CPUs/node, 24&nbsp;cores/CPU)<br/>
| AMD EPYC 7352 (Zen 2), x86_64, 2&nbsp;CPUs/node, 24&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 155: Line 260:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 1.6&nbsp;TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:c3:00.0-nvme-1</code>)  (primary disk)<br />
* disk0, 1.6&nbsp;TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 1.6&nbsp;TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:c4:00.0-nvme-1</code>)  <br/>
* disk1, 1.6&nbsp;TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: <code class="file">/dev/disk1</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 164: Line 269:
* <span style="color:grey">eth2/eno35, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno35, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno36, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno36, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment</span><br />
* fpga0, Ethernet-FPGA, configured rate: 100&nbsp;Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: xrt<br />
* fpga0, FPGA/Ethernet, configured rate: 100&nbsp;Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: n/a<br />
* fpga1, Ethernet-FPGA, configured rate: 100&nbsp;Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: xrt<br/>
* fpga1, FPGA/Ethernet, configured rate: 100&nbsp;Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: n/a<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''FPGA:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''FPGA:'''
Line 171: Line 276:
|-
|-
|}
|}
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Grenoble:_servan|exotic]]''' page for more information.<br/>


== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=troll%20only troll] ==
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=troll%20only troll] ==
Line 183: Line 290:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
| [[Exotic#Grenoble:_troll|exotic]] job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge R640<br/>
| Dell PowerEdge R640<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2019-11-21<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
Line 192: Line 302:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 5218 (Cascade Lake-SP, 2.30GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 5218 (Cascade Lake-SP), x86_64, 2.30GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 199: Line 309:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Micron MTFDDAK480TDN (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Micron MTFDDAK480TDN (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 1.6&nbsp;TB SSD NVME Dell Samsung PM1735 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:d8:00.0-nvme-1</code>)  <br/>
* disk1, 1.6&nbsp;TB SSD NVME Dell Samsung PM1735 (dev: <code class="file">/dev/disk1</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 209: Line 319:
|-
|-
|}
|}
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Grenoble:_troll|exotic]]''' page for more information.<br/>


== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=yeti%20only yeti] ==
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=yeti%20only yeti] ==
Line 222: Line 334:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
| [[Exotic#Grenoble:_yeti|exotic]] job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge R940<br/>
| Dell PowerEdge R940<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2017-12-26<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
Line 231: Line 346:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 238: Line 353:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk1, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk2, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk2, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk3, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk3, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk4, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash PM1725b 1.6TB AIC (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:59:00.0-nvme-1</code>)  <br />
* disk4, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash PM1725b 1.6TB AIC (dev: <code class="file">/dev/disk4</code>)  <br />
* disk5, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:6d:00.0-nvme-1</code>)  <br/>
* disk5, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk5</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 260: Line 375:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
| [[Exotic#Grenoble:_yeti|exotic]] job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge R940<br/>
| Dell PowerEdge R940<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2017-12-26<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
Line 269: Line 387:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 276: Line 394:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk1, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk2, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk2, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk3, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk3, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk4, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:59:00.0-nvme-1</code>)  <br />
* disk4, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk4</code>)  <br />
* disk5, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:6d:00.0-nvme-1</code>)  <br/>
* disk5, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk5</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 298: Line 416:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
| [[Exotic#Grenoble:_yeti|exotic]] job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge R940<br/>
| Dell PowerEdge R940<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2017-12-26<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
Line 307: Line 428:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU)<br/>
| Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 4&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 314: Line 435:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G8R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G8R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk1, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk2, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk2, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk3, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk3, 2.0&nbsp;TB HDD SAS Seagate ST2000NX0463 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk4, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:59:00.0-nvme-1</code>)  <br />
* disk4, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk4</code>)  <br />
* disk5, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:6d:00.0-nvme-1</code>)  <br/>
* disk5, 1.6&nbsp;TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: <code class="file">/dev/disk5</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 329: Line 450:
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2022-06-29 ([https://github.com/grid5000/reference-repository/commit/362f6514fa commit 362f6514fa])</small>''
|}
 
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Grenoble:_yeti|exotic]]''' page for more information.<br/>
 
= Clusters in the testing queue =
 
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=nessie%20only nessie] ==
 
'''1 node, 2 cpus, 64 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/nessie/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=fgrenoble|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p nessie</code> <code>-I</code>}}
 
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| testing queue<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| HPE ProLiant DL385 Gen10+ v2<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2024-08-19<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2024-11-08<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon nil (Golden Cove), x86_64, 2&nbsp;CPUs/node, 32&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 64&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* disk0, 1.92&nbsp;TB SSD NVME HP VO001920KYDMT (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 480&nbsp;GB SSD SATA HP VK000480GZCNE (dev: <code class="file">/dev/disk1</code>)  <br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0, Ethernet, configured rate: 25&nbsp;Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN<br />
* <span style="color:grey">eth1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br/>
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2024-11-25 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/fc062abbb4 commit fc062abbb4])</small>''

Latest revision as of 11:29, 25 November 2024

See also: Network topology for Grenoble

Summary

  • 6 clusters
  • 55 nodes
  • 1808 CPU cores
  • 48 GPUs
  • 172032 GPUs cores
  • 12.31 TiB RAM + 6.0 TiB PMEM
  • 90 SSDs and 68 HDDs on nodes (total: 230.93 TB)
  • 108.9 TFLOPS (excluding GPUs)

Clusters summary

Default queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
dahu 2018-03-22 2017-12-12 32 2 Intel Xeon Gold 6130 16 cores/CPU x86_64 192 GiB 240 GB SSD + 480 GB SSD + 4.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
drac exotic job type 2020-10-05 2016-10-17 12 2 IBM POWER8NVL 1.0 10 cores/CPU ppc64le 128 GiB 1.0 TB HDD + 1.0 TB HDD 10 Gbps + 2 x 100 Gbps InfiniBand 4 x Nvidia Tesla P100 (16 GiB)
servan exotic job type 2021-12-15 2021-12-10 2 2 AMD EPYC 7352 24 cores/CPU x86_64 128 GiB 1.6 TB SSD + 1.6 TB SSD 25 Gbps + 2 x 100 Gbps FPGA/Ethernet Xilinx Alveo U200
troll exotic job type 2019-12-23 2019-11-21 4 2 Intel Xeon Gold 5218 16 cores/CPU x86_64 384 GiB + 1.5 TiB PMEM 480 GB SSD + 1.6 TB SSD 25 Gbps (SR‑IOV) + 100 Gbps Omni-Path
yeti exotic job type 2018-01-16 2017-12-26 4 4 Intel Xeon Gold 6130 16 cores/CPU x86_64 768 GiB 480 GB SSD + 3 x 2.0 TB HDD* + 2 x 1.6 TB SSD 10 Gbps + 100 Gbps Omni-Path

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments      ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment

Testing queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
nessie testing queue 2024-11-08 2024-08-19 1 2 Intel Xeon nil 32 cores/CPU x86_64 64 GiB 1.92 TB SSD + 480 GB SSD 25 Gbps 

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments      ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment

Clusters in the default queue

dahu

32 nodes, 64 cpus, 1024 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -p dahu -I
dahu-[1,4-32] (30 nodes, 60 cpus, 960 cores)
Model: Dell PowerEdge C6420
Manufacturing date: 2017-12-12
Date of arrival: 2018-03-22
CPU: Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 240 GB SSD SATA Samsung MZ7KM240HMHQ0D3 (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Samsung MZ7KM480HMHQ0D3 (dev: /dev/disk1)
  • disk2, 4.0 TB HDD SATA Seagate ST4000NM0265-2DC (dev: /dev/disk2)
Network:
  • eth0/enp24s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

dahu-2 (1 node, 2 cpus, 32 cores)
Model: Dell PowerEdge C6420
Manufacturing date: 2017-12-12
Date of arrival: 2018-03-22
CPU: Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 240 GB SSD SATA Samsung MZ7KM240HMHQ0D3 (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Samsung MZ7KM480HMHQ0D3 (dev: /dev/disk1)
  • disk2, 4.0 TB HDD SATA Toshiba TOSHIBA MG08ADA4 (dev: /dev/disk2)
Network:
  • eth0/enp24s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

dahu-3 (1 node, 2 cpus, 32 cores)
Model: Dell PowerEdge C6420
Manufacturing date: 2017-12-12
Date of arrival: 2018-03-22
CPU: Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 240 GB SSD SATA Samsung MZ7KM240HMHQ0D3 (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Samsung MZ7KM480HMHQ0D3 (dev: /dev/disk1)
  • disk2, 4.0 TB HDD SATA Seagate ST4000NM018B-2TF (dev: /dev/disk2)
Network:
  • eth0/enp24s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

drac

12 nodes, 24 cpus, 240 cores (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -t exotic -p drac -I
Access condition: exotic job type
Model: IBM PowerNV S822LC (8335-GTB)
Manufacturing date: 2016-10-17
Date of arrival: 2020-10-05
CPU: IBM POWER8NVL 1.0 (POWER8), ppc64le, 2 CPUs/node, 10 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 1.0 TB HDD SATA Seagate ST1000NX0313 (dev: /dev/disk0) (primary disk)
  • disk1, 1.0 TB HDD SATA Seagate ST1000NX0313 (dev: /dev/disk1)
Network:
  • eth0/enP1p1s0f0, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x
  • eth1/enP1p1s0f1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x - unavailable for experiment
  • eth2/enP1p1s0f2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x - unavailable for experiment
  • eth3/enP1p1s0f3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet, driver: bnx2x - unavailable for experiment
  • eth4/enP9p7s0f0, Ethernet, configured rate: 1 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/enP9p7s0f1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27700 Family [ConnectX-4], driver: mlx5_core
  • ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27700 Family [ConnectX-4], driver: mlx5_core
GPU: 4 x Nvidia Tesla P100-SXM2-16GB (16 GiB)
Compute capability: 6.0

Note: This cluster is defined as exotic. Please read the exotic page for more information.

servan

2 nodes, 4 cpus, 96 cores (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -t exotic -p servan -I
Access condition: exotic job type
Model: Dell PowerEdge R7525
Manufacturing date: 2021-12-10
Date of arrival: 2021-12-15
CPU: AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 1.6 TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: /dev/disk0) (primary disk)
  • disk1, 1.6 TB SSD NVME Dell Dell Ent NVMe v2 AGN MU U.2 1.6TB (dev: /dev/disk1)
Network:
  • eth0/eno33, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller E810-C for SFP, driver: ice
  • eth1/eno34, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment
  • eth2/eno35, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment
  • eth3/eno36, Ethernet, model: Intel Ethernet Controller E810-C for SFP, driver: ice - unavailable for experiment
  • fpga0, FPGA/Ethernet, configured rate: 100 Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: n/a
  • fpga1, FPGA/Ethernet, configured rate: 100 Gbps, model: Xilinx Alveo U200 QSFP28 (100GbE), driver: n/a
FPGA: Xilinx Alveo U200

Note: This cluster is defined as exotic. Please read the exotic page for more information.

troll

4 nodes, 8 cpus, 128 cores (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -t exotic -p troll -I
Access condition: exotic job type
Model: Dell PowerEdge R640
Manufacturing date: 2019-11-21
Date of arrival: 2019-12-23
CPU: Intel Xeon Gold 5218 (Cascade Lake-SP), x86_64, 2.30GHz, 2 CPUs/node, 16 cores/CPU
Memory: 384 GiB + 1.5 TiB PMEM
Storage:
  • disk0, 480 GB SSD SATA Micron MTFDDAK480TDN (dev: /dev/disk0) (primary disk)
  • disk1, 1.6 TB SSD NVME Dell Samsung PM1735 (dev: /dev/disk1)
Network:
  • eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/eno2, Ethernet, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

Note: This cluster is defined as exotic. Please read the exotic page for more information.

yeti

4 nodes, 16 cpus, 256 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -t exotic -p yeti -I
yeti-1 (1 node, 4 cpus, 64 cores)
Access condition: exotic job type
Model: Dell PowerEdge R940
Manufacturing date: 2017-12-26
Date of arrival: 2018-01-16
CPU: Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 4 CPUs/node, 16 cores/CPU
Memory: 768 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk1*) (reservable)
  • disk2, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk2*) (reservable)
  • disk3, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk3*) (reservable)
  • disk4, 1.6 TB SSD NVME Dell Dell Express Flash PM1725b 1.6TB AIC (dev: /dev/disk4)
  • disk5, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk5)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

yeti-[2,4] (2 nodes, 8 cpus, 128 cores)
Access condition: exotic job type
Model: Dell PowerEdge R940
Manufacturing date: 2017-12-26
Date of arrival: 2018-01-16
CPU: Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 4 CPUs/node, 16 cores/CPU
Memory: 768 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk1*) (reservable)
  • disk2, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk2*) (reservable)
  • disk3, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk3*) (reservable)
  • disk4, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk4)
  • disk5, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk5)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

yeti-3 (1 node, 4 cpus, 64 cores)
Access condition: exotic job type
Model: Dell PowerEdge R940
Manufacturing date: 2017-12-26
Date of arrival: 2018-01-16
CPU: Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 4 CPUs/node, 16 cores/CPU
Memory: 768 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G8R (dev: /dev/disk0) (primary disk)
  • disk1, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk1*) (reservable)
  • disk2, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk2*) (reservable)
  • disk3, 2.0 TB HDD SAS Seagate ST2000NX0463 (dev: /dev/disk3*) (reservable)
  • disk4, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk4)
  • disk5, 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC (dev: /dev/disk5)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

Note: This cluster is defined as exotic. Please read the exotic page for more information.

Clusters in the testing queue

nessie

1 node, 2 cpus, 64 cores (json)

Reservation example:

Terminal.png fgrenoble:
oarsub -q testing -p nessie -I
Access condition: testing queue
Model: HPE ProLiant DL385 Gen10+ v2
Manufacturing date: 2024-08-19
Date of arrival: 2024-11-08
CPU: Intel Xeon nil (Golden Cove), x86_64, 2 CPUs/node, 32 cores/CPU
Memory: 64 GiB
Storage:
  • disk0, 1.92 TB SSD NVME HP VO001920KYDMT (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA HP VK000480GZCNE (dev: /dev/disk1)
Network:
  • eth0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN
  • eth1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment

Last generated from the Grid'5000 Reference API on 2024-11-25 (commit fc062abbb4)