Nancy:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
 
(6 intermediate revisions by 5 users not shown)
Line 1: Line 1:
__NOEDITSECTION__
__NOEDITSECTION__
{{Portal|User}}
{{Portal|User}}
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Toulouse:Hardware|Toulouse]]</div>
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Strasbourg:Hardware|Strasbourg]] | [[Toulouse:Hardware|Toulouse]]</div>
'''See also:''' [[Nancy:Network|Network topology for Nancy]]
'''See also:''' [[Nancy:Network|Network topology for Nancy]]
= Summary =
= Summary =
* 11 clusters
* 13 clusters
* 245 nodes
* 268 nodes
* 6136 CPU cores
* 10568 CPU cores
* 120 GPUs
* 134 GPUs
* 547840 GPUs cores
* 802304 GPUs cores
* 38.38&nbsp;TiB RAM
* 57.88&nbsp;TiB RAM
* 288 SSDs and 128 HDDs on nodes (total: 456.9&nbsp;TB)
* 311 SSDs and 129 HDDs on nodes (total: 528.52&nbsp;TB)
* 281.4 TFLOPS (excluding GPUs)
* 770.5 TFLOPS (excluding GPUs)
{|width="100%" border="0"
{|width="100%" border="0"
|-
|-
| width="50%" valign="top" |
| width="50%" valign="top" |
{| width="100%"
{| width="100%"
=== Default queue ressources ===
=== Default queue resources ===
* 2 clusters
* 2 clusters
* 126 nodes
* 126 nodes
Line 28: Line 28:
| width="50%" valign="top" |
| width="50%" valign="top" |
{| width="100%"
{| width="100%"
=== Production queue ressources ===
=== Production queue resources ===
* 9 clusters
* 9 clusters
* 119 nodes
* 119 nodes
Line 35: Line 35:
* 520192 GPUs cores
* 520192 GPUs cores
* 26.5&nbsp;TiB RAM
* 26.5&nbsp;TiB RAM
* 36 SSDs and 128 HDDs on nodes (total: 272.54&nbsp;TB)
* 36 SSDs and 129 HDDs on nodes (total: 273.74&nbsp;TB)
* 198.5 TFLOPS (excluding GPUs)
* 198.5 TFLOPS (excluding GPUs)
|}
|}
Line 41: Line 41:


= Clusters summary =
= Clusters summary =
== Default queue ressources ==
== Default queue resources ==
{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
Line 67: Line 67:
|}
|}
''*: disk is [[Disk_reservation|reservable]]''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''**: crossed GPUs are not supported by Grid'5000 default environments''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment''
''*: disk is [[Disk_reservation|reservable]]''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''**: crossed GPUs are not supported by Grid'5000 default environments''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment''
== Production queue ressources ==
== Production queue resources ==
{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
Line 97: Line 97:
|[[#grosminet|grosminet]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2023-12-05||2023-11-30||1||4||Intel Xeon Gold 6240L||18&nbsp;cores/CPU||x86_64||data-sort-value="6597069766656"|6.0&nbsp;TiB||data-sort-value="11920"|<b>1.6&nbsp;TB&nbsp;SSD</b> +&nbsp;7&nbsp;x&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="25000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|[[#grosminet|grosminet]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2023-12-05||2023-11-30||1||4||Intel Xeon Gold 6240L||18&nbsp;cores/CPU||x86_64||data-sort-value="6597069766656"|6.0&nbsp;TiB||data-sort-value="11920"|<b>1.6&nbsp;TB&nbsp;SSD</b> +&nbsp;7&nbsp;x&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="25000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|-
|-
|[[#grostiti|grostiti]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2024-01-10||2015-10-23||1||4||Intel Xeon E7-4850 v3||14&nbsp;cores/CPU||x86_64||data-sort-value="1649267441664"|1.5&nbsp;TiB||data-sort-value="4282"|<b>599&nbsp;GB&nbsp;HDD</b> +&nbsp;4.0&nbsp;TB&nbsp;HDD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|[[#grostiti|grostiti]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2024-01-10||2015-10-23||1||4||Intel Xeon E7-4850 v3||14&nbsp;cores/CPU||x86_64||data-sort-value="1649267441664"|1.5&nbsp;TiB||data-sort-value="5399"|<b>1.2&nbsp;TB&nbsp;HDD</b> +&nbsp;4.0&nbsp;TB&nbsp;HDD +&nbsp;599&nbsp;GB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|-
|-
|[[#grue|grue]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2019-11-25||2019-11-15||5||2||AMD EPYC 7351||16&nbsp;cores/CPU||x86_64||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="446"|<b>479&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||4&nbsp;x&nbsp;Nvidia Tesla&nbsp;T4&nbsp;(15&nbsp;GiB)
|[[#grue|grue]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2019-11-25||2019-11-15||5||2||AMD EPYC 7351||16&nbsp;cores/CPU||x86_64||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="446"|<b>479&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||4&nbsp;x&nbsp;Nvidia Tesla&nbsp;T4&nbsp;(15&nbsp;GiB)
Line 104: Line 104:
|-
|-
|[[#grvingt|grvingt]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2018-04-11||2018-04-01||64||2||Intel Xeon Gold 6130||16&nbsp;cores/CPU||x86_64||data-sort-value="206158430208"|192&nbsp;GiB||data-sort-value="931"|<b>1.0&nbsp;TB&nbsp;HDD</b>||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|[[#grvingt|grvingt]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2018-04-11||2018-04-01||64||2||Intel Xeon Gold 6130||16&nbsp;cores/CPU||x86_64||data-sort-value="206158430208"|192&nbsp;GiB||data-sort-value="931"|<b>1.0&nbsp;TB&nbsp;HDD</b>||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||
|-
|}
''*: disk is [[Disk_reservation|reservable]]''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''**: crossed GPUs are not supported by Grid'5000 default environments''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment''
== Testing queue resources ==
{|class="wikitable sortable"
|-
!rowspan=2|Cluster
!rowspan=2|Access Condition
!rowspan=2|Date of arrival
!rowspan=2|Manufacturing date
!data-sort-type="number" rowspan=2|Nodes
!colspan=4|CPU
!data-sort-type="number" rowspan=2|Memory
!data-sort-type="number" rowspan=2|Storage
!data-sort-type="number" rowspan=2|Network
!rowspan=2|Accelerators
|-
!data-sort-type="number"|#
!|Name
!data-sort-type="number"|Cores
!|Architecture
|-
|[[#grdix|grdix]]||<b>testing</b>&nbsp;queue||2024-09-27||2024-09-02||16||2||AMD EPYC 9754||128&nbsp;cores/CPU||x86_64||data-sort-value="1099511627776"|1.0&nbsp;TiB||data-sort-value="1490"|<b>1.6&nbsp;TB&nbsp;SSD</b>||data-sort-value="225000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;200&nbsp;Gbps&nbsp;InfiniBand||
|-
|[[#gres|gres]]||<b>testing</b>&nbsp;queue||2024-08-23||2024-08-07||7||2||AMD EPYC 9254||24&nbsp;cores/CPU||x86_64||data-sort-value="549755813888"|512&nbsp;GiB||data-sort-value="5961"|<b>6.4&nbsp;TB&nbsp;SSD</b>||data-sort-value="25000"|25&nbsp;Gbps&nbsp;||2&nbsp;x&nbsp;Nvidia Tesla&nbsp;L40S&nbsp;(45&nbsp;GiB)
|-
|-
|}
|}
Line 138: Line 164:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Micron MTFDDAK480TDN (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Micron MTFDDAK480TDN (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 960&nbsp;GB SSD SATA Micron MTFDDAK960TDN (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br/>
* disk1, 960&nbsp;GB SSD SATA Micron MTFDDAK960TDN (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 169: Line 195:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Samsung MZ7KH480HAHQ0D3 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Samsung MZ7KH480HAHQ0D3 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 960&nbsp;GB SSD SATA Micron MTFDDAK960TDN (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br/>
* disk1, 960&nbsp;GB SSD SATA Micron MTFDDAK960TDN (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 200: Line 226:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Micron MTFDDAK480TDN (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Micron MTFDDAK480TDN (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 960&nbsp;GB SSD SATA Intel SSDSC2KG960G8R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br/>
* disk1, 960&nbsp;GB SSD SATA Intel SSDSC2KG960G8R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 212: Line 238:
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg/?filter=grouille%20only grouille] ==
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg/?filter=grouille%20only grouille] ==


'''2 nodes, 4 cpus, 128 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grouille/nodes.json?pretty=1 json])
'''2 nodes, 4 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grouille/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''
Line 218: Line 244:
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p grouille</code> <code>-I</code>}}
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p grouille</code> <code>-I</code>}}


; grouille-1 (1 node, 2 cpus, 64 cores)
{|
{|
|-
|-
Line 241: Line 266:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 1.92&nbsp;TB SSD SAS Toshiba KRM5XVUG1T92 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:1:0</code>)  (primary disk)<br />
* disk0, 1.92&nbsp;TB SSD SAS Toshiba KRM5XVUG1T92 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 960&nbsp;GB SSD SATA Micron MTFDDAK960TDT (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:0:0</code>) [[Disk_reservation|(reservable)]] <br/>
* disk1, 960&nbsp;GB SSD SATA Micron MTFDDAK960TDT (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* <span style="color:grey">eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* eth2/eno33, Ethernet, configured rate: 25&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br />
* <span style="color:grey">eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 2&nbsp;x&nbsp;Nvidia A100-PCIE-40GB&nbsp;(40&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;8.0<br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
 
; grouille-2 (1 node, 2 cpus, 64 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| [[Exotic#Nancy:_grouille|exotic]] job type<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge R7525<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2020-12-07<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2021-01-13<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD EPYC 7452 (Zen 2), x86_64, 2&nbsp;CPUs/node, 32&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 128&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* disk0, 1.92&nbsp;TB SSD SAS Toshiba KRM5XVUG1T92 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:1:0</code>)  (primary disk)<br />
* disk1, 960&nbsp;GB SSD SATA Micron MTFDDAK960TDT (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 328: Line 314:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Silver 4110 (Skylake), x86_64, 2.10GHz, 2&nbsp;CPUs/node, 8&nbsp;cores/CPU<br/>
| Intel Xeon Silver 4110 (Skylake-SP), x86_64, 2.10GHz, 2&nbsp;CPUs/node, 8&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 334: Line 320:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 479&nbsp;GB HDD SATA Dell PERC H330 Adp (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:19:00.0-scsi-0:2:0:0</code>)  (primary disk)<br/>
|  disk0, 479&nbsp;GB HDD SATA Dell PERC H330 Adp (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 365: Line 351:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Silver 4110 (Skylake), x86_64, 2.10GHz, 2&nbsp;CPUs/node, 8&nbsp;cores/CPU<br/>
| Intel Xeon Silver 4110 (Skylake-SP), x86_64, 2.10GHz, 2&nbsp;CPUs/node, 8&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 371: Line 357:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 479&nbsp;GB HDD SATA Dell PERC H330 Adp (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:19:00.0-scsi-0:2:0:0</code>)  (primary disk)<br/>
|  disk0, 479&nbsp;GB HDD SATA Dell PERC H330 Adp (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 420: Line 406:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G8R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:1a:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G8R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 8.0&nbsp;TB HDD SAS Seagate ST8000NM0185 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:1a:00.0-scsi-0:0:1:0</code>)  <br/>
* disk1, 8.0&nbsp;TB HDD SAS Seagate ST8000NM0185 (dev: <code class="file">/dev/disk1</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 467: Line 453:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce4fea-lun-0</code>)  (primary disk)<br />
* disk0, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce4fee-lun-0</code>)  <br />
* disk1, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk1</code>)  <br />
* disk2, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce5002-lun-0</code>)  <br />
* disk2, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk2</code>)  <br />
* disk3, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk3</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce500e-lun-0</code>)  <br />
* disk3, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk3</code>)  <br />
* disk4, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce5012-lun-0</code>)  <br />
* disk4, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk4</code>)  <br />
* disk5, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce5016-lun-0</code>)  <br />
* disk5, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk5</code>)  <br />
* disk6, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk6</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce501a-lun-0</code>)  <br />
* disk6, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk6</code>)  <br />
* disk7, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk7</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce502e-lun-0</code>)  <br/>
* disk7, 3.84&nbsp;TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk7</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 521: Line 507:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 299&nbsp;GB HDD SAS Dell PERC H730 Mini (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:03:00.0-scsi-0:2:0:0</code>)  (primary disk)<br />
* disk0, 299&nbsp;GB HDD SAS Dell PERC H730 Mini (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 299&nbsp;GB HDD SAS Dell PERC H730 Mini (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:03:00.0-scsi-0:2:1:0</code>)  <br/>
* disk1, 299&nbsp;GB HDD SAS Dell PERC H730 Mini (dev: <code class="file">/dev/disk1</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 570: Line 556:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b0c2-lun-0</code>)  (primary disk)<br />
* disk0, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b0e2-lun-0</code>)  <br />
* disk1, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk1</code>)  <br />
* disk2, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b0f2-lun-0</code>)  <br />
* disk2, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk2</code>)  <br />
* disk3, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk3</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b102-lun-0</code>)  <br />
* disk3, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk3</code>)  <br />
* disk4, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b112-lun-0</code>)  <br />
* disk4, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk4</code>)  <br />
* disk5, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b122-lun-0</code>)  <br />
* disk5, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk5</code>)  <br />
* disk6, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk6</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b132-lun-0</code>)  <br />
* disk6, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk6</code>)  <br />
* disk7, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk7</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b182-lun-0</code>)  <br/>
* disk7, 1.6&nbsp;TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk7</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/ens1f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice, SR-IOV enabled - no KaVLAN<br />
* eth0/ens1f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice, SR-IOV enabled<br />
* <span style="color:grey">eth1/ens1f1, Ethernet, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice - unavailable for experiment</span><br/>
* <span style="color:grey">eth1/ens1f1, Ethernet, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice - unavailable for experiment</span><br/>
|-
|-
Line 619: Line 605:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 599&nbsp;GB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:04:00.0-scsi-0:2:0:0</code>)  (primary disk)<br />
* disk0, 1.2&nbsp;TB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 4.0&nbsp;TB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:04:00.0-scsi-0:2:1:0</code>)  <br/>
* disk1, 4.0&nbsp;TB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk1</code>)  <br />
* disk2, 599&nbsp;GB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk2</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 629: Line 616:
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment</span><br />
* <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment</span><br />
* ib1, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br />
* <span style="color:grey">ib1, Omni-Path, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1 - unavailable for experiment</span><br />
* <span style="color:grey">ib2, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment</span><br/>
* <span style="color:grey">ib2, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment</span><br/>
|-
|-
Line 668: Line 655:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 479&nbsp;GB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:e1:00.0-scsi-0:2:0:0</code>)  (primary disk)<br/>
|  disk0, 479&nbsp;GB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 717: Line 704:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 1.92&nbsp;TB SSD SATA Samsung MZ7KH1T9HAJR0D3 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:1:0</code>)  (primary disk)<br/>
|  disk0, 1.92&nbsp;TB SSD SATA Samsung MZ7KH1T9HAJR0D3 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 754: Line 741:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 1.92&nbsp;TB SSD SATA Sk Hynix HFS1T9G32FEH-BA1 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:0:0</code>)  (primary disk)<br/>
|  disk0, 1.92&nbsp;TB SSD SATA Sk Hynix HFS1T9G32FEH-BA1 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 796: Line 783:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6130 (Skylake), x86_64, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
| Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 802: Line 789:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 1.0&nbsp;TB HDD SATA Seagate ST1000NX0443 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:11.5-ata-3</code>)  (primary disk)<br/>
|  disk0, 1.0&nbsp;TB HDD SATA Seagate ST1000NX0443 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
Line 810: Line 797:
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
* ib0, Omni-Path, configured rate: 100&nbsp;Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2024-04-25 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/53c24cb516 commit 53c24cb516])</small>''
|}
 
= Clusters in the testing queue =
 
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg/?filter=grdix%20only grdix] ==
 
'''16 nodes, 32 cpus, 4096 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grdix/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p grdix</code> <code>-I</code>}}
 
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| testing queue<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| ProLiant DL385 Gen11<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2024-09-02<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2024-09-27<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD EPYC 9754 (Zen 4c), x86_64, 2&nbsp;CPUs/node, 128&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 1.0&nbsp;TiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 1.6&nbsp;TB SSD NVME Samsung MO001600KYDMU (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0np0, Ethernet, configured rate: 25&nbsp;Gbps, model: Mellanox Technologies MT2894 Family [ConnectX-6 Lx], driver: mlx5_core, SR-IOV enabled<br />
* <span style="color:grey">eth1/ens22f1np1, Ethernet, model: Mellanox Technologies MT2894 Family [ConnectX-6 Lx], driver: mlx5_core - unavailable for experiment</span><br />
* ibs1, InfiniBand, configured rate: 200&nbsp;Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/>
|-
|}
 
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg/?filter=gres%20only gres] ==
 
'''7 nodes, 14 cpus, 336 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/gres/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p gres</code> <code>-I</code>}}
 
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| testing queue<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| ProLiant DL385 Gen11<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2024-08-07<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2024-08-23<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD EPYC 9254 (Zen 4), x86_64, 2&nbsp;CPUs/node, 24&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 512&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 6.4&nbsp;TB SSD NVME Samsung MO006400KYDND (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/ens22f0np0, Ethernet, configured rate: 25&nbsp;Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN<br />
* <span style="color:grey">eth1/ens22f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 2&nbsp;x&nbsp;Nvidia L40S&nbsp;(45&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;8.9<br/>
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2024-11-20 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/0a0d40ea34 commit 0a0d40ea34])</small>''

Latest revision as of 11:31, 20 November 2024

Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse

See also: Network topology for Nancy

Summary

  • 13 clusters
  • 268 nodes
  • 10568 CPU cores
  • 134 GPUs
  • 802304 GPUs cores
  • 57.88 TiB RAM
  • 311 SSDs and 129 HDDs on nodes (total: 528.52 TB)
  • 770.5 TFLOPS (excluding GPUs)

Default queue resources

  • 2 clusters
  • 126 nodes
  • 2360 CPU cores
  • 4 GPUs
  • 27648 GPUs cores
  • 11.88 TiB RAM
  • 252 SSDs and 0 HDDs on nodes (total: 184.36 TB)
  • 82.9 TFLOPS (excluding GPUs)

Production queue resources

  • 9 clusters
  • 119 nodes
  • 3776 CPU cores
  • 116 GPUs
  • 520192 GPUs cores
  • 26.5 TiB RAM
  • 36 SSDs and 129 HDDs on nodes (total: 273.74 TB)
  • 198.5 TFLOPS (excluding GPUs)

Clusters summary

Default queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
gros 2019-09-04 2019-07-16 124 1 Intel Xeon Gold 5220 18 cores/CPU x86_64 96 GiB 480 GB SSD + 960 GB SSD* 2 x 25 Gbps (SR‑IOV) 
grouille exotic job type 2021-01-13 2020-12-07 2 2 AMD EPYC 7452 32 cores/CPU x86_64 128 GiB 1.92 TB SSD + 960 GB SSD* 25 Gbps  2 x Nvidia A100 (40 GiB)

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments      ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment

Production queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
graffiti production queue 2019-06-07 2019-05-27 13 2 Intel Xeon Silver 4110 8 cores/CPU x86_64 128 GiB 479 GB HDD 10 Gbps  [1-12]: 4 x Nvidia RTX 2080 Ti (11 GiB)
13: 4 x Nvidia Quadro RTX 6000 (23 GiB)
grappe production queue 2020-08-20 2020-07-09 16 2 Intel Xeon Gold 5218R 20 cores/CPU x86_64 96 GiB 480 GB SSD + 8.0 TB HDD 25 Gbps 
grat production queue 2022-09-07 2022-06-22 1 2 AMD EPYC 7513 32 cores/CPU x86_64 512 GiB 3.84 TB SSD + 7 x 3.84 TB SSD 25 Gbps (SR‑IOV)  8 x Nvidia A100 (40 GiB)
grele production queue 2017-06-26 2017-06-07 14 2 Intel Xeon E5-2650 v4 12 cores/CPU x86_64 128 GiB 299 GB HDD + 299 GB HDD 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path 2 x Nvidia GTX 1080 Ti (11 GiB)
grosminet production queue 2023-12-05 2023-11-30 1 4 Intel Xeon Gold 6240L 18 cores/CPU x86_64 6.0 TiB 1.6 TB SSD + 7 x 1.6 TB SSD 25 Gbps (SR‑IOV) 
grostiti production queue 2024-01-10 2015-10-23 1 4 Intel Xeon E7-4850 v3 14 cores/CPU x86_64 1.5 TiB 1.2 TB HDD + 4.0 TB HDD + 599 GB HDD 10 Gbps (SR‑IOV) 
grue production queue 2019-11-25 2019-11-15 5 2 AMD EPYC 7351 16 cores/CPU x86_64 128 GiB 479 GB HDD 10 Gbps  4 x Nvidia Tesla T4 (15 GiB)
gruss production queue 2021-08-26 2021-06-24 4 2 AMD EPYC 7352 24 cores/CPU x86_64 256 GiB 1.92 TB SSD 25 Gbps  2 x Nvidia A40 (45 GiB)
grvingt production queue 2018-04-11 2018-04-01 64 2 Intel Xeon Gold 6130 16 cores/CPU x86_64 192 GiB 1.0 TB HDD 10 Gbps + 100 Gbps Omni-Path

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments      ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment

Testing queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
grdix testing queue 2024-09-27 2024-09-02 16 2 AMD EPYC 9754 128 cores/CPU x86_64 1.0 TiB 1.6 TB SSD 25 Gbps (SR‑IOV) + 200 Gbps InfiniBand
gres testing queue 2024-08-23 2024-08-07 7 2 AMD EPYC 9254 24 cores/CPU x86_64 512 GiB 6.4 TB SSD 25 Gbps  2 x Nvidia Tesla L40S (45 GiB)

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments      ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment

Clusters in the default queue

gros

124 nodes, 124 cpus, 2232 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png fnancy:
oarsub -p gros -I
gros-[1-26,28-67,69-124] (122 nodes, 122 cpus, 2196 cores)
Model: Dell PowerEdge R640
Manufacturing date: 2019-07-16
Date of arrival: 2019-09-04
CPU: Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU
Memory: 96 GiB
Storage:
  • disk0, 480 GB SSD SATA Micron MTFDDAK480TDN (dev: /dev/disk0) (primary disk)
  • disk1, 960 GB SSD SATA Micron MTFDDAK960TDN (dev: /dev/disk1*) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled (multi NICs example)
gros-27 (1 node, 1 cpu, 18 cores)
Model: Dell PowerEdge R640
Manufacturing date: 2019-07-16
Date of arrival: 2019-09-04
CPU: Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU
Memory: 96 GiB
Storage:
  • disk0, 480 GB SSD SATA Samsung MZ7KH480HAHQ0D3 (dev: /dev/disk0) (primary disk)
  • disk1, 960 GB SSD SATA Micron MTFDDAK960TDN (dev: /dev/disk1*) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled (multi NICs example)
gros-68 (1 node, 1 cpu, 18 cores)
Model: Dell PowerEdge R640
Manufacturing date: 2019-07-16
Date of arrival: 2019-09-04
CPU: Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU
Memory: 96 GiB
Storage:
  • disk0, 480 GB SSD SATA Micron MTFDDAK480TDN (dev: /dev/disk0) (primary disk)
  • disk1, 960 GB SSD SATA Intel SSDSC2KG960G8R (dev: /dev/disk1*) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled (multi NICs example)

grouille

2 nodes, 4 cpus, 128 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -t exotic -p grouille -I
Access condition: exotic job type
Model: Dell PowerEdge R7525
Manufacturing date: 2020-12-07
Date of arrival: 2021-01-13
CPU: AMD EPYC 7452 (Zen 2), x86_64, 2 CPUs/node, 32 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 1.92 TB SSD SAS Toshiba KRM5XVUG1T92 (dev: /dev/disk0) (primary disk)
  • disk1, 960 GB SSD SATA Micron MTFDDAK960TDT (dev: /dev/disk1*) (reservable)
Network:
  • eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 2 x Nvidia A100-PCIE-40GB (40 GiB)
Compute capability: 8.0

Note: This cluster is defined as exotic. Please read the exotic page for more information.

Clusters in the production queue

graffiti

13 nodes, 26 cpus, 208 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p graffiti -I

Max walltime per nodes:

  • graffiti-[1-3]: 24h
  • graffiti-[4-6]: 48h
  • graffiti-[7-13]: 168h
graffiti-[1-12] (12 nodes, 24 cpus, 192 cores)
Access condition: production queue
Model: Dell PowerEdge T640
Manufacturing date: 2019-05-27
Date of arrival: 2019-06-07
CPU: Intel Xeon Silver 4110 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU
Memory: 128 GiB
Storage: disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1np0, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
  • eth1/eno2np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
  • eth2/ens4f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth3/ens4f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
GPU: 4 x Nvidia GeForce RTX 2080 Ti (11 GiB)
Compute capability: 7.5
graffiti-13 (1 node, 2 cpus, 16 cores)
Access condition: production queue
Model: Dell PowerEdge T640
Manufacturing date: 2019-05-27
Date of arrival: 2019-06-07
CPU: Intel Xeon Silver 4110 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU
Memory: 128 GiB
Storage: disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1np0, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
  • eth1/eno2np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
  • eth2/ens4f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth3/ens4f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
GPU: 4 x Nvidia Quadro RTX 6000 (23 GiB)
Compute capability: 7.5

grappe

16 nodes, 32 cpus, 640 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grappe -I

Max walltime per nodes:

  • grappe-[1-4]: 48h
  • grappe-[5-8]: 96h
  • grappe-[9-16]: 168h
Access condition: production queue
Model: Dell PowerEdge R640
Manufacturing date: 2020-07-09
Date of arrival: 2020-08-20
CPU: Intel Xeon Gold 5218R (Cascade Lake-SP), x86_64, 2.10GHz, 2 CPUs/node, 20 cores/CPU
Memory: 96 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G8R (dev: /dev/disk0) (primary disk)
  • disk1, 8.0 TB HDD SAS Seagate ST8000NM0185 (dev: /dev/disk1)
Network:
  • eth0/ens1f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens1f1, Ethernet, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e - unavailable for experiment
  • eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment

grat

1 node, 2 cpus, 64 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grat -I

Max walltime per nodes:

  • grat-1: 168h
Access condition: production queue
Model: HPE Apollo 6500
Manufacturing date: 2022-06-22
Date of arrival: 2022-09-07
CPU: AMD EPYC 7513 (Zen 3), x86_64, 2 CPUs/node, 32 cores/CPU
Memory: 512 GiB
Storage:
  • disk0, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk0) (primary disk)
  • disk1, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk1)
  • disk2, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk2)
  • disk3, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk3)
  • disk4, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk4)
  • disk5, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk5)
  • disk6, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk6)
  • disk7, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk7)
Network:
  • eth0/ens21f0np0, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled
  • eth1/ens21f1np1, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 8 x Nvidia A100-SXM4-40GB (40 GiB)
Compute capability: 8.0

grele

14 nodes, 28 cpus, 336 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grele -I

Max walltime per nodes:

  • grele-[1-3]: 24h
  • grele-[4-6]: 48h
  • grele-[7-14]: 168h
Access condition: production queue
Model: Dell PowerEdge R730
Manufacturing date: 2017-06-07
Date of arrival: 2017-06-26
CPU: Intel Xeon E5-2650 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 12 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 299 GB HDD SAS Dell PERC H730 Mini (dev: /dev/disk0) (primary disk)
  • disk1, 299 GB HDD SAS Dell PERC H730 Mini (dev: /dev/disk1)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1
GPU: 2 x Nvidia GeForce GTX 1080 Ti (11 GiB)
Compute capability: 6.1

grosminet

1 node, 4 cpus, 72 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grosminet -I

Max walltime per nodes:

  • grosminet-1: 24h
Access condition: production queue
Model: Proliant DL560 Gen10
Manufacturing date: 2023-11-30
Date of arrival: 2023-12-05
CPU: Intel Xeon Gold 6240L (Cascade Lake-SP), x86_64, 2.60GHz, 4 CPUs/node, 18 cores/CPU
Memory: 6.0 TiB
Storage:
  • disk0, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk0) (primary disk)
  • disk1, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk1)
  • disk2, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk2)
  • disk3, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk3)
  • disk4, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk4)
  • disk5, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk5)
  • disk6, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk6)
  • disk7, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk7)
Network:
  • eth0/ens1f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice, SR-IOV enabled
  • eth1/ens1f1, Ethernet, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice - unavailable for experiment

grostiti

1 node, 4 cpus, 56 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grostiti -I

Max walltime per nodes:

  • grostiti-1: 168h
Access condition: production queue
Model: Dell PowerEdge R930
Manufacturing date: 2015-10-23
Date of arrival: 2024-01-10
CPU: Intel Xeon E7-4850 v3 (Haswell), x86_64, 2.20GHz, 4 CPUs/node, 14 cores/CPU
Memory: 1.5 TiB
Storage:
  • disk0, 1.2 TB HDD SAS Dell PERC H730P Adp (dev: /dev/disk0) (primary disk)
  • disk1, 4.0 TB HDD SAS Dell PERC H730P Adp (dev: /dev/disk1)
  • disk2, 599 GB HDD SAS Dell PERC H730P Adp (dev: /dev/disk2)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • ib0, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment
  • ib1, Omni-Path, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1 - unavailable for experiment
  • ib2, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment

grue

5 nodes, 10 cpus, 160 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grue -I

Max walltime per nodes:

  • grue-[1-2]: 24h
  • grue-[3-4]: 48h
  • grue-5: 168h
Access condition: production queue
Model: Dell PowerEdge R7425
Manufacturing date: 2019-11-15
Date of arrival: 2019-11-25
CPU: AMD EPYC 7351 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU
Memory: 128 GiB
Storage: disk0, 479 GB HDD SAS Dell PERC H730P Adp (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 4 x Nvidia Tesla T4 (15 GiB)
Compute capability: 7.5

gruss

4 nodes, 8 cpus, 192 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p gruss -I

Max walltime per nodes:

  • gruss-[1-2]: 24h
  • gruss-3: 48h
  • gruss-4: 168h
gruss-1 (1 node, 2 cpus, 48 cores)
Access condition: production queue
Model: Dell PowerEdge R7525
Manufacturing date: 2021-06-24
Date of arrival: 2021-08-26
CPU: AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU
Memory: 256 GiB
Storage: disk0, 1.92 TB SSD SATA Samsung MZ7KH1T9HAJR0D3 (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 2 x Nvidia A40 (45 GiB)
Compute capability: 8.6
gruss-[2-4] (3 nodes, 6 cpus, 144 cores)
Access condition: production queue
Model: Dell PowerEdge R7525
Manufacturing date: 2021-06-24
Date of arrival: 2021-08-26
CPU: AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU
Memory: 256 GiB
Storage: disk0, 1.92 TB SSD SATA Sk Hynix HFS1T9G32FEH-BA1 (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 2 x Nvidia A40 (45 GiB)
Compute capability: 8.6

grvingt

64 nodes, 128 cpus, 2048 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grvingt -I

Max walltime per nodes:

  • grvingt-[1-8]: 4h
  • grvingt-[9-16]: 12h
  • grvingt-[17-64]: 168h
Access condition: production queue
Model: Dell PowerEdge C6420
Manufacturing date: 2018-04-01
Date of arrival: 2018-04-11
CPU: Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU
Memory: 192 GiB
Storage: disk0, 1.0 TB HDD SATA Seagate ST1000NX0443 (dev: /dev/disk0) (primary disk)
Network:
  • eth0/enp24s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

Clusters in the testing queue

grdix

16 nodes, 32 cpus, 4096 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q testing -p grdix -I
Access condition: testing queue
Model: ProLiant DL385 Gen11
Manufacturing date: 2024-09-02
Date of arrival: 2024-09-27
CPU: AMD EPYC 9754 (Zen 4c), x86_64, 2 CPUs/node, 128 cores/CPU
Memory: 1.0 TiB
Storage: disk0, 1.6 TB SSD NVME Samsung MO001600KYDMU (dev: /dev/disk0) (primary disk)
Network:
  • eth0/enp1s0f0np0, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT2894 Family [ConnectX-6 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/ens22f1np1, Ethernet, model: Mellanox Technologies MT2894 Family [ConnectX-6 Lx], driver: mlx5_core - unavailable for experiment
  • ibs1, InfiniBand, configured rate: 200 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core

gres

7 nodes, 14 cpus, 336 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q testing -p gres -I
Access condition: testing queue
Model: ProLiant DL385 Gen11
Manufacturing date: 2024-08-07
Date of arrival: 2024-08-23
CPU: AMD EPYC 9254 (Zen 4), x86_64, 2 CPUs/node, 24 cores/CPU
Memory: 512 GiB
Storage: disk0, 6.4 TB SSD NVME Samsung MO006400KYDND (dev: /dev/disk0) (primary disk)
Network:
  • eth0/ens22f0np0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN
  • eth1/ens22f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
GPU: 2 x Nvidia L40S (45 GiB)
Compute capability: 8.9

Last generated from the Grid'5000 Reference API on 2024-11-20 (commit 0a0d40ea34)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Nancy:Hardware&oldid=104173"