Nancy:Hardware: Difference between revisions
Sphilippot (talk | contribs) No edit summary |
Lpouilloux (talk | contribs) No edit summary |
||
(141 intermediate revisions by 18 users not shown) | |||
Line 1: | Line 1: | ||
__NOEDITSECTION__ | __NOEDITSECTION__ | ||
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div> | {{Portal|User}} | ||
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Toulouse:Hardware|Toulouse]]</div> | |||
'''See also:''' [[Nancy:Network|Network topology for Nancy]] | |||
= Summary = | |||
* 11 clusters | |||
* 245 nodes | |||
* 6136 CPU cores | |||
* 120 GPUs | |||
* 547840 GPUs cores | |||
* 38.38 TiB RAM | |||
* 288 SSDs and 128 HDDs on nodes (total: 456.9 TB) | |||
* 281.4 TFLOPS (excluding GPUs) | |||
{|width="100%" border="0" | |||
|- | |||
| width="50%" valign="top" | | |||
{| width="100%" | |||
=== Default queue resources === | |||
* 2 clusters | |||
* 126 nodes | |||
* 2360 CPU cores | |||
* 4 GPUs | |||
* 27648 GPUs cores | |||
* 11.88 TiB RAM | |||
* 252 SSDs and 0 HDDs on nodes (total: 184.36 TB) | |||
* 82.9 TFLOPS (excluding GPUs) | |||
|} | |||
| width="50%" valign="top" | | |||
{| width="100%" | |||
=== Production queue resources === | |||
* 9 clusters | |||
* 119 nodes | |||
* 3776 CPU cores | |||
* 116 GPUs | |||
* 520192 GPUs cores | |||
* 26.5 TiB RAM | |||
* 36 SSDs and 128 HDDs on nodes (total: 272.54 TB) | |||
* 198.5 TFLOPS (excluding GPUs) | |||
|} | |||
|} | |||
= | = Clusters summary = | ||
''' | == Default queue resources == | ||
{|class="wikitable sortable" | |||
|- | |||
!rowspan=2|Cluster | |||
!rowspan=2|Access Condition | |||
!rowspan=2|Date of arrival | |||
!rowspan=2|Manufacturing date | |||
!data-sort-type="number" rowspan=2|Nodes | |||
!colspan=4|CPU | |||
!data-sort-type="number" rowspan=2|Memory | |||
!data-sort-type="number" rowspan=2|Storage | |||
!data-sort-type="number" rowspan=2|Network | |||
!rowspan=2|Accelerators | |||
|- | |||
!data-sort-type="number"|# | |||
!|Name | |||
!data-sort-type="number"|Cores | |||
!|Architecture | |||
|- | |||
|[[#gros|gros]]||||2019-09-04||2019-07-16||124||1||Intel Xeon Gold 5220||18 cores/CPU||x86_64||data-sort-value="103079215104"|96 GiB||data-sort-value="1341"|<b>480 GB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps (SR‑IOV) || | |||
|- | |||
|[[#grouille|grouille]]||<b>[[Exotic#Nancy:_grouille|exotic]]</b> job type||2021-01-13||2020-12-07||2||2||AMD EPYC 7452||32 cores/CPU||x86_64||data-sort-value="137438953472"|128 GiB||data-sort-value="2682"|<b>1.92 TB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="25000"|25 Gbps ||2 x Nvidia A100 (40 GiB) | |||
|- | |||
|} | |||
''*: disk is [[Disk_reservation|reservable]]'' ''**: crossed GPUs are not supported by Grid'5000 default environments'' ''***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment'' | |||
== Production queue resources == | |||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
!|Cluster | !rowspan=2|Cluster | ||
!| | !rowspan=2|Access Condition | ||
!|Date of arrival | !rowspan=2|Date of arrival | ||
!data-sort-type="number"|Nodes | !rowspan=2|Manufacturing date | ||
!|CPU | !data-sort-type="number" rowspan=2|Nodes | ||
!colspan=4|CPU | |||
!data-sort-type="number" rowspan=2|Memory | |||
!data-sort-type="number" rowspan=2|Storage | |||
!data-sort-type="number" rowspan=2|Network | |||
!rowspan=2|Accelerators | |||
|- | |||
!data-sort-type="number"|# | |||
!|Name | |||
!data-sort-type="number"|Cores | !data-sort-type="number"|Cores | ||
!data-sort- | !|Architecture | ||
|- | |||
|[[#graffiti|graffiti]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2019-06-07||2019-05-27||13||2||Intel Xeon Silver 4110||8 cores/CPU||x86_64||data-sort-value="137438953472"|128 GiB||data-sort-value="446"|<b>479 GB HDD</b>||data-sort-value="10000"|10 Gbps ||[1-12]: 4 x Nvidia RTX 2080 Ti (11 GiB)<br />13: 4 x Nvidia Quadro RTX 6000 (23 GiB) | |||
|- | |- | ||
|[[# | |[[#grappe|grappe]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2020-08-20||2020-07-09||16||2||Intel Xeon Gold 5218R||20 cores/CPU||x86_64||data-sort-value="103079215104"|96 GiB||data-sort-value="7899"|<b>480 GB SSD</b> + 8.0 TB HDD||data-sort-value="25000"|25 Gbps || | ||
|- | |- | ||
|[[# | |[[#grat|grat]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2022-09-07||2022-06-22||1||2||AMD EPYC 7513||32 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="28608"|<b>3.84 TB SSD</b> + 7 x 3.84 TB SSD||data-sort-value="25000"|25 Gbps (SR‑IOV) ||8 x Nvidia A100 (40 GiB) | ||
|- | |- | ||
|[[# | |[[#grele|grele]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2017-06-26||2017-06-07||14||2||Intel Xeon E5-2650 v4||12 cores/CPU||x86_64||data-sort-value="137438953472"|128 GiB||data-sort-value="556"|<b>299 GB HDD</b> + 299 GB HDD||data-sort-value="110000"|10 Gbps (SR‑IOV) + 100 Gbps Omni-Path||2 x Nvidia GTX 1080 Ti (11 GiB) | ||
|- | |- | ||
|[[# | |[[#grosminet|grosminet]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2023-12-05||2023-11-30||1||4||Intel Xeon Gold 6240L||18 cores/CPU||x86_64||data-sort-value="6597069766656"|6.0 TiB||data-sort-value="11920"|<b>1.6 TB SSD</b> + 7 x 1.6 TB SSD||data-sort-value="25000"|25 Gbps (SR‑IOV) || | ||
|- | |- | ||
|[[# | |[[#grostiti|grostiti]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2024-01-10||2015-10-23||1||4||Intel Xeon E7-4850 v3||14 cores/CPU||x86_64||data-sort-value="1649267441664"|1.5 TiB||data-sort-value="4282"|<b>599 GB HDD</b> + 4.0 TB HDD||data-sort-value="110000"|10 Gbps (SR‑IOV) + 100 Gbps Omni-Path|| | ||
|- | |- | ||
|[[# | |[[#grue|grue]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2019-11-25||2019-11-15||5||2||AMD EPYC 7351||16 cores/CPU||x86_64||data-sort-value="137438953472"|128 GiB||data-sort-value="446"|<b>479 GB HDD</b>||data-sort-value="10000"|10 Gbps ||4 x Nvidia Tesla T4 (15 GiB) | ||
|- | |- | ||
|[[# | |[[#gruss|gruss]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2021-08-26||2021-06-24||4||2||AMD EPYC 7352||24 cores/CPU||x86_64||data-sort-value="274877906944"|256 GiB||data-sort-value="1788"|<b>1.92 TB SSD</b>||data-sort-value="25000"|25 Gbps ||2 x Nvidia A40 (45 GiB) | ||
|- | |- | ||
|[[# | |[[#grvingt|grvingt]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2018-04-11||2018-04-01||64||2||Intel Xeon Gold 6130||16 cores/CPU||x86_64||data-sort-value="206158430208"|192 GiB||data-sort-value="931"|<b>1.0 TB HDD</b>||data-sort-value="110000"|10 Gbps + 100 Gbps Omni-Path|| | ||
|- | |- | ||
|[[ | |} | ||
''*: disk is [[Disk_reservation|reservable]]'' ''**: crossed GPUs are not supported by Grid'5000 default environments'' ''***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment'' | |||
= Clusters in the [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg/ default queue] = | |||
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg/?filter=gros%20only gros] == | |||
'''124 nodes, 124 cpus, 2232 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/gros/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
== | {{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="env">-p gros</code> <code>-I</code>}} | ||
; gros-[1-26,<wbr>28-67,<wbr>69-124] (122 nodes, 122 cpus, 2196 cores) | |||
{| | {| | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge R640<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2019-07-16<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2019-09-04<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 96 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* | * disk0, 480 GB SSD SATA Micron MTFDDAK480TDN (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:0:0</code>) (primary disk)<br /> | ||
* | * disk1, 960 GB SSD SATA Micron MTFDDAK960TDN (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: | * eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled<br /> | ||
* | * eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | ||
|- | |- | ||
|} | |} | ||
<hr style="height:10pt; visibility:hidden;" /> | |||
; gros-27 (1 node, 1 cpu, 18 cores) | |||
; | |||
{| | {| | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| | | Dell PowerEdge R640<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2019-07-16<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2019-09-04<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 96 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* disk0, 480 GB SSD SATA Samsung MZ7KH480HAHQ0D3 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:0:0</code>) (primary disk)<br /> | |||
* disk1, 960 GB SSD SATA Micron MTFDDAK960TDN (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled<br /> | ||
* eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
* | |||
|- | |- | ||
|} | |} | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
; | ; gros-68 (1 node, 1 cpu, 18 cores) | ||
{| | {| | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| | | Dell PowerEdge R640<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2019-07-16<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2019-09-04<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 96 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* disk0, 480 GB SSD SATA Micron MTFDDAK480TDN (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:0:0</code>) (primary disk)<br /> | |||
* disk1, 960 GB SSD SATA Intel SSDSC2KG960G8R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:17:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled<br /> | ||
* eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
* | |||
|- | |- | ||
|} | |} | ||
== | == [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg/?filter=grouille%20only grouille] == | ||
''' | '''2 nodes, 4 cpus, 128 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grouille/nodes.json?pretty=1 json]) | ||
; | |||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p grouille</code> <code>-I</code>}} | |||
; grouille-1 (1 node, 2 cpus, 64 cores) | |||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| [[Exotic#Nancy:_grouille|exotic]] job type<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge R7525<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2020-12-07<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2021-01-13<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| | | AMD EPYC 7452 (Zen 2), x86_64, 2 CPUs/node, 32 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 128 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* disk0, 1.92 TB SSD SAS Toshiba KRM5XVUG1T92 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:1:0</code>) (primary disk)<br /> | |||
* disk1, 960 GB SSD SATA Micron MTFDDAK960TDT (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:0:0</code>) [[Disk_reservation|(reservable)]] <br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet | * <span style="color:grey">eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth1/eno2, Ethernet, model: Broadcom NetXtreme | * <span style="color:grey">eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* | * eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br /> | ||
* <span style="color:grey">eth3/ | * <span style="color:grey">eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| 2 x Nvidia | | 2 x Nvidia A100-PCIE-40GB (40 GiB)<br>Compute capability: 8.0<br/> | ||
|- | |- | ||
|} | |} | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
; | ; grouille-2 (1 node, 2 cpus, 64 cores) | ||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| [[Exotic#Nancy:_grouille|exotic]] job type<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge R7525<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2020-12-07<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2021-01-13<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| | | AMD EPYC 7452 (Zen 2), x86_64, 2 CPUs/node, 32 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 128 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* disk0, 1.92 TB SSD SAS Toshiba KRM5XVUG1T92 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:1:0</code>) (primary disk)<br /> | |||
* disk1, 960 GB SSD SATA Micron MTFDDAK960TDT (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet | * <span style="color:grey">eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth1/eno2, Ethernet, model: Broadcom NetXtreme | * <span style="color:grey">eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* | * eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br /> | ||
* <span style="color:grey">eth3/ | * <span style="color:grey">eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| 2 x Nvidia | | 2 x Nvidia A100-PCIE-40GB (40 GiB)<br>Compute capability: 8.0<br/> | ||
|- | |||
|} | |||
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Nancy:_grouille|exotic]]''' page for more information.<br/> | |||
= Clusters in the [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/ production queue] = | |||
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=graffiti%20only graffiti] == | |||
'''13 nodes, 26 cpus, 208 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/graffiti/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p graffiti</code> <code>-I</code>}} | |||
'''Max walltime per nodes:''' | |||
* graffiti-[1-3]: 24h | |||
* graffiti-[4-6]: 48h | |||
* graffiti-[7-13]: 168h | |||
; graffiti-[1-12] (12 nodes, 24 cpus, 192 cores) | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge T640<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2019-05-27<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2019-06-07<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon Silver 4110 (Skylake), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 128 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:19:00.0-scsi-0:2:0:0</code>) (primary disk)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* <span style="color:grey">eth0/eno1np0, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth1/eno2np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br /> | |||
* eth2/ens4f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br /> | |||
* <span style="color:grey">eth3/ens4f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| 4 x Nvidia GeForce RTX 2080 Ti (11 GiB)<br>Compute capability: 7.5<br/> | |||
|- | |- | ||
|} | |} | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
; | ; graffiti-13 (1 node, 2 cpus, 16 cores) | ||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge T640<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2019-05-27<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2019-06-07<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon Silver 4110 (Skylake), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 128 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:19:00.0-scsi-0:2:0:0</code>) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * <span style="color:grey">eth0/eno1np0, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth1/ | * <span style="color:grey">eth1/eno2np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br /> | ||
* | * eth2/ens4f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br /> | ||
* <span style="color:grey">eth3/ | * <span style="color:grey">eth3/ens4f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| | | 4 x Nvidia Quadro RTX 6000 (23 GiB)<br>Compute capability: 7.5<br/> | ||
|- | |- | ||
|} | |} | ||
== | == [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=grappe%20only grappe] == | ||
'''16 nodes, 32 cpus, 640 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grappe/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p grappe</code> <code>-I</code>}} | |||
'''Max walltime per nodes:''' | |||
* grappe-[1-4]: 48h | |||
* grappe-[5-8]: 96h | |||
* grappe-[9-16]: 168h | |||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge R640<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2020-07-09<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2020-08-20<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon Gold 5218R (Cascade Lake-SP), x86_64, 2.10GHz, 2 CPUs/node, 20 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 96 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* | * disk0, 480 GB SSD SATA Intel SSDSC2KG480G8R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:1a:00.0-scsi-0:0:0:0</code>) (primary disk)<br /> | ||
* | * disk1, 8.0 TB HDD SAS Seagate ST8000NM0185 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:1a:00.0-scsi-0:0:1:0</code>) <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/ens1f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | ||
* <span style="color:grey"> | * <span style="color:grey">eth1/ens1f1, Ethernet, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e - unavailable for experiment</span><br /> | ||
* <span style="color:grey"> | * <span style="color:grey">eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* <span style="color:grey"> | * <span style="color:grey">eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* | * <span style="color:grey">eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/> | |||
|- | |||
|} | |||
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=grat%20only grat] == | |||
'''1 node, 2 cpus, 64 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grat/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p grat</code> <code>-I</code>}} | |||
'''Max walltime per nodes:''' | |||
* grat-1: 168h | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| HPE Apollo 6500<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2022-06-22<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2022-09-07<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| AMD EPYC 7513 (Zen 3), x86_64, 2 CPUs/node, 32 cores/CPU<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 512 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 3.84 TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce4fea-lun-0</code>) (primary disk)<br /> | |||
* disk1, 3.84 TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce4fee-lun-0</code>) <br /> | |||
* disk2, 3.84 TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce5002-lun-0</code>) <br /> | |||
* disk3, 3.84 TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk3</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce500e-lun-0</code>) <br /> | |||
* disk4, 3.84 TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce5012-lun-0</code>) <br /> | |||
* disk5, 3.84 TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce5016-lun-0</code>) <br /> | |||
* disk6, 3.84 TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk6</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce501a-lun-0</code>) <br /> | |||
* disk7, 3.84 TB SSD SAS HP VO003840RZWVA (dev: <code class="file">/dev/disk7</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:64:00.0-sas-0x58ce38ee21ce502e-lun-0</code>) <br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/ens21f0np0, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled<br /> | |||
* <span style="color:grey">eth1/ens21f1np1, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| | | 8 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/> | ||
|- | |- | ||
|} | |} | ||
== grele | == [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=grele%20only grele] == | ||
'''14 nodes, 28 cpus, 336 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grele/nodes.json?pretty=1 json]) | '''14 nodes, 28 cpus, 336 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grele/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p grele</code> <code>-I</code>}} | |||
'''Max walltime per nodes:''' | |||
* grele-[1-3]: 24h | |||
* grele-[4-6]: 48h | |||
* grele-[7-14]: 168h | |||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge R730<br/> | | Dell PowerEdge R730<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2017-06-07<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 279: | Line 514: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2650 v4 Broadwell | | Intel Xeon E5-2650 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 12 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| 128 | | 128 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* | * disk0, 299 GB HDD SAS Dell PERC H730 Mini (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:03:00.0-scsi-0:2:0:0</code>) (primary disk)<br /> | ||
* | * disk1, 299 GB HDD SAS Dell PERC H730 Mini (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:03:00.0-scsi-0:2:1:0</code>) <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* <span style="color:grey">eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| 2 x Nvidia GTX 1080 Ti<br/> | | 2 x Nvidia GeForce GTX 1080 Ti (11 GiB)<br>Compute capability: 6.1<br/> | ||
|- | |- | ||
|} | |} | ||
== | == [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=grosminet%20only grosminet] == | ||
'''1 node, 4 cpus, 72 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grosminet/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p grosminet</code> <code>-I</code>}} | |||
'''Max walltime per nodes:''' | |||
* grosminet-1: 24h | |||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| | | Proliant DL560 Gen10<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2023-11-30<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2023-12-05<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon Gold 6240L (Cascade Lake-SP), x86_64, 2.60GHz, 4 CPUs/node, 18 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 6.0 TiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* disk0, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b0c2-lun-0</code>) (primary disk)<br /> | |||
* disk1, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b0e2-lun-0</code>) <br /> | |||
* disk2, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b0f2-lun-0</code>) <br /> | |||
* disk3, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk3</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b102-lun-0</code>) <br /> | |||
* disk4, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b112-lun-0</code>) <br /> | |||
* disk5, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b122-lun-0</code>) <br /> | |||
* disk6, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk6</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b132-lun-0</code>) <br /> | |||
* disk7, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: <code class="file">/dev/disk7</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:28:00.0-sas-0x50000f0b02a4b182-lun-0</code>) <br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/ens1f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice, SR-IOV enabled - no KaVLAN<br /> | ||
* <span style="color:grey">eth1/ | * <span style="color:grey">eth1/ens1f1, Ethernet, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice - unavailable for experiment</span><br/> | ||
|- | |- | ||
|} | |} | ||
== | == [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=grostiti%20only grostiti] == | ||
'''1 node, 4 cpus, 56 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grostiti/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p grostiti</code> <code>-I</code>}} | |||
'''Max walltime per nodes:''' | |||
* grostiti-1: 168h | |||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge R930<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2015-10-23<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2024-01-10<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon E7-4850 v3 (Haswell), x86_64, 2.20GHz, 4 CPUs/node, 14 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 1.5 TiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* disk0, 599 GB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:04:00.0-scsi-0:2:0:0</code>) (primary disk)<br /> | |||
* disk1, 4.0 TB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:04:00.0-scsi-0:2:1:0</code>) <br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* <span style="color:grey">eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment</span><br /> | |||
* ib1, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br /> | |||
* <span style="color:grey">ib2, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment</span><br/> | |||
|- | |- | ||
|} | |} | ||
== | == [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=grue%20only grue] == | ||
'''5 nodes, 10 cpus, 160 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grue/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p grue</code> <code>-I</code>}} | |||
'''Max walltime per nodes:''' | |||
* grue-[1-2]: 24h | |||
* grue-[3-4]: 48h | |||
* grue-5: 168h | |||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge R7425<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2019-11-15<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2019-11-25<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| | | AMD EPYC 7351 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| 128 | | 128 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | disk0, 479 GB HDD SAS Dell PERC H730P Adp (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:e1:00.0-scsi-0:2:0:0</code>) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br /> | ||
* eth1/eno2, Ethernet | * <span style="color:grey">eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | |||
* <span style="color:grey"> | |- | ||
* <span style="color:grey"> | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| 4 x Nvidia Tesla T4 (15 GiB)<br>Compute capability: 7.5<br/> | |||
|- | |- | ||
|} | |} | ||
== | == [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=gruss%20only gruss] == | ||
''' | '''4 nodes, 8 cpus, 192 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/gruss/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p gruss</code> <code>-I</code>}} | |||
'''Max walltime per nodes:''' | |||
* gruss-[1-2]: 24h | |||
* gruss-3: 48h | |||
* gruss-4: 168h | |||
; gruss-1 (1 node, 2 cpus, 48 cores) | |||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge R7525<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2021-06-24<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2021-08-26<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| | | AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 256 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | disk0, 1.92 TB SSD SATA Samsung MZ7KH1T9HAJR0D3 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:1:0</code>) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet | * <span style="color:grey">eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* eth1/eno2, Ethernet | * <span style="color:grey">eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br /> | |||
* <span style="color:grey">eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | |||
* | |- | ||
* <span style="color:grey"> | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| 2 x Nvidia A40 (45 GiB)<br>Compute capability: 8.6<br/> | |||
|- | |- | ||
|} | |} | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
; | ; gruss-[2-4] (3 nodes, 6 cpus, 144 cores) | ||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge R7525<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2021-06-24<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2021-08-26<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| | | AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 256 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | disk0, 1.92 TB SSD SATA Sk Hynix HFS1T9G32FEH-BA1 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:0:0</code>) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet | * <span style="color:grey">eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* eth1/eno2, Ethernet | * <span style="color:grey">eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br /> | |||
* | * <span style="color:grey">eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | ||
* <span style="color:grey"> | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| 2 x Nvidia A40 (45 GiB)<br>Compute capability: 8.6<br/> | |||
|- | |- | ||
|} | |} | ||
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=grvingt%20only grvingt] == | |||
'''64 nodes, 128 cpus, 2048 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grvingt/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p grvingt</code> <code>-I</code>}} | |||
'''Max walltime per nodes:''' | |||
* grvingt-[1-8]: 4h | |||
* grvingt-[9-16]: 12h | |||
* grvingt-[17-64]: 168h | |||
{| | {| | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| production queue<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge | | Dell PowerEdge C6420<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2018-04-01<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2018-04-11<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon Gold 6130 (Skylake), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 192 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | disk0, 1.0 TB HDD SATA Seagate ST1000NX0443 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:11.5-ata-3</code>) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/enp24s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br /> | ||
* <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br /> | |||
* ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/> | |||
* <span style="color:grey"> | |||
* ib0, | |||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on | |}''<small>Last generated from the Grid'5000 Reference API on 2024-05-03 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/3e11476b07 commit 3e11476b07])</small>'' |
Latest revision as of 09:46, 3 May 2024
See also: Network topology for Nancy
Summary
- 11 clusters
- 245 nodes
- 6136 CPU cores
- 120 GPUs
- 547840 GPUs cores
- 38.38 TiB RAM
- 288 SSDs and 128 HDDs on nodes (total: 456.9 TB)
- 281.4 TFLOPS (excluding GPUs)
Default queue resources
|
Production queue resources
|
Clusters summary
Default queue resources
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
gros | 2019-09-04 | 2019-07-16 | 124 | 1 | Intel Xeon Gold 5220 | 18 cores/CPU | x86_64 | 96 GiB | 480 GB SSD + 960 GB SSD* | 2 x 25 Gbps (SR‑IOV) | ||
grouille | exotic job type | 2021-01-13 | 2020-12-07 | 2 | 2 | AMD EPYC 7452 | 32 cores/CPU | x86_64 | 128 GiB | 1.92 TB SSD + 960 GB SSD* | 25 Gbps | 2 x Nvidia A100 (40 GiB) |
*: disk is reservable **: crossed GPUs are not supported by Grid'5000 default environments ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment
Production queue resources
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
graffiti | production queue | 2019-06-07 | 2019-05-27 | 13 | 2 | Intel Xeon Silver 4110 | 8 cores/CPU | x86_64 | 128 GiB | 479 GB HDD | 10 Gbps | [1-12]: 4 x Nvidia RTX 2080 Ti (11 GiB) 13: 4 x Nvidia Quadro RTX 6000 (23 GiB) |
grappe | production queue | 2020-08-20 | 2020-07-09 | 16 | 2 | Intel Xeon Gold 5218R | 20 cores/CPU | x86_64 | 96 GiB | 480 GB SSD + 8.0 TB HDD | 25 Gbps | |
grat | production queue | 2022-09-07 | 2022-06-22 | 1 | 2 | AMD EPYC 7513 | 32 cores/CPU | x86_64 | 512 GiB | 3.84 TB SSD + 7 x 3.84 TB SSD | 25 Gbps (SR‑IOV) | 8 x Nvidia A100 (40 GiB) |
grele | production queue | 2017-06-26 | 2017-06-07 | 14 | 2 | Intel Xeon E5-2650 v4 | 12 cores/CPU | x86_64 | 128 GiB | 299 GB HDD + 299 GB HDD | 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path | 2 x Nvidia GTX 1080 Ti (11 GiB) |
grosminet | production queue | 2023-12-05 | 2023-11-30 | 1 | 4 | Intel Xeon Gold 6240L | 18 cores/CPU | x86_64 | 6.0 TiB | 1.6 TB SSD + 7 x 1.6 TB SSD | 25 Gbps (SR‑IOV) | |
grostiti | production queue | 2024-01-10 | 2015-10-23 | 1 | 4 | Intel Xeon E7-4850 v3 | 14 cores/CPU | x86_64 | 1.5 TiB | 599 GB HDD + 4.0 TB HDD | 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path | |
grue | production queue | 2019-11-25 | 2019-11-15 | 5 | 2 | AMD EPYC 7351 | 16 cores/CPU | x86_64 | 128 GiB | 479 GB HDD | 10 Gbps | 4 x Nvidia Tesla T4 (15 GiB) |
gruss | production queue | 2021-08-26 | 2021-06-24 | 4 | 2 | AMD EPYC 7352 | 24 cores/CPU | x86_64 | 256 GiB | 1.92 TB SSD | 25 Gbps | 2 x Nvidia A40 (45 GiB) |
grvingt | production queue | 2018-04-11 | 2018-04-01 | 64 | 2 | Intel Xeon Gold 6130 | 16 cores/CPU | x86_64 | 192 GiB | 1.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path |
*: disk is reservable **: crossed GPUs are not supported by Grid'5000 default environments ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment
Clusters in the default queue
gros
124 nodes, 124 cpus, 2232 cores, split as follows due to differences between nodes (json)
Reservation example:
- gros-[1-26,
28-67, 69-124] (122 nodes, 122 cpus, 2196 cores)
Model: | Dell PowerEdge R640 |
Manufacturing date: | 2019-07-16 |
Date of arrival: | 2019-09-04 |
CPU: | Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU |
Memory: | 96 GiB |
Storage: |
|
Network: |
|
- gros-27 (1 node, 1 cpu, 18 cores)
Model: | Dell PowerEdge R640 |
Manufacturing date: | 2019-07-16 |
Date of arrival: | 2019-09-04 |
CPU: | Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU |
Memory: | 96 GiB |
Storage: |
|
Network: |
|
- gros-68 (1 node, 1 cpu, 18 cores)
Model: | Dell PowerEdge R640 |
Manufacturing date: | 2019-07-16 |
Date of arrival: | 2019-09-04 |
CPU: | Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU |
Memory: | 96 GiB |
Storage: |
|
Network: |
|
grouille
2 nodes, 4 cpus, 128 cores, split as follows due to differences between nodes (json)
Reservation example:
- grouille-1 (1 node, 2 cpus, 64 cores)
Access condition: | exotic job type |
Model: | Dell PowerEdge R7525 |
Manufacturing date: | 2020-12-07 |
Date of arrival: | 2021-01-13 |
CPU: | AMD EPYC 7452 (Zen 2), x86_64, 2 CPUs/node, 32 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia A100-PCIE-40GB (40 GiB) Compute capability: 8.0 |
- grouille-2 (1 node, 2 cpus, 64 cores)
Access condition: | exotic job type |
Model: | Dell PowerEdge R7525 |
Manufacturing date: | 2020-12-07 |
Date of arrival: | 2021-01-13 |
CPU: | AMD EPYC 7452 (Zen 2), x86_64, 2 CPUs/node, 32 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia A100-PCIE-40GB (40 GiB) Compute capability: 8.0 |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
Clusters in the production queue
graffiti
13 nodes, 26 cpus, 208 cores, split as follows due to differences between nodes (json)
Reservation example:
Max walltime per nodes:
- graffiti-[1-3]: 24h
- graffiti-[4-6]: 48h
- graffiti-[7-13]: 168h
- graffiti-[1-12] (12 nodes, 24 cpus, 192 cores)
Access condition: | production queue |
Model: | Dell PowerEdge T640 |
Manufacturing date: | 2019-05-27 |
Date of arrival: | 2019-06-07 |
CPU: | Intel Xeon Silver 4110 (Skylake), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 128 GiB |
Storage: | disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:19:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
GPU: | 4 x Nvidia GeForce RTX 2080 Ti (11 GiB) Compute capability: 7.5 |
- graffiti-13 (1 node, 2 cpus, 16 cores)
Access condition: | production queue |
Model: | Dell PowerEdge T640 |
Manufacturing date: | 2019-05-27 |
Date of arrival: | 2019-06-07 |
CPU: | Intel Xeon Silver 4110 (Skylake), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 128 GiB |
Storage: | disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:19:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
GPU: | 4 x Nvidia Quadro RTX 6000 (23 GiB) Compute capability: 7.5 |
grappe
16 nodes, 32 cpus, 640 cores (json)
Reservation example:
Max walltime per nodes:
- grappe-[1-4]: 48h
- grappe-[5-8]: 96h
- grappe-[9-16]: 168h
Access condition: | production queue |
Model: | Dell PowerEdge R640 |
Manufacturing date: | 2020-07-09 |
Date of arrival: | 2020-08-20 |
CPU: | Intel Xeon Gold 5218R (Cascade Lake-SP), x86_64, 2.10GHz, 2 CPUs/node, 20 cores/CPU |
Memory: | 96 GiB |
Storage: |
|
Network: |
|
grat
1 node, 2 cpus, 64 cores (json)
Reservation example:
Max walltime per nodes:
- grat-1: 168h
Access condition: | production queue |
Model: | HPE Apollo 6500 |
Manufacturing date: | 2022-06-22 |
Date of arrival: | 2022-09-07 |
CPU: | AMD EPYC 7513 (Zen 3), x86_64, 2 CPUs/node, 32 cores/CPU |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia A100-SXM4-40GB (40 GiB) Compute capability: 8.0 |
grele
14 nodes, 28 cpus, 336 cores (json)
Reservation example:
Max walltime per nodes:
- grele-[1-3]: 24h
- grele-[4-6]: 48h
- grele-[7-14]: 168h
Access condition: | production queue |
Model: | Dell PowerEdge R730 |
Manufacturing date: | 2017-06-07 |
Date of arrival: | 2017-06-26 |
CPU: | Intel Xeon E5-2650 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 12 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia GeForce GTX 1080 Ti (11 GiB) Compute capability: 6.1 |
grosminet
1 node, 4 cpus, 72 cores (json)
Reservation example:
Max walltime per nodes:
- grosminet-1: 24h
Access condition: | production queue |
Model: | Proliant DL560 Gen10 |
Manufacturing date: | 2023-11-30 |
Date of arrival: | 2023-12-05 |
CPU: | Intel Xeon Gold 6240L (Cascade Lake-SP), x86_64, 2.60GHz, 4 CPUs/node, 18 cores/CPU |
Memory: | 6.0 TiB |
Storage: |
|
Network: |
|
grostiti
1 node, 4 cpus, 56 cores (json)
Reservation example:
Max walltime per nodes:
- grostiti-1: 168h
Access condition: | production queue |
Model: | Dell PowerEdge R930 |
Manufacturing date: | 2015-10-23 |
Date of arrival: | 2024-01-10 |
CPU: | Intel Xeon E7-4850 v3 (Haswell), x86_64, 2.20GHz, 4 CPUs/node, 14 cores/CPU |
Memory: | 1.5 TiB |
Storage: |
|
Network: |
|
grue
5 nodes, 10 cpus, 160 cores (json)
Reservation example:
Max walltime per nodes:
- grue-[1-2]: 24h
- grue-[3-4]: 48h
- grue-5: 168h
Access condition: | production queue |
Model: | Dell PowerEdge R7425 |
Manufacturing date: | 2019-11-15 |
Date of arrival: | 2019-11-25 |
CPU: | AMD EPYC 7351 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU |
Memory: | 128 GiB |
Storage: | disk0, 479 GB HDD SAS Dell PERC H730P Adp (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:e1:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
GPU: | 4 x Nvidia Tesla T4 (15 GiB) Compute capability: 7.5 |
gruss
4 nodes, 8 cpus, 192 cores, split as follows due to differences between nodes (json)
Reservation example:
Max walltime per nodes:
- gruss-[1-2]: 24h
- gruss-3: 48h
- gruss-4: 168h
- gruss-1 (1 node, 2 cpus, 48 cores)
Access condition: | production queue |
Model: | Dell PowerEdge R7525 |
Manufacturing date: | 2021-06-24 |
Date of arrival: | 2021-08-26 |
CPU: | AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU |
Memory: | 256 GiB |
Storage: | disk0, 1.92 TB SSD SATA Samsung MZ7KH1T9HAJR0D3 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:1:0 ) (primary disk) |
Network: |
|
GPU: | 2 x Nvidia A40 (45 GiB) Compute capability: 8.6 |
- gruss-[2-4] (3 nodes, 6 cpus, 144 cores)
Access condition: | production queue |
Model: | Dell PowerEdge R7525 |
Manufacturing date: | 2021-06-24 |
Date of arrival: | 2021-08-26 |
CPU: | AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU |
Memory: | 256 GiB |
Storage: | disk0, 1.92 TB SSD SATA Sk Hynix HFS1T9G32FEH-BA1 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:0:0 ) (primary disk) |
Network: |
|
GPU: | 2 x Nvidia A40 (45 GiB) Compute capability: 8.6 |
grvingt
64 nodes, 128 cpus, 2048 cores (json)
Reservation example:
Max walltime per nodes:
- grvingt-[1-8]: 4h
- grvingt-[9-16]: 12h
- grvingt-[17-64]: 168h
Access condition: | production queue |
Model: | Dell PowerEdge C6420 |
Manufacturing date: | 2018-04-01 |
Date of arrival: | 2018-04-11 |
CPU: | Intel Xeon Gold 6130 (Skylake), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU |
Memory: | 192 GiB |
Storage: | disk0, 1.0 TB HDD SATA Seagate ST1000NX0443 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:00:11.5-ata-3 ) (primary disk) |
Network: |
|
Last generated from the Grid'5000 Reference API on 2024-05-03 (commit 3e11476b07)