Rennes:Hardware: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
Jlelaurain (talk | contribs) No edit summary |
||
Line 5: | Line 5: | ||
'''See also:''' [[Rennes:Network|Network topology for Rennes]] | '''See also:''' [[Rennes:Network|Network topology for Rennes]] | ||
= Summary = | = Summary = | ||
* | * 5 clusters | ||
* | * 109 nodes | ||
* | * 1948 CPU cores | ||
* 6 GPUs | * 6 GPUs | ||
* 14. | * 14.75 TiB RAM | ||
* 33 SSDs and | * 33 SSDs and 316 HDDs on nodes (total: 202.08 TB) | ||
* | * 72.7 TFLOPS (excluding GPUs) | ||
= Clusters = | = Clusters = | ||
Line 39: | Line 39: | ||
|- | |- | ||
|[[#paravance|paravance]]||||2015-01-13||72||2||Intel Xeon E5-2630 v3||8 cores/CPU||x86_64||128 GiB||data-sort-value="1116"|<b>600 GB HDD</b> + 600 GB HDD||data-sort-value="20000"|2 x 10 Gbps (SR‑IOV) || | |[[#paravance|paravance]]||||2015-01-13||72||2||Intel Xeon E5-2630 v3||8 cores/CPU||x86_64||128 GiB||data-sort-value="1116"|<b>600 GB HDD</b> + 600 GB HDD||data-sort-value="20000"|2 x 10 Gbps (SR‑IOV) || | ||
|- | |||
|[[#roazhon4|roazhon4]]||<b>testing</b> queue||2023-09-06||1||2||AMD EPYC 7H12||64 cores/CPU||x86_64||512 GiB||data-sort-value="2310"|<b>480 GB HDD</b> + 2.0 TB HDD||data-sort-value="1000"|1 Gbps || | |||
|- | |- | ||
|} | |} | ||
Line 64: | Line 66: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU | | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 98: | Line 100: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU | | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 132: | Line 134: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU | | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 166: | Line 168: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU | | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 206: | Line 208: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU | | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 251: | Line 253: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| AMD EPYC 7413 (Zen 3, 2 CPUs/node, 24 cores/CPU | | AMD EPYC 7413 (Zen 3), x86_64, 2 CPUs/node, 24 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 297: | Line 299: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU | | Intel Xeon E5-2660 v2 (Sandy Bridge), x86_64, 2.20GHz, 2 CPUs/node, 10 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 333: | Line 335: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU | | Intel Xeon E5-2660 v2 (Sandy Bridge), x86_64, 2.20GHz, 2 CPUs/node, 10 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 369: | Line 371: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU | | Intel Xeon E5-2660 v2 (Sandy Bridge), x86_64, 2.20GHz, 2 CPUs/node, 10 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 405: | Line 407: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU | | Intel Xeon E5-2660 v2 (Sandy Bridge), x86_64, 2.20GHz, 2 CPUs/node, 10 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 425: | Line 427: | ||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on 2023-09- | |} | ||
= Clusters in the testing queue = | |||
== [https://intranet.grid5000.fr/oar/Rennes/drawgantt-svg/?filter=roazhon4%20only roazhon4] == | |||
'''1 node, 2 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/rennes/clusters/roazhon4/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=frennes|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p roazhon4</code> <code>-I</code>}} | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| testing queue<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge R7525<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2023-09-06<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| AMD EPYC 7H12 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 512 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 480 GB HDD SATA Dell DELLBOSS VD (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:21:00.0-ata-1</code>) (primary disk)<br /> | |||
* disk1, 2.0 TB HDD SAS Seagate ST2000NM013A (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:0:0:0</code>) <br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/eno1, Ethernet, configured rate: 1 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - no KaVLAN<br /> | |||
* <span style="color:grey">eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth2/eno33, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth3/eno34, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br/> | |||
|- | |||
|}''<small>Last generated from the Grid'5000 Reference API on 2023-09-21 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/01066ef497 commit 01066ef497])</small>'' |
Revision as of 14:32, 21 September 2023
Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Toulouse
See also: Network topology for Rennes
Summary
- 5 clusters
- 109 nodes
- 1948 CPU cores
- 6 GPUs
- 14.75 TiB RAM
- 33 SSDs and 316 HDDs on nodes (total: 202.08 TB)
- 72.7 TFLOPS (excluding GPUs)
Clusters
Cluster | Access Condition | Date of arrival | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | ||||||||
abacus25 | production queue | 2023-06-05 | 2 | 2 | AMD EPYC 7413 | 24 cores/CPU | x86_64 | 512 GiB | 960 GB SSD + 2 x 960 GB SSD | 10 Gbps (SR‑IOV) | 3 x Nvidia A40 (45 GiB) |
paranoia | production queue | 2014-02-21 | 7 | 2 | Intel Xeon E5-2660 v2 | 10 cores/CPU | x86_64 | 128 GiB | 600 GB HDD + 4 x 600 GB HDD | 1 Gbps (SR‑IOV) + 2 x 10 Gbps (SR‑IOV) | |
parasilo | 2015-01-13 | 27 | 2 | Intel Xeon E5-2630 v3 | 8 cores/CPU | x86_64 | 128 GiB | 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* | 2 x 10 Gbps (SR‑IOV) | ||
paravance | 2015-01-13 | 72 | 2 | Intel Xeon E5-2630 v3 | 8 cores/CPU | x86_64 | 128 GiB | 600 GB HDD + 600 GB HDD | 2 x 10 Gbps (SR‑IOV) | ||
roazhon4 | testing queue | 2023-09-06 | 1 | 2 | AMD EPYC 7H12 | 64 cores/CPU | x86_64 | 512 GiB | 480 GB HDD + 2.0 TB HDD | 1 Gbps |
*: disk is reservable
**: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the default queue
parasilo
27 nodes, 54 cpus, 432 cores, split as follows due to differences between nodes (json)
Reservation example:
- parasilo-[1-5,
7-12, 14-15, 17-24, 26-28] (24 nodes, 48 cpus, 384 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- parasilo-6 (1 node, 2 cpus, 16 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- parasilo-13 (1 node, 2 cpus, 16 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- parasilo-25 (1 node, 2 cpus, 16 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
paravance
72 nodes, 144 cpus, 1152 cores (json)
Reservation example:
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell), x86_64, 2.40GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
Clusters in the production queue
abacus25
2 nodes, 4 cpus, 96 cores (json)
Reservation example:
Max walltime per nodes:
- abacus25-1: 96h
- abacus25-2: 168h
Access condition: | production queue |
Model: | HPE ProLiant DL385 Gen10+ v2 |
Date of arrival: | 2023-06-05 |
CPU: | AMD EPYC 7413 (Zen 3), x86_64, 2 CPUs/node, 24 cores/CPU |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
GPU: | 3 x Nvidia A40 (45 GiB) Compute capability: 8.6 |
paranoia
7 nodes, 14 cpus, 140 cores, split as follows due to differences between nodes (json)
Reservation example:
Max walltime per nodes:
- paranoia-[1-4]: 12h
- paranoia-[5-7]: 168h
- paranoia-[1-2,
5, 7] (4 nodes, 8 cpus, 80 cores)
Access condition: | production queue |
Model: | Dell PowerEdge C6220 II |
Date of arrival: | 2014-02-21 |
CPU: | Intel Xeon E5-2660 v2 (Sandy Bridge), x86_64, 2.20GHz, 2 CPUs/node, 10 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- paranoia-3 (1 node, 2 cpus, 20 cores)
Access condition: | production queue |
Model: | Dell PowerEdge C6220 II |
Date of arrival: | 2014-02-21 |
CPU: | Intel Xeon E5-2660 v2 (Sandy Bridge), x86_64, 2.20GHz, 2 CPUs/node, 10 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- paranoia-4 (1 node, 2 cpus, 20 cores)
Access condition: | production queue |
Model: | Dell PowerEdge C6220 II |
Date of arrival: | 2014-02-21 |
CPU: | Intel Xeon E5-2660 v2 (Sandy Bridge), x86_64, 2.20GHz, 2 CPUs/node, 10 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- paranoia-8 (1 node, 2 cpus, 20 cores)
Access condition: | production queue |
Model: | Dell PowerEdge C6220 II |
Date of arrival: | 2014-02-21 |
CPU: | Intel Xeon E5-2660 v2 (Sandy Bridge), x86_64, 2.20GHz, 2 CPUs/node, 10 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
Clusters in the testing queue
roazhon4
1 node, 2 cpus, 128 cores (json)
Reservation example:
Access condition: | testing queue |
Model: | Dell PowerEdge R7525 |
Date of arrival: | 2023-09-06 |
CPU: | AMD EPYC 7H12 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
Last generated from the Grid'5000 Reference API on 2023-09-21 (commit 01066ef497)