Grenoble:Hardware: Difference between revisions
No edit summary |
No edit summary |
||
Line 4: | Line 4: | ||
'''See also:''' [[Grenoble:Network|Network topology for Grenoble]] | '''See also:''' [[Grenoble:Network|Network topology for Grenoble]] | ||
= Summary = | = Summary = | ||
* | * 6 clusters | ||
* | * 55 nodes | ||
* | * 1808 CPU cores | ||
* 48 GPUs | * 48 GPUs | ||
* 172032 GPUs cores | * 172032 GPUs cores | ||
* 12. | * 12.31 TiB RAM + 6.0 TiB PMEM | ||
* | * 90 SSDs and 68 HDDs on nodes (total: 230.93 TB) | ||
* | * 108.9 TFLOPS (excluding GPUs) | ||
= Clusters summary = | = Clusters summary = | ||
== Default queue resources == | |||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
Line 44: | Line 45: | ||
|- | |- | ||
|} | |} | ||
''*: disk is [[Disk_reservation|reservable]]'' | ''*: disk is [[Disk_reservation|reservable]]'' ''**: crossed GPUs are not supported by Grid'5000 default environments'' ''***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment'' | ||
== Testing queue resources == | |||
{|class="wikitable sortable" | |||
|- | |||
!rowspan=2|Cluster | |||
!rowspan=2|Access Condition | |||
!rowspan=2|Date of arrival | |||
!rowspan=2|Manufacturing date | |||
!data-sort-type="number" rowspan=2|Nodes | |||
!colspan=4|CPU | |||
!data-sort-type="number" rowspan=2|Memory | |||
!data-sort-type="number" rowspan=2|Storage | |||
!data-sort-type="number" rowspan=2|Network | |||
!rowspan=2|Accelerators | |||
|- | |||
!data-sort-type="number"|# | |||
!|Name | |||
!data-sort-type="number"|Cores | |||
!|Architecture | |||
|- | |||
''**: crossed GPUs are not supported by Grid'5000 default environments'' | |[[#nessie|nessie]]||<b>testing</b> queue||2024-11-08||2024-08-19||1||2||Intel Xeon nil||32 cores/CPU||x86_64||data-sort-value="68719476736"|64 GiB||data-sort-value="2235"|<b>1.92 TB SSD</b> + 480 GB SSD||data-sort-value="25000"|25 Gbps || | ||
|- | |||
|} | |||
''*: disk is [[Disk_reservation|reservable]]'' ''**: crossed GPUs are not supported by Grid'5000 default environments'' ''***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment'' | |||
= Clusters in the [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/ default queue] = | = Clusters in the [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/ default queue] = | ||
Line 430: | Line 452: | ||
|} | |} | ||
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Grenoble:_yeti|exotic]]''' page for more information.<br/>''<small>Last generated from the Grid'5000 Reference API on 2024- | '''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Grenoble:_yeti|exotic]]''' page for more information.<br/> | ||
= Clusters in the testing queue = | |||
== [https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?filter=nessie%20only nessie] == | |||
'''1 node, 2 cpus, 64 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/nessie/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fgrenoble|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p nessie</code> <code>-I</code>}} | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| testing queue<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| HPE ProLiant DL385 Gen10+ v2<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2024-08-19<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2024-11-08<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon nil (Golden Cove), x86_64, 2 CPUs/node, 32 cores/CPU<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 64 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 1.92 TB SSD NVME HP VO001920KYDMT (dev: <code class="file">/dev/disk0</code>) (primary disk)<br /> | |||
* disk1, 480 GB SSD SATA HP VK000480GZCNE (dev: <code class="file">/dev/disk1</code>) <br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN<br /> | |||
* <span style="color:grey">eth1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br/> | |||
|- | |||
|}''<small>Last generated from the Grid'5000 Reference API on 2024-11-25 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/fc062abbb4 commit fc062abbb4])</small>'' |
Latest revision as of 11:29, 25 November 2024
See also: Network topology for Grenoble
Summary
- 6 clusters
- 55 nodes
- 1808 CPU cores
- 48 GPUs
- 172032 GPUs cores
- 12.31 TiB RAM + 6.0 TiB PMEM
- 90 SSDs and 68 HDDs on nodes (total: 230.93 TB)
- 108.9 TFLOPS (excluding GPUs)
Clusters summary
Default queue resources
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
dahu | 2018-03-22 | 2017-12-12 | 32 | 2 | Intel Xeon Gold 6130 | 16 cores/CPU | x86_64 | 192 GiB | 240 GB SSD + 480 GB SSD + 4.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path | ||
drac | exotic job type | 2020-10-05 | 2016-10-17 | 12 | 2 | IBM POWER8NVL 1.0 | 10 cores/CPU | ppc64le | 128 GiB | 1.0 TB HDD + 1.0 TB HDD | 10 Gbps + 2 x 100 Gbps InfiniBand | 4 x Nvidia Tesla P100 (16 GiB) |
servan | exotic job type | 2021-12-15 | 2021-12-10 | 2 | 2 | AMD EPYC 7352 | 24 cores/CPU | x86_64 | 128 GiB | 1.6 TB SSD + 1.6 TB SSD | 25 Gbps + 2 x 100 Gbps FPGA/Ethernet | Xilinx Alveo U200 |
troll | exotic job type | 2019-12-23 | 2019-11-21 | 4 | 2 | Intel Xeon Gold 5218 | 16 cores/CPU | x86_64 | 384 GiB + 1.5 TiB PMEM | 480 GB SSD + 1.6 TB SSD | 25 Gbps (SR‑IOV) + 100 Gbps Omni-Path | |
yeti | exotic job type | 2018-01-16 | 2017-12-26 | 4 | 4 | Intel Xeon Gold 6130 | 16 cores/CPU | x86_64 | 768 GiB | 480 GB SSD + 3 x 2.0 TB HDD* + 2 x 1.6 TB SSD | 10 Gbps + 100 Gbps Omni-Path |
*: disk is reservable **: crossed GPUs are not supported by Grid'5000 default environments ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment
Testing queue resources
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
nessie | testing queue | 2024-11-08 | 2024-08-19 | 1 | 2 | Intel Xeon nil | 32 cores/CPU | x86_64 | 64 GiB | 1.92 TB SSD + 480 GB SSD | 25 Gbps |
*: disk is reservable **: crossed GPUs are not supported by Grid'5000 default environments ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment
Clusters in the default queue
dahu
32 nodes, 64 cpus, 1024 cores, split as follows due to differences between nodes (json)
Reservation example:
- dahu-[1,
4-32] (30 nodes, 60 cpus, 960 cores)
Model: | Dell PowerEdge C6420 |
Manufacturing date: | 2017-12-12 |
Date of arrival: | 2018-03-22 |
CPU: | Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU |
Memory: | 192 GiB |
Storage: |
|
Network: |
|
- dahu-2 (1 node, 2 cpus, 32 cores)
Model: | Dell PowerEdge C6420 |
Manufacturing date: | 2017-12-12 |
Date of arrival: | 2018-03-22 |
CPU: | Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU |
Memory: | 192 GiB |
Storage: |
|
Network: |
|
- dahu-3 (1 node, 2 cpus, 32 cores)
Model: | Dell PowerEdge C6420 |
Manufacturing date: | 2017-12-12 |
Date of arrival: | 2018-03-22 |
CPU: | Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU |
Memory: | 192 GiB |
Storage: |
|
Network: |
|
drac
12 nodes, 24 cpus, 240 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | IBM PowerNV S822LC (8335-GTB) |
Manufacturing date: | 2016-10-17 |
Date of arrival: | 2020-10-05 |
CPU: | IBM POWER8NVL 1.0 (POWER8), ppc64le, 2 CPUs/node, 10 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
GPU: | 4 x Nvidia Tesla P100-SXM2-16GB (16 GiB) Compute capability: 6.0 |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
servan
2 nodes, 4 cpus, 96 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Dell PowerEdge R7525 |
Manufacturing date: | 2021-12-10 |
Date of arrival: | 2021-12-15 |
CPU: | AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
FPGA: | Xilinx Alveo U200 |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
troll
4 nodes, 8 cpus, 128 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Dell PowerEdge R640 |
Manufacturing date: | 2019-11-21 |
Date of arrival: | 2019-12-23 |
CPU: | Intel Xeon Gold 5218 (Cascade Lake-SP), x86_64, 2.30GHz, 2 CPUs/node, 16 cores/CPU |
Memory: | 384 GiB + 1.5 TiB PMEM |
Storage: |
|
Network: |
|
Note: This cluster is defined as exotic. Please read the exotic page for more information.
yeti
4 nodes, 16 cpus, 256 cores, split as follows due to differences between nodes (json)
Reservation example:
- yeti-1 (1 node, 4 cpus, 64 cores)
Access condition: | exotic job type |
Model: | Dell PowerEdge R940 |
Manufacturing date: | 2017-12-26 |
Date of arrival: | 2018-01-16 |
CPU: | Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 4 CPUs/node, 16 cores/CPU |
Memory: | 768 GiB |
Storage: |
|
Network: |
|
- yeti-[2,
4] (2 nodes, 8 cpus, 128 cores)
Access condition: | exotic job type |
Model: | Dell PowerEdge R940 |
Manufacturing date: | 2017-12-26 |
Date of arrival: | 2018-01-16 |
CPU: | Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 4 CPUs/node, 16 cores/CPU |
Memory: | 768 GiB |
Storage: |
|
Network: |
|
- yeti-3 (1 node, 4 cpus, 64 cores)
Access condition: | exotic job type |
Model: | Dell PowerEdge R940 |
Manufacturing date: | 2017-12-26 |
Date of arrival: | 2018-01-16 |
CPU: | Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 4 CPUs/node, 16 cores/CPU |
Memory: | 768 GiB |
Storage: |
|
Network: |
|
Note: This cluster is defined as exotic. Please read the exotic page for more information.
Clusters in the testing queue
nessie
1 node, 2 cpus, 64 cores (json)
Reservation example:
Access condition: | testing queue |
Model: | HPE ProLiant DL385 Gen10+ v2 |
Manufacturing date: | 2024-08-19 |
Date of arrival: | 2024-11-08 |
CPU: | Intel Xeon nil (Golden Cove), x86_64, 2 CPUs/node, 32 cores/CPU |
Memory: | 64 GiB |
Storage: |
|
Network: |
|
Last generated from the Grid'5000 Reference API on 2024-11-25 (commit fc062abbb4)