Toulouse:Hardware: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 8: | Line 8: | ||
* 21 nodes | * 21 nodes | ||
* 384 CPU cores | * 384 CPU cores | ||
* 12 GPUs | |||
* 2.63 TiB RAM | * 2.63 TiB RAM | ||
* 21 SSDs and 0 HDDs on nodes (total: 32.65 TB) | * 21 SSDs and 0 HDDs on nodes (total: 32.65 TB) | ||
| Line 23: | Line 24: | ||
!data-sort-type="number" rowspan=2|Storage | !data-sort-type="number" rowspan=2|Storage | ||
!data-sort-type="number" rowspan=2|Network | !data-sort-type="number" rowspan=2|Network | ||
!rowspan=2|Accelerators | |||
|- | |- | ||
!data-sort-type="number"|# | !data-sort-type="number"|# | ||
| Line 30: | Line 32: | ||
|- | |- | ||
|[[#estats|estats]]||<b>testing</b> queue,<br/><b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2023-06-13||12||4||Carmel Unknown||2 cores/CPU||aarch64||32 GiB||data-sort-value="1863"|<b>2.0 TB SSD</b>||data-sort-value="1000"|1 Gbps | |[[#estats|estats]]||<b>testing</b> queue,<br/><b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2023-06-13||12||1: 1<br />[2-12]: 4||Carmel Unknown||1: 8 cores/CPU<br />[2-12]: 2 cores/CPU||aarch64||32 GiB||data-sort-value="1863"|<b>2.0 TB SSD</b>||data-sort-value="1000"|1 Gbps ||Nvidia AGX Xavier (30 GiB) | ||
|- | |- | ||
|[[#montcalm|montcalm]]||<b>testing</b> queue||2022-12-01||9||2||Intel Xeon Silver 4314||16 cores/CPU||x86_64||256 GiB||data-sort-value="894"|<b>960 GB SSD</b>||data-sort-value="10000"|10 Gbps | |[[#montcalm|montcalm]]||<b>testing</b> queue||2022-12-01||9||2||Intel Xeon Silver 4314||16 cores/CPU||x86_64||256 GiB||data-sort-value="894"|<b>960 GB SSD</b>||data-sort-value="10000"|10 Gbps || | ||
|- | |- | ||
|} | |} | ||
''**: crossed GPUs are not supported by Grid'5000 default environments'' | |||
= Clusters in the testing queue = | = Clusters in the testing queue = | ||
== [https://intranet.grid5000.fr/oar/Toulouse/drawgantt-svg/?filter=estats%20only estats] == | == [https://intranet.grid5000.fr/oar/Toulouse/drawgantt-svg/?filter=estats%20only estats] == | ||
'''12 nodes, | '''12 nodes, 45 cpus, 96 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/toulouse/clusters/estats/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | '''Reservation example:''' | ||
| Line 46: | Line 48: | ||
{{Term|location=ftoulouse|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="replace">-t exotic</code> <code class="env">-p estats</code> <code>-I</code>}} | {{Term|location=ftoulouse|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="replace">-t exotic</code> <code class="env">-p estats</code> <code>-I</code>}} | ||
; estats-1 (1 node, 1 cpu, 8 cores) | |||
{| | {| | ||
|- | |- | ||
| Line 52: | Line 55: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Connecttech/Nvidia AGX Xavier<br/> | | Connecttech/Nvidia Jetson AGX Xavier<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2023-06-13<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Carmel Unknown (Carmel, 1 CPU/node, 8 cores/CPU)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 32 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| disk0, 2.0 TB SSD NVME Samsung Samsung SSD 970 EVO Plus 2TB (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/platform-14180000.pcie-pci-0000:01:00.0-nvme-1</code>) (primary disk)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0, Ethernet, configured rate: 1 Gbps, model: N/A, driver: nvethernet - no KaVLAN<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| Nvidia AGX Xavier (30 GiB)<br>Compute capability: 7.2<br/> | |||
|- | |||
|} | |||
<hr style="height:10pt; visibility:hidden;" /> | |||
; estats-[2-12] (11 nodes, 44 cpus, 88 cores) | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| testing queue, exotic job type<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Connecttech/Nvidia Jetson AGX Xavier<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| Line 69: | Line 103: | ||
| | | | ||
* eth0, Ethernet, configured rate: 1 Gbps, model: N/A, driver: nvethernet - no KaVLAN<br/> | * eth0, Ethernet, configured rate: 1 Gbps, model: N/A, driver: nvethernet - no KaVLAN<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| Nvidia AGX Xavier (30 GiB)<br>Compute capability: 7.2<br/> | |||
|- | |- | ||
|} | |} | ||
| Line 105: | Line 142: | ||
* <span style="color:grey">eth1/ens10f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br/> | * <span style="color:grey">eth1/ens10f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on 2023-09- | |}''<small>Last generated from the Grid'5000 Reference API on 2023-09-15 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/055cf2c4f7 commit 055cf2c4f7])</small>'' | ||
Revision as of 10:48, 15 September 2023
Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Toulouse
See also: Network topology for Toulouse
Summary
- 2 clusters
- 21 nodes
- 384 CPU cores
- 12 GPUs
- 2.63 TiB RAM
- 21 SSDs and 0 HDDs on nodes (total: 32.65 TB)
- 33.1 TFLOPS (excluding GPUs)
Clusters
| Cluster | Access Condition | Date of arrival | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
|---|---|---|---|---|---|---|---|---|---|---|---|
| # | Name | Cores | Architecture | ||||||||
| estats | testing queue, exotic job type |
2023-06-13 | 12 | 1: 1 [2-12]: 4 |
Carmel Unknown | 1: 8 cores/CPU [2-12]: 2 cores/CPU |
aarch64 | 32 GiB | 2.0 TB SSD | 1 Gbps | Nvidia AGX Xavier (30 GiB) |
| montcalm | testing queue | 2022-12-01 | 9 | 2 | Intel Xeon Silver 4314 | 16 cores/CPU | x86_64 | 256 GiB | 960 GB SSD | 10 Gbps | |
**: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the testing queue
estats
12 nodes, 45 cpus, 96 cores, split as follows due to differences between nodes (json)
Reservation example:
|
ftoulouse:
|
oarsub -q testing -t exotic -p estats -I |
- estats-1 (1 node, 1 cpu, 8 cores)
| Access condition: | testing queue, exotic job type |
| Model: | Connecttech/Nvidia Jetson AGX Xavier |
| Date of arrival: | 2023-06-13 |
| CPU: | Carmel Unknown (Carmel, 1 CPU/node, 8 cores/CPU) |
| Memory: | 32 GiB |
| Storage: | disk0, 2.0 TB SSD NVME Samsung Samsung SSD 970 EVO Plus 2TB (dev: /dev/disk0, by-path: /dev/disk/by-path/platform-14180000.pcie-pci-0000:01:00.0-nvme-1) (primary disk) |
| Network: |
|
| GPU: | Nvidia AGX Xavier (30 GiB) Compute capability: 7.2 |
- estats-[2-12] (11 nodes, 44 cpus, 88 cores)
| Access condition: | testing queue, exotic job type |
| Model: | Connecttech/Nvidia Jetson AGX Xavier |
| Date of arrival: | 2023-06-13 |
| CPU: | Carmel Unknown (Carmel, 4 CPUs/node, 2 cores/CPU) |
| Memory: | 32 GiB |
| Storage: | disk0, 2.0 TB SSD NVME Samsung Samsung SSD 970 EVO Plus 2TB (dev: /dev/disk0, by-path: /dev/disk/by-path/platform-14180000.pcie-pci-0000:01:00.0-nvme-1) (primary disk) |
| Network: |
|
| GPU: | Nvidia AGX Xavier (30 GiB) Compute capability: 7.2 |
montcalm
9 nodes, 18 cpus, 288 cores (json)
Reservation example:
|
|
ftoulouse:
|
oarsub -q testing -p montcalm -I |
| Access condition: | testing queue |
| Model: | HPE Proliant DL360 Gen10+ |
| Date of arrival: | 2022-12-01 |
| CPU: | Intel Xeon Silver 4314 (Ice Lake, 2.40GHz, 2 CPUs/node, 16 cores/CPU) |
| Memory: | 256 GiB |
| Storage: | disk0, 960 GB SSD SATA HP VK000960GXAWL (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:00:17.0-ata-1) (primary disk) |
| Network: |
|
Last generated from the Grid'5000 Reference API on 2023-09-15 (commit 055cf2c4f7)