Toulouse:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
Line 32: Line 32:
|-
|-


|[[#estats|estats]]||<b>testing</b>&nbsp;queue,<br/><b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2023-06-13||12||1: 1<br />[2-12]: 4||Carmel Unknown||1: 8&nbsp;cores/CPU<br />[2-12]: 2&nbsp;cores/CPU||aarch64||32&nbsp;GiB||data-sort-value="1863"|<b>2.0&nbsp;TB&nbsp;SSD</b>||data-sort-value="1000"|1&nbsp;Gbps&nbsp;||Nvidia AGX&nbsp;Xavier&nbsp;(30&nbsp;GiB)
|[[#estats|estats]]||<b>testing</b>&nbsp;queue,<br/><b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2023-06-13||12||1||Carmel Unknown||8&nbsp;cores/CPU||aarch64||32&nbsp;GiB||data-sort-value="1863"|<b>2.0&nbsp;TB&nbsp;SSD</b>||data-sort-value="1000"|1&nbsp;Gbps&nbsp;||Nvidia AGX&nbsp;Xavier&nbsp;(30&nbsp;GiB)
|-
|-
|[[#montcalm|montcalm]]||<b>testing</b>&nbsp;queue||2022-12-01||9||2||Intel Xeon Silver 4314||16&nbsp;cores/CPU||x86_64||256&nbsp;GiB||data-sort-value="894"|<b>960&nbsp;GB&nbsp;SSD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
|[[#montcalm|montcalm]]||<b>testing</b>&nbsp;queue||2022-12-01||9||2||Intel Xeon Silver 4314||16&nbsp;cores/CPU||x86_64||256&nbsp;GiB||data-sort-value="894"|<b>960&nbsp;GB&nbsp;SSD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
Line 42: Line 42:
== [https://intranet.grid5000.fr/oar/Toulouse/drawgantt-svg/?filter=estats%20only estats] ==
== [https://intranet.grid5000.fr/oar/Toulouse/drawgantt-svg/?filter=estats%20only estats] ==


'''12 nodes, 45 cpus, 96 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/toulouse/clusters/estats/nodes.json?pretty=1 json])
'''12 nodes, 12 cpus, 96 cores''' ([https://public-api.grid5000.fr/stable/sites/toulouse/clusters/estats/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''
Line 48: Line 48:
{{Term|location=ftoulouse|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="replace">-t exotic</code> <code class="env">-p estats</code> <code>-I</code>}}
{{Term|location=ftoulouse|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="replace">-t exotic</code> <code class="env">-p estats</code> <code>-I</code>}}


; estats-1 (1 node, 1 cpu, 8 cores)
{|
{|
|-
|-
Line 62: Line 61:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Carmel Unknown (Carmel, 1&nbsp;CPU/node, 8&nbsp;cores/CPU)<br/>
| Carmel Unknown (Carmel, 1&nbsp;CPU/node, 8&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 32&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 2.0&nbsp;TB SSD NVME Samsung Samsung SSD 970 EVO Plus 2TB (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/platform-14180000.pcie-pci-0000:01:00.0-nvme-1</code>)  (primary disk)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0, Ethernet, configured rate: 1&nbsp;Gbps, model: N/A, driver: nvethernet - no KaVLAN<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| Nvidia AGX&nbsp;Xavier&nbsp;(30&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;7.2<br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
; estats-[2-12] (11 nodes, 44 cpus, 88 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| testing queue, exotic job type<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Connecttech/Nvidia Jetson AGX Xavier<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2023-06-13<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Carmel Unknown (Carmel, 4&nbsp;CPUs/node, 2&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 142: Line 110:
* <span style="color:grey">eth1/ens10f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br/>
* <span style="color:grey">eth1/ens10f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2023-09-15 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/055cf2c4f7 commit 055cf2c4f7])</small>''
|}''<small>Last generated from the Grid'5000 Reference API on 2023-09-15 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/a1bc1fa382 commit a1bc1fa382])</small>''

Revision as of 11:50, 15 September 2023

See also: Network topology for Toulouse

Summary

  • 2 clusters
  • 21 nodes
  • 384 CPU cores
  • 12 GPUs
  • 2.63 TiB RAM
  • 21 SSDs and 0 HDDs on nodes (total: 32.65 TB)
  • 33.1 TFLOPS (excluding GPUs)

Clusters

Cluster Access Condition Date of arrival Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
estats testing queue,
exotic job type
2023-06-13 12 1 Carmel Unknown 8 cores/CPU aarch64 32 GiB 2.0 TB SSD 1 Gbps  Nvidia AGX Xavier (30 GiB)
montcalm testing queue 2022-12-01 9 2 Intel Xeon Silver 4314 16 cores/CPU x86_64 256 GiB 960 GB SSD 10 Gbps 

**: crossed GPUs are not supported by Grid'5000 default environments

Clusters in the testing queue

estats

12 nodes, 12 cpus, 96 cores (json)

Reservation example:

Terminal.png ftoulouse:
oarsub -q testing -t exotic -p estats -I
Access condition: testing queue, exotic job type
Model: Connecttech/Nvidia Jetson AGX Xavier
Date of arrival: 2023-06-13
CPU: Carmel Unknown (Carmel, 1 CPU/node, 8 cores/CPU)
Memory: 32 GiB
Storage: disk0, 2.0 TB SSD NVME Samsung Samsung SSD 970 EVO Plus 2TB (dev: /dev/disk0, by-path: /dev/disk/by-path/platform-14180000.pcie-pci-0000:01:00.0-nvme-1) (primary disk)
Network:
  • eth0, Ethernet, configured rate: 1 Gbps, model: N/A, driver: nvethernet - no KaVLAN
GPU: Nvidia AGX Xavier (30 GiB)
Compute capability: 7.2

montcalm

9 nodes, 18 cpus, 288 cores (json)

Reservation example:

Terminal.png ftoulouse:
oarsub -q testing -p montcalm -I
Access condition: testing queue
Model: HPE Proliant DL360 Gen10+
Date of arrival: 2022-12-01
CPU: Intel Xeon Silver 4314 (Ice Lake, 2.40GHz, 2 CPUs/node, 16 cores/CPU)
Memory: 256 GiB
Storage: disk0, 960 GB SSD SATA HP VK000960GXAWL (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:00:17.0-ata-1) (primary disk)
Network:
  • eth0/ens10f0np0, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en
  • eth1/ens10f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment

Last generated from the Grid'5000 Reference API on 2023-09-15 (commit a1bc1fa382)