Nancy:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
Line 5: Line 5:
= Summary =
= Summary =
* 13 clusters
* 13 clusters
* 268 nodes
* 267 nodes
* 10568 CPU cores
* 10544 CPU cores
* 134 GPUs
* 132 GPUs
* 802304 GPUs cores
* 795136 GPUs cores
* 57.88 TiB RAM
* 57.75 TiB RAM
* 311 SSDs and 129 HDDs on nodes (total: 528.52 TB)
* 311 SSDs and 127 HDDs on nodes (total: 527.92 TB)
* 770.5 TFLOPS (excluding GPUs)
* 769.7 TFLOPS (excluding GPUs)
{|width="100%" border="0"
{|width="100%" border="0"
|-
|-
Line 30: Line 30:
=== Production queue resources ===
=== Production queue resources ===
* 9 clusters
* 9 clusters
* 119 nodes
* 118 nodes
* 3776 CPU cores
* 3752 CPU cores
* 116 GPUs
* 114 GPUs
* 520192 GPUs cores
* 513024 GPUs cores
* 26.5 TiB RAM
* 26.38 TiB RAM
* 36 SSDs and 129 HDDs on nodes (total: 273.74 TB)
* 36 SSDs and 127 HDDs on nodes (total: 273.15 TB)
* 198.5 TFLOPS (excluding GPUs)
* 197.7 TFLOPS (excluding GPUs)
|}
|}
|}
|}
Line 93: Line 93:
|[[#grat|grat]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2022-09-07||2022-06-22||1||2||AMD EPYC 7513||32&nbsp;cores/CPU||x86_64||data-sort-value="549755813888"|512&nbsp;GiB||data-sort-value="28608"|<b>3.84&nbsp;TB&nbsp;SSD</b> +&nbsp;7&nbsp;x&nbsp;3.84&nbsp;TB&nbsp;SSD||data-sort-value="25000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||8&nbsp;x&nbsp;Nvidia A100&nbsp;(40&nbsp;GiB)
|[[#grat|grat]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2022-09-07||2022-06-22||1||2||AMD EPYC 7513||32&nbsp;cores/CPU||x86_64||data-sort-value="549755813888"|512&nbsp;GiB||data-sort-value="28608"|<b>3.84&nbsp;TB&nbsp;SSD</b> +&nbsp;7&nbsp;x&nbsp;3.84&nbsp;TB&nbsp;SSD||data-sort-value="25000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||8&nbsp;x&nbsp;Nvidia A100&nbsp;(40&nbsp;GiB)
|-
|-
|[[#grele|grele]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2017-06-26||2017-06-07||14||2||Intel Xeon E5-2650 v4||12&nbsp;cores/CPU||x86_64||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="556"|<b>299&nbsp;GB&nbsp;HDD</b> +&nbsp;299&nbsp;GB&nbsp;HDD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||2&nbsp;x&nbsp;Nvidia GTX&nbsp;1080&nbsp;Ti&nbsp;(11&nbsp;GiB)
|[[#grele|grele]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2017-06-26||2017-06-07||13||2||Intel Xeon E5-2650 v4||12&nbsp;cores/CPU||x86_64||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="556"|<b>299&nbsp;GB&nbsp;HDD</b> +&nbsp;299&nbsp;GB&nbsp;HDD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;Omni-Path||2&nbsp;x&nbsp;Nvidia GTX&nbsp;1080&nbsp;Ti&nbsp;(11&nbsp;GiB)
|-
|-
|[[#grosminet|grosminet]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2023-12-05||2023-11-30||1||4||Intel Xeon Gold 6240L||18&nbsp;cores/CPU||x86_64||data-sort-value="6597069766656"|6.0&nbsp;TiB||data-sort-value="11920"|<b>1.6&nbsp;TB&nbsp;SSD</b> +&nbsp;7&nbsp;x&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="25000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|[[#grosminet|grosminet]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2023-12-05||2023-11-30||1||4||Intel Xeon Gold 6240L||18&nbsp;cores/CPU||x86_64||data-sort-value="6597069766656"|6.0&nbsp;TiB||data-sort-value="11920"|<b>1.6&nbsp;TB&nbsp;SSD</b> +&nbsp;7&nbsp;x&nbsp;1.6&nbsp;TB&nbsp;SSD||data-sort-value="25000"|25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
Line 474: Line 474:
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=grele%20only grele] ==
== [https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?filter=grele%20only grele] ==


'''14 nodes, 28 cpus, 336 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grele/nodes.json?pretty=1 json])
'''13 nodes, 26 cpus, 312 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/grele/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''
Line 483: Line 483:
* grele-[1-3]: 24h
* grele-[1-3]: 24h
* grele-[4-6]: 48h
* grele-[4-6]: 48h
* grele-[7-14]: 168h
* grele-[7-13]: 168h


{|
{|
Line 879: Line 879:
| 2&nbsp;x&nbsp;Nvidia L40S&nbsp;(45&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;8.9<br/>
| 2&nbsp;x&nbsp;Nvidia L40S&nbsp;(45&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;8.9<br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2024-11-29 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/b46127b1da commit b46127b1da])</small>''
|}''<small>Last generated from the Grid'5000 Reference API on 2024-12-12 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/3b8ae8370a commit 3b8ae8370a])</small>''

Revision as of 09:22, 12 December 2024

Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse

See also: Network topology for Nancy

Summary

  • 13 clusters
  • 267 nodes
  • 10544 CPU cores
  • 132 GPUs
  • 795136 GPUs cores
  • 57.75 TiB RAM
  • 311 SSDs and 127 HDDs on nodes (total: 527.92 TB)
  • 769.7 TFLOPS (excluding GPUs)

Default queue resources

  • 2 clusters
  • 126 nodes
  • 2360 CPU cores
  • 4 GPUs
  • 27648 GPUs cores
  • 11.88 TiB RAM
  • 252 SSDs and 0 HDDs on nodes (total: 184.36 TB)
  • 82.9 TFLOPS (excluding GPUs)

Production queue resources

  • 9 clusters
  • 118 nodes
  • 3752 CPU cores
  • 114 GPUs
  • 513024 GPUs cores
  • 26.38 TiB RAM
  • 36 SSDs and 127 HDDs on nodes (total: 273.15 TB)
  • 197.7 TFLOPS (excluding GPUs)

Clusters summary

Default queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
gros 2019-09-04 2019-07-16 124 1 Intel Xeon Gold 5220 18 cores/CPU x86_64 96 GiB 480 GB SSD + 960 GB SSD* 2 x 25 Gbps (SR‑IOV) 
grouille exotic job type 2021-01-13 2020-12-07 2 2 AMD EPYC 7452 32 cores/CPU x86_64 128 GiB 1.92 TB SSD + 960 GB SSD* 25 Gbps  2 x Nvidia A100 (40 GiB)

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments      ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment

Production queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
graffiti production queue 2019-06-07 2019-05-27 13 2 Intel Xeon Silver 4110 8 cores/CPU x86_64 128 GiB 479 GB HDD 10 Gbps  [1-12]: 4 x Nvidia RTX 2080 Ti (11 GiB)
13: 4 x Nvidia Quadro RTX 6000 (23 GiB)
grappe production queue 2020-08-20 2020-07-09 16 2 Intel Xeon Gold 5218R 20 cores/CPU x86_64 96 GiB 480 GB SSD + 8.0 TB HDD 25 Gbps 
grat production queue 2022-09-07 2022-06-22 1 2 AMD EPYC 7513 32 cores/CPU x86_64 512 GiB 3.84 TB SSD + 7 x 3.84 TB SSD 25 Gbps (SR‑IOV)  8 x Nvidia A100 (40 GiB)
grele production queue 2017-06-26 2017-06-07 13 2 Intel Xeon E5-2650 v4 12 cores/CPU x86_64 128 GiB 299 GB HDD + 299 GB HDD 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path 2 x Nvidia GTX 1080 Ti (11 GiB)
grosminet production queue 2023-12-05 2023-11-30 1 4 Intel Xeon Gold 6240L 18 cores/CPU x86_64 6.0 TiB 1.6 TB SSD + 7 x 1.6 TB SSD 25 Gbps (SR‑IOV) 
grostiti production queue 2024-01-10 2015-10-23 1 4 Intel Xeon E7-4850 v3 14 cores/CPU x86_64 1.5 TiB 1.2 TB HDD + 4.0 TB HDD + 599 GB HDD 10 Gbps (SR‑IOV) 
grue production queue 2019-11-25 2019-11-15 5 2 AMD EPYC 7351 16 cores/CPU x86_64 128 GiB 479 GB HDD 10 Gbps  4 x Nvidia Tesla T4 (15 GiB)
gruss production queue 2021-08-26 2021-06-24 4 2 AMD EPYC 7352 24 cores/CPU x86_64 256 GiB 1.92 TB SSD 25 Gbps  2 x Nvidia A40 (45 GiB)
grvingt production queue 2018-04-11 2018-04-01 64 2 Intel Xeon Gold 6130 16 cores/CPU x86_64 192 GiB 1.0 TB HDD 10 Gbps + 100 Gbps Omni-Path

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments      ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment

Testing queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
grdix testing queue 2024-09-27 2024-09-02 16 2 AMD EPYC 9754 128 cores/CPU x86_64 1.0 TiB 1.6 TB SSD 25 Gbps (SR‑IOV) + 200 Gbps InfiniBand
gres testing queue 2024-08-23 2024-08-07 7 2 AMD EPYC 9254 24 cores/CPU x86_64 512 GiB 6.4 TB SSD 25 Gbps  2 x Nvidia Tesla L40S (45 GiB)

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments      ***: OPA (Omni-Path Architecture) is currently not supported on Debian 12 environment

Clusters in the default queue

gros

124 nodes, 124 cpus, 2232 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png fnancy:
oarsub -p gros -I
gros-[1-26,28-67,69-124] (122 nodes, 122 cpus, 2196 cores)
Model: Dell PowerEdge R640
Manufacturing date: 2019-07-16
Date of arrival: 2019-09-04
CPU: Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU
Memory: 96 GiB
Storage:
  • disk0, 480 GB SSD SATA Micron MTFDDAK480TDN (dev: /dev/disk0) (primary disk)
  • disk1, 960 GB SSD SATA Micron MTFDDAK960TDN (dev: /dev/disk1*) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled (multi NICs example)
gros-27 (1 node, 1 cpu, 18 cores)
Model: Dell PowerEdge R640
Manufacturing date: 2019-07-16
Date of arrival: 2019-09-04
CPU: Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU
Memory: 96 GiB
Storage:
  • disk0, 480 GB SSD SATA Samsung MZ7KH480HAHQ0D3 (dev: /dev/disk0) (primary disk)
  • disk1, 960 GB SSD SATA Micron MTFDDAK960TDN (dev: /dev/disk1*) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled (multi NICs example)
gros-68 (1 node, 1 cpu, 18 cores)
Model: Dell PowerEdge R640
Manufacturing date: 2019-07-16
Date of arrival: 2019-09-04
CPU: Intel Xeon Gold 5220 (Cascade Lake-SP), x86_64, 2.20GHz, 1 CPU/node, 18 cores/CPU
Memory: 96 GiB
Storage:
  • disk0, 480 GB SSD SATA Micron MTFDDAK480TDN (dev: /dev/disk0) (primary disk)
  • disk1, 960 GB SSD SATA Intel SSDSC2KG960G8R (dev: /dev/disk1*) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled (multi NICs example)

grouille

2 nodes, 4 cpus, 128 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -t exotic -p grouille -I
Access condition: exotic job type
Model: Dell PowerEdge R7525
Manufacturing date: 2020-12-07
Date of arrival: 2021-01-13
CPU: AMD EPYC 7452 (Zen 2), x86_64, 2 CPUs/node, 32 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 1.92 TB SSD SAS Toshiba KRM5XVUG1T92 (dev: /dev/disk0) (primary disk)
  • disk1, 960 GB SSD SATA Micron MTFDDAK960TDT (dev: /dev/disk1*) (reservable)
Network:
  • eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 2 x Nvidia A100-PCIE-40GB (40 GiB)
Compute capability: 8.0

Note: This cluster is defined as exotic. Please read the exotic page for more information.

Clusters in the production queue

graffiti

13 nodes, 26 cpus, 208 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p graffiti -I

Max walltime per nodes:

  • graffiti-[1-3]: 24h
  • graffiti-[4-6]: 48h
  • graffiti-[7-13]: 168h
graffiti-[1-12] (12 nodes, 24 cpus, 192 cores)
Access condition: production queue
Model: Dell PowerEdge T640
Manufacturing date: 2019-05-27
Date of arrival: 2019-06-07
CPU: Intel Xeon Silver 4110 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU
Memory: 128 GiB
Storage: disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1np0, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
  • eth1/eno2np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
  • eth2/ens4f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth3/ens4f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
GPU: 4 x Nvidia GeForce RTX 2080 Ti (11 GiB)
Compute capability: 7.5
graffiti-13 (1 node, 2 cpus, 16 cores)
Access condition: production queue
Model: Dell PowerEdge T640
Manufacturing date: 2019-05-27
Date of arrival: 2019-06-07
CPU: Intel Xeon Silver 4110 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU
Memory: 128 GiB
Storage: disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1np0, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
  • eth1/eno2np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
  • eth2/ens4f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth3/ens4f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
GPU: 4 x Nvidia Quadro RTX 6000 (23 GiB)
Compute capability: 7.5

grappe

16 nodes, 32 cpus, 640 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grappe -I

Max walltime per nodes:

  • grappe-[1-4]: 48h
  • grappe-[5-8]: 96h
  • grappe-[9-16]: 168h
Access condition: production queue
Model: Dell PowerEdge R640
Manufacturing date: 2020-07-09
Date of arrival: 2020-08-20
CPU: Intel Xeon Gold 5218R (Cascade Lake-SP), x86_64, 2.10GHz, 2 CPUs/node, 20 cores/CPU
Memory: 96 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G8R (dev: /dev/disk0) (primary disk)
  • disk1, 8.0 TB HDD SAS Seagate ST8000NM0185 (dev: /dev/disk1)
Network:
  • eth0/ens1f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens1f1, Ethernet, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e - unavailable for experiment
  • eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment

grat

1 node, 2 cpus, 64 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grat -I

Max walltime per nodes:

  • grat-1: 168h
Access condition: production queue
Model: HPE Apollo 6500
Manufacturing date: 2022-06-22
Date of arrival: 2022-09-07
CPU: AMD EPYC 7513 (Zen 3), x86_64, 2 CPUs/node, 32 cores/CPU
Memory: 512 GiB
Storage:
  • disk0, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk0) (primary disk)
  • disk1, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk1)
  • disk2, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk2)
  • disk3, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk3)
  • disk4, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk4)
  • disk5, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk5)
  • disk6, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk6)
  • disk7, 3.84 TB SSD SAS HP VO003840RZWVA (dev: /dev/disk7)
Network:
  • eth0/ens21f0np0, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled
  • eth1/ens21f1np1, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 8 x Nvidia A100-SXM4-40GB (40 GiB)
Compute capability: 8.0

grele

13 nodes, 26 cpus, 312 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grele -I

Max walltime per nodes:

  • grele-[1-3]: 24h
  • grele-[4-6]: 48h
  • grele-[7-13]: 168h
Access condition: production queue
Model: Dell PowerEdge R730
Manufacturing date: 2017-06-07
Date of arrival: 2017-06-26
CPU: Intel Xeon E5-2650 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 12 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 299 GB HDD SAS Dell PERC H730 Mini (dev: /dev/disk0) (primary disk)
  • disk1, 299 GB HDD SAS Dell PERC H730 Mini (dev: /dev/disk1)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1
GPU: 2 x Nvidia GeForce GTX 1080 Ti (11 GiB)
Compute capability: 6.1

grosminet

1 node, 4 cpus, 72 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grosminet -I

Max walltime per nodes:

  • grosminet-1: 24h
Access condition: production queue
Model: Proliant DL560 Gen10
Manufacturing date: 2023-11-30
Date of arrival: 2023-12-05
CPU: Intel Xeon Gold 6240L (Cascade Lake-SP), x86_64, 2.60GHz, 4 CPUs/node, 18 cores/CPU
Memory: 6.0 TiB
Storage:
  • disk0, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk0) (primary disk)
  • disk1, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk1)
  • disk2, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk2)
  • disk3, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk3)
  • disk4, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk4)
  • disk5, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk5)
  • disk6, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk6)
  • disk7, 1.6 TB SSD SAS HPE VO001600JWZJQ (dev: /dev/disk7)
Network:
  • eth0/ens1f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice, SR-IOV enabled
  • eth1/ens1f1, Ethernet, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice - unavailable for experiment

grostiti

1 node, 4 cpus, 56 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grostiti -I

Max walltime per nodes:

  • grostiti-1: 168h
Access condition: production queue
Model: Dell PowerEdge R930
Manufacturing date: 2015-10-23
Date of arrival: 2024-01-10
CPU: Intel Xeon E7-4850 v3 (Haswell), x86_64, 2.20GHz, 4 CPUs/node, 14 cores/CPU
Memory: 1.5 TiB
Storage:
  • disk0, 1.2 TB HDD SAS Dell PERC H730P Adp (dev: /dev/disk0) (primary disk)
  • disk1, 4.0 TB HDD SAS Dell PERC H730P Adp (dev: /dev/disk1)
  • disk2, 599 GB HDD SAS Dell PERC H730P Adp (dev: /dev/disk2)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • ib0, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment
  • ib1, Omni-Path, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1 - unavailable for experiment
  • ib2, InfiniBand, model: Mellanox Technologies MT27500 Family [ConnectX-3], driver: mlx4_core - unavailable for experiment

grue

5 nodes, 10 cpus, 160 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grue -I

Max walltime per nodes:

  • grue-[1-2]: 24h
  • grue-[3-4]: 48h
  • grue-5: 168h
Access condition: production queue
Model: Dell PowerEdge R7425
Manufacturing date: 2019-11-15
Date of arrival: 2019-11-25
CPU: AMD EPYC 7351 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU
Memory: 128 GiB
Storage: disk0, 479 GB HDD SAS Dell PERC H730P Adp (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 4 x Nvidia Tesla T4 (15 GiB)
Compute capability: 7.5

gruss

4 nodes, 8 cpus, 192 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p gruss -I

Max walltime per nodes:

  • gruss-[1-2]: 24h
  • gruss-3: 48h
  • gruss-4: 168h
gruss-1 (1 node, 2 cpus, 48 cores)
Access condition: production queue
Model: Dell PowerEdge R7525
Manufacturing date: 2021-06-24
Date of arrival: 2021-08-26
CPU: AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU
Memory: 256 GiB
Storage: disk0, 1.92 TB SSD SATA Samsung MZ7KH1T9HAJR0D3 (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 2 x Nvidia A40 (45 GiB)
Compute capability: 8.6
gruss-[2-4] (3 nodes, 6 cpus, 144 cores)
Access condition: production queue
Model: Dell PowerEdge R7525
Manufacturing date: 2021-06-24
Date of arrival: 2021-08-26
CPU: AMD EPYC 7352 (Zen 2), x86_64, 2 CPUs/node, 24 cores/CPU
Memory: 256 GiB
Storage: disk0, 1.92 TB SSD SATA Sk Hynix HFS1T9G32FEH-BA1 (dev: /dev/disk0) (primary disk)
Network:
  • eth0/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth1/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth2/eno33, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • eth3/eno34, Ethernet, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 2 x Nvidia A40 (45 GiB)
Compute capability: 8.6

grvingt

64 nodes, 128 cpus, 2048 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q production -p grvingt -I

Max walltime per nodes:

  • grvingt-[1-8]: 4h
  • grvingt-[9-16]: 12h
  • grvingt-[17-64]: 168h
Access condition: production queue
Model: Dell PowerEdge C6420
Manufacturing date: 2018-04-01
Date of arrival: 2018-04-11
CPU: Intel Xeon Gold 6130 (Skylake-SP), x86_64, 2.10GHz, 2 CPUs/node, 16 cores/CPU
Memory: 192 GiB
Storage: disk0, 1.0 TB HDD SATA Seagate ST1000NX0443 (dev: /dev/disk0) (primary disk)
Network:
  • eth0/enp24s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e
  • eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
  • ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1

Clusters in the testing queue

grdix

16 nodes, 32 cpus, 4096 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q testing -p grdix -I
Access condition: testing queue
Model: ProLiant DL365 Gen11
Manufacturing date: 2024-09-02
Date of arrival: 2024-09-27
CPU: AMD EPYC 9754 (Zen 4c), x86_64, 2 CPUs/node, 128 cores/CPU
Memory: 1.0 TiB
Storage: disk0, 1.6 TB SSD NVME Samsung MO001600KYDMU (dev: /dev/disk0) (primary disk)
Network:
  • eth0/enp1s0f0np0, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT2894 Family [ConnectX-6 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/ens22f1np1, Ethernet, model: Mellanox Technologies MT2894 Family [ConnectX-6 Lx], driver: mlx5_core - unavailable for experiment
  • ibs1, InfiniBand, configured rate: 200 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core

gres

7 nodes, 14 cpus, 336 cores (json)

Reservation example:

Terminal.png fnancy:
oarsub -q testing -p gres -I
Access condition: testing queue
Model: ProLiant DL385 Gen11
Manufacturing date: 2024-08-07
Date of arrival: 2024-08-23
CPU: AMD EPYC 9254 (Zen 4), x86_64, 2 CPUs/node, 24 cores/CPU
Memory: 512 GiB
Storage: disk0, 6.4 TB SSD NVME Samsung MO006400KYDND (dev: /dev/disk0) (primary disk)
Network:
  • eth0/ens22f0np0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en
  • eth1/ens22f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment
GPU: 2 x Nvidia L40S (45 GiB)
Compute capability: 8.9

Last generated from the Grid'5000 Reference API on 2024-12-12 (commit 3b8ae8370a)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Nancy:Hardware&oldid=104337"