Hardware

From Grid5000
Revision as of 09:20, 5 December 2023 by Amerlin (talk | contribs)
Jump to navigation Jump to search

Summary

  • 9 sites
  • 66 clusters
  • 764 nodes
  • 16772 CPU cores
  • 383 GPUs
  • 1773504 GPUs cores
  • 108.83 TiB RAM + 6.0 TiB PMEM
  • 554 SSDs and 903 HDDs on nodes (total: 1.46 PB)
  • 713.0 TFLOPS (excluding GPUs)

Clusters

Site Cluster Access Condition Date of arrival Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
Grenoble dahu 2018-03-22 32 2 Intel Xeon Gold 6130 16 cores/CPU x86_64 192 GiB 240 GB SSD + 480 GB SSD + 4.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Grenoble drac exotic job type 2020-10-05 12 2 IBM POWER8NVL 1.0 10 cores/CPU ppc64le 128 GiB 1.0 TB HDD + 1.0 TB HDD 10 Gbps + 2 x 100 Gbps InfiniBand 4 x Nvidia Tesla P100 (16 GiB)
Grenoble servan exotic job type 2021-12-15 2 2 AMD EPYC 7352 24 cores/CPU x86_64 128 GiB 1.6 TB SSD + 1.6 TB SSD 25 Gbps + 2 x 100 Gbps FPGA/Ethernet Xilinx Alveo U200
Grenoble troll exotic job type 2019-12-23 4 2 Intel Xeon Gold 5218 16 cores/CPU x86_64 384 GiB + 1.5 TiB PMEM 480 GB SSD + 1.6 TB SSD 25 Gbps (SR‑IOV) + 100 Gbps Omni-Path
Grenoble yeti exotic job type 2018-01-16 4 4 Intel Xeon Gold 6130 16 cores/CPU x86_64 768 GiB 480 GB SSD + 3 x 2.0 TB HDD* + 2 x 1.6 TB SSD 10 Gbps + 100 Gbps Omni-Path
Lille chiclet 2018-08-06 8 2 AMD EPYC 7301 16 cores/CPU x86_64 128 GiB 480 GB SSD + 2 x 4.0 TB HDD* 2 x 25 Gbps 
Lille chifflot 2018-08-01 8 2 Intel Xeon Gold 6126 12 cores/CPU x86_64 192 GiB 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* 2 x 25 Gbps  [1-6]: 2 x Nvidia Tesla P100 (16 GiB)
[7-8]: 2 x Nvidia Tesla V100 (32 GiB)
Luxembourg petitprince 2013-09-10 11 2 Intel Xeon E5-2630L 6 cores/CPU x86_64 32 GiB 250 GB HDD 2 x 10 Gbps 
Lyon gemini exotic job type 2019-09-01 2 2 Intel Xeon E5-2698 v4 20 cores/CPU x86_64 512 GiB 480 GB SSD + 4 x 1.92 TB SSD* 10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand 8 x Nvidia Tesla V100 (32 GiB)
Lyon hercule 2012-10-02 4 2 Intel Xeon E5-2620 6 cores/CPU x86_64 32 GiB 2.0 TB HDD + 2 x 2.0 TB HDD 10 Gbps (SR‑IOV) 
Lyon neowise exotic job type 2021-05-17 10 1 AMD EPYC 7642 48 cores/CPU x86_64 512 GiB 1.92 TB SSD 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand 8 x AMD MI50 (32 GiB)
Lyon nova 2016-12-01 22 2 Intel Xeon E5-2620 v4 8 cores/CPU x86_64 64 GiB 598 GB HDD 10 Gbps (SR‑IOV) 
Lyon orion 2012-09-14 3 2 Intel Xeon E5-2630 6 cores/CPU x86_64 32 GiB 299 GB HDD 10 Gbps (SR‑IOV)  Nvidia Tesla M2075 (5 GiB)**
Lyon pyxis exotic job type 2020-01-06 4 2 Cavium ThunderX2 99xx 32 cores/CPU aarch64 256 GiB 250 GB SSD + 250 GB SSD 10 Gbps (SR‑IOV) + 100 Gbps InfiniBand
Lyon sagittaire 2006-07-01 10 2 AMD Opteron 250 1 core/CPU x86_64 2 GiB 73 GB HDD 1 Gbps 
Lyon sirius exotic job type 2021-11-18 1 2 AMD EPYC 7742 64 cores/CPU x86_64 1.0 TiB 1.92 TB SSD + 1.92 TB SSD + 4 x 3.84 TB SSD 100 Gbps  8 x Nvidia A100 (40 GiB)
Lyon taurus 2012-09-14 12 2 Intel Xeon E5-2630 6 cores/CPU x86_64 32 GiB 299 GB HDD 10 Gbps (SR‑IOV) 
Nancy graffiti production queue 2019-06-07 13 2 Intel Xeon Silver 4110 8 cores/CPU x86_64 128 GiB 479 GB HDD 10 Gbps  [1-12]: 4 x Nvidia RTX 2080 Ti (11 GiB)
13: 4 x Nvidia Quadro RTX 6000 (22 GiB)
Nancy graoully production queue 2016-01-04 16 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand
Nancy graphique production queue 2015-05-12 5 2 Intel Xeon E5-2620 v3 6 cores/CPU x86_64 64 GiB 299 GB HDD 10 Gbps + 56 Gbps InfiniBand 2 x Nvidia GTX 980 (4 GiB)
Nancy grappe production queue 2020-08-20 16 2 Intel Xeon Gold 5218R 20 cores/CPU x86_64 96 GiB 480 GB SSD + 8.0 TB HDD* 25 Gbps 
Nancy grat production queue 2022-09-07 1 2 AMD EPYC 7513 32 cores/CPU x86_64 512 GiB 3.84 TB SSD + 7 x 3.84 TB SSD 25 Gbps (SR‑IOV)  8 x Nvidia A100 (40 GiB)
Nancy grele production queue 2017-06-26 14 2 Intel Xeon E5-2650 v4 12 cores/CPU x86_64 128 GiB 299 GB HDD + 299 GB HDD 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path 2 x Nvidia GTX 1080 Ti (11 GiB)
Nancy grimani production queue 2016-08-30 6 2 Intel Xeon E5-2603 v3 6 cores/CPU x86_64 64 GiB 1.0 TB HDD 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path 2 x Nvidia Tesla K40M (11 GiB)
Nancy grimoire 2016-01-22 8 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* 4 x 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand
Nancy grisou 2016-01-04 46 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 600 GB HDD 1 Gbps + 4 x 10 Gbps (SR‑IOV) 
Nancy gros 2019-09-04 124 1 Intel Xeon Gold 5220 18 cores/CPU x86_64 96 GiB 480 GB SSD + 960 GB SSD* 2 x 25 Gbps (SR‑IOV) 
Nancy grouille exotic job type 2021-01-13 2 2 AMD EPYC 7452 32 cores/CPU x86_64 128 GiB 1.92 TB SSD + 960 GB SSD* 25 Gbps  2 x Nvidia A100 (40 GiB)
Nancy grue production queue 2019-11-25 5 2 AMD EPYC 7351 16 cores/CPU x86_64 128 GiB 479 GB HDD 10 Gbps  4 x Nvidia Tesla T4 (15 GiB)
Nancy gruss production queue 2021-08-26 4 2 AMD EPYC 7352 24 cores/CPU x86_64 256 GiB 1.92 TB SSD 25 Gbps  2 x Nvidia A40 (45 GiB)
Nancy grvingt production queue 2018-04-11 64 2 Intel Xeon Gold 6130 16 cores/CPU x86_64 192 GiB 1.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Nantes econome 2014-04-16 22 2 Intel Xeon E5-2660 8 cores/CPU x86_64 64 GiB 2.0 TB HDD 10 Gbps (SR‑IOV) 
Nantes ecotype 2017-10-16 48 2 Intel Xeon E5-2630L v4 10 cores/CPU x86_64 128 GiB 400 GB SSD 10 Gbps (SR‑IOV) 
Rennes abacus1 production queue 2023-10-24 1 2 Intel Xeon E5-2650 v4 12 cores/CPU x86_64 128 GiB 299 GB HDD 1 Gbps  2 x Nvidia Tesla K80 (11 GiB)
Rennes abacus2 production queue 2023-11-10 1 2 Intel Xeon E5-2609 v4 8 cores/CPU x86_64 64 GiB 299 GB HDD 1 Gbps (SR‑IOV)  2 x Nvidia Tesla P100 (16 GiB)
Rennes abacus3 production queue 2023-10-13 1 2 Intel Xeon E5-2620 v4 8 cores/CPU x86_64 128 GiB 299 GB HDD + 959 GB HDD + 8.0 TB HDD 1 Gbps  4 x Nvidia A5000 (24 GiB)
Rennes abacus4 production queue 2023-10-09 1 2 Intel Xeon Silver 4114 10 cores/CPU x86_64 128 GiB 959 GB HDD 1 Gbps  2 x Nvidia A40 (45 GiB)
Rennes abacus8 production queue 2023-11-17 1 2 Intel Xeon Gold 5120 14 cores/CPU x86_64 192 GiB 512 GB SSD + 512 GB SSD 1 Gbps  2 x Nvidia Quadro P6000 (24 GiB)
Rennes abacus9 production queue 2023-11-06 1 2 Intel Xeon Silver 4114 10 cores/CPU x86_64 192 GiB 239 GB HDD 10 Gbps  4 x Nvidia Tesla V100 (32 GiB)
Rennes abacus10 production queue 2023-10-30 1 2 Intel Xeon Silver 4114 10 cores/CPU x86_64 192 GiB 959 GB HDD + 299 GB HDD + 6.0 TB HDD 1 Gbps  4 x Nvidia A5000 (24 GiB)
Rennes abacus11 production queue 2023-10-24 1 2 Intel Xeon Silver 4114 10 cores/CPU x86_64 192 GiB 299 GB HDD + 959 GB HDD + 8.0 TB HDD 1 Gbps  4 x Nvidia RTX 2080 Ti (11 GiB)
Rennes abacus12 production queue 2023-11-17 1 2 Intel Xeon Gold 6248 20 cores/CPU x86_64 384 GiB 299 GB HDD 10 Gbps  3 x Nvidia Tesla V100 (32 GiB)
Rennes abacus14 production queue 2023-11-08 1 2 Intel Xeon Silver 4214 12 cores/CPU x86_64 384 GiB 240 GB SSD + 240 GB SSD 10 Gbps  4 x Nvidia Tesla V100 (32 GiB)
Rennes abacus16 production queue 2023-10-16 1 2 Intel Xeon Silver 4214 12 cores/CPU x86_64 384 GiB 239 GB HDD 10 Gbps  4 x Nvidia Tesla V100 (32 GiB)
Rennes abacus17 production queue 2023-11-17 1 2 AMD EPYC 7282 16 cores/CPU x86_64 256 GiB 240 GB SSD + 960 GB SSD 1 Gbps  2 x Nvidia Quadro RTX 6000 (22 GiB)
Rennes abacus18 production queue 2023-10-11 1 2 AMD EPYC 7352 24 cores/CPU x86_64 256 GiB 240 GB SSD + 960 GB SSD 1 Gbps  3 x Nvidia Quadro RTX 6000 (22 GiB)
Rennes abacus19 production queue 2023-11-17 1 2 Intel Xeon Gold 5220R 24 cores/CPU x86_64 384 GiB 960 GB SSD + 240 GB SSD 1 Gbps  2 x Nvidia Quadro RTX 8000 (44 GiB)
Rennes abacus20 production queue 2023-10-11 1 2 Intel Xeon Gold 5220R 24 cores/CPU x86_64 768 GiB 480 GB SSD + 1.92 TB SSD 1 Gbps  4 x Nvidia Quadro RTX 8000 (44 GiB)
Rennes abacus25 production queue 2023-06-05 4 2 AMD EPYC 7413 24 cores/CPU x86_64 512 GiB 960 GB SSD + 2 x 960 GB SSD 10 Gbps (SR‑IOV)  3 x Nvidia A40 (45 GiB)
Rennes paranoia production queue 2014-02-21 7 2 Intel Xeon E5-2660 v2 10 cores/CPU x86_64 128 GiB 600 GB HDD + 4 x 600 GB HDD 1 Gbps (SR‑IOV) + 2 x 10 Gbps (SR‑IOV) 
Rennes parasilo 2015-01-13 27 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* 2 x 10 Gbps (SR‑IOV) 
Rennes paravance 2015-01-13 72 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 600 GB HDD 2 x 10 Gbps (SR‑IOV) 
Rennes roazhon1 production queue 2023-10-24 1 2 Intel Xeon Gold 6154 18 cores/CPU x86_64 384 GiB 799 GB HDD 1 Gbps 
Rennes roazhon2 production queue 2023-09-06 1 2 Intel Xeon Gold 5120 14 cores/CPU x86_64 256 GiB 799 GB HDD + 16 GB HDD 1 Gbps 
Rennes roazhon4 production queue 2023-09-06 1 2 AMD EPYC 7H12 64 cores/CPU x86_64 512 GiB 480 GB HDD + 2.0 TB HDD 1 Gbps 
Rennes roazhon5 production queue 2023-10-13 11 2 Intel Xeon E5-2660 v3 10 cores/CPU x86_64 128 GiB 598 GB HDD 1 Gbps (SR‑IOV) 
Rennes roazhon6 production queue 2023-10-24 4 2 Intel Xeon E5-2650 v4 12 cores/CPU x86_64 192 GiB 1.2 TB HDD 1 Gbps (SR‑IOV) 
Rennes roazhon8 production queue 2023-10-24 4 2 Intel Xeon E5-2650 v4 12 cores/CPU x86_64 256 GiB 1.0 TB HDD 10 Gbps (SR‑IOV) 
Rennes roazhon9 production queue 2023-10-09 4 2 Intel Xeon Gold 5118 12 cores/CPU x86_64 512 GiB 1.2 TB HDD 10 Gbps 
Rennes roazhon10 production queue 2023-10-24 4 2 Intel Xeon Gold 5220 18 cores/CPU x86_64 384 GiB 239 GB HDD + 1.92 TB HDD 10 Gbps 
Rennes roazhon11 production queue 2023-10-24 3 2 Intel Xeon E5-2660 8 cores/CPU x86_64 64 GiB 597 GB HDD 1 Gbps (SR‑IOV) 
Rennes roazhon12 production queue 2023-10-24 4 2 Intel Xeon E5-2660 8 cores/CPU x86_64 128 GiB 597 GB HDD 1 Gbps (SR‑IOV) 
Rennes roazhon13 production queue 2023-10-06 8 2 Intel Xeon Gold 6254 18 cores/CPU x86_64 384 GiB 1.0 TB HDD 10 Gbps 
Sophia uvb 2011-01-04 30 2 Intel Xeon X5670 6 cores/CPU x86_64 96 GiB 250 GB HDD 1 Gbps (SR‑IOV) + 40 Gbps InfiniBand
Toulouse estats testing queue,
exotic job type
2023-06-13 12 1 Nvidia Carmel 8 cores/CPU aarch64 32 GiB 2.0 TB SSD 1 Gbps  Nvidia AGX Xavier (30 GiB)
Toulouse montcalm testing queue 2022-12-01 9 2 Intel Xeon Silver 4314 16 cores/CPU x86_64 256 GiB 960 GB SSD 10 Gbps 

CPUs

CPU counts per architecture

Arch Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse CPU total
aarch64 8 12 20
ppc64le 24 24
x86_64 92 32 22 118 524 140 340 60 18 1346
Sites total 116 32 22 126 524 140 340 60 30 1390

Core counts per architecture

Arch Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Core total
aarch64 256 96 352
ppc64le 240 240
x86_64 1504 448 132 1288 7260 1312 3588 360 288 16180
Sites total 1744 448 132 1544 7260 1312 3588 360 384 16772

CPU counts per family

Vendor Family Arch Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse CPU total
AMD EPYC x86_64 4 16 12 24 14 70
AMD Opteron x86_64 20 20
Cavium ThunderX2 aarch64 8 8
IBM POWER8NVL ppc64le 24 24
Intel Xeon x86_64 88 16 22 86 500 140 326 60 18 1256
Nvidia Carmel aarch64 12 12
Sites total 116 32 22 126 524 140 340 60 30 1390

Core counts per family

Vendor Family Arch Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Core total
AMD EPYC x86_64 96 256 608 544 400 1904
AMD Opteron x86_64 20 20
Cavium ThunderX2 aarch64 256 256
IBM POWER8NVL ppc64le 240 240
Intel Xeon x86_64 1408 192 132 660 6716 1312 3188 360 288 14256
Nvidia Carmel aarch64 96 96
Sites total 1744 448 132 1544 7260 1312 3588 360 384 16772

CPU counts per model

Vendor Model Microarch Arch Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse CPU total
AMD Opteron 250 K8 x86_64 20 20
AMD EPYC 7301 Zen x86_64 16 16
AMD EPYC 7351 Zen x86_64 10 10
AMD EPYC 7282 Zen 2 x86_64 2 2
AMD EPYC 7352 Zen 2 x86_64 4 8 2 14
AMD EPYC 7452 Zen 2 x86_64 4 4
AMD EPYC 7642 Zen 2 x86_64 10 10
AMD EPYC 7742 Zen 2 x86_64 2 2
AMD EPYC 7H12 Zen 2 x86_64 2 2
AMD EPYC 7413 Zen 3 x86_64 8 8
AMD EPYC 7513 Zen 3 x86_64 2 2
Cavium ThunderX2 99xx Vulcan aarch64 8 8
IBM POWER8NVL 1.0 POWER8 ppc64le 24 24
Intel Xeon X5670 Westmere x86_64 60 60
Intel Xeon E5-2609 v4 Sandy Bridge x86_64 2 2
Intel Xeon E5-2620 Sandy Bridge x86_64 8 8
Intel Xeon E5-2630 Sandy Bridge x86_64 30 30
Intel Xeon E5-2630L Sandy Bridge x86_64 22 22
Intel Xeon E5-2650 v4 Sandy Bridge x86_64 2 2
Intel Xeon E5-2660 Sandy Bridge x86_64 44 14 58
Intel Xeon E5-2660 v2 Sandy Bridge x86_64 14 14
Intel Xeon E5-2603 v3 Haswell x86_64 12 12
Intel Xeon E5-2620 v3 Haswell x86_64 10 10
Intel Xeon E5-2630 v3 Haswell x86_64 140 198 338
Intel Xeon E5-2650 v4 Haswell x86_64 8 8
Intel Xeon E5-2660 v3 Haswell x86_64 22 22
Intel Xeon E5-2620 v4 Broadwell x86_64 44 2 46
Intel Xeon E5-2630L v4 Broadwell x86_64 96 96
Intel Xeon E5-2650 v4 Broadwell x86_64 28 8 36
Intel Xeon E5-2698 v4 Broadwell x86_64 4 4
Intel Xeon Gold 5118 Skylake x86_64 8 8
Intel Xeon Gold 5120 Skylake x86_64 4 4
Intel Xeon Gold 6126 Skylake x86_64 16 16
Intel Xeon Gold 6130 Skylake x86_64 80 128 208
Intel Xeon Gold 6154 Skylake x86_64 2 2
Intel Xeon Silver 4110 Skylake x86_64 26 26
Intel Xeon Silver 4114 Skylake x86_64 8 8
Intel Xeon Silver 4214 Skylake x86_64 2 2
Intel Xeon Gold 5218 Cascade Lake-SP x86_64 8 8
Intel Xeon Gold 5218R Cascade Lake-SP x86_64 32 32
Intel Xeon Gold 5220 Cascade Lake-SP x86_64 124 8 132
Intel Xeon Gold 5220R Cascade Lake-SP x86_64 4 4
Intel Xeon Gold 6248 Cascade Lake-SP x86_64 2 2
Intel Xeon Gold 6254 Cascade Lake-SP x86_64 16 16
Intel Xeon Silver 4214 Cascade Lake-SP x86_64 2 2
Intel Xeon Silver 4314 Ice Lake x86_64 18 18
Nvidia Carmel Carmel aarch64 12 12
Sites total 116 32 22 126 524 140 340 60 30 1390

Core counts per model

Vendor Model Microarch Arch Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Cores total
AMD Opteron 250 K8 x86_64 20 20
AMD EPYC 7301 Zen x86_64 256 256
AMD EPYC 7351 Zen x86_64 160 160
AMD EPYC 7282 Zen 2 x86_64 32 32
AMD EPYC 7352 Zen 2 x86_64 96 192 48 336
AMD EPYC 7452 Zen 2 x86_64 128 128
AMD EPYC 7642 Zen 2 x86_64 480 480
AMD EPYC 7742 Zen 2 x86_64 128 128
AMD EPYC 7H12 Zen 2 x86_64 128 128
AMD EPYC 7413 Zen 3 x86_64 192 192
AMD EPYC 7513 Zen 3 x86_64 64 64
Cavium ThunderX2 99xx Vulcan aarch64 256 256
IBM POWER8NVL 1.0 POWER8 ppc64le 240 240
Intel Xeon X5670 Westmere x86_64 360 360
Intel Xeon E5-2609 v4 Sandy Bridge x86_64 16 16
Intel Xeon E5-2620 Sandy Bridge x86_64 48 48
Intel Xeon E5-2630 Sandy Bridge x86_64 180 180
Intel Xeon E5-2630L Sandy Bridge x86_64 132 132
Intel Xeon E5-2650 v4 Sandy Bridge x86_64 24 24
Intel Xeon E5-2660 Sandy Bridge x86_64 352 112 464
Intel Xeon E5-2660 v2 Sandy Bridge x86_64 140 140
Intel Xeon E5-2603 v3 Haswell x86_64 72 72
Intel Xeon E5-2620 v3 Haswell x86_64 60 60
Intel Xeon E5-2630 v3 Haswell x86_64 1120 1584 2704
Intel Xeon E5-2650 v4 Haswell x86_64 96 96
Intel Xeon E5-2660 v3 Haswell x86_64 220 220
Intel Xeon E5-2620 v4 Broadwell x86_64 352 16 368
Intel Xeon E5-2630L v4 Broadwell x86_64 960 960
Intel Xeon E5-2650 v4 Broadwell x86_64 336 96 432
Intel Xeon E5-2698 v4 Broadwell x86_64 80 80
Intel Xeon Gold 5118 Skylake x86_64 96 96
Intel Xeon Gold 5120 Skylake x86_64 56 56
Intel Xeon Gold 6126 Skylake x86_64 192 192
Intel Xeon Gold 6130 Skylake x86_64 1280 2048 3328
Intel Xeon Gold 6154 Skylake x86_64 36 36
Intel Xeon Silver 4110 Skylake x86_64 208 208
Intel Xeon Silver 4114 Skylake x86_64 80 80
Intel Xeon Silver 4214 Skylake x86_64 24 24
Intel Xeon Gold 5218 Cascade Lake-SP x86_64 128 128
Intel Xeon Gold 5218R Cascade Lake-SP x86_64 640 640
Intel Xeon Gold 5220 Cascade Lake-SP x86_64 2232 144 2376
Intel Xeon Gold 5220R Cascade Lake-SP x86_64 96 96
Intel Xeon Gold 6248 Cascade Lake-SP x86_64 40 40
Intel Xeon Gold 6254 Cascade Lake-SP x86_64 288 288
Intel Xeon Silver 4214 Cascade Lake-SP x86_64 24 24
Intel Xeon Silver 4314 Ice Lake x86_64 288 288
Nvidia Carmel Carmel aarch64 96 96
Sites total 1744 448 132 1544 7260 1312 3588 360 384 16772

Memory

RAM size per node

RAM size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Nodes total
2 GiB 10 10
32 GiB 11 19 12 42
64 GiB 22 11 22 4 59
96 GiB 140 30 170
128 GiB 14 8 104 48 124 298
192 GiB 32 8 64 8 112
256 GiB 4 4 7 9 24
384 GiB 4 17 21
512 GiB 12 1 9 22
768 GiB 4 1 5
1.0 TiB 1 1
Sites total 54 16 11 68 324 70 170 30 21 764

PMEM size per node

PMEM size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Nodes total
1.5 TiB 4 4
Sites total 4 4

Accelerators (GPU, Xeon Phi, FPGA)

Accelerator counts per type

Vendor Type Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Accelerators total
AMD GPU 80 80
Nvidia GPU 48 16 27 142 58 12 303
Xilinx FPGA 2 2
Sites total 50 16 107 142 58 12 385

Accelerator counts per model

Vendor Type Model Microarch Memory Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Accelerators total
AMD GPU MI50 Vega20 32GB 80 80
Nvidia GPU A100 Ampere 40GB 8 12 20
Nvidia GPU A40 Ampere 45GB 8 14 22
Nvidia GPU A5000 Ampere 24GB 8 8
Nvidia GPU AGX Xavier Volta 30GB 12 12
Nvidia GPU GTX 1080 Ti Pascal 11GB 28 28
Nvidia GPU GTX 980 Fermi 4GB 10 10
Nvidia GPU Quadro P6000 Pascal 24GB 2 2
Nvidia GPU Quadro RTX 6000 Turing 22GB 4 5 9
Nvidia GPU Quadro RTX 8000 Turing 44GB 6 6
Nvidia GPU RTX 2080 Ti Turing 11GB 48 4 52
Nvidia GPU Tesla K40M Kepler 11GB 12 12
Nvidia GPU Tesla K80 Kepler 11GB 2 2
Nvidia GPU Tesla M2075 Maxwell 5GB 3 3
Nvidia GPU Tesla P100 Pascal 16GB 48 12 2 62
Nvidia GPU Tesla T4 Turing 15GB 20 20
Nvidia GPU Tesla V100 Volta 32GB 4 16 15 35
Xilinx FPGA Alveo U200 N/A 64GB 2 2
Sites total 50 16 107 142 58 12 385

GPU core counts per GPU model

Vendor Model Microarch Memory Compute capability Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Cores total
AMD MI50 Vega20 32GB N/A 409600 409600
Nvidia A100 Ampere 40GB 8.0 55296 82944 138240
Nvidia A40 Ampere 45GB 8.6 86016 150528 236544
Nvidia A5000 Ampere 24GB 8.6 65536 65536
Nvidia AGX Xavier Volta 30GB 7.2 6144 6144
Nvidia GTX 1080 Ti Pascal 11GB 6.1 100352 100352
Nvidia GTX 980 Fermi 4GB 5.2 20480 20480
Nvidia Quadro P6000 Pascal 24GB 6.1 7680 7680
Nvidia Quadro RTX 6000 Turing 22GB 7.5 18432 23040 41472
Nvidia Quadro RTX 8000 Turing 44GB 7.5 27648 27648
Nvidia RTX 2080 Ti Turing 11GB 7.5 208896 17408 226304
Nvidia Tesla K40M Kepler 11GB 3.5 34560 34560
Nvidia Tesla K80 Kepler 11GB 3.7 4992 4992
Nvidia Tesla M2075 Maxwell 5GB 2.0 1344 1344
Nvidia Tesla P100 Pascal 16GB 6.0 172032 43008 7168 222208
Nvidia Tesla T4 Turing 15GB 7.5 51200 51200
Nvidia Tesla V100 Volta 32GB 7.0 20480 81920 76800 179200
Sites total 172032 63488 548160 602880 380800 6144 1773504

Networking

Network interconnects

Interconnect Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Cards total
Ethernet 1 Gbps 10 46 43 30 12 141
Ethernet 10 Gbps 48 22 67 339 70 240 9 795
Ethernet 25 Gbps 6 32 271 309
Ethernet 100 Gbps 1 1
FPGA/Ethernet 100 Gbps 4 4
InfiniBand 40 Gbps 30 30
InfiniBand 56 Gbps 29 29
InfiniBand 100 Gbps 24 30 54
Omni-Path 100 Gbps 40 84 124
Sites total 122 32 22 108 769 70 283 60 21 1487

Nodes with several Ethernet interfaces

Site Cluster Nodes 25G interfaces 10G interfaces 1G interfaces Interfaces (throughput)
Lille chiclet 8 2 enp98s0f0 (25 Gbps), enp98s0f1 (25 Gbps)
Lille chifflot 8 2 ens5f0 (25 Gbps), ens5f1 (25 Gbps)
Luxembourg petitprince 11 2 eno1 (10 Gbps), eno2 (10 Gbps)
Lyon neowise 10 2 eno1 (10 Gbps), eno2 (10 Gbps)
Nancy grimoire 8 4 eno1 (10 Gbps), eno2 (10 Gbps), enp129s0f0 (10 Gbps), enp129s0f1 (10 Gbps)
Nancy grisou 46 4 1 eno1 (10 Gbps), eno2 (10 Gbps), eno3 (1 Gbps), enp4s0f0 (10 Gbps), enp4s0f1 (10 Gbps)
Nancy gros 124 2 eno1 (25 Gbps), eno2 (25 Gbps)
Rennes paranoia 7 2 1 eno1 (1 Gbps), enp3s0f0 (10 Gbps), enp3s0f1 (10 Gbps)
Rennes parasilo 27 2 eno1 (10 Gbps), eno2 (10 Gbps)
Rennes paravance 72 2 eno1 (10 Gbps), eno2 (10 Gbps)

Nodes with SR-IOV support

Site Cluster Nodes Interfaces (max number of Virtual Functions)
Grenoble troll 4 eno1 (63 VFs)
Lyon gemini 2 enp1s0f0 (63 VFs)
Lyon hercule 4 enp130s0f1 (63 VFs)
Lyon neowise 10 eno1 (8 VFs), eno2 (8 VFs)
Lyon nova 22 enp5s0f0 (63 VFs)
Lyon orion 3 enp68s0f0 (63 VFs)
Lyon pyxis 4 eno1 (96 VFs)
Lyon taurus 12 enp68s0f0 (63 VFs)
Nancy graoully 16 eno1 (63 VFs)
Nancy grat 1 ens21f0np0 (8 VFs)
Nancy grele 14 eno1 (63 VFs)
Nancy grimani 6 eno1 (63 VFs)
Nancy grimoire 8 eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs)
Nancy grisou 46 eno1 (63 VFs), eno2 (63 VFs), enp4s0f0 (63 VFs), enp4s0f1 (63 VFs)
Nancy gros 124 eno1 (63 VFs), eno2 (63 VFs)
Nantes econome 22 enp3s0f0 (63 VFs)
Nantes ecotype 48 eno1 (63 VFs)
Rennes abacus25 4 ens10f0 (64 VFs)
Rennes abacus2 1 eno1 (7 VFs)
Rennes paranoia 7 eno1 (7 VFs), enp3s0f0 (63 VFs), enp3s0f1 (63 VFs)
Rennes parasilo 27 eno1 (63 VFs), eno2 (63 VFs)
Rennes paravance 72 eno1 (63 VFs), eno2 (63 VFs)
Rennes roazhon11 3 eno1 (7 VFs)
Rennes roazhon12 4 eno1 (7 VFs)
Rennes roazhon5 11 eno1 (7 VFs)
Rennes roazhon6 4 eno1 (7 VFs)
Rennes roazhon8 4 eno1 (63 VFs)
Sophia uvb 30 eno1 (7 VFs)

Network interface models

Type Driver Model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Cards total
Ethernet bnx2x Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet 12 5 17
Ethernet bnx2x Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet 11 11
Ethernet bnxt_en Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller 9 9
Ethernet bnxt_en Broadcom Inc. and subsidiaries BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller 1 1
Ethernet i40e Intel Ethernet Controller X710 for 10GbE SFP+ 36 82 20 138
Ethernet i40e Intel Ethernet Controller XXV710 for 25GbE SFP28 16 16 32
Ethernet i40e Intel Ethernet Controller XXV710 for 25GbE backplane 4 4
Ethernet ice Intel Ethernet Controller E810-C for SFP 2 2
Ethernet igb Intel 82576 Gigabit Network Connection 30 30
Ethernet igb Intel I350 Gigabit Backplane Connection 15 15
Ethernet igb Intel I350 Gigabit Network Connection 46 24 70
Ethernet ixgbe Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection 4 90 70 110 274
Ethernet ixgbe Intel Ethernet 10G 2P X520 Adapter 37 54 91
Ethernet ixgbe Intel Ethernet Controller 10-Gigabit X540-AT2 2 2
Ethernet mlx5_core Mellanox Technologies MT27710 Family [ConnectX-4 Lx] 4 10 124 138
Ethernet mlx5_core Mellanox Technologies MT27800 Family [ConnectX-5] 7 7
Ethernet mlx5_core Mellanox Technologies MT28908 Family [ConnectX-6] 1 1
Ethernet nvethernet N/A N/A 12 12
Ethernet qede QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller 4 4
Ethernet tg3 Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet 10 10
Ethernet tg3 Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe 3 3
FPGA/Ethernet* n/a Xilinx Alveo U200 QSFP28 (100GbE) 2 2
InfiniBand mlx4_core Mellanox Technologies MT25408A0-FCC-QI ConnectX, Dual Port 40Gb/s InfiniBand / 10GigE Adapter IC with PCIe 2.0 x8 5.0GT/s Interface 30 30
InfiniBand mlx4_core Mellanox Technologies MT27500 Family [ConnectX-3] 29 29
InfiniBand mlx5_core Mellanox Technologies MT27700 Family [ConnectX-4] 12 12
InfiniBand mlx5_core Mellanox Technologies MT27800 Family [ConnectX-5] 2 2
InfiniBand mlx5_core Mellanox Technologies MT28908 Family [ConnectX-6] 14 14
Omni-Path hfi1 Intel Omni-Path HFI Silicon 100 Series [discrete] 40 84 124
Sites total 108 16 11 84 537 70 177 60 21 1084

*: Ethernet interfaces on FPGA cards are not directly usable by the operating system

Storage

SSD models

SSD interface Model Size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse SSDs total
NVME Dell Ent NVMe v2 AGN MU U.2 1.6TB 1.6 TB 4 4
NVME Dell Express Flash NVMe PM1725 1.6TB AIC 1.6 TB 7 7
NVME Dell Express Flash PM1725b 1.6TB AIC 1.6 TB 1 1
NVME Dell Samsung PM1735 1.6 TB 4 4
NVME Kioxia KCM6DRUL3T84 3.84 TB 4 4
NVME SAMSUNG MZ1LB1T9HALS-00007 1.92 TB 12 12
NVME Samsung SSD 970 EVO Plus 2TB 2.0 TB 12 12
SAS HP VO003840RZWVA 3.84 TB 8 8
SAS HPE MO000960RXKRC 960 GB 2 2
SAS HPE MO000960RXRQK 960 GB 2 2
SAS Toshiba KRM5XVUG1T92 1.92 TB 2 2
SAS Toshiba PX02SSF020 200 GB 8 26 34
SAS Toshiba PX04SHB020 200 GB 1 1
SAS Toshiba PX04SMB040 400 GB 48 48
SAS Toshiba PX05SVB048Y 480 GB 8 8
SATA HP VK000960GXAWL 960 GB 9 9
SATA HP VK000960GXNZB 960 GB 2 2
SATA HP VK000960GZCNF 960 GB 6 6
SATA Intel SSDSC2KB960G8R 960 GB 1 1
SATA Intel SSDSC2KG480G7R 480 GB 3 16 19
SATA Intel SSDSC2KG480G8R 480 GB 1 16 17
SATA Intel SSDSC2KG960G8R 960 GB 1 1
SATA Intel SSDSCKKB240G8R 240 GB 1 1
SATA Micron MTFDDAK480TDN 480 GB 4 123 127
SATA Micron MTFDDAK960TDD 960 GB 2 2
SATA Micron MTFDDAK960TDN 960 GB 123 123
SATA Micron MTFDDAK960TDT 960 GB 2 2
SATA Micron MTFDDAV240TCB 240 GB 3 3
SATA Micron MTFDDAV240TDU 240 GB 1 1
SATA SAMSUNG MZ7KM480 480 GB 2 2
SATA SAMSUNG MZ7LM1T9 1.92 TB 8 8
SATA SK hynix SC311 S 512 GB 2 2
SATA Samsung MZ7KH1T9HAJR0D3 1.92 TB 1 1
SATA Samsung MZ7KH480HAHQ0D3 480 GB 1 1
SATA Samsung MZ7KM240HMHQ0D3 240 GB 32 32
SATA Samsung MZ7KM480HMHQ0D3 480 GB 32 32
SATA Samsung MZ7LH480HBHQ0D3 480 GB 1 1
SATA Samsung MZILT1T9HBJR0D3 1.92 TB 1 1
SATA Samsung SSD 860 250 GB 8 8
SATA Sk Hynix HFS1T9G32FEH-BA1 1.92 TB 3 3
Sites total 88 24 34 288 48 51 21 554

Nodes with several disks

Site Cluster Number of nodes Main disk Additional HDDs Additional SSDs
Grenoble dahu 32 SSD 240 GB 1 (4.0 TB) 1 (480 GB)
Grenoble drac 12 HDD 1.0 TB 1 (1.0 TB) 0
Grenoble servan 2 SSD 1.6 TB 0 1 (1.6 TB)
Grenoble troll 4 SSD 480 GB 0 1 (1.6 TB)
Grenoble yeti 4 SSD 480 GB 3 (2.0 TB*, 2.0 TB*, 2.0 TB*) 2 (1.6 TB, 1.6 TB)
Lille chiclet 8 SSD 480 GB 2 (4.0 TB*, 4.0 TB*) 0
Lille chifflot 8 SSD 480 GB 4 (4.0 TB*, 4.0 TB*, 4.0 TB*, 4.0 TB*) 1 (480 GB*)
Lyon gemini 2 SSD 480 GB 0 4 (1.92 TB*, 1.92 TB*, 1.92 TB*, 1.92 TB*)
Lyon hercule 4 HDD 2.0 TB 2 (2.0 TB, 2.0 TB) 0
Lyon pyxis 4 SSD 250 GB 0 1 (250 GB)
Lyon sirius 1 SSD 1.92 TB 0 5 (1.92 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB)
Nancy grappe 16 SSD 480 GB 1 (8.0 TB*) 0
Nancy grat 1 SSD 3.84 TB 0 7 (3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB)
Nancy grele 14 HDD 299 GB 1 (299 GB) 0
Nancy grimoire 8 HDD 600 GB 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) 1 (200 GB*)
Nancy grisou 46 HDD 600 GB 1 (600 GB) 0
Nancy gros 124 SSD 480 GB 0 1 (960 GB*)
Nancy grouille 2 SSD 1.92 TB 0 1 (960 GB*)
Rennes abacus10 1 HDD 959 GB 2 (299 GB, 6.0 TB) 0
Rennes abacus11 1 HDD 299 GB 2 (959 GB, 8.0 TB) 0
Rennes abacus14 1 SSD 240 GB 0 1 (240 GB)
Rennes abacus17 1 SSD 240 GB 0 1 (960 GB)
Rennes abacus18 1 SSD 240 GB 0 1 (960 GB)
Rennes abacus19 1 SSD 960 GB 0 1 (240 GB)
Rennes abacus20 1 SSD 480 GB 0 1 (1.92 TB)
Rennes abacus25 4 SSD 960 GB 0 2 (960 GB, 960 GB)
Rennes abacus3 1 HDD 299 GB 2 (959 GB, 8.0 TB) 0
Rennes abacus8 1 SSD 512 GB 0 1 (512 GB)
Rennes paranoia 7 HDD 600 GB 4 (600 GB, 600 GB, 600 GB, 600 GB) 0
Rennes parasilo 27 HDD 600 GB 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) 1 (200 GB*)
Rennes paravance 72 HDD 600 GB 1 (600 GB) 0
Rennes roazhon10 4 HDD 239 GB 1 (1.92 TB) 0
Rennes roazhon2 1 HDD 799 GB 1 (16 GB) 0
Rennes roazhon4 1 HDD 480 GB 1 (2.0 TB) 0

*: disk is reservable

Nodes models

Nodes model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Nodes total
AMD-Penguin Computing 10 10
Connecttech/Nvidia Jetson AGX Xavier 12 12
DELL C4140 1 1
Dell PowerEdge C4140 2 2
Dell PowerEdge C6100 30 30
Dell PowerEdge C6220 4 22 7 33
Dell PowerEdge C6220 II 7 7
Dell PowerEdge C6320 4 4
Dell PowerEdge C6420 32 64 8 104
Dell PowerEdge M620 11 11
Dell PowerEdge M630 15 15
Dell PowerEdge MX740c 4 4
Dell PowerEdge R430 22 22
Dell PowerEdge R630 70 48 99 217
Dell PowerEdge R640 4 140 2 146
Dell PowerEdge R720 15 5 20
Dell PowerEdge R730 20 2 22
Dell PowerEdge R740 8 2 10
Dell PowerEdge R7425 8 5 13
Dell PowerEdge R7525 2 6 2 10
Dell PowerEdge R7920 1 1
Dell PowerEdge R940 4 4
Dell PowerEdge T640 13 3 16
Dell R740 1 1
Gigabyte R181-T92-00 4 4
HPE Apollo 6500 1 1
HPE ProLiant DL385 Gen10+ v2 4 4
HPE Proliant DL360 Gen10+ 9 9
IBM PowerNV S822LC (8335-GTB) 12 12
NVidia DGX A100 1 1
Nvidia DGX-1 2 2
PowerEdge C6420 4 4
PowerEdge R7525 1 1
PowerEdge T640 1 1
Sun Fire V20z 10 10
Sites total 54 16 11 68 324 70 170 30 21 764

Last generated from the Grid'5000 Reference API on 2023-12-05 (commit 2c9775698f)