Hardwaredev: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 71: | Line 71: | ||
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphique|graphique]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2015-05-12||5||2 x Intel Xeon E5-2620 v3||6 cores/CPU||64 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand||2 x Nvidia GTX 980 (4 GiB) | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphique|graphique]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2015-05-12||5||2 x Intel Xeon E5-2620 v3||6 cores/CPU||64 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand||2 x Nvidia GTX 980 (4 GiB) | ||
|- | |- | ||
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphite|graphite]]||||2013-12-05||4||2 x Intel Xeon E5-2650||8 cores/CPU||256 GiB||data-sort-value="558"|<b>1 x 300 GB SSD</b> + 1 x 300 GB SSD||data-sort-value="66000"|10 Gbps (SR‑IOV) + 56 Gbps InfiniBand||Intel Xeon Phi 7120P | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphite|graphite]]||||2013-12-05||4||2 x Intel Xeon E5-2650||8 cores/CPU||256 GiB||data-sort-value="558"|<b>1 x 300 GB SSD</b> + 1 x 300 GB SSD||data-sort-value="66000"|10 Gbps (SR‑IOV) + 56 Gbps InfiniBand||Intel Xeon Phi 7120P | ||
|- | |- | ||
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grappe|grappe]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2020-08-20||16||2 x Intel Xeon Gold 5218R||20 cores/CPU||96 GiB||data-sort-value="7899"|<b>480 GB SSD</b> + 8.0 TB HDD[[Disk_reservation|*]]||data-sort-value="25000"|25 Gbps || | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grappe|grappe]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2020-08-20||16||2 x Intel Xeon Gold 5218R||20 cores/CPU||96 GiB||data-sort-value="7899"|<b>480 GB SSD</b> + 8.0 TB HDD[[Disk_reservation|*]]||data-sort-value="25000"|25 Gbps || | ||
Revision as of 01:00, 24 May 2022
Summary
- 8 sites
- 40 clusters
- 755 nodes
- 15840 CPU cores
- 321 GPUs
- 102.36 TiB RAM + 6.0 TiB PMEM
- 525 SSDs and 940 HDDs on nodes (total: 1.44 PB)
- 622.0 TFLOPS (excluding GPUs)
Clusters
| Site | Cluster | Access Condition | Date of arrival | Nodes | CPU | Cores | Memory | Storage | Network | Accelerators |
|---|---|---|---|---|---|---|---|---|---|---|
| Grenoble | dahu | 2018-03-22 | 32 | 2 x Intel Xeon Gold 6130 | 16 cores/CPU | 192 GiB | 240 GB SSD + 480 GB SSD + 4.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path | ||
| Grenoble | drac | exotic job type | 2020-10-05 | 12 | 2 x Power POWER8NVL 1.0 | 10 cores/CPU | 128 GiB | 1 x 1.0 TB HDD + 1 x 1.0 TB HDD | 10 Gbps + 2 x 100 Gbps InfiniBand | 4 x Nvidia Tesla P100 (16 GiB) |
| Grenoble | servan | testing queue, exotic job type |
2021-12-15 | 2 | 2 x AMD EPYC 7352 | 24 cores/CPU | 128 GiB | 1 x 1.6 TB SSD + 1 x 1.6 TB SSD | 25 Gbps + 2 x 100 Gbps Ethernet-FPGA | Xilinx Alveo U200 |
| Grenoble | troll | exotic job type | 2019-12-23 | 4 | 2 x Intel Xeon Gold 5218 | 16 cores/CPU | 384 GiB + 1.5 TiB PMEM | 480 GB SSD + 1.6 TB SSD | 25 Gbps (SR‑IOV) + 100 Gbps Omni-Path | |
| Grenoble | yeti | exotic job type | 2018-01-16 | 4 | 4 x Intel Xeon Gold 6130 | 16 cores/CPU | 768 GiB | 480 GB SSD + 3 x 2.0 TB HDD* + 2 x 1.6 TB SSD | 10 Gbps + 100 Gbps Omni-Path | |
| Lille | chetemi | 2016-12-01 | 15 | 2 x Intel Xeon E5-2630 v4 | 10 cores/CPU | 256 GiB | [1-9, 10: 600 GB HDD + 300 GB HDD |
2 x 10 Gbps (SR‑IOV) | ||
| Lille | chiclet | 2018-08-06 | 8 | 2 x AMD EPYC 7301 | 16 cores/CPU | 128 GiB | 480 GB SSD + 2 x 4.0 TB HDD* | 2 x 25 Gbps | ||
| Lille | chifflet | 2016-12-01 | 8 | 2 x Intel Xeon E5-2680 v4 | 14 cores/CPU | 768 GiB | 400 GB SSD + 400 GB SSD* + 2 x 4.0 TB HDD* | 2 x 10 Gbps (SR‑IOV) | 2 x Nvidia GTX 1080 Ti (11 GiB) | |
| Lille | chifflot | 2018-08-01 | 8 | 2 x Intel Xeon Gold 6126 | 12 cores/CPU | 192 GiB | 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* | 2 x 25 Gbps | [1-6]: 2 x Nvidia Tesla P100 (16 GiB) [7-8]: 2 x Nvidia Tesla V100 (32 GiB) | |
| Luxembourg | petitprince | 2013-09-10 | 14 | 2 x Intel Xeon E5-2630L | 6 cores/CPU | 32 GiB | 250 GB HDD | 2 x 10 Gbps | ||
| Lyon | gemini | exotic job type | 2019-09-01 | 2 | 2 x Intel Xeon E5-2698 v4 | 20 cores/CPU | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD* | 10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand | 8 x Nvidia Tesla V100 (32 GiB) |
| Lyon | hercule | 2012-10-02 | 4 | 2 x Intel Xeon E5-2620 | 6 cores/CPU | 32 GiB | 1 x 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps (SR‑IOV) | ||
| Lyon | neowise | exotic job type | 2021-05-17 | 10 | AMD EPYC 7642 | 48 cores/CPU | 512 GiB | 1.92 TB SSD | 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand | 8 x AMD MI50 (32 GiB) |
| Lyon | nova | 2016-12-01 | 22 | 2 x Intel Xeon E5-2620 v4 | 8 cores/CPU | 64 GiB | 598 GB HDD | 10 Gbps (SR‑IOV) | ||
| Lyon | orion | 2012-09-14 | 3 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | Nvidia Tesla M2075 (5 GiB) | |
| Lyon | pyxis | exotic job type | 2020-01-06 | 4 | 2 x ARM ThunderX2 99xx | 32 cores/CPU | 256 GiB | 1 x 250 GB SSD + 1 x 250 GB SSD | 10 Gbps (SR‑IOV) + 100 Gbps InfiniBand | |
| Lyon | sagittaire | 2006-07-01 | 10 | 2 x AMD Opteron 250 | 1 core/CPU | 2 GiB | 73 GB HDD | 1 Gbps | ||
| Lyon | sirius | exotic job type | 2021-11-18 | 1 | 2 x AMD EPYC 7742 | 64 cores/CPU | 1.0 TiB | 1 x 1.92 TB SSD + 1 x 1.92 TB SSD + 4 x 3.84 TB SSD | 1 Gbps | 8 x Nvidia A100 (40 GiB) |
| Lyon | taurus | 2012-09-14 | 12 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | ||
| Nancy | graffiti | production queue | 2019-06-07 | 13 | 2 x Intel Xeon Silver 4110 | 8 cores/CPU | 128 GiB | 479 GB HDD | 10 Gbps | [1-12]: 4 x Nvidia RTX 2080 Ti (11 GiB) 13: 4 x Nvidia Quadro RTX 6000 (22 GiB) |
| Nancy | graoully | production queue | 2016-01-04 | 16 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 600 GB HDD | 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand | |
| Nancy | graphique | production queue | 2015-05-12 | 5 | 2 x Intel Xeon E5-2620 v3 | 6 cores/CPU | 64 GiB | 299 GB HDD | 10 Gbps + 56 Gbps InfiniBand | 2 x Nvidia GTX 980 (4 GiB) |
| Nancy | graphite | 2013-12-05 | 4 | 2 x Intel Xeon E5-2650 | 8 cores/CPU | 256 GiB | 1 x 300 GB SSD + 1 x 300 GB SSD | 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand | Intel Xeon Phi 7120P | |
| Nancy | grappe | production queue | 2020-08-20 | 16 | 2 x Intel Xeon Gold 5218R | 20 cores/CPU | 96 GiB | 480 GB SSD + 8.0 TB HDD* | 25 Gbps | |
| Nancy | grcinq | production queue | 2013-04-09 | 43 | 2 x Intel Xeon E5-2650 | 8 cores/CPU | 64 GiB | 1.0 TB HDD | 1 Gbps (SR‑IOV) + 56 Gbps InfiniBand | |
| Nancy | grele | production queue | 2017-06-26 | 14 | 2 x Intel Xeon E5-2650 v4 | 12 cores/CPU | 128 GiB | 1 x 299 GB HDD + 1 x 299 GB HDD | 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path | 2 x Nvidia GTX 1080 Ti (11 GiB) |
| Nancy | grimani | production queue | 2016-08-30 | 6 | 2 x Intel Xeon E5-2603 v3 | 6 cores/CPU | 64 GiB | 1.0 TB HDD | 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path | 2 x Nvidia Tesla K40M (11 GiB) |
| Nancy | grimoire | 2016-01-22 | 8 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* | 4 x 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand | ||
| Nancy | grisou | 2016-01-04 | 49 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 1 x 600 GB HDD + 1 x 600 GB HDD | [1-32, 49: 4 x 10 Gbps (SR‑IOV) [50-51]: 4 x 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand |
||
| Nancy | gros | 2019-09-04 | 124 | Intel Xeon Gold 5220 | 18 cores/CPU | 96 GiB | 480 GB SSD + 960 GB SSD* | 2 x 25 Gbps (SR‑IOV) | ||
| Nancy | grouille | exotic job type | 2021-01-13 | 2 | 2 x AMD EPYC 7452 | 32 cores/CPU | 128 GiB | 1.92 TB SSD + 960 GB SSD* | 25 Gbps | 2 x Nvidia A100 (40 GiB) |
| Nancy | grue | production queue | 2019-11-25 | 5 | 2 x AMD EPYC 7351 | 16 cores/CPU | 128 GiB | 479 GB HDD | 10 Gbps | 4 x Nvidia Tesla T4 (15 GiB) |
| Nancy | gruss | production queue | 2021-08-26 | 4 | 2 x AMD EPYC 7352 | 24 cores/CPU | 256 GiB | 1.92 TB SSD | 25 Gbps | 2 x Nvidia A40 (45 GiB) |
| Nancy | grvingt | production queue | 2018-04-11 | 64 | 2 x Intel Xeon Gold 6130 | 16 cores/CPU | 192 GiB | 1.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path | |
| Nantes | econome | 2014-04-16 | 22 | 2 x Intel Xeon E5-2660 | 8 cores/CPU | 64 GiB | 2.0 TB HDD | 10 Gbps (SR‑IOV) | ||
| Nantes | ecotype | 2017-10-16 | 48 | 2 x Intel Xeon E5-2630L v4 | 10 cores/CPU | 128 GiB | 400 GB SSD | 2 x 10 Gbps (SR‑IOV) | ||
| Rennes | paranoia | 2014-02-21 | 8 | 2 x Intel Xeon E5-2660 v2 | 10 cores/CPU | 128 GiB | 1 x 600 GB HDD + 4 x 600 GB HDD | 1 Gbps (SR‑IOV) + 2 x 10 Gbps (SR‑IOV) | ||
| Rennes | parasilo | 2015-01-13 | 27 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* | 2 x 10 Gbps (SR‑IOV) | ||
| Rennes | paravance | 2015-01-13 | 72 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 1 x 600 GB HDD + 1 x 600 GB HDD | 2 x 10 Gbps (SR‑IOV) | ||
| Sophia | uvb | 2011-01-04 | 30 | 2 x Intel Xeon X5670 | 6 cores/CPU | 96 GiB | 250 GB HDD | 1 Gbps (SR‑IOV) + 40 Gbps InfiniBand |
Processors
Processors counts per families
| Processor family | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Processors total |
|---|---|---|---|---|---|---|---|---|---|
| AMD EPYC | 4 | 16 | 12 | 22 | 54 | ||||
| AMD Opteron | 20 | 20 | |||||||
| Intel Xeon | 88 | 62 | 28 | 86 | 600 | 140 | 214 | 60 | 1278 |
| POWER8NVL | 24 | 24 | |||||||
| ThunderX2 | 8 | 8 | |||||||
| Sites total | 116 | 78 | 28 | 126 | 622 | 140 | 214 | 60 | 1384 |
Processors counts per models
| Microarchitecture | Processor model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Processors total |
|---|---|---|---|---|---|---|---|---|---|---|
| K8 | AMD Opteron 250 | 20 | 20 | |||||||
| Westmere | Intel Xeon X5670 | 60 | 60 | |||||||
| Sandy Bridge | Intel Xeon E5-2620 | 8 | 8 | |||||||
| Sandy Bridge | Intel Xeon E5-2630 | 30 | 30 | |||||||
| Sandy Bridge | Intel Xeon E5-2630L | 28 | 28 | |||||||
| Sandy Bridge | Intel Xeon E5-2650 | 94 | 94 | |||||||
| Sandy Bridge | Intel Xeon E5-2660 | 44 | 44 | |||||||
| Sandy Bridge | Intel Xeon E5-2660 v2 | 16 | 16 | |||||||
| Haswell | Intel Xeon E5-2603 v3 | 12 | 12 | |||||||
| Haswell | Intel Xeon E5-2620 v3 | 10 | 10 | |||||||
| Haswell | Intel Xeon E5-2630 v3 | 146 | 198 | 344 | ||||||
| POWER8 | POWER8NVL 1.0 | 24 | 24 | |||||||
| Broadwell | Intel Xeon E5-2620 v4 | 44 | 44 | |||||||
| Broadwell | Intel Xeon E5-2630 v4 | 30 | 30 | |||||||
| Broadwell | Intel Xeon E5-2630L v4 | 96 | 96 | |||||||
| Broadwell | Intel Xeon E5-2650 v4 | 28 | 28 | |||||||
| Broadwell | Intel Xeon E5-2680 v4 | 16 | 16 | |||||||
| Broadwell | Intel Xeon E5-2698 v4 | 4 | 4 | |||||||
| Skylake | Intel Xeon Gold 6126 | 16 | 16 | |||||||
| Skylake | Intel Xeon Gold 6130 | 80 | 128 | 208 | ||||||
| Skylake | Intel Xeon Silver 4110 | 26 | 26 | |||||||
| Zen | AMD EPYC 7301 | 16 | 16 | |||||||
| Zen | AMD EPYC 7351 | 10 | 10 | |||||||
| Vulcan | ThunderX2 99xx | 8 | 8 | |||||||
| Cascade Lake-SP | Intel Xeon Gold 5218 | 8 | 8 | |||||||
| Cascade Lake-SP | Intel Xeon Gold 5218R | 32 | 32 | |||||||
| Cascade Lake-SP | Intel Xeon Gold 5220 | 124 | 124 | |||||||
| Zen 2 | AMD EPYC 7352 | 4 | 8 | 12 | ||||||
| Zen 2 | AMD EPYC 7452 | 4 | 4 | |||||||
| Zen 2 | AMD EPYC 7642 | 10 | 10 | |||||||
| Zen 2 | AMD EPYC 7742 | 2 | 2 | |||||||
| Sites total | 116 | 78 | 28 | 126 | 622 | 140 | 214 | 60 | 1384 |
Cores counts per models
| Microarchitecture | Core model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Cores total |
|---|---|---|---|---|---|---|---|---|---|---|
| K8 | AMD Opteron 250 | 20 | 20 | |||||||
| Westmere | Intel Xeon X5670 | 360 | 360 | |||||||
| Sandy Bridge | Intel Xeon E5-2620 | 48 | 48 | |||||||
| Sandy Bridge | Intel Xeon E5-2630 | 180 | 180 | |||||||
| Sandy Bridge | Intel Xeon E5-2630L | 168 | 168 | |||||||
| Sandy Bridge | Intel Xeon E5-2650 | 752 | 752 | |||||||
| Sandy Bridge | Intel Xeon E5-2660 | 352 | 352 | |||||||
| Sandy Bridge | Intel Xeon E5-2660 v2 | 160 | 160 | |||||||
| Haswell | Intel Xeon E5-2603 v3 | 72 | 72 | |||||||
| Haswell | Intel Xeon E5-2620 v3 | 60 | 60 | |||||||
| Haswell | Intel Xeon E5-2630 v3 | 1168 | 1584 | 2752 | ||||||
| POWER8 | POWER8NVL 1.0 | 240 | 240 | |||||||
| Broadwell | Intel Xeon E5-2620 v4 | 352 | 352 | |||||||
| Broadwell | Intel Xeon E5-2630 v4 | 300 | 300 | |||||||
| Broadwell | Intel Xeon E5-2630L v4 | 960 | 960 | |||||||
| Broadwell | Intel Xeon E5-2650 v4 | 336 | 336 | |||||||
| Broadwell | Intel Xeon E5-2680 v4 | 224 | 224 | |||||||
| Broadwell | Intel Xeon E5-2698 v4 | 80 | 80 | |||||||
| Skylake | Intel Xeon Gold 6126 | 192 | 192 | |||||||
| Skylake | Intel Xeon Gold 6130 | 1280 | 2048 | 3328 | ||||||
| Skylake | Intel Xeon Silver 4110 | 208 | 208 | |||||||
| Zen | AMD EPYC 7301 | 256 | 256 | |||||||
| Zen | AMD EPYC 7351 | 160 | 160 | |||||||
| Vulcan | ThunderX2 99xx | 256 | 256 | |||||||
| Cascade Lake-SP | Intel Xeon Gold 5218 | 128 | 128 | |||||||
| Cascade Lake-SP | Intel Xeon Gold 5218R | 640 | 640 | |||||||
| Cascade Lake-SP | Intel Xeon Gold 5220 | 2232 | 2232 | |||||||
| Zen 2 | AMD EPYC 7352 | 96 | 192 | 288 | ||||||
| Zen 2 | AMD EPYC 7452 | 128 | 128 | |||||||
| Zen 2 | AMD EPYC 7642 | 480 | 480 | |||||||
| Zen 2 | AMD EPYC 7742 | 128 | 128 | |||||||
| Sites total | 1744 | 972 | 168 | 1544 | 7996 | 1312 | 1744 | 360 | 15840 |
Memory
RAM size per node
| RAM size | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Nodes total |
|---|---|---|---|---|---|---|---|---|---|
| 2 GiB | 10 | 10 | |||||||
| 32 GiB | 14 | 19 | 33 | ||||||
| 64 GiB | 22 | 54 | 22 | 98 | |||||
| 96 GiB | 140 | 30 | 170 | ||||||
| 128 GiB | 14 | 8 | 107 | 48 | 107 | 284 | |||
| 192 GiB | 32 | 8 | 64 | 104 | |||||
| 256 GiB | 15 | 4 | 8 | 27 | |||||
| 384 GiB | 4 | 4 | |||||||
| 512 GiB | 12 | 12 | |||||||
| 768 GiB | 4 | 8 | 12 | ||||||
| 1.0 TiB | 1 | 1 | |||||||
| Sites total | 54 | 39 | 14 | 68 | 373 | 70 | 107 | 30 | 755 |
PMEM size per node
| PMEM size | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Nodes total |
|---|---|---|---|---|---|---|---|---|---|
| 1.5 TiB | 4 | 4 | |||||||
| Sites total | 4 | 4 |
Networking
Network interconnects
| Interconnect | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Cards total |
|---|---|---|---|---|---|---|---|---|---|
| Ethernet 1 Gbps | 11 | 89 | 8 | 30 | 138 | ||||
| Ethernet 10 Gbps | 48 | 46 | 28 | 67 | 355 | 118 | 214 | 876 | |
| Ethernet 25 Gbps | 6 | 32 | 270 | 308 | |||||
| Ethernet-FPGA 100 Gbps | 4 | 4 | |||||||
| InfiniBand 40 Gbps | 30 | 30 | |||||||
| InfiniBand 56 Gbps | 78 | 78 | |||||||
| InfiniBand 100 Gbps | 24 | 30 | 54 | ||||||
| Omni-Path 100 Gbps | 40 | 84 | 124 | ||||||
| Sites total | 122 | 78 | 28 | 108 | 876 | 118 | 222 | 60 | 1612 |
Nodes with several Ethernet interfaces
| Site | Cluster | Nodes | 25G interfaces | 10G interfaces | 1G interfaces | Interfaces (throughput) |
|---|---|---|---|---|---|---|
| Lille | chetemi | 15 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
| Lille | chiclet | 8 | 2 | enp98s0f0 (25 Gbps), enp98s0f1 (25 Gbps) | ||
| Lille | chifflet | 8 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
| Lille | chifflot | 8 | 2 | ens5f0 (25 Gbps), ens5f1 (25 Gbps) | ||
| Luxembourg | petitprince | 14 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
| Lyon | neowise | 10 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
| Nancy | grimoire | 8 | 4 | eno1 (10 Gbps), eno2 (10 Gbps), enp129s0f0 (10 Gbps), enp129s0f1 (10 Gbps) | ||
| Nancy | grisou-49 | 1 | 4 | eno1 (10 Gbps), eno2 (10 Gbps), enp4s0f0 (10 Gbps), enp4s0f1 (10 Gbps) | ||
| Nancy | grisou-[1-32, |
46 | 4 | 1 | eno1 (10 Gbps), eno2 (10 Gbps), eno3 (1 Gbps), enp4s0f0 (10 Gbps), enp4s0f1 (10 Gbps) | |
| Nancy | grisou-[50-51] | 2 | 4 | eno1 (10 Gbps), eno2 (10 Gbps), enp129s0f0 (10 Gbps), enp129s0f1 (10 Gbps) | ||
| Nancy | gros | 124 | 2 | eno1 (25 Gbps), eno2 (25 Gbps) | ||
| Nantes | ecotype | 48 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
| Rennes | paranoia | 8 | 2 | 1 | eno1 (1 Gbps), enp3s0f0 (10 Gbps), enp3s0f1 (10 Gbps) | |
| Rennes | parasilo | 27 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
| Rennes | paravance | 72 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) |
Nodes with SR-IOV support
| Site | Cluster | Nodes | Interfaces (max number of Virtual Functions) |
|---|---|---|---|
| Grenoble | troll | 4 | eno1 (63 VFs) |
| Lille | chetemi | 15 | eno1 (63 VFs), eno2 (63 VFs) |
| Lille | chifflet | 8 | eno1 (63 VFs), eno2 (63 VFs) |
| Lyon | gemini | 2 | enp1s0f0 (63 VFs) |
| Lyon | hercule | 4 | enp130s0f1 (63 VFs) |
| Lyon | neowise | 10 | eno1 (8 VFs), eno2 (8 VFs) |
| Lyon | nova | 22 | enp5s0f0 (63 VFs) |
| Lyon | orion | 3 | enp68s0f0 (63 VFs) |
| Lyon | pyxis | 4 | eno1 (96 VFs) |
| Lyon | taurus | 12 | enp68s0f0 (63 VFs) |
| Nancy | graoully | 16 | eno1 (63 VFs) |
| Nancy | graphite | 4 | eno1 (63 VFs) |
| Nancy | grcinq | 43 | eno1 (7 VFs) |
| Nancy | grele | 14 | eno1 (63 VFs) |
| Nancy | grimani | 6 | eno1 (63 VFs) |
| Nancy | grimoire | 8 | eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs) |
| Nancy | grisou-[1-32, |
47 | eno1 (63 VFs), eno2 (63 VFs), enp4s0f0 (63 VFs), enp4s0f1 (63 VFs) |
| Nancy | grisou-[50-51] | 2 | eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs) |
| Nancy | gros | 124 | eno1 (63 VFs), eno2 (63 VFs) |
| Nantes | econome | 22 | enp3s0f0 (63 VFs) |
| Nantes | ecotype | 48 | eno1 (63 VFs), eno2 (63 VFs) |
| Rennes | paranoia | 8 | eno1 (7 VFs), enp3s0f0 (63 VFs), enp3s0f1 (63 VFs) |
| Rennes | parasilo | 27 | eno1 (63 VFs), eno2 (63 VFs) |
| Rennes | paravance | 72 | eno1 (63 VFs), eno2 (63 VFs) |
| Sophia | uvb | 30 | eno1 (7 VFs) |
Network interface models
| Type | Driver | Model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Cards total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Ethernet | bnx2x | Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet | 12 | 5 | 17 | ||||||
| Ethernet | bnx2x | Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet | 14 | 14 | |||||||
| Ethernet | i40e | Intel Ethernet Controller X710 for 10GbE SFP+ | 36 | 82 | 118 | ||||||
| Ethernet | i40e | Intel Ethernet Controller XXV710 for 25GbE SFP28 | 16 | 16 | 32 | ||||||
| Ethernet | ice | Intel Ethernet Controller E810-C for SFP | 2 | 2 | |||||||
| Ethernet | igb | Intel 82576 Gigabit Network Connection | 30 | 30 | |||||||
| Ethernet | igb | Intel I210 Gigabit Network Connection | 1 | 1 | |||||||
| Ethernet | igb | Intel I350 Gigabit Network Connection | 89 | 8 | 97 | ||||||
| Ethernet | ixgbe | Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection | 23 | 4 | 97 | 70 | 107 | 301 | |||
| Ethernet | ixgbe | Intel Ethernet 10G 2P X520 Adapter | 37 | 57 | 94 | ||||||
| Ethernet | ixgbe | Intel Ethernet Controller 10-Gigabit X540-AT2 | 2 | 2 | |||||||
| Ethernet | mlx5_core | Mellanox Technologies MT27710 Family [ConnectX-4 Lx] | 4 | 10 | 124 | 138 | |||||
| Ethernet | mlx5_core | Mellanox Technologies MT27800 Family [ConnectX-5] | 6 | 6 | |||||||
| Ethernet | qede | QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller | 4 | 4 | |||||||
| Ethernet | tg3 | Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet | 10 | 10 | |||||||
| Ethernet-FPGA* | xrt | Xilinx Alveo U200 QSFP28 (100GbE) | 2 | 2 | |||||||
| InfiniBand | mlx4_core | Mellanox Technologies MT25408A0-FCC-QI ConnectX, Dual Port 40Gb/s InfiniBand / 10GigE Adapter IC with PCIe 2.0 x8 5.0GT/s Interface | 30 | 30 | |||||||
| InfiniBand | mlx4_core | Mellanox Technologies MT27500 Family [ConnectX-3] | 78 | 78 | |||||||
| InfiniBand | mlx5_core | Mellanox Technologies MT27700 Family [ConnectX-4] | 12 | 12 | |||||||
| InfiniBand | mlx5_core | Mellanox Technologies MT27800 Family [ConnectX-5] | 2 | 2 | |||||||
| InfiniBand | mlx5_core | Mellanox Technologies MT28908 Family [ConnectX-6] | 14 | 14 | |||||||
| Omni-Path | hfi1 | Intel Omni-Path HFI Silicon 100 Series [discrete] | 40 | 84 | 124 | ||||||
| Sites total | 108 | 39 | 14 | 84 | 638 | 70 | 115 | 60 | 1128 |
*: By default network interface on FPGA card is not supported by OS
Storage
SSD models
| SSD interface | Model | Size | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | SSDs total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| NVME | Dell Ent NVMe v2 AGN MU U.2 1.6TB | 1.6 TB | 4 | 4 | |||||||
| NVME | Dell Express Flash NVMe PM1725 1.6TB AIC | 1.6 TB | 7 | 7 | |||||||
| NVME | Dell Express Flash PM1725b 1.6TB AIC | 1.6 TB | 1 | 1 | |||||||
| NVME | Dell Samsung PM1735 | 1.6 TB | 4 | 4 | |||||||
| NVME | Kioxia KCM6DRUL3T84 | 3.84 TB | 4 | 4 | |||||||
| NVME | SAMSUNG MZ1LB1T9HALS-00007 | 1.92 TB | 12 | 12 | |||||||
| SAS | Toshiba KRM5XVUG1T92 | 1.92 TB | 2 | 2 | |||||||
| SAS | Toshiba PX02SSF020 | 200 GB | 8 | 26 | 34 | ||||||
| SAS | Toshiba PX04SHB020 | 200 GB | 1 | 1 | |||||||
| SAS | Toshiba PX04SMB040 | 400 GB | 16 | 48 | 64 | ||||||
| SAS | Toshiba PX05SVB048Y | 480 GB | 8 | 8 | |||||||
| SATA | INTEL SSDSC2BB30 | 300 GB | 8 | 8 | |||||||
| SATA | Intel SSDSC2KG480G7R | 480 GB | 3 | 16 | 19 | ||||||
| SATA | Intel SSDSC2KG480G8R | 480 GB | 1 | 16 | 17 | ||||||
| SATA | Intel SSDSC2KG960G8R | 960 GB | 1 | 1 | |||||||
| SATA | Micron MTFDDAK480TDN | 480 GB | 4 | 124 | 128 | ||||||
| SATA | Micron MTFDDAK960TDN | 960 GB | 123 | 123 | |||||||
| SATA | Micron MTFDDAK960TDT | 960 GB | 2 | 2 | |||||||
| SATA | SAMSUNG MZ7KM480 | 480 GB | 2 | 2 | |||||||
| SATA | SAMSUNG MZ7LM1T9 | 1.92 TB | 8 | 8 | |||||||
| SATA | Samsung MZ7KH1T9HAJR0D3 | 1.92 TB | 1 | 1 | |||||||
| SATA | Samsung MZ7KM240HMHQ0D3 | 240 GB | 32 | 32 | |||||||
| SATA | Samsung MZ7KM480HMHQ0D3 | 480 GB | 32 | 32 | |||||||
| SATA | Samsung SSD 860 | 250 GB | 8 | 8 | |||||||
| SATA | Sk Hynix HFS1T9G32FEH-BA1 | 1.92 TB | 3 | 3 | |||||||
| Sites total | 88 | 40 | 34 | 288 | 48 | 27 | 525 |
Nodes with several disks
| Site | Cluster | Number of nodes | Main disk | Additional HDDs | Additional SSDs |
|---|---|---|---|---|---|
| Grenoble | dahu | 32 | SSD 240 GB | 1 (4.0 TB) | 1 (480 GB) |
| Grenoble | drac | 12 | HDD 1.0 TB | 1 (1.0 TB) | 0 |
| Grenoble | servan | 2 | SSD 1.6 TB | 0 | 1 (1.6 TB) |
| Grenoble | troll | 4 | SSD 480 GB | 0 | 1 (1.6 TB) |
| Grenoble | yeti | 4 | SSD 480 GB | 3 (2.0 TB*, 2.0 TB*, 2.0 TB*) | 2 (1.6 TB, 1.6 TB) |
| Lille | chetemi-10 | 1 | HDD 600 GB | 1 (300 GB) | 0 |
| Lille | chetemi-[1-9, |
14 | HDD 300 GB | 1 (300 GB) | 0 |
| Lille | chiclet | 8 | SSD 480 GB | 2 (4.0 TB*, 4.0 TB*) | 0 |
| Lille | chifflet | 8 | SSD 400 GB | 2 (4.0 TB*, 4.0 TB*) | 1 (400 GB*) |
| Lille | chifflot | 8 | SSD 480 GB | 4 (4.0 TB*, 4.0 TB*, 4.0 TB*, 4.0 TB*) | 1 (480 GB*) |
| Lyon | gemini | 2 | SSD 480 GB | 0 | 4 (1.92 TB*, 1.92 TB*, 1.92 TB*, 1.92 TB*) |
| Lyon | hercule | 4 | HDD 2.0 TB | 2 (2.0 TB, 2.0 TB) | 0 |
| Lyon | pyxis | 4 | SSD 250 GB | 0 | 1 (250 GB) |
| Lyon | sirius | 1 | SSD 1.92 TB | 0 | 5 (1.92 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB) |
| Nancy | graphite | 4 | SSD 300 GB | 0 | 1 (300 GB) |
| Nancy | grappe | 16 | SSD 480 GB | 1 (8.0 TB*) | 0 |
| Nancy | grele | 14 | HDD 299 GB | 1 (299 GB) | 0 |
| Nancy | grimoire | 8 | HDD 600 GB | 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) | 1 (200 GB*) |
| Nancy | grisou | 49 | HDD 600 GB | 1 (600 GB) | 0 |
| Nancy | gros | 124 | SSD 480 GB | 0 | 1 (960 GB*) |
| Nancy | grouille | 2 | SSD 1.92 TB | 0 | 1 (960 GB*) |
| Rennes | paranoia | 8 | HDD 600 GB | 4 (600 GB, 600 GB, 600 GB, 600 GB) | 0 |
| Rennes | parasilo | 27 | HDD 600 GB | 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) | 1 (200 GB*) |
| Rennes | paravance | 72 | HDD 600 GB | 1 (600 GB) | 0 |
*: disk is reservable
Accelerators (GPU, Xeon Phi, FPGA)
Accelerator families
| Accelerator family | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Accelerators total |
|---|---|---|---|---|---|---|---|---|---|
| AMD GPU | 80 | 80 | |||||||
| Intel MIC | 4 | 4 | |||||||
| Nvidia GPU | 48 | 32 | 27 | 134 | 241 | ||||
| Xilinx FPGA | 2 | 2 | |||||||
| Sites total | 50 | 32 | 107 | 138 | 327 |
Accelerator models
| Accelerator model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Accelerators total |
|---|---|---|---|---|---|---|---|---|---|
| AMD Radeon Instinct MI50 32GB | 80 | 80 | |||||||
| Intel Xeon Phi 7120P | 4 | 4 | |||||||
| Nvidia A100-PCIE-40GB | 4 | 4 | |||||||
| Nvidia A100-SXM4-40GB | 8 | 8 | |||||||
| Nvidia A40 | 8 | 8 | |||||||
| Nvidia GeForce GTX 1080 Ti | 16 | 28 | 44 | ||||||
| Nvidia GeForce GTX 980 | 10 | 10 | |||||||
| Nvidia GeForce RTX 2080 Ti | 48 | 48 | |||||||
| Nvidia Quadro RTX 6000 | 4 | 4 | |||||||
| Nvidia Tesla K40m | 12 | 12 | |||||||
| Nvidia Tesla M2075 | 3 | 3 | |||||||
| Nvidia Tesla P100-PCIE-16GB | 12 | 12 | |||||||
| Nvidia Tesla P100-SXM2-16GB | 48 | 48 | |||||||
| Nvidia Tesla T4 | 20 | 20 | |||||||
| Nvidia Tesla V100-PCIE-32GB | 4 | 4 | |||||||
| Nvidia Tesla V100-SXM2-32GB | 16 | 16 | |||||||
| Xilinx Alveo U200 | 2 | 2 | |||||||
| Sites total | 50 | 32 | 107 | 138 | 327 |
Accelerator cores
| Accelerator model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Cores total |
|---|---|---|---|---|---|---|---|---|---|
| AMD Radeon Instinct MI50 32GB | 409600 | 409600 | |||||||
| Intel Xeon Phi 7120P | 244 | 244 | |||||||
| Nvidia A100-PCIE-40GB | 27648 | 27648 | |||||||
| Nvidia A100-SXM4-40GB | 55296 | 55296 | |||||||
| Nvidia A40 | 86016 | 86016 | |||||||
| Nvidia GeForce GTX 1080 Ti | 57344 | 100352 | 157696 | ||||||
| Nvidia GeForce GTX 980 | 20480 | 20480 | |||||||
| Nvidia GeForce RTX 2080 Ti | 208896 | 208896 | |||||||
| Nvidia Quadro RTX 6000 | 18432 | 18432 | |||||||
| Nvidia Tesla K40m | 34560 | 34560 | |||||||
| Nvidia Tesla M2075 | 1344 | 1344 | |||||||
| Nvidia Tesla P100-PCIE-16GB | 43008 | 43008 | |||||||
| Nvidia Tesla P100-SXM2-16GB | 172032 | 172032 | |||||||
| Nvidia Tesla T4 | 51200 | 51200 | |||||||
| Nvidia Tesla V100-PCIE-32GB | 20480 | 20480 | |||||||
| Nvidia Tesla V100-SXM2-32GB | 81920 | 81920 | |||||||
| Sites total | 172032 | 120832 | 548160 | 547828 | 1388852 |
Nodes models
| Nodes model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Nodes total |
|---|---|---|---|---|---|---|---|---|---|
| AMD-Penguin Computing | 10 | 10 | |||||||
| Dell PowerEdge C6100 | 30 | 30 | |||||||
| Dell PowerEdge C6220 | 4 | 43 | 22 | 69 | |||||
| Dell PowerEdge C6220 II | 8 | 8 | |||||||
| Dell PowerEdge C6420 | 32 | 64 | 96 | ||||||
| Dell PowerEdge M620 | 14 | 14 | |||||||
| Dell PowerEdge R430 | 22 | 22 | |||||||
| Dell PowerEdge R630 | 15 | 73 | 48 | 99 | 235 | ||||
| Dell PowerEdge R640 | 4 | 140 | 144 | ||||||
| Dell PowerEdge R720 | 15 | 9 | 24 | ||||||
| Dell PowerEdge R730 | 8 | 20 | 28 | ||||||
| Dell PowerEdge R740 | 8 | 8 | |||||||
| Dell PowerEdge R7425 | 8 | 5 | 13 | ||||||
| Dell PowerEdge R7525 | 2 | 6 | 8 | ||||||
| Dell PowerEdge R940 | 4 | 4 | |||||||
| Dell PowerEdge T640 | 13 | 13 | |||||||
| IBM PowerNV S822LC (8335-GTB) | 12 | 12 | |||||||
| NVidia DGX A100 | 1 | 1 | |||||||
| Nvidia DGX-1 | 2 | 2 | |||||||
| R181-T92-00 | 4 | 4 | |||||||
| Sun Fire V20z | 10 | 10 | |||||||
| Sites total | 54 | 39 | 14 | 68 | 373 | 70 | 107 | 30 | 755 |
Last generated from the Grid'5000 Reference API on 2022-05-24 (commit 6bc296b05e)