Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
Line 4: Line 4:
= Summary =
= Summary =
* 9 sites
* 9 sites
* 42 clusters
* 43 clusters
* 756 nodes
* 758 nodes
* 16048 CPU cores
* 16144 CPU cores
* 329 GPUs
* 335 GPUs
* 104.18 TiB RAM + 6.0 TiB PMEM
* 105.18 TiB RAM + 6.0 TiB PMEM
* 542 SSDs and 923 HDDs on nodes (total: 1.47 PB)
* 548 SSDs and 923 HDDs on nodes (total: 1.47 PB)
* 651.7 TFLOPS (excluding GPUs)
* 655.8 TFLOPS (excluding GPUs)


= Clusters =
= Clusters =
Line 105: Line 105:
|-
|-
|[[Nantes:Hardware|Nantes]]||[[Nantes:Hardware#ecotype|ecotype]]||||2017-10-16||48||2||Intel Xeon E5-2630L v4||10&nbsp;cores/CPU||x86_64||128&nbsp;GiB||data-sort-value="372"|<b>400&nbsp;GB&nbsp;SSD</b>||data-sort-value="20000"|2&nbsp;x&nbsp;10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|[[Nantes:Hardware|Nantes]]||[[Nantes:Hardware#ecotype|ecotype]]||||2017-10-16||48||2||Intel Xeon E5-2630L v4||10&nbsp;cores/CPU||x86_64||128&nbsp;GiB||data-sort-value="372"|<b>400&nbsp;GB&nbsp;SSD</b>||data-sort-value="20000"|2&nbsp;x&nbsp;10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|-
|[[Rennes:Hardware|Rennes]]||[[Rennes:Hardware#abacus25|abacus25]]||<b>testing</b>&nbsp;queue||2023-06-05||2||2||AMD EPYC 7413||24&nbsp;cores/CPU||x86_64||512&nbsp;GiB||data-sort-value="2682"|<b>960&nbsp;GB&nbsp;SSD</b> +&nbsp;2&nbsp;x&nbsp;960&nbsp;GB&nbsp;SSD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||3&nbsp;x&nbsp;Nvidia A40&nbsp;(45&nbsp;GiB)
|-
|-
|[[Rennes:Hardware|Rennes]]||[[Rennes:Hardware#paranoia|paranoia]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2014-02-21||7||2||Intel Xeon E5-2660 v2||10&nbsp;cores/CPU||x86_64||128&nbsp;GiB||data-sort-value="2790"|<b>600&nbsp;GB&nbsp;HDD</b> +&nbsp;4&nbsp;x&nbsp;600&nbsp;GB&nbsp;HDD||data-sort-value="21000"|1&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;2&nbsp;x&nbsp;10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|[[Rennes:Hardware|Rennes]]||[[Rennes:Hardware#paranoia|paranoia]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2014-02-21||7||2||Intel Xeon E5-2660 v2||10&nbsp;cores/CPU||x86_64||128&nbsp;GiB||data-sort-value="2790"|<b>600&nbsp;GB&nbsp;HDD</b> +&nbsp;4&nbsp;x&nbsp;600&nbsp;GB&nbsp;HDD||data-sort-value="21000"|1&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;2&nbsp;x&nbsp;10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
Line 134: Line 136:
|-
|-


|data-sort-value="001"|AMD EPYC||4||16||||12||24||||||||||'''56'''
|data-sort-value="001"|AMD EPYC||4||16||||12||24||||4||||||'''60'''
|-
|-
|data-sort-value="002"|AMD Opteron||||||||20||||||||||||'''20'''
|data-sort-value="002"|AMD Opteron||||||||20||||||||||||'''20'''
Line 144: Line 146:
|data-sort-value="005"|ThunderX2||||||||8||||||||||||'''8'''
|data-sort-value="005"|ThunderX2||||||||8||||||||||||'''8'''
|-
|-
!'''Sites total'''!!'''116'''!!'''76'''!!'''24'''!!'''126'''!!'''614'''!!'''140'''!!'''212'''!!'''60'''!!'''18'''!!'''1386'''
!'''Sites total'''!!'''116'''!!'''76'''!!'''24'''!!'''126'''!!'''614'''!!'''140'''!!'''216'''!!'''60'''!!'''18'''!!'''1390'''
|-
|-
|}
|}
Line 225: Line 227:
|-
|-
|data-sort-value="2019, Zen 2"|Zen 2||data-sort-value="2019, AMD EPYC 7742"|AMD EPYC 7742||||||||2||||||||||||'''2'''
|data-sort-value="2019, Zen 2"|Zen 2||data-sort-value="2019, AMD EPYC 7742"|AMD EPYC 7742||||||||2||||||||||||'''2'''
|-
|data-sort-value="2020, Zen 3"|Zen 3||data-sort-value="2020, AMD EPYC 7413"|AMD EPYC 7413||||||||||||||4||||||'''4'''
|-
|-
|data-sort-value="2020, Zen 3"|Zen 3||data-sort-value="2020, AMD EPYC 7513"|AMD EPYC 7513||||||||||2||||||||||'''2'''
|data-sort-value="2020, Zen 3"|Zen 3||data-sort-value="2020, AMD EPYC 7513"|AMD EPYC 7513||||||||||2||||||||||'''2'''
Line 230: Line 234:
|data-sort-value="2021, Ice Lake"|Ice Lake||data-sort-value="2021, Intel Xeon Silver 4314"|Intel Xeon Silver 4314||||||||||||||||||18||'''18'''
|data-sort-value="2021, Ice Lake"|Ice Lake||data-sort-value="2021, Intel Xeon Silver 4314"|Intel Xeon Silver 4314||||||||||||||||||18||'''18'''
|-
|-
!'''Sites total'''!! !!'''116'''!!'''76'''!!'''24'''!!'''126'''!!'''614'''!!'''140'''!!'''212'''!!'''60'''!!'''18'''!!'''1386'''
!'''Sites total'''!! !!'''116'''!!'''76'''!!'''24'''!!'''126'''!!'''614'''!!'''140'''!!'''216'''!!'''60'''!!'''18'''!!'''1390'''
|-
|-
|}
|}
Line 311: Line 315:
|-
|-
|data-sort-value="2019, Zen 2"|Zen 2||data-sort-value="2019, AMD EPYC 7742"|AMD EPYC 7742||||||||128||||||||||||'''128'''
|data-sort-value="2019, Zen 2"|Zen 2||data-sort-value="2019, AMD EPYC 7742"|AMD EPYC 7742||||||||128||||||||||||'''128'''
|-
|data-sort-value="2020, Zen 3"|Zen 3||data-sort-value="2020, AMD EPYC 7413"|AMD EPYC 7413||||||||||||||96||||||'''96'''
|-
|-
|data-sort-value="2020, Zen 3"|Zen 3||data-sort-value="2020, AMD EPYC 7513"|AMD EPYC 7513||||||||||64||||||||||'''64'''
|data-sort-value="2020, Zen 3"|Zen 3||data-sort-value="2020, AMD EPYC 7513"|AMD EPYC 7513||||||||||64||||||||||'''64'''
Line 316: Line 322:
|data-sort-value="2021, Ice Lake"|Ice Lake||data-sort-value="2021, Intel Xeon Silver 4314"|Intel Xeon Silver 4314||||||||||||||||||288||'''288'''
|data-sort-value="2021, Ice Lake"|Ice Lake||data-sort-value="2021, Intel Xeon Silver 4314"|Intel Xeon Silver 4314||||||||||||||||||288||'''288'''
|-
|-
!'''Sites total'''!! !!'''1744'''!!'''952'''!!'''144'''!!'''1544'''!!'''7980'''!!'''1312'''!!'''1724'''!!'''360'''!!'''288'''!!'''16048'''
!'''Sites total'''!! !!'''1744'''!!'''952'''!!'''144'''!!'''1544'''!!'''7980'''!!'''1312'''!!'''1820'''!!'''360'''!!'''288'''!!'''16144'''
|-
|-
|}
|}
Line 353: Line 359:
|data-sort-value="000384 GB"|384&nbsp;GiB||4||||||||||||||||||'''4'''
|data-sort-value="000384 GB"|384&nbsp;GiB||4||||||||||||||||||'''4'''
|-
|-
|data-sort-value="000512 GB"|512&nbsp;GiB||||||||12||1||||||||||'''13'''
|data-sort-value="000512 GB"|512&nbsp;GiB||||||||12||1||||2||||||'''15'''
|-
|-
|data-sort-value="000768 GB"|768&nbsp;GiB||4||8||||||||||||||||'''12'''
|data-sort-value="000768 GB"|768&nbsp;GiB||4||8||||||||||||||||'''12'''
Line 359: Line 365:
|data-sort-value="001024 GB"|1.0&nbsp;TiB||||||||1||||||||||||'''1'''
|data-sort-value="001024 GB"|1.0&nbsp;TiB||||||||1||||||||||||'''1'''
|-
|-
!'''Sites total'''!!'''54'''!!'''38'''!!'''12'''!!'''68'''!!'''369'''!!'''70'''!!'''106'''!!'''30'''!!'''9'''!!'''756'''
!'''Sites total'''!!'''54'''!!'''38'''!!'''12'''!!'''68'''!!'''369'''!!'''70'''!!'''108'''!!'''30'''!!'''9'''!!'''758'''
|-
|-
|}
|}
Line 403: Line 409:
|data-sort-value="Ethernet 001000"|Ethernet 1&nbsp;Gbps||||||||10||87||||7||30||||'''134'''
|data-sort-value="Ethernet 001000"|Ethernet 1&nbsp;Gbps||||||||10||87||||7||30||||'''134'''
|-
|-
|data-sort-value="Ethernet 010000"|Ethernet 10&nbsp;Gbps||48||44||24||67||343||118||212||||9||'''865'''
|data-sort-value="Ethernet 010000"|Ethernet 10&nbsp;Gbps||48||44||24||67||343||118||214||||9||'''867'''
|-
|-
|data-sort-value="Ethernet 025000"|Ethernet 25&nbsp;Gbps||6||32||||||271||||||||||'''309'''
|data-sort-value="Ethernet 025000"|Ethernet 25&nbsp;Gbps||6||32||||||271||||||||||'''309'''
Line 419: Line 425:
|data-sort-value="Omni-Path 100000"|Omni-Path 100&nbsp;Gbps||40||||||||84||||||||||'''124'''
|data-sort-value="Omni-Path 100000"|Omni-Path 100&nbsp;Gbps||40||||||||84||||||||||'''124'''
|-
|-
!'''Sites total'''!!'''122'''!!'''76'''!!'''24'''!!'''108'''!!'''859'''!!'''118'''!!'''219'''!!'''60'''!!'''9'''!!'''1595'''
!'''Sites total'''!!'''122'''!!'''76'''!!'''24'''!!'''108'''!!'''859'''!!'''118'''!!'''221'''!!'''60'''!!'''9'''!!'''1597'''
|-
|-
|}
|}
Line 511: Line 517:
|-
|-
|[[Nantes:Network|Nantes]]||[[Nantes:Hardware#ecotype|ecotype]]||48||data-sort-value="126"|eno1 (63 VFs), eno2 (63 VFs)
|[[Nantes:Network|Nantes]]||[[Nantes:Hardware#ecotype|ecotype]]||48||data-sort-value="126"|eno1 (63 VFs), eno2 (63 VFs)
|-
|[[Rennes:Network|Rennes]]||[[Rennes:Hardware#abacus25|abacus25]]||2||data-sort-value="64"|ens10f0 (64 VFs)
|-
|-
|[[Rennes:Network|Rennes]]||[[Rennes:Hardware#paranoia|paranoia]]||7||data-sort-value="133"|eno1 (7 VFs), enp3s0f0 (63 VFs), enp3s0f1 (63 VFs)
|[[Rennes:Network|Rennes]]||[[Rennes:Hardware#paranoia|paranoia]]||7||data-sort-value="133"|eno1 (7 VFs), enp3s0f0 (63 VFs), enp3s0f1 (63 VFs)
Line 545: Line 553:
|data-sort-value="Ethernet"|Ethernet||data-sort-value="bnxt_en"|bnxt_en||data-sort-value="Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller"|Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller||||||||||||||||||9||'''9'''
|data-sort-value="Ethernet"|Ethernet||data-sort-value="bnxt_en"|bnxt_en||data-sort-value="Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller"|Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller||||||||||||||||||9||'''9'''
|-
|-
|data-sort-value="Ethernet"|Ethernet||data-sort-value="i40e"|i40e||data-sort-value="Intel Ethernet Controller X710 for 10GbE SFP+"|Intel Ethernet Controller X710 for 10GbE SFP+||36||||||||82||||||||||'''118'''
|data-sort-value="Ethernet"|Ethernet||data-sort-value="i40e"|i40e||data-sort-value="Intel Ethernet Controller X710 for 10GbE SFP+"|Intel Ethernet Controller X710 for 10GbE SFP+||36||||||||82||||2||||||'''120'''
|-
|-
|data-sort-value="Ethernet"|Ethernet||data-sort-value="i40e"|i40e||data-sort-value="Intel Ethernet Controller XXV710 for 25GbE SFP28"|Intel Ethernet Controller XXV710 for 25GbE SFP28||||16||||||16||||||||||'''32'''
|data-sort-value="Ethernet"|Ethernet||data-sort-value="i40e"|i40e||data-sort-value="Intel Ethernet Controller XXV710 for 25GbE SFP28"|Intel Ethernet Controller XXV710 for 25GbE SFP28||||16||||||16||||||||||'''32'''
Line 585: Line 593:
|data-sort-value="Omni-Path"|Omni-Path||data-sort-value="hfi1"|hfi1||data-sort-value="Intel Omni-Path HFI Silicon 100 Series [discrete]"|Intel Omni-Path HFI Silicon 100 Series [discrete]||40||||||||84||||||||||'''124'''
|data-sort-value="Omni-Path"|Omni-Path||data-sort-value="hfi1"|hfi1||data-sort-value="Intel Omni-Path HFI Silicon 100 Series [discrete]"|Intel Omni-Path HFI Silicon 100 Series [discrete]||40||||||||84||||||||||'''124'''
|-
|-
!'''Sites total'''!! !! !!'''108'''!!'''38'''!!'''12'''!!'''84'''!!'''627'''!!'''70'''!!'''113'''!!'''60'''!!'''9'''!!'''1121'''
!'''Sites total'''!! !! !!'''108'''!!'''38'''!!'''12'''!!'''84'''!!'''627'''!!'''70'''!!'''115'''!!'''60'''!!'''9'''!!'''1123'''
|-
|-
|}
|}
Line 621: Line 629:
|-
|-
|data-sort-value="SAS"|SAS||data-sort-value="HP VO003840RZWVA"|HP VO003840RZWVA||data-sort-value="3840755982336"|3.84&nbsp;TB||||||||||8||||||||||'''8'''
|data-sort-value="SAS"|SAS||data-sort-value="HP VO003840RZWVA"|HP VO003840RZWVA||data-sort-value="3840755982336"|3.84&nbsp;TB||||||||||8||||||||||'''8'''
|-
|data-sort-value="SAS"|SAS||data-sort-value="HPE MO000960RXKRC"|HPE MO000960RXKRC||data-sort-value="960197124096"|960&nbsp;GB||||||||||||||2||||||'''2'''
|-
|-
|data-sort-value="SAS"|SAS||data-sort-value="Toshiba KRM5XVUG1T92"|Toshiba KRM5XVUG1T92||data-sort-value="1920383410176"|1.92&nbsp;TB||||||||||2||||||||||'''2'''
|data-sort-value="SAS"|SAS||data-sort-value="Toshiba KRM5XVUG1T92"|Toshiba KRM5XVUG1T92||data-sort-value="1920383410176"|1.92&nbsp;TB||||||||||2||||||||||'''2'''
Line 633: Line 643:
|-
|-
|data-sort-value="SATA"|SATA||data-sort-value="HP VK000960GXAWL"|HP VK000960GXAWL||data-sort-value="960197124096"|960&nbsp;GB||||||||||||||||||9||'''9'''
|data-sort-value="SATA"|SATA||data-sort-value="HP VK000960GXAWL"|HP VK000960GXAWL||data-sort-value="960197124096"|960&nbsp;GB||||||||||||||||||9||'''9'''
|-
|data-sort-value="SATA"|SATA||data-sort-value="HP VK000960GZCNF"|HP VK000960GZCNF||data-sort-value="960197124096"|960&nbsp;GB||||||||||||||4||||||'''4'''
|-
|-
|data-sort-value="SATA"|SATA||data-sort-value="INTEL SSDSC2BB30"|INTEL SSDSC2BB30||data-sort-value="300069052416"|300&nbsp;GB||||||||||8||||||||||'''8'''
|data-sort-value="SATA"|SATA||data-sort-value="INTEL SSDSC2BB30"|INTEL SSDSC2BB30||data-sort-value="300069052416"|300&nbsp;GB||||||||||8||||||||||'''8'''
Line 664: Line 676:
|data-sort-value="SATA"|SATA||data-sort-value="Sk Hynix HFS1T9G32FEH-BA1"|Sk Hynix HFS1T9G32FEH-BA1||data-sort-value="1920383410176"|1.92&nbsp;TB||||||||||3||||||||||'''3'''
|data-sort-value="SATA"|SATA||data-sort-value="Sk Hynix HFS1T9G32FEH-BA1"|Sk Hynix HFS1T9G32FEH-BA1||data-sort-value="1920383410176"|1.92&nbsp;TB||||||||||3||||||||||'''3'''
|-
|-
!'''Sites total'''!! !! !!'''88'''!!'''40'''!!!!'''34'''!!'''296'''!!'''48'''!!'''27'''!!!!'''9'''!!'''542'''
!'''Sites total'''!! !! !!'''88'''!!'''40'''!!!!'''34'''!!'''296'''!!'''48'''!!'''33'''!!!!'''9'''!!'''548'''
|-
|-
|}
|}
Line 719: Line 731:
|-
|-
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grouille|grouille]]||2||SSD 1.92&nbsp;TB||0||1 (960&nbsp;GB[[Disk_reservation|*]])
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grouille|grouille]]||2||SSD 1.92&nbsp;TB||0||1 (960&nbsp;GB[[Disk_reservation|*]])
|-
|[[Rennes:Hardware|Rennes]]||[[Rennes:Hardware#abacus25|abacus25]]||2||SSD 960&nbsp;GB||0||2 (960&nbsp;GB, 960&nbsp;GB)
|-
|-
|[[Rennes:Hardware|Rennes]]||[[Rennes:Hardware#paranoia|paranoia]]||7||HDD 600&nbsp;GB||4 (600&nbsp;GB, 600&nbsp;GB, 600&nbsp;GB, 600&nbsp;GB)||0
|[[Rennes:Hardware|Rennes]]||[[Rennes:Hardware#paranoia|paranoia]]||7||HDD 600&nbsp;GB||4 (600&nbsp;GB, 600&nbsp;GB, 600&nbsp;GB, 600&nbsp;GB)||0
Line 749: Line 763:
|data-sort-value="002"|Intel MIC||||||||||4||||||||||'''4'''
|data-sort-value="002"|Intel MIC||||||||||4||||||||||'''4'''
|-
|-
|data-sort-value="003"|Nvidia GPU||48||32||||27||142||||||||||'''249'''
|data-sort-value="003"|Nvidia GPU||48||32||||27||142||||6||||||'''255'''
|-
|-
|data-sort-value="004"|Xilinx FPGA||2||||||||||||||||||'''2'''
|data-sort-value="004"|Xilinx FPGA||2||||||||||||||||||'''2'''
|-
|-
!'''Sites total'''!!'''50'''!!'''32'''!!!!'''107'''!!'''146'''!!!!!!!!!!'''335'''
!'''Sites total'''!!'''50'''!!'''32'''!!!!'''107'''!!'''146'''!!!!'''6'''!!!!!!'''341'''
|-
|-
|}
|}
Line 780: Line 794:
|data-sort-value="004"|Nvidia A100-SXM4-40GB||||||||8||8||||||||||'''16'''
|data-sort-value="004"|Nvidia A100-SXM4-40GB||||||||8||8||||||||||'''16'''
|-
|-
|data-sort-value="005"|Nvidia A40||||||||||8||||||||||'''8'''
|data-sort-value="005"|Nvidia A40||||||||||8||||6||||||'''14'''
|-
|-
|data-sort-value="006"|Nvidia GeForce GTX 1080 Ti||||16||||||28||||||||||'''44'''
|data-sort-value="006"|Nvidia GeForce GTX 1080 Ti||||16||||||28||||||||||'''44'''
Line 806: Line 820:
|data-sort-value="017"|Xilinx Alveo U200||2||||||||||||||||||'''2'''
|data-sort-value="017"|Xilinx Alveo U200||2||||||||||||||||||'''2'''
|-
|-
!'''Sites total'''!!'''50'''!!'''32'''!!!!'''107'''!!'''146'''!!!!!!!!!!'''335'''
!'''Sites total'''!!'''50'''!!'''32'''!!!!'''107'''!!'''146'''!!!!'''6'''!!!!!!'''341'''
|-
|-
|}
|}
Line 833: Line 847:
|data-sort-value="004"|Nvidia A100-SXM4-40GB||||||||55296||55296||||||||||'''110592'''
|data-sort-value="004"|Nvidia A100-SXM4-40GB||||||||55296||55296||||||||||'''110592'''
|-
|-
|data-sort-value="005"|Nvidia A40||||||||||86016||||||||||'''86016'''
|data-sort-value="005"|Nvidia A40||||||||||86016||||64512||||||'''150528'''
|-
|-
|data-sort-value="006"|Nvidia GeForce GTX 1080 Ti||||57344||||||100352||||||||||'''157696'''
|data-sort-value="006"|Nvidia GeForce GTX 1080 Ti||||57344||||||100352||||||||||'''157696'''
Line 857: Line 871:
|data-sort-value="016"|Nvidia Tesla V100-SXM2-32GB||||||||81920||||||||||||'''81920'''
|data-sort-value="016"|Nvidia Tesla V100-SXM2-32GB||||||||81920||||||||||||'''81920'''
|-
|-
!'''Sites total'''!!'''172032'''!!'''120832'''!!!!'''548160'''!!'''603124'''!!!!!!!!!!'''1444148'''
!'''Sites total'''!!'''172032'''!!'''120832'''!!!!'''548160'''!!'''603124'''!!!!'''64512'''!!!!!!'''1508660'''
|-
|-
|}
|}
Line 908: Line 922:
|data-sort-value="016"|Dell PowerEdge T640||||||||||13||||||||||'''13'''
|data-sort-value="016"|Dell PowerEdge T640||||||||||13||||||||||'''13'''
|-
|-
|data-sort-value="017"|HPE Proliant DL360 Gen10+||||||||||||||||||9||'''9'''
|data-sort-value="017"|HPE ProLiant DL385 Gen10+ v2||||||||||||||2||||||'''2'''
|-
|data-sort-value="018"|HPE Proliant DL360 Gen10+||||||||||||||||||9||'''9'''
|-
|-
|data-sort-value="018"|HPe Apollo 6500||||||||||1||||||||||'''1'''
|data-sort-value="019"|HPe Apollo 6500||||||||||1||||||||||'''1'''
|-
|-
|data-sort-value="019"|IBM PowerNV S822LC (8335-GTB)||12||||||||||||||||||'''12'''
|data-sort-value="020"|IBM PowerNV S822LC (8335-GTB)||12||||||||||||||||||'''12'''
|-
|-
|data-sort-value="020"|NVidia DGX A100||||||||1||||||||||||'''1'''
|data-sort-value="021"|NVidia DGX A100||||||||1||||||||||||'''1'''
|-
|-
|data-sort-value="021"|Nvidia DGX-1||||||||2||||||||||||'''2'''
|data-sort-value="022"|Nvidia DGX-1||||||||2||||||||||||'''2'''
|-
|-
|data-sort-value="022"|R181-T92-00||||||||4||||||||||||'''4'''
|data-sort-value="023"|R181-T92-00||||||||4||||||||||||'''4'''
|-
|-
|data-sort-value="023"|Sun Fire V20z||||||||10||||||||||||'''10'''
|data-sort-value="024"|Sun Fire V20z||||||||10||||||||||||'''10'''
|-
|-
!'''Sites total'''!!'''54'''!!'''38'''!!'''12'''!!'''68'''!!'''369'''!!'''70'''!!'''106'''!!'''30'''!!'''9'''!!'''756'''
!'''Sites total'''!!'''54'''!!'''38'''!!'''12'''!!'''68'''!!'''369'''!!'''70'''!!'''108'''!!'''30'''!!'''9'''!!'''758'''
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2023-06-02 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/7ced0d5bb1 commit 7ced0d5bb1])</small>''
|}''<small>Last generated from the Grid'5000 Reference API on 2023-06-19 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/eed917075a commit eed917075a])</small>''

Revision as of 14:48, 19 June 2023

Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Toulouse

Summary

  • 9 sites
  • 43 clusters
  • 758 nodes
  • 16144 CPU cores
  • 335 GPUs
  • 105.18 TiB RAM + 6.0 TiB PMEM
  • 548 SSDs and 923 HDDs on nodes (total: 1.47 PB)
  • 655.8 TFLOPS (excluding GPUs)

Clusters

Site Cluster Access Condition Date of arrival Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
Grenoble dahu 2018-03-22 32 2 Intel Xeon Gold 6130 16 cores/CPU x86_64 192 GiB 240 GB SSD + 480 GB SSD + 4.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Grenoble drac exotic job type 2020-10-05 12 2 POWER8NVL 1.0 10 cores/CPU ppc64le 128 GiB 1.0 TB HDD + 1.0 TB HDD 10 Gbps + 2 x 100 Gbps InfiniBand 4 x Nvidia Tesla P100 (16 GiB)
Grenoble servan exotic job type 2021-12-15 2 2 AMD EPYC 7352 24 cores/CPU x86_64 128 GiB 1.6 TB SSD + 1.6 TB SSD 25 Gbps + 2 x 100 Gbps FPGA/Ethernet Xilinx Alveo U200
Grenoble troll exotic job type 2019-12-23 4 2 Intel Xeon Gold 5218 16 cores/CPU x86_64 384 GiB + 1.5 TiB PMEM 480 GB SSD + 1.6 TB SSD 25 Gbps (SR‑IOV) + 100 Gbps Omni-Path
Grenoble yeti exotic job type 2018-01-16 4 4 Intel Xeon Gold 6130 16 cores/CPU x86_64 768 GiB 480 GB SSD + 3 x 2.0 TB HDD* + 2 x 1.6 TB SSD 10 Gbps + 100 Gbps Omni-Path
Lille chetemi 2016-12-01 14 2 Intel Xeon E5-2630 v4 10 cores/CPU x86_64 256 GiB 300 GB HDD + 300 GB HDD 2 x 10 Gbps (SR‑IOV) 
Lille chiclet 2018-08-06 8 2 AMD EPYC 7301 16 cores/CPU x86_64 128 GiB 480 GB SSD + 2 x 4.0 TB HDD* 2 x 25 Gbps 
Lille chifflet 2016-12-01 8 2 Intel Xeon E5-2680 v4 14 cores/CPU x86_64 768 GiB 400 GB SSD + 400 GB SSD* + 2 x 4.0 TB HDD* 2 x 10 Gbps (SR‑IOV)  2 x Nvidia GTX 1080 Ti (11 GiB)
Lille chifflot 2018-08-01 8 2 Intel Xeon Gold 6126 12 cores/CPU x86_64 192 GiB 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* 2 x 25 Gbps  [1-6]: 2 x Nvidia Tesla P100 (16 GiB)
[7-8]: 2 x Nvidia Tesla V100 (32 GiB)
Luxembourg petitprince 2013-09-10 12 2 Intel Xeon E5-2630L 6 cores/CPU x86_64 32 GiB 250 GB HDD 2 x 10 Gbps 
Lyon gemini exotic job type 2019-09-01 2 2 Intel Xeon E5-2698 v4 20 cores/CPU x86_64 512 GiB 480 GB SSD + 4 x 1.92 TB SSD* 10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand 8 x Nvidia Tesla V100 (32 GiB)
Lyon hercule 2012-10-02 4 2 Intel Xeon E5-2620 6 cores/CPU x86_64 32 GiB 2.0 TB HDD + 2 x 2.0 TB HDD 10 Gbps (SR‑IOV) 
Lyon neowise exotic job type 2021-05-17 10 1 AMD EPYC 7642 48 cores/CPU x86_64 512 GiB 1.92 TB SSD 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand 8 x AMD MI50 (32 GiB)
Lyon nova 2016-12-01 22 2 Intel Xeon E5-2620 v4 8 cores/CPU x86_64 64 GiB 598 GB HDD 10 Gbps (SR‑IOV) 
Lyon orion 2012-09-14 3 2 Intel Xeon E5-2630 6 cores/CPU x86_64 32 GiB 299 GB HDD 10 Gbps (SR‑IOV)  Nvidia Tesla M2075 (5 GiB)**
Lyon pyxis exotic job type 2020-01-06 4 2 ThunderX2 99xx 32 cores/CPU aarch64 256 GiB 250 GB SSD + 250 GB SSD 10 Gbps (SR‑IOV) + 100 Gbps InfiniBand
Lyon sagittaire 2006-07-01 10 2 AMD Opteron 250 1 core/CPU x86_64 2 GiB 73 GB HDD 1 Gbps 
Lyon sirius exotic job type 2021-11-18 1 2 AMD EPYC 7742 64 cores/CPU x86_64 1.0 TiB 1.92 TB SSD + 1.92 TB SSD + 4 x 3.84 TB SSD 100 Gbps  8 x Nvidia A100 (40 GiB)
Lyon taurus 2012-09-14 12 2 Intel Xeon E5-2630 6 cores/CPU x86_64 32 GiB 299 GB HDD 10 Gbps (SR‑IOV) 
Nancy graffiti production queue 2019-06-07 13 2 Intel Xeon Silver 4110 8 cores/CPU x86_64 128 GiB 479 GB HDD 10 Gbps  [1-12]: 4 x Nvidia RTX 2080 Ti (11 GiB)
13: 4 x Nvidia Quadro RTX 6000 (22 GiB)
Nancy graoully production queue 2016-01-04 16 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand
Nancy graphique production queue 2015-05-12 5 2 Intel Xeon E5-2620 v3 6 cores/CPU x86_64 64 GiB 299 GB HDD 10 Gbps + 56 Gbps InfiniBand 2 x Nvidia GTX 980 (4 GiB)
Nancy graphite 2013-12-05 4 2 Intel Xeon E5-2650 8 cores/CPU x86_64 256 GiB 300 GB SSD + 300 GB SSD 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand Intel Xeon Phi 7120P
Nancy grappe production queue 2020-08-20 16 2 Intel Xeon Gold 5218R 20 cores/CPU x86_64 96 GiB 480 GB SSD + 8.0 TB HDD* 25 Gbps 
Nancy grat production queue 2022-09-07 1 2 AMD EPYC 7513 32 cores/CPU x86_64 512 GiB 3.84 TB SSD + 7 x 3.84 TB SSD 25 Gbps (SR‑IOV)  8 x Nvidia A100 (40 GiB)
Nancy grcinq production queue 2013-04-09 41 2 Intel Xeon E5-2650 8 cores/CPU x86_64 64 GiB 1.0 TB HDD 1 Gbps (SR‑IOV) + 56 Gbps InfiniBand
Nancy grele production queue 2017-06-26 14 2 Intel Xeon E5-2650 v4 12 cores/CPU x86_64 128 GiB 299 GB HDD + 299 GB HDD 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path 2 x Nvidia GTX 1080 Ti (11 GiB)
Nancy grimani production queue 2016-08-30 6 2 Intel Xeon E5-2603 v3 6 cores/CPU x86_64 64 GiB 1.0 TB HDD 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path 2 x Nvidia Tesla K40M (11 GiB)
Nancy grimoire 2016-01-22 8 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* 4 x 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand
Nancy grisou 2016-01-04 46 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 600 GB HDD 1 Gbps + 4 x 10 Gbps (SR‑IOV) 
Nancy gros 2019-09-04 124 1 Intel Xeon Gold 5220 18 cores/CPU x86_64 96 GiB 480 GB SSD + 960 GB SSD* 2 x 25 Gbps (SR‑IOV) 
Nancy grouille exotic job type 2021-01-13 2 2 AMD EPYC 7452 32 cores/CPU x86_64 128 GiB 1.92 TB SSD + 960 GB SSD* 25 Gbps  2 x Nvidia A100 (40 GiB)
Nancy grue production queue 2019-11-25 5 2 AMD EPYC 7351 16 cores/CPU x86_64 128 GiB 479 GB HDD 10 Gbps  4 x Nvidia Tesla T4 (15 GiB)
Nancy gruss production queue 2021-08-26 4 2 AMD EPYC 7352 24 cores/CPU x86_64 256 GiB 1.92 TB SSD 25 Gbps  2 x Nvidia A40 (45 GiB)
Nancy grvingt production queue 2018-04-11 64 2 Intel Xeon Gold 6130 16 cores/CPU x86_64 192 GiB 1.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Nantes econome 2014-04-16 22 2 Intel Xeon E5-2660 8 cores/CPU x86_64 64 GiB 2.0 TB HDD 10 Gbps (SR‑IOV) 
Nantes ecotype 2017-10-16 48 2 Intel Xeon E5-2630L v4 10 cores/CPU x86_64 128 GiB 400 GB SSD 2 x 10 Gbps (SR‑IOV) 
Rennes abacus25 testing queue 2023-06-05 2 2 AMD EPYC 7413 24 cores/CPU x86_64 512 GiB 960 GB SSD + 2 x 960 GB SSD 10 Gbps (SR‑IOV)  3 x Nvidia A40 (45 GiB)
Rennes paranoia production queue 2014-02-21 7 2 Intel Xeon E5-2660 v2 10 cores/CPU x86_64 128 GiB 600 GB HDD + 4 x 600 GB HDD 1 Gbps (SR‑IOV) + 2 x 10 Gbps (SR‑IOV) 
Rennes parasilo 2015-01-13 27 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* 2 x 10 Gbps (SR‑IOV) 
Rennes paravance 2015-01-13 72 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 600 GB HDD 2 x 10 Gbps (SR‑IOV) 
Sophia uvb 2011-01-04 30 2 Intel Xeon X5670 6 cores/CPU x86_64 96 GiB 250 GB HDD 1 Gbps (SR‑IOV) + 40 Gbps InfiniBand
Toulouse montcalm testing queue 2022-12-01 9 2 Intel Xeon Silver 4314 16 cores/CPU x86_64 256 GiB 960 GB SSD 10 Gbps 

Processors

Processors counts per families

Processor family Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Processors total
AMD EPYC 4 16 12 24 4 60
AMD Opteron 20 20
Intel Xeon 88 60 24 86 590 140 212 60 18 1278
POWER8NVL 24 24
ThunderX2 8 8
Sites total 116 76 24 126 614 140 216 60 18 1390

Processors counts per models

Microarchitecture Processor model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Processors total
K8 AMD Opteron 250 20 20
Westmere Intel Xeon X5670 60 60
Sandy Bridge Intel Xeon E5-2620 8 8
Sandy Bridge Intel Xeon E5-2630 30 30
Sandy Bridge Intel Xeon E5-2630L 24 24
Sandy Bridge Intel Xeon E5-2650 90 90
Sandy Bridge Intel Xeon E5-2660 44 44
Sandy Bridge Intel Xeon E5-2660 v2 14 14
Haswell Intel Xeon E5-2603 v3 12 12
Haswell Intel Xeon E5-2620 v3 10 10
Haswell Intel Xeon E5-2630 v3 140 198 338
POWER8 POWER8NVL 1.0 24 24
Broadwell Intel Xeon E5-2620 v4 44 44
Broadwell Intel Xeon E5-2630 v4 28 28
Broadwell Intel Xeon E5-2630L v4 96 96
Broadwell Intel Xeon E5-2650 v4 28 28
Broadwell Intel Xeon E5-2680 v4 16 16
Broadwell Intel Xeon E5-2698 v4 4 4
Skylake Intel Xeon Gold 6126 16 16
Skylake Intel Xeon Gold 6130 80 128 208
Skylake Intel Xeon Silver 4110 26 26
Zen AMD EPYC 7301 16 16
Zen AMD EPYC 7351 10 10
Vulcan ThunderX2 99xx 8 8
Cascade Lake-SP Intel Xeon Gold 5218 8 8
Cascade Lake-SP Intel Xeon Gold 5218R 32 32
Cascade Lake-SP Intel Xeon Gold 5220 124 124
Zen 2 AMD EPYC 7352 4 8 12
Zen 2 AMD EPYC 7452 4 4
Zen 2 AMD EPYC 7642 10 10
Zen 2 AMD EPYC 7742 2 2
Zen 3 AMD EPYC 7413 4 4
Zen 3 AMD EPYC 7513 2 2
Ice Lake Intel Xeon Silver 4314 18 18
Sites total 116 76 24 126 614 140 216 60 18 1390

Cores counts per models

Microarchitecture Core model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Cores total
K8 AMD Opteron 250 20 20
Westmere Intel Xeon X5670 360 360
Sandy Bridge Intel Xeon E5-2620 48 48
Sandy Bridge Intel Xeon E5-2630 180 180
Sandy Bridge Intel Xeon E5-2630L 144 144
Sandy Bridge Intel Xeon E5-2650 720 720
Sandy Bridge Intel Xeon E5-2660 352 352
Sandy Bridge Intel Xeon E5-2660 v2 140 140
Haswell Intel Xeon E5-2603 v3 72 72
Haswell Intel Xeon E5-2620 v3 60 60
Haswell Intel Xeon E5-2630 v3 1120 1584 2704
POWER8 POWER8NVL 1.0 240 240
Broadwell Intel Xeon E5-2620 v4 352 352
Broadwell Intel Xeon E5-2630 v4 280 280
Broadwell Intel Xeon E5-2630L v4 960 960
Broadwell Intel Xeon E5-2650 v4 336 336
Broadwell Intel Xeon E5-2680 v4 224 224
Broadwell Intel Xeon E5-2698 v4 80 80
Skylake Intel Xeon Gold 6126 192 192
Skylake Intel Xeon Gold 6130 1280 2048 3328
Skylake Intel Xeon Silver 4110 208 208
Zen AMD EPYC 7301 256 256
Zen AMD EPYC 7351 160 160
Vulcan ThunderX2 99xx 256 256
Cascade Lake-SP Intel Xeon Gold 5218 128 128
Cascade Lake-SP Intel Xeon Gold 5218R 640 640
Cascade Lake-SP Intel Xeon Gold 5220 2232 2232
Zen 2 AMD EPYC 7352 96 192 288
Zen 2 AMD EPYC 7452 128 128
Zen 2 AMD EPYC 7642 480 480
Zen 2 AMD EPYC 7742 128 128
Zen 3 AMD EPYC 7413 96 96
Zen 3 AMD EPYC 7513 64 64
Ice Lake Intel Xeon Silver 4314 288 288
Sites total 1744 952 144 1544 7980 1312 1820 360 288 16144

Memory

RAM size per node

RAM size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Nodes total
2 GiB 10 10
32 GiB 12 19 31
64 GiB 22 52 22 96
96 GiB 140 30 170
128 GiB 14 8 104 48 106 280
192 GiB 32 8 64 104
256 GiB 14 4 8 9 35
384 GiB 4 4
512 GiB 12 1 2 15
768 GiB 4 8 12
1.0 TiB 1 1
Sites total 54 38 12 68 369 70 108 30 9 758

PMEM size per node

PMEM size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Nodes total
1.5 TiB 4 4
Sites total 4 4

Networking

Network interconnects

Interconnect Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Cards total
Ethernet 1 Gbps 10 87 7 30 134
Ethernet 10 Gbps 48 44 24 67 343 118 214 9 867
Ethernet 25 Gbps 6 32 271 309
Ethernet 100 Gbps 1 1
FPGA/Ethernet 100 Gbps 4 4
InfiniBand 40 Gbps 30 30
InfiniBand 56 Gbps 74 74
InfiniBand 100 Gbps 24 30 54
Omni-Path 100 Gbps 40 84 124
Sites total 122 76 24 108 859 118 221 60 9 1597

Nodes with several Ethernet interfaces

Site Cluster Nodes 25G interfaces 10G interfaces 1G interfaces Interfaces (throughput)
Lille chetemi 14 2 eno1 (10 Gbps), eno2 (10 Gbps)
Lille chiclet 8 2 enp98s0f0 (25 Gbps), enp98s0f1 (25 Gbps)
Lille chifflet 8 2 eno1 (10 Gbps), eno2 (10 Gbps)
Lille chifflot 8 2 ens5f0 (25 Gbps), ens5f1 (25 Gbps)
Luxembourg petitprince 12 2 eno1 (10 Gbps), eno2 (10 Gbps)
Lyon neowise 10 2 eno1 (10 Gbps), eno2 (10 Gbps)
Nancy grimoire 8 4 eno1 (10 Gbps), eno2 (10 Gbps), enp129s0f0 (10 Gbps), enp129s0f1 (10 Gbps)
Nancy grisou 46 4 1 eno1 (10 Gbps), eno2 (10 Gbps), eno3 (1 Gbps), enp4s0f0 (10 Gbps), enp4s0f1 (10 Gbps)
Nancy gros 124 2 eno1 (25 Gbps), eno2 (25 Gbps)
Nantes ecotype 48 2 eno1 (10 Gbps), eno2 (10 Gbps)
Rennes paranoia 7 2 1 eno1 (1 Gbps), enp3s0f0 (10 Gbps), enp3s0f1 (10 Gbps)
Rennes parasilo 27 2 eno1 (10 Gbps), eno2 (10 Gbps)
Rennes paravance 72 2 eno1 (10 Gbps), eno2 (10 Gbps)

Nodes with SR-IOV support

Site Cluster Nodes Interfaces (max number of Virtual Functions)
Grenoble troll 4 eno1 (63 VFs)
Lille chetemi 14 eno1 (63 VFs), eno2 (63 VFs)
Lille chifflet 8 eno1 (63 VFs), eno2 (63 VFs)
Lyon gemini 2 enp1s0f0 (63 VFs)
Lyon hercule 4 enp130s0f1 (63 VFs)
Lyon neowise 10 eno1 (8 VFs), eno2 (8 VFs)
Lyon nova 22 enp5s0f0 (63 VFs)
Lyon orion 3 enp68s0f0 (63 VFs)
Lyon pyxis 4 eno1 (96 VFs)
Lyon taurus 12 enp68s0f0 (63 VFs)
Nancy graoully 16 eno1 (63 VFs)
Nancy graphite 4 eno1 (63 VFs)
Nancy grat 1 ens21f0np0 (8 VFs)
Nancy grcinq 41 eno1 (7 VFs)
Nancy grele 14 eno1 (63 VFs)
Nancy grimani 6 eno1 (63 VFs)
Nancy grimoire 8 eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs)
Nancy grisou 46 eno1 (63 VFs), eno2 (63 VFs), enp4s0f0 (63 VFs), enp4s0f1 (63 VFs)
Nancy gros 124 eno1 (63 VFs), eno2 (63 VFs)
Nantes econome 22 enp3s0f0 (63 VFs)
Nantes ecotype 48 eno1 (63 VFs), eno2 (63 VFs)
Rennes abacus25 2 ens10f0 (64 VFs)
Rennes paranoia 7 eno1 (7 VFs), enp3s0f0 (63 VFs), enp3s0f1 (63 VFs)
Rennes parasilo 27 eno1 (63 VFs), eno2 (63 VFs)
Rennes paravance 72 eno1 (63 VFs), eno2 (63 VFs)
Sophia uvb 30 eno1 (7 VFs)

Network interface models

Type Driver Model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Cards total
Ethernet bnx2x Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet 12 5 17
Ethernet bnx2x Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet 12 12
Ethernet bnxt_en Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller 9 9
Ethernet i40e Intel Ethernet Controller X710 for 10GbE SFP+ 36 82 2 120
Ethernet i40e Intel Ethernet Controller XXV710 for 25GbE SFP28 16 16 32
Ethernet ice Intel Ethernet Controller E810-C for SFP 2 2
Ethernet igb Intel 82576 Gigabit Network Connection 30 30
Ethernet igb Intel I350 Gigabit Network Connection 87 7 94
Ethernet ixgbe Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection 22 4 94 70 106 296
Ethernet ixgbe Intel Ethernet 10G 2P X520 Adapter 37 54 91
Ethernet ixgbe Intel Ethernet Controller 10-Gigabit X540-AT2 2 2
Ethernet mlx5_core Mellanox Technologies MT27710 Family [ConnectX-4 Lx] 4 10 124 138
Ethernet mlx5_core Mellanox Technologies MT27800 Family [ConnectX-5] 7 7
Ethernet mlx5_core Mellanox Technologies MT28908 Family [ConnectX-6] 1 1
Ethernet qede QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller 4 4
Ethernet tg3 Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet 10 10
FPGA/Ethernet* n/a Xilinx Alveo U200 QSFP28 (100GbE) 2 2
InfiniBand mlx4_core Mellanox Technologies MT25408A0-FCC-QI ConnectX, Dual Port 40Gb/s InfiniBand / 10GigE Adapter IC with PCIe 2.0 x8 5.0GT/s Interface 30 30
InfiniBand mlx4_core Mellanox Technologies MT27500 Family [ConnectX-3] 74 74
InfiniBand mlx5_core Mellanox Technologies MT27700 Family [ConnectX-4] 12 12
InfiniBand mlx5_core Mellanox Technologies MT27800 Family [ConnectX-5] 2 2
InfiniBand mlx5_core Mellanox Technologies MT28908 Family [ConnectX-6] 14 14
Omni-Path hfi1 Intel Omni-Path HFI Silicon 100 Series [discrete] 40 84 124
Sites total 108 38 12 84 627 70 115 60 9 1123

*: Ethernet interfaces on FPGA cards are not directly usable by the operating system

Storage

SSD models

SSD interface Model Size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse SSDs total
NVME Dell Ent NVMe v2 AGN MU U.2 1.6TB 1.6 TB 4 4
NVME Dell Express Flash NVMe PM1725 1.6TB AIC 1.6 TB 7 7
NVME Dell Express Flash PM1725b 1.6TB AIC 1.6 TB 1 1
NVME Dell Samsung PM1735 1.6 TB 4 4
NVME Kioxia KCM6DRUL3T84 3.84 TB 4 4
NVME SAMSUNG MZ1LB1T9HALS-00007 1.92 TB 12 12
SAS HP VO003840RZWVA 3.84 TB 8 8
SAS HPE MO000960RXKRC 960 GB 2 2
SAS Toshiba KRM5XVUG1T92 1.92 TB 2 2
SAS Toshiba PX02SSF020 200 GB 8 26 34
SAS Toshiba PX04SHB020 200 GB 1 1
SAS Toshiba PX04SMB040 400 GB 16 48 64
SAS Toshiba PX05SVB048Y 480 GB 8 8
SATA HP VK000960GXAWL 960 GB 9 9
SATA HP VK000960GZCNF 960 GB 4 4
SATA INTEL SSDSC2BB30 300 GB 8 8
SATA Intel SSDSC2KG480G7R 480 GB 3 16 19
SATA Intel SSDSC2KG480G8R 480 GB 1 16 17
SATA Intel SSDSC2KG960G8R 960 GB 1 1
SATA Micron MTFDDAK480TDN 480 GB 4 123 127
SATA Micron MTFDDAK960TDN 960 GB 123 123
SATA Micron MTFDDAK960TDT 960 GB 2 2
SATA SAMSUNG MZ7KM480 480 GB 2 2
SATA SAMSUNG MZ7LM1T9 1.92 TB 8 8
SATA Samsung MZ7KH1T9HAJR0D3 1.92 TB 1 1
SATA Samsung MZ7KH480HAHQ0D3 480 GB 1 1
SATA Samsung MZ7KM240HMHQ0D3 240 GB 32 32
SATA Samsung MZ7KM480HMHQ0D3 480 GB 32 32
SATA Samsung SSD 860 250 GB 8 8
SATA Sk Hynix HFS1T9G32FEH-BA1 1.92 TB 3 3
Sites total 88 40 34 296 48 33 9 548

Nodes with several disks

Site Cluster Number of nodes Main disk Additional HDDs Additional SSDs
Grenoble dahu 32 SSD 240 GB 1 (4.0 TB) 1 (480 GB)
Grenoble drac 12 HDD 1.0 TB 1 (1.0 TB) 0
Grenoble servan 2 SSD 1.6 TB 0 1 (1.6 TB)
Grenoble troll 4 SSD 480 GB 0 1 (1.6 TB)
Grenoble yeti 4 SSD 480 GB 3 (2.0 TB*, 2.0 TB*, 2.0 TB*) 2 (1.6 TB, 1.6 TB)
Lille chetemi 14 HDD 300 GB 1 (300 GB) 0
Lille chiclet 8 SSD 480 GB 2 (4.0 TB*, 4.0 TB*) 0
Lille chifflet 8 SSD 400 GB 2 (4.0 TB*, 4.0 TB*) 1 (400 GB*)
Lille chifflot 8 SSD 480 GB 4 (4.0 TB*, 4.0 TB*, 4.0 TB*, 4.0 TB*) 1 (480 GB*)
Lyon gemini 2 SSD 480 GB 0 4 (1.92 TB*, 1.92 TB*, 1.92 TB*, 1.92 TB*)
Lyon hercule 4 HDD 2.0 TB 2 (2.0 TB, 2.0 TB) 0
Lyon pyxis 4 SSD 250 GB 0 1 (250 GB)
Lyon sirius 1 SSD 1.92 TB 0 5 (1.92 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB)
Nancy graphite 4 SSD 300 GB 0 1 (300 GB)
Nancy grappe 16 SSD 480 GB 1 (8.0 TB*) 0
Nancy grat 1 SSD 3.84 TB 0 7 (3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB)
Nancy grele 14 HDD 299 GB 1 (299 GB) 0
Nancy grimoire 8 HDD 600 GB 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) 1 (200 GB*)
Nancy grisou 46 HDD 600 GB 1 (600 GB) 0
Nancy gros 124 SSD 480 GB 0 1 (960 GB*)
Nancy grouille 2 SSD 1.92 TB 0 1 (960 GB*)
Rennes abacus25 2 SSD 960 GB 0 2 (960 GB, 960 GB)
Rennes paranoia 7 HDD 600 GB 4 (600 GB, 600 GB, 600 GB, 600 GB) 0
Rennes parasilo 27 HDD 600 GB 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) 1 (200 GB*)
Rennes paravance 72 HDD 600 GB 1 (600 GB) 0

*: disk is reservable

Accelerators (GPU, Xeon Phi, FPGA)

Accelerator families

Accelerator family Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Accelerators total
AMD GPU 80 80
Intel MIC 4 4
Nvidia GPU 48 32 27 142 6 255
Xilinx FPGA 2 2
Sites total 50 32 107 146 6 341

Accelerator models

Accelerator model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Accelerators total
AMD Radeon Instinct MI50 32GB 80 80
Intel Xeon Phi 7120P 4 4
Nvidia A100-PCIE-40GB 4 4
Nvidia A100-SXM4-40GB 8 8 16
Nvidia A40 8 6 14
Nvidia GeForce GTX 1080 Ti 16 28 44
Nvidia GeForce GTX 980 10 10
Nvidia GeForce RTX 2080 Ti 48 48
Nvidia Quadro RTX 6000 4 4
Nvidia Tesla K40m 12 12
Nvidia Tesla M2075 3 3
Nvidia Tesla P100-PCIE-16GB 12 12
Nvidia Tesla P100-SXM2-16GB 48 48
Nvidia Tesla T4 20 20
Nvidia Tesla V100-PCIE-32GB 4 4
Nvidia Tesla V100-SXM2-32GB 16 16
Xilinx Alveo U200 2 2
Sites total 50 32 107 146 6 341

Accelerator cores

Accelerator model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Cores total
AMD Radeon Instinct MI50 32GB 409600 409600
Intel Xeon Phi 7120P 244 244
Nvidia A100-PCIE-40GB 27648 27648
Nvidia A100-SXM4-40GB 55296 55296 110592
Nvidia A40 86016 64512 150528
Nvidia GeForce GTX 1080 Ti 57344 100352 157696
Nvidia GeForce GTX 980 20480 20480
Nvidia GeForce RTX 2080 Ti 208896 208896
Nvidia Quadro RTX 6000 18432 18432
Nvidia Tesla K40m 34560 34560
Nvidia Tesla M2075 1344 1344
Nvidia Tesla P100-PCIE-16GB 43008 43008
Nvidia Tesla P100-SXM2-16GB 172032 172032
Nvidia Tesla T4 51200 51200
Nvidia Tesla V100-PCIE-32GB 20480 20480
Nvidia Tesla V100-SXM2-32GB 81920 81920
Sites total 172032 120832 548160 603124 64512 1508660

Nodes models

Nodes model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Toulouse Nodes total
AMD-Penguin Computing 10 10
Dell PowerEdge C6100 30 30
Dell PowerEdge C6220 4 41 22 67
Dell PowerEdge C6220 II 7 7
Dell PowerEdge C6420 32 64 96
Dell PowerEdge M620 12 12
Dell PowerEdge R430 22 22
Dell PowerEdge R630 14 70 48 99 231
Dell PowerEdge R640 4 140 144
Dell PowerEdge R720 15 9 24
Dell PowerEdge R730 8 20 28
Dell PowerEdge R740 8 8
Dell PowerEdge R7425 8 5 13
Dell PowerEdge R7525 2 6 8
Dell PowerEdge R940 4 4
Dell PowerEdge T640 13 13
HPE ProLiant DL385 Gen10+ v2 2 2
HPE Proliant DL360 Gen10+ 9 9
HPe Apollo 6500 1 1
IBM PowerNV S822LC (8335-GTB) 12 12
NVidia DGX A100 1 1
Nvidia DGX-1 2 2
R181-T92-00 4 4
Sun Fire V20z 10 10
Sites total 54 38 12 68 369 70 108 30 9 758

Last generated from the Grid'5000 Reference API on 2023-06-19 (commit eed917075a)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Hardware&oldid=99277"