Nancy:Hardware: Difference between revisions
No edit summary |
No edit summary |
||
Line 6: | Line 6: | ||
= Summary = | = Summary = | ||
'''14 clusters, | '''14 clusters, 375 nodes, 7900 cores, 327.2 TFLOPS''' | ||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
Line 24: | Line 24: | ||
|[[#graoully|graoully]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2016-01-04||16||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand, SR-IOV available|| | |[[#graoully|graoully]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2016-01-04||16||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand, SR-IOV available|| | ||
|- | |- | ||
|[[#graphique|graphique]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2015-05-12|| | |[[#graphique|graphique]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2015-05-12||5||2 x Intel Xeon E5-2620 v3||6 cores/CPU||64 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand||2 x Nvidia GTX 980 | ||
|- | |- | ||
|[[#graphite|graphite]]||||2013-12-05||4||2 x Intel Xeon E5-2650||8 cores/CPU||256 GiB||data-sort-value="558"|<b>1 x 300 GB SSD</b> + 1 x 300 GB SSD||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand, SR-IOV available||Intel Xeon Phi 7120P | |[[#graphite|graphite]]||||2013-12-05||4||2 x Intel Xeon E5-2650||8 cores/CPU||256 GiB||data-sort-value="558"|<b>1 x 300 GB SSD</b> + 1 x 300 GB SSD||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand, SR-IOV available||Intel Xeon Phi 7120P | ||
Line 40: | Line 40: | ||
|[[#grisou|grisou]]||||2016-01-04||51||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="41000"|[1-48]: 1 Gbps + 4 x 10 Gbps , SR-IOV available<br />49: 4 x 10 Gbps , SR-IOV available<br />[50-51]: 4 x 10 Gbps + 56 Gbps InfiniBand, SR-IOV available|| | |[[#grisou|grisou]]||||2016-01-04||51||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="41000"|[1-48]: 1 Gbps + 4 x 10 Gbps , SR-IOV available<br />49: 4 x 10 Gbps , SR-IOV available<br />[50-51]: 4 x 10 Gbps + 56 Gbps InfiniBand, SR-IOV available|| | ||
|- | |- | ||
|[[#gros|gros]]||||2019-09-04||124||Intel Xeon Gold 5220||18 cores/CPU||96 GiB||data-sort-value="1341"|<b>480 GB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps || | |[[#gros|gros]]||||2019-09-04||124||Intel Xeon Gold 5220||18 cores/CPU||96 GiB||data-sort-value="1341"|<b>480 GB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps , SR-IOV available|| | ||
|- | |- | ||
|[[#grouille|grouille]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2021-01-13||2||2 x AMD EPYC 7452||32 cores/CPU||128 GiB||data-sort-value="2682"|<b>1.92 TB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="25000"|25 Gbps ||2 x Nvidia A100 | |[[#grouille|grouille]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2021-01-13||2||2 x AMD EPYC 7452||32 cores/CPU||128 GiB||data-sort-value="2682"|<b>1.92 TB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="25000"|25 Gbps ||2 x Nvidia A100 | ||
Line 271: | Line 271: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core<br /> | * eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled<br /> | ||
* eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | * eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | ||
|- | |- | ||
|} | |} | ||
Line 300: | Line 300: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core<br /> | * eth0/eno1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled<br /> | ||
* eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | * eth1/eno2, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | ||
|- | |- | ||
|} | |} | ||
Line 469: | Line 469: | ||
== graphique == | == graphique == | ||
''' | '''5 nodes, 10 cpus, 60 cores''' ([https://public-api.grid5000.fr/stable/sites/nancy/clusters/graphique/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | '''Reservation example:''' | ||
Line 475: | Line 475: | ||
{{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p "cluster='graphique'"</code> <code>-I</code>}} | {{Term|location=fnancy|cmd=<code class="command">oarsub</code> <code class="replace">-q production</code> <code class="env">-p "cluster='graphique'"</code> <code>-I</code>}} | ||
{| | {| | ||
|- | |- | ||
Line 811: | Line 775: | ||
* ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/> | * ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on 2021-08- | |}''<small>Last generated from the Grid'5000 Reference API on 2021-08-12 ([https://github.com/grid5000/reference-repository/commit/c39a9a401a commit c39a9a401a])</small>'' |
Revision as of 15:26, 12 August 2021
See also: Network topology for Nancy
Summary
14 clusters, 375 nodes, 7900 cores, 327.2 TFLOPS
Cluster | Access Condition | Date of arrival | Nodes | CPU | Cores | Memory | Storage | Network | Accelerators |
---|---|---|---|---|---|---|---|---|---|
graffiti | production queue | 2019-06-07 | 13 | 2 x Intel Xeon Silver 4110 | 8 cores/CPU | 128 GiB | 479 GB HDD | 10 Gbps | [1-12]: 4 x Nvidia RTX 2080 Ti 13: 4 x Nvidia Quadro RTX 6000 |
graoully | production queue | 2016-01-04 | 16 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 1 x 600 GB HDD + 1 x 600 GB HDD | 10 Gbps + 56 Gbps InfiniBand, SR-IOV available | |
graphique | production queue | 2015-05-12 | 5 | 2 x Intel Xeon E5-2620 v3 | 6 cores/CPU | 64 GiB | 299 GB HDD | 10 Gbps + 56 Gbps InfiniBand | 2 x Nvidia GTX 980 |
graphite | 2013-12-05 | 4 | 2 x Intel Xeon E5-2650 | 8 cores/CPU | 256 GiB | 1 x 300 GB SSD + 1 x 300 GB SSD | 10 Gbps + 56 Gbps InfiniBand, SR-IOV available | Intel Xeon Phi 7120P | |
grappe | production queue | 2020-08-20 | 16 | 2 x Intel Xeon Gold 5218R | 20 cores/CPU | 96 GiB | 480 GB SSD + 8.0 TB HDD* | 25 Gbps | |
grcinq | production queue | 2013-04-09 | 47 | 2 x Intel Xeon E5-2650 | 8 cores/CPU | 64 GiB | 1.0 TB HDD | 1 Gbps + 56 Gbps InfiniBand, SR-IOV available | |
grele | production queue | 2017-06-26 | 14 | 2 x Intel Xeon E5-2650 v4 | 12 cores/CPU | 128 GiB | 1 x 299 GB HDD + 1 x 299 GB HDD | 10 Gbps + 100 Gbps Omni-Path, SR-IOV available | 2 x Nvidia GTX 1080 Ti |
grimani | production queue | 2016-08-30 | 6 | 2 x Intel Xeon E5-2603 v3 | 6 cores/CPU | 64 GiB | 1.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path, SR-IOV available | 2 x Nvidia Tesla K40M |
grimoire | 2016-01-22 | 8 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* | 4 x 10 Gbps + 56 Gbps InfiniBand, SR-IOV available | ||
grisou | 2016-01-04 | 51 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 1 x 600 GB HDD + 1 x 600 GB HDD | [1-48]: 1 Gbps + 4 x 10 Gbps , SR-IOV available 49: 4 x 10 Gbps , SR-IOV available [50-51]: 4 x 10 Gbps + 56 Gbps InfiniBand, SR-IOV available |
||
gros | 2019-09-04 | 124 | Intel Xeon Gold 5220 | 18 cores/CPU | 96 GiB | 480 GB SSD + 960 GB SSD* | 2 x 25 Gbps , SR-IOV available | ||
grouille | exotic job type | 2021-01-13 | 2 | 2 x AMD EPYC 7452 | 32 cores/CPU | 128 GiB | 1.92 TB SSD + 960 GB SSD* | 25 Gbps | 2 x Nvidia A100 |
grue | production queue | 2019-11-25 | 5 | 2 x AMD EPYC 7351 | 16 cores/CPU | 128 GiB | 479 GB HDD | 10 Gbps | 4 x Nvidia Tesla T4 |
grvingt | production queue | 2018-04-11 | 64 | 2 x Intel Xeon Gold 6130 | 16 cores/CPU | 192 GiB | 1.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path |
*: disk is reservable
Clusters in default queue
graphite
4 nodes, 8 cpus, 64 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Date of arrival: | 2013-12-05 |
CPU: | Intel Xeon E5-2650 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 256 GiB |
Storage: |
|
Network: |
|
Xeon Phi: | Intel Xeon Phi 7120P |
grimoire
8 nodes, 16 cpus, 128 cores (json)
Reservation example:
Model: | Dell PowerEdge R630 |
Date of arrival: | 2016-01-22 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
grisou
51 nodes, 102 cpus, 816 cores, split as follows due to differences between nodes (json)
Reservation example:
- grisou-[1-48] (48 nodes, 96 cpus, 768 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2016-01-04 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- grisou-49 (1 node, 2 cpus, 16 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2016-01-04 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- grisou-[50-51] (2 nodes, 4 cpus, 32 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2016-01-04 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
gros
124 nodes, 124 cpus, 2232 cores, split as follows due to differences between nodes (json)
Reservation example:
- gros-[1-67,
69-124] (123 nodes, 123 cpus, 2214 cores)
Model: | Dell PowerEdge R640 |
Date of arrival: | 2019-09-04 |
CPU: | Intel Xeon Gold 5220 (Cascade Lake-SP, 2.20GHz, 1 CPU/node, 18 cores/CPU) |
Memory: | 96 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
- gros-68 (1 node, 1 cpu, 18 cores)
Model: | Dell PowerEdge R640 |
Date of arrival: | 2019-09-04 |
CPU: | Intel Xeon Gold 5220 (Cascade Lake-SP, 2.20GHz, 1 CPU/node, 18 cores/CPU) |
Memory: | 96 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
grouille
2 nodes, 4 cpus, 128 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Dell PowerEdge R7525 |
Date of arrival: | 2021-01-13 |
CPU: | AMD EPYC 7452 (Zen 2, 2 CPUs/node, 32 cores/CPU) |
Memory: | 128 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
GPU: | 2 x Nvidia A100-PCIE-40GB |
Clusters in production queue
graffiti
13 nodes, 26 cpus, 208 cores, split as follows due to differences between nodes (json)
Reservation example:
- graffiti-[1-12] (12 nodes, 24 cpus, 192 cores)
Access condition: | production queue |
Model: | Dell PowerEdge T640 |
Date of arrival: | 2019-06-07 |
CPU: | Intel Xeon Silver 4110 (Skylake, 2.10GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: | disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:19:00.0-scsi-0:2:0:0) (primary disk) |
Network: |
|
GPU: | 4 x Nvidia GeForce RTX 2080 Ti |
- graffiti-13 (1 node, 2 cpus, 16 cores)
Access condition: | production queue |
Model: | Dell PowerEdge T640 |
Date of arrival: | 2019-06-07 |
CPU: | Intel Xeon Silver 4110 (Skylake, 2.10GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: | disk0, 479 GB HDD SATA Dell PERC H330 Adp (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:19:00.0-scsi-0:2:0:0) (primary disk) |
Network: |
|
GPU: | 4 x Nvidia Quadro RTX 6000 |
graoully
16 nodes, 32 cpus, 256 cores (json)
Reservation example:
Access condition: | production queue |
Model: | Dell PowerEdge R630 |
Date of arrival: | 2016-01-04 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
graphique
5 nodes, 10 cpus, 60 cores (json)
Reservation example:
Access condition: | production queue |
Model: | Dell PowerEdge R720 |
Date of arrival: | 2015-05-12 |
CPU: | Intel Xeon E5-2620 v3 (Haswell, 2.40GHz, 2 CPUs/node, 6 cores/CPU) |
Memory: | 64 GiB |
Storage: | disk0, 299 GB HDD RAID-1 (2 disks) Dell PERC H330 Mini (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0) (primary disk) |
Network: |
|
GPU: | 2 x Nvidia GeForce GTX 980 |
grappe
16 nodes, 32 cpus, 640 cores (json)
Reservation example:
Access condition: | production queue |
Model: | Dell PowerEdge R640 |
Date of arrival: | 2020-08-20 |
CPU: | Intel Xeon Gold 5218R (Cascade Lake-SP, 2.10GHz, 2 CPUs/node, 20 cores/CPU) |
Memory: | 96 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
grcinq
47 nodes, 94 cpus, 752 cores, split as follows due to differences between nodes (json)
Reservation example:
- grcinq-[1,
5, 8, 18, 30, 46] (6 nodes, 12 cpus, 96 cores)
Access condition: | production queue |
Model: | Dell PowerEdge C6220 |
Date of arrival: | 2013-04-09 |
CPU: | Intel Xeon E5-2650 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 64 GiB |
Storage: | disk0, 1.0 TB HDD SATA Seagate ST1000NM0033-9ZM (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1) (primary disk) |
Network: |
|
- grcinq-[2-4,
6-7, 9-17, 19-29, 31-45, 47] (41 nodes, 82 cpus, 656 cores)
Access condition: | production queue |
Model: | Dell PowerEdge C6220 |
Date of arrival: | 2013-04-09 |
CPU: | Intel Xeon E5-2650 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 64 GiB |
Storage: | disk0, 1.0 TB HDD SATA Western Digital WDC WD1003FBYX-1 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1) (primary disk) |
Network: |
|
grele
14 nodes, 28 cpus, 336 cores (json)
Reservation example:
Access condition: | production queue |
Model: | Dell PowerEdge R730 |
Date of arrival: | 2017-06-26 |
CPU: | Intel Xeon E5-2650 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 12 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia GeForce GTX 1080 Ti |
grimani
6 nodes, 12 cpus, 72 cores (json)
Reservation example:
Access condition: | production queue |
Model: | Dell PowerEdge R730 |
Date of arrival: | 2016-08-30 |
CPU: | Intel Xeon E5-2603 v3 (Haswell, 1.60GHz, 2 CPUs/node, 6 cores/CPU) |
Memory: | 64 GiB |
Storage: | disk0, 1.0 TB HDD SATA Seagate ST1000NX0423 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk) |
Network: |
|
GPU: | 2 x Nvidia Tesla K40m |
grue
5 nodes, 10 cpus, 160 cores (json)
Reservation example:
Access condition: | production queue |
Model: | Dell PowerEdge R7425 |
Date of arrival: | 2019-11-25 |
CPU: | AMD EPYC 7351 (Zen, 2 CPUs/node, 16 cores/CPU) |
Memory: | 128 GiB |
Storage: | disk0, 479 GB HDD SAS Dell PERC H730P Adp (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:e1:00.0-scsi-0:2:0:0) (primary disk) |
Network: |
|
GPU: | 4 x Nvidia Tesla T4 |
grvingt
64 nodes, 128 cpus, 2048 cores (json)
Reservation example:
Access condition: | production queue |
Model: | Dell PowerEdge C6420 |
Date of arrival: | 2018-04-11 |
CPU: | Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2 CPUs/node, 16 cores/CPU) |
Memory: | 192 GiB |
Storage: | disk0, 1.0 TB HDD SATA Seagate ST1000NX0443 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:11.5-ata-3) (primary disk) |
Network: |
|
Last generated from the Grid'5000 Reference API on 2021-08-12 (commit c39a9a401a)