Luxembourg:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
 
(25 intermediate revisions by 7 users not shown)
Line 1: Line 1:
__NOTOC__
__NOEDITSECTION__
__NOEDITSECTION__
{{Portal|User}}
{{Portal|User}}
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Louvain:Hardware|Louvain]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Strasbourg:Hardware|Strasbourg]] | [[Toulouse:Hardware|Toulouse]]</div>
'''See also:''' [[Luxembourg:Network|Network topology for Luxembourg]]
'''See also:''' [[Luxembourg:Network|Network topology for Luxembourg]]
= Summary =
= Summary =
* 1 cluster
* 3 clusters
* 14 nodes
* 56 nodes
* 168 CPU cores
* 2120 CPU cores
* 448&nbsp;GiB RAM
* 36 GPUs
* 14 HDDs on nodes (total: 3.5&nbsp;TB)
* 342016 GPUs cores
* 2.7 TFLOPS (excluding GPUs)
* 11.5&nbsp;TiB RAM
* 56 SSDs and 0 HDDs on nodes (total: 31.37&nbsp;TB)
* 113.7 TFLOPS (excluding GPUs)


= Clusters =
= Clusters summary =
{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
Line 18: Line 19:
!rowspan=2|Access Condition
!rowspan=2|Access Condition
!rowspan=2|Date of arrival
!rowspan=2|Date of arrival
!rowspan=2|Manufacturing date
!data-sort-type="number" rowspan=2|Nodes
!data-sort-type="number" rowspan=2|Nodes
!colspan=4|CPU
!colspan=4|CPU
Line 23: Line 25:
!data-sort-type="number" rowspan=2|Storage
!data-sort-type="number" rowspan=2|Storage
!data-sort-type="number" rowspan=2|Network
!data-sort-type="number" rowspan=2|Network
!rowspan=2|Accelerators
|-
|-
!data-sort-type="number"|#
!data-sort-type="number"|#
Line 30: Line 33:
|-
|-


|[[#petitprince|petitprince]]||||2013-09-10||14||2||Intel Xeon E5-2630L||6&nbsp;cores/CPU||x86_64||32&nbsp;GiB||data-sort-value="232"|<b>250&nbsp;GB&nbsp;HDD</b>||data-sort-value="20000"|2&nbsp;x&nbsp;10&nbsp;Gbps&nbsp;
|[[#clervaux|clervaux]]||||2025-09-01||2016-12-29||48||2||Intel Xeon E5-2680 v4||14&nbsp;cores/CPU||x86_64||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="111"|<b>120&nbsp;GB&nbsp;SSD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|-
|[[#larochette|larochette]]||||2024-06-24||2024-07-24||7||2||Intel Xeon Platinum 8568Y+||48&nbsp;cores/CPU||x86_64||data-sort-value="549755813888"|512&nbsp;GiB||data-sort-value="2980"|<b>3.2&nbsp;TB&nbsp;SSD</b>||data-sort-value="25000"|25&nbsp;Gbps&nbsp;||4&nbsp;x&nbsp;AMD MI210&nbsp;(64&nbsp;GiB)
|-
|[[#vianden|vianden]]||<b>[[Exotic#Luxembourg:_vianden|exotic]]</b>&nbsp;job&nbsp;type||2025-01-06||2024-07-14||1||2||Intel Xeon Platinum 8470||52&nbsp;cores/CPU||x86_64||data-sort-value="2199023255552"|2.0&nbsp;TiB||data-sort-value="2980"|<b>3.2&nbsp;TB&nbsp;SSD</b>||data-sort-value="120000"|2&nbsp;x&nbsp;10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;||8&nbsp;x&nbsp;AMD MI300X&nbsp;(192&nbsp;GiB)
|-
|}
''**: crossed GPUs are not supported by Grid'5000 default environments''
= Clusters in the [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/ default queue] =
 
== [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/?filter=clervaux%20only clervaux] ==
 
'''48 nodes, 96 cpus, 1344 cores''' ([https://public-api.grid5000.fr/stable/sites/luxembourg/clusters/clervaux/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=fluxembourg|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p clervaux</code> <code>-I</code>}}
 
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge C6320<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2016-12-29<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2025-09-01<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5-2680 v4 (Broadwell), x86_64, 2.40GHz, 2&nbsp;CPUs/node, 14&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 128&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 120&nbsp;GB SSD SATA Intel INTEL SSDSC2BB12 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0np0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br />
* <span style="color:grey">eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br/>
|-
|-
|}
|}


= Clusters in the [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/ default queue] =
== [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/?filter=larochette%20only larochette] ==
 
'''7 nodes, 14 cpus, 672 cores''' ([https://public-api.grid5000.fr/stable/sites/luxembourg/clusters/larochette/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=fluxembourg|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p larochette</code> <code>-I</code>}}
 
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge R760XA<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2024-07-24<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2024-06-24<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Platinum 8568Y+ (Emerald Rapids), x86_64, 2&nbsp;CPUs/node, 48&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 512&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 3.2&nbsp;TB SSD SAS Dell Dell NVMe ISE PS (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp1s0f0np0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice<br />
* <span style="color:grey">eth1/eno12409, Ethernet, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice - unavailable for experiment</span><br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 4&nbsp;x&nbsp;AMD Instinct&nbsp;MI210&nbsp;(64&nbsp;GiB)<br/>
|-
|}


== [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/?filter=petitprince%20only petitprince] ==
== [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/?filter=vianden%20only vianden] ==


'''14 nodes, 28 cpus, 168 cores''' ([https://public-api.grid5000.fr/stable/sites/luxembourg/clusters/petitprince/nodes.json?pretty=1 json])
'''1 node, 2 cpus, 104 cores''' ([https://public-api.grid5000.fr/stable/sites/luxembourg/clusters/vianden/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''


{{Term|location=fluxembourg|cmd=<code class="command">oarsub</code> <code class="env">-p petitprince</code> <code>-I</code>}}
{{Term|location=fluxembourg|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="replace">-t exotic</code> <code class="env">-p vianden</code> <code>-I</code>}}


{|
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| [[Exotic#Luxembourg:_vianden|exotic]] job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge M620<br/>
| Dell PowerEdge XE9680<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2024-07-14<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2013-09-10<br/>
| 2025-01-06<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon E5-2630L (Sandy Bridge, 2.00GHz, 2&nbsp;CPUs/node, 6&nbsp;cores/CPU)<br/>
| Intel Xeon Platinum 8470 (Sapphire Rapids), x86_64, 2&nbsp;CPUs/node, 52&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 32&nbsp;GiB<br/>
| 2.0&nbsp;TiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 250&nbsp;GB HDD SATA Seagate ST9250610NS (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:1f.2-ata-1</code>)  (primary disk)<br/>
|  disk0, 3.2&nbsp;TB SSD NVME Dell Dell Ent NVMe PM1735a MU 3.2TB (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet, driver: bnx2x<br />
* eth0/enp158s0f0np0, Ethernet, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT2892 Family [ConnectX-6 Dx], driver: mlx5_core<br />
* eth1/eno2, Ethernet, configured rate: 10&nbsp;Gbps, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet, driver: bnx2x [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
* <span style="color:grey">eth1/enp158s0f1np1, Ethernet, model: Mellanox Technologies MT2892 Family [ConnectX-6 Dx], driver: mlx5_core - unavailable for experiment</span><br />
* eth2/enp1s0f0np0, Ethernet, configured rate: 10&nbsp;Gbps, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br />
* eth3/eno12409np1, Ethernet, configured rate: 10&nbsp;Gbps, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br />
* <span style="color:grey">eth4/eno12419np2, Ethernet, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en - unavailable for experiment</span><br />
* <span style="color:grey">eth5/eno12429np3, Ethernet, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en - unavailable for experiment</span><br />
* <span style="color:grey">eth6/eno8303, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth7/eno8403, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 8&nbsp;x&nbsp;AMD AMD&nbsp;Instinct&nbsp;MI300X&nbsp;(192&nbsp;GiB)<br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2022-06-07 ([https://github.com/grid5000/reference-repository/commit/5d4b87f3e6 commit 5d4b87f3e6])</small>''
|}
 
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Luxembourg:_vianden|exotic]]''' page for more information.<br/>''<small>Last generated from the Grid'5000 Reference API on 2025-10-09 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/2a41e66580 commit 2a41e66580])</small>''

Latest revision as of 16:09, 9 October 2025

Hardware: Global | Grenoble | Lille | Louvain | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse

See also: Network topology for Luxembourg

Summary

  • 3 clusters
  • 56 nodes
  • 2120 CPU cores
  • 36 GPUs
  • 342016 GPUs cores
  • 11.5 TiB RAM
  • 56 SSDs and 0 HDDs on nodes (total: 31.37 TB)
  • 113.7 TFLOPS (excluding GPUs)

Clusters summary

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
clervaux 2025-09-01 2016-12-29 48 2 Intel Xeon E5-2680 v4 14 cores/CPU x86_64 128 GiB 120 GB SSD 10 Gbps (SR‑IOV) 
larochette 2024-06-24 2024-07-24 7 2 Intel Xeon Platinum 8568Y+ 48 cores/CPU x86_64 512 GiB 3.2 TB SSD 25 Gbps  4 x AMD MI210 (64 GiB)
vianden exotic job type 2025-01-06 2024-07-14 1 2 Intel Xeon Platinum 8470 52 cores/CPU x86_64 2.0 TiB 3.2 TB SSD 2 x 10 Gbps + 100 Gbps  8 x AMD MI300X (192 GiB)

**: crossed GPUs are not supported by Grid'5000 default environments

Clusters in the default queue

clervaux

48 nodes, 96 cpus, 1344 cores (json)

Reservation example:

Terminal.png fluxembourg:
oarsub -q default -p clervaux -I
Model: Dell PowerEdge C6320
Manufacturing date: 2016-12-29
Date of arrival: 2025-09-01
CPU: Intel Xeon E5-2680 v4 (Broadwell), x86_64, 2.40GHz, 2 CPUs/node, 14 cores/CPU
Memory: 128 GiB
Storage: disk0, 120 GB SSD SATA Intel INTEL SSDSC2BB12 (dev: /dev/disk0) (primary disk)
Network:
  • eth0/enp1s0f0np0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment

larochette

7 nodes, 14 cpus, 672 cores (json)

Reservation example:

Terminal.png fluxembourg:
oarsub -q default -p larochette -I
Model: Dell PowerEdge R760XA
Manufacturing date: 2024-07-24
Date of arrival: 2024-06-24
CPU: Intel Xeon Platinum 8568Y+ (Emerald Rapids), x86_64, 2 CPUs/node, 48 cores/CPU
Memory: 512 GiB
Storage: disk0, 3.2 TB SSD SAS Dell Dell NVMe ISE PS (dev: /dev/disk0) (primary disk)
Network:
  • eth0/enp1s0f0np0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice
  • eth1/eno12409, Ethernet, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice - unavailable for experiment
GPU: 4 x AMD Instinct MI210 (64 GiB)

vianden

1 node, 2 cpus, 104 cores (json)

Reservation example:

Terminal.png fluxembourg:
oarsub -q default -t exotic -p vianden -I
Access condition: exotic job type
Model: Dell PowerEdge XE9680
Manufacturing date: 2024-07-14
Date of arrival: 2025-01-06
CPU: Intel Xeon Platinum 8470 (Sapphire Rapids), x86_64, 2 CPUs/node, 52 cores/CPU
Memory: 2.0 TiB
Storage: disk0, 3.2 TB SSD NVME Dell Dell Ent NVMe PM1735a MU 3.2TB (dev: /dev/disk0) (primary disk)
Network:
  • eth0/enp158s0f0np0, Ethernet, configured rate: 100 Gbps, model: Mellanox Technologies MT2892 Family [ConnectX-6 Dx], driver: mlx5_core
  • eth1/enp158s0f1np1, Ethernet, model: Mellanox Technologies MT2892 Family [ConnectX-6 Dx], driver: mlx5_core - unavailable for experiment
  • eth2/enp1s0f0np0, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en (multi NICs example)
  • eth3/eno12409np1, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en (multi NICs example)
  • eth4/eno12419np2, Ethernet, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en - unavailable for experiment
  • eth5/eno12429np3, Ethernet, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en - unavailable for experiment
  • eth6/eno8303, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth7/eno8403, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
GPU: 8 x AMD AMD Instinct MI300X (192 GiB)

Note: This cluster is defined as exotic. Please read the exotic page for more information.
Last generated from the Grid'5000 Reference API on 2025-10-09 (commit 2a41e66580)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Luxembourg:Hardware&oldid=107793"