Lyon:Hardware: Difference between revisions
No edit summary  | 
				No edit summary  | 
				||
| (90 intermediate revisions by 17 users not shown) | |||
| Line 1: | Line 1: | ||
__NOEDITSECTION__  | __NOEDITSECTION__  | ||
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>  | {{Portal|User}}  | ||
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Louvain:Hardware|Louvain]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Strasbourg:Hardware|Strasbourg]] | [[Toulouse:Hardware|Toulouse]]</div>  | |||
'''See also:''' [[Lyon:Network|Network topology for Lyon]]  | |||
= Summary =  | |||
* 10 clusters  | |||
* 69 nodes  | |||
* 1798 CPU cores  | |||
* 111 GPUs  | |||
* 620864 GPUs cores  | |||
* 11.74 TiB RAM  | |||
* 42 SSDs and 56 HDDs on nodes (total: 109.39 TB)  | |||
* 50.6 TFLOPS (excluding GPUs)  | |||
=   | = Clusters summary =  | ||
{|class="wikitable sortable"  | {|class="wikitable sortable"  | ||
|-  | |-  | ||
!|Cluster  | !rowspan=2|Cluster  | ||
!|  | !rowspan=2|Access Condition  | ||
!|Date of arrival  | !rowspan=2|Date of arrival  | ||
!data-sort-type="number"|Nodes  | !rowspan=2|Manufacturing date  | ||
!|CPU  | !data-sort-type="number" rowspan=2|Nodes  | ||
!colspan=4|CPU  | |||
!data-sort-type="number" rowspan=2|Memory  | |||
!data-sort-type="number" rowspan=2|Storage  | |||
!data-sort-type="number" rowspan=2|Network  | |||
!rowspan=2|Accelerators  | |||
|-  | |||
!data-sort-type="number"|#  | |||
!|Name  | |||
!data-sort-type="number"|Cores  | !data-sort-type="number"|Cores  | ||
!  | !|Architecture  | ||
|-  | |-  | ||
|[[#  | |||
|[[#gemini|gemini]]||<b>[[Exotic#Lyon:_gemini|exotic]]</b> job type||2019-09-01||2019-06-12||2||2||Intel Xeon E5-2698 v4||20 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="7599"|<b>480 GB SSD</b> + 4 x 1.92 TB SSD[[Disk_reservation|*]]||data-sort-value="10000"|10 Gbps (SR‑IOV) ||8 x Nvidia Tesla V100 (32 GiB)  | |||
|-  | |-  | ||
|[[#  | |[[#hercule|hercule]]||||2012-10-02||2012-07-19||4||2||Intel Xeon E5-2620||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="5589"|<b>2.0 TB HDD</b> + 2 x 2.0 TB HDD||data-sort-value="10000"|10 Gbps (SR‑IOV) ||  | ||
|-  | |-  | ||
|[[#  | |[[#hydra|hydra]]||<b>[[Exotic#Lyon:_hydra|exotic]]</b> job type||2024-02-15||2024-02-15||4||1||NVIDIA/ARM Grace A02  CPU||72 cores/CPU||aarch64||data-sort-value="515396075520"|480 GiB||data-sort-value="2682"|<b>960 GB SSD</b> + 1.92 TB SSD||data-sort-value="10000"|10 Gbps (SR‑IOV) ||Nvidia H200 (96 GiB)  | ||
|-  | |-  | ||
|[[#  | |[[#neowise|neowise]]||<b>[[Exotic#Lyon:_neowise|exotic]]</b> job type||2021-05-17||2021-05-17||10||1||AMD EPYC 7642||48 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="1788"|<b>1.92 TB SSD</b>||data-sort-value="220000"|2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand||8 x AMD MI50 (32 GiB)  | ||
|-  | |-  | ||
|[[#  | |[[#nova|nova]]||||2016-12-01||2016-10-28||20||2||Intel Xeon E5-2620 v4||8 cores/CPU||x86_64||data-sort-value="68719476736"|64 GiB||data-sort-value="557"|<b>598 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||  | ||
|-  | |||
|[[#orion|orion]]||||2012-09-14||2012-07-16||3||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||<s>Nvidia Tesla M2075 (5 GiB)</s>**  | |||
|-  | |||
|[[#pyxis|pyxis]]||<b>[[Exotic#Lyon:_pyxis|exotic]]</b> job type||2020-01-06||2019-11-07||4||2||Cavium ThunderX2 99xx||32 cores/CPU||aarch64||data-sort-value="274877906944"|256 GiB||data-sort-value="464"|<b>250 GB SSD</b> + 250 GB SSD||data-sort-value="10000"|10 Gbps (SR‑IOV) ||  | |||
|-  | |||
|[[#sagittaire|sagittaire]]||||2006-07-01||2006-07-01||9||2||AMD Opteron 250||1 core/CPU||x86_64||data-sort-value="2147483648"|2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps ||  | |||
|-  | |||
|[[#sirius|sirius]]||<b>[[Exotic#Lyon:_sirius|exotic]]</b> job type||2021-11-18||2021-11-24||1||2||AMD EPYC 7742||64 cores/CPU||x86_64||data-sort-value="1099511627776"|1.0 TiB||data-sort-value="17880"|<b>1.92 TB SSD</b> + 1.92 TB SSD + 4 x 3.84 TB SSD||data-sort-value="100000"|100 Gbps ||8 x Nvidia A100 (40 GiB)  | |||
|-  | |||
|[[#taurus|taurus]]||||2012-09-14||2012-07-16||12||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||  | |||
|-  | |||
|}  | |||
''*: disk is [[Disk_reservation|reservable]]''  | |||
''**: crossed GPUs are not supported by Grid'5000 default environments''  | |||
= Clusters in the [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/ default queue] =  | |||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=gemini%20only gemini] ==  | |||
'''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="replace">-t exotic</code> <code class="env">-p gemini</code> <code>-I</code>}}  | |||
{|  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''  | |||
| [[Exotic#Lyon:_gemini|exotic]] job type<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | |||
| Nvidia DGX-1<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2019-06-12<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | |||
| 2019-09-01<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | |||
| Intel Xeon E5-2698 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 20 cores/CPU<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | |||
| 512 GiB<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | |||
|   | |||
* disk0, 480 GB SSD SATA Samsung SAMSUNG MZ7KM480 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />  | |||
* disk1, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />  | |||
* disk2, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />  | |||
* disk3, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />  | |||
* disk4, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | |||
|   | |||
* eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe, SR-IOV enabled<br />  | |||
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib2, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''  | |||
| 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB)<br>Compute capability: 7.0<br/>  | |||
|-  | |||
|}  | |}  | ||
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Lyon:_gemini|exotic]]''' page for more information.<br/>  | |||
== hercule ==  | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=hercule%20only hercule] ==  | ||
'''4 nodes, 8 cpus, 48 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/hercule/nodes.json?pretty=1 json])  | '''4 nodes, 8 cpus, 48 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/hercule/nodes.json?pretty=1 json])  | ||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p hercule</code> <code>-I</code>}}  | |||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
| Dell PowerEdge C6220<br/>  | | Dell PowerEdge C6220<br/>  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2012-07-19<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
| Line 44: | Line 131: | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| Intel Xeon E5-2620 Sandy Bridge   | | Intel Xeon E5-2620 (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU<br/>  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | |||
| 32 GiB<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | |||
|   | |||
* disk0, 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />  | |||
* disk1, 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: <code class="file">/dev/disk1</code>)  <br />  | |||
* disk2, 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: <code class="file">/dev/disk2</code>)  <br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | |||
|   | |||
* <span style="color:grey">eth0/enp130s0f0, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br />  | |||
* eth1/enp130s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br />  | |||
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | |||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>  | |||
|-  | |||
|}  | |||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=hydra%20only hydra] ==  | |||
'''4 nodes, 4 cpus, 288 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/hydra/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="replace">-t exotic</code> <code class="env">-p hydra</code> <code>-I</code>}}  | |||
{|  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''  | |||
| [[Exotic#Lyon:_hydra|exotic]] job type<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | |||
| NVIDIA Grace Hopper<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2024-02-15<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | |||
| 2024-02-15<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | |||
| NVIDIA/ARM Grace A02  CPU (Grace), aarch64, 1 CPU/node, 72 cores/CPU<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
|   | | 480 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |    | ||
* 1.  | * disk0, 960 GB SSD NVME Samsung SAMSUNG MZ1L2960HCJR-00A07 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />  | ||
* disk1, 1.92 TB SSD SCSI Samsung SAMSUNG MZTL21T9 (dev: <code class="file">/dev/disk1</code>)  <br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | |||
|   | |||
* eth0/enp1s0f0np0, Ethernet, configured rate: 10 Gbps, model: Mellanox Technologies MT2910 Family [ConnectX-7], driver: mlx5_core, SR-IOV enabled<br />  | |||
* <span style="color:grey">eth1/enp1s0f1np1, Ethernet, model: Mellanox Technologies MT2910 Family [ConnectX-7], driver: mlx5_core - unavailable for experiment</span><br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''  | |||
| Nvidia GH200 (96 GiB)<br>Compute capability: 9.0<br/>  | |||
|-  | |||
|}  | |||
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Lyon:_hydra|exotic]]''' page for more information.<br/>  | |||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=neowise%20only neowise] ==  | |||
'''10 nodes, 10 cpus, 480 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/neowise/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="replace">-t exotic</code> <code class="env">-p neowise</code> <code>-I</code>}}  | |||
{|  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''  | |||
| [[Exotic#Lyon:_neowise|exotic]] job type<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | |||
| AMD-Penguin Computing<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2021-05-17<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | |||
| 2021-05-17<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | |||
| AMD EPYC 7642 (Zen 2), x86_64, 1 CPU/node, 48 cores/CPU<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | |||
| 512 GiB<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | |||
|  disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
*   | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled<br />  | ||
* eth1/  | * eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled - no KaVLAN<br />  | ||
*   | * ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br />  | ||
* ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''  | |||
| 8 x AMD Radeon Instinct MI50 32GB (32 GiB)<br/>  | |||
|-  | |-  | ||
|}  | |}  | ||
== nova ==  | '''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Lyon:_neowise|exotic]]''' page for more information.<br/>  | ||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=nova%20only nova] ==  | |||
'''20 nodes, 40 cpus, 320 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/nova/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p nova</code> <code>-I</code>}}  | |||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
| Dell PowerEdge R430<br/>  | | Dell PowerEdge R430<br/>  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2016-10-28<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
| Line 76: | Line 261: | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| Intel Xeon E5-2620 v4 Broadwell   | | Intel Xeon E5-2620 v4 (Broadwell), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
| 64   | | 64 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |  disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* eth0/enp5s0f0, Ethernet   | * eth0/enp5s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br />  | ||
* <span style="color:grey"> eth1/enp5s0f1, Ethernet   | * <span style="color:grey">eth1/enp5s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth2/eno1, Ethernet   | * <span style="color:grey">eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth3/eno2, Ethernet   | * <span style="color:grey">eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth4/eno3, Ethernet   | * <span style="color:grey">eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth5/eno4, Ethernet   | * <span style="color:grey">eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/>  | ||
|-  | |-  | ||
|}  | |}  | ||
== orion ==  | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=orion%20only orion] ==  | ||
'''3 nodes, 6 cpus, 36 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/orion/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p orion</code> <code>-I</code>}}  | |||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
| Dell PowerEdge R720<br/>  | | Dell PowerEdge R720<br/>  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2012-07-16<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
| Line 107: | Line 300: | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| Intel Xeon E5-2630 Sandy Bridge   | | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
| 32   | | 32 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |  disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* eth0/enp68s0f0, Ethernet   | * eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br />  | ||
* <span style="color:grey"> eth1/enp68s0f1, Ethernet   | * <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth2/eno1, Ethernet   | * <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth3/eno2, Ethernet   | * <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth4/eno3, Ethernet   | * <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth5/eno4, Ethernet   | * <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''  | ||
| Nvidia Tesla M2075<br/>  | | <s>Nvidia Tesla M2075 (5 GiB)<br>Compute capability: 2.0</s><br>''not supported by Grid'5000 default environments''<br/>  | ||
|-  | |-  | ||
|}  | |}  | ||
==   | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=pyxis%20only pyxis] ==  | ||
'''4 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/pyxis/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="replace">-t exotic</code> <code class="env">-p pyxis</code> <code>-I</code>}}  | |||
{|  | {|  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''  | |||
| [[Exotic#Lyon:_pyxis|exotic]] job type<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
|   | | Gigabyte R181-T92-00<br/>  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2019-11-07<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
|   | | 2020-01-06<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
|   | | Cavium ThunderX2 99xx (Vulcan), aarch64, 2 CPUs/node, 32 cores/CPU<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
|   | | 256 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|   | |    | ||
* disk0, 250 GB SSD SATA Samsung Samsung SSD 860 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />  | |||
* disk1, 250 GB SSD SATA Samsung Samsung SSD 860 (dev: <code class="file">/dev/disk1</code>)  <br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* <span style="color:grey">   | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede, SR-IOV enabled<br />  | ||
*   | * <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br />  | ||
* <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br/>  | |||
|-  | |-  | ||
|}  | |}  | ||
<  | |||
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Lyon:_pyxis|exotic]]''' page for more information.<br/>  | |||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sagittaire%20only sagittaire] ==  | |||
'''9 nodes, 18 cpus, 18 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p sagittaire</code> <code>-I</code>}}  | |||
; sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)  | ; sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)  | ||
| Line 163: | Line 378: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
| Sun Fire V20z<br/>  | | Sun Fire V20z<br/>  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2006-07-01<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
| Line 168: | Line 386: | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| AMD Opteron 250 K8   | | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
| 2   | | 2 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |  disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* <span style="color:grey"> eth0/enp2s2f0, Ethernet   | * <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br />  | ||
* eth1/enp2s2f1, Ethernet   | * eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/>  | ||
|-  | |-  | ||
|}  | |}  | ||
<hr style="height:10pt; visibility:hidden;" />  | <hr style="height:10pt; visibility:hidden;" />  | ||
; sagittaire-[  | ; sagittaire-[3-5,<wbr>13-16] (7 nodes, 14 cpus, 14 cores)  | ||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
| Sun Fire V20z<br/>  | | Sun Fire V20z<br/>  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2006-07-01<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
| Line 194: | Line 415: | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| AMD Opteron 250 K8   | | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
| 2   | | 2 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |  disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* <span style="color:grey"> eth0/enp2s2f0, Ethernet   | * <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br />  | ||
* eth1/enp2s2f1, Ethernet   | * eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/>  | ||
|-  | |-  | ||
|}  | |}  | ||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sirius%20only sirius] ==  | |||
'''1 node, 2 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sirius/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="replace">-t exotic</code> <code class="env">-p sirius</code> <code>-I</code>}}  | |||
{|  | {|  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''  | |||
| [[Exotic#Lyon:_sirius|exotic]] job type<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
|   | | NVidia DGX A100<br/>  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2021-11-24<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
|   | | 2021-11-18<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| AMD   | | AMD EPYC 7742 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
| 1   | | 1.0 TiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |    | ||
* disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />  | |||
* disk1, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk1</code>)  <br />  | |||
* disk2, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk2</code>)  <br />  | |||
* disk3, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk3</code>)  <br />  | |||
* disk4, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk4</code>)  <br />  | |||
* disk5, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk5</code>)  <br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* <span style="color:grey">   | * eth0/enp225s0f0np0, Ethernet, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br />  | ||
*   | * <span style="color:grey">eth1/enp226s0, Ethernet, model: Intel I210 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | ||
* <span style="color:grey">eth2/enp225s0f1np1, Ethernet, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib2, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib4, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib5, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib6, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />  | |||
* <span style="color:grey">ib7, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br/>  | |||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''  | |||
| 8 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/>  | |||
|-  | |-  | ||
|}  | |}  | ||
== taurus ==  | '''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Lyon:_sirius|exotic]]''' page for more information.<br/>  | ||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=taurus%20only taurus] ==  | |||
'''12 nodes, 24 cpus, 144 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json])  | |||
'''Reservation example:'''  | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p taurus</code> <code>-I</code>}}  | |||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
| Dell PowerEdge R720<br/>  | | Dell PowerEdge R720<br/>  | ||
|-  | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''  | |||
| 2012-07-16<br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
| Line 247: | Line 508: | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| Intel Xeon E5-2630 Sandy Bridge   | | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
| 32   | | 32 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |  disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* eth0/enp68s0f0, Ethernet   | * eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br />  | ||
* <span style="color:grey"> eth1/enp68s0f1, Ethernet   | * <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth2/eno1, Ethernet   | * <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth3/eno2, Ethernet   | * <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth4/eno3, Ethernet   | * <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />  | ||
* <span style="color:grey"> eth5/eno4, Ethernet   | * <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>  | ||
|-  | |-  | ||
|}''<small>Last generated from the   | |}''<small>Last generated from the Grid'5000 Reference API on 2025-06-12 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/ff45fc1aea commit ff45fc1aea])</small>''  | ||
Latest revision as of 15:37, 12 June 2025
See also: Network topology for Lyon
Summary
- 10 clusters
 - 69 nodes
 - 1798 CPU cores
 - 111 GPUs
 - 620864 GPUs cores
 - 11.74 TiB RAM
 - 42 SSDs and 56 HDDs on nodes (total: 109.39 TB)
 - 50.6 TFLOPS (excluding GPUs)
 
Clusters summary
| Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| # | Name | Cores | Architecture | |||||||||
| gemini | exotic job type | 2019-09-01 | 2019-06-12 | 2 | 2 | Intel Xeon E5-2698 v4 | 20 cores/CPU | x86_64 | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD* | 10 Gbps (SR‑IOV) | 8 x Nvidia Tesla V100 (32 GiB) | 
| hercule | 2012-10-02 | 2012-07-19 | 4 | 2 | Intel Xeon E5-2620 | 6 cores/CPU | x86_64 | 32 GiB | 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps (SR‑IOV) | ||
| hydra | exotic job type | 2024-02-15 | 2024-02-15 | 4 | 1 | NVIDIA/ARM Grace A02 CPU | 72 cores/CPU | aarch64 | 480 GiB | 960 GB SSD + 1.92 TB SSD | 10 Gbps (SR‑IOV) | Nvidia H200 (96 GiB) | 
| neowise | exotic job type | 2021-05-17 | 2021-05-17 | 10 | 1 | AMD EPYC 7642 | 48 cores/CPU | x86_64 | 512 GiB | 1.92 TB SSD | 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand | 8 x AMD MI50 (32 GiB) | 
| nova | 2016-12-01 | 2016-10-28 | 20 | 2 | Intel Xeon E5-2620 v4 | 8 cores/CPU | x86_64 | 64 GiB | 598 GB HDD | 10 Gbps (SR‑IOV) | ||
| orion | 2012-09-14 | 2012-07-16 | 3 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | ||
| pyxis | exotic job type | 2020-01-06 | 2019-11-07 | 4 | 2 | Cavium ThunderX2 99xx | 32 cores/CPU | aarch64 | 256 GiB | 250 GB SSD + 250 GB SSD | 10 Gbps (SR‑IOV) | |
| sagittaire | 2006-07-01 | 2006-07-01 | 9 | 2 | AMD Opteron 250 | 1 core/CPU | x86_64 | 2 GiB | 73 GB HDD | 1 Gbps | ||
| sirius | exotic job type | 2021-11-18 | 2021-11-24 | 1 | 2 | AMD EPYC 7742 | 64 cores/CPU | x86_64 | 1.0 TiB | 1.92 TB SSD + 1.92 TB SSD + 4 x 3.84 TB SSD | 100 Gbps | 8 x Nvidia A100 (40 GiB) | 
| taurus | 2012-09-14 | 2012-07-16 | 12 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | ||
*: disk is reservable
**: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the default queue
gemini
2 nodes, 4 cpus, 80 cores (json)
Reservation example:
| Access condition: | exotic job type | 
| Model: | Nvidia DGX-1 | 
| Manufacturing date: | 2019-06-12 | 
| Date of arrival: | 2019-09-01 | 
| CPU: | Intel Xeon E5-2698 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 20 cores/CPU | 
| Memory: | 512 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
| GPU: | 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB) Compute capability: 7.0  | 
Note: This cluster is defined as exotic. Please read the exotic page for more information.
hercule
4 nodes, 8 cpus, 48 cores (json)
Reservation example:
| Model: | Dell PowerEdge C6220 | 
| Manufacturing date: | 2012-07-19 | 
| Date of arrival: | 2012-10-02 | 
| CPU: | Intel Xeon E5-2620 (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU | 
| Memory: | 32 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
hydra
4 nodes, 4 cpus, 288 cores (json)
Reservation example:
| Access condition: | exotic job type | 
| Model: | NVIDIA Grace Hopper | 
| Manufacturing date: | 2024-02-15 | 
| Date of arrival: | 2024-02-15 | 
| CPU: | NVIDIA/ARM Grace A02  CPU (Grace), aarch64, 1 CPU/node, 72 cores/CPU | 
| Memory: | 480 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
| GPU: | Nvidia GH200 (96 GiB) Compute capability: 9.0  | 
Note: This cluster is defined as exotic. Please read the exotic page for more information.
neowise
10 nodes, 10 cpus, 480 cores (json)
Reservation example:
| Access condition: | exotic job type | 
| Model: | AMD-Penguin Computing | 
| Manufacturing date: | 2021-05-17 | 
| Date of arrival: | 2021-05-17 | 
| CPU: | AMD EPYC 7642 (Zen 2), x86_64, 1 CPU/node, 48 cores/CPU | 
| Memory: | 512 GiB | 
| Storage: | disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk0)  (primary disk) | 
| Network: | 
  | 
| GPU: | 8 x AMD Radeon Instinct MI50 32GB (32 GiB) | 
Note: This cluster is defined as exotic. Please read the exotic page for more information.
nova
20 nodes, 40 cpus, 320 cores (json)
Reservation example:
| Model: | Dell PowerEdge R430 | 
| Manufacturing date: | 2016-10-28 | 
| Date of arrival: | 2016-12-01 | 
| CPU: | Intel Xeon E5-2620 v4 (Broadwell), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU | 
| Memory: | 64 GiB | 
| Storage: | disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: /dev/disk0)  (primary disk) | 
| Network: | 
  | 
orion
3 nodes, 6 cpus, 36 cores (json)
Reservation example:
| Model: | Dell PowerEdge R720 | 
| Manufacturing date: | 2012-07-16 | 
| Date of arrival: | 2012-09-14 | 
| CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU | 
| Memory: | 32 GiB | 
| Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0)  (primary disk) | 
| Network: | 
  | 
| GPU: | Compute capability: 2.0 not supported by Grid'5000 default environments  | 
pyxis
4 nodes, 8 cpus, 256 cores (json)
Reservation example:
| Access condition: | exotic job type | 
| Model: | Gigabyte R181-T92-00 | 
| Manufacturing date: | 2019-11-07 | 
| Date of arrival: | 2020-01-06 | 
| CPU: | Cavium ThunderX2 99xx (Vulcan), aarch64, 2 CPUs/node, 32 cores/CPU | 
| Memory: | 256 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
Note: This cluster is defined as exotic. Please read the exotic page for more information.
sagittaire
9 nodes, 18 cpus, 18 cores, split as follows due to differences between nodes (json)
Reservation example:
- sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
 
| Model: | Sun Fire V20z | 
| Manufacturing date: | 2006-07-01 | 
| Date of arrival: | 2006-07-01 | 
| CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU | 
| Memory: | 2 GiB | 
| Storage: | disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: /dev/disk0)  (primary disk) | 
| Network: | 
  | 
- sagittaire-[3-5,
13-16] (7 nodes, 14 cpus, 14 cores)  
| Model: | Sun Fire V20z | 
| Manufacturing date: | 2006-07-01 | 
| Date of arrival: | 2006-07-01 | 
| CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU | 
| Memory: | 2 GiB | 
| Storage: | disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: /dev/disk0)  (primary disk) | 
| Network: | 
  | 
sirius
1 node, 2 cpus, 128 cores (json)
Reservation example:
| Access condition: | exotic job type | 
| Model: | NVidia DGX A100 | 
| Manufacturing date: | 2021-11-24 | 
| Date of arrival: | 2021-11-18 | 
| CPU: | AMD EPYC 7742 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU | 
| Memory: | 1.0 TiB | 
| Storage: | 
  | 
| Network: | 
  | 
| GPU: | 8 x Nvidia A100-SXM4-40GB (40 GiB) Compute capability: 8.0  | 
Note: This cluster is defined as exotic. Please read the exotic page for more information.
taurus
12 nodes, 24 cpus, 144 cores (json)
Reservation example:
| Model: | Dell PowerEdge R720 | 
| Manufacturing date: | 2012-07-16 | 
| Date of arrival: | 2012-09-14 | 
| CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU | 
| Memory: | 32 GiB | 
| Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0)  (primary disk) | 
| Network: | 
  | 
Last generated from the Grid'5000 Reference API on 2025-06-12 (commit ff45fc1aea)