Lille:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
 
(13 intermediate revisions by 5 users not shown)
Line 1: Line 1:
__NOTOC__
__NOEDITSECTION__
__NOEDITSECTION__
{{Portal|User}}
{{Portal|User}}
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Toulouse:Hardware|Toulouse]]</div>
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Strasbourg:Hardware|Strasbourg]] | [[Toulouse:Hardware|Toulouse]]</div>
'''See also:''' [[Lille:Network|Network topology for Lille]]
'''See also:''' [[Lille:Network|Network topology for Lille]]
= Summary =
= Summary =
* 2 clusters
* 4 clusters
* 16 nodes
* 29 nodes
* 448 CPU cores
* 1024 CPU cores
* 16 GPUs
* 48 GPUs
* 63488 GPUs cores
* 284672 GPUs cores
* 2.5&nbsp;TiB RAM
* 9.0&nbsp;TiB RAM
* 24 SSDs and 48 HDDs on nodes (total: 203.56&nbsp;TB)
* 71 SSDs and 47 HDDs on nodes (total: 309.02&nbsp;TB)
* 20.5 TFLOPS (excluding GPUs)
* 57.8 TFLOPS (excluding GPUs)


= Clusters =
= Clusters summary =
== Default queue resources ==
{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
Line 34: Line 34:
|-
|-


|[[#chiclet|chiclet]]||||2018-08-06||2018-07-27||8||2||AMD EPYC 7301||16&nbsp;cores/CPU||x86_64||128&nbsp;GiB||data-sort-value="7899"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;2&nbsp;x&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||
|[[#chiclet|chiclet]]||||2018-08-06||2018-07-27||8||2||AMD EPYC 7301||16&nbsp;cores/CPU||x86_64||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="7899"|[1-7]: <b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;2&nbsp;x&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]<br />8: <b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||
|-
|-
|[[#chifflot|chifflot]]||||2018-08-01||2018-07-17||8||2||Intel Xeon Gold 6126||12&nbsp;cores/CPU||x86_64||192&nbsp;GiB||data-sort-value="15798"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;480&nbsp;GB&nbsp;SSD[[Disk_reservation|*]] +&nbsp;4&nbsp;x&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||[1-6]: 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;P100&nbsp;(16&nbsp;GiB)<br />[7-8]: 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100&nbsp;(32&nbsp;GiB)
|[[#chifflot|chifflot]]||||2018-08-01||2018-07-17||8||2||Intel Xeon Gold 6126||12&nbsp;cores/CPU||x86_64||data-sort-value="206158430208"|192&nbsp;GiB||data-sort-value="15798"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;480&nbsp;GB&nbsp;SSD[[Disk_reservation|*]] +&nbsp;4&nbsp;x&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||[1-6]: 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;P100&nbsp;(16&nbsp;GiB)<br />[7-8]: 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100&nbsp;(32&nbsp;GiB)
|-
|-
|}
|}
''*: disk is [[Disk_reservation|reservable]]''
''*: disk is [[Disk_reservation|reservable]]''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''**: crossed GPUs are not supported by Grid'5000 default environments''
== Testing queue resources ==
{|class="wikitable sortable"
|-
!rowspan=2|Cluster
!rowspan=2|Access Condition
!rowspan=2|Date of arrival
!rowspan=2|Manufacturing date
!data-sort-type="number" rowspan=2|Nodes
!colspan=4|CPU
!data-sort-type="number" rowspan=2|Memory
!data-sort-type="number" rowspan=2|Storage
!data-sort-type="number" rowspan=2|Network
!rowspan=2|Accelerators
|-
!data-sort-type="number"|#
!|Name
!data-sort-type="number"|Cores
!|Architecture
|-
 
|[[#chirop|chirop]]||<b>testing</b>&nbsp;queue||2024-01-25||2023-05-02||5||2||Intel Xeon Platinum 8358||32&nbsp;cores/CPU||x86_64||data-sort-value="549755813888"|512&nbsp;GiB||data-sort-value="8940"|<b>1.92&nbsp;TB&nbsp;SSD</b> +&nbsp;2&nbsp;x&nbsp;3.84&nbsp;TB&nbsp;SSD||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||
|-
|[[#chuc|chuc]]||<b>testing</b>&nbsp;queue||2024-01-22||2023-05-02||8||1||AMD EPYC 7513||32&nbsp;cores/CPU||x86_64||data-sort-value="549755813888"|512&nbsp;GiB||data-sort-value="7152"|<b>1.92&nbsp;TB&nbsp;SSD</b> +&nbsp;3&nbsp;x&nbsp;1.92&nbsp;TB&nbsp;SSD||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||4&nbsp;x&nbsp;Nvidia A100&nbsp;(40&nbsp;GiB)
|-
|}
''*: disk is [[Disk_reservation|reservable]]''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;''**: crossed GPUs are not supported by Grid'5000 default environments''


''**: crossed GPUs are not supported by Grid'5000 default environments''
= Clusters in the [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/ default queue] =
= Clusters in the [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/ default queue] =


== [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chiclet%20only chiclet] ==
== [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chiclet%20only chiclet] ==


'''8 nodes, 16 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chiclet/nodes.json?pretty=1 json])
'''8 nodes, 16 cpus, 256 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chiclet/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''
Line 52: Line 77:
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="env">-p chiclet</code> <code>-I</code>}}
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="env">-p chiclet</code> <code>-I</code>}}


; chiclet-[1-7] (7 nodes, 14 cpus, 224 cores)
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Dell PowerEdge R7425<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2018-07-27<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2018-08-06<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD EPYC 7301 (Zen), x86_64, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 128&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* disk0, 480&nbsp;GB SSD SAS Toshiba PX05SVB048Y (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/enp98s0f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth1/enp98s0f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
|-
|}
<hr style="height:10pt; visibility:hidden;" />
; chiclet-8 (1 node, 2 cpus, 32 cores)
{|
{|
|-
|-
Line 71: Line 129:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SAS Toshiba PX05SVB048Y (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SAS Toshiba PX05SVB048Y (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk1, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
* disk2, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp98s0f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth0/enp98s0f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth1/enp98s0f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br />
* eth1/enp98s0f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
* <span style="color:grey">eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/>
|-
|-
|}
|}
Line 107: Line 160:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
| Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 114: Line 167:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk5, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0</code>) [[Disk_reservation|(reservable)]] <br/>
* disk5, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
Line 149: Line 198:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
| Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 156: Line 205:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk5, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0</code>) [[Disk_reservation|(reservable)]] <br/>
* disk5, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
Line 191: Line 236:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
| Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 198: Line 243:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk5, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0</code>) [[Disk_reservation|(reservable)]] <br/>
* disk5, 4.0&nbsp;TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
Line 233: Line 274:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
| Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 240: Line 281:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk5, 4.0&nbsp;TB HDD SAS Toshiba MG08SDA400NY (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0</code>) [[Disk_reservation|(reservable)]] <br/>
* disk5, 4.0&nbsp;TB HDD SAS Toshiba MG08SDA400NY (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
Line 275: Line 312:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
| Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 12&nbsp;cores/CPU<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
Line 282: Line 319:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0</code>)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk1, 480&nbsp;GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk2, 4.0&nbsp;TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk3, 4.0&nbsp;TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0</code>) [[Disk_reservation|(reservable)]] <br />
* disk4, 4.0&nbsp;TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br />
* disk5, 4.0&nbsp;TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0</code>) [[Disk_reservation|(reservable)]] <br/>
* disk5, 4.0&nbsp;TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth0/ens5f0, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br />
* eth1/ens5f1, Ethernet, configured rate: 25&nbsp;Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100-PCIE-32GB&nbsp;(32&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;7.0<br/>
| 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100-PCIE-32GB&nbsp;(32&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;7.0<br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2024-01-19 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/136b27c1df commit 136b27c1df])</small>''
|}
 
= Clusters in the testing queue =
 
== [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chirop%20only chirop] ==
 
'''5 nodes, 10 cpus, 320 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chirop/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p chirop</code> <code>-I</code>}}
 
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| testing queue<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| DL360 Gen10+<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2023-05-02<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2024-01-25<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Platinum 8358 (Ice Lake-SP), x86_64, 2.60GHz, 2&nbsp;CPUs/node, 32&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 512&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* disk0, 1.92&nbsp;TB SSD NVME Kioxia KCD6XLUL1T92 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 3.84&nbsp;TB SSD SATA HP VK003840GWSRV (dev: <code class="file">/dev/disk1</code>)  <br />
* disk2, 3.84&nbsp;TB SSD SATA HP VK003840GWSRV (dev: <code class="file">/dev/disk2</code>)  <br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/ens10f0np0, Ethernet, configured rate: 25&nbsp;Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en<br />
* eth1/ens10f1np1, Ethernet, configured rate: 25&nbsp;Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
|-
|}
 
== [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chuc%20only chuc] ==
 
'''8 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chuc/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p chuc</code> <code>-I</code>}}
 
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| testing queue<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Apollo 6500 Gen10 Plus<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2023-05-02<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2024-01-22<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD EPYC 7513 (Zen 3), x86_64, 1&nbsp;CPU/node, 32&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 512&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|
* disk0, 1.92&nbsp;TB SSD SAS HPE VO001920RZWUV (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br />
* disk1, 1.92&nbsp;TB SSD SAS HPE VO001920RZWUV (dev: <code class="file">/dev/disk1</code>)  <br />
* disk2, 1.92&nbsp;TB SSD SAS HPE VO001920RZWUV (dev: <code class="file">/dev/disk2</code>)  <br />
* disk3, 1.92&nbsp;TB SSD SAS HPE VO001920RZWUV (dev: <code class="file">/dev/disk3</code>)  <br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/ens15f0np0, Ethernet, configured rate: 25&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled<br />
* eth1/ens15f1np1, Ethernet, configured rate: 25&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 4&nbsp;x&nbsp;Nvidia A100-SXM4-40GB&nbsp;(40&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;8.0<br/>
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2024-10-31 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/e6c135ba47 commit e6c135ba47])</small>''

Latest revision as of 15:51, 31 October 2024

Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse

See also: Network topology for Lille

Summary

  • 4 clusters
  • 29 nodes
  • 1024 CPU cores
  • 48 GPUs
  • 284672 GPUs cores
  • 9.0 TiB RAM
  • 71 SSDs and 47 HDDs on nodes (total: 309.02 TB)
  • 57.8 TFLOPS (excluding GPUs)

Clusters summary

Default queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
chiclet 2018-08-06 2018-07-27 8 2 AMD EPYC 7301 16 cores/CPU x86_64 128 GiB [1-7]: 480 GB SSD + 2 x 4.0 TB HDD*
8: 480 GB SSD + 4.0 TB HDD*		 2 x 25 Gbps 
chifflot 2018-08-01 2018-07-17 8 2 Intel Xeon Gold 6126 12 cores/CPU x86_64 192 GiB 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* 2 x 25 Gbps  [1-6]: 2 x Nvidia Tesla P100 (16 GiB)
[7-8]: 2 x Nvidia Tesla V100 (32 GiB)

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments

Testing queue resources

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
chirop testing queue 2024-01-25 2023-05-02 5 2 Intel Xeon Platinum 8358 32 cores/CPU x86_64 512 GiB 1.92 TB SSD + 2 x 3.84 TB SSD 2 x 25 Gbps 
chuc testing queue 2024-01-22 2023-05-02 8 1 AMD EPYC 7513 32 cores/CPU x86_64 512 GiB 1.92 TB SSD + 3 x 1.92 TB SSD 2 x 25 Gbps (SR‑IOV)  4 x Nvidia A100 (40 GiB)

*: disk is reservable      **: crossed GPUs are not supported by Grid'5000 default environments

Clusters in the default queue

chiclet

8 nodes, 16 cpus, 256 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png flille:
oarsub -p chiclet -I
chiclet-[1-7] (7 nodes, 14 cpus, 224 cores)
Model: Dell PowerEdge R7425
Manufacturing date: 2018-07-27
Date of arrival: 2018-08-06
CPU: AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 480 GB SSD SAS Toshiba PX05SVB048Y (dev: /dev/disk0) (primary disk)
  • disk1, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*) (reservable)
Network:
  • eth0/enp98s0f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/enp98s0f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
chiclet-8 (1 node, 2 cpus, 32 cores)
Model: Dell PowerEdge R7425
Manufacturing date: 2018-07-27
Date of arrival: 2018-08-06
CPU: AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 480 GB SSD SAS Toshiba PX05SVB048Y (dev: /dev/disk0) (primary disk)
  • disk1, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk1*) (reservable)
Network:
  • eth0/enp98s0f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/enp98s0f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)

chifflot

8 nodes, 16 cpus, 192 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png flille:
oarsub -p chifflot -I
chifflot-[1,4-5] (3 nodes, 6 cpus, 72 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-2 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-3 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-6 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Toshiba MG08SDA400NY (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-[7-8] (2 nodes, 4 cpus, 48 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
GPU: 2 x Nvidia Tesla V100-PCIE-32GB (32 GiB)
Compute capability: 7.0

Clusters in the testing queue

chirop

5 nodes, 10 cpus, 320 cores (json)

Reservation example:

Terminal.png flille:
oarsub -q testing -p chirop -I
Access condition: testing queue
Model: DL360 Gen10+
Manufacturing date: 2023-05-02
Date of arrival: 2024-01-25
CPU: Intel Xeon Platinum 8358 (Ice Lake-SP), x86_64, 2.60GHz, 2 CPUs/node, 32 cores/CPU
Memory: 512 GiB
Storage:
  • disk0, 1.92 TB SSD NVME Kioxia KCD6XLUL1T92 (dev: /dev/disk0) (primary disk)
  • disk1, 3.84 TB SSD SATA HP VK003840GWSRV (dev: /dev/disk1)
  • disk2, 3.84 TB SSD SATA HP VK003840GWSRV (dev: /dev/disk2)
Network:
  • eth0/ens10f0np0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en
  • eth1/ens10f1np1, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en (multi NICs example)

chuc

8 nodes, 8 cpus, 256 cores (json)

Reservation example:

Terminal.png flille:
oarsub -q testing -p chuc -I
Access condition: testing queue
Model: Apollo 6500 Gen10 Plus
Manufacturing date: 2023-05-02
Date of arrival: 2024-01-22
CPU: AMD EPYC 7513 (Zen 3), x86_64, 1 CPU/node, 32 cores/CPU
Memory: 512 GiB
Storage:
  • disk0, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: /dev/disk0) (primary disk)
  • disk1, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: /dev/disk1)
  • disk2, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: /dev/disk2)
  • disk3, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: /dev/disk3)
Network:
  • eth0/ens15f0np0, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled
  • eth1/ens15f1np1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled (multi NICs example)
GPU: 4 x Nvidia A100-SXM4-40GB (40 GiB)
Compute capability: 8.0

Last generated from the Grid'5000 Reference API on 2024-10-31 (commit e6c135ba47)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Lille:Hardware&oldid=104061"