Lille:Hardware: Difference between revisions
No edit summary |
No edit summary |
||
(34 intermediate revisions by 11 users not shown) | |||
Line 1: | Line 1: | ||
__NOTOC__ | __NOTOC__ | ||
__NOEDITSECTION__ | __NOEDITSECTION__ | ||
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div> | {{Portal|User}} | ||
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div> | |||
'''See also:''' [[Lille:Network|Network topology for Lille]] | |||
= Summary = | = Summary = | ||
''' | '''4 clusters, 39 nodes, 972 cores, 39.6 TFLOPS''' | ||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
!|Cluster | !|Cluster | ||
!| | !|Access Condition | ||
!|Date of arrival | !|Date of arrival | ||
!data-sort-type="number"|Nodes | !data-sort-type="number"|Nodes | ||
Line 18: | Line 20: | ||
!|Accelerators | !|Accelerators | ||
|- | |- | ||
|[[#chetemi|chetemi]]|| | |[[#chetemi|chetemi]]||||2016-12-01||15||2 x Intel Xeon E5-2630 v4||10 cores/CPU||256 GiB||data-sort-value="558"|[1-9,<wbr>11-15]: <b>1 x 300 GB HDD</b> + 1 x 300 GB HDD<br />10: <b>600 GB HDD</b> + 300 GB HDD||data-sort-value="20000"|2 x 10 Gbps (SR‑IOV) || | ||
|- | |- | ||
|[[#chifflet|chifflet]]|| | |[[#chiclet|chiclet]]||||2018-08-06||8||2 x AMD EPYC 7301||16 cores/CPU||128 GiB||data-sort-value="7899"|<b>480 GB SSD</b> + 2 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps || | ||
|- | |||
|[[#chifflet|chifflet]]||||2016-12-01||8||2 x Intel Xeon E5-2680 v4||14 cores/CPU||768 GiB||data-sort-value="8196"|<b>400 GB SSD</b> + 400 GB SSD[[Disk_reservation|*]] + 2 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="20000"|2 x 10 Gbps (SR‑IOV) ||2 x Nvidia GTX 1080 Ti | |||
|- | |||
|[[#chifflot|chifflot]]||||2018-08-01||8||2 x Intel Xeon Gold 6126||12 cores/CPU||192 GiB||data-sort-value="15798"|<b>480 GB SSD</b> + 480 GB SSD[[Disk_reservation|*]] + 4 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps ||[1-6]: 2 x Nvidia Tesla P100<br />[7-8]: 2 x Nvidia Tesla V100 | |||
|} | |} | ||
''*: disk is [[Disk_reservation|reservable]]'' | |||
= Clusters in default queue = | |||
= | == chetemi == | ||
== chetemi == | '''15 nodes, 30 cpus, 300 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chetemi/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | |||
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='chetemi'"</code> <code>-I</code>}} | |||
; chetemi-[1-9,<wbr>11-15] (14 nodes, 28 cpus, 280 cores) | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge R630<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2016-12-01<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon E5-2630 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 10 cores/CPU)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 256 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 300 GB HDD SAS Seagate ST300MP0005 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)<br /> | |||
* disk1, 300 GB HDD SAS Seagate ST300MP0005 (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) <br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | |||
* eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | |||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | |||
|- | |||
|} | |||
<hr style="height:10pt; visibility:hidden;" /> | |||
; chetemi-10 (1 node, 2 cpus, 20 cores) | |||
{| | {| | ||
|- | |- | ||
Line 38: | Line 80: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2630 v4 Broadwell | | Intel Xeon E5-2630 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 10 cores/CPU)<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 256 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 600 GB HDD SAS Seagate ST600MP0036 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)<br /> | |||
* disk1, 300 GB HDD SAS Seagate ST300MP0005 (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) <br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | |||
* eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | |||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | |||
|- | |||
|} | |||
== chiclet == | |||
'''8 nodes, 16 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chiclet/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='chiclet'"</code> <code>-I</code>}} | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge R7425<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2018-08-06<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| AMD EPYC 7301 (Zen, 2 CPUs/node, 16 cores/CPU)<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 128 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* | * disk0, 480 GB SSD SAS Toshiba PX05SVB048Y (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:0:0) (primary disk)<br /> | ||
* | * disk1, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | ||
* disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | |||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/enp98s0f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | ||
* <span style="color:grey"> | * eth1/enp98s0f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey"> | * <span style="color:grey">eth2/eno1, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* <span style="color:grey"> | * <span style="color:grey">eth3/eno2, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth4/eno3, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth5/eno4, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/> | |||
|- | |- | ||
|} | |} | ||
Line 60: | Line 142: | ||
'''8 nodes, 16 cpus, 224 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chifflet/nodes.json?pretty=1 json]) | '''8 nodes, 16 cpus, 224 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chifflet/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | |||
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='chifflet'"</code> <code>-I</code>}} | |||
{| | {| | ||
|- | |- | ||
Line 69: | Line 156: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2680 v4 Broadwell 2. | | Intel Xeon E5-2680 v4 (Broadwell, 2.40GHz, 2 CPUs/node, 14 cores/CPU)<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 768 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 400 GB SSD SAS Toshiba PX04SMB040 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)<br /> | |||
* disk1, 400 GB SSD SAS Toshiba PX04SMB040 (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk2, 4.0 TB HDD SATA Toshiba TOSHIBA MG04ACA4 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk3, 4.0 TB HDD SATA Toshiba TOSHIBA MG04ACA4 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br /> | |||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | |||
* eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | |||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| 2 x Nvidia GeForce GTX 1080 Ti<br/> | |||
|- | |||
|} | |||
== chifflot == | |||
'''8 nodes, 16 cpus, 192 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chifflot/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='chifflot'"</code> <code>-I</code>}} | |||
; chifflot-[1,<wbr>4-6] (4 nodes, 8 cpus, 96 cores) | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge R740<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2018-08-01<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 192 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)<br /> | |||
* disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/sdf*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) [[Disk_reservation|(reservable)]] <br /> | |||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
* eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | |||
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| 2 x Nvidia Tesla P100-PCIE-16GB<br/> | |||
|- | |||
|} | |||
<hr style="height:10pt; visibility:hidden;" /> | |||
; chifflot-2 (1 node, 2 cpus, 24 cores) | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge R740<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2018-08-01<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 192 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)<br /> | |||
* disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/sdf*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) [[Disk_reservation|(reservable)]] <br /> | |||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
* eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | |||
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| 2 x Nvidia Tesla P100-PCIE-16GB<br/> | |||
|- | |||
|} | |||
<hr style="height:10pt; visibility:hidden;" /> | |||
; chifflot-3 (1 node, 2 cpus, 24 cores) | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge R740<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2018-08-01<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 192 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| | |||
* disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)<br /> | |||
* disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk2, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk4, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk5, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/sdf*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) [[Disk_reservation|(reservable)]] <br /> | |||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
* eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | |||
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| 2 x Nvidia Tesla P100-PCIE-16GB<br/> | |||
|- | |||
|} | |||
<hr style="height:10pt; visibility:hidden;" /> | |||
; chifflot-[7-8] (2 nodes, 4 cpus, 48 cores) | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge R740<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2018-08-01<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU)<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 192 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* | * disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)<br /> | ||
* | * disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | ||
* | * disk2, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 3. | * disk3, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br /> | ||
* disk4, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) [[Disk_reservation|(reservable)]] <br /> | |||
* disk5, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/sdf*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) [[Disk_reservation|(reservable)]] <br /> | |||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | ||
* <span style="color:grey"> | * eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey"> | * <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey"> | * <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| 2 x Nvidia | | 2 x Nvidia Tesla V100-PCIE-32GB<br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on | |}''<small>Last generated from the Grid'5000 Reference API on 2021-08-31 ([https://github.com/grid5000/reference-repository/commit/a5c6e6cff2 commit a5c6e6cff2])</small>'' |
Revision as of 22:38, 31 August 2021
See also: Network topology for Lille
Summary
4 clusters, 39 nodes, 972 cores, 39.6 TFLOPS
Cluster | Access Condition | Date of arrival | Nodes | CPU | Cores | Memory | Storage | Network | Accelerators |
---|---|---|---|---|---|---|---|---|---|
chetemi | 2016-12-01 | 15 | 2 x Intel Xeon E5-2630 v4 | 10 cores/CPU | 256 GiB | [1-9, 10: 600 GB HDD + 300 GB HDD |
2 x 10 Gbps (SR‑IOV) | ||
chiclet | 2018-08-06 | 8 | 2 x AMD EPYC 7301 | 16 cores/CPU | 128 GiB | 480 GB SSD + 2 x 4.0 TB HDD* | 2 x 25 Gbps | ||
chifflet | 2016-12-01 | 8 | 2 x Intel Xeon E5-2680 v4 | 14 cores/CPU | 768 GiB | 400 GB SSD + 400 GB SSD* + 2 x 4.0 TB HDD* | 2 x 10 Gbps (SR‑IOV) | 2 x Nvidia GTX 1080 Ti | |
chifflot | 2018-08-01 | 8 | 2 x Intel Xeon Gold 6126 | 12 cores/CPU | 192 GiB | 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* | 2 x 25 Gbps | [1-6]: 2 x Nvidia Tesla P100 [7-8]: 2 x Nvidia Tesla V100 |
*: disk is reservable
Clusters in default queue
chetemi
15 nodes, 30 cpus, 300 cores, split as follows due to differences between nodes (json)
Reservation example:
- chetemi-[1-9,
11-15] (14 nodes, 28 cpus, 280 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2016-12-01 |
CPU: | Intel Xeon E5-2630 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 10 cores/CPU) |
Memory: | 256 GiB |
Storage: |
|
Network: |
|
- chetemi-10 (1 node, 2 cpus, 20 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2016-12-01 |
CPU: | Intel Xeon E5-2630 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 10 cores/CPU) |
Memory: | 256 GiB |
Storage: |
|
Network: |
|
chiclet
8 nodes, 16 cpus, 256 cores (json)
Reservation example:
Model: | Dell PowerEdge R7425 |
Date of arrival: | 2018-08-06 |
CPU: | AMD EPYC 7301 (Zen, 2 CPUs/node, 16 cores/CPU) |
Memory: | 128 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
chifflet
8 nodes, 16 cpus, 224 cores (json)
Reservation example:
Model: | Dell PowerEdge R730 |
Date of arrival: | 2016-12-01 |
CPU: | Intel Xeon E5-2680 v4 (Broadwell, 2.40GHz, 2 CPUs/node, 14 cores/CPU) |
Memory: | 768 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
GPU: | 2 x Nvidia GeForce GTX 1080 Ti |
chifflot
8 nodes, 16 cpus, 192 cores, split as follows due to differences between nodes (json)
Reservation example:
- chifflot-[1,
4-6] (4 nodes, 8 cpus, 96 cores)
Model: | Dell PowerEdge R740 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU) |
Memory: | 192 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
GPU: | 2 x Nvidia Tesla P100-PCIE-16GB |
- chifflot-2 (1 node, 2 cpus, 24 cores)
Model: | Dell PowerEdge R740 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU) |
Memory: | 192 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
GPU: | 2 x Nvidia Tesla P100-PCIE-16GB |
- chifflot-3 (1 node, 2 cpus, 24 cores)
Model: | Dell PowerEdge R740 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU) |
Memory: | 192 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
GPU: | 2 x Nvidia Tesla P100-PCIE-16GB |
- chifflot-[7-8] (2 nodes, 4 cpus, 48 cores)
Model: | Dell PowerEdge R740 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU) |
Memory: | 192 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
GPU: | 2 x Nvidia Tesla V100-PCIE-32GB |
Last generated from the Grid'5000 Reference API on 2021-08-31 (commit a5c6e6cff2)