Rennes:Hardware: Difference between revisions
Ddelabroye (talk | contribs) No edit summary |
No edit summary |
||
(25 intermediate revisions by 9 users not shown) | |||
Line 2: | Line 2: | ||
__NOEDITSECTION__ | __NOEDITSECTION__ | ||
{{Portal|User}} | {{Portal|User}} | ||
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div> | <div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div> | ||
'''See also:''' [[Rennes:Network|Network topology for Rennes]] | |||
= Summary = | = Summary = | ||
'''5 clusters, | '''5 clusters, 140 nodes, 2264 cores, 67.9 TFLOPS''' | ||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
!|Cluster | !|Cluster | ||
!| | !|Access Condition | ||
!|Date of arrival | !|Date of arrival | ||
!data-sort-type="number"|Nodes | !data-sort-type="number"|Nodes | ||
Line 18: | Line 19: | ||
!data-sort-type="number"|Network | !data-sort-type="number"|Network | ||
|- | |- | ||
|[[#paranoia|paranoia]]|| | |[[#paranoia|paranoia]]||||2014-02-21||8||2 x Intel Xeon E5-2660 v2||10 cores/CPU||128 GiB||data-sort-value="2790"|<b>1 x 600 GB HDD</b> + 4 x 600 GB HDD||data-sort-value="21000"|1 Gbps (SR‑IOV) + 2 x 10 Gbps (SR‑IOV) | ||
|- | |- | ||
|[[#parapide|parapide]]|| | |[[#parapide|parapide]]||||2010-01-25||17||2 x Intel Xeon X5570||4 cores/CPU||24 GiB||data-sort-value="465"|<b>500 GB HDD</b>||data-sort-value="21000"|1 Gbps + 20 Gbps InfiniBand | ||
|- | |- | ||
|[[#parapluie|parapluie]]|| | |[[#parapluie|parapluie]]||||2010-11-02||16||2 x AMD Opteron 6164 HE||12 cores/CPU||48 GiB||data-sort-value="232"|<b>250 GB HDD</b>||data-sort-value="21000"|1 Gbps + 20 Gbps InfiniBand | ||
|- | |- | ||
|[[#parasilo|parasilo]]|| | |[[#parasilo|parasilo]]||||2015-01-13||27||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="2976"|<b>600 GB HDD</b> + 4 x 600 GB HDD[[Disk_reservation|*]] + 200 GB SSD[[Disk_reservation|*]]||data-sort-value="20000"|2 x 10 Gbps (SR‑IOV) | ||
|- | |- | ||
|[[#paravance|paravance]]|| | |[[#paravance|paravance]]||||2015-01-13||72||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="20000"|2 x 10 Gbps (SR‑IOV) | ||
|} | |} | ||
''*: disk is [[Disk_reservation|reservable]]'' | |||
= | = Clusters in default queue = | ||
== paranoia == | == paranoia == | ||
'''8 nodes, 16 cpus, 160 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/rennes/clusters/paranoia/nodes.json?pretty=1 json]) | '''8 nodes, 16 cpus, 160 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/rennes/clusters/paranoia/nodes.json?pretty=1 json]) | ||
; paranoia-[2,<wbr>5- | '''Reservation example:''' | ||
{{Term|location=frennes|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='paranoia'"</code> <code>-I</code>}} | |||
; paranoia-[1-2,<wbr>5-6,<wbr>8] (5 nodes, 10 cpus, 100 cores) | |||
{| | {| | ||
|- | |- | ||
Line 85: | Line 58: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 600 GB HDD | * disk0, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy0-lun-0) (primary disk)<br /> | ||
* 600 GB HDD | * disk1, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy1-lun-0) <br /> | ||
* 600 GB HDD | * disk2, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdc, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy2-lun-0) <br /> | ||
* 600 GB HDD | * disk3, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdd, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy3-lun-0) <br /> | ||
* 600 GB HDD | * disk4, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sde, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy4-lun-0) <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb<br /> | * eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
Line 118: | Line 91: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 600 GB HDD | * disk0, 600 GB HDD SAS Western Digital WD6002BKTG (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy0-lun-0) (primary disk)<br /> | ||
* 600 GB HDD | * disk1, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy1-lun-0) <br /> | ||
* 600 GB HDD | * disk2, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdc, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy2-lun-0) <br /> | ||
* 600 GB HDD | * disk3, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdd, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy3-lun-0) <br /> | ||
* 600 GB HDD | * disk4, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sde, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy4-lun-0) <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb<br /> | * eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
Line 151: | Line 124: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 600 GB HDD | * disk0, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy0-lun-0) (primary disk)<br /> | ||
* 600 GB HDD | * disk1, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy1-lun-0) <br /> | ||
* 600 GB HDD | * disk2, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdc, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy2-lun-0) <br /> | ||
* 600 GB HDD | * disk3, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdd, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy3-lun-0) <br /> | ||
* 600 GB HDD | * disk4, 600 GB HDD SAS Western Digital WD6002BKTG (dev: /dev/sde, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy4-lun-0) <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb<br /> | * eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
Line 167: | Line 140: | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
; paranoia- | ; paranoia-7 (1 node, 2 cpus, 20 cores) | ||
{| | {| | ||
|- | |- | ||
Line 184: | Line 157: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 600 GB HDD | * disk0, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy0-lun-0) (primary disk)<br /> | ||
* 600 GB HDD | * disk1, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy1-lun-0) <br /> | ||
* 600 GB HDD | * disk2, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdc, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy2-lun-0) <br /> | ||
* 600 GB HDD | * disk3, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sdd, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy4-lun-0) <br /> | ||
* 600 GB HDD | * disk4, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/sde, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy3-lun-0) <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb<br /> | * eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
Line 201: | Line 174: | ||
== parapide == | == parapide == | ||
''' | '''17 nodes, 34 cpus, 136 cores''' ([https://public-api.grid5000.fr/stable/sites/rennes/clusters/parapide/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | |||
{{Term|location=frennes|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='parapide'"</code> <code>-I</code>}} | |||
{| | {| | ||
|- | |- | ||
Line 217: | Line 195: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| 500 GB HDD SATA Hitachi HITACHI HUA7250S | | disk0, 500 GB HDD SATA Hitachi HITACHI HUA7250S (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 230: | Line 208: | ||
== parapluie == | == parapluie == | ||
''' | '''16 nodes, 32 cpus, 384 cores''' ([https://public-api.grid5000.fr/stable/sites/rennes/clusters/parapluie/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | |||
{{Term|location=frennes|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='parapluie'"</code> <code>-I</code>}} | |||
{| | {| | ||
|- | |- | ||
Line 246: | Line 229: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| 250 GB HDD SATA HP VB0250EAVER | | disk0, 250 GB HDD SATA HP VB0250EAVER (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:11.0-ata-1) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
Line 261: | Line 244: | ||
== parasilo == | == parasilo == | ||
''' | '''27 nodes, 54 cpus, 432 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/rennes/clusters/parasilo/nodes.json?pretty=1 json]) | ||
; parasilo-[1-5,<wbr>7-12,<wbr>14-24,<wbr>26-28] ( | |||
'''Reservation example:''' | |||
{{Term|location=frennes|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='parasilo'"</code> <code>-I</code>}} | |||
; parasilo-[1-5,<wbr>7-12,<wbr>14-15,<wbr>17-24,<wbr>26-28] (24 nodes, 48 cpus, 384 cores) | |||
{| | {| | ||
|- | |- | ||
Line 279: | Line 267: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 600 GB HDD | * disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)<br /> | ||
* 600 GB HDD | * disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk2, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk3, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk4, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 200 GB SSD | * disk5, 200 GB SSD SAS Toshiba PX02SSF020 (dev: /dev/sdf*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:5:0) [[Disk_reservation|(reservable)]] <br /> | ||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
Line 313: | Line 302: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 600 GB HDD | * disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)<br /> | ||
* 600 GB HDD | * disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk2, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk3, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk4, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 200 GB SSD | * disk5, 200 GB SSD SAS Toshiba PX04SHB020 (dev: /dev/sdf*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:5:0) [[Disk_reservation|(reservable)]] <br /> | ||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
Line 347: | Line 337: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 600 GB HDD | * disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)<br /> | ||
* 600 GB HDD | * disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk2, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk3, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk4, 600 GB HDD SAS Toshiba AL15SEB060NY (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 200 GB SSD | * disk5, 200 GB SSD SAS Toshiba PX02SSF020 (dev: /dev/sdf*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:5:0) [[Disk_reservation|(reservable)]] <br /> | ||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
Line 381: | Line 372: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 600 GB HDD | * disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)<br /> | ||
* 600 GB HDD | * disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk2, 600 GB HDD SAS Seagate ST600MP0005 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk3, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 600 GB HDD | * disk4, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0) [[Disk_reservation|(reservable)]] <br /> | ||
* 200 GB SSD | * disk5, 200 GB SSD SAS Toshiba PX02SSF020 (dev: /dev/sdf*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:5:0) [[Disk_reservation|(reservable)]] <br /> | ||
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
Line 400: | Line 392: | ||
'''72 nodes, 144 cpus, 1152 cores''' ([https://public-api.grid5000.fr/stable/sites/rennes/clusters/paravance/nodes.json?pretty=1 json]) | '''72 nodes, 144 cpus, 1152 cores''' ([https://public-api.grid5000.fr/stable/sites/rennes/clusters/paravance/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | |||
{{Term|location=frennes|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='paravance'"</code> <code>-I</code>}} | |||
{| | {| | ||
|- | |- | ||
Line 416: | Line 413: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* 600 GB HDD | * disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)<br /> | ||
* 600 GB HDD | * disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> | ||
* eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | * eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | ||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on | |}''<small>Last generated from the Grid'5000 Reference API on 2021-08-31 ([https://github.com/grid5000/reference-repository/commit/a5c6e6cff2 commit a5c6e6cff2])</small>'' |
Revision as of 22:38, 31 August 2021
See also: Network topology for Rennes
Summary
5 clusters, 140 nodes, 2264 cores, 67.9 TFLOPS
Cluster | Access Condition | Date of arrival | Nodes | CPU | Cores | Memory | Storage | Network |
---|---|---|---|---|---|---|---|---|
paranoia | 2014-02-21 | 8 | 2 x Intel Xeon E5-2660 v2 | 10 cores/CPU | 128 GiB | 1 x 600 GB HDD + 4 x 600 GB HDD | 1 Gbps (SR‑IOV) + 2 x 10 Gbps (SR‑IOV) | |
parapide | 2010-01-25 | 17 | 2 x Intel Xeon X5570 | 4 cores/CPU | 24 GiB | 500 GB HDD | 1 Gbps + 20 Gbps InfiniBand | |
parapluie | 2010-11-02 | 16 | 2 x AMD Opteron 6164 HE | 12 cores/CPU | 48 GiB | 250 GB HDD | 1 Gbps + 20 Gbps InfiniBand | |
parasilo | 2015-01-13 | 27 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* | 2 x 10 Gbps (SR‑IOV) | |
paravance | 2015-01-13 | 72 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 1 x 600 GB HDD + 1 x 600 GB HDD | 2 x 10 Gbps (SR‑IOV) |
*: disk is reservable
Clusters in default queue
paranoia
8 nodes, 16 cpus, 160 cores, split as follows due to differences between nodes (json)
Reservation example:
- paranoia-[1-2,
5-6, 8] (5 nodes, 10 cpus, 100 cores)
Model: | Dell PowerEdge C6220 II |
Date of arrival: | 2014-02-21 |
CPU: | Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- paranoia-3 (1 node, 2 cpus, 20 cores)
Model: | Dell PowerEdge C6220 II |
Date of arrival: | 2014-02-21 |
CPU: | Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- paranoia-4 (1 node, 2 cpus, 20 cores)
Model: | Dell PowerEdge C6220 II |
Date of arrival: | 2014-02-21 |
CPU: | Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- paranoia-7 (1 node, 2 cpus, 20 cores)
Model: | Dell PowerEdge C6220 II |
Date of arrival: | 2014-02-21 |
CPU: | Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
parapide
17 nodes, 34 cpus, 136 cores (json)
Reservation example:
Model: | SUN FIRE X2270 |
Date of arrival: | 2010-01-25 |
CPU: | Intel Xeon X5570 (Nehalem, 2.93GHz, 2 CPUs/node, 4 cores/CPU) |
Memory: | 24 GiB |
Storage: | disk0, 500 GB HDD SATA Hitachi HITACHI HUA7250S (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1) (primary disk) |
Network: |
|
parapluie
16 nodes, 32 cpus, 384 cores (json)
Reservation example:
Model: | HP ProLiant DL165 G7 |
Date of arrival: | 2010-11-02 |
CPU: | AMD Opteron 6164 HE (K10, 2 CPUs/node, 12 cores/CPU) |
Memory: | 48 GiB |
Storage: | disk0, 250 GB HDD SATA HP VB0250EAVER (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:11.0-ata-1) (primary disk) |
Network: |
|
parasilo
27 nodes, 54 cpus, 432 cores, split as follows due to differences between nodes (json)
Reservation example:
- parasilo-[1-5,
7-12, 14-15, 17-24, 26-28] (24 nodes, 48 cpus, 384 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
- parasilo-6 (1 node, 2 cpus, 16 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
- parasilo-13 (1 node, 2 cpus, 16 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
- parasilo-25 (1 node, 2 cpus, 16 cores)
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier |
Network: |
|
paravance
72 nodes, 144 cpus, 1152 cores (json)
Reservation example:
Model: | Dell PowerEdge R630 |
Date of arrival: | 2015-01-13 |
CPU: | Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU) |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
Last generated from the Grid'5000 Reference API on 2021-08-31 (commit a5c6e6cff2)