Grenoble:Hardware: Difference between revisions
		
		
		
		
		
		Jump to navigation
		Jump to search
		
				
		
		
	
No edit summary  | 
				No edit summary  | 
				||
| (43 intermediate revisions by 12 users not shown) | |||
| Line 1: | Line 1: | ||
__NOTOC__  | __NOTOC__  | ||
__NOEDITSECTION__  | __NOEDITSECTION__  | ||
{{Portal|User}}  | |||
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>  | <div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>  | ||
= Summary =  | = Summary =  | ||
'''3 clusters, 40 nodes, 1408 cores, 19.0 TFLOPS'''  | |||
{|class="wikitable sortable"  | {|class="wikitable sortable"  | ||
|-  | |-  | ||
!|Cluster  | !|Cluster  | ||
!|  | !|Access Condition  | ||
!|Date of arrival  | !|Date of arrival  | ||
!data-sort-type="number"|Nodes  | !data-sort-type="number"|Nodes  | ||
| Line 16: | Line 18: | ||
!data-sort-type="number"|Network  | !data-sort-type="number"|Network  | ||
|-  | |-  | ||
|[[#  | |[[#dahu|dahu]]||||2018-03-22||32||2 x Intel Xeon Gold 6130||16 cores/CPU||192 GiB||data-sort-value="4396"|<b>240 GB SSD</b> + 480 GB SSD + 4.0 TB HDD||data-sort-value="110000"|10 Gbps + 100 Gbps Omni-Path  | ||
|-  | |-  | ||
|[[#  | |[[#troll|troll]]||||2019-12-23||4||2 x Intel Xeon Gold 5218||16 cores/CPU||384 GiB + 1.5 TiB PMEM||data-sort-value="1937"|<b>480 GB SSD</b> + 1.6 TB SSD||data-sort-value="110000"|10 Gbps + 100 Gbps Omni-Path  | ||
|-  | |||
|[[#yeti|yeti]]||||2018-01-16||4||4 x Intel Xeon Gold 6130||16 cores/CPU||768 GiB||data-sort-value="7526"|<b>480 GB SSD</b> + 3 x 2.0 TB HDD + 1.6 TB SSD||data-sort-value="110000"|10 Gbps + 100 Gbps Omni-Path  | |||
|}  | |}  | ||
| Line 24: | Line 28: | ||
= Cluster details =  | = Cluster details =  | ||
==   | == dahu ==  | ||
'''  | '''32 nodes, 64 cpus, 1024 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/dahu/nodes.json?pretty=1 json])  | ||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
|   | | Dell PowerEdge C6420<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
|   | | 2018-03-22<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| Intel Xeon   | | Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2 CPUs/node, 16 cores/CPU)<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
|   | | 192 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |    | ||
* 240 GB SSD SATA Samsung MZ7KM240HMHQ0D3  (path: /dev/disk/by-path/pci-0000:00:11.5-ata-3)  (primary disk)<br />  | |||
* 480 GB SSD SATA Samsung MZ7KM480HMHQ0D3  (path: /dev/disk/by-path/pci-0000:00:11.5-ata-4)  <br />  | |||
* 4.0 TB HDD SATA Seagate ST4000NM0265-2DC  (path: /dev/disk/by-path/pci-0000:00:11.5-ata-5)  <br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* eth0/  | * eth0/enp24s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />  | ||
* <span style="color:grey"> eth1/  | * <span style="color:grey">eth1/enp24s0f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />  | ||
* ib0,   | * ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>  | ||
|-  | |-  | ||
|}  | |}  | ||
== troll ==  | |||
'''4 nodes, 8 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/troll/nodes.json?pretty=1 json])  | |||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
|   | | Dell PowerEdge R640<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
|   | | 2019-12-23<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| Intel Xeon   | | Intel Xeon Gold 5218 (Cascade Lake-SP, 2.30GHz, 2 CPUs/node, 16 cores/CPU)<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
|   | | 384 GiB + 1.5 TiB PMEM<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|   | |    | ||
* 480 GB SSD SATA Micron MTFDDAK480TDN  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0)  (primary disk)<br />  | |||
* 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC  (path: /dev/disk/by-path/pci-0000:d8:00.0-nvme-1)  <br/>  | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* eth0/  | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core<br />  | ||
* <span style="color:grey"> eth1/  | * <span style="color:grey">eth1/eno2, Ethernet, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core - unavailable for experiment</span><br />  | ||
* ib0,   | * ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>  | ||
|-  | |-  | ||
|}  | |}  | ||
;   | == yeti ==  | ||
'''4 nodes, 16 cpus, 256 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/grenoble/clusters/yeti/nodes.json?pretty=1 json])  | |||
; yeti-[1-2,<wbr>4] (3 nodes, 12 cpus, 192 cores)  | |||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
|   | | Dell PowerEdge R940<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
|   | | 2018-01-16<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| Intel Xeon   | | Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4 CPUs/node, 16 cores/CPU)<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
|   | | 768 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |    | ||
*   | * 480 GB SSD SAS Intel SSDSC2KG480G7R  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0)  (primary disk)<br />  | ||
* 2.0 TB HDD SAS Seagate ST2000NX0463  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br />  | |||
*   | * 2.0 TB HDD SAS Seagate ST2000NX0463  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br />  | ||
* 2.0 TB HDD SAS Seagate ST2000NX0463  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br />  | |||
* 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC  (path: /dev/disk/by-path/pci-0000:6d:00.0-nvme-1)  <br/>  | |||
|   | |||
|   | |||
|   | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* eth0, Ethernet   | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />  | ||
* <span style="color:grey"> eth1, Ethernet   | * <span style="color:grey">eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />  | ||
*   | * <span style="color:grey">eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />  | ||
* <span style="color:grey">   | * <span style="color:grey">eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />  | ||
* ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>  | |||
|-  | |-  | ||
|}  | |}  | ||
<hr style="height:10pt; visibility:hidden;" />  | <hr style="height:10pt; visibility:hidden;" />  | ||
;   | ; yeti-3 (1 node, 4 cpus, 64 cores)  | ||
{|  | {|  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''  | ||
|   | | Dell PowerEdge R940<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''  | ||
|   | | 2018-01-16<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''  | ||
| Intel Xeon   | | Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4 CPUs/node, 16 cores/CPU)<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''  | ||
|   | | 768 GiB<br/>  | ||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''  | ||
|    | |    | ||
*   | * 480 GB SSD SAS Intel SSDSC2KG480G8R  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0)  (primary disk)<br />  | ||
* 2.0 TB HDD SAS Seagate ST2000NX0463  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) [[Disk_reservation|(reservable)]] <br />  | |||
* 2.0 TB HDD SAS Seagate ST2000NX0463  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) [[Disk_reservation|(reservable)]] <br />  | |||
* 2.0 TB HDD SAS Seagate ST2000NX0463  (path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) [[Disk_reservation|(reservable)]] <br />  | |||
* 1.6 TB SSD NVME Dell Dell Express Flash NVMe PM1725 1.6TB AIC  (path: /dev/disk/by-path/pci-0000:6d:00.0-nvme-1)  <br/>  | |||
|   | |||
|   | |||
|   | |||
|-  | |-  | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''  | ||
|    | |    | ||
* <span style="color:grey">   | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e<br />  | ||
*   | * <span style="color:grey">eth1/eno2, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />  | ||
* <span style="color:grey">eth2/eno3, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />  | |||
* <span style="color:grey">   | * <span style="color:grey">eth3/eno4, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment</span><br />  | ||
* ib0, Omni-Path, configured rate: 100 Gbps, model: Intel Omni-Path HFI Silicon 100 Series [discrete], driver: hfi1<br/>  | |||
|-  | |-  | ||
|}''<small>  | |}''<small>Last generated from the Grid'5000 Reference API on 2020-06-15 ([https://github.com/grid5000/reference-repository/commit/001f4d421 commit 001f4d421])</small>''  | ||
Revision as of 15:56, 15 June 2020
Summary
3 clusters, 40 nodes, 1408 cores, 19.0 TFLOPS
| Cluster | Access Condition | Date of arrival | Nodes | CPU | Cores | Memory | Storage | Network | 
|---|---|---|---|---|---|---|---|---|
| dahu | 2018-03-22 | 32 | 2 x Intel Xeon Gold 6130 | 16 cores/CPU | 192 GiB | 240 GB SSD + 480 GB SSD + 4.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path | |
| troll | 2019-12-23 | 4 | 2 x Intel Xeon Gold 5218 | 16 cores/CPU | 384 GiB + 1.5 TiB PMEM | 480 GB SSD + 1.6 TB SSD | 10 Gbps + 100 Gbps Omni-Path | |
| yeti | 2018-01-16 | 4 | 4 x Intel Xeon Gold 6130 | 16 cores/CPU | 768 GiB | 480 GB SSD + 3 x 2.0 TB HDD + 1.6 TB SSD | 10 Gbps + 100 Gbps Omni-Path | 
Cluster details
dahu
32 nodes, 64 cpus, 1024 cores (json)
| Model: | Dell PowerEdge C6420 | 
| Date of arrival: | 2018-03-22 | 
| CPU: | Intel Xeon Gold 6130 (Skylake, 2.10GHz, 2 CPUs/node, 16 cores/CPU) | 
| Memory: | 192 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
troll
4 nodes, 8 cpus, 128 cores (json)
| Model: | Dell PowerEdge R640 | 
| Date of arrival: | 2019-12-23 | 
| CPU: | Intel Xeon Gold 5218 (Cascade Lake-SP, 2.30GHz, 2 CPUs/node, 16 cores/CPU) | 
| Memory: | 384 GiB + 1.5 TiB PMEM | 
| Storage: | 
  | 
| Network: | 
  | 
yeti
4 nodes, 16 cpus, 256 cores, split as follows due to differences between nodes (json)
- yeti-[1-2,
4] (3 nodes, 12 cpus, 192 cores)  
| Model: | Dell PowerEdge R940 | 
| Date of arrival: | 2018-01-16 | 
| CPU: | Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4 CPUs/node, 16 cores/CPU) | 
| Memory: | 768 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
- yeti-3 (1 node, 4 cpus, 64 cores)
 
| Model: | Dell PowerEdge R940 | 
| Date of arrival: | 2018-01-16 | 
| CPU: | Intel Xeon Gold 6130 (Skylake, 2.10GHz, 4 CPUs/node, 16 cores/CPU) | 
| Memory: | 768 GiB | 
| Storage: | 
  | 
| Network: | 
  | 
Last generated from the Grid'5000 Reference API on 2020-06-15 (commit 001f4d421)