Rennes:Network: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
(10 intermediate revisions by 4 users not shown)
Line 3: Line 3:
{{Portal|User}}
{{Portal|User}}


=Network Topology=
= Overview of Ethernet network topology  =
<gallery>
File:Topo_rennes.svg|[[Rennes_Network_Topology|Automated Network topology from API]]
</gallery>


= IP networks in use =
[[File:RennesNetwork.png|900px]]


You have to use a public network range to run an experiment between several Grid5000 sites.
{{:Rennes:GeneratedNetwork}}


=== Public networks ===
= More details about the network topology (deprecated)=
 
* only some servers : '''131.254.202.0/23'''
 
=== Routed private networks ===
 
* computing : '''172.16.96.0/20'''
* virtual : '''10.156.0.0/14'''
 
=== Local networks ===
 
* IPMI : '''172.17.96.0/20'''
* 10G nets : '''172.18.96.0/20''' : see [[Rennes:Network#High_Performance_Networks|High Performance Networks]]
 
= Network =
 
== Experiment Network ==


[[Image:Rennes_experiment_network.png]]
[[Image:Rennes_experiment_network.png]]
Line 48: Line 29:
!align="left"|
!align="left"|
Secondary interface (kavlan only)
Secondary interface (kavlan only)
!align="left"|
Third interface (kavlan only)
|-
|-
|| Dell Poweredge R630
|| Dell Poweredge R630
Line 53: Line 36:
|| <code class="host">paravance-{1..72}-eth0.rennes.grid5000.fr</code>
|| <code class="host">paravance-{1..72}-eth0.rennes.grid5000.fr</code>
|| <code class="host">paravance-{1..72}-eth1-kavlan-*.rennes.grid5000.fr</code>
|| <code class="host">paravance-{1..72}-eth1-kavlan-*.rennes.grid5000.fr</code>
||
|-
|-
|| Dell Poweredge R630
|| Dell Poweredge R630
Line 58: Line 42:
|| <code class="host">parasilo-{1..28}-eth0.rennes.grid5000.fr</code>
|| <code class="host">parasilo-{1..28}-eth0.rennes.grid5000.fr</code>
|| <code class="host">parasilo-{1..28}-eth1-kavlan-*.rennes.grid5000.fr</code>
|| <code class="host">parasilo-{1..28}-eth1-kavlan-*.rennes.grid5000.fr</code>
||
|-
|-
|| Dell Poweredge C6220
|| Dell Poweredge C6220
|| <code class="host">paranoia-{1..8}.rennes.grid5000.fr</code>
|| <code class="host">paranoia-{1..8}.rennes.grid5000.fr</code>
|| <code class="host">paranoia-{1..8}-eth0.rennes.grid5000.fr</code>
|| <code class="host">paranoia-{1..8}-eth0.rennes.grid5000.fr</code>
|| <code class="host">paranoia-{1..8}-eth1-kavlan-*.rennes.grid5000.fr</code>
|| <code class="host">paranoia-{1..8}-eth2-kavlan-*.rennes.grid5000.fr</code>
|| <code class="host">paranoia-{1..8}-eth2-kavlan-*.rennes.grid5000.fr</code>
|-
|-
Line 67: Line 53:
|| <code class="host">parapluie-{1..40}.rennes.grid5000.fr</code>
|| <code class="host">parapluie-{1..40}.rennes.grid5000.fr</code>
|| <code class="host">parapluie-{1..40}-eth1.rennes.grid5000.fr</code>
|| <code class="host">parapluie-{1..40}-eth1.rennes.grid5000.fr</code>
||
||
|-
|-
|-  
|-  
Line 72: Line 60:
|| <code class="host">parapide-{1..25}.rennes.grid5000.fr</code>
|| <code class="host">parapide-{1..25}.rennes.grid5000.fr</code>
|| <code class="host">parapide-{1..25}-eth0.rennes.grid5000.fr</code>
|| <code class="host">parapide-{1..25}-eth0.rennes.grid5000.fr</code>
||
||
|}
|}


Line 85: Line 75:
* sources path : <code class="file">/usr/local/src/OFED-1.5</code>
* sources path : <code class="file">/usr/local/src/OFED-1.5</code>


* OAR property : ib10g=YES and ib10gmodel=MT25418.
* OAR property : ib=MT25418.
* IP over IB addressing : parapide-[1..25]-ib0.rennes.grid5000.fr (192.168.200.221 à 192.168.200.245)
* IP over IB addressing : parapide-[1..25]-ib0.rennes.grid5000.fr (192.168.200.221 à 192.168.200.245)
* IP over IB addressing : parapluie-[1..40]-ib0.rennes.grid5000.fr (192.168.201.1 à 192.168.201.40)
* IP over IB addressing : parapluie-[1..40]-ib0.rennes.grid5000.fr (192.168.201.1 à 192.168.201.40)
Line 113: Line 103:
  sRB-20210G #2: Temperature: 35C; HW Version: B00; Serial Number: CN2709001005
  sRB-20210G #2: Temperature: 35C; HW Version: B00; Serial Number: CN2709001005
  sLB-2024 #3: Temperature: 28C; HW Version: A04; Serial Number: CN0610001939
  sLB-2024 #3: Temperature: 28C; HW Version: A04; Serial Number: CN0610001939
=== OpenMPI ===
* Source path : <code class="file">/usr/local/src/openmpi-1.4.1-g5k</code>
* Installation options :
$ ./configure --prefix=/usr --with-mx=/usr --with-openib=/usr

Revision as of 10:15, 19 October 2018

Overview of Ethernet network topology

Error creating thumbnail: File with dimensions greater than 16 MP


Network devices models

  • bigdata-sw: Force10 S4810
  • c6509: Cisco WS-C6509-E
  • gw: Aruba 8325-48Y8C
  • parasilo-sw-1: Nexus 56128P
  • paravance-sw-1: Nexus 56128P
  • paravance-sw-2: Nexus 56128P
  • sw-1: Aruba 8325-48Y8C
  • sw-adm-1: Aruba 6300M
  • sw-dell-c003-01-rba: S4128F-ON
  • swcore-01-rba: WS-C6509-E
  • swdc-a035-01-02-rba: Nexus 5596
  • swdc-c003-01-02-rba: Nexus 5596

More details (including address ranges) are available from the Grid5000:Network page.

More details about the network topology (deprecated)

Rennes experiment network.png

  • Our network connectivity is provided by a single switch: a Cisco 6509. It provides us with a gigabit ethernet connection to each cluster node, a 10G uplink to Renater and a Gigabit uplink to the IRISA Network (used for DNS/NTP access, and connection to satellite sites).

Node names

  • Compute nodes must be reserved before use with OAR on frontend.rennes.grid5000.fr

Cluster

Compute Nodes Alias

Primary interface

Secondary interface (kavlan only)

Third interface (kavlan only)

Dell Poweredge R630 paravance-{1..72}.rennes.grid5000.fr paravance-{1..72}-eth0.rennes.grid5000.fr paravance-{1..72}-eth1-kavlan-*.rennes.grid5000.fr
Dell Poweredge R630 parasilo-{1..28}.rennes.grid5000.fr parasilo-{1..28}-eth0.rennes.grid5000.fr parasilo-{1..28}-eth1-kavlan-*.rennes.grid5000.fr
Dell Poweredge C6220 paranoia-{1..8}.rennes.grid5000.fr paranoia-{1..8}-eth0.rennes.grid5000.fr paranoia-{1..8}-eth1-kavlan-*.rennes.grid5000.fr paranoia-{1..8}-eth2-kavlan-*.rennes.grid5000.fr
HP Proliant parapluie-{1..40}.rennes.grid5000.fr parapluie-{1..40}-eth1.rennes.grid5000.fr
Sun Microsystem parapide-{1..25}.rennes.grid5000.fr parapide-{1..25}-eth0.rennes.grid5000.fr

High Performance Networks

20G Infiniband 4x QDR (parapide, parapluie)

Nodes

  • parapide-1 to parapide-25 have a 20G Infiniband 4x DDR (ConnectX) card.
  • parapluie-1 to parapluie-40 have a 20G Infiniband 4x DDR (ConnectX) card.
  • sources path : /usr/local/src/OFED-1.5
  • OAR property : ib=MT25418.
  • IP over IB addressing : parapide-[1..25]-ib0.rennes.grid5000.fr (192.168.200.221 à 192.168.200.245)
  • IP over IB addressing : parapluie-[1..40]-ib0.rennes.grid5000.fr (192.168.201.1 à 192.168.201.40)

Voltaire Switch ISR2012-056c

  • Gateway : 192.168.200.1
  • Hardware :
L:ISR2012-056c# version show
version: 5.4.0
date:    Mar 19 2009 02:47:23 PM
build Id:958
L:ISR2012-056c# front show 
Device: HW Version: B02; Serial Number: CN2309001330
sFB-2012 #1: Temperature: 32C; HW Version: A05; Serial Number: CN1409000632
sFB-2012 #2: Temperature: 31C; HW Version: A05; Serial Number: CN1409000631
sFB-2012 #3: Temperature: 30C; HW Version: A05; Serial Number: CN1409000634
sFB-2012 #4: Temperature: 34C; HW Version: A05; Serial Number: CN1409000630
sMB: Temperature: 28C; HW Version: E01; Serial Number: CN2309001258
sFU-8: Temperature: 24C
sFU-4: Temperature: 22C
L:ISR2012-056c# rear show
sLB-2024 #1: Temperature: 32C; HW Version: A03; Serial Number: CN1409000554
sRB-20210G #2: Temperature: 35C; HW Version: B00; Serial Number: CN2709001005
sLB-2024 #3: Temperature: 28C; HW Version: A04; Serial Number: CN0610001939