Rennes:Network: Difference between revisions

From Grid5000
Jump to navigation Jump to search
Line 50: Line 50:
== High Performance Networks ==
== High Performance Networks ==


=== Myrinet 10G on DELL nodes  ===
=== Myrinet 10G on DELL nodes  (paraquad, paramount) ===


==== Nodes ====
==== Nodes ====
Line 57: Line 57:
*<code class="host">paramount-1</code> to <code class="host">paraquad-33</code> have a 10GB Myrinet card.
*<code class="host">paramount-1</code> to <code class="host">paraquad-33</code> have a 10GB Myrinet card.


* Drivers : <code class="dir">/opt/mx/</code>
* Installation options :
$ ./configure --prefix=/usr
* OAR property : myri10g=YES and myri10gmodel=10g-pcie-8a-c ([http://paramount/oar/Rennes/monika.cgi?props=myri10g%3DYES&Action=Display+nodes+for+these+properties&.cgifields=props]).
* OAR property : myri10g=YES and myri10gmodel=10g-pcie-8a-c ([http://paramount/oar/Rennes/monika.cgi?props=myri10g%3DYES&Action=Display+nodes+for+these+properties&.cgifields=props]).
* IP over MX addressing : paraquad-[1..64]-myri0.rennes.grid5000.fr or paraquad-[1..64].myri (192.168.200.21 à 192.168.200.84)
* IP over MX addressing : paraquad-[1..64]-myri0.rennes.grid5000.fr (192.168.200.21 à 192.168.200.84)
* IP over MX addressing : paramount-[1..33]-myri0.rennes.grid5000.fr or paramount-[1..33].myri (192.168.201.171 à 192.168.201.203)
* IP over MX addressing : paramount-[1..33]-myri0.rennes.grid5000.fr (192.168.201.171 à 192.168.201.203)


==== Switch ====
==== Switch ====
Line 85: Line 86:
* slot 15 10G-SW16LC-8C
* slot 15 10G-SW16LC-8C
* slot 16 10G-SW16LC-8C
* slot 16 10G-SW16LC-8C
=== 10G Infiniband SDR (parapide) ===
==== Nodes ====
*<code class="host">parapide-1</code> to <code class="host">parapide-25</code> have a 10G Infiniband SDR card.
* Installation options :
$ ./configure --prefix=/usr
* OAR property : ib10g=YES and myri10gmodel=MT25418.
* IP over IB addressing : parapide-[1..25]-ib0.rennes.grid5000.fr (192.168.200.221 à 192.168.200.245)
==== Switch ====

Revision as of 11:13, 11 May 2010

IP networks in use

You have to use a public network range to run an experiment between several Grid5000 sites.

Public Networks

  • computing : 131.254.202.0/23
  • virtual : 10.156.0.0/14

Local Networks

Network

Experiment Network

Rennes experiment network.png

  • Our network connectivity is provided by a single switch: a Cisco 6509. It provides us with a gigabit ethernet connection to each cluster node, a 10G uplink to Renater and a Gigabit uplink to the IRISA Network (used for DNS/NTP access, and connection to satellite sites).

Node names

  • Compute nodes must be reserved before use with OAR on frontend.rennes.grid5000.fr


Cluster

Compute Nodes

Dell paramount-{1..33}.rennes.grid5000.fr
Dell paraquad-{1..64}.rennes.grid5000.fr
Carri System paradent-{1..64}.rennes.grid5000.fr
Sun Microsystem parapide-{1..25}.rennes.grid5000.fr

High Performance Networks

Myrinet 10G on DELL nodes (paraquad, paramount)

Nodes

  • paraquad-1 to paraquad-64 have a 10GB Myrinet card.
  • paramount-1 to paraquad-33 have a 10GB Myrinet card.
  • Installation options :
$ ./configure --prefix=/usr
  • OAR property : myri10g=YES and myri10gmodel=10g-pcie-8a-c ([1]).
  • IP over MX addressing : paraquad-[1..64]-myri0.rennes.grid5000.fr (192.168.200.21 à 192.168.200.84)
  • IP over MX addressing : paramount-[1..33]-myri0.rennes.grid5000.fr (192.168.201.171 à 192.168.201.203)

Switch

  • slot m M3-MONITOR
    • uc microcode version: M3 Switch Firmware v3.0 Type: LCMONITOR Compiled on: Oct 29 2004 16:44:54
    • uc rom version: 9S08 Monitor v1.0 Compiled on: Oct 17 2004 23:15:08
    • firmware: vv0.9.9.35 Feb 5 2009 18:20:36
  • slot 0 10G-SW16LC-6C2ER
    • uc microcode version: M4 Switch Firmware v1.2 Type: 10G-SW16LC-6C2ER Compiled on: Oct 31 2008 14:57:55
    • uc rom version: 9S08 Monitor v1.0 Compiled on: Oct 17 2004 23:15:08
  • slot 1 10G-SW16LC-8C
    • uc microcode version: M4 Switch Firmware v0.9 Type: 10G-SW16LC-8C Compiled on: Nov 28 2005 16:49:14
    • uc rom version: 9S08 Monitor v1.0 Compiled on: Oct 17 2004 23:15:08
  • slot 2 10G-SW16LC-8C
  • slot 3 10G-SW16LC-8C
  • slot 4 10G-SW16LC-8C
  • slot 5 10G-SW16LC-8C
  • slot 6 10G-SW16LC-8C
  • slot 7 10G-SW16LC-8C
  • slot 12 10G-SW16LC-8C
  • slot 13 10G-SW16LC-8C
  • slot 14 10G-SW16LC-8C
  • slot 15 10G-SW16LC-8C
  • slot 16 10G-SW16LC-8C

10G Infiniband SDR (parapide)

Nodes

  • parapide-1 to parapide-25 have a 10G Infiniband SDR card.
  • Installation options :
$ ./configure --prefix=/usr
  • OAR property : ib10g=YES and myri10gmodel=MT25418.
  • IP over IB addressing : parapide-[1..25]-ib0.rennes.grid5000.fr (192.168.200.221 à 192.168.200.245)

Switch