Sophia:Network

Network: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse

See also: Network Admins | Network survival guide

IP networks in use

You have to use a public network range to run an experiment between several Grid5000 sites.

Public Networks

• computing : 172.16.128.0/20
• virtual : 10.164.0.0/14

Local Networks

• admin or ipmi : 172.17.128.0.24

Network

Physical view of the compute network

Gigabit Ethernet

Helios Cluster (Sun X4100)

All the nodes are connected in gigabit ethernet to 2 Foudry EdgeIron switches (one Edgeiron 48GS and one EdgeIron24GS). The switches are interconnected using a 2x10Gbps stack (10GBps in each direction). The nodes are connected to the following switches:

• edgeiron48gs : helios01 to helios48 (48 nodes)
• edgeiron24gs : helios49 to helios56 (8 nodes)

You can choose the switch for your reservation with OAR, using the switch name: oarsub -l nodes=15 -p "switch='XXX'"

OS used: 2.2.6.35

Sol Cluster (Sun X2200 M2)

All the nodes are connected (in a non blocking way) to the main Foundry FastIron Super X switch.

47 nodes (from sol-1 to sol-47) have a second Ethernet interface connected to 2 Cisco 3750 stacked switches.

• IP addressing for eth1: sol-{1-47}-eth1, using the 172.16.128.0/24 network ( 172.16.128.154 can be used as a gateway)

The Cisco are interconnected to the main FastIron router with a single 1Gbps link. A separate VLAN is used.

	Warning
	The second network is no longer available on sol, as one of the two Cisco switch is dead

Suno Cluster (Dell R410)

All the nodes are connected (in a non blocking way) to the main Foundry FastIron Super X switch.

Topology

The main switch is a Foundry FastIron Super X. It has 2 dual 10GB modules, 4 modules with 24 gigabit ports, and 12 gigabit ports on the management module (so 60 gigabit ports are available). 4 slots are currently free.

The EdgeIron stack (helios) is connected to the FastIron with 2 aggregated 10GB links.

Network usage is available through cricket at: https://helpdesk2.grid5000.fr/cricket/grapher.cgi?target=%2Fsophia%2Fgw-sophia.sophia.grid5000.fr

Myri 2G

All helios nodes are connected to the 128 ports Myrinet 2000 switch.

You can submit jobs with OAR on Myrinet nodes using the 'myrinet' property: oarsub -l nodes=10 -p "myri2g='YES'".

MX driver is enabled by default on these nodes, IP emulation also.

• IP over MX addressing: helios-{1-56}-myri0 (192.168.7.{73-128})
• Myrinet network usage is available through cricket at: https://helpdesk2.grid5000.fr/cricket/

Myri 10G

A subset of the sol cluster (sol-[29-50]) is connected to a 10G Myrinet switch.

Architecture

Physical view of the Baie