Rennes:Network

Network topology

• Cisco 3750 switches have a 64Gb switching capacity, and they are stacked with a 32Gb bus. The uplink of each Cisco 3750 stack is a gigabit optical fiber.
• HP Nodes are connected with HP ProCurve 2848 switches.
• The 10Mb hub of Sun nodes connects the Service Processor of Sun nodes to the parasol-srv head node.
• Grid'5000 and Renater connectivity is provided by a Juniper M20 router.

Node names

• Head nodes are assigned to compilation, debugging and running reservations through OAR.
• Compute nodes must be reserved before use with GridPrems or OAR.

Cluster	Head Node from grid'5000	Head Node from IRISA	Compute Nodes
Apple	tartopom-dev.rennes.grid5000.fr	tartopom-dev.irisa.fr	tartopom{01..32}.rennes.grid5000.fr
Dell	paraci-dev.rennes.grid5000.fr	paraci-dev.irisa.fr	paraci{01..64}.rennes.grid5000.fr
HP	paravent-dev.rennes.grid5000.fr	paravent-dev.irisa.fr	paravent{01..99}.rennes.grid5000.fr
Sun	parasol-dev.rennes.grid5000.fr	parasol-dev.irisa.fr	parasol{01..64}.rennes.grid5000.fr

InfiniBand on HP nodes (paravent)

paravent01 to paravent64 have a 10GB Infiniband card (a Mellanox MT23108). Infiniband nodes are connected through 7 Voltaire ISR-9024 switches.

Addressing

Les plages d'addresses suivantes sont réservées et utilisées par Rennes :

131.254.202.0/23

Used by the ethernet and infiniband interface of nodes

10.254.202.0/23

These addresses are not routed (ie they can only be accessed from nodes at Rennes). They are used for the service processors (aka BMCs) or the parasoleil and paravent nodes.

The addresses assignement for routed addresses is :

• 131.254.202.0   -> 131.254.202.253 : parasol, paraci, and tartopom clusters
• 131.254.203.2   -> 131.254.203.101 : paravent compute nodes (Ethernet)
• 131.254.203.102 -> 131.254.203.201 : paravent compute nodes (InfiniBand)
• 131.254.203.202 -> 131.254.203.204 : paravent service nodes

The addresses assignement for non routed addresses is :

• 10.254.202.100 -> 10.254.202.165 : parasol service processors
• 10.254.203.2   -> 10.254.203.102 : service processors for paravent compute nodes
• 10.254.203.202 -> 10.254.203.204 : service processors for paravent service nodes

Myrinet on Dell nodes (paraci)

Nodes paraci17 to paraci32 have a 2 gigabit Myrinet network card, that has these characteristics:

• bus: PCI
• CPU: LANai9.0

These 16 cards are connected to a Myrinet switch M3-E32. This switch contains 3 M3-SW16-8S daughterboards, each with 8 ports. 8 ports of this switch are currently unused.

The driver installed is GM 2.1.19, it is installed in /stow-i386/gm-2.1.9.

Myrinet-enabled nodes are tagged with the lanai9 property in OAR. This links display their current state in Monika: monika.