Sophia:Network
Network
Gigabit Ethernet
Azur Cluster (IBM e325)
All the nodes are connected to 4 Cisco-3750 switches (gigabit ethernet). The switches are interconnected using a 32Gbps stack. The nodes are connected to the following switches:
- switch n°9 (Master) : node-1 to node-15 (15 nodes), 10GB uplink
to the FastIron
- switch n°8 : node-16 to node-36 (21 nodes)
- switch n°5 : node-37 to node-55 (19 nodes)
- switch n°6 : node-56 to node-74 (19 nodes)
The switches are dedicated to Grid5000 (since january 2007; before that, they were shared with the local cluster).
You can choose the switch for your reservation with OAR, using the switch number: oarsub -l nodes=15 -p switch=X
Network usage is available through cricket at : https://helpdesk.grid5000.fr/cricket/grapher.cgi?target=%2Fsophia%2Fcisco
OS used:
Cisco IOS Software, C3750 Software (C3750-IPBASE-M), Version 12.2(25)SEB4
Helios Cluster (Sun X4100)
All the nodes are connected in gigabit ethernet to 2 Foudry EdgeIron switches (one Edgeiron 48GS and one EdgeIron24GS). The switches are interconnected using a 2x10Gbps stack (10GBps in each direction). The nodes are connected to the following switches:
- switch n°1 : helios01 to helios48 (48 nodes)
- switch n°2 : helios49 to helios56 (8 nodes)
You can choose the switch for your reservation with OAR, using the switch number: oarsub -l nodes=15 -p switch=X
OS used: 2.2.6.35
Sol Cluster (Sun X2200 M2)
All the nodes are connected (in a non blocking way) to the main Foundry FastIron Super X switch.
47 nodes have a second Ethernet interface connected to 2 Cisco 3750 stacked switches.
Topology
The main switch is a Foundry FastIron Super X. It has 2 dual 10GB modules, 2 modules with 24 gigabit ports, and 12 gigabit ports on the management module (so 60 gigabit ports are available). 4 slots are currently free.
The Cisco 3750 stack (Azur) is connected to the FastIron switch with a 10GB link; The EdgeIron stack (helios) is connected to the FastIron with 2 aggregated 10GB links.
Each frontend is connected to the FastIron switch.
Network usage is available through cricket at: https://helpdesk.grid5000.fr/cricket/grapher.cgi?target=%2Fsophia%2Fgw-sophia.sophia.grid5000.fr
Myrinet
72 azur nodes and 56 helios nodes are connected to the 128 ports Myrinet 2000 switch.
You can submit jobs with OAR on Myrinet nodes using the 'myrinet' property: oarsub -l nodes=10 -p "myrinet='yes'".
Myrinet network usage is available through cricket at: https://helpdesk.grid5000.fr/cricket/