Nancy:Network: Difference between revisions
Xdelaruelle (talk | contribs) No edit summary |
Xdelaruelle (talk | contribs) No edit summary |
||
Line 1: | Line 1: | ||
Cluster's nodes are connected on an experimentation network, to compute, and on a management network, for their monitoring. The cluster is also interconnected to Grid'5000, to compute with nodes from the rest of the grid, and to Loria, to permit an access to the cluster from outside. | Cluster's nodes are connected on an experimentation network, to compute, and on a management network, for their monitoring. The cluster is also interconnected to Grid'5000, to compute with nodes from the rest of the grid, and to Loria, to permit an access to the cluster from outside. | ||
= | = Experiment network = | ||
== Topology === | |||
The experiments network is composed of two switches : | |||
* 48-port HP ProCurve 3400cl-48G, which receives Grid'5000 traffic | |||
* 24-port HP ProCurve 2824, which receives Laboratory traffic | |||
All the compute nodes are connected to the 48-port switch, to avoid jump between switchs during an experiment. The service nodes are connected to the 24-port switch. | |||
The 48-port switch is equipped with a 10Gbit transceiver. It receives Grid'5000 traffic on this uplink from the others clusters of the grid. The 24-port switch is connected to the laboratory with one of its 1Gbit uplink. | |||
[[Image:nancy_experiments_topology.png]] | |||
== Loria interconnect == | == Addressing == | ||
'' | Compute nodes, service nodes and network switches possess an IP address on the experiment network. All these materials are independently numbered. Moreover the two network interfaces of the compute nodes are also independently numbered. So there is a service node n°1 and compute node n°1, with a n°1A for its first interface and a n°1B for its second. It is important that the IP address coroborates this numbering. So, the chosen IP network is <code class="host">172.28.52.0/22</code>. | ||
Address: 172.28.52.0 10101100.00011100.001101 00.00000000 | |||
Netmask: 255.255.252.0 = 22 11111111.11111111.111111 00.00000000 | |||
Wildcard: 0.0.3.255 00000000.00000000.000000 11.11111111 | |||
=> | |||
Network: 172.28.52.0/22 10101100.00011100.001101 00.00000000 | |||
HostMin: 172.28.52.1 10101100.00011100.001101 00.00000001 | |||
HostMax: 172.28.55.254 10101100.00011100.001101 11.11111110 | |||
Broadcast: 172.28.55.255 10101100.00011100.001101 11.11111111 | |||
Hosts/Net: 1022 Class B, Private Internet | |||
This network range is divided between the materials this way : | |||
* <code class="host">172.28.52.[1-255]</code> are dedicated to this network switches | |||
* <code class="host">172.28.53.[1-255]</code> are dedicated to service nodes | |||
* <code class="host">172.28.54.[1-254]</code> are dedicated to compute nodes first interface | |||
* <code class="host">172.28.55.[1-254]</code> are dedicated to compute nodes second interface | |||
== Naming == | |||
Compute nodes, service nodes and network switches are named on the experiment network. Each possess 2 kind of name : one defined in the Grid'5000 specification and another one derived from the cluster name. These names contain the material numbering, which coroborates the IP address. | |||
=== Switch === | |||
* <code class="host">switch[1-255].nancy.grid5000.fr</code> | |||
* <code class="host">sgrillon[1-255].nancy.grid5000.fr</code> | |||
=== Service node === | |||
* <code class="host">frontale[1-255].nancy.grid5000.fr</code> | |||
(<code class="host">frontale.nancy.grid5000.fr</code> is also used for default service node) | |||
* <code class="host">fgrillon[1-255].nancy.grid5000.fr</code> | |||
(<code class="host">fgrillon.nancy.grid5000.fr</code> is also used for default service node) | |||
=== Compute node === | |||
Each compute network interface possess its own name : | |||
* <code class="host">node-[X]-a.nancy.grid5000.fr</code> | |||
(<code class="host">node-[X].nancy.grid5000.fr</code> is also used for the first interface) | |||
* <code class="host">grillon-[X]-a.nancy.grid5000.fr</code> | |||
(<code class="host">grillon-[X].nancy.grid5000.fr</code> is also used for the first interface) | |||
* <code class="host">node-[X]-b.nancy.grid5000.fr</code> | |||
* <code class="host">grillon-[X]-b.nancy.grid5000.fr</code> | |||
= Management network = | |||
== Topology === | |||
The management network is composed of one switch : | |||
* 50-port HP ProCurve 2650 | |||
All compute nodes are connected to the management switch with their ''iLO'' management card. Service nodes are also connected to this switch with their second compute network interface. This way, you can access the management network from these service nodes. | |||
The service node ''iLO'' management cards are connected to the 24-port experiment switch. Thanks to this, these interfaces can be accessed from the laboratory network [[#Loria interconnect]]. They are not part of the management network. | |||
[[Image:nancy_management_topology.png]] | |||
== Addressing == | |||
Compute nodes, service nodes and the switch, that participates, possess an IP address on the management network. The numbering used is the same as the experiment network one. IP address keeps coroborate this numbering. So, the chosen IP network is <code class="host">172.28.152.0/22</code>. | |||
Address: 172.28.152.0 10101100.00011100.100110 00.00000000 | |||
Netmask: 255.255.252.0 = 22 11111111.11111111.111111 00.00000000 | |||
Wildcard: 0.0.3.255 00000000.00000000.000000 11.11111111 | |||
=> | |||
Network: 172.28.152.0/22 10101100.00011100.100110 00.00000000 | |||
HostMin: 172.28.152.1 10101100.00011100.100110 00.00000001 | |||
HostMax: 172.28.155.254 10101100.00011100.100110 11.11111110 | |||
Broadcast: 172.28.155.255 10101100.00011100.100110 11.11111111 | |||
Hosts/Net: 1022 Class B, Private Internet | |||
This network range is divided between the materials in a similar way as experiment network does : | |||
* <code class="host">172.28.152.[1-255]</code> are dedicated to this network switches | |||
* <code class="host">172.28.153.[1-255]</code> are dedicated to service nodes | |||
* <code class="host">172.28.154.[1-254]</code> are dedicated to compute nodes | |||
== Naming == | |||
Compute nodes, service nodes and network switches are named on the experiment network. Each possess only one name, derived from cluster name in a manner to keep in mind that the interface is dedicated to management tasks. Names contain the material numbering, which coroborates the IP address. | |||
* <code class="host">sgrillade[1-255].nancy.grid5000.fr</code> are dedicated to this network switches | |||
* <code class="host">fgrillade[1-255].nancy.grid5000.fr</code> are dedicated to service nodes | |||
* <code class="host">grillade-[1-255].nancy.grid5000.fr</code> are dedicated to compute nodes | |||
= Grid'5000 interconnect = | |||
== Topology == | |||
Connection to others Grid'5000 sites uses the national research network, called [http://www.renater.fr Renater]. This network uses the 10Gbit Ethernet technology. | |||
[[Image:nancy_g5k_interconnect.png]] | |||
The local Renater site is managed by the [http://www.ciril.fr CIRIL], which is located at 2 km from the Loria, which hosts Nancy's Grid'5000 cluster. This distance implies the use of a fiber medium with the 10GBASE-LR technology. The 48-port experiment network switch, which is equipped with a 10GbE LR transceiver, takes in charge the Grid'5000 interconnect. | |||
Fiber linking to the CIRIL is not direct. Firstly, fiber goes down to the Faculté des Sciences. After that, it goes to Loria. Finally, it arrives on the cluster. | |||
[[Image:nancy_g5k_linking.png]] | |||
== Addressing == | |||
Not yet defined | |||
== Naming == | |||
There is no specific naming for the Grid'5000 interconnect, because the experiment network names are used on the entire grid. | |||
= Loria interconnect = | |||
== Topology == | |||
The Loria laboratory possess a 1Gbit Ethernet network. Service nodes of the cluster are connected to this network. So the 24-port experiment switch, which connects service nodes, makes the uplink to this network. | |||
[[Image:nancy_loria_interconnect.png]] | |||
Nancy's Grid'5000 cluster is hosted in Loria building. So cabling distance is short. 1000BASE-T technology is used with an RJ-45 CAT6 cable. The 24-port experiment switch is directly linked to the Loria router. | |||
[[Image:nancy_loria_linking.png]] | |||
== Addressing == | |||
Loria uses a public IP address range for its materials : <code class="host">152.81.0.0/16</code>. Within this range, the subnet <code class="host">152.81.44.0/24</code> is used for all clustering activities of the laboratory: | |||
* <code class="host">152.81.44.[21-??]</code> are dedicated to service node second experiment interface | |||
* <code class="host">152.81.44.[121-1??]</code> are dedicated to service node management interface | |||
== Naming == | |||
Service node interfaces connected to Loria network are also named on it. These names are gathered into <code class="domain">grid5000.loria.fr</code> subdomain : | |||
* <code class="host">fgrillon[1-??].grid5000.loria.fr</code> are dedicated to service node second experiment interface | |||
(<code class="host">fgrillon.grid5000.loria.fr</code>, <code class="host">grillon.grid5000.loria.fr</code> and <code class="host">acces.nancy.grid5000.fr</code> are also used for default service node) | |||
* <code class="host">fgrillade[1-??].grid5000.loria.fr</code> are dedicated to service node management interface |
Revision as of 11:06, 21 November 2005
Cluster's nodes are connected on an experimentation network, to compute, and on a management network, for their monitoring. The cluster is also interconnected to Grid'5000, to compute with nodes from the rest of the grid, and to Loria, to permit an access to the cluster from outside.
Experiment network
Topology =
The experiments network is composed of two switches :
- 48-port HP ProCurve 3400cl-48G, which receives Grid'5000 traffic
- 24-port HP ProCurve 2824, which receives Laboratory traffic
All the compute nodes are connected to the 48-port switch, to avoid jump between switchs during an experiment. The service nodes are connected to the 24-port switch.
The 48-port switch is equipped with a 10Gbit transceiver. It receives Grid'5000 traffic on this uplink from the others clusters of the grid. The 24-port switch is connected to the laboratory with one of its 1Gbit uplink.
Addressing
Compute nodes, service nodes and network switches possess an IP address on the experiment network. All these materials are independently numbered. Moreover the two network interfaces of the compute nodes are also independently numbered. So there is a service node n°1 and compute node n°1, with a n°1A for its first interface and a n°1B for its second. It is important that the IP address coroborates this numbering. So, the chosen IP network is 172.28.52.0/22
.
Address: 172.28.52.0 10101100.00011100.001101 00.00000000 Netmask: 255.255.252.0 = 22 11111111.11111111.111111 00.00000000 Wildcard: 0.0.3.255 00000000.00000000.000000 11.11111111 => Network: 172.28.52.0/22 10101100.00011100.001101 00.00000000 HostMin: 172.28.52.1 10101100.00011100.001101 00.00000001 HostMax: 172.28.55.254 10101100.00011100.001101 11.11111110 Broadcast: 172.28.55.255 10101100.00011100.001101 11.11111111 Hosts/Net: 1022 Class B, Private Internet
This network range is divided between the materials this way :
172.28.52.[1-255]
are dedicated to this network switches172.28.53.[1-255]
are dedicated to service nodes172.28.54.[1-254]
are dedicated to compute nodes first interface172.28.55.[1-254]
are dedicated to compute nodes second interface
Naming
Compute nodes, service nodes and network switches are named on the experiment network. Each possess 2 kind of name : one defined in the Grid'5000 specification and another one derived from the cluster name. These names contain the material numbering, which coroborates the IP address.
Switch
switch[1-255].nancy.grid5000.fr
sgrillon[1-255].nancy.grid5000.fr
Service node
frontale[1-255].nancy.grid5000.fr
(frontale.nancy.grid5000.fr
is also used for default service node)
fgrillon[1-255].nancy.grid5000.fr
(fgrillon.nancy.grid5000.fr
is also used for default service node)
Compute node
Each compute network interface possess its own name :
node-[X]-a.nancy.grid5000.fr
(node-[X].nancy.grid5000.fr
is also used for the first interface)
grillon-[X]-a.nancy.grid5000.fr
(grillon-[X].nancy.grid5000.fr
is also used for the first interface)
node-[X]-b.nancy.grid5000.fr
grillon-[X]-b.nancy.grid5000.fr
Management network
Topology =
The management network is composed of one switch :
- 50-port HP ProCurve 2650
All compute nodes are connected to the management switch with their iLO management card. Service nodes are also connected to this switch with their second compute network interface. This way, you can access the management network from these service nodes.
The service node iLO management cards are connected to the 24-port experiment switch. Thanks to this, these interfaces can be accessed from the laboratory network #Loria interconnect. They are not part of the management network.
Addressing
Compute nodes, service nodes and the switch, that participates, possess an IP address on the management network. The numbering used is the same as the experiment network one. IP address keeps coroborate this numbering. So, the chosen IP network is 172.28.152.0/22
.
Address: 172.28.152.0 10101100.00011100.100110 00.00000000 Netmask: 255.255.252.0 = 22 11111111.11111111.111111 00.00000000 Wildcard: 0.0.3.255 00000000.00000000.000000 11.11111111 => Network: 172.28.152.0/22 10101100.00011100.100110 00.00000000 HostMin: 172.28.152.1 10101100.00011100.100110 00.00000001 HostMax: 172.28.155.254 10101100.00011100.100110 11.11111110 Broadcast: 172.28.155.255 10101100.00011100.100110 11.11111111 Hosts/Net: 1022 Class B, Private Internet
This network range is divided between the materials in a similar way as experiment network does :
172.28.152.[1-255]
are dedicated to this network switches172.28.153.[1-255]
are dedicated to service nodes172.28.154.[1-254]
are dedicated to compute nodes
Naming
Compute nodes, service nodes and network switches are named on the experiment network. Each possess only one name, derived from cluster name in a manner to keep in mind that the interface is dedicated to management tasks. Names contain the material numbering, which coroborates the IP address.
sgrillade[1-255].nancy.grid5000.fr
are dedicated to this network switchesfgrillade[1-255].nancy.grid5000.fr
are dedicated to service nodesgrillade-[1-255].nancy.grid5000.fr
are dedicated to compute nodes
Grid'5000 interconnect
Topology
Connection to others Grid'5000 sites uses the national research network, called Renater. This network uses the 10Gbit Ethernet technology.
The local Renater site is managed by the CIRIL, which is located at 2 km from the Loria, which hosts Nancy's Grid'5000 cluster. This distance implies the use of a fiber medium with the 10GBASE-LR technology. The 48-port experiment network switch, which is equipped with a 10GbE LR transceiver, takes in charge the Grid'5000 interconnect.
Fiber linking to the CIRIL is not direct. Firstly, fiber goes down to the Faculté des Sciences. After that, it goes to Loria. Finally, it arrives on the cluster.
Addressing
Not yet defined
Naming
There is no specific naming for the Grid'5000 interconnect, because the experiment network names are used on the entire grid.
Loria interconnect
Topology
The Loria laboratory possess a 1Gbit Ethernet network. Service nodes of the cluster are connected to this network. So the 24-port experiment switch, which connects service nodes, makes the uplink to this network.
Nancy's Grid'5000 cluster is hosted in Loria building. So cabling distance is short. 1000BASE-T technology is used with an RJ-45 CAT6 cable. The 24-port experiment switch is directly linked to the Loria router.
Addressing
Loria uses a public IP address range for its materials : 152.81.0.0/16
. Within this range, the subnet 152.81.44.0/24
is used for all clustering activities of the laboratory:
152.81.44.[21-??]
are dedicated to service node second experiment interface152.81.44.[121-1??]
are dedicated to service node management interface
Naming
Service node interfaces connected to Loria network are also named on it. These names are gathered into grid5000.loria.fr
subdomain :
fgrillon[1-??].grid5000.loria.fr
are dedicated to service node second experiment interface
(fgrillon.grid5000.loria.fr
, grillon.grid5000.loria.fr
and acces.nancy.grid5000.fr
are also used for default service node)
fgrillade[1-??].grid5000.loria.fr
are dedicated to service node management interface