Luxembourg:Network: Difference between revisions

From Grid5000
Jump to navigation Jump to search
(Update: +nat vlan, -ext vlan, -access)
No edit summary
 
(20 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{Template:Site link|Network}}
{{Template:Site link|Network}}
{{See also|[[Network Admins]] | [[Network survival guide]]}}
{{Portal|Network}}
== Plans ==
{{Portal|User}}
 
'''See also:''' [[Luxembourg:Hardware|Hardware description for Luxembourg]]
 
= Overview of Ethernet network topology =
 
[[File:LuxembourgNetwork.svg|300px]]
 
{{:Luxembourg:GeneratedNetwork}}


== General overview ==
== General overview ==
Line 13: Line 21:


* A Core Layer 2 / 3 switch of type Cisco Catalyst 6506E, including one single supervisor (VS-S720-10G) and two line Gigabit copper cards (WS-X6748-GE-TX). This Switch is connecting :
* A Core Layer 2 / 3 switch of type Cisco Catalyst 6506E, including one single supervisor (VS-S720-10G) and two line Gigabit copper cards (WS-X6748-GE-TX). This Switch is connecting :
** the 22 computing Nodes in 1GbE mode to the ''prod'' VLAN
** the 38 computing Nodes in 1GbE mode to the ''prod'' VLAN
** the 22 computing Nodes in 1GbE mode to the ''admin'' VLAN
** the 38 computing Nodes in 1GbE mode to the ''admin'' VLAN
** the NFS server (in both ''prod'' and ''admin'' VLAN)
** the NFS server (in both ''prod'' and ''admin'' VLAN)
** the Adminfront server (in ''prod'', ''admin'', and ''nat'' VLAN)
** the Adminfront server (in ''prod'', ''admin'', and ''nat'' VLAN)
** the Renater backbone (VLAN 550)
** the Renater backbone (VLAN 550)
* A server farm of type Cisco Nexus 5020, responsible for connecting the 22 computing nodes in 10GbE mode (VLAN ''hsc'')
* A server farm of type Cisco Nexus 5020, responsible for connecting the 22 granduc nodes in 10GbE mode
 
The global architecture and network organization is based on the [[Network Golden rules]]


== Connectivity to GRID5000 ==
== Connectivity to GRID5000 ==


The connectivity to GRID 5000 is operated by the RESTENA foundation (for the luxembourgian side) in collaboration with Renater.
The connectivity to GRID 5000 is operated by the RESTENA foundation (for the Luxembourgian side) in collaboration with Renater.
The dedicated Grid5000 line has been prolongated from Nancy toward Luxembourg (see [[Network_interlink#Routing tables|Global network map]]) via Esch/Elzette.
The dedicated Grid5000 line has been propagated from Nancy toward Luxembourg (see [[Grid5000:Network|Global network map]]) via Esch/Alzette.
 
== VLANs ==
 
=== Overview ===
 
{| border="1" cellpadding="5" cellspacing="0" align="center"
|-
! scope="col" style="background: #efefef;" | VLAN
! scope="col" style="background: #efefef;" | Name
! scope="col" style="background: #efefef;" | Description
! scope="col" style="background: #efefef;" | Network
|-
| VLAN 10 || admin || Administration network (BMC interfaces + eth1 on each server) || 172.17.176.0/20
|-
| VLAN 30 || prod ||  Production network (all nodes ethernet interfaces + eth0 on each server/virtual machine) || 172.16.176.0/20
|-
| VLAN 50 || hsc ||  High speed computing network (10GbE) || 192.168.14.0/23
|-
| VLAN 103 || nat || NAT network || 192.168.69.0/30
|-
| VLAN 550 || Grid5000 ||  Gateway to Grid5000/Renater 5 || 192.168.4.0/24
|- 
| VLAN 1000 || BLACKHOLE ||  local usage, unused ports || n/a
|-
|}
 
=== Network routing ===
 
==== VLAN <code class='host'>prod</code>: '''172.16.176.0/20''' ====
* Computing nodes
** eth0 (1GbE) 172.16.176.0/23
** eth1 (1GbE) 172.16.178.0/23
* Gateway: 172.16.191.254 (SUP720-10G)
* Servers 172.16.191.0/24
** phys. eth0 (1GbE) 172.16.191.[1-99]
** virtual eth0 (1GbE) 172.16.191.[100-199]
 
====  VLAN <code class='host'>admin</code>: '''172.17.176.0/20''' ====
* Computing nodes
** BMC: 172.17.176.0/23
* Gateway: 172.17.191.254  (SUP720-10G)
* Servers 172.17.190.0/23
** BMC: 172.17.190.0/24
** phys. eth1 (1GbE) 172.17.191.[1-99]
** virtual eth1 (1GbE) 172.17.191.[100-199]
 
====  VLAN <code class='host'>nat</code>: '''192.168.69.0/30''' ====
* Nat domU
** eth0: 192.168.69.2
* Gateway: 192.168.69.1
 
The <code class='host'>nat</code> network is not routed on Grid5000, and is only available locally. The host <code class='host'>192.168.69.2</code> is the default gateway in the routing table of the core router.
 
====  VLAN <code class='host'>hsc</code>: '''192.168.14.0/23''' ====
* Computing nodes
** eth2 (10GbE): 192.168.14.0/23
* Gateway: 192.168.15.254 ( SUP720-10G DHCP Serveur)
 
The Core Switch (Cisco C6506E) is also acting as a DHCP Server for the Computing Nodes in the <code class='host'>hsc</code> VLAN.
As the Nexus device is not DHCP Server capable, the <code class='host'>hsc</code> VLAN had been extended (using the interface ''172.17.191.253'' belonging to the <code class='host'>admin</code> VLAN on the nexus) to the Core switch which act as DHCP Server.
The <code class='host'>hsc</code> segment is never routed among the network.
 
====  VLAN <code class='host'>grid5000</code>: '''192.168.4.0/24''' ====
* Gateway (Luxembourg) : 192.168.4.21 ( SUP720-10G ), other site gateways: see [[Renater5]]
 
== University of Luxembourg interconnection ==
 
We do not have an <code class='host'>EXT</code> VLAN on the site router.
Instead, the adminfront has a link (eth3) on the University network (VLAN 124, 10.74.0.0/16).
This interface is bridged and used by the NAT domU.

Latest revision as of 17:26, 8 March 2024

Network: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse

See also: Hardware description for Luxembourg

Overview of Ethernet network topology

LuxembourgNetwork.svg


Network devices models

  • gw-kirchberg: cisco WS-C6506-E
  • gw: cisco Nexus9000 C93240YC-FX2
  • mxl1: Force10 MXL
  • mxl2: Force10 MXL
  • sw-b04: cisco Nexus9000 C93180YC-FX3
  • sw-b09: cisco Nexus9000 C93180YC-FX3
  • ul-grid5000-sw02: cisco N5K-C5020P-BF

More details (including address ranges) are available from the Grid5000:Network page.

General overview

Cluster Lux5000.png

PDF version: Cluster Lux5000.pdf

Network Architecture

The Luxembourg site is built over two central network components:

  • A Core Layer 2 / 3 switch of type Cisco Catalyst 6506E, including one single supervisor (VS-S720-10G) and two line Gigabit copper cards (WS-X6748-GE-TX). This Switch is connecting :
    • the 38 computing Nodes in 1GbE mode to the prod VLAN
    • the 38 computing Nodes in 1GbE mode to the admin VLAN
    • the NFS server (in both prod and admin VLAN)
    • the Adminfront server (in prod, admin, and nat VLAN)
    • the Renater backbone (VLAN 550)
  • A server farm of type Cisco Nexus 5020, responsible for connecting the 22 granduc nodes in 10GbE mode

Connectivity to GRID5000

The connectivity to GRID 5000 is operated by the RESTENA foundation (for the Luxembourgian side) in collaboration with Renater. The dedicated Grid5000 line has been propagated from Nancy toward Luxembourg (see Global network map) via Esch/Alzette.

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Luxembourg:Network&oldid=102269"