Luxembourg:Network: Difference between revisions

From Grid5000
Jump to navigation Jump to search
m (→‎VLANs: typo)
No edit summary
 
(21 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{Template:Site link|Network}}
{{Template:Site link|Network}}
{{See also|[[Network Admins]] | [[Network survival guide]]}}
{{Portal|Network}}
== Plans ==
{{Portal|User}}
 
'''See also:''' [[Luxembourg:Hardware|Hardware description for Luxembourg]]
 
= Overview of Ethernet network topology =
 
[[File:LuxembourgNetwork.svg|300px]]
 
{{:Luxembourg:GeneratedNetwork}}


== General overview ==
== General overview ==
Line 13: Line 21:


* A Core Layer 2 / 3 switch of type Cisco Catalyst 6506E, including one single supervisor (VS-S720-10G) and two line Gigabit copper cards (WS-X6748-GE-TX). This Switch is connecting :
* A Core Layer 2 / 3 switch of type Cisco Catalyst 6506E, including one single supervisor (VS-S720-10G) and two line Gigabit copper cards (WS-X6748-GE-TX). This Switch is connecting :
** the 22 computing Nodes in 1GbE mode to the ''prod'' VLAN
** the 38 computing Nodes in 1GbE mode to the ''prod'' VLAN
** the 22 computing Nodes in 1GbE mode to the ''admin'' VLAN
** the 38 computing Nodes in 1GbE mode to the ''admin'' VLAN
** the different frontends and the NFS server (in both ''prod'' and ''admin'' VLAN)
** the NFS server (in both ''prod'' and ''admin'' VLAN)
** the Adminfront server (in ''prod'', ''admin'', and ''nat'' VLAN)
** the Renater backbone (VLAN 550)
** the Renater backbone (VLAN 550)
** the University of Luxembourg network
* A server farm of type Cisco Nexus 5020, responsible for connecting the 22 granduc nodes in 10GbE mode
* A server farm of type Cisco Nexus 5020, responsible for connecting the 22 computing nodes in 10GbE mode (VLAN ''hsc'')
 
The global architecture and network organization is based on the [[Network Golden rules]]


== Connectivity to GRID5000 ==
== Connectivity to GRID5000 ==


The connectivity to GRID 5000 is operated by the RESTENA foundation (for the luxembourgian side) in collaboration with Renater.
The connectivity to GRID 5000 is operated by the RESTENA foundation (for the Luxembourgian side) in collaboration with Renater.
The dedicated Grid5000 line has been prolongated from Nancy toward Luxembourg (see [[Network_interlink#Routing tables|Global network map]]) via Esch/Elzette.
The dedicated Grid5000 line has been propagated from Nancy toward Luxembourg (see [[Grid5000:Network|Global network map]]) via Esch/Alzette.
 
== VLANs ==
 
=== Overview ===
 
{| border="1" cellpadding="5" cellspacing="0" align="center"
|-
! scope="col" style="background: #efefef;" | VLAN
! scope="col" style="background: #efefef;" | Name
! scope="col" style="background: #efefef;" | Description
! scope="col" style="background: #efefef;" | Network
|-
| VLAN 10 || admin || Administration network (BMC interfaces + eth1 on each server) || 172.17.176.0/20
|-
| VLAN 30 || prod ||  Production network (all nodes ethernet interfaces + eth0 on each server/virtual machine) || 172.16.176.0/20
|-
| VLAN 40 || UL_DMZprivate ||  Gateway to the UL internal DMZ || 10.74.0.0/16
|-
| VLAN 50 || hsc ||  High speed computing network (10GbE) || 192.168.14.0/23
|-
| VLAN 550 || Grid5000 ||  Gateway to Grid5000/Renater 5 || 192.168.4.0/24
|- 
| VLAN 1000 || BLACKHOLE ||  local usage, unused ports || n/a
|-
|}
 
=== Network routing ===
 
==== VLAN <code class='host'>prod</code>: '''172.16.176.0/20''' ====
* Computing nodes
** eth0 (1GbE) 172.16.176.0/23
** eth1 (1GbE) 172.16.178.0/23
* Gateway: 172.16.191.254 (SUP720-10G)
* Servers 172.16.191.0/24
** phys. eth0 (1GbE) 172.16.191.[1-99]
** virtual eth0 (1GbE) 172.16.191.[100-199]
 
====  VLAN <code class='host'>admin</code>: '''172.17.176.0/20''' ====
* Computing nodes
** BMC: 172.17.176.0/23
* Gateway: 172.17.191.254  (SUP720-10G)
* Servers 172.17.190.0/23
** BMC: 172.17.190.0/24
** phys. eth1 (1GbE) 172.16.191.[1-99]
** virtual eth1 (1GbE) 172.16.191.[100-199]
 
====  VLAN <code class='host'>hsc</code>: '''192.168.14.0/23''' ====
* Computing nodes
** eth2 (10GbE): 192.168.14.0/23
* Gateway: 192.168.15.254 ( SUP720-10G DHCP Serveur)
 
The Core Switch (Cisco C6506E) is also acting as a DHCP Server for the Computing Nodes in the <code class='host'>hsc</code> VLAN.
As the Nexus device is not DHCP Server capable, the <code class='host'>hsc</code> VLAN had been extended (using the interface ''172.17.191.253'' belonging to the <code class='host'>admin</code> VLAN on the nexus) to the Core switch which act as DHCP Server.
The <code class='host'>hsc</code> segment is never routed among the network.
 
====  VLAN <code class='host'>grid5000</code>: '''192.168.4.0/24''' ====
* Gateway (Luxembourg) : 192.168.4.21 ( SUP720-10G ), other site gateways: see [[Renater5]]
 
==== VLAN <code class='host'>ext</code>: '''10.74.0.0/16''' ====
* Connection to the network of the University of Luxembourg
* Gateway 10.74.0.1 (FWSM UNI)

Latest revision as of 17:26, 8 March 2024

Network: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse

See also: Hardware description for Luxembourg

Overview of Ethernet network topology

LuxembourgNetwork.svg


Network devices models

  • gw-kirchberg: cisco WS-C6506-E
  • gw: cisco Nexus9000 C93240YC-FX2
  • mxl1: Force10 MXL
  • mxl2: Force10 MXL
  • sw-b04: cisco Nexus9000 C93180YC-FX3
  • sw-b09: cisco Nexus9000 C93180YC-FX3
  • ul-grid5000-sw02: cisco N5K-C5020P-BF

More details (including address ranges) are available from the Grid5000:Network page.

General overview

Cluster Lux5000.png

PDF version: Cluster Lux5000.pdf

Network Architecture

The Luxembourg site is built over two central network components:

  • A Core Layer 2 / 3 switch of type Cisco Catalyst 6506E, including one single supervisor (VS-S720-10G) and two line Gigabit copper cards (WS-X6748-GE-TX). This Switch is connecting :
    • the 38 computing Nodes in 1GbE mode to the prod VLAN
    • the 38 computing Nodes in 1GbE mode to the admin VLAN
    • the NFS server (in both prod and admin VLAN)
    • the Adminfront server (in prod, admin, and nat VLAN)
    • the Renater backbone (VLAN 550)
  • A server farm of type Cisco Nexus 5020, responsible for connecting the 22 granduc nodes in 10GbE mode

Connectivity to GRID5000

The connectivity to GRID 5000 is operated by the RESTENA foundation (for the Luxembourgian side) in collaboration with Renater. The dedicated Grid5000 line has been propagated from Nancy toward Luxembourg (see Global network map) via Esch/Alzette.

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Luxembourg:Network&oldid=102269"