Two ETBs (TCMS and multimedia) with two non-redundant consists HowTo

This document describes how to configure two ETBs (TCMS/ETB0 and multimedia/ETB1) with two non-redundant consists.

See Figure 1 below

                            ETB0 (TCMS)
                      = CST1 =  |   = CST2 =
                     .-------.  |  .-------.
                    /  UUID1  \ | /  UUID2  \
                    '---------' | '---------'
                     .-------.  |  .-------.
                   --+       +-----+       +--     dir1 = (ethX5, ethX6)
               <-dir1| etbn1 |  |  | etbn2 |dir2-> dir2 = (ethX7, ethX8)
                   --+       +-----+       +--
                     '-+-----'  |  '-+-----'
                   CN1 |        |    |     CN1
                   ----+---+--  |   -+----+---
                           |    |         |
10.128.64.200/21     .-----+-.  |     .---+---. 10.128.128.200/21
10.0.0.200/21 (ETB0) |       |  |     |       | 10.0.0.200/21 (ETB0)
                     |  gw1  |  |     |  gw2  |
10.0.8.200/21 (ETB1) |       |  |     |       | 10.0.8.200/21 (ETB1)
10.160.64.200/21     '-+-----'  |     '---+---' 10.160.128.200/21
                       |        |         |
                   ----+---+--  |   -+----+---
                       CN1 |    |    |     CN1
                     .-------.  |  .-+-----.
                   --+       +-----+       +--     dir1 = (ethX5, ethX6)
               <-dir1| etbn3 |  |  | etbn4 |dir2-> dir2 = (ethX7, ethX8)
                   --+       +-----+       +--
                     '-+--+--'  |  '-------'
                     .-------.  |  .-------.
                    /  UUID1  \ | /  UUID2  \
                    '---------' | '---------'
                     = CST1 =   |  = CST2 =
                          ETB1 (multimedia)

Figure 1: Two ETBs (TCMS and multimedia) with two non-redundant consists, topology.

Setting up a multiple ETB system consists of three parts:

  1. ETB0 configuration
  2. ETB1 configuration
  3. Gateway configuration

ETB0 configuration

First, configure etbn1, the node in the first consist, CST1, on ETB0 (TCMS).

etbn1:#> configure
etbn1:/config/#> vlan 1
Creating new VLAN vid:1 with name: vlan1
etbn1:/config/vlan-1/#> untagged ethX3
etbn1:/config/vlan-1/#> end
etbn1:/config/#> iface vlan1
etbn1:/config/iface-vlan1/#> no inet
etbn1:/config/iface-vlan1/#> inet static 10.0.0.1/21
etbn1:/config/iface-vlan1/inet-static-10.0.0.1/#> end
etbn1:/config/iface-vlan1/#> end
etbn1:/config/#> ttdp
Activating TTDP with default settings.
DNS Server activated
etbn1:/config/ttdp/#> uuid 11111111-1111-1111-1111-111111111111
etbn1:/config/ttdp/#> node 1 ecn 1
etbn1:/config/ttdp/#> ecn 1 vlan1
etbn1:/config/ttdp/#> dir1 ethX5,ethX6
Remember to manually set mdi/mdi-x mode
  in port settings for all agg ports.
etbn1:/config/ttdp/#> dir2 ethX7,ethX8
Remember to manually set mdi/mdi-x mode
  in port settings for all agg ports.
etbn1:/config/ttdp/#> local-id 1
etbn1:/config/ttdp/#> backbone-id tcms
etbn1:/config/ttdp/#> etb tcms
etbn1:/config/ttdp/etb-tcms/#> cn-network 10.0.0.0/21
etbn1:/config/ttdp/etb-tcms/#> gw-addr 10.0.0.200
etbn1:/config/ttdp/etb-tcms/#> req-addr 10.0.8.1
etbn1:/config/ttdp/etb-tcms/#> end
etbn1:/config/ttdp/#> etb multimedia
etbn1:/config/ttdp/etb-mm/#> cn-network 10.0.8.0/21
etbn1:/config/ttdp/etb-mm/#> gw-addr 10.0.8.200
etbn1:/config/ttdp/etb-mm/#> req-addr 10.0.0.1
etbn1:/config/ttdp/etb-mm/#> end
etbn1:/config/ttdp/#> end
TTDP: Created VLAN 492. Note that this VLAN will not be deleted automatically
  if TTDP is deactivated.
etbn1:/config/#> vlan 2
Creating new VLAN vid:2 with name: vlan2
etbn1:/config/vlan-2/#> no multicast-snooping
etbn1:/config/vlan-2/#> untagged lag-dir1,lag-dir2
etbn1:/config/vlan-2/#> end
etbn1:/config/#> end
Applying configuration.
Configuration activated.  Remember "copy run start" to save to flash (NVRAM).
etbn1:/#>

Configure etbn2, the node in the second consist, CST2, on ETB0 (TCMS). For brevity, only the steps that differ from configuring etbn1 will be shown below.

...
etbn2:/config/ttdp/#> uuid 22222222-2222-2222-2222-222222222222
...

ETB1 configuration

Configure etbn3, the node in the first consist, CST1, on ETB1 (multimedia). For brevity, only the steps that differ from configuring etbn1 will be shown below.

...
etbn3:/config/#> iface vlan1
etbn3:/config/iface-vlan1/#> no inet
etbn3:/config/iface-vlan1/#> inet static 10.0.8.1/21
etbn3:/config/iface-vlan1/inet-static-10.0.8.1/#> end
etbn3:/config/iface-vlan1/#> end
...
etbn3:/config/ttdp/#> uuid 11111111-1111-1111-1111-111111111111
...
etbn3:/config/ttdp/#> backbone-id multimedia
...

Configure etbn4, the node in the second consist, CST2, on ETB1 (multimedia). For brevity, only the steps that differ from configuring etbn1 will be shown below.

...
etbn4:/config/#> iface vlan1
etbn4:/config/iface-vlan1/#> no inet
etbn4:/config/iface-vlan1/#> inet static 10.0.8.1/21
etbn4:/config/iface-vlan1/inet-static-10.0.8.1/#> end
etbn4:/config/iface-vlan1/#> end
...
etbn4:/config/ttdp/#> uuid 22222222-2222-2222-2222-222222222222
...
etbn4:/config/ttdp/#> backbone-id multimedia
...

Gateway configuration

The gateways connecting the two ETBs can be either WeOS devices or customer-specific devices running other software. For requirements on this software in the latter case, see below. For WeOS gateways, configure the nodes as follows.

Using WeOS as gateways

gw1:#> configure
gw1:/config/#> vlan 1
Creating new VLAN vid:1 with name: vlan1
gw1:/config/vlan-1/#> untagged ethX3
gw1:/config/vlan-1/#> end
gw1:/config/#> iface vlan1
gw1:/config/iface-vlan1/#> no inet
gw1:/config/iface-vlan1/#> inet static 10.0.0.200/21
gw1:/config/iface-vlan1/inet-static-10.0.0.200/#> end
gw1:/config/iface-vlan1/#> end
gw1:/config/#> vlan 2
Creating new VLAN vid:2 with name: vlan2
gw1:/config/vlan-1/#> untagged ethX4
gw1:/config/vlan-1/#> end
gw1:/config/#> iface vlan2
gw1:/config/iface-vlan2/#> no inet
gw1:/config/iface-vlan2/#> inet static 10.0.8.200/21
gw1:/config/iface-vlan2/inet-static-10.0.8.200/#> end
gw1:/config/iface-vlan2/#> end
gw1:/config/#> ip
gw1:/config/ip/#> multicast-forwarding
gw1:/config/ip/#> mroute group 239.194.0.0 in vlan1 out vlan2
gw1:/config/ip/#> route 10.160.0.0/11 10.0.8.1
gw1:/config/ip/#> route 10.128.0.0/11 10.0.0.1
gw1:/config/ip/#> end
gw1:/config/#> end
gw1:/config/#> end
Applying configuration.
Configuration activated.  Remember "copy run start" to save to flash (NVRAM).
gw1:/#>

Do the exact same configuration on the second gateway (gw2).

Using customer specific gateways

The multiple ETB implementation assumes that the gateways:

1) are configured to be part of the CN on ETB0 (subnet 10.0.0.0/21) and ETB1 (subnet 10.0.8.0/21)

2) have a CN address of 10.0.0.200 and 10.0.8.200 on ETB0 and ETB1 CNs respectively.

3) have the following IP routes configured - 10.128.0.0/11 via 10.0.0.1 (local master router on etb0 side CN) - 10.160.0.0/11 via 10.0.8.1 (local master router on etb1 side CN) - 10.0.0.0/21 on the etb0 side - 10.0.8.0/21 on the etb1 side

4) do multicast join on the group 239.194.0.0 on ETB0

5) forward all relevant TRDP telegrams between ETB0 and ETB1. This step is crucial, and the set of relevant telegrams will depend on the specific application. However, in general, the TRDP telegrams with ComIDs 100 - 111 inclusive are required for TTDB synchronisation.

Note

See Port configuration on how to set MDI/MDIX on the aggregate ports.