【Nexus】Part 9 – EVPN/VXLAN ES MH
今回はNXOSにおいてEVPN/VXLANでESI(Ethernet Segment Identifier)を用いてマルチホーミングを行ってみます。
EVPN/VXLANの基本については前々回の記事をご参考にいただければと思います。
＊Nexus9000vシリーズの記事のまとめはこちらから
＊Nexus 9000vはversion 9.3(1)を元に動作確認を行っています。
EVPN/VXLAN マルチホーミング
前々回同様、Loopbackアドレスの配布のためアンダーレイプロトコルには、物理IPでのBGP peer(address-family ipv4)を確立しています。
ES(Ethernet Segment)周りについては、以下のドキュメントを参考にコンフィグレーションをしています。基本設定として、マルチホーミングを行うデバイスの該当IF上でポートチャネルを作成し、それぞれ同一のESIを設定します。
VXLAN EVPN Multihoming Overview Introduction to Multihoming
https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus9000/sw/93x/vxlan/configuration/guide/b-cisco-nexus-9000-series-nx-os-vxlan-configuration-guide-93x/b-cisco-nexus-9000-series-nx-os-vxlan-configuration-guide-93x_appendix_011001.html
また上記ドキュメントに記載がありますが、アップリンクにはトラッキング(evpn multihoming core-tracking)を有効にし、アップリンクが全て落ちたときにマルチホーミングIFを落としてブラックホールを防止します。
アンダーレイ構成図
オーバレイ構成図
確認項目
各端末間で疎通できることを確認
各機器のコンフィグクレーション
NXOS1 – Spine1
hostname NXOS1
nv overlay evpn
feature bgp
route-map permitall permit 10
set ip next-hop unchanged
interface Ethernet1/1
no switchport
mac-address 5000.0003.0001
ip address 192.168.1.42/24
no shutdown
interface Ethernet1/2
no switchport
mac-address 5000.0003.0001
ip address 192.168.3.42/24
no shutdown
interface Ethernet1/3
no switchport
mac-address 5000.0003.0001
ip address 192.168.5.42/24
no shutdown
interface loopback0
ip address 10.1.1.1/32
router bgp 100
router-id 10.1.1.1
address-family ipv4 unicast
network 10.1.1.1/32
address-family l2vpn evpn
nexthop route-map permitall
retain route-target all
neighbor 30.1.1.1
remote-as 200
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
disable-peer-as-check
send-community extended
route-map permitall out
neighbor 40.1.1.1
remote-as 200
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
disable-peer-as-check
send-community extended
route-map permitall out
neighbor 40.1.1.2
remote-as 200
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
disable-peer-as-check
send-community extended
route-map permitall out
neighbor 192.168.1.43
remote-as 200
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
neighbor 192.168.3.43
remote-as 200
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
neighbor 192.168.5.43
remote-as 200
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
NXOS2 – Spine2
hostname NXOS2
nv overlay evpn
feature bgp
route-map permitall permit 10
set ip next-hop unchanged
interface Ethernet1/1
no switchport
mac-address 5000.0003.0002
ip address 192.168.2.42/24
no shutdown
interface Ethernet1/2
no switchport
mac-address 5000.0003.0002
ip address 192.168.4.42/24
no shutdown
interface Ethernet1/3
no switchport
mac-address 5000.0003.0002
ip address 192.168.6.42/24
no shutdown
interface loopback0
ip address 20.1.1.1/32
router bgp 100
router-id 20.1.1.1
address-family ipv4 unicast
network 20.1.1.1/32
address-family l2vpn evpn
retain route-target all
neighbor 30.1.1.1
remote-as 200
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
disable-peer-as-check
send-community extended
route-map permitall out
neighbor 40.1.1.1
remote-as 200
ebgp-multihop 3
address-family l2vpn evpn
disable-peer-as-check
send-community extended
route-map permitall out
neighbor 40.1.1.2
remote-as 200
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
disable-peer-as-check
send-community extended
route-map permitall out
neighbor 192.168.2.43
remote-as 200
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
neighbor 192.168.4.43
remote-as 200
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
neighbor 192.168.6.43
remote-as 200
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
NXOS3 – Leaf1
hostname NXOS3
nv overlay evpn
feature bgp
feature interface-vlan
feature vn-segment-vlan-based
feature lacp
feature nv overlay
fabric forwarding anycast-gateway-mac 0000.2222.3333
vlan 1,101,1001-1002
vlan 101
vn-segment 900001
vlan 1001
vn-segment 2001001
vlan 1002
vn-segment 2001002
vrf context vxlan-900001
vni 900001
rd auto
address-family ipv4 unicast
route-target import 65535:101
route-target import 65535:101 evpn
route-target export 65535:101
route-target export 65535:101 evpn
address-family ipv6 unicast
route-target import 65535:101
route-target import 65535:101 evpn
route-target export 65535:101
route-target export 65535:101 evpn
hardware access-list tcam region vpc-convergence 256
interface Vlan101
no shutdown
vrf member vxlan-900001
ip forward
interface Vlan1001
no shutdown
vrf member vxlan-900001
ip address 4.1.1.1/24
ipv6 address 4:1:0:1::1/64
fabric forwarding mode anycast-gateway
interface Vlan1002
no shutdown
vrf member vxlan-900001
ip address 4.2.2.1/24
ipv6 address 4:2:0:1::1/64
fabric forwarding mode anycast-gateway
interface nve1
no shutdown
host-reachability protocol bgp
source-interface loopback0
member vni 900001 associate-vrf
member vni 2001001
ingress-replication protocol bgp
member vni 2001002
ingress-replication protocol bgp
interface Ethernet1/1
no switchport
mac-address 5000.0003.0003
ip address 192.168.1.43/24
no shutdown
interface Ethernet1/2
no switchport
mac-address 5000.0003.0003
ip address 192.168.2.43/24
no shutdown
interface Ethernet1/3
switchport access vlan 1001
interface Ethernet1/4
switchport access vlan 1002
interface loopback0
ip address 30.1.1.1/32
router bgp 200
router-id 30.1.1.1
address-family ipv4 unicast
network 30.1.1.1/32
address-family l2vpn evpn
maximum-paths 64
maximum-paths ibgp 64
neighbor 10.1.1.1
remote-as 100
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
allowas-in 3
send-community extended
neighbor 20.1.1.1
remote-as 100
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
allowas-in 3
send-community extended
neighbor 192.168.1.42
remote-as 100
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
neighbor 192.168.2.42
remote-as 100
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
vrf vxlan-900001
neighbor 10.1.1.1
remote-as 100
evpn
vni 2001001 l2
rd 30.1.1.1:1001
route-target import 30.1.1.1:1001
route-target export 30.1.1.1:1001
vni 2001002 l2
rd 30.1.1.1:1002
route-target import 30.1.1.1:1002
route-target export 30.1.1.1:1002
NXOS4 – Leaf2
hostname NXOS4
nv overlay evpn
feature bgp
feature interface-vlan
feature vn-segment-vlan-based
feature lacp
feature nv overlay
evpn esi multihoming
ethernet-segment delay-restore time 180
fabric forwarding anycast-gateway-mac 0000.2222.3333
vlan 1,101,1001-1002
vlan 101
vn-segment 900001
vlan 1001
vn-segment 2001001
vlan 1002
vn-segment 2001002
vrf context vxlan-900001
vni 900001
rd auto
address-family ipv4 unicast
route-target import 65535:101
route-target import 65535:101 evpn
route-target export 65535:101
route-target export 65535:101 evpn
address-family ipv6 unicast
route-target import 65535:101
route-target import 65535:101 evpn
route-target export 65535:101
route-target export 65535:101 evpn
hardware access-list tcam region vpc-convergence 256
interface Vlan101
no shutdown
vrf member vxlan-900001
ip forward
interface Vlan1001
no shutdown
vrf member vxlan-900001
ip address 4.1.1.1/24
ipv6 address 4:1:0:1::1/64
fabric forwarding mode anycast-gateway
interface Vlan1002
no shutdown
vrf member vxlan-900001
ip address 4.2.2.1/24
ipv6 address 4:2:0:1::1/64
fabric forwarding mode anycast-gateway
interface nve1
no shutdown
host-reachability protocol bgp
source-interface loopback0
member vni 900001 associate-vrf
member vni 2001001
ingress-replication protocol bgp
member vni 2001002
ingress-replication protocol bgp
interface port-channel1
switchport mode trunk
switchport trunk allowed vlan 1,1001,1002
ethernet-segment 2011
system-mac 0000.0000.2011
interface Ethernet1/1
no switchport
evpn multihoming core-tracking
mac-address 5000.0003.0004
ip address 192.168.3.43/24
no shutdown
interface Ethernet1/2
no switchport
evpn multihoming core-tracking
mac-address 5000.0003.0004
ip address 192.168.4.43/24
no shutdown
interface Ethernet1/3
switchport mode trunk
switchport trunk allowed vlan 1,1001,1002
channel-group 1
interface loopback0
ip address 40.1.1.1/32
router bgp 200
router-id 40.1.1.1
address-family ipv4 unicast
network 40.1.1.1/32
address-family l2vpn evpn
maximum-paths 64
maximum-paths ibgp 64
neighbor 10.1.1.1
remote-as 100
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
allowas-in 3
send-community extended
neighbor 20.1.1.1
remote-as 100
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
allowas-in 3
send-community extended
neighbor 192.168.3.42
remote-as 100
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
neighbor 192.168.4.42
remote-as 100
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
vrf vxlan-900001
evpn
vni 2001001 l2
rd 30.1.1.1:1001
route-target import 30.1.1.1:1001
route-target export 30.1.1.1:1001
vni 2001002 l2
rd 30.1.1.1:1002
route-target import 30.1.1.1:1002
route-target export 30.1.1.1:1002
NXOS5 – Leaf3 vPC2
hostname NXOS5
nv overlay evpn
feature bgp
feature interface-vlan
feature vn-segment-vlan-based
feature lacp
feature nv overlay
fabric forwarding anycast-gateway-mac 0000.2222.3333
vlan 1,101,1001-1002
vlan 101
vn-segment 900001
vlan 1001
vn-segment 2001001
vlan 1002
vn-segment 2001002
vrf context vxlan-900001
vni 900001
rd 30.1.1.1:1
address-family ipv4 unicast
route-target import 65535:101
route-target import 65535:101 evpn
route-target export 65535:101
route-target export 65535:101 evpn
address-family ipv6 unicast
route-target import 65535:101
route-target import 65535:101 evpn
route-target export 65535:101
route-target export 65535:101 evpn
hardware access-list tcam region vpc-convergence 256
interface Vlan101
no shutdown
vrf member vxlan-900001
ip forward
interface Vlan1001
no shutdown
vrf member vxlan-900001
ip address 4.1.1.1/24
ipv6 address 4:1:0:1::1/64
fabric forwarding mode anycast-gateway
interface Vlan1002
no shutdown
vrf member vxlan-900001
ip address 4.2.2.1/24
ipv6 address 4:2:0:1::1/64
fabric forwarding mode anycast-gateway
interface nve1
no shutdown
host-reachability protocol bgp
source-interface loopback0
member vni 900001 associate-vrf
member vni 2001001
ingress-replication protocol bgp
member vni 2001002
ingress-replication protocol bgp
interface port-channel1
switchport mode trunk
switchport trunk allowed vlan 1,1001,1002
ethernet-segment 2011
system-mac 0000.0000.2011
interface Ethernet1/1
no switchport
evpn multihoming core-tracking
mac-address 5000.0003.0004
ip address 192.168.5.43/24
no shutdown
interface Ethernet1/2
no switchport
evpn multihoming core-tracking
mac-address 5000.0003.0004
ip address 192.168.6.43/24
no shutdown
interface Ethernet1/3
switchport mode trunk
switchport trunk allowed vlan 1,1001,1002
channel-group 1
interface loopback0
ip address 40.1.1.2/32
router bgp 200
router-id 40.1.1.2
address-family ipv4 unicast
network 40.1.1.2/32
address-family l2vpn evpn
maximum-paths 64
maximum-paths ibgp 64
neighbor 10.1.1.1
remote-as 100
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
allowas-in 3
send-community extended
neighbor 20.1.1.1
remote-as 100
update-source loopback0
ebgp-multihop 3
address-family l2vpn evpn
allowas-in 3
send-community extended
neighbor 192.168.5.42
remote-as 100
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
neighbor 192.168.6.42
remote-as 100
address-family ipv4 unicast
allowas-in 3
disable-peer-as-check
vrf vxlan-900001
evpn
vni 2001001 l2
rd 30.1.1.1:1001
route-target import 30.1.1.1:1001
route-target export 30.1.1.1:1001
vni 2001002 l2
rd 30.1.1.1:1002
route-target import 30.1.1.1:1002
route-target export 30.1.1.1:1002
オーバレイのステータス確認
NXOS1 – Spine1
NXOS1# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 10.1.1.1, local AS number 100
BGP table version is 677, L2VPN EVPN config peers 3, capable peers 3
20 network entries and 24 paths using 5280 bytes of memory
BGP attribute entries [18/2952], BGP AS path entries [1/6]
BGP community entries [0/0], BGP clusterlist entries [0/0]
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
30.1.1.1 4 200 269 175 677 0 0 01:51:48 6
40.1.1.1 4 200 413 206 677 0 0 00:10:01 9
40.1.1.2 4 200 372 246 677 0 0 00:38:56 9
NXOS1#
NXOS1# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 677, Local Router ID is 10.1.1.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 30.1.1.1:1001
* e[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.1 0 200 i
*>e 40.1.1.2 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6807]:[0]:[0.0.0.0]/216
30.1.1.1 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6809]:[0]:[0.0.0.0]/216
40.1.1.1 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6807]:[32]:[4.1.1.11]/272
30.1.1.1 0 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.6809]:[32]:[4.1.1.12]/272
40.1.1.1 0 200 i
*>e 40.1.1.2 0 200 i
*>e[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 0 200 i
*>e[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 0 200 i
*>e[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 0 200 i
Route Distinguisher: 30.1.1.1:1002
* e[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.1 0 200 i
*>e 40.1.1.2 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6808]:[0]:[0.0.0.0]/216
30.1.1.1 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.680a]:[0]:[0.0.0.0]/216
40.1.1.2 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6808]:[32]:[4.2.2.11]/272
30.1.1.1 0 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.680a]:[32]:[4.2.2.12]/272
40.1.1.2 0 200 i
*>e 40.1.1.1 0 200 i
*>e[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 0 200 i
*>e[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 0 200 i
*>e[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 0 200 i
Route Distinguisher: 40.1.1.1:7817
*>e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.1 0 200 i
Route Distinguisher: 40.1.1.1:27000
*>e[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.1]/136
40.1.1.1 0 200 i
Route Distinguisher: 40.1.1.2:7817
*>e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.2 0 200 i
Route Distinguisher: 40.1.1.2:27000
*>e[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.2]/136
40.1.1.2 0 200 i
NXOS1#
NXOS2 – Spine2
NXOS2# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 20.1.1.1, local AS number 100
BGP table version is 664, L2VPN EVPN config peers 3, capable peers 3
19 network entries and 23 paths using 5040 bytes of memory
BGP attribute entries [17/2788], BGP AS path entries [1/6]
BGP community entries [0/0], BGP clusterlist entries [0/0]
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
30.1.1.1 4 200 353 176 664 0 0 01:52:03 6
40.1.1.1 4 200 503 210 664 0 0 00:09:52 9
40.1.1.2 4 200 496 247 664 0 0 00:38:58 8
NXOS2#
NXOS2# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 664, Local Router ID is 20.1.1.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 30.1.1.1:1001
* e[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.1 0 200 i
*>e 40.1.1.2 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6807]:[0]:[0.0.0.0]/216
30.1.1.1 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6809]:[0]:[0.0.0.0]/216
40.1.1.1 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6807]:[32]:[4.1.1.11]/272
30.1.1.1 0 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.6809]:[32]:[4.1.1.12]/272
40.1.1.1 0 200 i
*>e 40.1.1.2 0 200 i
*>e[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 0 200 i
*>e[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 0 200 i
*>e[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 0 200 i
Route Distinguisher: 30.1.1.1:1002
* e[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.1 0 200 i
*>e 40.1.1.2 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6808]:[0]:[0.0.0.0]/216
30.1.1.1 0 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6808]:[32]:[4.2.2.11]/272
30.1.1.1 0 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.680a]:[32]:[4.2.2.12]/272
40.1.1.2 0 200 i
*>e 40.1.1.1 0 200 i
*>e[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 0 200 i
*>e[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 0 200 i
*>e[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 0 200 i
Route Distinguisher: 40.1.1.1:7817
*>e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.1 0 200 i
Route Distinguisher: 40.1.1.1:27000
*>e[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.1]/136
40.1.1.1 0 200 i
Route Distinguisher: 40.1.1.2:7817
*>e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.2 0 200 i
Route Distinguisher: 40.1.1.2:27000
*>e[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.2]/136
40.1.1.2 0 200 i
NXOS2#
NXOS3 – Leaf1
NXOS3# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 30.1.1.1, local AS number 200
BGP table version is 839, L2VPN EVPN config peers 2, capable peers 2
20 network entries and 32 paths using 5760 bytes of memory
BGP attribute entries [18/2952], BGP AS path entries [1/10]
BGP community entries [0/0], BGP clusterlist entries [0/0]
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
10.1.1.1 4 100 452 162 839 0 0 01:52:07 11
20.1.1.1 4 100 457 181 839 0 0 01:52:12 11
NXOS3#
NXOS3# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 839, Local Router ID is 30.1.1.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 30.1.1.1:1001 (L2VNI 2001001)
*>e[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.2 0 100 200 i
* e 40.1.1.2 0 100 200 i
*>l[2]:[0]:[0]:[48]:[0050.7966.6807]:[0]:[0.0.0.0]/216
30.1.1.1 100 32768 i
* e[2]:[0]:[0]:[48]:[0050.7966.6809]:[0]:[0.0.0.0]/216
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
*>l[2]:[0]:[0]:[48]:[0050.7966.6807]:[32]:[4.1.1.11]/272
30.1.1.1 100 32768 i
* e[2]:[0]:[0]:[48]:[0050.7966.6809]:[32]:[4.1.1.12]/272
40.1.1.2 0 100 200 i
*>e 40.1.1.2 0 100 200 i
*>l[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 100 32768 i
* e[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
* e[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 0 100 200 i
*>e 40.1.1.2 0 100 200 i
Route Distinguisher: 30.1.1.1:1002 (L2VNI 2001002)
*>e[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.2 0 100 200 i
* e 40.1.1.2 0 100 200 i
*>l[2]:[0]:[0]:[48]:[0050.7966.6808]:[0]:[0.0.0.0]/216
30.1.1.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[0050.7966.6808]:[32]:[4.2.2.11]/272
30.1.1.1 100 32768 i
* e[2]:[0]:[0]:[48]:[0050.7966.680a]:[32]:[4.2.2.12]/272
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
*>l[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 100 32768 i
* e[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
* e[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 0 100 200 i
*>e 40.1.1.2 0 100 200 i
Route Distinguisher: 30.1.1.1:65534 (L2VNI 0)
*|e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.1 0 100 200 i
*>e 40.1.1.2 0 100 200 i
Route Distinguisher: 40.1.1.1:7817
* e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
Route Distinguisher: 40.1.1.2:7817
* e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.2 0 100 200 i
*>e 40.1.1.2 0 100 200 i
Route Distinguisher: 30.1.1.1:3 (L3VNI 900001)
*>e[2]:[0]:[0]:[48]:[0050.7966.6809]:[32]:[4.1.1.12]/272
40.1.1.2 0 100 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.680a]:[32]:[4.2.2.12]/272
40.1.1.1 0 100 200 i
NXOS3#
NXOS3# show system internal l2fwder mac
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link,
(T) - True, (F) - False, C - ControlPlane MAC
VLAN MAC Address Type age Secure NTFY Ports
---------+-----------------+--------+---------+------+----+------------------
* 1001 0050.7966.6807 dynamic 00:03:13 F F Eth1/3
* 1002 0050.7966.680a static - F F nve-peer1 40.1.1.1
G - 5000:0003:0003 static - F F sup-eth1(R)
* 1001 0050.7966.6809 static - F F nve-peer1 40.1.1.1
* 1002 0050.7966.6808 dynamic 00:03:25 F F Eth1/4
G 1001 5000.0003.0007 static - F F sup-eth1(R)
G 1002 5000.0003.0007 static - F F sup-eth1(R)
1 1 -00:00:22:22:33:33 - 1
NXOS3#
NXOS3# show ip route vrf vxlan-900001
IP Route Table for VRF "vxlan-900001"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
4.1.1.0/24, ubest/mbest: 1/0, attached
*via 4.1.1.1, Vlan1001, [0/0], 01:54:46, direct
4.1.1.1/32, ubest/mbest: 1/0, attached
*via 4.1.1.1, Vlan1001, [0/0], 01:54:46, local
4.1.1.11/32, ubest/mbest: 1/0, attached
*via 4.1.1.11, Vlan1001, [190/0], 01:43:23, hmm
4.1.1.12/32, ubest/mbest: 1/0
*via 40.1.1.2%default, [20/0], 00:13:18, bgp-200, external, tag 100 (evpn) segid: 900001 tunnelid: 0x28010102 encap: VXLAN
4.2.2.0/24, ubest/mbest: 1/0, attached
*via 4.2.2.1, Vlan1002, [0/0], 01:54:46, direct
4.2.2.1/32, ubest/mbest: 1/0, attached
*via 4.2.2.1, Vlan1002, [0/0], 01:54:46, local
4.2.2.11/32, ubest/mbest: 1/0, attached
*via 4.2.2.11, Vlan1002, [190/0], 01:43:32, hmm
4.2.2.12/32, ubest/mbest: 1/0
*via 40.1.1.1%default, [20/0], 00:01:06, bgp-200, external, tag 100 (evpn) segid: 900001 tunnelid: 0x28010101 encap: VXLAN
NXOS3#
NXOS3# show ip arp vrf vxlan-900001
Flags: * - Adjacencies learnt on non-active FHRP router
+ - Adjacencies synced via CFSoE
# - Adjacencies Throttled for Glean
CP - Added via L2RIB, Control plane Adjacencies
PS - Added via L2RIB, Peer Sync
RO - Re-Originated Peer Sync Entry
D - Static Adjacencies attached to down interface
IP ARP Table for context vxlan-900001
Total number of entries: 2
Address Age MAC Address Interface Flags
4.2.2.11 00:00:59 0050.7966.6808 Vlan1002
4.1.1.11 00:01:08 0050.7966.6807 Vlan1001
NXOS3#
NXOS3# show nve peers
Interface Peer-IP State LearnType Uptime Router-Mac
--------- -------------------------------------- ----- --------- -------- -----------------
nve1 40.1.1.1 Up CP 00:10:01 5000.0004.0007
nve1 40.1.1.2 Up CP 00:39:07 5000.0005.0007
NXOS3#
NXOS3# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
SU - Suppress Unknown Unicast
Xconn - Crossconnect
MS-IR - Multisite Ingress Replication
Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 900001 n/a Up CP L3 [vxlan-900001]
nve1 2001001 UnicastBGP Up CP L2 [1001]
nve1 2001002 UnicastBGP Up CP L2 [1002]
NXOS3#
NXOS4 – Leaf2 vPC1
NXOS4# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 40.1.1.1, local AS number 200
BGP table version is 94, L2VPN EVPN config peers 2, capable peers 2
23 network entries and 39 paths using 6960 bytes of memory
BGP attribute entries [22/3608], BGP AS path entries [1/10]
BGP community entries [0/0], BGP clusterlist entries [0/0]
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
10.1.1.1 4 100 64 26 94 0 0 00:11:09 13
20.1.1.1 4 100 64 25 94 0 0 00:10:49 13
NXOS4#
NXOS4# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 94, Local Router ID is 40.1.1.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 30.1.1.1:1001 (L2VNI 2001001)
* e[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.2 0 100 200 i
* e 40.1.1.2 0 100 200 i
*>l 40.1.1.1 100 32768 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6807]:[0]:[0.0.0.0]/216
30.1.1.1 0 100 200 i
* e 30.1.1.1 0 100 200 i
*>l[2]:[0]:[0]:[48]:[0050.7966.6809]:[0]:[0.0.0.0]/216
40.1.1.1 100 32768 i
* e[2]:[0]:[0]:[48]:[0050.7966.6807]:[32]:[4.1.1.11]/272
30.1.1.1 0 100 200 i
*>e 30.1.1.1 0 100 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.6809]:[32]:[4.1.1.12]/272
40.1.1.2 0 100 200 i
* e 40.1.1.2 0 100 200 i
*>l 40.1.1.1 100 32768 i
* e[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 0 100 200 i
*>e 30.1.1.1 0 100 200 i
*>l[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 100 32768 i
* e[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 0 100 200 i
*>e 40.1.1.2 0 100 200 i
Route Distinguisher: 30.1.1.1:1002 (L2VNI 2001002)
* e[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.2 0 100 200 i
* e 40.1.1.2 0 100 200 i
*>l 40.1.1.1 100 32768 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6808]:[0]:[0.0.0.0]/216
30.1.1.1 0 100 200 i
* e 30.1.1.1 0 100 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.6808]:[32]:[4.2.2.11]/272
30.1.1.1 0 100 200 i
*>e 30.1.1.1 0 100 200 i
*>l[2]:[0]:[0]:[48]:[0050.7966.680a]:[32]:[4.2.2.12]/272
40.1.1.1 100 32768 i
* e[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 0 100 200 i
*>e 30.1.1.1 0 100 200 i
*>l[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 100 32768 i
* e[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 0 100 200 i
*>e 40.1.1.2 0 100 200 i
Route Distinguisher: 40.1.1.1:27000 (ES [0300.0000.0020.1100.07db 0])
*>l[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.1]/136
40.1.1.1 100 32768 i
*>e[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.2]/136
40.1.1.2 0 100 200 i
Route Distinguisher: 40.1.1.1:65534 (L2VNI 0)
*>e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.2 0 100 200 i
Route Distinguisher: 40.1.1.2:7817
* e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.2 0 100 200 i
*>e 40.1.1.2 0 100 200 i
Route Distinguisher: 40.1.1.2:27000
* e[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.2]/136
40.1.1.2 0 100 200 i
*>e 40.1.1.2 0 100 200 i
Route Distinguisher: 40.1.1.1:7817 (EAD-ES [0300.0000.0020.1100.07db 7817])
*>l[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.1 100 32768 i
Route Distinguisher: 40.1.1.1:3 (L3VNI 900001)
*>e[2]:[0]:[0]:[48]:[0050.7966.6807]:[32]:[4.1.1.11]/272
30.1.1.1 0 100 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6808]:[32]:[4.2.2.11]/272
30.1.1.1 0 100 200 i
NXOS4#
NXOS4# show system internal l2fwder mac
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link,
(T) - True, (F) - False, C - ControlPlane MAC
VLAN MAC Address Type age Secure NTFY Ports
---------+-----------------+--------+---------+------+----+------------------
* 1001 0050.7966.6807 static - F F nve-peer1 30.1.1.1
G 101 5000.0004.0007 static - F F sup-eth1(R)
G 1001 5000.0004.0007 static - F F sup-eth1(R)
G 1002 5000.0004.0007 static - F F sup-eth1(R)
* 1001 0050.7966.6809 dynamic 00:01:47 F F Po1
G - 5000:0003:0004 static - F F sup-eth1(R)
* 1002 0050.7966.6808 static - F F nve-peer1 30.1.1.1
1 1 -00:00:22:22:33:33 - 1
NXOS4#
NXOS4# show ip route vrf vxlan-900001
IP Route Table for VRF "vxlan-900001"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
4.1.1.0/24, ubest/mbest: 1/0, attached
*via 4.1.1.1, Vlan1001, [0/0], 00:12:34, direct
4.1.1.1/32, ubest/mbest: 1/0, attached
*via 4.1.1.1, Vlan1001, [0/0], 00:12:34, local
4.1.1.11/32, ubest/mbest: 1/0
*via 30.1.1.1%default, [20/0], 00:10:49, bgp-200, external, tag 100 (evpn) segid: 900001 tunnelid: 0x1e010101 encap: VXLAN
4.1.1.12/32, ubest/mbest: 1/0, attached
*via 4.1.1.12, Vlan1001, [190/0], 00:01:48, hmm
4.2.2.0/24, ubest/mbest: 1/0, attached
*via 4.2.2.1, Vlan1002, [0/0], 00:12:34, direct
4.2.2.1/32, ubest/mbest: 1/0, attached
*via 4.2.2.1, Vlan1002, [0/0], 00:12:34, local
4.2.2.11/32, ubest/mbest: 1/0
*via 30.1.1.1%default, [20/0], 00:10:49, bgp-200, external, tag 100 (evpn) segid: 900001 tunnelid: 0x1e010101 encap: VXLAN
4.2.2.12/32, ubest/mbest: 1/0, attached
*via 4.2.2.12, Vlan1002, [190/0], 00:01:55, hmm
NXOS4#
NXOS4# show ip arp vrf vxlan-900001
Flags: * - Adjacencies learnt on non-active FHRP router
+ - Adjacencies synced via CFSoE
# - Adjacencies Throttled for Glean
CP - Added via L2RIB, Control plane Adjacencies
PS - Added via L2RIB, Peer Sync
RO - Re-Originated Peer Sync Entry
D - Static Adjacencies attached to down interface
IP ARP Table for context vxlan-900001
Total number of entries: 2
Address Age MAC Address Interface Flags
4.2.2.12 00:01:43 0050.7966.680a Vlan1002
4.1.1.12 00:01:47 0050.7966.6809 Vlan1001 PS
NXOS4#
NXOS4# show nve peers
Interface Peer-IP State LearnType Uptime Router-Mac
--------- -------------------------------------- ----- --------- -------- -----------------
nve1 30.1.1.1 Up CP 00:10:49 5000.0003.0007
nve1 40.1.1.2 Up CP 00:10:49 n/a
NXOS4#
NXOS4# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
SU - Suppress Unknown Unicast
Xconn - Crossconnect
MS-IR - Multisite Ingress Replication
Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 900001 n/a Up CP L3 [vxlan-900001]
nve1 2001001 UnicastBGP Up CP L2 [1001]
nve1 2001002 UnicastBGP Up CP L2 [1002]
NXOS4#
NXOS5 – Leaf3 vPC2
NXOS5# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 40.1.1.2, local AS number 200
BGP table version is 338, L2VPN EVPN config peers 2, capable peers 2
23 network entries and 36 paths using 6600 bytes of memory
BGP attribute entries [22/3608], BGP AS path entries [1/10]
BGP community entries [0/0], BGP clusterlist entries [0/0]
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
10.1.1.1 4 100 179 72 338 0 0 00:40:16 12
20.1.1.1 4 100 180 76 338 0 0 00:40:06 12
NXOS5#
NXOS5# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 338, Local Router ID is 40.1.1.2
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 30.1.1.1:1001 (L2VNI 2001001)
*>l[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.2 100 32768 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6807]:[0]:[0.0.0.0]/216
30.1.1.1 0 100 200 i
* e 30.1.1.1 0 100 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.6809]:[0]:[0.0.0.0]/216
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.6807]:[32]:[4.1.1.11]/272
30.1.1.1 0 100 200 i
*>e 30.1.1.1 0 100 200 i
*>l[2]:[0]:[0]:[48]:[0050.7966.6809]:[32]:[4.1.1.12]/272
40.1.1.2 100 32768 i
* e[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 0 100 200 i
*>e 30.1.1.1 0 100 200 i
* e[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
*>l[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 100 32768 i
Route Distinguisher: 30.1.1.1:1002 (L2VNI 2001002)
*>l[1]:[0300.0000.0020.1100.07db]:[0x0]/152
40.1.1.2 100 32768 i
* e[2]:[0]:[0]:[48]:[0050.7966.6808]:[0]:[0.0.0.0]/216
30.1.1.1 0 100 200 i
*>e 30.1.1.1 0 100 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.6808]:[32]:[4.2.2.11]/272
30.1.1.1 0 100 200 i
*>e 30.1.1.1 0 100 200 i
* e[2]:[0]:[0]:[48]:[0050.7966.680a]:[32]:[4.2.2.12]/272
40.1.1.1 0 100 200 i
* e 40.1.1.1 0 100 200 i
*>l 40.1.1.2 100 32768 i
* e[3]:[0]:[32]:[30.1.1.1]/88
30.1.1.1 0 100 200 i
*>e 30.1.1.1 0 100 200 i
* e[3]:[0]:[32]:[40.1.1.1]/88
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
*>l[3]:[0]:[32]:[40.1.1.2]/88
40.1.1.2 100 32768 i
Route Distinguisher: 40.1.1.1:7817
* e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
Route Distinguisher: 40.1.1.1:27000
* e[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.1]/136
40.1.1.1 0 100 200 i
*>e 40.1.1.1 0 100 200 i
Route Distinguisher: 40.1.1.2:27000 (ES [0300.0000.0020.1100.07db 0])
*>e[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.1]/136
40.1.1.1 0 100 200 i
*>l[4]:[0300.0000.0020.1100.07db]:[32]:[40.1.1.2]/136
40.1.1.2 100 32768 i
Route Distinguisher: 40.1.1.2:65534 (L2VNI 0)
*>e[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.1 0 100 200 i
Route Distinguisher: 40.1.1.2:7817 (EAD-ES [0300.0000.0020.1100.07db 7817])
*>l[1]:[0300.0000.0020.1100.07db]:[0xffffffff]/152
40.1.1.2 100 32768 i
Route Distinguisher: 40.1.1.2:3 (L3VNI 900001)
*>e[2]:[0]:[0]:[48]:[0050.7966.6807]:[32]:[4.1.1.11]/272
30.1.1.1 0 100 200 i
*>e[2]:[0]:[0]:[48]:[0050.7966.6808]:[32]:[4.2.2.11]/272
30.1.1.1 0 100 200 i
NXOS5#
NXOS5# show system internal l2fwder mac
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link,
(T) - True, (F) - False, C - ControlPlane MAC
VLAN MAC Address Type age Secure NTFY Ports
---------+-----------------+--------+---------+------+----+------------------
* 1001 0050.7966.6807 static - F F nve-peer1 30.1.1.1
G 1001 5000.0005.0007 static - F F sup-eth1(R)
G 1002 5000.0005.0007 static - F F sup-eth1(R)
* 1002 0050.7966.680a static - F F nve-peer2 40.1.1.1
* 1001 0050.7966.6809 dynamic 00:00:30 F F Po1
G 101 5000.0005.0007 static - F F sup-eth1(R)
G - 5000:0003:0004 static - F F sup-eth1(R)
* 1002 0050.7966.6808 static - F F nve-peer1 30.1.1.1
1 1 -00:00:22:22:33:33 - 1
NXOS5#
NXOS5# show ip route vrf vxlan-900001
IP Route Table for VRF "vxlan-900001"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
4.1.1.0/24, ubest/mbest: 1/0, attached
*via 4.1.1.1, Vlan1001, [0/0], 00:41:50, direct
4.1.1.1/32, ubest/mbest: 1/0, attached
*via 4.1.1.1, Vlan1001, [0/0], 00:41:50, local
4.1.1.11/32, ubest/mbest: 1/0
*via 30.1.1.1%default, [20/0], 00:40:06, bgp-200, external, tag 100 (evpn) segid: 900001 tunnelid: 0x1e010101 encap: VXLAN
4.1.1.12/32, ubest/mbest: 1/0, attached
*via 4.1.1.12, Vlan1001, [190/0], 00:37:15, hmm
4.2.2.0/24, ubest/mbest: 1/0, attached
*via 4.2.2.1, Vlan1002, [0/0], 00:41:51, direct
4.2.2.1/32, ubest/mbest: 1/0, attached
*via 4.2.2.1, Vlan1002, [0/0], 00:41:51, local
4.2.2.11/32, ubest/mbest: 1/0
*via 30.1.1.1%default, [20/0], 00:40:06, bgp-200, external, tag 100 (evpn) segid: 900001 tunnelid: 0x1e010101 encap: VXLAN
4.2.2.12/32, ubest/mbest: 1/0, attached
*via 4.2.2.12, Vlan1002, [190/0], 00:02:06, hmm
NXOS5#
NXOS5# show ip arp vrf vxlan-900001
Flags: * - Adjacencies learnt on non-active FHRP router
+ - Adjacencies synced via CFSoE
# - Adjacencies Throttled for Glean
CP - Added via L2RIB, Control plane Adjacencies
PS - Added via L2RIB, Peer Sync
RO - Re-Originated Peer Sync Entry
D - Static Adjacencies attached to down interface
IP ARP Table for context vxlan-900001
Total number of entries: 2
Address Age MAC Address Interface Flags
4.2.2.12 00:01:54 0050.7966.680a Vlan1002 PS
4.1.1.12 00:18:29 0050.7966.6809 Vlan1001
NXOS5#
NXOS5# show nve peers
Interface Peer-IP State LearnType Uptime Router-Mac
--------- -------------------------------------- ----- --------- -------- -----------------
nve1 30.1.1.1 Up CP 00:40:06 5000.0003.0007
nve1 40.1.1.1 Up CP 00:11:00 n/a
NXOS5#
NXOS5# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
SU - Suppress Unknown Unicast
Xconn - Crossconnect
MS-IR - Multisite Ingress Replication
Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 900001 n/a Up CP L3 [vxlan-900001]
nve1 2001001 UnicastBGP Up CP L2 [1001]
nve1 2001002 UnicastBGP Up CP L2 [1002]
NXOS5#
結果
問題なく各端末感で疎通できることを確認。
なお網経由のPingを打ち続けると、マルチホームを形成するデバイス上でMACのduplicateが発生。
frozen-listというリストに入れられてしまい通信ができなくなる。どうもL2スイッチ（NXOS6）がper packetで分散しているようなので、このMH環境でduplicateが発生していると思われるが、MH機能自身のNexus9000vの制限の可能性もあり。
参考URL
Cisco Nexus 9000 Series NX-OS VXLAN Configuration Guide, Release 9.3(x)