XRv with Nexus 1000v switching

[keshav0011]

Hello, On Page 10., under 'Supported VMware Features and Operations' of IOS-XRv Installation Guide, 'vSwitch' is shown as one of the supported features. That makes me wonder whether DVS is supported at all (?).. That is, is it possible to trunk between Nexus 1000v DVS and XRv while all (VSM, VEM and XRv) components are running on the same ESXi host?

I am setting up a N1K at this time. Next, I was going to install and use it with XRv. I wanted to know if there are any specifics that I should be aware of?

Thanks in advance!

Regards

[Vinit Jain]

Hello Keshav

I have not tried connecting both of them but have run them individually. I think this could work. Please refer to the below document as it might help you setting it up.

https://supportforums.cisco.com/document/12068551/running-ios-xrv-esxi-and-qemukvm#Connecting_IOS_XRv_to_External_Devices

The vSwitch is on the hypervisor (ESXi) and yes, DVS is supported but for that i believe you will have to install VMWare vCenter. That should make the connectivity work between both the N1000v and XRv.

Hope this helps.

Regards

Vinit

PS: Please rate useful posts.

[keshav0011]

Thanks for the response. I will give this a try after I get the DVS migration working. 

Thanks again,

[keshav0011]

I’m trying to ping between two vlans (VMs on nexus 1000v on ESXi) using XRv over a trunk port but the pings are failing. Would someone be able to tell if I’m missing anything from the config please (Diagram of my small test network is in the attachment below)?  Many Thanks!

Nexus-1000v:

vm2-VSM0-56# show vlan br

VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
1 default active
10 non-NAT-clients active Veth8, Veth9, Veth12
20 NAT-clients active Veth11, Veth12
24 system active Po1, Veth1, Veth2, Veth3, Veth4
Veth5, Veth6, Veth7, Veth10
Eth3/1

vm2-VSM0-56#

vm2-VSM0-56# show vlan id 10

VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
10 non-NAT-clients active Veth8, Veth9, Veth12

VLAN Type Vlan-mode
---- ----- ----------
10 enet CE

Remote SPAN VLAN
----------------
Disabled

Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------

vm2-VSM0-56#

vm2-VSM0-56# show port-profile name non-nat-clients

port-profile non-nat-clients
type: Vethernet
description:
status: enabled
max-ports: 32
min-ports: 1
inherit:
config attributes:
switchport mode access
switchport access vlan 10
no shutdown
evaluated config attributes:
switchport mode access
switchport access vlan 10
no shutdown
assigned interfaces:
Vethernet8
Vethernet9
port-group: non-nat-clients
system vlans: 10
capability l3control: no
capability iscsi-multipath: no
capability vxlan: no
capability l3-vservice: no
port-profile role: none
port-binding: static

vm2-VSM0-56#

vm2-VSM0-56# show vlan id 20

VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
20 NAT-clients active Veth11, Veth12

VLAN Type Vlan-mode
---- ----- ----------
20 enet CE

Remote SPAN VLAN
----------------
Disabled

Primary Secondary Type Ports
------- --------- --------------- -------------------------------------------

vm2-VSM0-56#

vm2-VSM0-56# show port-profile name nat-clients

port-profile nat-clients
type: Vethernet
description:
status: enabled
max-ports: 32
min-ports: 1
inherit:
config attributes:
switchport mode access
switchport access vlan 20
no shutdown
evaluated config attributes:
switchport mode access
switchport access vlan 20
no shutdown
assigned interfaces:
Vethernet11
port-group: nat-clients
system vlans: 20
capability l3control: no
capability iscsi-multipath: no
capability vxlan: no
capability l3-vservice: no
port-profile role: none
port-binding: static

vm2-VSM0-56#

vm2-VSM0-56# show int vethernet 9 status

--------------------------------------------------------------------------------
Port Name Status Vlan/ Duplex Speed Type
Segment
--------------------------------------------------------------------------------
Veth9 vm2-debian-60, Net connected 10 auto auto --
vm2-VSM0-56# show int vethernet 9 brief

--------------------------------------------------------------------------------
Vethernet VLAN/ Type Mode Status Reason MTU Module
Segment
--------------------------------------------------------------------------------
Veth9 10 virt access up none 1500 3
vm2-VSM0-56# show int vethernet 9 switchport
Name: Vethernet9
Switchport: Enabled
Switchport Monitor: Not enabled
Operational Mode: access
Access Mode VLAN: 10 (non-NAT-clients)
Trunking Native Mode VLAN: 10 (non-NAT-clients)
Trunking VLANs Allowed: 10
Voice VLAN: none
Extended Trust State : not trusted [COS = 0]
Administrative private-vlan primary host-association: none
Administrative private-vlan secondary host-association: none
Administrative private-vlan primary mapping: none
Administrative private-vlan secondary mapping: none
Administrative private-vlan trunk native VLAN: none
Administrative private-vlan trunk encapsulation: dot1q
Administrative private-vlan trunk normal VLANs: none
Administrative private-vlan trunk private VLANs: none
Operational private-vlan: none

vm2-VSM0-56#

vm2-VSM0-56# show int vethernet 11 status

--------------------------------------------------------------------------------
Port Name Status Vlan/ Duplex Speed Type
Segment
--------------------------------------------------------------------------------
Veth11 vm2-debian-rs-200, connected 20 auto auto --
vm2-VSM0-56# show int vethernet 11 brief

--------------------------------------------------------------------------------
Vethernet VLAN/ Type Mode Status Reason MTU Module
Segment
--------------------------------------------------------------------------------
Veth11 20 virt access up none 1500 3
vm2-VSM0-56#

vm2-VSM0-56# show int vethernet 11 switchport
Name: Vethernet11
Switchport: Enabled
Switchport Monitor: Not enabled
Operational Mode: access
Access Mode VLAN: 20 (NAT-clients)
Trunking Native Mode VLAN: 20 (NAT-clients)
Trunking VLANs Allowed: 20
Voice VLAN: none
Extended Trust State : not trusted [COS = 0]
Administrative private-vlan primary host-association: none
Administrative private-vlan secondary host-association: none
Administrative private-vlan primary mapping: none
Administrative private-vlan secondary mapping: none
Administrative private-vlan trunk native VLAN: none
Administrative private-vlan trunk encapsulation: dot1q
Administrative private-vlan trunk normal VLANs: none
Administrative private-vlan trunk private VLANs: none
Operational private-vlan: none

vm2-VSM0-56#

vm2-VSM0-56# show int vethernet 12 status

--------------------------------------------------------------------------------
Port Name Status Vlan/ Duplex Speed Type
Segment
--------------------------------------------------------------------------------
Veth12 Cisco IOS XRv-1, N connected trunk auto auto --
vm2-VSM0-56# show int vethernet 12 brief

--------------------------------------------------------------------------------
Vethernet VLAN/ Type Mode Status Reason MTU Module
Segment
--------------------------------------------------------------------------------
Veth12 1 virt trunk up none 1500 3
vm2-VSM0-56#

vm2-VSM0-56# show int vethernet 12 switchport
Name: Vethernet12
Switchport: Enabled
Switchport Monitor: Not enabled
Operational Mode: trunk
Access Mode VLAN: 1 (default)
Trunking Native Mode VLAN: 1 (default)
Trunking VLANs Allowed: 10,20
Voice VLAN: none
Extended Trust State : not trusted [COS = 0]
Administrative private-vlan primary host-association: none
Administrative private-vlan secondary host-association: none
Administrative private-vlan primary mapping: none
Administrative private-vlan secondary mapping: none
Administrative private-vlan trunk native VLAN: none
Administrative private-vlan trunk encapsulation: dot1q
Administrative private-vlan trunk normal VLANs: none
Administrative private-vlan trunk private VLANs: none
Operational private-vlan: none

vm2-VSM0-56#

Port-profiles:

vm2-VSM0-56# show port-profile name non-nat-clients

port-profile non-nat-clients
type: Vethernet
description:
status: enabled
max-ports: 32
min-ports: 1
inherit:
config attributes:
switchport mode access
switchport access vlan 10
no shutdown
evaluated config attributes:
switchport mode access
switchport access vlan 10
no shutdown
assigned interfaces:
Vethernet8
Vethernet9
port-group: non-nat-clients
system vlans: 10
capability l3control: no
capability iscsi-multipath: no
capability vxlan: no
capability l3-vservice: no
port-profile role: none
port-binding: static

vm2-VSM0-56#

vm2-VSM0-56# show port-profile name nat-clients

port-profile nat-clients
type: Vethernet
description:
status: enabled
max-ports: 32
min-ports: 1
inherit:
config attributes:
switchport mode access
switchport access vlan 20
no shutdown
evaluated config attributes:
switchport mode access
switchport access vlan 20
no shutdown
assigned interfaces:
Vethernet11
port-group: nat-clients
system vlans: 20
capability l3control: no
capability iscsi-multipath: no
capability vxlan: no
capability l3-vservice: no
port-profile role: none
port-binding: static

vm2-VSM0-56#

----------------------------------------------

XRv:

RP/0/0/CPU0:ios#show int brief
Tue Nov 24 23:32:05.103 UTC

Intf Intf LineP Encap MTU BW
Name State State Type (byte) (Kbps)
--------------------------------------------------------------------------------
Lo0 up up Loopback 1500 0
Nu0 up up Null 1500 0
Mg0/0/CPU0/0 admin-down admin-down ARPA 1514 0
Gi0/0/0/0 up up ARPA 1514 1000000
Gi0/0/0/0.10 up up 802.1Q 1518 1000000
Gi0/0/0/0.20 up up 802.1Q 1518 1000000

RP/0/0/CPU0:ios#

RP/0/0/CPU0:ios#show int gi0/0/0/0.10 brief
Tue Nov 24 23:32:46.161 UTC

Intf Intf LineP Encap MTU BW
Name State State Type (byte) (Kbps)
--------------------------------------------------------------------------------
Gi0/0/0/0.10 up up 802.1Q 1518 1000000

RP/0/0/CPU0:ios#

RP/0/0/CPU0:ios#show int gi0/0/0/0.10 detail
Tue Nov 24 23:33:06.169 UTC
GigabitEthernet0/0/0/0.10 is up, line protocol is up
Interface state transitions: 1
Hardware is VLAN sub-interface(s), address is 0050.5680.ad99
Description: VLAN-10
Internet address is 172.17.10.1/24
MTU 1518 bytes, BW 1000000 Kbit (Max: 1000000 Kbit)
reliability 255/255, txload 0/255, rxload 0/255
Encapsulation 802.1Q Virtual LAN, VLAN Id 10, loopback not set,
Last link flapped 06:46:18
ARP type ARPA, ARP timeout 04:00:00
Last input 01:29:51, output 01:29:51
Last clearing of "show interface" counters never
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
33 packets input, 10964 bytes, 3 total input drops
21 drops for unrecognized upper-level protocol
Received 4700 broadcast packets, 37 multicast packets
38 packets output, 3728 bytes, 0 total output drops
Output 1 broadcast packets, 0 multicast packets

RP/0/0/CPU0:ios#

RP/0/0/CPU0:ios#show int gi0/0/0/0.20 brief
Tue Nov 24 23:33:54.816 UTC

Intf Intf LineP Encap MTU BW
Name State State Type (byte) (Kbps)
--------------------------------------------------------------------------------
Gi0/0/0/0.20 up up 802.1Q 1518 1000000

RP/0/0/CPU0:ios#show int gi0/0/0/0.20 detail
Tue Nov 24 23:33:59.536 UTC
GigabitEthernet0/0/0/0.20 is up, line protocol is up
Interface state transitions: 1
Hardware is VLAN sub-interface(s), address is 0050.5680.ad99
Description: VLAN-20
Internet address is 172.20.20.1/24
MTU 1518 bytes, BW 1000000 Kbit (Max: 1000000 Kbit)
reliability 255/255, txload 0/255, rxload 0/255
Encapsulation 802.1Q Virtual LAN, VLAN Id 20, loopback not set,
Last link flapped 06:47:11
ARP type ARPA, ARP timeout 04:00:00
Last input 01:28:43, output 01:28:43
Last clearing of "show interface" counters never
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
38 packets input, 11536 bytes, 3 total input drops
21 drops for unrecognized upper-level protocol
Received 21 broadcast packets, 37 multicast packets
41 packets output, 4166 bytes, 0 total output drops
Output 1 broadcast packets, 0 multicast packets

RP/0/0/CPU0:ios#

By the way, pings between the following are working fine:

 - Client-VM-1 (172.17.10.2) and the sub-interface on XRv (Gi0/0/0/0.10 with IP 172.17.10.1) to carry the respective VLAN (vlan 10) traffic.

 - Client-VM-2 (172.20.20.3) and the sub-interface on XRv (Gi0/0/0/0.20 with IP 172.20.20.1) to carry the respective VLAN (vlan 20) traffic. 

So, atleast I know that pings between the endpoints works if a static route is added on the hosts.. Something like the following on Client-VM-1:

route add -net 172.20.20.0 netmask 255.255.255.0 gw 172.17.10.1