topic Re: VDX NOS: Can fabric virtual gateways be assigned to a VRF? in Data Center (VDX)

VDX NOS: Can fabric virtual gateways be assigned to a VRF?

wgs — Thu, 13 Jun 2019 20:17:12 GMT

We currently use our VDX for only layer 2 functions. We are looking at turning on layer 3 routing, and the fabric route virtual gateway functionality.

I see the VDX supports 32 vrfs, and the vrf documentation describes assigning ip interfaces and vrrp/vrrp-e addresses to vrf domains. I do not see anything in the documentation that explains if an ip fabric-virtual-gateway address can be added to vrf.

Example from docs:
(config)# interface ve 6000 device
(config-Ve-6000)# attach rbridge-id 10,11,12
(config-Ve-6000)# no shutdown
(config-Ve-6000)# ip fabric-virtual-gateway
(config-ip-fabric-virtual-gateway )# gateway-address 10.65.40.100/24
(config-ip-fabric-virtual-gateway )# exit
FROM VRF DOCS--->>(config-Ve-6000)# vrf forwarding orange

will this work?

Unfortunately I do not have a lab to test this on.

Thank you

Re: VDX NOS: Can fabric virtual gateways be assigned to a VRF?

Michael_Morey — Thu, 13 Jun 2019 21:00:00 GMT

wgs,

Yes, this is possible, here is the correct process:

Step 1:

Configure the VRF on each RB attached:

code:

Static-Lab-SM08_VDX1(config)# rbr 1   
Static-Lab-SM08_VDX1(config-rbridge-id-1)# vrf orange
Static-Lab-SM08_VDX1(config-vrf-orange)# address-family ipv4 uni
Static-Lab-SM08_VDX1(vrf-orange-ipv4-unicast)#

Static-Lab-SM08_VDX1(config)# rbr 2   
Static-Lab-SM08_VDX1(config-rbridge-id-2)# vrf orange
Static-Lab-SM08_VDX1(config-vrf-orange)# address-family ipv4 uni
Static-Lab-SM08_VDX1(vrf-orange-ipv4-unicast)# exit

Step 2:

Setup Fabric Virtual Gateway globally

code:

Static-Lab-SM08_VDX1(config)# router fabric-virtual-gateway 
Static-Lab-SM08_VDX1(conf-router-fabric-virtual-gateway)# address-family ipv4
Static-Lab-SM08_VDX1(conf-address-family-ipv4)# exit
Static-Lab-SM08_VDX1(conf-router-fabric-virtual-gateway)# exit

Static-Lab-SM08_VDX1(config)# interface ve 6000
Static-Lab-SM08_VDX1(config-Ve-6000)# attach rbridge-id add 1,2
Static-Lab-SM08_VDX1(config-Ve-6000)# no shut
Static-Lab-SM08_VDX1(config-Ve-6000)# ip fabric-virtual-gateway 
Static-Lab-SM08_VDX1(config-ip-fabric-virtual-gw)# gateway-address 10.65.40.100/24
Static-Lab-SM08_VDX1(config-ip-fabric-virtual-gw)# exit

Step 3:

Configure each RB with the appropriate VE

code:

Static-Lab-SM08_VDX1(config)# rb 1
Static-Lab-SM08_VDX1(config-rbridge-id-1)# int ve 6000
Static-Lab-SM08_VDX1(config-rbridge-Ve-6000)# vrf forwarding orange
Static-Lab-SM08_VDX1(config-rbridge-Ve-6000)# ip fabric-virtual-gateway 
Static-Lab-SM08_VDX1(config-ip-fabric-virtual-gw)# enable
Static-Lab-SM08_VDX1(config-ip-fabric-virtual-gw)# exit

Static-Lab-SM08_VDX1(config)# rb 2
Static-Lab-SM08_VDX1(config-rbridge-id-2)# int ve 6000
Static-Lab-SM08_VDX1(config-rbridge-Ve-6000)# vrf forwarding orange
Static-Lab-SM08_VDX1(config-rbridge-Ve-6000)# ip fabric-virtual-gateway 
Static-Lab-SM08_VDX1(config-ip-fabric-virtual-gw)# enable
Static-Lab-SM08_VDX1(config-ip-fabric-virtual-gw)# exit

I hope this answers your question

Thank you,

Michael Morey, BCNP, BCEFP
Principal Technical Support Engineer

Re: VDX NOS: Can fabric virtual gateways be assigned to a VRF?

wgs — Thu, 13 Jun 2019 22:44:48 GMT

Thank you for the quick answer. I'm glad this works and I do not have to use vrrp instead..

Re: VDX NOS: Can fabric virtual gateways be assigned to a VRF?

wgs — Tue, 18 Jun 2019 22:25:57 GMT

Hello. I've tried this procedure and it is working well. I do have two questions:

I have vcs fabric with four cluster members. Each cluster member appears to have elected different arp responders (although two have elected the same) . Is that a problem?

Total number of IPv4 Fabric Virtual Gateway Sessions : 1
Sessions in Init state : 0
Gateway MAC address: 02e0.5200.010f

Interface Admin State ARP Load Threshold Track Last State
State Responder Balancing Priority Priority Changed
========= ===== ===== ========= ========= ========= ======== ==========
Ve 191 Enabled Active Rbr-id 1 Enabled unset 0 0d.0h.13m.13s ago
show ip fabric-virtual-gateway rbridge-id 1
============Rbridge-id:1============

Total number of IPv4 Fabric Virtual Gateway Sessions : 1
Sessions in Init state : 0
Gateway MAC address: 02e0.5200.010f

Interface Admin State ARP Load Threshold Track Last State
State Responder Balancing Priority Priority Changed
========= ===== ===== ========= ========= ========= ======== ==========
Ve 191 Enabled Active Rbr-id 1 Enabled unset 0 0d.0h.13m.21s ago

show ip fabric-virtual-gateway rbridge-id 2
============Rbridge-id:2============

Total number of IPv4 Fabric Virtual Gateway Sessions : 1
Sessions in Init state : 0
Gateway MAC address: 02e0.5200.010f

Interface Admin State ARP Load Threshold Track Last State
State Responder Balancing Priority Priority Changed
========= ===== ===== ========= ========= ========= ======== ==========
Ve 191 Enabled Active Rbr-id 100 Enabled unset 0 0d.0h.13m.22s ago

show ip fabric-virtual-gateway rbridge-id 100
============Rbridge-id:100============

Total number of IPv4 Fabric Virtual Gateway Sessions : 1
Sessions in Init state : 0
Gateway MAC address: 02e0.5200.010f

Interface Admin State ARP Load Threshold Track Last State
State Responder Balancing Priority Priority Changed
========= ===== ===== ========= ========= ========= ======== ==========
Ve 191 Enabled Active Rbr-id 1 Enabled unset 0 0d.0h.13m.24s ago

show ip fabric-virtual-gateway rbridge-id 200
============Rbridge-id:200============

Total number of IPv4 Fabric Virtual Gateway Sessions : 1
Sessions in Init state : 0
Gateway MAC address: 02e0.5200.010f

Interface Admin State ARP Load Threshold Track Last State
State Responder Balancing Priority Priority Changed
========= ===== ===== ========= ========= ========= ======== ==========
Ve 191 Enabled Active Rbr-id 200 Enabled unset 0 0d.0h.13m.27s ago

Re: VDX NOS: Can fabric virtual gateways be assigned to a VRF?

wgs — Tue, 18 Jun 2019 22:32:30 GMT

Second question that I could not find a answer to in documentation:

within the ve configuration, the command
ip fabric-virtual-gateway

asks for an id or autogenerates one. Here ID 1 was autogenerated.

rbridge-id 2
interface Ve 1091
vrf forwarding PICKLE
ip fabric-virtual-gateway 1
enable
!
no shutdown

Does this ID need to be unique within the vcs fabric (appears to be limited to 255)? Is it a way of creating different gateway addresses under the same ve interface?

Thank you,

wgs

Re: VDX NOS: Can fabric virtual gateways be assigned to a VRF?

Michael_Morey — Tue, 18 Jun 2019 22:58:33 GMT

This is not a major issue, as the RB that receives the ARP reqeust will simply forward it to the registered ARP responder. The election of ARP responder is not a dynamic process and only occurs at the time of configuration. If you wish to change this you can detach the RBs from the FVG config and reattach them, and the ARP responder election should take place again.

I am not sure what version you are on, but this is not an option in NOS 7.3.0 as there is only 1 global instance of FVG. So my answer would be, Yes the ID needs to be unique, and No you can not setup multiple gateway IPs or instances like you can in a VRRP-E solution.

code:

Slot  Name  Primary/Secondary Versions             Status
---------------------------------------------------------------------------
SW/0  NOS   7.3.0a                       ACTIVE*
            7.3.0a                        
SW/1  NOS   7.3.0a                       STANDBY
            7.3.0a                        

Static-Lab-SM08_VDX1(config-rbridge-Ve-6000)# do show run rb 1 int ve 6000
rbridge-id 1
 interface Ve 6000
 vrf forwarding orange
 ip fabric-virtual-gateway
  enable
 !
 no shutdown
 !
!
Static-Lab-SM08_VDX1(config-rbridge-Ve-6000)# ip fabric-virtual-gateway ?
Possible completions:
  1

Thanks,

Michael Morey
Principal Technical Support Engineer – Switching, Routing & Analytics

Re: VDX NOS: Can fabric virtual gateways be assigned to a VRF?

wgs — Tue, 18 Jun 2019 23:13:25 GMT

Thank you for the quick reply. We are on much older code, so I think we will upgrade.

I do notice that one of my rbridges show ip fabric-virtual-gateway detail lists:

Load balancing configuration: Enabled
Load balancing current status: Disabled

I'm not sure what would cause that but I suspect it's a problem.