topic Re: ESXi host LAG to VOSS vIST cluster in ExtremeSwitching (VSP/Fabric Engine)

ESXi host LAG to VOSS vIST cluster

Robert_Zdzieblo — Tue, 21 Nov 2023 14:48:44 GMT

Hello,

I am trying to setup a 2 NICs LAG from ESXi host to vIST cluster based on two 5520 units running Fabric Engine.

At first I was trying to setup LACP enabled SMLT connection to ESXi with flex-uni config, but I still got "Churn" error in logs and MLT was in NORM, not SMLT mode.

Then I've found an article saying that EXSi supports LACP only with vDS virtual switches, which is not true in my case.

I have other SMLT links with LACP enabled on that cluster, which are working fine.

Is it any way to setup LAG to ESXi host from SMLTed VOSS cluster? Should the SMLT be set without LACP enabled? Is there anyone with working config like this?

REGARDS

Robert

Re: ESXi host LAG to VOSS vIST cluster

EXTR_Paul — Tue, 21 Nov 2023 20:24:32 GMT

Why are you using FLI-UNI's. This is a DVR deployment?

If you aren't using DvR just use normal UNI's.

ANyways. This is 100% supported in VOSS. Here are two examples.

Here is KB article. https://extreme-networks.my.site.com/ExtrArticleDetail?an=000083501&q=VOSS%20SMLT%20LACP%20confog

There is a working example in this TCG.

https://documentation.extremenetworks.com/TCG-TSG/VSP_CCTV_Deployment.pdf

Re: ESXi host LAG to VOSS vIST cluster

FredrikB-NN2 — Wed, 22 Nov 2023 13:54:23 GMT

I normally like to use LACP LAG to ESXi hosts but the server people always complain about how expensive the licenses for that are. When reverting to VMware's own load balancing (per VM etc.), each connection to the server is treated as just a normal VLAN trunk (or even untagged if you happen to have have only one VLAN). VMware will distribute the VMs across those links in it's own way. The return traffic needs to go via the same link that the VM is connected to, which is learnt by the switch as soon as the VM "speaks". A VM move to another host or link is seen by the switch as soon as the VM sends the next frame. The downside here is that if your SMLT pair is fed by another SMLT par in the core, the ISC/ISL link can get heavily loaded. This is avoided when you connect the VMware servers with a proper LAG.

So, if your VMware servers use their own load balancing, forget MLT/SMLT on your switches for the ports facing the hosts and configure normal VLAN trunks.

Re: ESXi host LAG to VOSS vIST cluster

WillyHe — Wed, 22 Nov 2023 14:35:22 GMT

A vIST cluster allows to connect systems and other network devices as

Dynamic LAG (LACP)
Static LAG (depending on manufacturer called MLT/DMLT/SMLT for Extreme VOSS/Fabric Engine devices, Ether-channel, LACP static, ...)

I read that a dynamic LACP connection is working OK so i do not provide an example configuration for that.

This is a static SMLT configuration example:
The same MLT ID must be used on both vIST cluster members.

Create MLT
mlt 139 enable name "Static_LAG"
mlt 139 member 1/39,1/41
mlt 139 encapsulation dot1q (or not if un-tagged)

Enable SMLT
interface mlt 139
smlt
exit

Add VLAN(s)
vlan mlt 2202 139

Notice a difference between LACP and static MLT configuration, for LACP the vlan's are assigned to the port(s), for a static MLT the vlan's can also be assigned to the MLT.

Behavior difference between LACP LAG and static LAG (applicable for all vendors).

In LACP LAG each connection is negotiated between the two partners and when agreed the link becomes a member of the LACP group.
In LACP there is a kind of identity check build in to assure the connected ports are on the same device and the same LACP group.
In Static LAG when a port is up it becomes active in the LAG, also when the ports are connected to different devices.
When connecting EXTREME switches to each other, vlacp is preferably used to have the same behavior as the LACP "identity" check.

regards
WillyHe

Re: ESXi host LAG to VOSS vIST cluster

Robert_Zdzieblo — Mon, 27 Nov 2023 09:44:16 GMT

Hi EXTR_Paul,

Thanks for the links!

I was advised to use flex-uni uplinks, cause in this way we don't have CVLANs on Fabric nodes (both 5520 cores),

That is what I would like to maintain, if possible.

I tried to configure static LAG with no LACP to ESXi host (still using flex-uni uplinks). I have proper SMLT status and I can see ESXi host MACs on my LAG ports, but there is no communication with VMs on that hosts (no ping to VM's IP).

I know that I should use only static LAG config.

Any suggestions how to configure it from the ESXi vSwitch side?

REGARDS

Robert

Re: ESXi host LAG to VOSS vIST cluster

EXTR_Paul — Tue, 28 Nov 2023 15:48:16 GMT

you will need to google for how to configure LAG/LACP on an ESXi host there is a ton of information about there on the VMware site

Re: ESXi host LAG to VOSS vIST cluster

WillyHe — Wed, 29 Nov 2023 08:19:09 GMT

Hello,

Things I would check for troubleshooting.

Are the I-SID and VLAN ID's correct (the same as for the L3 vlan on the (for that vlan) routing switch) and is the VLAN tagged assigned to the flex-uni interfaces.
Are the ESX MAC addresses learned in the correct vlan.
Have the MLT/SMLT interfaces the same configuration on both cluster members, e.g. same SMLT id., same flex-uni vlan's assigned, ...
The ESX vSwitch must have the same vlan's tagged as the SMLT cluster.
If required, there can be ONE vlan assigned UN-tagged (a so called native/default/... vlan) on the ESX and SMLT cluster flex-uni interfaces.

regards
WillyHe

Re: ESXi host LAG to VOSS vIST cluster

Robert_Zdzieblo — Thu, 30 Nov 2023 14:10:02 GMT

Hi everyone,

I finally got it working. I just did configuration once again, shuting down/up member interfaces, creating MLT again with no LACP, with SMLT and with flex-uni enabled.

On the ESXi side vSwitch setting was as follows:

Thank you guys for your support!

BR, Robert