How to configure lag on a EOS Switches like securestack B5 for esx teaming nic

  • 0
  • 1
  • Question
  • Updated 2 years ago
  • Answered
  • (Edited)
We try to connect 2 teaming nics on a esxi V6 to a  B5 securestack configured with static lag but after connecting the second link we loose our connectivity.
Does anyone has an Idea for our problem ? Is it a problem in the esx ? With an HP switch we can connect the esxi but not with the securestack.


B5_Stack(su)->show port status lag.0.3
          Alias        Oper    Admin   Speed
Port      (truncated)  Status  Status  (bps)     Duplex  Type
--------- ------------ ------- ------- --------- ------- ------------
lag.0.3   Mgmnt        Up      Up      2.0G      full    lag
B5_Stack(su)->
B5_Stack(su)->
B5_Stack(su)->show port status ge.2.42
          Alias        Oper    Admin   Speed
Port      (truncated)  Status  Status  (bps)     Duplex  Type
--------- ------------ ------- ------- --------- ------- ------------
ge.2.42                dormant Up      1.0G      full    BaseT RJ45/PoE
B5_Stack(su)->
B5_Stack(su)->
B5_Stack(su)->
B5_Stack(su)->show lacp
Global Link Aggregation state: enabled
Single Port LAGs:              enabled

Aggregator: lag.0.1
                         Actor                  Partner
System Identifier:     20:B3:99:97:64:94    00:1F:45:77:74:00
  System Priority:                 32768                32768
        Admin Key:                     1
         Oper Key:                     1                    1
   Attached Ports:    ge.1.47
                      ge.2.47

Aggregator: lag.0.2
                         Actor                  Partner
System Identifier:     20:B3:99:97:64:94    E0:07:1B:DF:0D:40
  System Priority:                 32768                 3392
        Admin Key:                     2
         Oper Key:                     2                  211
   Attached Ports:    ge.1.45
                      ge.2.45
                      ge.3.45

Aggregator: lag.0.3
                         Actor                  Partner

System Identifier:     20:B3:99:97:64:94    00:00:00:00:00:00
  System Priority:                 32768                32768
        Admin Key:                     3
         Oper Key:                     3                    1
   Attached Ports:    ge.2.42
                      ge.3.42
Photo of Robert_J

Robert_J

  • 150 Points 100 badge 2x thumb

Posted 2 years ago

  • 0
  • 1
Photo of Daniel Coughlin

Daniel Coughlin, Employee

  • 2,648 Points 2k badge 2x thumb
It might be helpful to understand some more of the configuration.  Does the lag have the proper vlan association?  Can you share the relevant parts of the configuration? Given the output you supplied ports appear to be in lag.0.3.  I will point at a short article but it seems you got that far.

How to create a static lag on Modular and SecureStack switches
Photo of Erik Auerswald

Erik Auerswald, Embassador

  • 12,782 Points 10k badge 2x thumb
Hi Robert,

you should check if the VLAN configuration of LAG (e.g. lag.0.3) and the physical ports (e.g. ge.2.42;ge.3.42) match. The LAG is configured independently from the physical ports, thus you need to configure the VLANs for the LAG as well. You can use the command "show vlan portinfo port ge.2.42;ge.3.42;lag.0.3" to verify.

Erik
Photo of Robert_J

Robert_J

  • 150 Points 100 badge 2x thumb
Hello,
yes the lag has the proper vlan config. The ping to the esxi is working, as long as i use only one link. I'm not shure, if there is any problem with the lag algorithm in the esxi (we used "hashing" ) and the securestack, but any other algorithm than hash didnt worked although.

And the esx teaming nic config work well with HP static trunk, but for redundancy of the esx with should connect 1 host to the securestack.

Is there any tested combination of lag configs for securestack and esxi v6. Maybe it is better to use lacp than static lag.

lag.0.1 and 0.2 are working well, lag.0.3 has problems


B5_Stack(su)->set lacp static lag.0.3

Issuing :
        set lacp static lag.0.3
        set lacp aadminkey lag.0.3 3

----> config
#lacp
set lacp aadminkey lag.0.1 1
set lacp aadminkey lag.0.2 2
set lacp aadminkey lag.0.3 3
set lacp singleportlag enable
!

set port lacp port ge.1.45 aadminkey 2
set port lacp port ge.1.47 aadminkey 1
set port lacp port ge.2.42 aadminkey 3
set port lacp port ge.2.45 aadminkey 2
set port lacp port ge.2.47 aadminkey 1
set port lacp port ge.3.42 aadminkey 3
set port lacp port ge.3.45 aadminkey 2
set port lacp port ge.1.45 enable
set port lacp port ge.1.47 enable
set port lacp port ge.2.45 enable
set port lacp port ge.2.47 enable
set port lacp port ge.3.45 enable



B5_Stack(su)->show port status lag.0.3
          Alias        Oper    Admin   Speed
Port      (truncated)  Status  Status  (bps)     Duplex  Type
--------- ------------ ------- ------- --------- ------- ------------
lag.0.3   Mgmnt        Up      Up      2.0G      full    lag
B5_Stack(su)->
B5_Stack(su)->
B5_Stack(su)->show port status ge.2.42
          Alias        Oper    Admin   Speed
Port      (truncated)  Status  Status  (bps)     Duplex  Type
--------- ------------ ------- ------- --------- ------- ------------
ge.2.42                dormant Up      1.0G      full    BaseT RJ45/PoE

B5_Stack(su)->show spantree debug port ge.2.42
STP Diagnostic Common Counters
----------------------------------
Topology Change Count      - 59
Message Expiration Count   - 138
Invalid BPDU Count         - 118
STP BPDU Rx Count          - 138
STP BPDU Tx Count          - 22829470
STP TCN BPDU Rx Count      - 114
STP TCN BPDU Tx Count      - 0
STP TC BPDU Rx Count       - 0
STP TC BPDU Tx Count       - 189
RST BPDU Rx Count          - 876364
RST BPDU Tx Count          - 514299684
RST TC BPDU Rx Count       - 63
RST TC BPDU Tx Count       - 366
MST BPDU Rx Count          - 5507485
MST BPDU Tx Count          - 0
MST CIST TC BPDU Rx Count  - 232
MST CIST TC BPDU Tx Count  - 0

STP Diagnostic Port Counters for SID 0 Port ge.2.42
---------------------------------------------------------
Port Role                  - Disabled
Message Expiration Count   - 0

Invalid BPDU Count         - 0
STP BPDU Rx Count          - 0
STP BPDU Tx Count          - 0
STP TCN BPDU Rx Count      - 0
STP TCN BPDU Tx Count      - 0
STP TC BPDU Rx Count       - 0
STP TC BPDU Tx Count       - 0
RST BPDU Rx Count          - 0
RST BPDU Tx Count          - 5715096
RST TC BPDU Rx Count       - 0
RST TC BPDU Tx Count       - 0
MST BPDU Rx Count          - 0
MST BPDU Tx Count          - 0
MST CIST TC BPDU Rx Count  - 0
MST CIST TC BPDU Tx Count  - 0
B5_Stack(su)->show spantree debug port ge.2.42
STP Diagnostic Common Counters
----------------------------------
Topology Change Count      - 59
Message Expiration Count   - 138
Invalid BPDU Count         - 118
STP BPDU Rx Count          - 138
STP BPDU Tx Count          - 22829478
STP TCN BPDU Rx Count      - 114
STP TCN BPDU Tx Count      - 0
STP TC BPDU Rx Count       - 0
STP TC BPDU Tx Count       - 189
RST BPDU Rx Count          - 876366
RST BPDU Tx Count          - 514299853
RST TC BPDU Rx Count       - 63
RST TC BPDU Tx Count       - 366
MST BPDU Rx Count          - 5507487
MST BPDU Tx Count          - 0
MST CIST TC BPDU Rx Count  - 232
MST CIST TC BPDU Tx Count  - 0

STP Diagnostic Port Counters for SID 0 Port ge.2.42
---------------------------------------------------------
Port Role                  - Disabled
Message Expiration Count   - 0

Invalid BPDU Count         - 0
STP BPDU Rx Count          - 0
STP BPDU Tx Count          - 0
STP TCN BPDU Rx Count      - 0
STP TCN BPDU Tx Count      - 0
STP TC BPDU Rx Count       - 0
STP TC BPDU Tx Count       - 0
RST BPDU Rx Count          - 0
RST BPDU Tx Count          - 5715096
RST TC BPDU Rx Count       - 0
RST TC BPDU Tx Count       - 0
MST BPDU Rx Count          - 0
MST BPDU Tx Count          - 0
MST CIST TC BPDU Rx Count  - 0
MST CIST TC BPDU Tx Count  - 0
B5_Stack(su)->show spantree debug port lag.0.3
STP Diagnostic Common Counters
----------------------------------
Topology Change Count      - 59
Message Expiration Count   - 138
Invalid BPDU Count         - 118
STP BPDU Rx Count          - 138
STP BPDU Tx Count          - 22829528
STP TCN BPDU Rx Count      - 114
STP TCN BPDU Tx Count      - 0
STP TC BPDU Rx Count       - 0
STP TC BPDU Tx Count       - 189
RST BPDU Rx Count          - 876378
RST BPDU Tx Count          - 514300968
RST TC BPDU Rx Count       - 63
RST TC BPDU Tx Count       - 366
MST BPDU Rx Count          - 5507500
MST BPDU Tx Count          - 0
MST CIST TC BPDU Rx Count  - 232
MST CIST TC BPDU Tx Count  - 0
Photo of Erik Auerswald

Erik Auerswald, Embassador

  • 12,782 Points 10k badge 2x thumb
Hi Robert,

why does the LAG to an ESXi server receive spanning tree BPDUs? What is the output of "show spantree stats active"?

Erik
Photo of Robert_J

Robert_J

  • 150 Points 100 badge 2x thumb
Hi Erik,
I dont know why I recieve bpdu on this port and I cannot show you any new output, as i am not near the switch now. Are there any stp configs in the esxi to be disabled or should we disable stp on the lag physical ports ?


Vlan config should be correct for physical and lag port

set vlan egress 160 ge.1.42;ge.1.45;ge.2.42;ge.2.45;ge.3.42;ge.3.45;lag.0.2-3 tagged
Photo of Erik Auerswald

Erik Auerswald, Embassador

  • 12,782 Points 10k badge 2x thumb
Hi Robert,

the ESXi host should not send STP BPDUs, both Standard and Distributed vSwitch do not support STP and do not switch between uplinks.

A virtual machine running on the host might do this, e.g. a GNU/Linux system using a bridge (as opposed to open-vswitch or normal ethernet interfaces). Before disabling STP you should verify that there is no loop inside the ESXi host created by virtual machines running on it.

Since your outputs show BPDUs received on ge.2.42 and lag.0.3, but you did not show any on ge.3.42, I'd assume that BPDUs are only sent on one of the two links. That link is blocked by STP (you verify this using "show spantree stats active"); if the two links are aggregated into one, the only link is blocked.

In my opinion it is worth investigating why STP BPDUs are received from an ESXi host, instead of just ignoring said BPDUs.

Erik