x440 stack enable sharing issue

  • 0
  • 1
  • Problem
  • Updated 3 years ago
  • Solved
I have an issue with LAG across stack (4x Summit x440-24t-10G stacked via SummitStack-V):

Slot-3 Stack.18 # sh slot
Slots    Type                 Configured           State       Ports
--------------------------------------------------------------------
Slot-1   X440-24t-10G         X440-24t-10G         Operational   26
Slot-2   X440-24t-10G         X440-24t-10G         Operational   26
Slot-3   X440-24t-10G         X440-24t-10G         Operational   26
Slot-4   X440-24t-10G         X440-24t-10G         Operational   26
Slot-5                                             Empty          0
Slot-6                                             Empty          0
Slot-7                                             Empty          0
Slot-8                                             Empty          0


Slot:             Slot-3 *                     Slot-1             
    ------------------------     ------------------------
Current State:    MASTER                       BACKUP (In Sync)

Image Selected:   secondary                    secondary
Image Booted:     secondary                    secondary
Primary ver:      15.5.4.2                     15.5.4.2
Secondary ver:    15.5.4.2                     15.5.4.2

Config Selected:  primary.cfg
Config Booted:    primary.cfg

primary.cfg       Created by ExtremeXOS version 15.5.4.2
                  396528 bytes saved on Thu Oct 29 16:26:54 2015

The stack seems to be OK, all nodes are online and operational, XOS version 15.5.4.2 on all nodes.

I need to create 8 ports LAG (LACP enabled) across stack (SFP ports 23-24 on each stack node), but something goes wrong:

Slot-3 Stack.21 # enable sharing 1:23 grouping 1:23-24,2:23-24,3:23-24,4:23-24 lacp
Error: No valid port(s) in the specified "portList" value "1:23-24,2:23-24,3:23-24,4:23-24".
Configuration failed on backup Node, command execution aborted!

I tried to create 2 ports static LAG across stack (for example copper Ethernet 1:1,2:1 with 1:1 as master port), but got similar issue:

Slot-3 Stack.22 # enable sharing 1:1 grouping 1:1,2:1
Error: No valid port(s) in the specified "portList" value "1:1,2:1".
Configuration failed on backup Node, command execution aborted!
 
Photo of Chingis Taltaev

Chingis Taltaev

  • 178 Points 100 badge 2x thumb

Posted 3 years ago

  • 0
  • 1
Photo of Patrick Voss

Patrick Voss, Employee

  • 11,474 Points 10k badge 2x thumb
Hi Chingis,

Can you try to enable sharing just using the master port in the grouping? like so..

enable sharing 1:1 grouping 1:1

If this works try to add port 1:2. Like so..

configure sharing 1:1 add ports 1:2
Photo of Chingis Taltaev

Chingis Taltaev

  • 178 Points 100 badge 2x thumb
Slot-3 Stack.6 # enable sharing 1:1 grouping 1:1
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

Slot-3 Stack.7 # configure sharing 1:1 add ports 1:2
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

Slot-3 Stack.8 # configure sharing 1:1 add ports 2:1
Error: No valid port(s) in the specified "portList" value "2:1".
Configuration failed on backup Node, command execution aborted!

:(
Photo of Chingis Taltaev

Chingis Taltaev

  • 178 Points 100 badge 2x thumb
Also i noticed that Master- Slot 3, Backup - Slot 1, but they differs by hw revision, i think (slot 1 & 2 are 800475-00-13 Rev 13 switches, slot 3 & 4 are 800475-00-08 Rev 8 switches).
Photo of Patrick Voss

Patrick Voss, Employee

  • 11,414 Points 10k badge 2x thumb
Hardware revision should not matter as long as they can see each other and the stack builds properly everything should work just fine.
Photo of Patrick Voss

Patrick Voss, Employee

  • 11,474 Points 10k badge 2x thumb
Can you send the "show stacking" command along with "debug epm show peer"? Also take a look at the "show port no-refresh" output to see if these ports are present.
Photo of Chingis Taltaev

Chingis Taltaev

  • 178 Points 100 badge 2x thumb
* Slot-3 Stack.15 # sh stacking
Stack Topology is a Ring
Active Topology is a Ring
Node MAC Address    Slot  Stack State  Role     Flags
------------------  ----  -----------  -------  ---
*00:04:96:82:56:05  3     Active       Master   CA-
 00:04:96:82:55:fe  4     Active       Standby  CA-
 00:04:96:99:37:99  1     Active       Backup   CA-
 00:04:96:99:37:a0  2     Active       Standby  CA-
* - Indicates this node
Flags:  (C) Candidate for this active topology, (A) Active Node
        (O) node may be in Other active topology

* Slot-3 Stack.16 # debug epm show peer
Chassis     Slot     Peer Id  Partition B/S
---------------------------------------------
 0           3            0          2   2
 0           1            64         2   2
 0           4            65         2   2
 0           2            67         2   2

* Slot-3 Stack.28 # sh ports no-refresh
Port Summary
Port  Display         VLAN Name          Port  Link  Speed  Duplex
#     String          (or # VLANs)       State State Actual Actual
==================================================================
1:1                   Default             E     R
1:2                   Default             E     R
1:3                   Default             E     R
1:4                   Default             E     R
1:5                   Default             E     R
1:6                   Default             E     R
1:7                   Default             E     R
1:8                   Default             E     R
1:9                   Default             E     R
1:10                  Default             E     R
1:11                  Default             E     R
1:12                  Default             E     R
1:13                  Default             E     R
1:14                  Default             E     R
1:15                  Default             E     R
1:16                  Default             E     R
1:17                  Default             E     R
1:18                  Default             E     R
1:19                  Default             E     R
1:20                  Default             E     R
1:21                  Default             E     R
1:22                  Default             E     R
1:23                  Default             E     R
1:24                  Default             E     R
1:25                  Default             E     NP
1:26                  Default             E     NP
2:1                   Default             E     R
2:2                   Default             E     R
2:3                   Default             E     R
2:4                   Default             E     R
2:5                   Default             E     R
2:6                   Default             E     R
2:7                   Default             E     R
2:8                   Default             E     R
2:9                   Default             E     R
2:10                  Default             E     R
2:11                  Default             E     R
2:12                  Default             E     R
2:13                  Default             E     R
2:14                  Default             E     R
2:15                  Default             E     R
2:16                  Default             E     R
2:17                  Default             E     R
2:18                  Default             E     R
2:19                  Default             E     R
2:20                  Default             E     R
2:21                  Default             E     R
2:22                  Default             E     R
2:23                  Default             E     R
2:24                  Default             E     R
2:25                  Default             E     NP
2:26                  Default             E     NP
3:1                   Default             E     R
3:2                   Default             E     R
3:3                   Default             E     R
3:4                   Default             E     R
3:5                   Default             E     R
3:6                   Default             E     R
3:7                   Default             E     R
3:8                   Default             E     R
3:9                   Default             E     R
3:10                  Default             E     R
3:11                  Default             E     R
3:12                  Default             E     R
3:13                  Default             E     R
3:14                  Default             E     R
3:15                  Default             E     R
3:16                  Default             E     R
3:17                  Default             E     R
3:18                  Default             E     R
3:19                  Default             E     R
3:20                  Default             E     R
3:21                  Default             E     R
3:22                  Default             E     R
3:23                  Default             E     R
3:24                  Default             E     R
3:25                  Default             E     NP
3:26                  Default             E     NP
4:1                   Default             E     R
4:2                   Default             E     R
4:3                   Default             E     R
4:4                   Default             E     R
4:5                   Default             E     R
4:6                   Default             E     R
4:7                   Default             E     R
4:8                   Default             E     R
4:9                   Default             E     R
4:10                  Default             E     R
4:11                  Default             E     R
4:12                  Default             E     R
4:13                  Default             E     R
4:14                  Default             E     R
4:15                  Default             E     R
4:16                  Default             E     R
4:17                  Default             E     R
4:18                  Default             E     R
4:19                  Default             E     R
4:20                  Default             E     R
4:21                  Default             E     R
4:22                  Default             E     R
4:23                  Default             E     R
4:24                  Default             E     R
4:25                  Default             E     NP
4:26                  Default             E     NP
==================================================================
   Port State: D-Disabled, E-Enabled
   Link State: A-Active, R-Ready, NP-Port not present, L-Loopback,
               D-ELSM enabled but not up
               d-Ethernet OAM enabled but not up
Photo of Patrick Voss

Patrick Voss, Employee

  • 11,474 Points 10k badge 2x thumb
Everything looks good based on the outputs. Can you do a "reboot stack-topology" and then attempt to create the lag? I only ask this because based on the "show ports" output it looks like this is a newly built stack and you are preparing it for production (Based on no active ports).
Photo of Chingis Taltaev

Chingis Taltaev

  • 178 Points 100 badge 2x thumb
It is not in production, i'lll try to reboot it later.
Photo of Prashanth KG

Prashanth KG, Employee

  • 5,300 Points 5k badge 2x thumb
From the outputs that you have provided below, it seems like only slot 2 is affected. I would suggest rebooting slot 2 first and check if that helps! 

Also, since it is not in production, use the latest recommended image 15.6.3.1 patch 1-5 when you are provisioning this to the production environment. Let us know if reboot solves this! 
Photo of Chingis Taltaev

Chingis Taltaev

  • 178 Points 100 badge 2x thumb
I rebooted only switch at stack slot 2 and finally LAG was successfully built:

Slot-3 Stack.3 # reboot slot 2
Do you want to save configuration changes to currently selected configuration
file (primary.cfg) and reboot?
(y - save and reboot, n - reboot without save, <cr> - cancel command) Yes
Saving configuration on master ........................ done!
Synchronizing configuration to backup .......... done!
Saving configuration on Standbys (Slots: 2,4).

Slot-3 Stack.4 # sh slot
Slots    Type                 Configured           State       Ports
--------------------------------------------------------------------
Slot-1   X440-24t-10G         X440-24t-10G         Operational   26
Slot-2   X440-24t-10G         Empty         26
Slot-3   X440-24t-10G         X440-24t-10G         Operational   26
Slot-4   X440-24t-10G         X440-24t-10G         Operational   26
Slot-5                                             Empty          0
Slot-6                                             Empty          0
Slot-7                                             Empty          0
Slot-8                                             Empty          0

after reboot:
Slot-3 Stack.5 # sh slot
Slots    Type                 Configured           State       Ports
--------------------------------------------------------------------
Slot-1   X440-24t-10G         X440-24t-10G         Operational   26
Slot-2   X440-24t-10G         X440-24t-10G         Operational   26
Slot-3   X440-24t-10G         X440-24t-10G         Operational   26
Slot-4   X440-24t-10G         X440-24t-10G         Operational   26
Slot-5                                             Empty          0
Slot-6                                             Empty          0
Slot-7                                             Empty          0
Slot-8                                             Empty          0

Slot-3 Stack.5 # sh stacking
Stack Topology is a Ring
Active Topology is a Ring
Node MAC Address    Slot  Stack State  Role     Flags
------------------  ----  -----------  -------  ---
*00:04:96:82:56:05  3     Active       Master   CA-
 00:04:96:82:55:fe  4     Active       Standby  CA-
 00:04:96:99:37:99  1     Active       Backup   CA-
 00:04:96:99:37:a0  2     Active       Standby  CA-
* - Indicates this node
Flags:  (C) Candidate for this active topology, (A) Active Node
        (O) node may be in Other active topology

* Slot-3 Stack.13 # enable sharing 1:23 grouping 1:23-24,2:23-24,3:23-24,4:23-24 lacp
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

* Slot-3 Stack.16 # sh sharing
Load Sharing Monitor
Config    Current    Agg       Ld Share    Ld Share  Agg   Link    Link Up
Master    Master     Control   Algorithm   Group     Mbr   State   Transitions
==============================================================================
  1:23               LACP      L2          1:23       -      R        0
                               L2          1:24       -      R        0
                               L2          2:23       -      R        0
                               L2          2:24       -      R        0
                               L2          3:23       -      R        0
                               L2          3:24       -      R        0
                               L2          4:23       -      R        0
                               L2          4:24       -      R        0
==============================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
                        (L3_L4) Layer 3 address and Layer 4 port based
                        (custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Number of load sharing trunks: 1


Finally, everything working as i expected, but i don't i understand - is it bug
or just sync master/backup master with standby nodes issue ?

I will update firmware to the current level further.

Thanks a lot !
Photo of Prashanth KG

Prashanth KG, Employee

  • 5,300 Points 5k badge 2x thumb
Not a known issue that we are already aware of. It could be a synchronization issue between the master and slot 2. I would not even generalize the sync issue for all the standby nodes as slot 4 worked fine. An upgrade could help! If the issue happens again in recommended version, I would suggest contacting GTAC. 
Photo of Prashanth KG

Prashanth KG, Employee

  • 5,300 Points 5k badge 2x thumb
Hi Chingis,

Just to narrow down, can you try to add a port from the master switch to the sharing. 

configure sharing 1:1 add ports 3:1 

Check if this works! This would help us to narrow down the issue to only adding ports from the standby node. 
Looking forward to your response. 
Photo of Chingis Taltaev

Chingis Taltaev

  • 178 Points 100 badge 2x thumb
* Slot-3 Stack.3 # enable sharing 1:1 grouping 1:1
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

* Slot-3 Stack.4 # configure sharing 1:1 add ports 2:1
Error: No valid port(s) in the specified "portList" value "2:1".
Configuration failed on backup Node, command execution aborted!

* Slot-3 Stack.5 # configure sharing 1:1 add ports 3:1
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

* Slot-3 Stack.6 # configure sharing 1:1 add ports 4:1
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

* Slot-3 Stack.7 # sh sharing
Load Sharing Monitor
Config    Current    Agg       Ld Share    Ld Share  Agg   Link    Link Up
Master    Master     Control   Algorithm   Group     Mbr   State   Transitions
==============================================================================
   1:1               Static    L2          1:1        -      R        0
                               L2          3:1        -      R        0
                               L2          4:1        -      R        0
==============================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
                        (L3_L4) Layer 3 address and Layer 4 port based
                        (custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Number of load sharing trunks: 1