topic RE: x440 stack enable sharing issue in ExtremeSwitching (EXOS/Switch Engine)

x440 stack enable sharing issue

Chingis_Taltae1 — Thu, 29 Oct 2015 19:03:00 GMT

I have an issue with LAG across stack (4x Summit x440-24t-10G stacked via SummitStack-V):

Slot-3 Stack.18 # sh slot
Slots Type Configured State Ports
--------------------------------------------------------------------
Slot-1 X440-24t-10G X440-24t-10G Operational 26
Slot-2 X440-24t-10G X440-24t-10G Operational 26
Slot-3 X440-24t-10G X440-24t-10G Operational 26
Slot-4 X440-24t-10G X440-24t-10G Operational 26
Slot-5 Empty 0
Slot-6 Empty 0
Slot-7 Empty 0
Slot-8 Empty 0

Slot: Slot-3 * Slot-1
------------------------ ------------------------
Current State: MASTER BACKUP (In Sync)

Image Selected: secondary secondary
Image Booted: secondary secondary
Primary ver: 15.5.4.2 15.5.4.2
Secondary ver: 15.5.4.2 15.5.4.2

Config Selected: primary.cfg
Config Booted: primary.cfg

primary.cfg Created by ExtremeXOS version 15.5.4.2
396528 bytes saved on Thu Oct 29 16:26:54 2015

The stack seems to be OK, all nodes are online and operational, XOS version 15.5.4.2 on all nodes.

I need to create 8 ports LAG (LACP enabled) across stack (SFP ports 23-24 on each stack node), but something goes wrong:

Slot-3 Stack.21 # enable sharing 1:23 grouping 1:23-24,2:23-24,3:23-24,4:23-24 lacp
Error: No valid port(s) in the specified "portList" value "1:23-24,2:23-24,3:23-24,4:23-24".
Configuration failed on backup Node, command execution aborted!

I tried to create 2 ports static LAG across stack (for example copper Ethernet 1:1,2:1 with 1:1 as master port), but got similar issue:

Slot-3 Stack.22 # enable sharing 1:1 grouping 1:1,2:1
Error: No valid port(s) in the specified "portList" value "1:1,2:1".
Configuration failed on backup Node, command execution aborted!

RE: x440 stack enable sharing issue

Patrick_Voss — Thu, 29 Oct 2015 19:16:00 GMT

Hi Chingis,

Can you try to enable sharing just using the master port in the grouping? like so..

enable sharing 1:1 grouping 1:1

If this works try to add port 1:2. Like so..

configure sharing 1:1 add ports 1:2

RE: x440 stack enable sharing issue

Chingis_Taltae1 — Thu, 29 Oct 2015 19:41:00 GMT

Slot-3 Stack.6 # enable sharing 1:1 grouping 1:1
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

Slot-3 Stack.7 # configure sharing 1:1 add ports 1:2
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

Slot-3 Stack.8 # configure sharing 1:1 add ports 2:1
Error: No valid port(s) in the specified "portList" value "2:1".
Configuration failed on backup Node, command execution aborted!



RE: x440 stack enable sharing issue

Chingis_Taltae1 — Thu, 29 Oct 2015 19:41:00 GMT

Also i noticed that Master- Slot 3, Backup - Slot 1, but they differs by hw revision, i think (slot 1 & 2 are 800475-00-13 Rev 13 switches, slot 3 & 4 are 800475-00-08 Rev 8 switches).

RE: x440 stack enable sharing issue

Patrick_Voss — Thu, 29 Oct 2015 19:41:00 GMT

Hardware revision should not matter as long as they can see each other and the stack builds properly everything should work just fine.

RE: x440 stack enable sharing issue

Patrick_Voss — Thu, 29 Oct 2015 19:48:00 GMT

Can you send the "show stacking" command along with "debug epm show peer"? Also take a look at the "show port no-refresh" output to see if these ports are present.

RE: x440 stack enable sharing issue

Chingis_Taltae1 — Thu, 29 Oct 2015 19:59:00 GMT

* Slot-3 Stack.15 # sh stacking
Stack Topology is a Ring
Active Topology is a Ring
Node MAC Address Slot Stack State Role Flags
------------------ ---- ----------- ------- ---
*00:04:96:82:56:05 3 Active Master CA-
00:04:96:82:55:fe 4 Active Standby CA-
00:04:96:99:37:99 1 Active Backup CA-
00:04:96:99:37:a0 2 Active Standby CA-
* - Indicates this node
Flags: (C) Candidate for this active topology, (A) Active Node
(O) node may be in Other active topology

* Slot-3 Stack.16 # debug epm show peer
Chassis Slot Peer Id Partition B/S
---------------------------------------------
0 3 0 2 2
0 1 64 2 2
0 4 65 2 2
0 2 67 2 2

* Slot-3 Stack.28 # sh ports no-refresh
Port Summary
Port Display VLAN Name Port Link Speed Duplex
# String (or # VLANs) State State Actual Actual
==================================================================
1:1 Default E R
1:2 Default E R
1:3 Default E R
1:4 Default E R
1:5 Default E R
1:6 Default E R
1:7 Default E R
1:8 Default E R
1:9 Default E R
1:10 Default E R
1:11 Default E R
1:12 Default E R
1:13 Default E R
1:14 Default E R
1:15 Default E R
1:16 Default E R
1:17 Default E R
1:18 Default E R
1:19 Default E R
1:20 Default E R
1:21 Default E R
1:22 Default E R
1:23 Default E R
1:24 Default E R
1:25 Default E NP
1:26 Default E NP
2:1 Default E R
2:2 Default E R
2:3 Default E R
2:4 Default E R
2:5 Default E R
2:6 Default E R
2:7 Default E R
2:8 Default E R
2:9 Default E R
2:10 Default E R
2:11 Default E R
2:12 Default E R
2:13 Default E R
2:14 Default E R
2:15 Default E R
2:16 Default E R
2:17 Default E R
2:18 Default E R
2:19 Default E R
2:20 Default E R
2:21 Default E R
2:22 Default E R
2:23 Default E R
2:24 Default E R
2:25 Default E NP
2:26 Default E NP
3:1 Default E R
3:2 Default E R
3:3 Default E R
3:4 Default E R
3:5 Default E R
3:6 Default E R
3:7 Default E R
3:8 Default E R
3:9 Default E R
3:10 Default E R
3:11 Default E R
3:12 Default E R
3:13 Default E R
3:14 Default E R
3:15 Default E R
3:16 Default E R
3:17 Default E R
3:18 Default E R
3:19 Default E R
3:20 Default E R
3:21 Default E R
3:22 Default E R
3:23 Default E R
3:24 Default E R
3:25 Default E NP
3:26 Default E NP
4:1 Default E R
4:2 Default E R
4:3 Default E R
4:4 Default E R
4:5 Default E R
4:6 Default E R
4:7 Default E R
4:8 Default E R
4:9 Default E R
4:10 Default E R
4:11 Default E R
4:12 Default E R
4:13 Default E R
4:14 Default E R
4:15 Default E R
4:16 Default E R
4:17 Default E R
4:18 Default E R
4:19 Default E R
4:20 Default E R
4:21 Default E R
4:22 Default E R
4:23 Default E R
4:24 Default E R
4:25 Default E NP
4:26 Default E NP
==================================================================
Port State: D-Disabled, E-Enabled
Link State: A-Active, R-Ready, NP-Port not present, L-Loopback,
D-ELSM enabled but not up
d-Ethernet OAM enabled but not up

RE: x440 stack enable sharing issue

Patrick_Voss — Thu, 29 Oct 2015 20:08:00 GMT

Everything looks good based on the outputs. Can you do a "reboot stack-topology" and then attempt to create the lag? I only ask this because based on the "show ports" output it looks like this is a newly built stack and you are preparing it for production (Based on no active ports).

RE: x440 stack enable sharing issue

Chingis_Taltae1 — Thu, 29 Oct 2015 20:08:00 GMT

It is not in production, i'lll try to reboot it later.

RE: x440 stack enable sharing issue

Prashanth_KG — Thu, 29 Oct 2015 20:08:00 GMT

From the outputs that you have provided below, it seems like only slot 2 is affected. I would suggest rebooting slot 2 first and check if that helps!

Also, since it is not in production, use the latest recommended image 15.6.3.1 patch 1-5 when you are provisioning this to the production environment. Let us know if reboot solves this!

RE: x440 stack enable sharing issue

Chingis_Taltae1 — Thu, 29 Oct 2015 20:08:00 GMT

I rebooted only switch at stack slot 2 and finally LAG was successfully built:

Slot-3 Stack.3 # reboot slot 2
Do you want to save configuration changes to currently selected configuration
file (primary.cfg) and reboot?
(y - save and reboot, n - reboot without save, - cancel command) Yes
Saving configuration on master ........................ done!
Synchronizing configuration to backup .......... done!
Saving configuration on Standbys (Slots: 2,4).

Slot-3 Stack.4 # sh slot
Slots Type Configured State Ports
--------------------------------------------------------------------
Slot-1 X440-24t-10G X440-24t-10G Operational 26
Slot-2 X440-24t-10G Empty 26
Slot-3 X440-24t-10G X440-24t-10G Operational 26
Slot-4 X440-24t-10G X440-24t-10G Operational 26
Slot-5 Empty 0
Slot-6 Empty 0
Slot-7 Empty 0
Slot-8 Empty 0

after reboot:
Slot-3 Stack.5 # sh slot
Slots Type Configured State Ports
--------------------------------------------------------------------
Slot-1 X440-24t-10G X440-24t-10G Operational 26
Slot-2 X440-24t-10G X440-24t-10G Operational 26
Slot-3 X440-24t-10G X440-24t-10G Operational 26
Slot-4 X440-24t-10G X440-24t-10G Operational 26
Slot-5 Empty 0
Slot-6 Empty 0
Slot-7 Empty 0
Slot-8 Empty 0

Slot-3 Stack.5 # sh stacking
Stack Topology is a Ring
Active Topology is a Ring
Node MAC Address Slot Stack State Role Flags
------------------ ---- ----------- ------- ---
*00:04:96:82:56:05 3 Active Master CA-
00:04:96:82:55:fe 4 Active Standby CA-
00:04:96:99:37:99 1 Active Backup CA-
00:04:96:99:37:a0 2 Active Standby CA-
* - Indicates this node
Flags: (C) Candidate for this active topology, (A) Active Node
(O) node may be in Other active topology

* Slot-3 Stack.13 # enable sharing 1:23 grouping 1:23-24,2:23-24,3:23-24,4:23-24 lacp
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

* Slot-3 Stack.16 # sh sharing
Load Sharing Monitor
Config Current Agg Ld Share Ld Share Agg Link Link Up
Master Master Control Algorithm Group Mbr State Transitions
==============================================================================
1:23 LACP L2 1:23 - R 0
L2 1:24 - R 0
L2 2:23 - R 0
L2 2:24 - R 0
L2 3:23 - R 0
L2 3:24 - R 0
L2 4:23 - R 0
L2 4:24 - R 0
==============================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
(L3_L4) Layer 3 address and Layer 4 port based
(custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Number of load sharing trunks: 1

Finally, everything working as i expected, but i don't i understand - is it bug
or just sync master/backup master with standby nodes issue ?

I will update firmware to the current level further.

Thanks a lot !

RE: x440 stack enable sharing issue

Prashanth_KG — Thu, 29 Oct 2015 20:08:00 GMT

Not a known issue that we are already aware of. It could be a synchronization issue between the master and slot 2. I would not even generalize the sync issue for all the standby nodes as slot 4 worked fine. An upgrade could help! If the issue happens again in recommended version, I would suggest contacting GTAC.

RE: x440 stack enable sharing issue

Prashanth_KG — Thu, 29 Oct 2015 20:17:00 GMT

Hi Chingis,

Just to narrow down, can you try to add a port from the master switch to the sharing.

configure sharing 1:1 add ports 3:1

Check if this works! This would help us to narrow down the issue to only adding ports from the standby node.
Looking forward to your response.

RE: x440 stack enable sharing issue

Chingis_Taltae1 — Thu, 29 Oct 2015 20:17:00 GMT

* Slot-3 Stack.3 # enable sharing 1:1 grouping 1:1
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

* Slot-3 Stack.4 # configure sharing 1:1 add ports 2:1
Error: No valid port(s) in the specified "portList" value "2:1".
Configuration failed on backup Node, command execution aborted!

* Slot-3 Stack.5 # configure sharing 1:1 add ports 3:1
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

* Slot-3 Stack.6 # configure sharing 1:1 add ports 4:1
Warning: Any config on the master port is lost (STP, IGMP Filter, IGMP Static Group, MAC-Security, CFM, TRILL, etc.)

* Slot-3 Stack.7 # sh sharing
Load Sharing Monitor
Config Current Agg Ld Share Ld Share Agg Link Link Up
Master Master Control Algorithm Group Mbr State Transitions
==============================================================================
1:1 Static L2 1:1 - R 0
L2 3:1 - R 0
L2 4:1 - R 0
==============================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
(L3_L4) Layer 3 address and Layer 4 port based
(custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Number of load sharing trunks: 1