ExtremeSwitching (EXOS)

Expand all | Collapse all

X460 and X450 Flapping Ports

  • 1.  X460 and X450 Flapping Ports

    Posted 05-06-2014 06:53
    I have installed 15 new X460 switch stacks, and upgraded the Firmware on some old X450s.
    I notice that many of the Ethernet Ports are "Flapping". There is no stable connection, and devices constantly disconnect/reconnect at 10M/100M/1000M. I note that the problem is worse with some Canon Printers, but other devices have problems. I can make the ports more stable by forcing the speed to 10M.

    Here are some typical syslogs:

    May 6 10:21:31 degp-s02


  • 2.  RE: X460 and X450 Flapping Ports

    Posted 05-06-2014 10:09
    What type of cable are you using to connect two switches?
    Is there any L2 switch present in between the X460 and X450.
    Does same type of log messages present on both the side of switch port during the same time?
    How frequently the ports are getting flapped?
    Is there any loop in the network?
    Do you see any process going high in "top" command output?


  • 3.  RE: X460 and X450 Flapping Ports

    Posted 05-06-2014 11:40
    hi

    Tha cables are described: MegaLine-Patch 6AEA-RJ45SL
    I have a L3 core switch (x460-24x) connected to 10 edge switches (x460-48p) and some older X450-48P), in a star network.

    The problems are between the edge switches and the devices. Many Canon Printers iR-ADV C5235 (MAC 88:87:17:7e:82:2d) have the problem - see logs below.
    Some PCs also have a problem.
    The users are starting to complain about the new network.
    The message occurs only on edge ports, not between switches.
    There is no loop in the network ( I checked ELRP )
    The messages appear every few minutes (see below)

    * Slot-1 DEGP-S09.11 # show cpu-monitoring
    (sorted output)
    Card Process 5 10 30 1 5 30 1 Max Total
    Slot-1 fdb 0.7 0.9 1.0 1.0 0.9 0.8 0.8 3.4 16,772.9 16,121.2
    Slot-1 exsshd 2.4 2.0 1.6 1.5 1.6 1.1 0.9 6.8 3,707.4 20,690.4
    Slot-1 snmpSubagent 0.0 0.0 0.0 0.0 0.0 0.1 0.0 21.9 2,935.9 1,951.0
    Slot-1 nodemgr 0.2 0.1 0.1 0.1 0.1 0.1 0.1 0.5 2,509.3 2,651.9
    Slot-1 snmpMaster 0.0 0.0 0.0 0.0 0.0 0.1 0.0 22.1 2,451.3 1,914.6
    Slot-1 hal 0.8 0.5 0.5 0.4 0.4 0.4 0.4 66.6 2,365.6 14,125.2
    Slot-1 epm 0.1 0.0 0.0 0.1 0.1 0.1 0.1 7.1 1,594.7 684.4
    Slot-1 acl 0.2 0.2 0.1 0.1 0.1 0.1 0.1 0.8 1,493.1 4,160.6
    Slot-1 cfgmgr 0.0 0.0 0.0 0.0 0.0 0.1 0.0 9.6 992.0 546.5
    Slot-1 etmon 0.0 0.0 0.0 0.1 0.1 0.1 0.1 7.8 950.2 964.9
    Slot-1 bfd 0.1 0.0 0.0 0.1 0.1 0.1 0.1 0.6 677.3 813.0
    Slot-1 rip 0.1 0.0 0.0 0.1 0.1 0.1 0.1 0.8 599.5 1,227.9
    Slot-1 r.png 0.0 0.0 0.0 0.1 0.1 0.1 0.1 0.6 578.6 679.5
    Slot-1 thttpd 0.0 0.0 0.0 0.0 0.0 0.1 0.1 14.2 509.7 71.1
    Slot-1 esrp 0.0 0.0 0.0 0.2 0.1 0.1 0.1 6.5 441.9 542.1
    Slot-1 msdp 0.0 0.0 0.0 0.1 0.1 0.1 0.1 0.6 382.7 464.2
    Slot-1 eaps 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.8 241.0 76.3
    Slot-1 vlan 0.0 0.0 0.0 0.0 0.0 0.0 0.0 7.2 214.0 58.4
    Slot-1 System 8.3 7.4 8.4 7.6 8.0 7.8 7.8 15.6 196.6 278,076.4

    * Slot-1 DEGP-S09.13 # top
    Mem: 402768K used, 107736K free, 0K shrd, 144268K buff, 91192K cached
    CPU: 1.6% usr 12.7% sys 0.0% nic 81.3% idle 0.0% io 3.7% irq 0.4% sirq
    Load average: 7.26 7.33 7.34 4/185 13639
    PID PPID USER STAT RSS %MEM CPU %CPU COMMAND
    1217 2 root RW< 0 0.0 0 4.2 [bcmLINK.0]
    1219 2 root SW< 0 0.0 1 3.7 [bcmLINK.1]
    13626 1695 root S 1324 0.2 1 2.1 ./exsshd
    1439 1 root S 3212 0.6 1 0.9 ./fdb
    13639 13638 root R 820 0.1 0 0.9 top -d 3

    I also see on some switches (below is the core switch):
    05/06/2014 14:40:44.09


  • 4.  RE: X460 and X450 Flapping Ports

    Posted 05-06-2014 11:40
    what is mean
    switch#top .?
    for what it using ?


  • 5.  RE: X460 and X450 Flapping Ports

    Posted 05-06-2014 11:40
    please refer to the "ExtremeXOS Command Reference Guide" to get information about the different commands...

    # top

    Description:
    Displays real-time CPU utilization information by process.


  • 6.  RE: X460 and X450 Flapping Ports

    Posted 05-06-2014 15:57
    How long you have seen this issue? Have you done any changes which could trigger this issue?

    Does auto negotiation is on,on all the port which are connected to the end devices? if yes, then you might need to open case with TAC for further investigation.


  • 7.  RE: X460 and X450 Flapping Ports

    Posted 05-07-2014 05:45
    I was using AUTO on all ports. for the flapping ports, I have set the connection to fixed 10M/half.
    I think I must open a case.
    What are the best commands to check the switch?
    You suggested TOP? any others?



  • 8.  RE: X460 and X450 Flapping Ports

    Posted 05-07-2014 05:53
    Yes,

    You can share the below information to TAC when you open case. It would help to get resolution as soon as possible.

    Network topology diagram
    show forwarding configuration
    debug hal show forwarding distributions
    debug hal show ipv4Mc
    show iproute reserved-entries statistics
    show tech
    show port information detail
    show port configuration
    debug hal show optic-info
    debug hal show cpu-queue

    Thanks.



  • 9.  RE: X460 and X450 Flapping Ports

    Posted 05-07-2014 05:53
    thank for this information , but when i doing this commands i got on many values ! how can i know which the better value?


  • 10.  RE: X460 and X450 Flapping Ports

    Posted 05-07-2014 15:31
    I had this same problem in Extreme switches. This happened when I fixed the port speed to 100Mbps Full duplex for example, workstation and IP station and printers were auto-negotiation happened flapping port.


  • 11.  RE: X460 and X450 Flapping Ports

    Posted 05-07-2014 18:30
    Hi Edson, Thanks for the input. Most of my problems occur with Canon printers, so as a work around I have been setting the speed to 10M fixed. I'm just annoyed that we have "upgraded" from 10 year old Cisco switches (which had no problems) to brand new Extreme switches that have these problems.


  • 12.  RE: X460 and X450 Flapping Ports

    Posted 05-20-2014 10:32
    Hi Martin,

    I suspect that your old switches were Fast Ethernet switches? In this case you should check your passive infrastructure. I've seen issues with Gigabit in one of our offices as well, turned out that the - very old - cabling wasn't able to handle Gigabit Ethernet. If cabling turns out to be the issue you've basically got two options:

    * Replace the cabling.
    * configure ports


  • 13.  RE: X460 and X450 Flapping Ports

    Posted 05-26-2014 16:13
    Robert, thanks for the feedback. I have tried this, it helps a bit. ;-)


  • 14.  RE: X460 and X450 Flapping Ports

    Posted 01-21-2015 08:44
    hi martin, did you managed to resolve the issue? I having the same issue with x460 now


  • 15.  RE: X460 and X450 Flapping Ports

    Posted 01-21-2015 09:04
    Hi Boon,
    Are you seeing this problem in X460 XGM module 10g ports?

    could you copy paste the link flap logs from x460 and its peer device?


  • 16.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 01:36
    Hi there,

    after we upgraded the switch firmware and applied debounce time 150 to stack ports, the stack ports flapping issue was resolved. However, I did observed some flapping for data ports. No sure if anyone noticed this issue.


  • 17.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 04:16
    It applies to data ports as well Please apply denounce timer settings Summit , bd8k and bdx8 10 g ports are impacted


  • 18.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 04:34
    should we applied debounce 150 to all data ports too? Extreme support advise that it should be applied to port that are flapping only. is that right?


  • 19.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 04:58
    If the switch is connected to another 10 g port
    (Switch) then yes. '
    All 10g switch to switch connectivity ports must have debounce timer to 150 .

    Note: 3rd party vendors have default debounce
    Timer as 150


  • 20.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 10:31
    The latest release of EXOS (15.5.3) should have a fix that remove the debounce timer. Please check the RN.


  • 21.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 10:47
    it is not 10G port, but the 1G data ports that are flapping. I have upgraded to 15.5.3 patch 1-2.
    #configured stack-port debounce time 150

    #debug hal configure stack-ports pre-emphasis 7 driver-current 9

    anyone faced similar issue?



  • 22.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 10:47
    I have a 2 slot stack with 460 runing xos 15.4.2 , I tried to configure the command "configure stack-ports 2:2 debounce time 150" but it is not accepted by the sw

    How can i configure the debounce timer?



  • 23.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 10:47
    You need 15.5.3 I think for this command. Upgrade to the latest patch of this release.


  • 24.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 10:47
    we just need to upgrade x460 to the right EXOS version.
    I believe in x460 by default the debounce timer is 150.
    For other chassis based and summit switches it has to be manually set with exos versions.


  • 25.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 12:00
    It looks like in exos 15.5.x we dont need these settings.[x460]



  • 26.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 12:26
    no sure, it is requested by extreme support to put in these commands after upgrade to 15.5.3 patch 1-2


  • 27.  RE: X460 and X450 Flapping Ports

    Posted 01-27-2015 13:21
    Just for clarification.

    There was an issue with 10G uplinks on x460. This is documented in the FN404. This is resolved with some EXOS version, as documented.

    Stacking flapping is addressed via a specific command, that is accessible and persistent since 15.5.3. Defining the right value, if you have that issue, should be done with the help of TAC.

    Other summits, BD, ports, are not impacted.

    For 1G flapping, that could be due to cabling (is the cable old? what category? PoE on it as well?) or due to the end-device.

    Using debounce timer on a data port will certainly prevent flapping. Question is, is that for a good thing? If the flapping is due to some issues with the links, hiding it will not resolve loss of packet, poor performances, etc. I am not aware of problem of that sort, so I'd encourage you to validate the infra, check if reducing speed helps...