High CPU utilization on X450a stack with ERPS

Alexander_Shiko — Fri, 05 Jul 2019 18:31:31 GMT

Hello!

I'm testing ERPS-protected ring between Summit X670G2 and two stacks consisting of two Summit X450a switches. When ERPS is in state "Idle", on Summit X450a stacks high CPU utilization is observed. CPU is highly utilized by mcmgr process. The example output from RPL owner:

code:

* Slot-1 swc1-igo.ki.1 # show erps "ring-SPKI"

  Name: ring-SPKI
  Operational State: Idle        Node Type: RPL Owner,  Revertive
  Configured State : Enabled

  East Ring Port :  1:25 MepId: 0  Remote MepId: 0      Status: Unblocked
  West Ring Port : +2:25 MepId: 0  Remote MepId: 0      Status: Blocked

  Periodic timer interval:  5000 millisec (Enabled)
  Hold-off timer interval:  0    millisec (Enabled)
  Guard timer interval   :  500  millisec (Enabled)
  WTB timer interval     :  5500 millisec (Enabled)
  WTR timer interval     :  300000 millisec (Enabled)

  Ring MD Level          :  ----
  CCM Interval East      :  1000 millisec
  CCM Interval West      :  1000 millisec
  Notify Topology Change :  -------
  Subring Mode           :  Virtual Channel

  ERPS Control Vlan: V201-ring-SPKI-Control  VID:201
  Topology Change Propogation List: None
  Topology Change Propogation  : Disabled
  ERPS Ring's Sub-Ring(s): None
  ERPS Ring has following Protected Vlan(s):
  ERPS Ring's Protected Vlan(s): Unassigned
  Number of Protected Vlans: 1
  (+) RPL Protection Port, (^) RPL Neighbor Port
  (f) Force Switch Port, (m) Manual Switch Port

* Slot-1 swc1-igo.ki.2 # show cpu-monitoring process mcmgr

      CPU Utilization Statistics - Monitored every 5 seconds
-------------------------------------------------------------------------------

Card   Process      5    10   30   1    5    30   1    Max           Total
                    secs secs secs min  mins mins hour            User/System
                    util util util util util util util util       CPU Usage
                    (%)  (%)  (%)  (%)   (%)  (%)  (%)  (%)         (secs)
-------------------------------------------------------------------------------

Slot-1 System       26.1 21.5 20.1 21.7 20.6 20.8 22.6 99.9   288.43   644605.73
Slot-2 System       27.4 24.7 25.6 24.3 23.6 22.0 22.7 99.9     0.00       0.00
Slot-1 mcmgr        65.0 71.3 72.8 68.8 70.2 70.0 68.3 90.9 611371.64  1681632.13
Slot-2 mcmgr         0.0  0.0  0.0  0.0  0.0  0.0  0.0  6.4    38.97      23.40

When ERPS is in state "Protection" or "Pending" then everything looks fine:

code:

* Slot-1 swc1-igo.ki.4 # show erps "ring-SPKI"

  Name: ring-SPKI
  Operational State: Protection        Node Type: RPL Owner,  Revertive
  Configured State : Enabled

  East Ring Port :  1:25 MepId: 0  Remote MepId: 0      Status: Unblocked
  West Ring Port : +2:25 MepId: 0  Remote MepId: 0      Status: Blocked  

  Periodic timer interval:  5000 millisec (Enabled)
  Hold-off timer interval:  0    millisec (Enabled)
  Guard timer interval   :  500  millisec (Enabled)
  WTB timer interval     :  5500 millisec (Enabled)
  WTR timer interval     :  300000 millisec (Enabled)

  Ring MD Level          :  ----
  CCM Interval East      :  1000 millisec
  CCM Interval West      :  1000 millisec
  Notify Topology Change :  -------                         
  Subring Mode           :  Virtual Channel                 

  ERPS Control Vlan: V201-ring-SPKI-Control  VID:201  
  Topology Change Propogation List: None
  Topology Change Propogation  : Disabled
  ERPS Ring's Sub-Ring(s): None
  ERPS Ring has following Protected Vlan(s):
    Vlan Name                    VID
    mgmt_Backbone                10   
  Number of Protected Vlans: 1
  (+) RPL Protection Port, (^) RPL Neighbor Port
  (f) Force Switch Port, (m) Manual Switch Port

* Slot-1 swc1-igo.ki.4 # show cpu-monitoring process mcmgr

      CPU Utilization Statistics - Monitored every 5 seconds
-------------------------------------------------------------------------------

Card   Process      5    10   30   1    5    30   1    Max           Total
                    secs secs secs min  mins mins hour            User/System
                    util util util util util util util util       CPU Usage
                    (%)  (%)  (%)  (%)   (%)  (%)  (%)  (%)         (secs)
-------------------------------------------------------------------------------

Slot-1 System        2.1  2.5  5.2 19.0 20.4 20.5 22.3 99.9   288.47   644637.90
Slot-2 System        0.2  0.4  6.6 22.8 24.2 22.9 22.7 99.9     0.00       0.00
Slot-1 mcmgr         0.0  0.0 14.5 71.1 70.8 70.2 68.6 90.9 611402.40  1681716.55
Slot-2 mcmgr         0.0  0.0  0.0  0.0  0.0  0.0  0.0  6.4    38.98      23.40

The configuration is simple. Here is output from all three devices:
RPL Owner:

code:

* Slot-1 swc1-igo.ki.5 # show configuration "erps"
#
# Module erps configuration.
#
enable erps
create erps ring-SPKI
configure erps ring-SPKI add control vlan V201-ring-SPKI-Control
configure erps ring-SPKI ring-port east 1:25
configure erps ring-SPKI ring-port west 2:25
configure erps ring-SPKI protection-port 2:25
enable erps ring-SPKI
configure erps ring-SPKI add protected vlan mgmt_Backbone

East switch:

code:

swc1-gdr.ki.1 # show configuration "erps"
#
# Module erps configuration.
#
enable erps
create erps Ring-SPI
configure erps Ring-SPI add control vlan V201_Ring-SPI
configure erps Ring-SPI ring-port east 15
configure erps Ring-SPI ring-port west 31
enable erps Ring-SPI
configure erps Ring-SPI add protected vlan mgmt_Backbone

West switch:

code:

* Slot-2 sw0-kur.ki.itcons.net.ua.10 # show configuration "erps" 
#
# Module erps configuration.
#
enable erps
create erps ring-SPI
configure erps ring-SPI add control vlan V201_ring-SPI
configure erps ring-SPI ring-port east 1:26
configure erps ring-SPI ring-port west 1:25
enable erps ring-SPI
configure erps ring-SPI add protected vlan mgmt_Backbone

Did anyone have the similar issue? Any help is kindly appreciated! Thanks.

Re: High CPU utilization on X450a stack with ERPS

Necheporenko__N — Sat, 06 Jul 2019 16:00:58 GMT

Hello Alexander,

What is the EXOS version used in your test and please share outputs:

top
show iproute reser ent
show acce usage acl-s port 1

Best Regards,
Nikolay

Re: High CPU utilization on X450a stack with ERPS

Alexander_Shiko — Tue, 09 Jul 2019 15:22:11 GMT

Kind apologises for noising. It was just misconfiguration of VLANs in the ring. ?

topic High CPU utilization on X450a stack with ERPS in ExtremeSwitching (EXOS/Switch Engine)

High CPU utilization on X450a stack with ERPS

Re: High CPU utilization on X450a stack with ERPS

Re: High CPU utilization on X450a stack with ERPS