topic RE: Abnormal high CPU utilization on stack in ExtremeSwitching (EXOS/Switch Engine)

Abnormal high CPU utilization on stack

Ilya_Semenov — Fri, 07 Oct 2016 00:01:00 GMT

Hello, everybody!

I have a stack of 2x460 and 6x440 1st generation summits (8 switches total). The problem is every morning at exactly same time I get the message from snmp (please, see the attached file).

I've noticed also, that there is constantly high CPU utilization from 20 to approximately 50% regardless of the day time. The EXOS version is 15.7.4.2.

Please, share your ideas about reasons why it happening.

Many thanks in advance,

Ilya

RE: Abnormal high CPU utilization on stack

BrandonC — Fri, 07 Oct 2016 00:12:00 GMT

The SNMP timeout may be due to the high CPU on the switch.

Is the cliMaster process always the one that is highest?

You can check if there are any CLI sessions hung on the stack with the command 'show session'.

Also, I would take a look at the logs on the switch to see if anything interesting stands out.

-Brandon

RE: Abnormal high CPU utilization on stack

Marco_Lorenz — Fri, 07 Oct 2016 00:25:00 GMT

The reason for high cpu can be a device sending a lot of multicasts. Because multicasts are pricessed in the main cpu the load will inctease with the amount of multicasts being send to the device. You can figure it out by inspecting a tracefile. I have a similar issue and the only way to decrease cpu load was an accesslist which blocks multicasttraffic on the port where the sending device is attached.

RE: Abnormal high CPU utilization on stack

Erik_Auerswald — Fri, 07 Oct 2016 00:25:00 GMT

Lots of multicast traffic can be generated by many end systems sending some multicast, e.g. Bonjour, MDNS, LLMNR, SSDP/UPnP. These packets are sent to the switch CPU, but the switch does not use the information.

Taking a packet capture should give you information about the amount of this kind of multicast traffic in your network.

You can stop those packets from affecting the switch CPU by using an ACL. You can use the following as an example to start from:
entry deny_MDNS { if match all { destination-address 224.0.0.251/32; } then { deny-cpu; count MDNS-deny; } } entry deny_LLMNR { if match all { destination-address 224.0.0.252/32; } then { deny-cpu; count LLMNR-deny; } }The counters give you a way to see if there were packets affected by the ACL.

You might want to take a look at the GTAC Knowledge article How can I block mDNS with an ACL using MAC addresses as well.

RE: Abnormal high CPU utilization on stack

Gilson_Fraboni — Fri, 07 Oct 2016 00:28:00 GMT

you have configuring Windows NLB on the stack?

RE: Abnormal high CPU utilization on stack

Marco_Lorenz — Fri, 07 Oct 2016 00:28:00 GMT

If possible you can disable all edgeports and enable them one after the other and look which port is responsible for the high cpu load.

RE: Abnormal high CPU utilization on stack

Marco_Lorenz — Fri, 07 Oct 2016 02:14:00 GMT

No. No NLB. In my case it is a machinecntroller from Siemens (S7), which is sending a lot of multicasts and brings CPU to 85% in average.

RE: Abnormal high CPU utilization on stack

Prashanth_KG — Fri, 07 Oct 2016 05:28:00 GMT

Hi Ilya,

As per the screenshot, the process CLI master seems to be consuming high amount of CPU.
In general, CLI would consume CPU in case of any outputs collected from different sessions.
Since timeout is happening at the same time in the morning, I would like to check if there is any script running to fetch any outputs from the switch around the same time.

It could be from the NMS device or any other server.
In addition to this, looking at the logs could also provide any lead for the investigation.

Hope this helps!

RE: Abnormal high CPU utilization on stack

Ilya_Semenov — Wed, 12 Oct 2016 21:11:00 GMT

Hello, everybody!

I've checked my switches for excessive multicast. There in no anything unusual - average amount on access ports, more on uplinks.

The only CLI session is mine, which I use at the moment.

I've found some scripts in the configuration, but how can find out the time when it is running? Not sure this is important, but this stack is connected to Netsight system.

Please, see the log files attached.

Many thanks in advance,

Ilya

Mem: 642724K used, 378788K free, 0K shrd, 127648K buff, 144432K cachedCPU: 35.1% usr 58.7% sys 0.0% nic 0.1% idle 0.0% io 2.5% irq 3.3% sirq
Load average: 12.95 12.81 12.45 14/186 6261
PID PPID USER STAT RSS %MEM CPU %CPU COMMAND
1489 1 root R < 36220 3.5 1 40.4 ./hal
1493 1 root S 30972 3.0 0 34.7 ./cliMaster
1560 1 root S 4140 0.4 0 4.9 ./stp
1568 1 root S 4812 0.4 0 3.2 ./mcmgr
1635 2 root SW< 0 0.0 1 3.2 [bcmL2X.1]
1816 2 root SW< 0 0.0 1 2.4 [bcmCNTR.1]
1341 2 root SW 0 0.0 1 2.4 [bcmRX]
1815 2 root SW< 0 0.0 0 1.6 [bcmCNTR.0]
1633 2 root RW< 0 0.0 0 1.2 [bcmL2X.0]
6110 6109 root R 832 0.0 0 0.8 top -d 3
1491 1 root S 1732 0.1 0 0.4 ./nodemgr
1284 2 root RW< 0 0.0 1 0.4 [bcmLINK.1]
1532 1 root S 3144 0.3 1 0.3 ./lacp
1281 2 root RW< 0 0.0 0 0.3 [bcmLINK.0]
1627 1 root S 5576 0.5 1 0.1 ./xmld
1505 1 root S 4784 0.4 0 0.1 ./vlan
1497 1 root S 4136 0.4 0 0.1 ./snmpMaster
1593 1 root S 3508 0.3 0 0.1 ./acl
1658 1 root S 3148 0.3 1 0.1 ./erps
1537 1 root S 2736 0.2 1 0.1 ./synce
1570 1 root S 2672 0.2 0 0.1 ./bfd
1582 1 root S 2152 0.2 0 0.1 ./r.png
1287 2 root SW< 0 0.0 0 0.1 [bcmRLINK]
1613 1 root S 21556 2.1 0 0.0 ./etmon
1642 1 root R 6644 0.6 0 0.0 ./upm
1595 1 root S 6452 0.6 0 0.0 ./netTools
1495 1 root S 5236 0.5 0 0.0 ./cfgmgr
1648 1 root S 5076 0.5 0 0.0 ./idMgr
1500 1 root S 4824 0.4 0 0.0 ./snmpSubagent
1507 1 root S 4396 0.4 1 0.0 ./fdb
1563 1 root S 3972 0.3 1 0.0 ./rtmgr update
1485 1 root S 3576 0.3 0 0.0 ./emsServer
1650 1 root S 3356 0.3 0 0.0 ./vmt
1529 1 root S 3288 0.3 1 0.0 ./lldp
1646 1 root S 3268 0.3 0 0.0 ./dot1ag
1555 1 root S 3116 0.3 0 0.0 ./eaps
1597 1 root S 2976 0.2 0 0.0 ./netLogin
1652 1 root S 2956 0.2 1 0.0 ./vsm
1557 1 root S 2948 0.2 0 0.0 ./esrp
1666 1 root S < 2940 0.2 0 0.0 ./mrp
1605 1 root S 2908 0.2 0 0.0 ./telnetd -e
1640 1 root S 2900 0.2 1 0.0 ./ipSecurity
1660 1 root S 2788 0.2 0 0.0 ./fcoe
1511 1 root S 2784 0.2 0 0.0 ./elrp
1616 1 root S 2768 0.2 0 0.0 ./ipfix
1623 1 root S 2760 0.2 0 0.0 ./poe
1526 1 root S 2756 0.2 0 0.0 ./edp
1644 1 root S 2736 0.2 0 0.0 ./hclag
1534 1 root S 2708 0.2 0 0.0 ./ethoam
1521 1 root S 2688 0.2 0 0.0 ./elsm
1117 1 root S 2680 0.2 0 0.0 /exos/bin/epm -t 40 -f /exos/config/epmrc.Edge -d /exos/config/epmdprc
1577 1 root S 2468 0.2 0 0.0 ./rip
1502 1 root S 2272 0.2 0 0.0 ./aaa -t random
1487 1 root S 2224 0.2 0 0.0 ./devmgr
1572 1 root S 2156 0.2 0 0.0 ./msdp
1671 1 root S 1992 0.1 0 0.0 ./ntp
1638 1 root S 1964 0.1 0 0.0 ./xmlc
1618 1 root S 1888 0.1 0 0.0 ./thttpd
6000 1614 root S 1764 0.1 1 0.0 exsh

Slot-1 sw-416-1.3 # sh cpu

CPU Utilization Statistics - Monitored every 5 seconds
-------------------------------------------------------------------------------

Card Process 5 10 30 1 5 30 1 Max Total
secs secs secs min mins mins hour User/System
util util util util util util util util CPU Usage
(%) (%) (%) (%) (%) (%) (%) (%) (secs)
-------------------------------------------------------------------------------

Slot-1 System 12.7 14.7 13.6 14.1 13.6 13.5 13.0 57.7 605.68 864077.47
Slot-7 System 9.6 8.8 10.2 10.3 9.8 9.6 9.3 94.1 0.00 0.00
Slot-1 aaa 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 297.52 318.13
Slot-1 acl 0.0 0.0 0.0 0.1 0.1 0.1 0.1 3.1 5849.86 9895.30
Slot-1 bfd 0.0 0.0 0.0 0.1 0.1 0.1 0.1 1.7 2437.83 3918.24
Slot-1 bgp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 brm 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 ces 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 cfgmgr 0.0 0.0 0.3 1.3 1.1 1.2 1.1 46.2 7913.91 11305.44
Slot-1 cli 19.4 21.8 29.6 30.0 28.9 28.4 29.1 62.4 733385.67 323527.41
Slot-1 devmgr 0.0 0.0 0.0 0.1 0.1 0.1 0.1 16.6 962.27 749.59
Slot-1 dirser 0.1 0.0 0.0 0.1 0.1 0.1 0.1 4.6 487.26 1930.69
Slot-1 dosprotect 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.4 152.31 63.61
Slot-1 dot1ag 0.0 0.0 0.0 0.1 0.1 0.3 0.2 8.4 556.42 491.47
Slot-1 eaps 0.1 0.0 0.0 0.0 0.0 0.0 0.0 3.5 266.75 163.95
Slot-1 edp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 155.50 70.32
Slot-1 elrp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.1 149.65 66.56
Slot-1 elsm 0.0 0.0 0.0 0.1 0.1 0.1 0.1 1.7 422.65 411.30
Slot-1 ems 0.6 0.3 0.1 0.3 0.1 0.2 0.2 31.8 1362.58 2257.70
Slot-1 epm 0.4 0.2 0.1 0.2 0.1 0.1 0.1 12.5 6394.31 2213.05
Slot-1 erps 0.0 0.0 0.0 0.1 0.0 0.0 0.0 2.4 202.28 96.38
Slot-1 esrp 0.0 0.0 0.0 0.1 0.1 0.0 0.0 2.6 685.03 1060.98
Slot-1 ethoam 0.0 0.0 0.0 0.0 0.0 0.0 0.0 7.2 151.48 68.14
Slot-1 etmon 0.1 0.0 0.0 0.1 0.1 0.0 0.1 17.5 1414.09 2059.48
Slot-1 exacl 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 exdhcpsnoop 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 exdos 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 exfib 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 exfipSnoop 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 exosmc 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 exosq 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 exsflow 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 exsnoop 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 exvlan 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 fcoe 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 210.35 118.57
Slot-1 fdb 0.1 0.1 0.1 0.1 0.1 0.1 0.5 4.4 76005.18 16853.89
Slot-1 gptp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 hal 2.8 15.2 26.6 25.6 28.7 27.9 27.4 84.0 73649.74 546304.22
Slot-1 hclag 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.8 148.31 67.25
Slot-1 idMgr 0.0 0.0 0.0 0.0 0.0 0.0 0.0 12.6 179.78 73.58
Slot-1 ipSecurity 0.0 0.0 0.0 0.1 0.0 0.0 0.0 2.6 168.93 79.36
Slot-1 ipfix 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 163.19 68.09
Slot-1 isis 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 lacp 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.5 392.93 311.84
Slot-1 lldp 0.0 0.0 0.0 0.1 0.0 0.0 0.0 2.0 643.84 764.32
Slot-1 mcmgr 0.0 0.2 0.1 0.5 0.6 0.3 0.3 6.8 3350.48 3600.18
Slot-1 mpls 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 mrp 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.7 204.02 114.20
Slot-1 msdp 0.1 0.0 0.0 0.1 0.1 0.1 0.1 1.8 1088.31 1158.59
Slot-1 netLogin 0.0 0.0 0.0 0.0 0.0 0.0 0.0 13.1 176.13 82.45
Slot-1 netTools 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 188.39 83.89
Slot-1 nettx 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 nodemgr 0.3 0.3 0.4 0.4 0.3 0.3 0.3 3.5 17028.19 12475.77
Slot-1 ntp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 176.52 77.25
Slot-1 ospf 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 ospfv3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 pim 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 poe 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 149.12 68.30
Slot-1 polMgr 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.5 160.17 78.52
Slot-1 pwmib 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.3 159.73 61.58
Slot-1 rip 0.0 0.0 0.0 0.1 0.0 0.1 0.1 2.1 1537.24 3353.32
Slot-1 r.png 0.0 0.0 0.0 0.1 0.1 0.1 0.1 2.0 1471.75 1577.36
Slot-1 rtmgr 0.0 0.0 0.0 0.1 0.1 0.1 0.1 4.3 631.01 403.40
Slot-1 snmpMaster 0.0 0.0 0.0 0.2 0.1 1.0 0.5 22.3 13751.91 2999.93
Slot-1 snmpSubagent 0.0 0.0 0.0 0.1 0.1 1.0 0.5 18.4 12064.70 1575.87
Slot-1 stp 7.6 5.0 3.7 3.9 3.8 3.4 2.9 29.8 59609.82 82960.31
Slot-1 synce 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.4 191.39 113.93
Slot-1 techSupport 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.4 144.89 67.75
Slot-1 telnetd 0.0 0.0 0.0 0.1 0.1 0.0 0.0 1.8 168.28 69.14
Slot-1 tftpd 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.6 141.28 63.51
Slot-1 thttpd 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 147.77 63.61
Slot-1 trill 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 upm 0.0 0.0 0.0 0.1 0.0 0.0 0.1 1.7 405.91 478.57
Slot-1 vlan 0.0 0.0 0.0 0.1 0.1 0.1 0.0 16.3 3489.49 623.99
Slot-1 vmt 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 170.84 71.81
Slot-1 vrrp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-1 vsm 0.1 0.0 0.0 0.0 0.0 0.0 0.0 2.6 179.10 86.11
Slot-1 xmlc 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 165.58 65.64
Slot-1 xmld 0.0 0.0 0.0 0.1 0.0 0.0 0.0 21.2 190.71 73.97
Slot-7 aaa 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.5 173.81 235.13
Slot-7 acl 0.0 0.0 0.1 0.2 0.1 0.1 0.1 3.7 6272.74 9989.06
Slot-7 bfd 0.0 0.0 0.0 0.1 0.1 0.1 0.1 1.3 2238.40 3728.43
Slot-7 bgp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 brm 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 ces 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 cfgmgr 0.0 0.0 0.0 0.0 0.0 0.0 0.0 8.5 99.15 49.60
Slot-7 cli 0.0 0.0 0.0 0.0 0.0 0.0 0.0 35.5 148.23 108.05
Slot-7 devmgr 0.0 0.0 0.0 0.1 0.0 0.0 0.0 21.8 354.02 231.72
Slot-7 dirser 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 45.79 25.10
Slot-7 dosprotect 0.1 0.0 0.0 0.0 0.0 0.0 0.0 1.5 41.09 18.34
Slot-7 dot1ag 0.0 0.0 0.0 0.1 0.0 0.0 0.0 2.3 109.78 120.37
Slot-7 eaps 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.5 69.56 40.55
Slot-7 edp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.5 49.42 24.19
Slot-7 elrp 0.1 0.0 0.0 0.0 0.0 0.0 0.0 2.3 48.85 25.40
Slot-7 elsm 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 99.94 85.61
Slot-7 ems 0.0 0.0 0.0 0.0 0.0 0.0 0.0 39.2 162.14 180.38
Slot-7 epm 0.1 0.0 0.1 0.2 0.1 0.1 0.1 8.1 4286.86 1247.28
Slot-7 erps 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.5 59.45 30.45
Slot-7 esrp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 621.84 1102.21
Slot-7 ethoam 0.0 0.0 0.0 0.1 0.0 0.0 0.0 7.1 53.84 26.35
Slot-7 etmon 0.0 0.0 0.0 0.2 0.1 0.0 0.1 8.4 1422.60 2190.35
Slot-7 exacl 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 exdhcpsnoop 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 exdos 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 exfib 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 exfipSnoop 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 exosmc 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 exosq 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 exsflow 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 exsnoop 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 exvlan 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 fcoe 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 55.57 28.41
Slot-7 fdb 0.0 0.0 0.0 0.1 0.1 0.1 0.1 3.4 4610.88 2399.21
Slot-7 gptp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 hal 13.3 7.4 18.7 19.5 21.6 21.5 21.7 68.0 59936.63 446098.28
Slot-7 hclag 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.8 45.89 20.86
Slot-7 idMgr 0.0 0.0 0.0 0.1 0.0 0.0 0.0 15.0 52.64 22.50
Slot-7 ipSecurity 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 46.37 23.63
Slot-7 ipfix 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.3 49.10 21.25
Slot-7 isis 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 lacp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 224.88 111.31
Slot-7 lldp 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.6 78.04 33.30
Slot-7 mcmgr 0.1 0.0 0.0 0.1 0.1 0.1 0.0 4.1 1401.69 793.18
Slot-7 mpls 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 mrp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.5 72.63 41.02
Slot-7 msdp 0.0 0.0 0.0 0.1 0.0 0.0 0.0 2.3 1032.98 1149.49
Slot-7 netLogin 0.0 0.0 0.0 0.0 0.0 0.0 0.0 11.9 53.74 24.08
Slot-7 netTools 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.7 87.74 39.14
Slot-7 nettx 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 nodemgr 0.2 0.1 0.2 0.2 0.2 0.2 0.2 1.7 13913.30 11818.52
Slot-7 ntp 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.0 48.70 21.90
Slot-7 ospf 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 ospfv3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 pim 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 poe 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.5 46.06 23.16
Slot-7 polMgr 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 47.60 27.74
Slot-7 pwmib 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 46.40 18.90
Slot-7 rip 0.0 0.0 0.0 0.1 0.1 0.1 0.1 3.5 1579.98 3474.77
Slot-7 r.png 0.0 0.0 0.0 0.1 0.1 0.1 0.1 1.7 1469.34 1618.09
Slot-7 rtmgr 0.0 0.0 0.0 0.1 0.0 0.0 0.0 5.2 327.03 267.02
Slot-7 snmpMaster 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 58.37 26.25
Slot-7 snmpSubagent 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 52.21 22.55
Slot-7 stp 2.7 1.5 1.4 1.6 2.0 1.6 1.2 23.5 22063.67 721.34
Slot-7 synce 0.0 0.0 0.0 0.1 0.0 0.0 0.0 2.5 47.40 23.33
Slot-7 techSupport 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.3 44.13 22.08
Slot-7 telnetd 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 50.03 22.94
Slot-7 tftpd 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 40.79 17.67
Slot-7 thttpd 0.0 0.0 0.0 0.1 0.0 0.0 0.0 2.5 41.12 18.76
Slot-7 trill 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 upm 0.0 0.0 0.0 0.1 0.0 0.0 0.0 1.5 45.86 22.04
Slot-7 vlan 0.0 0.0 0.0 0.1 0.1 0.0 0.0 14.0 111.81 82.61
Slot-7 vmt 0.0 0.0 0.0 0.1 0.0 0.0 0.0 3.0 57.81 27.57
Slot-7 vrrp 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00
Slot-7 vsm 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 51.24 26.13
Slot-7 xmlc 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 44.74 17.03
Slot-7 xmld 0.0 0.0 0.0 0.0 0.0 0.0

RE: Abnormal high CPU utilization on stack

Ilya_Semenov — Mon, 17 Oct 2016 19:17:00 GMT

I've found scripts in stack's configurations:

# Module upm configuration.#
create upm profile blackhole1
set var portb 0
set var portb $TCL(string range ${EVENT.LOG_PARAM_0} 36 39)
disable port $portb
create log entry "Port $portb blocked by UPM"
delete var portb
.
create upm profile mac_move
set var portb1 0
set var portb2 0
set var mac 0
set var portb1 $EVENT.LOG_PARAM_2
set var portb2 $EVENT.LOG_PARAM_3
set var mac $EVENT.LOG_PARAM_0
disable port $portb1
disable port $portb2
create log entry "Port $portb1 and $portb2 was disabled by UPM sript (mac_move), flapping MAC is $mac "
delete var portb1
delete var portb2
delete var mac
.
create upm profile tftp-save
enable cli scripting
set var CLI.OUT " "
show switch
set var base_list2 $TCL(split ${CLI.OUT} "\n")
set var baseSystemTime $TCL(clock seconds)
set var systemTime $TCL(clock format $baseSystemTime -format {%d.%m.%Y_%H.%M.%S})
set var systemname $TCL(lindex $base_list2 1)
set var systemname $TCL(string replace $systemname 0 17 {})
delete var "CLI.OUT"
#set var filename "$(systemname)_$(systemTime)"
set var filename "$(systemname)"
delete var systemname
#delete var systemtype
delete var systemTime
delete var baseSystemTime
delete var base_list2
upload config 192.168.251.1 cfg/$(filename).cfg VR-Default
delete var filename
.

Could you please explain me, could it influence on cpu usage and interrupt the snmp process int the morning?

RE: Abnormal high CPU utilization on stack

Erik_Auerswald — Sun, 26 Feb 2017 00:36:00 GMT

The UPM profile tftp-save might create significant CPU load. Is this perhaps started regularly in the morning?