Abnormal high CPU utilization on stack

  • 0
  • 1
  • Problem
  • Updated 1 year ago
  • Not a Problem
  • (Edited)
Hello, everybody!

I have a stack of 2x460 and 6x440 1st generation summits (8 switches total). The problem is every morning at exactly same time I get the message from snmp (please, see the attached file).

I've noticed also, that there is constantly high CPU utilization from 20 to approximately 50% regardless of the day time. The EXOS version is 15.7.4.2.

Please, share your ideas about reasons why it happening.

Many thanks in advance, 

Ilya

Photo of Ilya Semenov

Ilya Semenov

  • 4,610 Points 4k badge 2x thumb

Posted 2 years ago

  • 0
  • 1
Photo of Brandon Clay

Brandon Clay, Escalation Support Engineer

  • 13,254 Points 10k badge 2x thumb
The SNMP timeout may be due to the high CPU on the switch.

Is the cliMaster process always the one that is highest?

You can check if there are any CLI sessions hung on the stack with the command 'show session'.

Also, I would take a look at the logs on the switch to see if anything interesting stands out.

-Brandon
Photo of Marco Lorenz

Marco Lorenz

  • 694 Points 500 badge 2x thumb
The reason for high cpu can be a device sending a lot of multicasts. Because multicasts are pricessed in the main cpu the load will inctease with the amount of multicasts being send to the device. You can figure it out by inspecting a tracefile. I have a similar issue and the only way to decrease cpu load was an accesslist which blocks multicasttraffic on the port where the sending device is attached.
Photo of Erik Auerswald

Erik Auerswald, Embassador

  • 12,886 Points 10k badge 2x thumb
Lots of multicast traffic can be generated by many end systems sending some multicast, e.g. Bonjour, MDNS, LLMNR, SSDP/UPnP. These packets are sent to the switch CPU, but the switch does not use the information.

Taking a packet capture should give you information about the amount of this kind of multicast traffic in your network.

You can stop those packets from affecting the switch CPU by using an ACL. You can use the following as an example to start from:
entry deny_MDNS {
  if match all {
    destination-address 224.0.0.251/32;
  } then {
    deny-cpu;
    count MDNS-deny;
  }
}
entry deny_LLMNR {
  if match all {
    destination-address 224.0.0.252/32;
  } then {
    deny-cpu;
    count LLMNR-deny;
  }
}
The counters give you a way to see if there were packets affected by the ACL.

You might want to take a look at the GTAC Knowledge article How can I block mDNS with an ACL using MAC addresses as well.
Photo of Gilson Fraboni

Gilson Fraboni

  • 92 Points 75 badge 2x thumb
you have configuring Windows NLB on the stack?
Photo of Marco Lorenz

Marco Lorenz

  • 694 Points 500 badge 2x thumb
If possible you can disable all edgeports and enable them one after the other and look which port is responsible for the high cpu load.
Photo of Marco Lorenz

Marco Lorenz

  • 694 Points 500 badge 2x thumb
No. No NLB. In my case it is a machinecntroller from Siemens (S7), which is sending a lot of multicasts and brings CPU to 85% in average.
Photo of Prashanth KG

Prashanth KG, Employee

  • 5,300 Points 5k badge 2x thumb
Hi Ilya,

As per the screenshot, the process CLI master seems to be consuming high amount of CPU. 
In general, CLI would consume CPU in case of any outputs collected from different sessions. 
Since timeout  is happening at the same time in the morning, I would like to check if there is any script running to fetch any outputs from the switch around the same time. 


It could be from the NMS device or any other server. 
In addition to this, looking at the logs could also provide any lead for the investigation. 

Hope this helps! 
Photo of Ilya Semenov

Ilya Semenov

  • 4,610 Points 4k badge 2x thumb
Hello, everybody!

I've checked my switches for excessive multicast. There in no anything unusual - average amount on access ports, more on uplinks.  

The only CLI session is mine, which I use at the moment.

I've found some scripts in the configuration, but how can find out the time when it is running? Not sure this is important, but this stack is connected to Netsight system.

Please, see the log files attached.

Many thanks in advance,

Ilya


Mem: 642724K used, 378788K free, 0K shrd, 127648K buff, 144432K cachedCPU: 35.1% usr 58.7% sys  0.0% nic  0.1% idle  0.0% io  2.5% irq  3.3% sirq
Load average: 12.95 12.81 12.45 14/186 6261
  PID  PPID USER     STAT   RSS %MEM CPU %CPU COMMAND
 1489     1 root     R <  36220  3.5   1 40.4 ./hal
 1493     1 root     S    30972  3.0   0 34.7 ./cliMaster
 1560     1 root     S     4140  0.4   0  4.9 ./stp
 1568     1 root     S     4812  0.4   0  3.2 ./mcmgr
 1635     2 root     SW<      0  0.0   1  3.2 [bcmL2X.1]
 1816     2 root     SW<      0  0.0   1  2.4 [bcmCNTR.1]
 1341     2 root     SW       0  0.0   1  2.4 [bcmRX]
 1815     2 root     SW<      0  0.0   0  1.6 [bcmCNTR.0]
 1633     2 root     RW<      0  0.0   0  1.2 [bcmL2X.0]
 6110  6109 root     R      832  0.0   0  0.8 top -d 3
 1491     1 root     S     1732  0.1   0  0.4 ./nodemgr
 1284     2 root     RW<      0  0.0   1  0.4 [bcmLINK.1]
 1532     1 root     S     3144  0.3   1  0.3 ./lacp
 1281     2 root     RW<      0  0.0   0  0.3 [bcmLINK.0]
 1627     1 root     S     5576  0.5   1  0.1 ./xmld
 1505     1 root     S     4784  0.4   0  0.1 ./vlan
 1497     1 root     S     4136  0.4   0  0.1 ./snmpMaster
 1593     1 root     S     3508  0.3   0  0.1 ./acl
 1658     1 root     S     3148  0.3   1  0.1 ./erps
 1537     1 root     S     2736  0.2   1  0.1 ./synce
 1570     1 root     S     2672  0.2   0  0.1 ./bfd
 1582     1 root     S     2152  0.2   0  0.1 ./ripng
 1287     2 root     SW<      0  0.0   0  0.1 [bcmRLINK]
 1613     1 root     S    21556  2.1   0  0.0 ./etmon
 1642     1 root     R     6644  0.6   0  0.0 ./upm
 1595     1 root     S     6452  0.6   0  0.0 ./netTools
 1495     1 root     S     5236  0.5   0  0.0 ./cfgmgr
 1648     1 root     S     5076  0.5   0  0.0 ./idMgr
 1500     1 root     S     4824  0.4   0  0.0 ./snmpSubagent
 1507     1 root     S     4396  0.4   1  0.0 ./fdb
 1563     1 root     S     3972  0.3   1  0.0 ./rtmgr update
 1485     1 root     S     3576  0.3   0  0.0 ./emsServer
 1650     1 root     S     3356  0.3   0  0.0 ./vmt
 1529     1 root     S     3288  0.3   1  0.0 ./lldp
 1646     1 root     S     3268  0.3   0  0.0 ./dot1ag
 1555     1 root     S     3116  0.3   0  0.0 ./eaps
 1597     1 root     S     2976  0.2   0  0.0 ./netLogin
 1652     1 root     S     2956  0.2   1  0.0 ./vsm
 1557     1 root     S     2948  0.2   0  0.0 ./esrp
 1666     1 root     S <   2940  0.2   0  0.0 ./mrp
 1605     1 root     S     2908  0.2   0  0.0 ./telnetd -e
 1640     1 root     S     2900  0.2   1  0.0 ./ipSecurity
 1660     1 root     S     2788  0.2   0  0.0 ./fcoe
 1511     1 root     S     2784  0.2   0  0.0 ./elrp
 1616     1 root     S     2768  0.2   0  0.0 ./ipfix
 1623     1 root     S     2760  0.2   0  0.0 ./poe
 1526     1 root     S     2756  0.2   0  0.0 ./edp
 1644     1 root     S     2736  0.2   0  0.0 ./hclag
 1534     1 root     S     2708  0.2   0  0.0 ./ethoam
 1521     1 root     S     2688  0.2   0  0.0 ./elsm
 1117     1 root     S     2680  0.2   0  0.0 /exos/bin/epm -t 40 -f /exos/config/epmrc.Edge -d /exos/config/epmdprc
 1577     1 root     S     2468  0.2   0  0.0 ./rip
 1502     1 root     S     2272  0.2   0  0.0 ./aaa -t random
 1487     1 root     S     2224  0.2   0  0.0 ./devmgr
 1572     1 root     S     2156  0.2   0  0.0 ./msdp
 1671     1 root     S     1992  0.1   0  0.0 ./ntp
 1638     1 root     S     1964  0.1   0  0.0 ./xmlc
 1618     1 root     S     1888  0.1   0  0.0 ./thttpd
 6000  1614 root     S     1764  0.1   1  0.0 exsh


Slot-1 sw-416-1.3 # sh cpu

      CPU Utilization Statistics - Monitored every 5 seconds
-------------------------------------------------------------------------------

Card   Process      5    10   30   1    5    30   1    Max           Total
                    secs secs secs min  mins mins hour            User/System
                    util util util util util util util util       CPU Usage
                    (%)  (%)  (%)  (%)   (%)  (%)  (%)  (%)         (secs)
-------------------------------------------------------------------------------

Slot-1 System       12.7 14.7 13.6 14.1 13.6 13.5 13.0 57.7   605.68   864077.47
Slot-7 System        9.6  8.8 10.2 10.3  9.8  9.6  9.3 94.1     0.00       0.00
Slot-1 aaa           0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.1   297.52     318.13
Slot-1 acl           0.0  0.0  0.0  0.1  0.1  0.1  0.1  3.1  5849.86    9895.30
Slot-1 bfd           0.0  0.0  0.0  0.1  0.1  0.1  0.1  1.7  2437.83    3918.24
Slot-1 bgp           0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 brm           0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 ces           0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 cfgmgr        0.0  0.0  0.3  1.3  1.1  1.2  1.1 46.2  7913.91   11305.44
Slot-1 cli          19.4 21.8 29.6 30.0 28.9 28.4 29.1 62.4 733385.67  323527.41
Slot-1 devmgr        0.0  0.0  0.0  0.1  0.1  0.1  0.1 16.6   962.27     749.59
Slot-1 dirser        0.1  0.0  0.0  0.1  0.1  0.1  0.1  4.6   487.26    1930.69
Slot-1 dosprotect    0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.4   152.31      63.61
Slot-1 dot1ag        0.0  0.0  0.0  0.1  0.1  0.3  0.2  8.4   556.42     491.47
Slot-1 eaps          0.1  0.0  0.0  0.0  0.0  0.0  0.0  3.5   266.75     163.95
Slot-1 edp           0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.7   155.50      70.32
Slot-1 elrp          0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.1   149.65      66.56
Slot-1 elsm          0.0  0.0  0.0  0.1  0.1  0.1  0.1  1.7   422.65     411.30
Slot-1 ems           0.6  0.3  0.1  0.3  0.1  0.2  0.2 31.8  1362.58    2257.70
Slot-1 epm           0.4  0.2  0.1  0.2  0.1  0.1  0.1 12.5  6394.31    2213.05
Slot-1 erps          0.0  0.0  0.0  0.1  0.0  0.0  0.0  2.4   202.28      96.38
Slot-1 esrp          0.0  0.0  0.0  0.1  0.1  0.0  0.0  2.6   685.03    1060.98
Slot-1 ethoam        0.0  0.0  0.0  0.0  0.0  0.0  0.0  7.2   151.48      68.14
Slot-1 etmon         0.1  0.0  0.0  0.1  0.1  0.0  0.1 17.5  1414.09    2059.48
Slot-1 exacl         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 exdhcpsnoop   0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 exdos         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 exfib         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 exfipSnoop    0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 exosmc        0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 exosq         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 exsflow       0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 exsnoop       0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 exvlan        0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 fcoe          0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.3   210.35     118.57
Slot-1 fdb           0.1  0.1  0.1  0.1  0.1  0.1  0.5  4.4 76005.18   16853.89
Slot-1 gptp          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 hal           2.8 15.2 26.6 25.6 28.7 27.9 27.4 84.0 73649.74   546304.22
Slot-1 hclag         0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.8   148.31      67.25
Slot-1 idMgr         0.0  0.0  0.0  0.0  0.0  0.0  0.0 12.6   179.78      73.58
Slot-1 ipSecurity    0.0  0.0  0.0  0.1  0.0  0.0  0.0  2.6   168.93      79.36
Slot-1 ipfix         0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.1   163.19      68.09
Slot-1 isis          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 lacp          0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.5   392.93     311.84
Slot-1 lldp          0.0  0.0  0.0  0.1  0.0  0.0  0.0  2.0   643.84     764.32
Slot-1 mcmgr         0.0  0.2  0.1  0.5  0.6  0.3  0.3  6.8  3350.48    3600.18
Slot-1 mpls          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 mrp           0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.7   204.02     114.20
Slot-1 msdp          0.1  0.0  0.0  0.1  0.1  0.1  0.1  1.8  1088.31    1158.59
Slot-1 netLogin      0.0  0.0  0.0  0.0  0.0  0.0  0.0 13.1   176.13      82.45
Slot-1 netTools      0.0  0.0  0.0  0.0  0.0  0.0  0.0  3.6   188.39      83.89
Slot-1 nettx         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 nodemgr       0.3  0.3  0.4  0.4  0.3  0.3  0.3  3.5 17028.19   12475.77
Slot-1 ntp           0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.0   176.52      77.25
Slot-1 ospf          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 ospfv3        0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 pim           0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 poe           0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.7   149.12      68.30
Slot-1 polMgr        0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.5   160.17      78.52
Slot-1 pwmib         0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.3   159.73      61.58
Slot-1 rip           0.0  0.0  0.0  0.1  0.0  0.1  0.1  2.1  1537.24    3353.32
Slot-1 ripng         0.0  0.0  0.0  0.1  0.1  0.1  0.1  2.0  1471.75    1577.36
Slot-1 rtmgr         0.0  0.0  0.0  0.1  0.1  0.1  0.1  4.3   631.01     403.40
Slot-1 snmpMaster    0.0  0.0  0.0  0.2  0.1  1.0  0.5 22.3 13751.91    2999.93
Slot-1 snmpSubagent  0.0  0.0  0.0  0.1  0.1  1.0  0.5 18.4 12064.70    1575.87
Slot-1 stp           7.6  5.0  3.7  3.9  3.8  3.4  2.9 29.8 59609.82   82960.31
Slot-1 synce         0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.4   191.39     113.93
Slot-1 techSupport   0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.4   144.89      67.75
Slot-1 telnetd       0.0  0.0  0.0  0.1  0.1  0.0  0.0  1.8   168.28      69.14
Slot-1 tftpd         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.6   141.28      63.51
Slot-1 thttpd        0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.1   147.77      63.61
Slot-1 trill         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 upm           0.0  0.0  0.0  0.1  0.0  0.0  0.1  1.7   405.91     478.57
Slot-1 vlan          0.0  0.0  0.0  0.1  0.1  0.1  0.0 16.3  3489.49     623.99
Slot-1 vmt           0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.0   170.84      71.81
Slot-1 vrrp          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-1 vsm           0.1  0.0  0.0  0.0  0.0  0.0  0.0  2.6   179.10      86.11
Slot-1 xmlc          0.0  0.0  0.0  0.0  0.0  0.0  0.0  3.1   165.58      65.64
Slot-1 xmld          0.0  0.0  0.0  0.1  0.0  0.0  0.0 21.2   190.71      73.97
Slot-7 aaa           0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.5   173.81     235.13
Slot-7 acl           0.0  0.0  0.1  0.2  0.1  0.1  0.1  3.7  6272.74    9989.06
Slot-7 bfd           0.0  0.0  0.0  0.1  0.1  0.1  0.1  1.3  2238.40    3728.43
Slot-7 bgp           0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 brm           0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 ces           0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 cfgmgr        0.0  0.0  0.0  0.0  0.0  0.0  0.0  8.5    99.15      49.60
Slot-7 cli           0.0  0.0  0.0  0.0  0.0  0.0  0.0 35.5   148.23     108.05
Slot-7 devmgr        0.0  0.0  0.0  0.1  0.0  0.0  0.0 21.8   354.02     231.72
Slot-7 dirser        0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.7    45.79      25.10
Slot-7 dosprotect    0.1  0.0  0.0  0.0  0.0  0.0  0.0  1.5    41.09      18.34
Slot-7 dot1ag        0.0  0.0  0.0  0.1  0.0  0.0  0.0  2.3   109.78     120.37
Slot-7 eaps          0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.5    69.56      40.55
Slot-7 edp           0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.5    49.42      24.19
Slot-7 elrp          0.1  0.0  0.0  0.0  0.0  0.0  0.0  2.3    48.85      25.40
Slot-7 elsm          0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.8    99.94      85.61
Slot-7 ems           0.0  0.0  0.0  0.0  0.0  0.0  0.0 39.2   162.14     180.38
Slot-7 epm           0.1  0.0  0.1  0.2  0.1  0.1  0.1  8.1  4286.86    1247.28
Slot-7 erps          0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.5    59.45      30.45
Slot-7 esrp          0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.2   621.84    1102.21
Slot-7 ethoam        0.0  0.0  0.0  0.1  0.0  0.0  0.0  7.1    53.84      26.35
Slot-7 etmon         0.0  0.0  0.0  0.2  0.1  0.0  0.1  8.4  1422.60    2190.35
Slot-7 exacl         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 exdhcpsnoop   0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 exdos         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 exfib         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 exfipSnoop    0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 exosmc        0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 exosq         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 exsflow       0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 exsnoop       0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 exvlan        0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 fcoe          0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.3    55.57      28.41
Slot-7 fdb           0.0  0.0  0.0  0.1  0.1  0.1  0.1  3.4  4610.88    2399.21
Slot-7 gptp          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 hal          13.3  7.4 18.7 19.5 21.6 21.5 21.7 68.0 59936.63   446098.28
Slot-7 hclag         0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.8    45.89      20.86
Slot-7 idMgr         0.0  0.0  0.0  0.1  0.0  0.0  0.0 15.0    52.64      22.50
Slot-7 ipSecurity    0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.2    46.37      23.63
Slot-7 ipfix         0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.3    49.10      21.25
Slot-7 isis          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 lacp          0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.2   224.88     111.31
Slot-7 lldp          0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.6    78.04      33.30
Slot-7 mcmgr         0.1  0.0  0.0  0.1  0.1  0.1  0.0  4.1  1401.69     793.18
Slot-7 mpls          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 mrp           0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.5    72.63      41.02
Slot-7 msdp          0.0  0.0  0.0  0.1  0.0  0.0  0.0  2.3  1032.98    1149.49
Slot-7 netLogin      0.0  0.0  0.0  0.0  0.0  0.0  0.0 11.9    53.74      24.08
Slot-7 netTools      0.0  0.0  0.0  0.0  0.0  0.0  0.0  4.7    87.74      39.14
Slot-7 nettx         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 nodemgr       0.2  0.1  0.2  0.2  0.2  0.2  0.2  1.7 13913.30   11818.52
Slot-7 ntp           0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.0    48.70      21.90
Slot-7 ospf          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 ospfv3        0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 pim           0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 poe           0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.5    46.06      23.16
Slot-7 polMgr        0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.7    47.60      27.74
Slot-7 pwmib         0.0  0.0  0.0  0.0  0.0  0.0  0.0  2.0    46.40      18.90
Slot-7 rip           0.0  0.0  0.0  0.1  0.1  0.1  0.1  3.5  1579.98    3474.77
Slot-7 ripng         0.0  0.0  0.0  0.1  0.1  0.1  0.1  1.7  1469.34    1618.09
Slot-7 rtmgr         0.0  0.0  0.0  0.1  0.0  0.0  0.0  5.2   327.03     267.02
Slot-7 snmpMaster    0.0  0.0  0.0  0.0  0.0  0.0  0.0  4.1    58.37      26.25
Slot-7 snmpSubagent  0.0  0.0  0.0  0.0  0.0  0.0  0.0  3.3    52.21      22.55
Slot-7 stp           2.7  1.5  1.4  1.6  2.0  1.6  1.2 23.5 22063.67     721.34
Slot-7 synce         0.0  0.0  0.0  0.1  0.0  0.0  0.0  2.5    47.40      23.33
Slot-7 techSupport   0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.3    44.13      22.08
Slot-7 telnetd       0.0  0.0  0.0  0.0  0.0  0.0  0.0  3.5    50.03      22.94
Slot-7 tftpd         0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.7    40.79      17.67
Slot-7 thttpd        0.0  0.0  0.0  0.1  0.0  0.0  0.0  2.5    41.12      18.76
Slot-7 trill         0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 upm           0.0  0.0  0.0  0.1  0.0  0.0  0.0  1.5    45.86      22.04
Slot-7 vlan          0.0  0.0  0.0  0.1  0.1  0.0  0.0 14.0   111.81      82.61
Slot-7 vmt           0.0  0.0  0.0  0.1  0.0  0.0  0.0  3.0    57.81      27.57
Slot-7 vrrp          0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0     0.00       0.00
Slot-7 vsm           0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.8    51.24      26.13
Slot-7 xmlc          0.0  0.0  0.0  0.0  0.0  0.0  0.0  3.5    44.74      17.03
Slot-7 xmld          0.0  0.0  0.0  0.0  0.0  0.0  0.0 18.7    42.31      17.66
Slot-1 sw-416-1.4 #































Slot-1 sw-416-1.2 # sh port statistics no-refreshPort      Link     Tx Pkt       Tx Byte       Rx Pkt       Rx Byte Rx Pkt Rx Pkt
          State    Count        Count         Count        Count    Bcast  Mcast
================================================================================
1:1       A      57142041  17606517221      2338047    731165643     6318    13334
1:2       A      79791916  51240325036     16068452   1812295255    82807    56657
1:3       A      60602994  21191275584      4064371   2234493575    10209    14874
1:4       A      36739779  13830580285       235644     17011369     1254    40977
1:5       A      61237361  22155342838      4581258   1891981047     7618    16859
1:6       A      60750758  21401302939      2331760   1077629472    10416    15050
1:7       A      59144622  19181133368      3218398    728597348    63062    15307
1:8       A      73467934  41236379041     11057447   2166298328    11771    17226
1:9       R             0            0            0            0        0        0
1:10      A      68781024  28850868796     11390051   4052348156    70920    17081
1:11      A      64317502  24259671733      6952398   1970143718     5417    11246
1:12      A      63654351  23327776124      5897200   2403826464    48868    12878
1:13      A      58374537  17713442549      4395026   3795061663    59695    15187
1:14      A      58189499  18724907590      1981463    493390185     4925    13681
1:15      R             0            0            0            0        0        0
1:16      R             0            0            0            0        0        0
1:17      A      56301814  16910325662      1979986   1211568002     3864     9949
1:18      A       3169782    369097591       874919    181662763    43838    81948
1:19      A      11703999   1009004131       741097    181503563     9961    11028
1:20      A      11308842    919659723        33220      3212597     8494    15242
1:21      R        371266     30869944        53258      4897221     5627     5681
1:22      R             0            0            0            0        0        0
1:23      A      52412312  20740900836     18721410   8967807519   183937    19298
1:24      A      42282468  29981722006     16136045   4377149344     4525    17667
1:25      A      44669515  14843280274      5465118   2097207290     5078    17196
1:26      R             0            0            0            0        0        0
1:27      A      41611799  12134705107      4591447   3396796643    21756   121707
1:28      A      11239496   4538847657      1319154    409282053    46534    32412
1:29      A      58341234  18845666982      3074068   1883470627     5435    19082
1:30      A      18035410   6444848072      4282769   3082164812    12551    28675
1:31      A      39284370  11631484247      1036689    317824415     6880    34684
1:32      R             0            0            0            0        0        0
1:33      R             0            0            0            0        0        0
1:34      R             0            0            0            0        0        0
1:35      A      37268349   9585748563       453602     82600622      862     2548
1:36      A      39054133  10455068561      2562974    839556946     6025     9080
1:37      R       1533792    939552054       357311     49284188      289      627
1:38      A       4003904   1782860672       768608    198458247     1766     3507
1:39      A      42432681  13730940366      3592922   2031278549    15405    25005
1:40      A      38361304   9897385339      1969806    596836889     3325     8101
1:41      R      30426023   8066685794       678769    147893496     1955     4229
1:42      A      40800688  12655786373      1666958    562433581    13886    10059
1:43      A      40784390  13300779548      1305270    216610360    37559     9501
1:44      R             0            0            0            0        0        0
1:45      R             0            0            0            0        0        0
1:46      A     706695911 247456278092      5768860   4690843570     4682     7903
1:47      R             0            0            0            0        0        0
1:48      A     701133989 270584258881     18036161  21439104571     3901     7020
1:49      R             0            0            0            0        0        0
1:50      R             0            0            0            0        0        0
1:51      R             0            0            0            0        0        0
1:52      R             0            0            0            0        0        0
1:53      A    1891681337 674868562793   3789034584 2511263190889 46548505 73869935
1:54      A    2212239426 639674075315    469767037 514863422938 16401166  3555234
1:55      NP            0            0            0            0        0        0
1:56      NP            0            0            0            0        0        0
1:57      NP            0            0            0            0        0        0
1:58      NP            0            0            0            0        0        0
2:1       A      38601594  12823799154       822540    197163733    31582     8131
2:2       R             0            0            0            0        0        0
2:3       R             0            0            0            0        0        0
2:4       R             0            0            0            0        0        0
2:5       R      14375112   5691332713      1063307    365299009    21903     5482
2:6       A      41701325  14135385693      3307225   1435776053    37142     9504
2:7       A      21197281   8337617000       119949      8274499     1040    19648
2:8       R             0            0            0            0        0        0
2:9       R     332736845 124836780469       243330     53815106      213     8122
2:10      A     604093350 281266228543     54549249  16770819531    54872    36343
2:11      R             0            0            0            0        0        0
2:12      A      44021399  19421803017      4670181   1243782966    45479    23999
2:13      R             0            0            0            0        0        0
2:14      R             0            0            0            0        0        0
2:15      R             0            0            0            0        0        0
2:16      R             0            0            0            0        0        0
2:17      R             0            0            0            0        0        0
2:18      R             0            0            0            0        0        0
2:19      A     580738416 264221211537     26962762   9772404511    10691    29982
2:20      A     571975031 258470336972     22213199   6664929756    30587    32251
2:21      R             0            0            0            0        0        0
2:22      A     891681550 788605383934    264430309  26553247264    14898    32359
2:23      R             0            0            0            0        0        0
2:24      R             0            0            0            0        0        0
2:25      A     507309923 205995716556       656237    135695942     3037     4680
2:26      A     498904846 181215141830       172344     17069654    61472    15237
2:27      A     512098443 209262495026      1598819    553523561     3130     4921
2:28      A     446309774 198521690154      1502526    342716552    36897     5328
2:29      A     540996106 228914609457      1342686    429423778     7437     5745
2:30      A     565870063 243719391401      4099904   5527600119     2684      129
2:31      A     521711406 219094692524      8850862   6705615944     4766     5340
2:32      A     448376905 200303092886       350589    237041928     2547    13014
2:33      A     441984354 200281996468       604204    352964848     1912    12943
2:34      R             0            0            0            0        0        0
2:35      R             0            0            0            0        0        0
2:36      R             0            0            0            0        0        0
2:37      R             0            0            0            0        0        0
2:38      A     562726350 221678205532     72710127  49398280424    11201     5265
2:39      A     532645161 222901574870     10383722   8562154107    54465     5264
2:40      A     314490017 121126042578        81148      5900099      738    10415
2:41      A     340681905  85453265180            0            0        0        0
2:42      A     550290314 236186886793      5586390   3959180538    17620     6209
2:43      R             0            0            0            0        0        0
2:44      R             0            0            0            0        0        0
2:45      R             0            0            0            0        0        0
2:46      R             0            0            0            0        0        0
2:47      R             0            0            0            0        0        0
2:48      A      12293267   1529069578      1459984    147593445     4501        0
3:1       A     615816366 271261676405      5508325   4431962718    32038    24612
3:2       R     480132419 116949949090            0            0        0        0
3:3       A     784761545 312224968519      3865587   1382136367    68930     9871
3:4       A     742586976 277411238131     12459990   2845224726     5408     8506
3:5       A     793796995 317894749426      6903804   2604784519     9935     9890
3:6       R     422528528 188181844520      3096462   1540663229     4061     6939
3:7       A     644079568 272226092495     18712828   8840249841     7115     6560
3:8       A     714453916 256678079382     11508676   7866336905     3805     7132
3:9       A     782526745 322202086712     13153757   3366401345     5057     7987
3:10      A     797508037 325029692100     13846923   9820617140     9003     9588
3:11      A     775245244 355953288459     47931674  10331891405     3321     5386
3:12      A     816552053 342838638251     13418602   3347657490    18580    10408
3:13      A     723826681 272705789459      6317771   4609680940     3816     6024
3:14      A     766967563 310559591418     13365086   4311514564     6909     8870
3:15      R             0            0            0            0        0        0
3:16      R             0            0            0            0        0        0
3:17      A     768422775 302961965968     22795853  25067505004     7142     8004
3:18      R             0            0            0            0        0        0
3:19      R             0            0            0            0        0        0
3:20      R             0            0            0            0        0        0
3:21      A     798242241 322247655167      7168686   4434247056     9980     9447
3:22      A     666401032 232850271244      7060673   7108390012     5831     4842
3:23      A     747787077 285943355587      5930516   5170023313     5296     8635
3:24      A     564762048 236169007348     14650736  16026443088     5497     6860
3:25      R             0            0            0            0        0        0
3:26      A     438785454 194141037451     26084152  22718954538    46425    20210
3:27      R      11979096   3180296355       102507     25979090      699     1502
3:28      R             0            0            0            0        0        0
3:29      R             0            0            0            0        0        0
3:30      A     802014571 321998704115     14277748  13552838123     6329     9632
3:31      A     770068477 303229598458      6464485   4296706434     4729     7758
3:32      A     673991534 293838188533      6395622   3580932639    23667     9908
3:33      A     718447631 268492365654      7467500   7718971524     3833     6189
3:34      A     811453437 331739813062      6632893   2945323542    16166    10061
3:35      A     853033999 419988332161     70148786  12600963854     5845     8568
3:36      R     686912278 312534112140     39375171  34518380390     9404     9268
3:37      A     714962274 316387612749      9730146   2620796760    10088     9789
3:38      A     811170169 332694730327     18704833   9149928491     4183     5863
3:39      A     737631828 279190673324      9193910   8162025434     3984     5839
3:40      R     656689275 291486817023     17885497   9570009969     5988     9706
3:41      R             0            0            0            0        0        0
3:42      A     608991268 202454766989       223458     42391944      489      748
3:43      A     771280780 414019905880     53352466   6853798075     5101     9589
3:44      A     465562676 114092853481            0            0        0        0
3:45      A     713503853 376173864231     45910026   5682174103    27094     9470
3:46      R             0            0            0            0        0        0
3:47      A     779619989 302771454352     32851256  36778340917     4891     8459
3:48      A     804452211 327944374182     13196858   7626797082    14475     9682
4:1       A     667847143 285504500154      9771936   6894726267    72381    41215
4:2       A     718951137 264030307460     12784124   8627335292     7515     6733
4:3       A     785578541 312821905411      7400765   4673759062    17028     8801
4:4       A     609022886 282177070467     18757301   7453466322     6117     8481
4:5       R             0            0            0            0        0        0
4:6       A     792933305 321785728328     12361485   2649806379     5090     8450
4:7       A     856977064 425901974520     63361472  12585671616     6125     8959
4:8       A     673184775 231090604929     12412191   8610862513     6267     6075
4:9       A     854104426 429398356802     64855953  11218162162     6276     8525
4:10      A     766846367 294740591371     17827985  16837173312     5900 &n
Photo of Ilya Semenov

Ilya Semenov

  • 4,610 Points 4k badge 2x thumb
I've found scripts in stack's configurations:

# Module upm configuration.#
create upm profile blackhole1
set var portb 0
set var portb $TCL(string range ${EVENT.LOG_PARAM_0} 36 39)
disable port $portb
create log entry "Port $portb blocked by UPM"
delete var portb
.
create upm profile mac_move
set var portb1 0
set var portb2 0
set var mac 0
set var portb1 $EVENT.LOG_PARAM_2
set var portb2 $EVENT.LOG_PARAM_3
set var mac $EVENT.LOG_PARAM_0
disable port $portb1
disable port $portb2
create log entry "Port $portb1 and $portb2 was disabled by UPM sript (mac_move), flapping MAC is $mac "
delete var portb1
delete var portb2
delete var mac
.
create upm profile tftp-save
enable cli scripting
set var CLI.OUT " "
show switch
set var base_list2 $TCL(split ${CLI.OUT} "\n")
set var baseSystemTime $TCL(clock seconds)
set var systemTime $TCL(clock format $baseSystemTime -format {%d.%m.%Y_%H.%M.%S})
set var systemname $TCL(lindex $base_list2 1)
set var systemname $TCL(string replace $systemname 0 17 {})
delete var "CLI.OUT"
#set var filename "$(systemname)_$(systemTime)"
set var filename "$(systemname)"
delete var systemname
#delete var systemtype
delete var systemTime
delete var baseSystemTime
delete var base_list2
upload config 192.168.251.1 cfg/$(filename).cfg VR-Default
delete var filename
.



Could you please explain me, could it influence on cpu usage and interrupt the snmp process int the morning?
Photo of Erik Auerswald

Erik Auerswald, Embassador

  • 12,960 Points 10k badge 2x thumb
The UPM profile tftp-save might create significant CPU load. Is this perhaps started regularly in the morning?