UPM makes the switch crash / lag horribly

  • 0
  • 1
  • Problem
  • Updated 2 years ago
  • Not a Problem
Hello,

I have been working lately on UPM testing for later use.
I noticed something pretty strange, when I execute a very simple script, after 2-3 times, it makes the switch lag horribly and everything slows down. The switch itself still does it's job switching, but the console and SSH become extremely slow, which is a problem.

Is there a way to solve that ?

Switch x250 with ExtremeXOS version 15.3.5.2

The script I tried, to check if it was due to my script or switch issue is : 

create log message "======================="
create log message "Starting script to test logging"
create log message "======================="



Thanks
Photo of Gaspard W

Gaspard W

  • 424 Points 250 badge 2x thumb

Posted 2 years ago

  • 0
  • 1
Photo of Henrique

Henrique, Employee

  • 10,302 Points 10k badge 2x thumb
Hi Gaspard,

Could you please share the UPM script and "show configuration upm"?
Photo of Gaspard W

Gaspard W

  • 424 Points 250 badge 2x thumb
Hi, the script is in the post above already.

and here is the show conf upm result
Photo of Henrique

Henrique, Employee

  • 10,302 Points 10k badge 2x thumb
Hi, what's the timer frequency? Are you running this script every how many sec/min?
Photo of Gaspard W

Gaspard W

  • 424 Points 250 badge 2x thumb
The timer makes it run only once, no repetition
Photo of Henrique

Henrique, Employee

  • 10,302 Points 10k badge 2x thumb
Hi Gaspard, when configuring UPM timer you have to specify a value (in seconds).  Or, if you want to run it once you have to use "run upm profile TestLog".

Based on the UPM configuration, I don't see how the UPM script could be running.

I guess that the slow connection behavior might be related to another issue.

Are you sure the script is being executed and the issue happens right after that?

Can you please share the outputs below:

show upm timer
show upm history

Did you see high CPU utilization for any specific process through "top"command?
Photo of Gaspard W

Gaspard W

  • 424 Points 250 badge 2x thumb
Hi,

The script works when a device (LLDP enabled) is connected on a port with UPM event device detect. The script executes once, and I can see that because it prints the text only once in the logs.

There are no real connection, it's on the console, but the switch is slow.

the timer:


The history is empty now, switch was rebooted, but it shows when you trigger UPM.

when the script runs, nothing is clearly having a high CPU utilization, not sure if it shows properly.

thanks
Photo of OscarK

OscarK, ESE

  • 7,912 Points 5k badge 2x thumb
Hello, is there any news about this issue ? Normally when the CLI becomes slow it means the script is doing something in a loop or uses a lot of memory. If you run the testlog script (that only logs a simple message) is the cpu usage high (top) ?

If you enable cli-config-logging you can see in the log the changes the script does, with show upm history exec-id <exec-id> you can see detailed what the script has done.
Photo of Drew C.

Drew C., Community Manager

  • 39,442 Points 20k badge 2x thumb
I'm marking this one as "Not a Problem" since the conversation has gone quiet.  I'll update it if something changes.