topic Unable to backup XOS Stack in ExtremeCloud IQ- Site Engine Management Center

Unable to backup XOS Stack

Nico_A_ — Tue, 05 Jan 2021 15:21:41 GMT

Hi together,

I have a problem with a config backup of a X450 (Stack) (Firmware: 30.2.1.8) using the XMC (8.4.4.26) Archive function.

When I start the backup it always shows “Device Busy - Waiting...“ at some point it is running into a timeout and stops the backup.

So far I have tried to find out why the Switch is busy but I could not find any task the Switch should execute….

A reboot of the Stack and the XMC could not solve the problem.

It would be great if you could help me.

greetings

Nico

Re: Unable to backup XOS Stack

StephanH — Tue, 05 Jan 2021 16:04:50 GMT

Hello Nico,

what file transfer method are you using? What do you see in Alarms&Events (select Inventory)?

Do you have other devices working? Do the use the same file transfer method?

Re: Unable to backup XOS Stack

Nico_A_ — Tue, 05 Jan 2021 16:52:58 GMT

Hello Stephan,

thanks for your help. Let me see if I can answer your question.

I use TFTP as file transport method.

In Alarm and Events is only a timeout Event.

Yes there are about 70 Devices witch use the same Backup config and they work just fine.

greetings

Nico

Re: Unable to backup XOS Stack

StephanH — Tue, 05 Jan 2021 17:41:51 GMT

Is this a manual or a scheduled backup?

If scheduled, can you try to create the backup manualy (right mouse to the device->Archives->Backup config)?

Please check the logs on the XOS switch if you can see any entries during the update

In addition you can try to do a manual backup on the switch (via CLI) to narrow down if the problem is on XMC or on the switch.

Re: Unable to backup XOS Stack

Nico_A_ — Tue, 05 Jan 2021 18:21:44 GMT

Hi Stephan,

normally it is a scheduled backup but I also tried to do a manual one.

I started a manual backup, imidetlly after it says “Management Center Archive - Device Busy - Waiting...”. There where no log entry on the XOS Switch during the Backup try.

A backup via cli worked.

greetings

Nico

Re: Unable to backup XOS Stack

Stefan_K_ — Tue, 05 Jan 2021 18:29:50 GMT

Is the switch on the same network as the other switches?

Re: Unable to backup XOS Stack

Nico_A_ — Tue, 05 Jan 2021 19:37:24 GMT

No, the Switch is in a different Subnet.

greetings

Nico

Re: Unable to backup XOS Stack

Stefan_K_ — Wed, 06 Jan 2021 01:34:23 GMT

Does the switch have multiple IP-Addresses and is he routing? Is he maybe connected to another router via a transfer-net and the transfer-net is not reachable from the subnet where your XMC is located? Have seen this multiple times.

Re: Unable to backup XOS Stack

Nico_A_ — Thu, 07 Jan 2021 14:00:30 GMT

No the Switch has only one IP and dose not route.
Yes the Switch is connected to a router but not via a transit-net.

The Switch is reachable from the XMC (I ping the Switch from the XMC).

greetings

Nico

Re: Unable to backup XOS Stack

StephanH — Thu, 07 Jan 2021 20:49:03 GMT

Hello Nico,

you can try to enable debugging for the Inventory Manager /Script (in Administration->Diagnostics-->Server->Server Diagnostics). Maybe than you can see more informations in the log pointing in the right direction.

Re: Unable to backup XOS Stack

Nico_A_ — Thu, 07 Jan 2021 21:22:03 GMT

Hello Stephan,

thanks for your help.

I activated the debug log and started the Backup manual from the XMC. Below you can find a part of the log file. I replaced the Switch IP and Username with <Switch_IP> and <USER>.

2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.scheduler.common.InvTaskMonitor] 0 Update data = [InvAuditTrail] Auditor Name = <SWITCH_IP>, Auditor Type = 1, Status = 5, Date = 1610024254898, Start
Time = 1610024254897, Server = , File = /tftpboot/configs/configs/79/1610024254897/<SWITCH_IP>.cfg, Entry Type = 2, Action Record = <SWITCH_IP>, User = <USER>, Message = Queued..., Detailed Statu
s = 5, Details = , Schedule Type = 6, Action record Time = 1610024254897, Schedule Name = Management Center Archive, Alert Status = 0, Description = , Progress = 0, Bytes Transferer = 0, Schedule Disp
lay Name = Management Center Archive, Snmp Context =
2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.scheduler.common.InvTaskMonitor] 0 Checking to see if update # 0 is a audit trail update.
2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.scheduler.common.InvTaskMonitor] notifying sched name Management Center Archive of audit
2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.scheduler.common.InvTaskMonitor] 0 -- Task Management Center Archive could not be found in monitored list
2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.services.InvDatabaseSubscriber] Handling event: class com.ets.netsight.inv.events.InvAuditTrailEvent
2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.scheduler.common.InvTaskMonitor] Got Update with 1 entries
2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.scheduler.common.InvTaskMonitor] 0 Update data = [InvAuditTrail] Auditor Name = <SWITCH_IP>, Auditor Type = 1, Status = 5, Date = 1610024254898, Start
Time = 1610024254897, Server = , File = /tftpboot/configs/configs/79/1610024254897/<SWITCH_IP>.cfg, Entry Type = 2, Action Record = <SWITCH_IP>, User = <USER>, Message = Device Busy - Waiting...,
Detailed Status = 5, Details = , Schedule Type = 6, Action record Time = 1610024254897, Schedule Name = Management Center Archive, Alert Status = 0, Description = , Progress = 0, Bytes Transferer = 0
, Schedule Display Name = Management Center Archive, Snmp Context =
2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.scheduler.common.InvTaskMonitor] 0 Checking to see if update # 0 is a audit trail update.
2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.scheduler.common.InvTaskMonitor] notifying sched name Management Center Archive of audit
2021-01-07 14:05:10,901 DEBUG [com.ets.netsight.inv.scheduler.common.InvTaskMonitor] 0 -- Task Management Center Archive could not be found in monitored list
2021-01-07 14:06:06,653 INFO [com.ets.netsight.inv.server.ConfigImpactCollector] -,,_. update firmware reference versions in dashboard
2021-01-07 14:06:06,655 INFO [com.ets.netsight.inv.server.ConfigImpactCollector] -,,_. update archived devices status in dashboard
2021-01-07 14:06:30,061 DEBUG [com.ets.netsight.inv.database.InvDatabase] InvDatabase - Unhandled Console Event onMessage()ObjectUpdatedEvent (1)
2021-01-07 14:06:30,074 INFO [com.ets.netsight.inv.server.ConfigImpactCollector] -,,_. devicesUpdated
2021-01-07 14:06:30,240 DEBUG [com.ets.netsight.inv.database.InvDatabase] InvDatabase - Unhandled Console Event onMessage()ObjectUpdatedEvent (1)
2021-01-07 14:06:30,257 INFO [com.ets.netsight.inv.server.ConfigImpactCollector] -,,_. devicesUpdated
2021-01-07 14:07:40,906 INFO [stdout] [Queue] Next Schedule not due yet, sleeping for 3679 seconds
2021-01-07 14:09:50,595 DEBUG [com.ets.netsight.inv.database.InvDatabase] InvDatabase - Unhandled Console Event onMessage()ObjectUpdatedEvent (1)
2021-01-07 14:09:50,607 INFO [com.ets.netsight.inv.server.ConfigImpactCollector] -,,_. devicesUpdated
2021-01-07 14:10:37,285 DEBUG [com.ets.netsight.inv.database.InvDatabase] InvDatabase - Unhandled Console Event onMessage()ObjectUpdatedEvent (1)
2021-01-07 14:10:37,297 INFO [com.ets.netsight.inv.server.ConfigImpactCollector] -,,_. devicesUpdated
2021-01-07 14:10:37,319 DEBUG [com.ets.netsight.inv.database.InvDatabase] InvDatabase - Unhandled Console Event onMessage()ObjectUpdatedEvent (1)
2021-01-07 14:10:37,332 INFO [com.ets.netsight.inv.server.ConfigImpactCollector] -,,_. devicesUpdated
2021-01-07 14:10:55,810 DEBUG [com.ets.netsight.inv.database.InvDatabase] InvDatabase - Unhandled Console Event onMessage()ObjectUpdatedEvent (1)
2021-01-07 14:10:55,825 INFO [com.ets.netsight.inv.server.ConfigImpactCollector] -,,_. devicesUpdated
2021-01-07 14:10:55,852 DEBUG [com.ets.netsight.inv.database.InvDatabase] InvDatabase - Unhandled Console Event onMessage()ObjectUpdatedEvent (1)
2021-01-07 14:10:55,866 INFO [com.ets.netsight.inv.server.ConfigImpactCollector] -,,_. devicesUpdated
2021-01-07 14:12:40,907 INFO [stdout] [Queue] Next Schedule not due yet, sleeping for 3379 seconds

greetings

Nico

Re: Unable to backup XOS Stack

StephanH — Thu, 07 Jan 2021 21:50:56 GMT

Unfortunately, I can't see any indication regarding the error cause. Maybe the fastest way to fix the problem is to open a GTAC case.

Re: Unable to backup XOS Stack

Tomasz_Lubas — Tue, 12 Jan 2021 16:51:32 GMT

What vr is used to make backup ? Is that network routable both ways ? Maybe asymetric routing is the cause ?

Re: Unable to backup XOS Stack

Nico_A_ — Wed, 13 Jan 2021 15:13:07 GMT

Hi,

the VR-Default is used. The communication in both directions is possible.

Regards Nico

Re: Unable to backup XOS Stack

Stefan_K_ — Fri, 15 Jan 2021 01:42:56 GMT

Can you provide the solution if GTAC could help you? 🙂

Re: Unable to backup XOS Stack

Nico_A_ — Fri, 15 Jan 2021 14:44:59 GMT

sure, as soon as we have one 🙂

Re: Unable to backup XOS Stack

Nico_A_ — Wed, 17 Feb 2021 20:02:39 GMT

Hi,

we found a soultion for this problem. We had to update the XMC to the Firmware 8.5.2.6

Now the backup runs without any issues.