ExtremeCloud IQ- Site Engine & Extreme Management Center

Expand all | Collapse all

After upgrading to XMC 8.1.4.40, all AP's show as down?

  • 1.  After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 08-14-2018 13:17
    Hello all,

    I just ran an upgrade on my XMC server to version 8.1.4.40. When it came back up, it shows all of my wireless access points as being down. In other words, I have hundreds of "AP Out of Service" alarms. I tried a reboot of the XMC server, to no avail,

    It is still connecting to my wireless controller and shows the AP's as active, and shows a number of clients that is accurate. But there is no longer any client history detail since the upgrade.

    I am running 10.41.04.0002 on my C5210 controllers. Is there a mandatory upgrade on the wireless side of things?



  • 2.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 08-14-2018 13:26
    Check the following:

    in XMC go to administration --> diagnostics

    Make sure the "Level" at the top is set to "Diagnostic"

    Click on historical Statistics collection --> Collector status

    Scroll down to the "Wireless Discover" section

    Check the status of the SYNC

    Does it say SYNC-SUCCEEDED or does it say INVALID SHARED SECRET?

    If INVALID SHARED SECRET try the following:

    SSH to the EWC and run the following commands:

    secureconnection
    message-bus-ciphers AES128-SHA256 3
    apply

    Give it about 10-15 minutes to attempt resync.

    If it shows sync'd it'll need 30 minutes before everything shows back up normally.

    Thanks
    -Ryan


  • 3.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 08-14-2018 13:26
    Hello Ryan,

    You are on the money - it's showing me a "SYNC_ERROR_INVALID_SHARED_SECRET" error.

    I went onto my EWC and ran that command. I am not sure if it worked or not. I didn't get an error message, but I got this warning message ...

    Warning: [AES128-SHA256] contains no NetSight client ciphers, one of the following:
    AES128-SHA
    RC4-SHA
    RC4-MD5
    Example to add NetSight client support: < message-bus-ciphers AES128-SHA256,AES128-SHA 3 >



  • 4.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 08-14-2018 13:26
    Hey, that fixed it Ryan. All of my false alarms vanished and my Wireless sync status is now showing "SYNC_SUCCEEDED".

    Thank you very much!!


  • 5.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 08-14-2018 13:26
    Check the "Collector Status" again to see if it says "SYNC-SUCCEEDED"

    You may have to remove the weak ciphers that are listed.

    If you SSH to the EWC and run the following:

    secureconnection
    show

    What do you see?



  • 6.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 08-14-2018 13:26
    Wonderful,

    As a side note you'll want to make sure you remove the weak ciphers and disable the weak ciphers.

    secureconnection
    weak cipher disable

    There was a change to support stronger ciphers for the EWC --> XMC connection. If anyone has previous had to enable weak ciphers on their EWC in the past they will need to perform this manual configuration to re-establish communication.

    There will be an addendum put into the release notes regarding this change as currently the release notes indicate you need to change to a weak cipher, and this is not correct.

    Thanks
    -Ryan



  • 7.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 08-14-2018 19:00
    I've just upgraded my XMC to 8.1.4 and have the same issue.

    Here my controller settings....

    V2110-1:secureconnection# show
    Weak Ciphers: disable

    Message Cipher: none
    V2110-1:secureconnection#



    I don't see a way to change it via the GUI and that is a little weird for me because I can't think of anything that isn't possible via the GUI (beside deep troubleshooting via the shell).



  • 8.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 08-14-2018 19:04
    Hey Ronald,

    Correct, there is no way to change it in the GUI. You will need to add these commands by SSHing into the EWC. You don't have to shell all the way into the OS.

    If your "Collector Status" shows the same "SYNC_ERROR_INVALID_SHARED_SECRET" message go ahead and run the commands:

    secureconnection
    message-bus-ciphers AES128-SHA256 3
    apply

    We should be releasing updated release notes with details soon.

    Thanks
    -Ryan


  • 9.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 08-14-2018 19:04
    Thanks working now.


  • 10.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 09-19-2018 18:53
    I had the same issue and changing the message-bus-ciphers to AES128-SHA256 3 fixed the communication issues even without making a change to the weak-ciphers setting.

    It appeared to be "factory defaulted" to weak-ciphers enabled and no message-bus-cipher configured prior to making this change to support XMC 8.1.4.40.

    Thanks for posting the fix.



  • 11.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 10-24-2018 18:19
    Great work Ron. Just came across this as we had recently upgraded to this version as well. Applied changes and all seems well. Dean



  • 12.  RE: After upgrading to XMC 8.1.4.40, all AP's show as down?

    Posted 07-01-2019 12:44
    Hi all,


    I have the same problem "AP out of Service" in Extreme Management Center 8.1.5.22 with C35 Firmware Version 10.41.10.0014

    I have check the status of Sync and it's ok "SYNC_SUCCEEDED"

    Can someone help me?


    Regards,
    Marcus.