topic Re: Firmware update now getting lost connection notifications in ExtremeWireless (IQE)

Firmware update now getting lost connection notifications

DeVoID — Wed, 14 Sep 2022 12:08:19 GMT

This is a recurring theme here.

I update the firmware on the AP's, and for weeks and months i get emails that AP "x" has lost its CAPWAP connection. If i get in the interface quick enough, i see the offline icon to the left of the AP, give it a few seconds, and its back online. Email after email with all different AP's around campus doing that.

Then sometimes that just stops, out of the blue no more notifications, other times a new firmware seems to fix whatever is going on with that, such as 10.0.4.5 that fixed the issue.

However, last week i install 10.5.1.0 and now im getting dozens of emails a day from various AP's stating they lost their CAPWAP connection. Same thing, quick enough in the interface, its showing as offline, but leave it alone and its back online in under a minute.

So it appears that this new firmware has re-introduced that back into our environment.

Any ideas about that? and yes that VoIP checkbox on Sonicwall is checked, persistent NAT.

Thanks, Jason

PS: These are AP650(AH) AP's

Re: Firmware update now getting lost connection notifications

Christoph_S — Wed, 14 Sep 2022 13:14:34 GMT

Hello Jason,

Have you also tried increasing the UDP Session Timeout for UDP port 12222 to 300 seconds. (Firewall Settings > Flood Protection > UDP) in the SonicWall firewall configuration for XIQ CAPWAP?

BR,

Re: Firmware update now getting lost connection notifications

DeVoID — Thu, 22 Sep 2022 11:59:07 GMT

Sorry been out sick. I havent tried that, but will just as soon as i finish playing catch up - although got another new issue... bonjour GW just stopped working on the AP's yesterday and still isnt working... sigh....)

Ill keep you posted, but may not be until next week. sorry thanks for that suggestion.

Re: Firmware update now getting lost connection notifications

DeVoID — Thu, 22 Sep 2022 15:07:22 GMT

I just looked, and we dont have anything specific to port 12222, just general settings:

if I change that, do you think multiplying it by 100 would be too large and actually cause us issues? and i should just do it by 50 first, so 150 seconds to start and see what happens?

although i am concerned that no matter what number you put in the box, you get this warning:

that makes me quite nervous.. remember all i did was update firmware on existing AP's.... i didnt change anything on the firewall to cause this......

thanks,

Jason.

Re: Firmware update now getting lost connection notifications

DeVoID — Thu, 22 Sep 2022 17:40:25 GMT

okay all of a sudden at 1230 im seeing a LOT of AP's go offline and then back online. Always pingable, but its been at most 6 in a day, we have had 7 in an hour, and its still going on.

I didnt change anything. so have no idea why this is going on. The cloud portion could go down, but the AP's at a location would be unaffected, right? EDIT: yes if you DONT believe what the interface is telling you... see below.

Re: Firmware update now getting lost connection notifications

DeVoID — Thu, 22 Sep 2022 17:42:21 GMT

Well, this is NOT good. So, i check the status of XIQ cloud services, and see virginia-1 is degraded, and note - with dismay - that its part of Amazon's AWS services. I check their services as well as downdetector.com and see right at that time a lot of complaints about AWS having issues.

So, i have an interface that isnt actually showing me what it is designed and created for. close to real-time status of my wifi network. its obvious this AWS outage is affecting their Virginia-1 site, which in turn turned our interface into meaningless data.

I thought something wasnt right, when all of those going down, were still pingable, and i had not received one complaint from our users.....

thats really bad, and really changes the way in which i now vies the XIQ interface... also, with all the AWS outages, why oh why did they decide to put their "stuff" there and not in-house?

Anyway, getting back to UDP, see my question above, thanks

Re: Firmware update now getting lost connection notifications

mlederer — Mon, 13 Mar 2023 16:00:40 GMT

Is there any update here? I too am concerned about increasing the threshold for all UDP connections. I tried to create a custom policy to affect just port 12222 but that didn't seem to have any effect. I'm not sure my method targeted port 12222 correctly.

Re: Firmware update now getting lost connection notifications

mlederer — Mon, 13 Mar 2023 17:53:13 GMT

What were the results of the changes you made? I am concerned about increasing the threshold for all UDP connections. I tried to create a custom policy to affect just port 12222 but that didn't seem to have any effect.

Re: Firmware update now getting lost connection notifications

Christoph_S — Tue, 14 Mar 2023 12:45:42 GMT

Have a look at this article: https://extremeportal.force.com/ExtrArticleDetail?an=000058924

This applied to any firewall with such settings.

If issue is not resolved, I would recommend that you open a GTAC case so that we may investigate further.

BR,

Re: Firmware update now getting lost connection notifications

DeVoID — Tue, 27 Feb 2024 12:23:51 GMT

I never did change it. This I believe is all related to them using Amazon AWS services. If you can ping your AP, and not getting user complaints, its just the crappy interface between XIQ and AWS. Just hate that AWS is used by so many external companies, even Wyze - security camera company - uses them for identifying what their cameras are seeing, like a person, pet, etc. I despise AWS, sadly Bezos had enough money to venture and fund that, and while it might be useful, it sucks when they have issues, or the company doesn't want to pay more to increase their services, and the customer pays for it with an interface that can be out-of-date, just like seeing AP's down when they are in fact up and working.

Sadly im having a similar but not the same issue after updating to 10.6.6.0 on AP650, this time they are down while the switch is up, and I have to either reboot the switch, or unplug the network cable at the switch for the AP and plug it back in for the AP to come back on line. So far two buildings have had all their AP's go offline, truly offline, while all other network devices are working fine on the same switch. I cam back here to see if others had a similar issue. Best, Jason.