topic High Interference after update in Aerohive Migrated Content

High Interference after update

cporter1 — Wed, 19 Jun 2019 22:17:58 GMT

We just upgraded our AP250's from 7.1 to 10.0r5 and are getting a ton of high interference alerts. Both radios on almost all AP's are set for 5ghz and auto power and channel. Has anyone else run into this?

Re: High Interference after update

samantha_lynn — Thu, 20 Jun 2019 20:14:45 GMT

I'd like to report this to our engineers so they can look in to this. Would you be able to get tech data from the same AP on 7.1 and 10.0r5 so we can compare the interference detected at each version? Below are some guides on how to collect tech data, if you'd like to send these directly to me, my email is Communityhelp@aerohive.com.

HiveManager Classic-https://thehivecommunity.aerohive.com/s/article/How-to-download-tech-data-in-Classic

HiveManager NG-https://thehivecommunity.aerohive.com/s/article/How-to-download-tech-data-in-HiveManager

Device CLI-https://thehivecommunity.aerohive.com/s/article/Collecting-Tech-Data-via-CLI

Re: High Interference after update

admin32 — Thu, 27 Jun 2019 04:45:10 GMT

yes, there was some comment about it in release notes somewhere a few versions back and it is yet to be fixed. The dashboard readings are not to be believed which is a tad annoying. We had a great dashboard of graph results for years and it now looks like a cluster storm network set up by idiots with only the software versions having changed.

You will find that ssh results from troubleshooting the APs directly are actually fine and as they always were. It does take a while to get your head around it and decide which to believe.

similar things happened in various 8x versions as well

Re: High Interference after update

tntjarks — Fri, 28 Jun 2019 01:28:54 GMT

We just updated our AP230s from 6.5r9 to 8.2r4 and are seeing the same thing, half or more of our hive is now showing high interference alerts in the Hivemanager. Turning down the power on some of them did not seem to change the warnings.

Re: High Interference after update

jgraham — Tue, 20 Aug 2019 06:02:58 GMT

Same here. Lots or interference now.

Re: High Interference after update

iss40b — Tue, 01 Oct 2019 02:06:22 GMT

Also seeing the same thing, Before Version 8 everything was fine, Now we have more Alarms than AP's, Almost every AP is showing interference alerts on both 2.4 and 5Ghz, Have followed all the guide and also turned off over 50% of the radios and still get alerts.

Re: High Interference after update

nick_nauwelaert — Tue, 01 Oct 2019 02:30:16 GMT

heya, most of the time the devices are indeed fine, but not always. over the past year or so we had 6 ap250's which all of the sudden had high interferance and high cpu usage. when logging in on the device it responds sluggish or not at all. when you do get it to respond 1 or both of the cpu cores will be fully loaded running softirq's and/or system:

ap250#sh cpu detail

CPU total utilization: 84.586%

CPU user utilization: 0.751%

CPU system utilization: 48.872%

Number of interrupt in last second: 2689

Interrupt utilization: 0.000%

Soft interrupt utilization: 34.962%

------------------------------------------------------------

CPU0 utilization:

CPU total utilization: 69.629%

CPU user utilization: 2.222%

CPU system utilization: 2.222%

Interrupt utilization: 0.000%

Soft interrupt utilization: 65.185%

------------------------------------------------------------

CPU1 utilization:

CPU total utilization: 100.000%

CPU user utilization: 0.000%

CPU system utilization: 96.212%

Interrupt utilization: 0.000%

Soft interrupt utilization: 3.787%

thus far we have not found a way to get this fixed without rma'ing the unit. new config, factory reset, firmware up/downgrade...

just took down 1 unit today running 8.4r11 and logging:

2019-09-30 11:11:20 info kernel: [wifi]: wl1: wlc_phy_rx_iq_est_acphy_percore: IQ measurement timed out

2019-09-30 11:11:20 info kernel: [wifi]: *** ERROR: R Cal value out of range. 4bit Rcal = 0.

2019-09-30 11:11:20 info kernel: [wifi]: wl1: fatal error, reinitializing

2019-09-30 11:11:20 info kernel: [wifi]: wl1: wlc_dpc HAMMERING: MI_GP0 set

Re: High Interference after update

tntjarks — Tue, 01 Oct 2019 02:33:58 GMT

Just this last weekend, I downgraded us to 6.5r10 to fix an issue with the 5ghz radio constantly rebooting in all our AP230s. This interference issue has gone away now.

Re: High Interference after update

admin32 — Tue, 01 Oct 2019 03:49:55 GMT

yes had one of those so far, weirdest thing as it was not software, needed a complete replacement AP to fix, was just sitting on 98% cpu constantly despite full resets and reconfigs and no clients. Unfortunately the 250 has been nothing but trouble for us, our rma counts are through the roof because they just refuse to boot sporadically. There is something very wrong in the basic boot level that bricks them where a reset does not even register. Pity because the 330 was very reliable.

Seems unbelievable they haven't squashed this bug by now though as its been reported for at least 6 months now and numerous updates have been released. All energies seem to be in reporting and graphing not backbone.

Re: High Interference after update

jgraham — Tue, 01 Oct 2019 04:51:55 GMT

How could you tell the radio was rebooting?

Re: High Interference after update

cporter1 — Tue, 08 Oct 2019 07:05:34 GMT

Thanks for the info all. We are having DFS issues also, probably goes along with the bug in the code. I may kick it back down to v7

Re: High Interference after update

rfinney — Tue, 10 Dec 2019 08:47:24 GMT

We are seeing the same thing on AP250's. We will have one start to act up, the cpu will spike, and it will start to drop pings and have high latency. Eventually it becomes more and more unresponsive. Pinging the device internally at 127.0.0.1 shows latency issues as well.

Found others having issues when beamforming was on which we do not.

Turning off wifi1 appears to fix the issue, at least on the one below.

sh cpu detail

CPU total utilization: 39.923%

CPU user utilization: 0.760%

CPU system utilization: 1.901%

Number of interrupt in last second: 2982

Interrupt utilization: 0.000%

Soft interrupt utilization: 37.262%

------------------------------------------------------------

CPU0 utilization:

CPU total utilization: 31.818%

CPU user utilization: 0.757%

CPU system utilization: 1.515%

Interrupt utilization: 0.000%

Soft interrupt utilization: 29.545%

------------------------------------------------------------

CPU1 utilization:

CPU total utilization: 48.091%

CPU user utilization: 0.763%

CPU system utilization: 1.526%

Interrupt utilization: 0.000%

Soft interrupt utilization: 45.801%

2019-12-09 19:40:14 info kernel: [wifi]: wl_add_timer: Already set. Name: wnm_bss_idle_timer, per 1

2019-12-09 19:40:14 info kernel: [wifi]: wl1: fatal error, reinitializing

2019-12-09 19:40:14 info kernel: [wifi]: wl1: wlc_dpc HAMMERING: MI_GP0 set

2019-12-09 19:40:14 info last message repeated 7 times