Issue with CAPWAP connection

[qR46s]

Hi,

We have an issue with AP130 ap's on different site. In one site we have 14 AP’s that are working great, but the capwap connection on two AP’s will not establish.

This is a show capwap client of a working ap:

CAPWAP client:   Enabled

CAPWAP transport mode:  UDP

RUN state: Connected securely to the CAPWAP server

CAPWAP client IP:        10.ccc.1.175

CAPWAP server IP:        10.sss.0.26

HiveManager Primary Name:10.sss.0.26

HiveManager Backup Name:

CAPWAP Default Server Name: aerohive.domain.xx

Virtual HiveManager Name: Domain

Server destination Port: 12222

CAPWAP send event:       Enabled

CAPWAP DTLS state:       Enabled

CAPWAP DTLS negotiation: Disabled

     DTLS next connect status:   Enable

     DTLS always accept bootstrap passphrase: Enabled

     DTLS session status: Connected

     DTLS key type: passphrase

     DTLS session cut interval:     5 seconds

     DTLS handshake wait interval: 60 seconds

     DTLS Max retry count:          3

     DTLS authorize failed:         0

     DTLS reconnect count:          0

Discovery interval:      5 seconds

Heartbeat interval:    120 seconds

Max discovery interval: 10 seconds

Neighbor dead interval:240 seconds

Silent interval:        15 seconds

Wait join interval:     60 seconds

Discovery count:         0

Max discovery count:     3

Retransmit count:        0

Max retransmit count:    1

Primary server tries:    0

Backup server tries:     0

Keepalives lost/sent:    138/10043

Event packet drop due to buffer shortage: 0

Event packet drop due to loss connection: 11

And this is an AP with issues:

CAPWAP client:   Enabled

CAPWAP transport mode:  UDP

SULKING state: Sending Discovery packets to find the CAPWAP server

CAPWAP client IP:        10.ccc.1.178

CAPWAP server IP:        10.sss.0.26

HiveManager Primary Name:10.sss.0.26

HiveManager Backup Name:

CAPWAP Default Server Name: aerohive.domain.xx

Virtual HiveManager Name: Domain

Server destination Port: 12222

CAPWAP send event:       Enabled

CAPWAP DTLS state:       Enabled

CAPWAP DTLS negotiation: Disabled

     DTLS next connect status:   Enable

     DTLS always accept bootstrap passphrase: Enabled

     DTLS session status: Disconnect

     DTLS key type: passphrase

     DTLS session cut interval:     5 seconds

     DTLS handshake wait interval: 60 seconds

     DTLS Max retry count:          3

     DTLS authorize failed:         0

     DTLS reconnect count:          0

Discovery interval:      5 seconds

Heartbeat interval:    120 seconds

Max discovery interval: 10 seconds

Neighbor dead interval:240 seconds

Silent interval:        15 seconds

Wait join interval:     60 seconds

Discovery count:         3

Max discovery count:     3

Retransmit count:        0

Max retransmit count:    1

Primary server tries:    1

Backup server tries:     0

Keepalives lost/sent:    0/0

Event packet drop due to buffer shortage: 0

Event packet drop due to loss connection: 6

I’ve did a factory reset of the AP, and tried to connect to AP from scratch, but nothing.

Some testing seems to be working:

AH-8f4ec0#exec _test tcp-service host 10.sss.0.26 port 22

Testing TCP connection for host=10.sss.0.26, port=22, timeout=10 seconds

Test successfully.



AH-8f4ec0#^Ccapwap ping 10.sss.0.26

CAPWAP ping parameters:

    Destination server: 10.sss.0.26 (10.sss.0.26)

    Destination port: 12222

    Count: 5

    Size: 56(82) bytes

    Timeout: 5 seconds

--------------------------------------------------

CAPWAP ping result:

    82 bytes from 10.sss.0.26 udp port 12222: seq=1 time=7.828 ms

    82 bytes from 10.sss.0.26 udp port 12222: seq=2 time=7.471 ms

    82 bytes from 10.sss.0.26 udp port 12222: seq=3 time=6.711 ms

    82 bytes from 10.sss.0.26 udp port 12222: seq=4 time=7.252 ms

    82 bytes from 10.sss.0.26 udp port 12222: seq=5 time=6.715 ms

    ------- 10.sss.0.26 CAPWAP ping statistics -------

    5 packets transmitted, 5 received, 0.00% packet loss, time 5044.790ms

    rtt min/avg/max = 6.711/7.195/7.828 ms

I can see the following capwap debugging:

<70>1  2020-11-17T10:21:03.544083+01:00 aerohive ah_cli: [security-6-ah_cli]204001: admin:<_show logging buffered >

<14>1  2020-11-17T10:21:00.306197+01:00 aerohive capwap: CAPWAP call the function error! state:Idle event:none  timer:idle_timer

<12>1  2020-11-17T10:21:00.306116+01:00 aerohive capwap: CAPWAP:couldn't open tunnel: Connection refused

<14>1  2020-11-17T10:21:00.305917+01:00 aerohive capwap: CAPWAP_TCP:tunnel_out_connect: do_connect (ip:10.sss.0.26 port:80) error: Connection refused

<13>1  2020-11-17T10:21:00.029276+01:00 aerohive root: trying 1 times on 10.sss.0.26

<78>1  2020-11-17T10:21:00.012247+01:00 aerohive crond[1867]: USER root pid 4137 cmd /etc/ntp.sh

<14>1  2020-11-17T10:20:59.254806+01:00 aerohive capwap: ignore capwap register service AP 8f4ec0 cannot contact HiveManager._http._tcp.,Don't need update

<70>1  2020-11-17T10:20:59.252527+01:00 aerohive capwap: [aaa-6-capwap]203053: CAPWAP_HM:Ready connecting to HM 10.sss.0.26

<14>1  2020-11-17T10:20:59.252375+01:00 aerohive capwap: CAPWAP_HM:use primary server(TCP), ip=10.sss.0.26, port=80

<14>1  2020-11-17T10:20:59.252279+01:00 aerohive capwap: CAPWAP_HM:get capwap server ip (10.sss.0.26) for name (10.sss.0.26)

<14>1  2020-11-17T10:20:59.252062+01:00 aerohive capwap: CAPWAP_HM:user has configured primary or backup HM's name

<14>1  2020-11-17T10:20:59.251932+01:00 aerohive capwap: CAPWAP_HM:get hivemanager name from scd (first:10.sss.0.26, second:).

<14>1  2020-11-17T10:20:59.251801+01:00 aerohive capwap: CAPWAP_HM:Choose HM IP or name for connecting....

<14>1  2020-11-17T10:20:59.251649+01:00 aerohive last message repeated 3 times

<14>1  2020-11-17T10:20:32.613410+01:00 aerohive capwap: ignore capwap register service AP 8f4ec0 cannot contact HiveManager._http._tcp.,Don't need update

<70>1  2020-11-17T10:20:32.610947+01:00 aerohive capwap: [application-6-capwap]209025: receive event capwap disconnect: eventid = 244: length = 0

<13>1  2020-11-17T10:20:31.111796+01:00 aerohive root: Connect 10.sss.0.26 failed, try next server

<13>1  2020-11-17T10:20:21.099817+01:00 aerohive root: trying 3 times on 10.sss.0.26

<70>1  2020-11-17T10:20:17.766534+01:00 aerohive capwap: [application-6-capwap]209025: receive event capwap disconnect: eventid = 244: length = 0

<14>1  2020-11-17T10:20:17.765671+01:00 aerohive capwap: CAPWAP:get device software version string:(HiveOS 8.3r2 build-191018)

<70>1  2020-11-17T10:20:17.611252+01:00 aerohive capwap: [application-6-capwap]209025: receive event capwap disconnect: eventid = 244: length = 0

<13>1  2020-11-17T10:20:11.088679+01:00 aerohive root: trying 2 times on 10.sss.0.26

<70>1  2020-11-17T10:20:02.690841+01:00 aerohive capwap: [application-6-capwap]209025: receive event capwap disconnect: eventid = 244: length = 0

<14>1  2020-11-17T10:20:02.688700+01:00 aerohive capwap: CAPWAP:get device software version string:(HiveOS 8.3r2 build-191018)

<70>1  2020-11-17T10:20:02.610644+01:00 aerohive capwap: [application-6-capwap]209025: receive event capwap disconnect: eventid = 244: length = 0

<13>1  2020-11-17T10:20:01.041336+01:00 aerohive root: trying 1 times on 10.sss.0.26

<78>1  2020-11-17T10:20:01.003562+01:00 aerohive crond[1867]: USER root pid 4007 cmd /etc/ntp.sh

<70>1  2020-11-17T10:19:54.514174+01:00 aerohive ah_cli: [security-6-ah_cli]204001: admin:<_show logging buffered >

<14>1  2020-11-17T10:19:49.872396+01:00 aerohive kernel: echo (3872): drop_caches: 3

<14>1  2020-11-17T10:19:49.787916+01:00 aerohive ah_top: PM: current cached memory: 130340 KB, exceed drop cache threshold: 71680 KB, Drop cache now.

<70>1  2020-11-17T10:19:47.789709+01:00 aerohive capwap: [application-6-capwap]209025: receive event capwap disconnect: eventid = 244: length = 0

<14>1  2020-11-17T10:19:47.788421+01:00 aerohive capwap: CAPWAP:get device software version string:(HiveOS 8.3r2 build-191018)

<14>1  2020-11-17T10:19:47.674737+01:00 aerohive capwap: Fetch shared memory 13001 of size 416, address at 0xb1616000

<70>1  2020-11-17T10:19:47.611561+01:00 aerohive capwap: [application-6-capwap]209025: receive event capwap disconnect: eventid = 244: length = 0

<14>1  2020-11-17T10:19:36.883883+01:00 aerohive capwap: ignore capwap register service AP 8f4ec0 cannot contact HiveManager._http._tcp.,Don't need update

<70>1  2020-11-17T10:19:36.881315+01:00 aerohive capwap: [aaa-6-capwap]203053: CAPWAP_HM:Ready connecting to HM 10.sss.0.26

<70>1  2020-11-17T10:19:36.881109+01:00 aerohive capwap: [aaa-6-capwap]203052: CAPWAP_HM:use primary server(UDP), ip=10.sss.0.26, port=12222

<14>1  2020-11-17T10:19:36.881004+01:00 aerohive capwap: CAPWAP_HM:get capwap server ip (10.sss.0.26) for name (10.sss.0.26)

<14>1  2020-11-17T10:19:36.880347+01:00 aerohive capwap: CAPWAP_HM:user has configured primary or backup HM's name

<14>1  2020-11-17T10:19:36.880260+01:00 aerohive capwap: CAPWAP_HM:get hivemanager name from scd (first:10.sss.0.26, second:).

<14>1  2020-11-17T10:19:36.880090+01:00 aerohive capwap: CAPWAP_HM:Choose HM IP or name for connecting....

<14>1  2020-11-17T10:19:36.879906+01:00 aerohive capwap: ignore capwap register service AP 8f4ec0 cannot contact HiveManager._http._tcp.,Don't need update

<14>1  2020-11-17T10:19:36.877234+01:00 aerohive capwap: ignore capwap register service AP 8f4ec0 cannot contact HiveManager._http._tcp.,Don't need update

<14>1  2020-11-17T10:19:36.742515+01:00 aerohive capwap: CAPWAP: Generate random number successfully

<14>1  2020-11-17T10:19:36.740279+01:00 aerohive capwap: CAPWAP: Ready to generate random number

<70>1  2020-11-17T10:19:36.739716+01:00 aerohive capwap: [application-6-capwap]209025: receive event BGD service info: eventid = 369: length = 168

<14>1  2020-11-17T10:19:36.739221+01:00 aerohive capwap: capwap monitor bonjour service HTTP proxy settings for hive hive0._aerohive-proxy._tcp.

When doing a packet capture I can see the packets going to the Hivemanager, but no response is coming back.

[HowardS]

Aerohive Migrated Content ... HiveManager Classic cannot communicated, would available please indicate how to migrate to Areohive NG cloud?


MyBalanceNow

[SamPirok]

Hello, I would recommend the troubleshooting outlined in this guide: https://extremeportal.force.com/ExtrArticleDetail?n=000047588&q=capwap

If that doesn’t help, you might want to open a support case to troubleshoot further with our engineers.