Just a thought, but how have you defined the hosts in the AAA policy?
If by hostname, maybe its a DNS failure of some sort?
If by IP address, is the RADIUS server attempting to do some sort of reverse-IP lookup and that is failing?
Have you taken some packet captures at the AP and the VX to see the progression of the RADIUS messages to identify where it is slowing down?