If you add a controller host on the AP, the AP try to connect to this controller. A AP is a virtuell controller, not a controller.
You need to remove the controller setting on the other APs. The AP find and join automatically via L2 broadcast, if one AP is configured as virtuell controller.
I think this function is limited to L2!