As described above, when you max out both controllers, on a fail over you will lose adoption on half of the APs. What can possibly play in your favor would be if you are running the WLANs in bridge mode local and not tunneling traffic back through the controller. If a controller goes down, the AP will still function handling all traffic as normal. Users will not know. In bridge mode tunnel, if a controller goes down, then half of the users will be ringing your phone off the hook complaining they lost network connectivity.
Either way, local or bridging, half of the APs will not adopt to the running controller. Always use the N+1 number when doing HA configurations.