After further investigating, all of the ports are going down because they are hitting the ARP rate limit. I'm still trying to figure out why this is only happening in one building. I turned off the ARP rate limit on the effected switch stacks and now they don't go down.
Students have consoles in their rooms in other residents halls with no issues.
