I may have misread the question. You can use the Management Out of Band port to manage the switch which would then be tied to a separate network. or you can just assign one IP to any switch to manage inband.
I thought the questions was if I have multiple VLANs with and IP address will all of them be allowed to be managed the switch and the answer is yes. the only way to restrict that access is to use an access profile/list.