Yes, adding a second "bootprelay" IP address entry should suffice, if the setup is currently working with relaying to one DHCP server, and both DHCP servers are reached via the same VLAN from the switch.
If the second DHCP server is reached from the switch via another VLAN, you need to ensure that bootprelay is enabled for that VLAN as well.