If your VSP has an IP address (say on GRT) on the same VLAN where the ERS is located, but you only have a mgmt CLIP on the VSP and the ERS does not have any valid return route to reach that VSP CLIP, then that might be your problem.
What you can do, is to create a "mgmt vlan" interface on that very same VSP VLAN; and when you configure the mgmt vlan IP address on that mgmt VLAN interface, you must/can configure the very same IP address that VLAN already has configured on GRT (hence in the VSP config, the same IP address appears configured twice, once under "interface vlan X" and once again under "mgmt vlan X"). Now you should be able to hit the ERS with SSH from the VSP.