Johan,
I am testing this out in the lab with a few tools. I am not seeing an issue yet but i would like a little information from you.
What is the application that you are using as a SSH application?
Have you tried other applications?
How long does it take for this event to happen?
Are you the only one sshing into the switch or switches?
How many switches are seeing this issue?
Thanks
Jason