The animation when switching between the VDs is extremely fast and had always looked a bit abrupt and thus unpleasant to me. I think it'd be nicer if the windows started moving first slowly, then more rapidly and finally more slowly again, maybe like a Gaussian curve or a sinus.
If it was slower, people would complain that it was too slow. This is as designed, I'm afraid.