I've had this problem, too. It doesn't happen frequently, though, so I don't mind. If ever that problem appears, I just reset VGS an it goes away. Just try saving your game more frequently so you won't lose too much playing time when it does kick in.
BTW, the problem doesn't happen on the world map alone.