It usually happens when I switch between 2 games where I'm different colors, especially on the same map. I finish my turn on one game as red, and then I scan the next game assuming that I'm red and I get very confused for a bit.
Yup. That's why I avoid having multiple active games in the same map ...