This game needs a feature like "Hold CTRL to distribute points without moving the map".
It's so annoying and it happens to me all the time that when I click to use my points it moves the map instead and I run out of time before I have spent all my points. It happens even when I'm not moving my mouse at all.
Can't think of any reason not to add this.