lennaert, shinkan, Did you test without fog of war. If fps is reasonable without that it would help. I can always try to make better system for that, maybe using tilemaps again. Also that is quite interesting what you said about frame rate increasing when you move them. On debug I get CPU from those unit events from about 6% to 14% when idle and on move. Also thanks again this really helps!
I guess I could start to make actual game play and see how it is in practice. 200 units is quite a lot to draw at the same time after all