Elliott I agree but that is my problem. My game is built so when controller one is connected you get assigned and control player one. The same goes for controller 2, 3 and 4.
I tried to add a keyboard controller option but that makes the keyboard control player one and if you then add a gamepad the gamepad also controls player one. So I haven't found a good solution how to make it work in a good way.
If I had thought of this from the beginning it had been a no brainer but I'm so far into the project with alot of layouts and I don't know how to implement it now