I found this old topic on the subject:
construct.net/en/forum/construct-3/how-do-i-8/keep-arrow-keys-scrolling-143744
Thing is, this never happened to me in Construct 2, only now I've upgraded to C3, so it seems to be something with the engine over it being a webpage issue.
FTR this is on itch.io