Interactivity setting on layers is only for mouse and touch events.
When a keyboard key is pressed, you need to pick the right note instance based on the current difficulty - either by layer name or by instance variable on the note. I suggest doing this with an instance variable, it will be easier.
EDIT: Wow, this is my 10000th post! :)