The physics behavior has the option to enable/disable collisions with object types. This however (sadly) cannot be done per instance.
One way of doing it would be to entirely disable physics for all objects on the lower layer (which does work per instance). You can pick these objects with the "pick objects by comparison" and pick all objects that are on the same layer as the ball. This will not work if you plan on having multiple balls on different layers at the same time.
I cannot go more specific than this since I do not know how you set everything up, but this should give you a general idea.