Are you guys limiting/filtering your collision checking by picking objects first?
For obstacles the player can interact with I usually pick the instances with onScreen, pickNearest or by checking the distance first, before checking collision.
What kind of tricks are you guys using?