Well if you do intend on trying to implement collisions for different angles on different layers, wouldn't that mean you would have to go clockwise?
I'm somewhat skeptical as to if that's actually feasible, what with all the extra calculations, etc, then again I have n idea how well you've optimized things already.
I guess one thing to think about is if there should be a view angle like you described if you do get collisions for different angles.
Seems that might be a bit confusing.