I doubt there would be any more loss of performance than if you had multiple collision masks. They are essentially doing the same thing, at the end of the day.
That being said, multiple collision masks on single objects are on Ashley's to-do list, albeit quite far back (as more important stuff is needed beforehand, and that this has a workaround).
Use the 'pin' behavior so that you don't have to worry about it.