A rounded square mask
Unfortunately, it doesn't work properly on 3D layers. Some of the sides are not rounded when the layer is 3d and the camera have some perspective.