Select a video, photo, precomp, solid or adjustment layer and Roundhouse shows its whole frame as a rectangle. Drag a corner in, exactly as you would on a shape.
The first time, Roundhouse adds a mask named Rounded Corners to the layer, and a Roundhouse effect that holds the corners.
The mask follows the effect, so when you change a corner again, the same mask updates. The video keeps playing inside it.
Layers that already have masks
If the layer has no masks, Rounded Corners is added in Add mode. If it already has masks, Rounded Corners goes last in Intersect mode, so it trims what your masks leave and doesn’t change them.
To round one of your own masks instead of the frame, select that mask in the timeline. See Round masks and shapes you drew.
Layer styles such as Stroke and Drop Shadow follow the new outline.
Precomps
A precomp’s frame rounds from the outside. The layers inside it aren’t touched.
Text layers
Roundhouse doesn’t round text. A mask on a text layer can only crop its letters, so when you select a text layer the panel says Text can’t be rounded. To put a rounded box behind text, draw a rectangle on a shape layer behind it and round that.
A mask you drew on a text layer still rounds when you select the mask itself.
Nulls and audio
Nulls and audio layers have no picture, so Roundhouse says Nulls have no picture to round or Audio has no picture to round.