To permanently remove the active layers from the view, right click on the layer in the ToC and select the “Delete layer” option.
A confirmation dialogue appears.