Colour Pass in Premiere is the easiest way of doing this. If you have anything else in frame the same colour that you do not want to leave then add a garbage matt.
You'll be surprised just how easy this is to do. Just don't try to hold your breath while it renders though