How to animate film footage in After Effects?

I've heard of the cartoon effect but what I'd like to do is animate all but one object in my footage. I just want to animate the background. How can I do that?

Thanks.