Without seeing your footage nobody can tell you much. Your failure quite likely is that you are looking for a one-step solution while from the sound of it, your setup would require like a gigazillion steps all combined.
1 person found this helpful
I would start by using Motion Stabilize rather than tracking. Pick two objects in the same plane in the footage where you want to replace the house in the shot where the camera moves in and track position rotation and scale then apply the stabilization. Now the objects that you tracked to motion stabilize should not move. Now add a layer to use as a track matte to remove the house and your replacement footage if it is locked off and the camera is not moving at all. If the replacement footage sticks to the stabilized footage just fine then you should be ready for step 2. If it does not then you need to animate position, scale and rotation so that the replacement footage looks right.
Step 2 involves removing the stabilization from the stabilized shot and adding the motion to the track matte and the replacement footage. This is easiest to do by adding a null and then tying the position of the null to the Anchor point of the footage that has been stabilized. That's the easy expression. Now you have to apply the opposite of rotation of the stabilized footage to the null. This is also easy because all you have to do is add an expression, add a minus sign, then drag the pickwhip from the null's rotation to the stabilized footage. The last expression is scale. This one is a little more complicated. To make things easier just apply this animation preset to the null after you name your stabilized footage "stabilized" and then move the CTI to the first frame and parent all of the layers to the null.
Here's the animation preset: Dropbox - destabilize Rotation Scale.ffx
If that doesn't work then the next trick I would try would be to camera track the footage. The trick there is to pick points in the same plane where you want to put the replacement footage to cover the house. The problem is that you may have a bunch of parallax difference between the house and the replacement footage. If you do then you will have to apply a 3D layer to the scene in the same plane as the ground you are going to replace then use a point light and a scaled copy of your footage as a projector to projection map the replacement footage onto the 3D layer. This is too complicated to explain in a post.
Excellent! Thank you, Rick, for interpreting my post. I appreciate the time you took to write all of this out for me. I'll be back to work on it tomorrow, and will let you know how it works out!
Just tried out step 1 really quick, and the background/replacement footage sticks and is all good. I'll do the rest tomorrow, as I'm looking forward to finally getting this done! Well done, Mr. Gerard!