There are several ways to accomplish this.
1. Parent the Guy in Black layer to the Background layer. Animate him separately
2. Instead of applying the tracking data to the Guy in Black layer, create a null layer that holds the tracking data.
Parent the Guy in Black layer to the null layer while holding down the Shift key.
Now you can animate the Guy in Black layer separately, while still maintaining the same tracking keyframes.
Here are some resources and tutorials about Parenting
Thank you very much that works perfectly