Look into other techniques like using Rotobrush or masks. Depending on the contrast, a luma key may also work.
Sometimes you can duplicate your footage and work with levels and curves to create a high contrast copy of the footage that can be used as a track mate. If you post a frame of the video we can tell you if this will work. It's called creating a procedural matte.