If I were to guess, the shots that don't work contain only large areas of relatively even color with no distinct details. Therefore the algorithm can't detect anything or at least doesn't have enough towork with. If that's the case, then there is nothing you can do. In that case using the old stabilization method with the tracker or mochaAE might be your only option.
Thanks for the info. Yes, one of the clips was a bride in her wedding dress and the background was white fabric. I actually never figured out how to get the old warp stablization to work for me so I either need to get back on youtube and watch them again, or let the clips go.
The default settings for Warp Stabilizer warp the image to stabilize it (hence the name). But you can switch to a different method within the effect to not do warping but just to do position, scale, and rotation changes. This is all explained in the resources here.