Every so often I will get glitched frames in AE, and also in FCP7 . The glitch happens when a clip is rendered. Most often, a diagonal line appears in a frame. Sometimes there are other issues, such as artifacting. The glitches never appear for more than one frame, and it is rare or more than one glitch in a single clip. The way we have been fixing the problem is to cut the clip around the glitch and re-render the affected area.
We haven't been able to pinpoint the cause. It doesn't have to do with a certain filter being used. We primarily use BCC, FxFactory, and CoreMelt plugins, and haven't seen any correlation between any one filter being used and glitches appearing. We tried the usual fixes, and just recently reformatted the computer and reinstalled from scratch. It seemed to work better for a couple weeks, but the glitch came back.
Here are two examples. I used an artist sketch filter on the video. The first glitch is a diagonal line, the second is distortion of the video/filter. The clean frame came between the two glitches.
1st glitch: http://i.imgur.com/pdT5t.jpg
2nd glitch: http://i.imgur.com/p3p7l.jpg
Clean frame: http://i.imgur.com/jLXa9.jpg
Specs: MBP with 2.66 GHz Core i7, 8GB DDR3 ram, GeForce GT 330M 512MB, currently running Lion 10.7.4
If I've left out any information, please ask. I'm just typing as I think.
What codec are you using? What version of AE. I'm not having any issues with any of the ProRez formats CS6 and OSX 10.7 0r 10.8
Try cleaning up Media Cache and Purge all memory