Yes. On my existing iMac 2MB 2Mhz core duo.
I'm looking for a new computer because of this problem. I often review drawings that are provide to me as pdf files
I checked out a new iMac 3.1 Mhz quad core i5, 4MB and it was disapointing. I tried both Preview (the mac pdf reader) and Adobe reader and they both had problems of flickering or delays. Surprisingly Good Reader on my iPad does a smoother but ultimately slower pan and zoom transition with a gradual increase to full resolution.
My delays are not as bad as yours and my computer does not usually crash. It seem that there should be some hardware or software fix for this.