Yes, you're probably running out of samples because your graphics card doesn't have these capabilities. You could probably circumvent it by reverting to CPU mode at the cost of things being a million times slower....
Is prerendering helpful here?
Is RT set to Cubic?
Hmm. I thought the GTX 570 was the way to go! Oh well...
I tried cubic, nothing changed. Not sure I understand the pre-rendering question. Rendering to a file will take away the 3D interactivity with other layers. But I did try exporting a file and the pointillization remains.
I was getting the same result in Ray-Trace that were not there in Classic. However, I wanted extruded text so not really an option. I increased the RT quality from 3 to 20 and it worked! (Course took a lot longer to render.)
3.4 GHz i7
GeForce GTX 680MX
Thanks, David. At least I know it's not just me! I bumped up the quality as well, and things looked decidedly better - at the expense of render time.