THat would point to some sirt of harware acceleration issue... Update your graphics drivers.
My drivers are the latest. I have a GTX 680 with the 377.88 drivers.
So I managed to find the answer myself. All I had to do was to increase the size of the object. My size was at 1024px which is a bit small for my 1080p screen. So considering the fact that I have a powerful GTX 680 graphics card I increased the size to 8192px.
To do this all I did was to go to Image>Image Size and then change the width and height to the same number(8192px in my case)