So I didn't notice at first - as on photoshop the PDF and PNG looks fine - but when you open up the PNG on windows - (see picture)
the colours seem to invert or just show white bits.
I've tried so much
using sRGB profile
Gifs are the same
And I really need it to be a transparent background so jpeg's are out the window
The inverted colors in Windows depends upon the color profile selected in the OS. Photoshop saves the file in different color modes but you need to see them in a calibrated or default color space on your monitor.
This article Save PNG Images with Transparent Background in Photoshop - Photoshop - Apps General Discussion should help you with saving the image with transparent background.