I have heard that Google 'might' not be able to read text inside AJAX. Does anyone here know forsure whether they can?
I have content that I do not want Google to see (it is duplicate copies of other content that I have elsewhere on my site and I do not want any duplicate content issues- where Google just chooses which one to show in its search results). If anyone has any better option for me for how I go about hiding this content from the Google crawler please tell me.
P.S. I do not want to have to resort to using frames (such as <iframe>) to hide the content.
can I assign a robots.txt file to not read spry?