1 Reply Latest reply on Aug 25, 2018 1:55 PM by Nancy OShea

    sitemap crawl error robots.txt

    bogdan ionut Level 1

      Hi there,

       

      I´ve just built a website in Muse and when I try to upload / test the sitemap.xml (.xml generated by Muse) in google/webmaster tools , it shows up the following message:

       

      ¨Unable to access the network: Unable to access robots.txt. We were unable to crawl your sitemap because we were unable to download the robots.txt file from the root of your site. Make sure it is accessible or eliminate it completely.¨

       

      Initially there was no robots.txt on the server and Muse doesn´t automatically generate one. I tried to create one with the following parameters, still the same message:

       

      User-agent: *

      Disallow:

       

      Now there´s no robots.txt file on the server.

       

      You can access my .xml file here: http://cristiantomafilmmaker.com/sitemap.xml

       

      Does anyone know why this error?

       

      Thank you.