• Global community
    • Language:
      • Deutsch
      • English
      • Español
      • Français
      • Português
  • 日本語コミュニティ
    Dedicated community for Japanese speakers
  • 한국 커뮤니티
    Dedicated community for Korean speakers
Exit
Locked
0

sitemap crawl error robots.txt

New Here ,
Aug 25, 2018 Aug 25, 2018

Copy link to clipboard

Copied

Hi there,

I´ve just built a website in Muse and when I try to upload / test the sitemap.xml (.xml generated by Muse) in google/webmaster tools , it shows up the following message:

¨Unable to access the network: Unable to access robots.txt. We were unable to crawl your sitemap because we were unable to download the robots.txt file from the root of your site. Make sure it is accessible or eliminate it completely.¨

Initially there was no robots.txt on the server and Muse doesn´t automatically generate one. I tried to create one with the following parameters, still the same message:

User-agent: *

Disallow:

Now there´s no robots.txt file on the server.

You can access my .xml file here: http://cristiantomafilmmaker.com/sitemap.xml

Does anyone know why this error?

Thank you.

Views

664

Translate

Translate

Report

Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines

correct answers 1 Correct answer

Community Expert , Aug 25, 2018 Aug 25, 2018

At the moment there is no robots.txt file on your server for Google bots to find.

http://cristiantomafilmmaker.com/robots.txt

Muse cannot generate a robots.txt file for you.  You need to generate one separately and manually FTP it to the root of your server.   See link below.

Create a robots.txt file - Search Console Help

Votes

Translate

Translate
Community Expert ,
Aug 25, 2018 Aug 25, 2018

Copy link to clipboard

Copied

LATEST

At the moment there is no robots.txt file on your server for Google bots to find.

http://cristiantomafilmmaker.com/robots.txt

Muse cannot generate a robots.txt file for you.  You need to generate one separately and manually FTP it to the root of your server.   See link below.

Create a robots.txt file - Search Console Help

Nancy O'Shea— Product User, Community Expert & Moderator
Alt-Web Design & Publishing ~ Web : Print : Graphics : Media

Votes

Translate

Translate

Report

Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines