Skip navigation
nancr
nancr Calculating status...
Currently Being Moderated

How do I stop crawlers from indexing and showing trial site url?

Aug 16, 2012 1:11 PM

Tags: #seo #search #url #trial_conversion #trial_sites #crawlers

I read about this a few months ago and can't seem to find it again in knowledge base.

 

I added a domain name to my trial site and now the original trial address is being show in search results.  Can someone tell me how I can prevent crawlers  and hide that url from search results?

 

Trial:  http://galleryofjewels.worldsecuresystems.com/

 

With added domain, want to show this domain only in search results:              http://www.gallery-of-jewels.com/

 

 

Thanks,

 

Nancy 

693 Views   11 Replies   Latest reply: Liam Dilley, Aug 17, 2012 3:49 PM
 
Replies
  • Liam Dilley
    4,237 posts
    Feb 28, 2012
    Currently Being Moderated
    1. Liam Dilley,
    Aug 16, 2012 1:19 PM   in reply to nancr
    Report

    Go to the domain manager and click the developemt URL in the list.

    See that tick box? :p

     
    |
    Mark as:
  • nancr
    Currently Being Moderated
    2. nancr,
    Aug 16, 2012 1:49 PM   in reply to Liam Dilley
    Report

    Liam,

    I see within the domain list, my new domain with and without www. plus galleryofjewels.worldsecuresystems.com (secure) and galleryofjewels.businesscatalyst.com (system)

     

    Should I replace galleryofjewels.businesscatalyst.com (system) with gallery-of-jewels.com?  and

     

    galleryofjewels.worldsecuresystems.com (secure)  with gallery-of-jewels.com?

     

    gallery-of-jewels-prefered-domain.jpg

     

     

    Thanks,

    Nancy

     
    |
    Mark as:
  • Brad Lawryk
    Currently Being Moderated
    3. Brad Lawryk,
    Aug 16, 2012 1:52 PM   in reply to nancr
    Report

    Nancy you are still using the old Admin. Switch to V3.

     

    This is the box Liam mentions ...

     

    redirect.jpg

     
    |
    Mark as:
  • nancr
    Currently Being Moderated
    4. nancr,
    Aug 16, 2012 2:37 PM   in reply to nancr
    Report

    Brad,

    Thanks for the heads up.

    I switched over to V3.

    I see the check box for http://galleryofjewels.businesscatalyst.com/ as in this picture.  I checked the box.Screen shot 2012-08-16 at 2.30.33 PM.png

    I do not see this check box for http://galleryofjewels.worldsecuresystems.com/

    Screen shot 2012-08-16 at 2.28.00 PM.png

    My original question is how to get the crawlers to stop indexing and showing results for http://galleryofjewels.worldsecuresystems.com/. 

    Nancy

     
    |
    Mark as:
  • Brad Lawryk
    Currently Being Moderated
    5. Brad Lawryk,
    Aug 16, 2012 2:43 PM   in reply to nancr
    Report

    The worldsecure ones should not be getting index at all by default if I'm not mistaken? At least I have never seen one come up.

     
    |
    Mark as:
  • nancr
    Currently Being Moderated
    6. nancr,
    Aug 16, 2012 2:58 PM   in reply to Brad Lawryk
    Report

    Brad,

    Here is a screen shot of a google search

    Screen shot 2012-08-16 at 2.53.43 PM.png

    I see wordsecure is getting indexed.  I just don't want google to get fed up with duplication down the road if this could be an issue.

     

    Nancy

     
    |
    Mark as:
  • Liam Dilley
    4,237 posts
    Feb 28, 2012
    Currently Being Moderated
    7. Liam Dilley,
    Aug 16, 2012 3:22 PM   in reply to nancr
    Report

    If you have links Brad they will.

    If the site linking structure is malformed and you have cases where a bot can get to a worldsecuresystems url then it will go through all the links on that page and index everything as that URL.

    Nancy, you need to find where these occur and lock them down so that does not happen.

     
    |
    Mark as:
  • nancr
    Currently Being Moderated
    8. nancr,
    Aug 16, 2012 5:09 PM   in reply to Liam Dilley
    Report

    Liam,

    I found where I had created a back button with an image linking to wordsecuresystems.  Could this be it.  Bottom picture shows the source code of the page suspect link hightlighted.

    http://www.gallery-of-jewels.com/jewelry-designers/vanessa-mellet

    Screen shot 2012-08-16 at 4.24.26 PM.png

     

    Screen shot 2012-08-16 at 4.21.42 PM.png

     

    I am pulling my hair out trying to remember how I made this back button.  The javascript and link to the image must be on a template but I can't find it.  Brain dead.  Any ideas?

     
    |
    Mark as:
  • Liam Dilley
    4,237 posts
    Feb 28, 2012
    Currently Being Moderated
    9. Liam Dilley,
    Aug 16, 2012 6:34 PM   in reply to nancr
    Report

    Built with a web app or content holder?

     
    |
    Mark as:
  • nancr
    Currently Being Moderated
    10. nancr,
    Aug 17, 2012 3:31 PM   in reply to Liam Dilley
    Report

    Liam,

     

    I searched around and found out I had used the module {module_goback,image}.  I had customized the module but for some reason added the source of the image as http://galleryofjewels.worldsecuresystems.com.  I couldn't see the module in my templates but now realize why I wouldn't be there.    I stumbeled upon the module template in the overall catalogue view.  There it was. 

     

    Screen shot 2012-08-17 at 3.23.21 PM.png

    Screen shot 2012-08-17 at 2.49.17 PM.png

     

    Now I find that http://galleryofjewels.businesscatalyst.com is being indexed also.  I think I can solve that too.

     

    Screen shot 2012-08-17 at 2.52.58 PM.png

     

    Thanks for your help.

     

    Nancy

     
    |
    Mark as:
  • Liam Dilley
    4,237 posts
    Feb 28, 2012
    Currently Being Moderated
    11. Liam Dilley,
    Aug 17, 2012 3:49 PM   in reply to nancr
    Report

    Cool, It is good you got the settings on for the 301 redirect from the development URL's but the ohter step (one which is the common issue) is that people have varied links throughout the site.

    Another common mistake is in some places on a site a link is www.something.com and others it is something.com - no consistancy.

     

    Adressing those sorts of things and you should be good. Note though that some of the results you see will take time to at first appear further down google search results and then go completly.

    You can help this by setting up google web master tools as you need to for your site.

     
    |
    Mark as:
Actions

More Like This

  • Retrieving data ...

Bookmarked By (0)

Answers + Points = Status

  • 10 points awarded for Correct Answers
  • 5 points awarded for Helpful Answers
  • 10,000+ points
  • 1,001-10,000 points
  • 501-1,000 points
  • 5-500 points