Handling 404 errors and web robots

[Tea man]

I'm using CFMX 6.1.
We handle our own errors for page not found (404 errors). But I'm finding that web spiders/robots from search engines such as Yahoo or Google seem to index these "page not found" custom pages. I want them to get the message that the page isn't found and DON'T index it, while displaying our custom error page to the human web visitors that encounter the same URL.

How do you do this?

[MikerRoo]

Placing the "no index" flag in the header works for us.

[Tea man]

Thanks MikerRoo for that suggestion.

I was wondering if there is a way to use the cfhttp or cfheader tags to handle this. Anyone with experience doing it and how?

[Newsgroup_User]

Google "robots.txt" for information on how to tell web bots what pages
should and shouldn't be indexed.

--
Bryan Ashcraft (remove brain to reply)
Web Application Developer
Wright Medical Technology, Inc.
------------------------------------------------------------------
Macromedia Certified Dreamweaver Developer
Adobe Community Expert (DW) :: http://www.adobe.com/communities/experts/


"Tea man" <webforumsuser@macromedia.com> wrote in message
news:ee7j8m$ftu$1@forums.macromedia.com...
> I'm using CFMX 6.1.
> We handle our own errors for page not found (404 errors). But I'm finding
> that
> web spiders/robots from search engines such as Yahoo or Google seem to
> index
> these "page not found" custom pages. I want them to get the message that
> the
> page isn't found and DON'T index it, while displaying our custom error
> page to
> the human web visitors that encounter the same URL.
>
> How do you do this?
>

[Tea man]

Thanks Bash.