0 Replies Latest reply on Jun 21, 2007 6:44 AM by machu1

    vSpider Problem

    machu1
      A few days ago I implemented a vspider search on CFMX 7 running on Linux. This is a development server and vspider works like a charm. Yesterday I moved all scripts to a mirror stage server and it doesn't work. I can see that a vspider runs and completes but no documents are being indexed. The folder structure of the two severs and software versions are identical. After reading some forum posts I came to conclusion that this might be an issue with a fact that vspider is licensed only fora local spidering. Since I know nothing about a linux, I asked my server administrator to see if there is any difference in Apache website properties between development and stage servers. They sent me the config (below) and they told me that it's virtually identical.

      At this point I really don't know what else i can do. I could use some help....

      -------------------------------------------------------------------
      Apache setup:
      DEV
      <VirtualHost *:80>
      ServerAdmin netops@companyname.com
      DocumentRoot /vol/wwwdev/site
      ServerName dev.companyname.com
      Alias /CFIDE /vol/wwwtest/bchtml/CFIDE
      ErrorLog logs/dev.companyname.com-error_log
      CustomLog logs/dev.companyname.com-access_log common
      </VirtualHost>


      STAGE
      <VirtualHost *:80>
      ServerAdmin netops@companyname.com
      DocumentRoot /vol/www/site
      ServerName stage.companyname.com
      ErrorDocument 404 "/err404.html"

      <Location /advertisers/adnet>
      AuthUserFile /vol/www/.htpasswd
      AuthName "Adnet"
      AuthType Basic
      Require user adnet
      </Location>
      Alias /CFIDE /vol/www/html/CFIDE
      ErrorLog logs/stage.companyname.com-error_log
      CustomLog logs/stage.companyname.com-access_log common
      </VirtualHost>


      ---------------------------LOG ON STAGE---------------------------------
      vspider - Verity, Inc. Version K5.5.0 (_ilnx21, Jun 29 2005)
      2007/06/21 04:00:21 Info: [vspider] (ind006000) Message database loaded from [/opt/coldfusionmx7/verity/k2/common/ind.msg].
      2007/06/21 04:00:21 Info: [vspider] (ind006001) License loaded from [/opt/coldfusionmx7/verity/k2/common/runtime.lic].
      2007/06/21 04:00:21 Info: [vspider] (ind005005) Licensed for local spidering.
      2007/06/21 04:00:21 Info: [vspider] (ind005008) Not licensed for remote spidering.
      Progress: [vspider] (ind010020) Vspider summary: Submitted 0 documents for insert, 0 documents for deletion, 0 documents for update;
      Progress: [vspider] (ind010021) Vspider summary: Indexed 0 documents, Deleted 0 documents, 0 bad documents;
      Progress: [vspider] (ind010022) Vspider summary: Skipped 1 keys, including 0 duplicate documents rejected;
      Progress: [vspider] (ind010023) Vspider summary: Failed to fetch 0 keys.
      vspider done

      ---------------------------LOG ON DEV---------------------------------
      vspider - Verity, Inc. Version K5.5.0 (_ilnx21, Jun 29 2005)
      2007/06/21 09:35:27 Info: [vspider] (ind006000) Message database loaded from [/opt/coldfusionmx7/verity/k2/common/ind.msg].
      2007/06/21 09:35:28 Info: [vspider] (ind006001) License loaded from [/opt/coldfusionmx7/verity/k2/common/runtime.lic].
      2007/06/21 09:35:28 Info: [vspider] (ind005005) Licensed for local spidering.
      2007/06/21 09:35:28 Info: [vspider] (ind005008) Not licensed for remote spidering.
      ....
      Entries of page indexing progress like:
      2007/06/21 09:35:29 Progress: [vspider] (ind031000) Inserting [ http://dev.companyname.com/tutorials/index.cfm
      .....

      Progress: [vspider] (ind010020) Vspider summary: Submitted 339 documents for insert, 0 documents for deletion, 0 documents for update;
      Progress: [vspider] (ind010021) Vspider summary: Indexed 291 documents, Deleted 0 documents, 48 bad documents;
      Progress: [vspider] (ind010022) Vspider summary: Skipped 3576 keys, including 22 duplicate documents rejected;
      Progress: [vspider] (ind010023) Vspider summary: Failed to fetch 642 keys.
      vspider done