PassMark Logo
Home » Forum

Announcement

Collapse
No announcement yet.

Crawl ignores stop and start tags

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Crawl ignores stop and start tags

    Love your product!

    We're doing some fine tuning and discovered that some of our "omitted" sections are still being crawled.

    Examining the view source, the tags do exist.

    Is there a "cache" we need to clear?
    Or?

    Thanks.

  • #2
    You can ask Zoom to not use the cache for spidering under "Configure"->"Spider options" and checking the option for "Reload all files (do not use cache)".

    What tags are you using to instruct Zoom to exclude the pages? I presume you mean robots meta tags and "noindex"? Make sure you have "Enable robots.txt support" checked on the abovementioned panel as well for this.

    You can also omit pages by the various options under "Configure"->"Skip options".
    --Ray
    Wrensoft Web Software
    Sydney, Australia
    Zoom Search Engine

    Comment


    • #3
      Thanks for the response.

      We are using Zoom tags:
      <!--ZOOMSTOP-->
      <!--ZOOMRESTART-->

      Yes, "Reload all files (do not use cache)" is checked.

      Here's an example:

      1) Go to our site at: growth trac.com

      2) Search on the word "wickham"

      3) Click on the 2nd result:
      http://www.growth trac.com/artman/publish/audio-adrenaline-867.php

      4) Do a ViewSource and note that all of the "wickham" references
      are enclosed by the stop and restart tags.

      (Many) other pages have the same issue.
      We've double-checked and tried different tag positions, but to no avail.

      Thanks for the assist.
      Jim

      Comment


      • #4
        Here is the FAQ on using ZOOMSTOP and ZOOMRESTART.
        http://www.wrensoft.com/zoom/support....html#zoomstop

        As noted in the FAQ, "You can put <!--ZOOMSTOP--> and <!--ZOOMRESTART--> tags to mark the sections of your page which you do not want to be indexed. Note that both tags must be present as a pair for this to work"

        I had a look at the source code on your page, this is what you have,

        <!--ZOOMSTOP-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        <!--ZOOMRESTART-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        <!--ZOOMSTOP-->
        <!--ZOOMRESTART-->

        So you don't have matching pairs.

        Comment


        • #5
          Yep. Sorry to bother you with this. It must have been a late night.

          Comment

          Working...
          X