Announcement

Collapse
No announcement yet.

Spiders All over my site.

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Spiders All over my site.

    The most users that have ever been on my small community is 11. Last night I noticed a 3 users with almost Identical IP's on the boards, and now there are 19 of them on my site, all almost identical IPs.

    EX:
    IP: xx.xxx.xx.68
    IP: xx.xxx.xx.72
    IP: xx.xxx.xx.87
    (Didnt want to post the whole IP addresse, not sure If thats allowed.)


    Only thing I can think of is that there a bunch of spiders, but Im not sure. Do I block them using apache? Im confused as to what to do.


    -Mike
    www.revo7.com

  • #2
    if its a bot feel free to post the whole IP as that will help us tell you what bot it is.
    Scott MacVicar

    My Blog | Twitter

    Comment


    • #3
      also, the site got linked by another large one yesterday, traffic has jumped up, but since the IPs are nearly the same im wondering.

      Comment


      • #4
        66.196.72.42

        Theres one of them, they are all the same except for the last two numbers.

        Comment


        • #5
          Resolved 66.196.72.42 to j3132.inktomisearch.com

          Check out http://www.vbulletin.com/forum/showthread.php?t=45828 it explains how to use robots.txt to stop your forums being spidered.
          Scott MacVicar

          My Blog | Twitter

          Comment


          • #6
            Thank you!

            Comment

            widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
            Working...
            X