Announcement

Collapse
No announcement yet.

Google dance and lots 'o spiders!

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Google dance and lots 'o spiders!

    Looks like googe is dancing. I hope i get my deep crawl indexed, but dont see any signs of it just yet...

    I also noticed i have had deep crawl spiders from teoma, looksmart, and inktomi on my forum for the last 72+ hrs. My logs show they have picked up some 40,000 pages combined, woohoo!

    Has anyone else noticed that alot of spiders are deep crawling as of late? This is my first deep crawl in over a year... Its about time they came back!
    Bike Forums.net

  • #2
    Yep, same here.

    I had google yesterday, looksmart today.

    And they keep coming back, heh

    Comment


    • #3
      I should post more often. I just checked my whos online, and see that the AV spider is there... drone6.sv.av.com
      Bike Forums.net

      Comment


      • #4
        Me to

        Had all of the above at my forum, and now google is doing its deep crawl.

        Not sure if it will have any great results in membership(people that post and not the people that register and never come back for some strange reason lol)

        I may be changing the format, if it dosen't pick up. Already have the new URL
        PLEASE VISIT US HERE. THANKS IN ADVANCE

        Comment


        • #5
          Google ususaly does a deepcrawl days after the dance. I removed sessionhash for spiders last night., I hope google can pick up ALL my threads... sure would be nice
          Bike Forums.net

          Comment


          • #6
            Thought I should mention that Google is successfully crawling the vbulletin3 Archive on vbulletin.com. Some people had some concerns that Google wouldn't successfully crawl the archives.

            Comment


            • #7
              some have reported that this session crawl is reported with spammers and the porn problem... just a note... I have the same at my boards and it seems kinda strange.. I tuned resolve ips off for now and banned he ips.. just for safety sakes.

              mark.

              Comment


              • #8
                Googlebot swarmed my sites yesterday and today. It does that every month or two with this intensity.
                --filburt1, vBulletin.org/vBulletinTemplates.com moderator
                Web Design Forums.net: vB Board of the Month
                vBulletin Mail System (vBMS): webmail for your forum users

                Comment


                • #9
                  Originally posted by dpkm
                  Thought I should mention that Google is successfully crawling the vbulletin3 Archive on vbulletin.com. Some people had some concerns that Google wouldn't successfully crawl the archives.
                  You sure?
                  I only get 3 archive links.
                  www.vbulletin.com/forum/archive/index.php/f-20
                  www.vbulletin.com/forum/archive/index.php/f-28
                  http://www.vbulletin.com/forum/archi...ex.php/t-49924
                  You're my Prince of Peace
                  And I will live my life for You

                  Comment


                  • #10
                    I agree with Nuno.....it seems a bit...small on the side..
                    ManagerJosh, Owner of 4 XenForo Licenses, 1 vBulletin Legacy License, 1 Internet Brands Suite License
                    Director, WorldSims.org | Gaming Hosting Administrator, SimGames.net, Urban Online Entertainment

                    Comment


                    • #11
                      Heh, google must be dancing.. My admin control panel for my hosting has a page rank of 9/10.
                      "63,000 bugs in the code, 63,000 bugs, you get 1 whacked with a service pack, now there's 63,005 bugs in the code."
                      "Before you critisize someone, walk a mile in their shoes. That way, when you critisize them, you're a mile away and you have their shoes."
                      Utopia Software - Current Software: Utopia News Pro (news management system)

                      Comment


                      • #12
                        how are you obtaining this information? What logs are you talking about?

                        Comment


                        • #13
                          anybody got any love for me on this one? ^

                          Comment


                          • #14
                            I use "Analog", or sometimes, i'll download the raw scripts via ftp, and do a search for "googlebot". I'm sure there are more ways to do so, I only looked after seeing some 20+ bots on my whosonline for the last week

                            Freshbot from google hit my forums last night, i hope they deepcrawl SOON. I want to get all my new dynamic content there. i finaly removed sessionhash, cant wait for next update!!
                            Bike Forums.net

                            Comment

                            widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
                            Working...
                            X