Announcement

Collapse
No announcement yet.

The success of the archive hack

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • dpkm
    replied
    Originally posted by SkuZZy
    Just wanted to say, with the newest update, battleforums now has 20k+ pages in google: http://www3.google.com/search?hl=en&...m+battleforums

    As for the vb3 archive, it doesn't work for betting your posts spidered in google. And someone mentioned above that when you switch to vb3, the old links will all be 404's. That can be fixed with a .htaccess that will redirect users to the proper thread. It can be easily done, or could even just make it so your 404 error page goes directly to your home page.

    Edit - Actually, with the latest update, it looks like the vb3 archive does work, somewhat. It isn't exactly "optimized" though... http://www.google.com/search?q=site:...start=120&sa=N - Don't know if google likes it or not.
    Hey, great! 20K pages is really boosting your traffic, I'd bet. I didn't want to rag on your efforts - like I said, I'm eagerly awaiting getting my forums in Google. But, from a usability standpoint, redirecting people to your homepage when they hit a 404 error page is not the greatest. .htaccess will do the trick, but I'm not certain how easy it might be. If everything is logical, for those with the ability to do the .htaccess, it certainly is the way to go while vb3 is in development.

    Lastly, your link to Google - there are two reasons for those URL-only, no-text-indexed results. 1) Google didn't get the chance to index those pages yet, and it will take a few updates to get it in (but it knows the pages are there!) 2) It is prevented from indexing the page via robots.txt, but it still places a pointer to the page since it knows that the link exists.

    As I doubt the archives are being protected by robots.txt, it is more likely that Google will get around to it eventually.

    Leave a comment:


  • SkuZZy
    replied
    Just wanted to say, with the newest update, battleforums now has 20k+ pages in google: http://www3.google.com/search?hl=en&...m+battleforums

    As for the vb3 archive, it doesn't work for betting your posts spidered in google. And someone mentioned above that when you switch to vb3, the old links will all be 404's. That can be fixed with a .htaccess that will redirect users to the proper thread. It can be easily done, or could even just make it so your 404 error page goes directly to your home page.

    Edit - Actually, with the latest update, it looks like the vb3 archive does work, somewhat. It isn't exactly "optimized" though... http://www.google.com/search?q=site:...start=120&sa=N - Don't know if google likes it or not.

    Leave a comment:


  • dpkm
    replied
    Originally posted by Dave#
    Why would anyone get 404's?

    The syntax of the url remains the same:

    http://www.vbulletin.com/forum/showt...threadid=67798

    So the pages generated by either the hack or VB archive will point to the correct content?

    Or am I missing something?
    Hmm.. well, unless I am missing something (and it's possible!) both the hack and vB3 archive generate search engine friendly pages and links that only exist when a request is made (that is, they do not exist as separate files on the web server), and those SE-friendly pages and links are different than the actual URL.

    e.g., the true URL : http://www.vbulletin.com/forum/showt...threadid=67798

    and the generated URL:
    http://www.vbulletin.com/forum/archi...ex.php/t-67798

    It is the generated URL that gets indexed by the search engine, and if you create a suite of generated URLs with the hack, you will need to ensure that your generated URLs are exactly the same when you implement vB3 (and it is certainly possible, but I think it will require some work). If you use the hack and then switch to vB3 and its archive with different URLs, then the hack URLs will return 404s to your visitors from search engines (until the search engines reindex everything and drop the old 404s which can take some time in some cases).
    Last edited by dpkm; Wed 26th Mar '03, 9:30pm.

    Leave a comment:


  • Dave#
    replied
    Why would anyone get 404's?

    The syntax of the url remains the same:

    http://www.vbulletin.com/forum/showt...threadid=67798

    So the pages generated by either the hack or VB archive will point to the correct content?

    Or am I missing something?

    Leave a comment:


  • Overgrow
    replied
    Good points, dpkm. On the first digest, Google picked up my chat forums and now I hit top 5 for phrases like "christina agulera naked" and "gta vice city hidden packages" ... I have these forums blocked from the archive now and show those incoming visitors a "no permission" sign (with banners of course).

    Leave a comment:


  • dpkm
    replied
    Optima, no need to install this hack with vB3 - vB3 comes with an archive (see bottom of the page).

    I checked out the script, and it looks great - but I thought I should remind everyone that as easy as this script makes it to get your forums spidered by Google, you should also consider how difficult it is to get the old URLs _out_ of Google if/when you switch to vB3 and move to the vB3 archiving system.

    Potentially, you could have thousands of search engine results pointing to your site, all pointing to 404s - and 404s can stick around a few Google update cycles. A 301 permanent redirect (as Google recommends to get old pages out of the index in the first go-round) for the whole archive directory will force your site visitors to go through extra steps to find what they were looking for, and may put people off. It would all be sorted out by Google eventually, but at what cost?

    I don't want to diminish what's been done - I just thought people should consider the above.
    Last edited by dpkm; Tue 25th Mar '03, 8:38pm.

    Leave a comment:


  • 0ptima
    replied
    Before VB, I used WWWBoard and Anyboard which created static html files which I have kept as archives. I have about 2 years worth of archives and Google has indexed 16,900 pages! Certain search phrases list my site near the top in Google and they are not directly related to my site (One particular phrase lists my site above the manufacturers website!)

    Once VB3 comes out, I will install this hack if it is available.

    Leave a comment:


  • SkuZZy
    replied
    Originally posted by IDN
    Made me run there for nothing, bad boy!
    sowwie

    Leave a comment:


  • Overgrow
    replied
    It can take over a month to get into Google. If you have an incoming link from a site that's marked "Fresh" (a date next to their result), then they are spidered every 2 or 3 days, and there is a chance that your site will get slurped up by the FreshBot as well. It's much more normal for the delay to be 3 to 6 weeks as the DeepCrawlers find you and add you to the real database.

    I've got over 50,000 Google page listings now.. Since this thread is full of horns and blowing, here is a little article I wrote about converting all of those SERP visitors into forum members:

    http://www.vbulletin.org/forum/showt...threadid=49721

    Check out my archive for an example of what I think is a good listing that should draw the searchers into the rest of the site. If your archive doesn't do that, what good is it right? Also, it's got lots of good internal links to boost my PR.

    http://www.overgrow.com/edge/showthread/t-252308.html

    Thanks for the hack skuzzy! I wrote vBSpiderFriend, which I don't use anymore, and I'm not using yours, but they all do basically the same thing.. it's the end-user's design that makes the difference.

    Leave a comment:


  • IDN
    replied
    Made me run there for nothing, bad boy!

    Leave a comment:


  • SkuZZy
    replied
    Originally posted by IDN
    For some reason, the archive hack is the same as the old version, you didn't updated it really, did you?
    The final version was released, I believe, about 2 weeks ago. I just never got around to letting everyone here know.

    Leave a comment:


  • bromyaur
    replied
    I installed the archive about a month ago (middle of february), I always have about 30 to 90 bots on my forum everyday, still waiting to see the results on google....hopefully soon.

    Leave a comment:


  • IDN
    replied
    For some reason, the archive hack is the same as the old version, you didn't updated it really, did you?

    Leave a comment:


  • ManagerJosh
    replied
    Takes about one week for google to add your site.

    Leave a comment:


  • IDN
    replied
    I added it to my sex forum, so i should get major hits from perverts, which has the good and the bad...

    Submitted my forum to the engines the day i opened my site, google started to spider on saturday, and i'm still not listed in google

    Leave a comment:

widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
Working...
X