Announcement

Collapse
No announcement yet.

Blocking search engine crawlers from certain pages (htaccess)

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Blocking search engine crawlers from certain pages (htaccess)

    Does anyone have an htaccess where they've already blocked Google, Bing, etc. from crawling certain pages on their site?
    • Profiles
    • Signature invisible for guests/google bot
    • Print pages
    • Stats
    • Help
    • Attach
    • Subscribe
    • Search


    These would also need to be removed from the sitemaps.

    Any thoughts?

  • #2
    You would want to use a robots.txt file.
    https://support.google.com/webmaster.../6062596?hl=en
    https://support.google.com/webmaster.../6062608?hl=en

    All proper search engines will follow this.

    We do not provide one by default as each site is different and the file must reside in the root directory of the web site. vBulletin is often installed in places other than the root directory.
    Translations provided by Google.

    Wayne Luke
    The Rabid Badger - a vBulletin Cloud demonstration site.
    vBulletin 5 API

    Comment

    Related Topics

    Collapse

    Working...
    X