Hey All,
In previous versions we had to block out the spiders from the Blog and Calender sections of the vBulletin software. As they would crawl on it for days and not get anywhere.
My question is, has this been fixed in the newest versions?
Can I remove the blocks?
In previous versions we had to block out the spiders from the Blog and Calender sections of the vBulletin software. As they would crawl on it for days and not get anywhere.
My question is, has this been fixed in the newest versions?
User-agent: *
Disallow: /calendar.php
Disallow: /blog.php
Disallow: /calendar.php
Disallow: /blog.php
Comment