Announcement

Collapse
No announcement yet.

inktomisearch.com

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • inktomisearch.com

    What do I have to do to stop them from searching through my board, was told to alter the robot txt but have no idea how to do it can anyone help?

    Many thanks

  • #2
    What is that? We had like 30 guests from there on our site :-S

    Comment


    • #3
      Hello,

      on vbulletin-germany.com, there was
      the same topic at the moment, and they
      posted the following description :

      http://www.kloth.net/internet/bottrap

      I hope, that is the information u requested

      C u
      thorsten

      Comment


      • #4
        Originally posted by skytho
        Hello,

        on vbulletin-germany.com, there was
        the same topic at the moment, and they
        posted the following description :

        http://www.kloth.net/internet/bottrap

        I hope, that is the information u requested

        C u
        thorsten

        Getting to the point now where I will just have to close the board down, the cost at the end of the month would just be too high.

        Does anyone know of a service people offer where I could pay them to stop them coming on my board, sadly not clever enough to do the above. thank u

        Comment


        • #5
          Just make a .htaccess file to deny their hosts. They might show up on the whois online, but they won't get far nor make any data traffic by it.

          Comment


          • #6
            Feel free to forward all inktomi bot's to my site, when Yahoo goes to Yatomi this fall you will be kicking yourself from letting them spider your site.
            Bike Forums.net

            Comment


            • #7
              Originally posted by shoppingtelly
              Getting to the point now where I will just have to close the board down, the cost at the end of the month would just be too high.

              Does anyone know of a service people offer where I could pay them to stop them coming on my board, sadly not clever enough to do the above. thank u
              It's really quite simple to stop. Just put a text file in your html root called robots.txt and put in it...
              Code:
              User-agent: *
              Disallow: /
              But if you do don't expect your site to to be listed on search engines.

              Comment


              • #8
                Originally posted by Zenith
                It's really quite simple to stop. Just put a text file in your html root called robots.txt and put in it...
                Code:
                User-agent: *
                Disallow: /
                But if you do don't expect your site to to be listed on search engines.

                How long do they stay on the board? not so bad if it's just a couple of days.

                Thnak You

                Comment


                • #9
                  Shouldn't you be happy that those robots are on your site making it popular? I would be more than happy to know HOW to get them on my site forever.

                  Comment


                  • #10
                    Originally posted by Novadream
                    Shouldn't you be happy that those robots are on your site making it popular? I would be more than happy to know HOW to get them on my site forever.
                    I have gone over my Bandwidth already as the site is mentioned on TV everyday and in the end you have to think is it worth the extra expense every month and even worse not knowing how much it is going to be.

                    Comment


                    • #11
                      Originally posted by shoppingtelly
                      I have gone over my Bandwidth already as the site is mentioned on TV everyday and in the end you have to think is it worth the extra expense every month and even worse not knowing how much it is going to be.
                      You cant afford the bandwidth for 30 users on your site which would be a few pennies at the most....But you have no problem spending real cash advertising on TV?

                      None of that makes sense...

                      Comment


                      • #12
                        Originally posted by Novadream
                        You cant afford the bandwidth for 30 users on your site which would be a few pennies at the most....But you have no problem spending real cash advertising on TV?

                        None of that makes sense...
                        No it's just a small Fan site, it just hets mentioned each week on Telly, the if they continue all month then it would be loads more to pay out thats all.

                        Anyway I will leave it there thanks to eveyone who helped.

                        Comment


                        • #13
                          well inktomisearch.com has been crawling my site for over a week.

                          Luckily, They haven't caused any bandwith issues (yet)

                          I was about to ask if anyone knew what this bot was ... I know most of them, and this one didn't sound too familiar..

                          thanks
                          -

                          Comment


                          • #14
                            shoppingtelly -

                            I believe that this is the information you're looking for.

                            Comment


                            • #15
                              Originally posted by I, Brian
                              shoppingtelly -

                              I believe that this is the information you're looking for.
                              I've created a robots.txt file, but inktomi is still trying to use the files I've blocked. Here is my robots.txt file:

                              User-agent: *
                              Disallow: /vbulletin/attachment.php
                              Disallow: /vbulletin/avatar.php
                              Disallow: /vbulletin/calendar.php
                              Disallow: /vbulletin/editpost.php
                              Disallow: /vbulletin/member.php
                              Disallow: /vbulletin/member2.php
                              Disallow: /vbulletin/memberlist.php
                              Disallow: /vbulletin/misc.php
                              Disallow: /vbulletin/moderator.php
                              Disallow: /vbulletin/newreply.php
                              Disallow: /vbulletin/newthread.php
                              Disallow: /vbulletin/online.php
                              Disallow: /vbulletin/poll.php
                              Disallow: /vbulletin/postings.php
                              Disallow: /vbulletin/printthread.php
                              Disallow: /vbulletin/private.php
                              Disallow: /vbulletin/private2.php
                              Disallow: /vbulletin/register.php
                              Disallow: /vbulletin/report.php
                              Disallow: /vbulletin/search.php
                              Disallow: /vbulletin/sendtofriend.php
                              Disallow: /vbulletin/threadrate.php
                              Disallow: /vbulletin/usercp.php
                              Disallow: /vbulletin/admin/
                              Disallow: /vbulletin/images/
                              Disallow: /vbulletin/mod/


                              GuestViewing Profile of a Forum Member08:57 AM 66.196.72.61GuestEditing Post08:56 AM 66.196.72.43GuestViewing FAQ08:49 AM 66.196.72.48GuestViewing Calendar day 2003-7-2308:48 AM 66.196.72.92GuestViewing Memberlist08:47 AM 66.196.72.62GuestViewing Thread in-vivo/in-vitro correlation08:57 AM 134.2.68.160GuestQuoting Post in Thread Dissolution Calculations08:56 AM 66.196.72.85GuestViewing Profile of a Forum Member08:56 AM 66.196.72.52GuestReporting a Post08:49 AM 66.196.72.41GuestReplying to Thread Dissolution Calculations


                              ?????

                              Comment

                              widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
                              Working...
                              X