Do Not Sell My Personal Information Jump to content
Ad: Genuine Lexus parts & accessories from the Lexus official store on eBay ×


  • Join The Club

    Join the Lexus Owners Club and be part of the Community. It's FREE!

     

Guests On Line

Scorpion

By Scorpion
in Lexus Owners Club Lounge

 Share

Recommended Posts


Nick The Greek Mentor

Nick The Greek

Posted
Posted
Probably bots.....

I've always got 20-30 yahoo slurp/googlebots floating around.

Remember one time Yahoo flooded us, had about 500 of them online indexing!

theres a bunch of bots on - but loads are real people - I can tell the difference ;)

do you find that they increase your server load? (the bots that is)

My server load has been creeping up recently, and I'm trying to figure out where and why.

I'm going to block all bots shortly for a while as an experiment. :ph34r:

Link to comment
Share on other sites
Matthew_McNally Grand Master

Matthew_McNally

Posted
Posted
do you find that they increase your server load? (the bots that is)

My server load has been creeping up recently, and I'm trying to figure out where and why.

I'm going to block all bots shortly for a while as an experiment.  :ph34r:

of course they do - they request pages that have to be served up by the database and webserver :duh:

Link to comment
Share on other sites
Nick The Greek Mentor

Nick The Greek

Posted
Posted
do you find that they increase your server load? (the bots that is)

My server load has been creeping up recently, and I'm trying to figure out where and why.

I'm going to block all bots shortly for a while as an experiment.  :ph34r:

of course they do - they request pages that have to be served up by the database and webserver :duh:

Well I dont know how it works on here as I dont use Invision, but when they visit me, they open a page and sit there until they time out. They dont go requesting lots of different pages, maybe it's the differences in the software causing it.

I dont think bots are the cause of my rising server load, but i'm going to block them to see what kind (if any) load they are imposing.

Link to comment
Share on other sites
Matthew_McNally Grand Master

Matthew_McNally

Posted
Posted
Well I dont know how it works on here as I dont use Invision, but when they visit me, they open a page and sit there until they time out. They dont go requesting lots of different pages, maybe it's the differences in the software causing it.

I dont think bots are the cause of my rising server load, but i'm going to block them to see what kind (if any) load they are imposing.

how do you know they time out?

Link to comment
Share on other sites
Matthew_McNally Grand Master

Matthew_McNally

Posted
Posted

just had a look at your forums, and the URL's are horrific.

spiders are getting more advanced - but they are not gonna follow many of those links.

you can use mod_rewrite to fix this.

infopop do offer / support it, as I am a member of infopops largest beta test forum, and their URL's are very SE friendly (thanks to mod_rewrite rules) and heavily spidered

Link to comment
Share on other sites
Nick The Greek Mentor

Nick The Greek

Posted
Posted
just had a look at your forums, and the URL's are horrific.

spiders are getting more advanced - but they are not gonna follow many of those links.

you can use mod_rewrite to fix this.

infopop do offer / support it, as I am a member of infopops largest beta test forum, and their URL's are very SE friendly (thanks to mod_rewrite rules) and heavily spidered

The reason the urls's look horrific is I turned off the spider friendly url's a few days ago, to see if it makes any difference and to see how far the spiders can get into ubbthreads. It makes a bit of difference, all they can access now is just a list of threads, they cant index the posts themselves.

Lol, in fact, looking at the stats (http://www.fordmondeo.org/wowwypopch/) it's actually increased the amount of pageviews by robots. :hehe:

As for knowing they time out, It says on the whos online.

eg:

68.142.251.16 Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 12/03/05 03:15 PM Viewing a list of posts

Electrical and Entertainment

That bot has been viewing that for the past 25 minutes.

side note - are you involved in the betas of infopops up and coming new software?

and sorry to everyone for going :offtopic::blush:

Link to comment
Share on other sites

Latest Deals

Lexus Official Store for genuine Lexus parts & accessories

Disclaimer: As the club is an eBay Partner, The club may be compensated if you make a purchase via eBay links

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
 Share
Go to topic listing






Lexus Owners Club Powered by Invision Community


eBay Disclosure: As the club is an eBay Partner, the club may earn commision if you make a purchase via the clubs eBay links.

DISCLAIMER: Lexusownersclub.co.uk is an independent Lexus forum for owners of Lexus vehicles. The club is not part of Lexus UK nor affiliated with or endorsed by Lexus UK in any way. The material contained in the forums is submitted by the general public and is NOT endorsed by Lexus Owners Club, ACI LTD, Lexus UK or Toyota Motor Corporation. The official Lexus website can be found at http://www.lexus.co.uk
×
  • Create New...