Bot-throttle

What is Bot-throttle?


1.

regulate the crawl rate of a search engine bot by using a bandwidth throttle on the web-server

We might need to bot-throttle googlebot this month because we're hit the bandwidth limit on our shared server.

See throttle, regulate, control, bot, search, engine


48

Random Words:

1. a phrase used to insult ones mother often used as a retort when a whitty come back is not available. often used between chavs.(note: dos..
1. 1. Misetinger who can't spell and can often be a real jackass, but is sometimes cool. Your spelling is almost as bad as badguy&apo..
1. A feeling of crazyness and extacy ushaly the result of being stupid with a friend. that dude is crazy he must be yped See excited, hig..