Bot-throttle

What is Bot-throttle?


1.

regulate the crawl rate of a search engine bot by using a bandwidth throttle on the web-server

We might need to bot-throttle googlebot this month because we're hit the bandwidth limit on our shared server.

See throttle, regulate, control, bot, search, engine


37

Random Words:

1. 3MG's stands for "3 Melancholy Gypsys". This little underground rap crew consists of Murs, Eligh and Scarub. Them three M..
1. The acronym for World of Worldcraft, a MMORPG created by Blizzard More like, W.O.W I paid for this crap?.. See wow, w.o.w, blizzard, m..
1. A wanna be brown who is actually persian white. Stop to get a tan you Yahya Naqvi 2. someone really cool Did you see TMac's dun..
Book Banner