Bot-throttle

What is Bot-throttle?


1.

regulate the crawl rate of a search engine bot by using a bandwidth throttle on the web-server

We might need to bot-throttle googlebot this month because we're hit the bandwidth limit on our shared server.

See throttle, regulate, control, bot, search, engine


0

Random Words:

1. adj. 1. Crazy. Exhibiting bizarre behavior. 2. Making merit-less arguments or defending ridiculous positions. * Note: center pronou..
1. to defiy gravity - a turd that touches the water in the toilet before departing your ass. i jus did a boss fugal. See boss fugal, shit..
1. When you're not on the internet. "Joey said that he was unternetted last night when he clicked on the wallpaper ad." Se..