Bot-throttle

What is Bot-throttle?


1.

regulate the crawl rate of a search engine bot by using a bandwidth throttle on the web-server

We might need to bot-throttle googlebot this month because we're hit the bandwidth limit on our shared server.

See throttle, regulate, control, bot, search, engine


48

Random Words:

1. a slang term more oftenly used to create a sense of definition in a sentence. Derived from the Rastafarian term for God, Ja, it has the ..
1. adjective, noun. see also booty, wack, stankand tore up -adjective 1. an offensive or embarassing behavior 2. something that is terr..
1. An insult that can be widely used. Often used to signify someone's stupidity. Norm: "So what are we doing today dude?" ..