Bot-throttle

What is Bot-throttle?

regulate the crawl rate of a search engine bot by using a bandwidth throttle on the web-server

We might need to bot-throttle googlebot this month because we're hit the bandwidth limit on our shared server.

See throttle, regulate, control, bot, search, engine

Ud Wannabe

1. A person that puts information about themselves or somebody they know in hopes of the information getting put on Urban Dictionary. Guy ..

910

1. The general time period before September 11, 2001. 910 nostalgically refers to an era of imagined security, especially while travelli..

Poleshafter

1. One who slides down the male shaft as they would a fire pole. You are my favorite poleshafter. See Sal..

All you need for a faster workflow in one place.

Bot-throttle Edit Meaning