Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Vegan Thugs

1. any vegan who uses itimidation or any type of strong-arm tatics to use for thier cause. Those vegan thugs from peta are scaring away my..

Zeniox

1. Zeniox also known as (zeeniox) in some occasions, is the one and the only tommy lee anderson jr.s' screen name for just about every..

Que Onda Guero

1. Spanish for "What's up, whitey?!" Que Onda Guero is a song by Beck. See guero, beck, spanish, whitey, what's up? ..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning