Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

2 By 4

1. A phrase i created that means a girl who is flat on both side(no boobs or ass) and is very skinny. "Woah, Amber is such a 2 by 4.&..

Queet

1. Especially viscous and tangy vaginal fluid produced by females immediately before and during powerful orgams. That bitch got queet all ..

Quigglet

1. Eoghan Quigg's (finalist from the xfactor 2008) groupies. or somebody who is totally in love with eoghan quigg, practically stalkin..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning