Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Knifeplay

1. The act of running knives across another person's body without actually stabbing, for sexual excitement. My boyfriend tyed me up a..

Xs And Os

1. 1. symbols used to represent sports players on a chart 2. hugs and kisses The Xs and Os looked a bit disorganized to me. See emoticon..

Mijo

1. Conjoined spanish slang of affection. Mi + hijo, "my son." Can be said to any man or boy, usually by an older person. Can also..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning