Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Upslice

1. Slang for female genitalia, especially the vaginal area. "She had the juiciest upslice I have ever stuck my tongue into". Se..

Oxycontin Boy

1. Another name for Rush Limbaugh. Has the amazing power to talk out of both sides of his mouth while shoving oxycontin pills in at the sam..

Vurtpunk

1. This is a sperm drinking man whore. e.g. I had some fun with a vurtpunk last night See sperm, richard, jon, punk, sex..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning