Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Inass

1. abbr. form in ass. she could shove that book inass See inass, ass, in the butt, bum..

Jim The Cop'd

1. This phrase came about after a cop named Jim appeared on the TV show Three Sheets and spilled beer all over himself when trying to drink..

Quofola

1. Quofola means a bald man that eats sponges. I just saw a Quofola in the street. He freaked me out. See bald, man, eats, quofola 1. Q..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning