Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Oh Mah Fuckin Gee

1. O MY FUCKING GOD or THATS FUCKING AWESOME (Off-The-Hip Headshot) O MAH FUCKIN GEEEEEEE!!!!!!!..

Babe's Bum

1. Female version of the British "Builder's Bum", when a beautiful woman in hipsters crouches forward, accidently/deliberate..

Offing Himself

1. Another way to say something is going to commit suicide/kill themselves. Fred: 'Did you hear Bob is offing himself tonight?' ..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning