Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Quted

1. A sexual act meaning when two men shove fruit up their ass, dance around a little bit, and then eat it while they fuck eachother and cry..

Ford P.o.s.

1. Ford Piece of Shit. From the movie MIB. Jay: Unlimited technology from the whole universe, and we cruise 'round in a Ford P.O.S. ..

Upside Yo Head

1. to bust somebody upside their head - To badly beat somebody. "Shut yo mouth, or ill bust you upside your head!"..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning