Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Zak'd

1. To do something to perfection or to beat someone mercilessly. He really Zak'd you up. See beaten, owned, pwned 2. A way of seri..

Vicko

1. Vicko är en otroligt snäll broder :) Han hjälper gärna till när det behövs och det uppskattas. // Daniel Vicko äger Vicko pwnar Vic..

Yanking It

1. Humping your fist with your flesh harpoon. Marcy walked into her bathroom only to discover David yanking it in front of her sink. See ..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning