Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Zeeky Boogie Doog

1. it is the blow up the world word. ZEEKY BOOGIE DOOG! (Explosion) See Steve..

Ricean

1. Someone who lives in the city of Rice, Minnesota. A redneck stereotype. Hardy har har, let's ride around our ATV's and wave ..

Userface

1. User-Interface The personal Interface one has as a user for the Interface they are using. I like the Userface I get on my phone. See ..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning