Thread: Robots.txt

What is the robots.txt file? What does it do? Do I need it?

LOL .. don't delete anything if you don't know what it is .. its only a text file .. open it up and see what it is .. maybe its something you installed?

Originally Posted by Jeremy

LOL .. don't delete anything if you don't know what it is .. its only a text file .. open it up and see what it is .. maybe its something you installed?

No, that's not it. I was reading about the robots.txt file on Google, and was wondering if I need it on my site? It's NOT there yet.

You only really NEED it if you want to keep the robots out of certain areas of your site. Like admin areas or ssl areas etc etc, or password protected pages and so on.

Karen

Originally Posted by Jeremy

LOL .. don't delete anything if you don't know what it is .. its only a text file .. open it up and see what it is .. maybe its something you installed?

Looks at Jeremy and wonders if hes been making his own canadian hooch.

Karen

Originally Posted by Karen Mac

Looks at Jeremy and wonders if hes been making his own canadian hooch.

Karen

I keep telling you Karen, Jeremy is NOT "Canadian" lol