Thread: Help with meta tags ?

How to stop google from crawling our website "sawgrassvillage.net" using meta tags? The site is for a group of members. I had to use Google tools to remove some of the data that they had posted oin the web. I know this is the reverse of normal but I had some unhappy members. I could use help with (where,how,&what) meta tags. I've never used them before.

Thanks
Nora

How do I use a robots.txt file to control access to my site?

A robots.txt file provides restrictions to search engine robots (known as "bots") that crawl the web. These bots are automated, and before they access pages of a site, they check to see if a robots.txt file exists that prevents them from accessing certain pages.

You need a robots.txt file only if your site includes content that you don't want search engines to index.

create the above file in notepad or similar
and enter:

User-agent: Googlebot
Disallow: /

Then UPLOAD the file to your website.

.................................................. ...................


For any other member................
If you want search engines to index everything in your site, you don't need a robots.txt file (not even an empty one)

Thanks bunch.
Where do I upload the file to ? (public, index, ??)

Nora

Hi Nora

Just upload it to your public_html (main) directory..........................

Thanks, I've done that and then I tried the Google robot analyzer but when I went to the dashboard, put my url for "sawgrassvillage.net" but could not find the right button to have my site analyzed rebot.
Is there a way to check to make sure I put the right file into the right place.????
Nora

use your bv ftp program or the file manager inyour cpanel and look for the robots.txt file..............if you havnt used the ftp program, view the video tutorial or click here:

I am slowly getting it.
Do I need to load my pages into the bots file including the the password protected pages or just load them as usual??
I tried out the meta tag analyzer on the general's page and found it very interesting.
Nora

Hi Nora..............the Generals name is David....................lol

Once you have uploaded the robots.txt file to your public.html directory/folder then you do not have to do anything else.

(publish your pages as normal)

When google bot comes a calling, it should read the robot.txt file first, and then leave straight away...................

Thanks General David and the whole bv community for all the help along the way.
One last question: does User-agent:* stop all spiders?

Nora (That's your a General & I'm just a Sergeant) Life is good