+ Reply to Thread
Results 1 to 6 of 6

Thread: robot txt file
      
   

  1. #1
    karenwms63's Avatar
    karenwms63 is offline Colonel
    Join Date
    Feb 2008
    Location
    Poplar Bluff, MO
    Posts
    865

    Red face robot txt file

    Help me, please.

    My partner's site is exclusively for family members (reunion info, photos, etc.) and she does not want it indexed by any SEs. I have used the meta tags on each page for noindex nofollow but this site is going to become rather large once the families send their stuff in and will have pages for each. How exactly do I do a robots.txt file for just the one domain name?

    Step by step...pretty please. :) I have the code:

    User-agent: *
    Disallow: /

    BUT I don't know what to do with it!

    I have read nearly every thread with the search terms "user-agent" and "robots.txt" and they say to upload to root directory(????). How do I make it and how do I upload it? Do I use BV builder or what? Help, please.

    Thank you,
    Karen Williams
    Your Belief is Your Reality

  2. #2
    Bethers's Avatar
    Bethers is offline Major General & Forum Moderator
    Join Date
    Feb 2006
    Posts
    5,232

    Default Re: Help...reunion site...noindex....please....lost!

    Karen,
    Someone else can help with that - BUT - you'll still need the nofollow on every page - as if anyone links to one of your pages (a friend/family member, etc) the se's will follow that link to the specific page - So, the site is GOING to be indexed no matter what unless there is never ever anywhere a link to it.

    You might want to consider a landing page (index page) and making the rest of the site password protected - then they have to come in through the home page and enter their password to get to the rest.

    If you really don't want it online, it's the best option.

  3. #3
    Marincky's Avatar
    Marincky is offline General
    Join Date
    Apr 2006
    Location
    Warwickshire, UK
    Posts
    4,565

    Default Re: Help...reunion site...noindex....please....lost!

    To back up on what Beth says above.. Sites will link to you without your say-so, directories, search engines, WILL pick you up somehow, and once one has you, others will follow... So as Beth says, unless you put a 'nofollow' on every page, you are quite likely to get indexed at some point.

    I must agree with Beth though that Password protecting your site after visitors come to your index page, is probably going to be your best bet.
    Don't aim for success if you want it; just do what you love and believe in, and it will come naturally.

  4. #4
    Marincky's Avatar
    Marincky is offline General
    Join Date
    Apr 2006
    Location
    Warwickshire, UK
    Posts
    4,565

    Default Re: Help...reunion site...noindex....please....lost!

    I just noticed you had a robots.txt question too sorry..

    This is easy, just creat a file using notepad and call it robots.txt. Then enter the code you want to tell the SE's by placing that within this notepad.

    Then just upload to your directory folder:

    If the domain is the main account domain, then just upload it to the public_html folder.

    If it is an addon domain, then add it to the addon domain folder within the public_html folder.

    You can do this in a couple of ways,

    My preferred method is to upload via FTP manager.

    BV Web builder > Tools > FTP Manager

    Log-in using your account details.

    On the LH side will be your PC files, on the RH side will be the Server

    Just find the file on the LH side, and make sure the RH window is open in the folder you want to place the file in and then just drag it over.

    Done
    Don't aim for success if you want it; just do what you love and believe in, and it will come naturally.

  5. #5
    karenwms63's Avatar
    karenwms63 is offline Colonel
    Join Date
    Feb 2008
    Location
    Poplar Bluff, MO
    Posts
    865

    Thumbs up Re: robot txt file

    Thank you so much Bethers and Ramsey. You guys are the greatest! Now I've got some more serious reading and learning to do, lol. Password protect sounds like the thing for me to do. And you pointed out what I had not considered--relatives send relatives links, lol. Thanks a bunch for the step by step, Ramsey, I really needed the part about the note pad. Thank you.
    Karen Williams
    Your Belief is Your Reality

  6. #6
    Marincky's Avatar
    Marincky is offline General
    Join Date
    Apr 2006
    Location
    Warwickshire, UK
    Posts
    4,565

    Default Re: robot txt file

    You are more than welcome Karen.
    Don't aim for success if you want it; just do what you love and believe in, and it will come naturally.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

     

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49