Results 1 to 4 of 4

Thread: how do you insert robots.txt
      
   

  1. #1
    travelspec is offline Corporal
    Join Date
    Nov 2007
    Posts
    18

    Default how do you insert robots.txt

    can anyone tell me how to properly insert the robots.txt on my site for the web crawlers



    http://www.travelspecials4you.com

  2. #2
    Bethers's Avatar
    Bethers is offline Major General & Forum Moderator
    Join Date
    Feb 2006
    Posts
    5,232

    Default Re: how do you insert robots.txt

    Right click on the page, go into "Page HTML" and insert the proper coding "between head tag".

  3. #3
    Karen Mac's Avatar
    Karen Mac is offline General
    Join Date
    Apr 2006
    Location
    X marks the spot
    Posts
    8,353

    Default Re: how do you insert robots.txt

    robots.txt.. is a file that you will have to upload to the ROOT of your domain. You can do as Beth suggested above and use a Meta Tag for the basic instruction.

    Karen

    VodaHost

    Your Website People!
    1-302-283-3777 North America / International
    07031847328 / United Kingdom

    ------------------------

    Top 3 Best Sellers

    Web Hosting - Unlimited disk space & bandwidth.

    Reseller Hosting - Start your own web hosting business.

    Search Engine & Directory Submission - 300 directories + (Google,Yahoo,Bing)



  4. #4
    Bethers's Avatar
    Bethers is offline Major General & Forum Moderator
    Join Date
    Feb 2006
    Posts
    5,232

    Default Re: how do you insert robots.txt

    Thanks, Karen - I was just thinking about the meta - not the file!

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

     

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49