Results 1 to 19 of 19

Thread: robots.txt
      
   

  1. #1
    vinny1957's Avatar
    vinny1957 is offline Members
    Join Date
    May 2005
    Location
    Littleton, Colorado
    Posts
    134

    Default robots.txt

    Now that my site is up, I'm looking to promote it and I ran up on robots.txt. I've looked at it and it helps or directs search engine spiders when they crawl your site. Now, my question is, does this have to be put in manually, or does BV put it in automaticly? If I do, next step is how and what to include?
    Thanks all.
    Vinny

  2. #2
    Steven.H is offline Lieutenant Colonel
    Join Date
    Jul 2005
    Posts
    500

    Default

    One of the best ways to promote your site is to be sure you have good metatags. After you have those established, there are also many programs, such as exitexchange, which help you get more traffic.

    I am not too familiar with robots.txt, but I have read somewhere that it can actually prevent robots from entering your website. I will have to look further into it.

    I will get back to you about it.
    ::Steven.H::

  3. #3
    vinny1957's Avatar
    vinny1957 is offline Members
    Join Date
    May 2005
    Location
    Littleton, Colorado
    Posts
    134

    Default

    Thanks a lot Steven, I happened accross this and was confused.

  4. #4
    Stroke.nz's Avatar
    Stroke.nz is offline The Man
    Join Date
    May 2005
    Location
    New Zealand
    Posts
    188

    Default

    Hi Vinny

    Here is an Interesting site I was looking at http://www.websight.net.au/search-en...r-friendly.asp

  5. #5
    vinny1957's Avatar
    vinny1957 is offline Members
    Join Date
    May 2005
    Location
    Littleton, Colorado
    Posts
    134

    Default

    Thanks a lot it is a good site for reference.

  6. #6
    pet121 is offline webmaster
    Join Date
    May 2005
    Location
    The High Hills
    Posts
    257

    Cool robot text

    I am learning every day about page rank ect... I will share with something with this forum I may be right or I may be wrong. I belong to many forums. this one forum and its members were pretty angry at this one site that was basically giving them a hard time. Anyway within a week there comments were posted on google and yahoo in the number two position right under the company they were angry with. The company ranked number 1 in there catagory the forums comments number 2. How did they get such a fast page rank? I think it was because of the robot txt inserted into their source code. In fact about 80% of pages that rank high seem to have robot txt. take a look. This is something i am still investingating. pet121

  7. #7
    vinny1957's Avatar
    vinny1957 is offline Members
    Join Date
    May 2005
    Location
    Littleton, Colorado
    Posts
    134

    Default

    Thanks a lot, I'll take a look. The more I look into this the more questions a have. But there's something to it.
    Vinny

  8. #8
    Stroke.nz's Avatar
    Stroke.nz is offline The Man
    Join Date
    May 2005
    Location
    New Zealand
    Posts
    188

    Default

    Add this to your meta

    <meta name="ROBOTS" content="INDEX,FOLLOW">

  9. #9
    vinny1957's Avatar
    vinny1957 is offline Members
    Join Date
    May 2005
    Location
    Littleton, Colorado
    Posts
    134

    Default

    Thanks Dave, I'll do it today.

  10. #10
    Maddog's Avatar
    Maddog is offline Lieutenant Colonel
    Join Date
    May 2005
    Location
    UK
    Posts
    514

    Default

    Quote Originally Posted by Stroke.nz
    Add this to your meta

    <meta name="ROBOTS" content="INDEX,FOLLOW">
    vinny make sure you place the above meta tag in each page
    www.bluevodaexchangelink.com
    BluevodaExchangeLink Help Center
    Bluevodaexchangelink Forum

    The only place for bluevoda site to be linked with!

  11. #11
    vinny1957's Avatar
    vinny1957 is offline Members
    Join Date
    May 2005
    Location
    Littleton, Colorado
    Posts
    134

    Default

    Quote Originally Posted by Maddog
    vinny make sure you place the above meta tag in each page
    Thanks Maddog, wiil do!

  12. #12
    vinny1957's Avatar
    vinny1957 is offline Members
    Join Date
    May 2005
    Location
    Littleton, Colorado
    Posts
    134

    Default

    Just thought of something - duh! I don't have any meta tags set up for my link page. Should I? It just links from my home page.

  13. #13
    rdarko's Avatar
    rdarko is offline First Lieutenant
    Join Date
    Jul 2005
    Location
    UK
    Posts
    172

    Smile

    Another way that worked for me is to put as many links to popular sites on your website and do lots of link exchanges with popular sites. As with Google...it sometimes comes across a new website via websites already in its indexes.

    Meta tags are good.

    Robots.txt prevent google adsense and other things from working properly.

    Just make sure you've submitted your site to as many search engines and that you've used Keyword Digger in BV to create your meta tags and you should be fine in a couple of weeks or so.

    Good luck!
    Ruth

    http://www.okose.com
    Professional Web design/development and Graphic Design

  14. #14
    vinny1957's Avatar
    vinny1957 is offline Members
    Join Date
    May 2005
    Location
    Littleton, Colorado
    Posts
    134

    Default

    Quote Originally Posted by rdarko
    Another way that worked for me is to put as many links to popular sites on your website and do lots of link exchanges with popular sites. As with Google...it sometimes comes across a new website via websites already in its indexes.

    Meta tags are good.

    Robots.txt prevent google adsense and other things from working properly.

    Just make sure you've submitted your site to as many search engines and that you've used Keyword Digger in BV to create your meta tags and you should be fine in a couple of weeks or so.

    Good luck!
    Thanks all!

  15. #15
    pet121 is offline webmaster
    Join Date
    May 2005
    Location
    The High Hills
    Posts
    257

    Thumbs up my advice

    Robot text is useful and has no bearing on googlebots. Googlebots search for content and are very slow. As for keywords use the keywords from your content page. Because your keyword must be in your content. If it is not you are penalized for it. Most important be honest with your website content and be sure it is relevant to your tiltle. I am no expert pet121

  16. #16
    Maddog's Avatar
    Maddog is offline Lieutenant Colonel
    Join Date
    May 2005
    Location
    UK
    Posts
    514

    Default

    Just to add more for you all some look for urlist.tx, this a list of all your pages.

    What you have to remeber it can take upto 2 months for your site to be shown in some serach engines, there is not 100% way of doing things other than using a service like VH offer
    www.bluevodaexchangelink.com
    BluevodaExchangeLink Help Center
    Bluevodaexchangelink Forum

    The only place for bluevoda site to be linked with!

  17. #17
    pet121 is offline webmaster
    Join Date
    May 2005
    Location
    The High Hills
    Posts
    257

    Thumbs up Maddog

    A friendly disagreement here, I agree a program like vh (voda hits a seo program)is likely a excellent product. I have had no opportunity to try it out so I can't really comment on it. But to get listed on major search engines without useing VH is just plain false. I am no expert, pet121

  18. #18
    Maddog's Avatar
    Maddog is offline Lieutenant Colonel
    Join Date
    May 2005
    Location
    UK
    Posts
    514

    Default

    bottom line people is to do all of the above, there is no set rules, some search look for sitemaps, robot.txt, urlist.txt and xml file!

    None of the above can hurt your listing!
    www.bluevodaexchangelink.com
    BluevodaExchangeLink Help Center
    Bluevodaexchangelink Forum

    The only place for bluevoda site to be linked with!

  19. #19
    pet121 is offline webmaster
    Join Date
    May 2005
    Location
    The High Hills
    Posts
    257

    Thumbs up maddog

    I agree and i was wrong to say vh is a seo program because it is not. VH is a website submitter. pet121

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

     

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49