Announcement

Collapse
No announcement yet.

about robots.txt

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • about robots.txt

    Hi!
    I'm José and my site is www.vaccontrol.com
    Looking at statistics on cPanel, and I saw frequently that "robots" made some visits...and "request" robots.txt. I don't have any file called robots.txt, and an error page 404 is the result.
    1- Is this a problem? or it's just the normal?
    2 - can (must) I do something t improve my site? . (anyway it is "listed" in importants searching sites)
    3 - What changes i need to do (tag's... metatags) when i change my pages, for exemple adding pages to my site?

    Thank you,
    José

  • #2
    Re: about robots.txt

    The robots look for robots.txt to find if you've set any "rules" for what they can and cannot access on your server. In most instances, you don't really need to worry about any of this, but you can read more here:

    http://www.robotstxt.org/wc/norobots.html
    My NASCAR Forum

    Comment


    • #3
      Re: about robots.txt

      Thank you for help.
      José

      Comment

      Working...
      X