|
|
|
#1
05-10-2008, 05:23 PM
| |||
| |||
hi can anyone help me with 404 error reports in awstats for my site. I'm only really concerned with the error hits i'm getting from robots this is what it reads Url /robots.txt error hits 38 Not really sure how to rectify this, hope one of the pro's can explain how. many thanks Max
__________________ Buy and Sell Antiques, Collectables & fine art Cheaper than feebay! visit:www.greatbritishantiques.com         |
|
#2
05-10-2008, 05:44 PM
| |||
| |||
Do you have a 'robots.txt' file? I believe this is basically used to tell bots which pages NOT to read/cache. The bot looks for it and if it doesn't find robots.txt it knows it can read any/all the pages. BTW: I am far from a pro! Perhaps if I am incorrect, someone will enlighten both of us.
__________________ jcaywood For a great adult gag gift: http://www.thegoofygiftshop.com Rockdale, TX Class of 1965: http://www.rhsclassof1965.com |
|
#3
05-10-2008, 09:48 PM
| ||||
| ||||
jcaywood pretty much hit the nail on the head. Search engines are trying to access the file called "robots.txt", which since you don't have one its not being found, which causes a 404 error (page not found). If you create a robots.txt, even a blank one, you won't get a 404 error when trying to access it.
__________________ Freelance web programming Do you need help installing a script, or need one written for you? I do freelance web programming (XHTML, CSS, PHP, MySQL). Feel free to contact me through my website and I will get back to you with a quote asap. Register/Login Script Do you use a Password Protected Directory? Need a way to allow users to make their own account, try my .htaccess Login Script |
|
#4
05-12-2008, 11:15 AM
| |||
| |||
Thanks for your help guys, I will work on it. much appreciated
__________________ Buy and Sell Antiques, Collectables & fine art Cheaper than feebay! visit:www.greatbritishantiques.com |
AWstats 
Re: AWstats 
