 Re: NOODP robort | |
Again, no need to complicate things or attend minutia.
Any robot file is a "command" the SE's take into consideration when evaluating a site, and they particularly are looking for "do not folow" moreso than 'directions' .... they have their own auto-pilot manner of discovery that does not need any help from you.
Once the bots find out which pages NOT to run, they will then look for those permitted pages and on those pages first for the additional elements which have been properly formatted for cache elevation (H-META, simple page META, etc.). They will never go back to a file for additional instructions or to assume conditions (your NOODP file). Having additional, or duplicated 'read' files for a single website is dysfunctional and MAY prove to be an instance of redundancy that could de-value the overall site assessment.
Have single read file (robots.txt, NOODP, etc.) and a validated sitemap.xml file and leave it at that.
By trying to attend to minute details of optimization for a site genre that you have, you may expect to run into conflicting valuations by the SE's, as they will likely see your unnecessary "refinements" as overkill, and nudge you into a generalized site classification as 'suspect' or even 'non-compliant' inasfar as you have all the construct in place but not enough Content/relevant Content to justify such a detailed construct. Get it?
|