As XML content formats mature, more and more robots are archiving XML documents. The robots processing instruction is the general XML equivalent of (and replacement for) the Robots META tag defined in HTML 4.0 and 4.01. It can be used in any XML format, including Scalable Vector Graphics (SVG), any version of RSS, Atom, XHTML, and many others. The robots processing instruction specifies whether or not the document may be indexed, archived, and links within it followed. Note that this instruction controls permissions; a robot may implement as many or few of these functions as it likes.
posted by Marcus Zillman |
4:15 AM
