Use of Robots Meta Tag
Robots Meta Tag is used to tell a web root that can be indexed and can track the links on the page. The marker element has occupied the increasingly important position. Moreover, it is also applied to the control permission without the robots.txt file on the top of the server, and some search engines have fully followed Robots Meta Tag, such as inktomi. Robots Meta Tag format: The Robots Meta TAG is placed in the background HTML source In the header area of the code (HEAD zone), its format is similar to: (large-lowercase)
HEAD>
...
Robot Meta Tag Options:
There are four instructions that can be used in a Robots Meta Tag: INDEX, NOINDEX, FOLLOW, and NOFOLLOW, "," separated. among them:
INDEX instruction: indicates that Robot can index this page;
FOLLOW instruction: Indicates that Robot can track this page link;
NOINDEX instruction: Represents the reject the Robot index this page, but track the links on the page;
NOFOLLOW Directive: Represents the rejection of the Robot trace this page, but can index this page.
Example:
In some search engine articles about Robots Meta Tag, predefined default settings are INDEX and FOLLOW. However, it is not the case for INKTOMI. The default item of INKTOMI is INDEX and NOFOLLOW.
There are also two global instructions: all and none.
All = index, FOLLOW: Indicates that you can index this page and track the link;
None = noIndex, NOFOLLOW: Indicates that the page is not allowed and the link is not allowed to track the link.