|
|
|
|
The purpose of the meta tag robots is to control how search engines crawl and index your web page. That way they do/don't index/follow it unless you want them to.
The meta tag robots has these four options: index, noindex, follow, nofollow. index/noindex and follow/nofollow are mutually exclusive so pick one of each. Separate them with a comma and a space. Here are their descriptions.
index: If you implement this option you are telling the search engine that you authorize them to index your web page which means they may decide to include it in their results.
noindex: If you implement this option you are telling the search engine that you do not authorize them to index your web page which means they cannot include it in their results.
follow: If you implement this option you are telling the search engine that you authorize them to follow the links on your web page to other web pages.
nofollow: If you implement this option you are telling the search engine that you do not authorize them to follow the links on your web page to other web pages.
By default search engines behave as if you had used the index and follow options. Therefore the meta tag robots are only necessary if you use noindex or nofollow.
Conclusion: Depends on Webmaster
Place the HTML code for the meta tag robots between the opening head tag (<head>) and closing head tag </head>.
This is an example of what the meta tag robots could be for this web page.
Meta Tag Robots: index, follow
Here is the above example inside the HTML code for the meta tag robots.
<meta name="robots" content="index, follow">
|
|
|
|
|