To exclude a page from indexing and following you should add the following to your page' <head></head> section.
<meta name="robots" content="noindex,nofollow">
rel="nofollow" on a specifik link just tells search engines to not follow that specific link. Even though they'll still follow it, it sends a signal, that you don't "trust" the link with the nofollow added.
But I understand, that "nofollow" keeps the crawlers from following the links on this respective page. I would like to prevent the crawlers from coming to this respective page. Or am I wrong?
However, I understand your point with the trust, so I'll just go with "noindex" :)
I you wanna prevent the crawlers from visiting the page completely, your should do a disallow in your robots.txt file instead.
But if the page is already indexed, you need to get it out of the index first, before blocking it in the robots.txt file, since the robots.txt disallow tells the search engines to stay away from the disallowed page completely.
If the page isn't indexed you can add the following to your robots.txt file which should be placed in the root directory of your FTP.
User-agent: *
Disallow: /page-you-dont-want-indexed
But let me know what kind of page you're wanting the crawlers to stay away from, then I can get a better idea whether you should noindex or Disallow in robots.txt :)
Using a checkbox to display a meta robots nofollow tag
I would like to offer a checkbox in the back office to add the meta robots nofollow tag in the head if checked.
I chose a true false document type, but I'm not sure how the code should look in the master page. I tried this, but it didn't work:
Any help? TIA!
Hi Christine,
This snippet works for me:
Hope that helps,
/Chriztian
Thanks so much Chriztian, that worked!
You could use this as well, if you want some more control over which tag to insert.
Hi!
Please excuse my question to this older thread, however I was wondering, what I have to do to exclude a certain page from indexing and following?
"noindex" will work as described, but "nofollow" will only handle outgoing links from this page. How would it work to add a
to all links to this page?
Hi Simon
To exclude a page from indexing and following you should add the following to your page'
<head></head>
section.<meta name="robots" content="noindex,nofollow">
rel="nofollow"
on a specifik link just tells search engines to not follow that specific link. Even though they'll still follow it, it sends a signal, that you don't "trust" the link with the nofollow added.Hope this helps :)
Best
Henrik
Hi Henrik,
But I understand, that "nofollow" keeps the crawlers from following the links on this respective page. I would like to prevent the crawlers from coming to this respective page. Or am I wrong?
However, I understand your point with the trust, so I'll just go with "noindex" :)
Best, Simeon
Hi again Simeon
I you wanna prevent the crawlers from visiting the page completely, your should do a disallow in your robots.txt file instead.
But if the page is already indexed, you need to get it out of the index first, before blocking it in the robots.txt file, since the robots.txt disallow tells the search engines to stay away from the disallowed page completely.
If the page isn't indexed you can add the following to your robots.txt file which should be placed in the root directory of your FTP.
User-agent: *
Disallow: /page-you-dont-want-indexed
But let me know what kind of page you're wanting the crawlers to stay away from, then I can get a better idea whether you should noindex or Disallow in robots.txt :)
Best
Henrik
is working on a reply...