Copied to clipboard

Flag this post as spam?

This post will be reported to the moderators as potential spam to be looked at


  • Shuchita 44 posts 153 karma points
    Jul 12, 2022 @ 05:56
    Shuchita
    0

    How we can ignore specific URL using SEO Checker?

    Is there any way in SEO Checker so that we can ignore specific URLs. Actually few pages are working conditionally, if condition fulfill then page will work, otherwise page will return 404 not found. But SEO Checker throwing error in this case. Here is the error message:

    SEOChecker: SEOChecker: Document with Id '16603' and with url https://mydomain.com/data/documents/versatile-deep-cleaner-warranty/ could not be validated because of the exception 'The remote server returned an error: (404) Not Found.' on the page    
    SEOChecker.Core.Exceptions.StreamLoadValidationError: The remote server returned an error: (404) Not Found.
       at SEOChecker.Core.Helpers.Request.GetStream(String url, HttpCookieCollection cookies, String userAgent)
       at SEOChecker.Core.Validation.DocumentValidator.Validate(Int32 documentId, IContextInfo context, String culture, Boolean validateKeyWords, String focusKeyword, Boolean editMode)
    

    Basically all URLs that are starting /data/documents/ need to ingore in SEO Checker. Also these URLs are needed in the sitemap.

    So is it possible to tell SEO Checker just ignore all URLs starting from /data/documents/?

    Thank you.

  • Richard Soeteman 4046 posts 12899 karma points MVP 2x
    Jul 13, 2022 @ 06:39
    Richard Soeteman
    0

    Hi,

    Add /data to the ReservedPaths and it should be ignored.

    Best,

    Richard

  • Shuchita 44 posts 153 karma points
    Jul 18, 2022 @ 16:19
    Shuchita
    0

    Thanks Richard for the reply.

    I can't make /data/documents/ a reserved url because it must be able to render via umbraco. It's supposed to return a 404 normally, but there's an exception for one crawler so that it can pull data from that node. If the user agent matches that crawler, it returns a blank page with some meta data in the head.

  • Richard Soeteman 4046 posts 12899 karma points MVP 2x
    Aug 08, 2022 @ 09:26
    Richard Soeteman
    0

    You can also add it to the UrlFilters in SEOChecker appsettings See manual https://soetemansoftware.nl/seo-checker/downloads then your request will be treated as a BOT.

    Best,

    Richard

Please Sign in or register to post replies

Write your reply to:

Draft