Sign in Register
Go to solution
Copied to clipboard

Flag this post as spam?

This post will be reported to the moderators as potential spam to be looked at


  • fabrice 104 posts 227 karma points
    Jul 26, 2012 @ 13:16
    fabrice
    0

    ImageGen and robots.txt

    Hello,

    I have setup my robots.txt like this :

    User-agent: *
    Disallow: /umbraco/

    However, the pictures are not parsed by google bot. I guess it's because Imagegen is in the /umbraco folder which is deny.

    So i added at the end

    Allow: /umbraco/ImageGen.ashx*

    but it still doesn't work.

    Any ideas ?

    Thank you very much

     

    Copy Link
  • Douglas Robar 3570 posts 4711 karma points MVP ∞ admin c-trib
    Jul 26, 2012 @ 17:13
    Douglas Robar
    0

    If you use a newer version of ImageGen you'll find it installs into the root of your site at /imagegen.ashx so you won't have to worry about disallowing /umbraco/ folder.

    I'm no expert on what google does and doesn't parse but it might be that Google just doesn't parse ashx files with querystring params. Or maybe they do. I don't know. Maybe someone else does. Or a search online to find the answer to what Google does and doesn't do. Do let us know what you find out.

    cheers,
    doug. 

    Copy Link
  • fabrice 104 posts 227 karma points
    Aug 29, 2012 @ 14:04
    fabrice
    0

    Hello,

     

    I have put an HttpModule to load ImageGen so google does not see /ImageGen.ashx?... but it sees /images/myimage?width=xxx

    You can find an example of it in uBootstrap source code.

    I have modified the version of uBootstrap to not check the physical existence of the file in the module for performance reason.

     


    Copy Link
Please Sign in or register to post replies

Write your reply to:

Draft