Haven't tested the scenario where you have different languages on subdirectories

I just have and it seems near perfect. Only issue is, if I go to a page where the related page is unpublished (or, I'd assume, doesn't exist) then not all languages are listed. 

Any suggestions as to where I should be looking?