The man on the moon is likely the “face” of the moon (if you try, you can kinda see it). And since the moon has a really good point of view from way up there, if he can’t see it, no one can.

i.e. the man on the moon can see all, but not [that]

This is my understanding.