This rule actually has two parts:
a) No one should notice that you’re not wearing an undershirt. You may, in fact, not be wearing one, but so long as no one knows, you’re fine. That’s an unlikely scenario, though. When in doubt, wear an undershirt. (This is no less important when wearing knit polo shirts.)
b) No one should notice your undershirt either.