Six at the beginning means:

Boy like contemplation.
For an inferior man, no blame.
For a superior man, humiliation.

This means contemplation from a distance, without comprehension. A man of influence is at hand, abut his influence is not understood by the common people. This matters little in the case of the masses, for they benefit by the actions of the ruling sage whether they understand them or not. But for a superior man it is a disgrace. He must not content himself with a shallow, thoughtless view of prevailing forces; he must contemplate them as a connected whole and try to understand them.