He who excuses, accuses himself

It suggests that

by frequently providing justifications or explanations for their actions, people are drawing attention to the fact that they have something to apologize for or defend.