A guilty conscience is the mother of invention.

expression suggesting that

If you feel guilty, you will think of a way to justify yourself.