proverb

He that does you an ill turn will never forgive you.

guilt

because

He feels guilty and you remind him of his guilt.