The exception proves the rule.

used to mean that

If an exception exists, there must be some rule to which the case is an exception.