“I can forgive, but I cannot forget, is only another way of saying, I will not forgive. Forgiveness ought to be like a cancelled note - torn in two, and burned up, so that it never can be shown against one.”
The idea behind the quotation
True forgiveness means letting go completely and not later using someone’s wrongdoing against them; claiming to forgive while holding on to it is really refusing to forgive.