In Chapter 17 Scarlet Letter, In what way is Chillingsworth sin worse than Hesters?

Chillingworth's sins are secret, he plans and manipulates behind the scenes..... his desire is to revenge his himself, though he will not publicly claim the right to do so. Hester's sin is public..... she has done her pennance, paid the price, and yet risen above those who condemned and punished her.