What are some of the ways Dimmesdale has been punished for his afair with Hester

Dimmesdale pretty much punishes himself. He does not seem to eat or sleep much. He is always stressed out verging on a heart attack. His chest aches and he grows more frail and gaunt each day.