Why does Hester feel responsible for Dimmesdale’s physical condition?

Because Chillingworth has figured out that Dimmesdale is Pearl's father, he constantly tortures him. Hester feels responsible because their indiscretion causes him immense grief and guilt. Hester, who begins to care more for others, feels a certain guilt that, although she bears the outward sign of the sin, he must suffer in silence.