Where are the four major characters during the final scaffold scene?

All four of the major characters stand upon the scaffold...

"They beheld the minister, leaning on Hester's shoulder and supported by her arm around him, approach the scaffold, and ascend its steps; while still the little hand of the sin-born child was clasped in his. Old Roger Chillingworth followed, as one intimately connected with the drama of guilt and sorrow in which they had all been actors, and well entitled, therefore, to be present at its closing scene."