What reason does John first give for not going to church regularly?

From the text:

PROCTOR: Mister Hale, (Slight pause as he controls himself.) I never knew I must account to that man for I come to church or stay at home…. My wife were sick this winter.

HALE: (Kindly.) So I am told. But you, Mister, why could you not come alone?

PROCTOR: I surely did come when I could, and when I could not I prayed in this house.