Why do you think the men abandoned Pew at the inn? in chapter 5

Suddenly, everyone hears horses galloping and a pistol-shot, a clear sign of danger. Frightened, the men flee abandoning Pew. When the horses approach, confused, Pew falls under a horse's hoof and is trampled to death by people who have heard of the plight of Jim and his mother and are coming to give assistance. THey leave Pew because they are more afraid of being caught than leaving the blind man to his fate.