Why is there so much resentment toward the narrator in the Jolly Dollar

The men in the Jolly Dollar treat the narrator like a stranger when he greets them as brothers and Barrelhouse, the bartender, has to calm them down. He tells the narrator that much of the community feels similarly to the men in the bar, that the Brotherhood has let them down.