does Silas Manner experience setbacks both in Reveloe and Lantern yard?If so, to what extent?

In Raveloe, Marner experiences setbacks because the people there are suspicious of him. He's a weaver (a trade associated with the Devil), he lives on the outskirts of town, and he is completely anti-social. His isolated behavior causes most the suspicion, as he doesn't allow anyone to get to know him. He doesn't even ask a neighbor in for tea, let alone join the gentlemen at the pub for a drink.

In Lantern Yard, Simon was a regular church goer, and he was well respected. Well, up until the point he was unjustly accused of theft...... and afterward shunned.