according to the first paragraph, how did the average person view weavers,travlers, and those who were clever

The first paragraph states;

"In this way it came to pass that those scattered linen-weavers --emigrants from the town into the country -- were to the last regarded as aliens by their rustic neighbours, and usually contracted the eccentric habits which belong to a state of loneliness."

the first paragraph clearly states that the weavers are emigrants which means they left their own country to settle permanently on another country.