How does the Walls family become outcasts within their own community? How do Brian and Jeannette cope with being labeled as they are?

Labeled in what way? What section of the novel does this question pertain to?

Does this relate to the fact that Brain and Jeannette are labeled learning disabilities in Part III?

yes