Why did the people think it was strange to see her with Homer?

Homer was a Northerner and a day laborer.

At first we were glad that Miss Emily would have an interest, because the ladies all said, "Of course a Grierson would not think seriously of a Northerner, a day laborer."