How did Hiram's dad embarrass Grampa when his Dad was young?

Grampa explains that when Harlan was younger people would look down on Grampa behind his back because Harlan did not go along with the ways of the South and that it caused Grampa a great deal of embarrassment. This news greatly upsets Hiram, but he is still determined to do what is necessary.