Why does Gene want to save face with Phineas?

Finny forms his group for his "Suicide Society." Gene isn't so keen to risk killing himself by jumping off a tree but always jumps because he doesn't want to "lose face with Phineas."