What is the main reason ralph is worried about the boy not comen back to the meeting?

In Chapter five, Ralphs's meeting degenerates into Jack openly defying him. As Jack walks off, many of the boys follow him. Piggy asks Ralph to blow the conch again. Ralph knows that if he tries to call another meeting and the boys don't come, his leadership is finished. What little power he has left will be over.