Why didn't he prevent Jack and his followers from swirling and chanting?

Ralph knew that if he tried to stop the hunters, they wouldn't listen. To acknowledge them would be to encourage them. If Ralph allowed them to descend into nothing more than animals, all hope of rescue would be lost.