Why did Gatsby leave college after just two weeks?

From the text:

An instinct toward his future glory had led him, some months before, to the small Lutheran college of St. Olaf in southern Minnesota. He stayed there two weeks, dismayed at its ferocious indifference to the drums of his destiny, to destiny itself, and despising the janitor’s work with which he was to pay his way through.