what do you learn about what happened to make lenie and george leave weed?

Details are sketchy. We know that Lennie loves soft things, the mouse, the rabbits etc. He apparently was holding on to a girl's soft dress, and did not let go. The assumption from the authorities was that he assaulted her, but Lennie is not normally violent.