Why does Charlie send Alice away?

Charlie wants to keep things as they are.... he's angry at Alice because he's angry at himself. He feels she's pushing him, and he can't be what she wants, or do the things she wants. He doesn't want to think about what he has lost, and Alice has become a reminder of that. Thus, he tells her to leave.