Why is Anne so afraid of arriving at the Spencer house?

Anne is afraid that once they get to Mrs. Spencer's house her time at Green Gables will come to an end. She is worried about being sent back.

“I was afraid it might be Mrs. Spencer’s place,” said Anne mournfully. “I don’t want to get there. Somehow, it will seem like the end of everything.”