Why did Mrs. Baroda go to her aunts?

Mrs. Baroda was tired of having him around..... he confused her.

From the text:

Gouvernail’s personality puzzled Mrs. Baroda, but she liked him. Indeed, he was a lovable, inoffensive fellow. After a few days, when she could understand him no better than at first, she gave over being puzzled and remained piqued. In this mood she left her husband and her guest, for the most part, alone together.

“When is he going—your friend?” she one day asked her husband. “For my part, he tires me frightfully.”

“You used to say he was a man of ideas,” she retorted, unconciliated. “I expected him to be interesting, at least. I’m going to the city in the morning to have my spring gowns fitted. Let me know when Mr. Gouvernail is gone; I shall be at my Aunt Octavie’s.”