Why was the librarian so shocked to see Tom and Willie together at the library in Chapter 4?

The librarian, Miss Emilia Thorne, is astonished to see that Tom Oakley has taken in a young boy. She thinks of Tom as a cranky old man who never helps out in any of the village activities or war efforts.