How do we know that the old man misses his wife?

Santiago had his wife's picture hanging in his shack but he took it down because, "it made him too lonely to see it."