what made the old man feel 'too lonely' at his shack?

From the text:

Once there had been a tinted photograph of his wife on the wall but he had taken it down because it made him too lonely to see it and it was on the shelf in the corner under his clean shirt.