Charley says, "to hell with it. when a deposit bottle is broken, you dont get your nickle back" what does he mean

One may invest a lot of time and money into a child, but if the child doesn't turn out well, you won't get any satisfaction or rewards for your time spent. But, there's no use worrying about it; you just pick up and go on with your own life, and let it go.