Why are men of "desperate fortunes" willing to risk their lives with Gulliver on his ship?

Gulliver replies to his master's query by saying these men ran from poverty or crimes they had committed. They would rather take their chances at sea than stay at home.