Why couldn't the witches destroy his ship?

The witches did not have the power to directly kill people or destroy ships. They could only manipulate the weather and cause havoc, Though his bark cannot be lost,. Yet it shall be tempest-tossed.