How does Aunt Polly find out that Tom did go swimming?

To keep him from swimming, she sewed his shirt on. He carefully sewed it back on when he was done, but he used a different color thread.