What does Taylor mean when she says, "Otherwise it kind of weasels its way into your head whether you like it or not"?

Taylor means that Lou Ann should stand up to her fears. She should talk back to them and and the fears submit, "Otherwise it kind of weasels its way into your head whether you like it or not."