why would Chopin not have Edna protest such a comment?

The fact that Mademoiselle Reisz uses the word "prejudice" places the burden of blame on society: society is not open-minded or enlightened enough to see Edna's love for what it really is. This is why Edna doesn't protest the comment about her infidelity.