Why might the party look away?

Do you mean look away from Winston seeing the prostitute? The party concedes the difficulty in controlling the male sex instinct. At times they may look the other way if the sex is with a Prole and is a meaningless exchange for money.