What does nick mean when he says he is one of the few who were invited?

Most of the guests at Gatsby's party just showed up without invitation. Nick was one of the few people who not only had been invited, but who had met Gatsby as well.