Why was Herbert at Miss Havisham's residence when we were first introduced to him earlier in the novel?

We are first introduced to Herbert when Pip and Herbert were kids at Miss Havisham’s house. Herbert challenges Pip to a gentlemanly fight which Pip wins.