What did Sam realize about the people around him at home or at school

They were always in trouble since Sam lived in a very tough Newark neighborhood. He realized that they were going to lead him into trouble. Yet he somehow kept circumventing the trouble they could get him in and ultimately he was able to attend a magnet school where he first met the "boys" (ultimately men) who would make a pact with him and plan for the future.