who is the main enemy in the story

I think that would be Sir Philip Morton who raised the taxes of the lowland farmers who rented lands from him and next he built a rock wall, cutting off any access the yeomen or estates-men had to the common land in the meadow.