Have you tried talking to them? Most disputes between rational adults can be resolved by a calm discussion with all parties involved.
If that doesn't work, I suggest trying to convince people you are in the right, not him.
If that doesn't work, assuming his team really is as bad as you say, just consistently defeat them and you'll earn your reputation.
Need age verification in the St. John's, NL, area? Contact me.