Wtf? That doesn't even make sense.
Make sure your punch isn't working against you by trying to spread that pin out, use some lube if you have too, it always feels better that way. Be careful not to break your trigger guard tabs though. If all else fails you could always use temperature or drill it out.