Lack of patches/rank/insignia doesn't adversely affect your ability to shoot plastic BBs at your friends.
Recently we had a young guy show up to a game in cadpat, with regimental rank (MCpl Engineer), a replica CF Tacvest and helmet. Visually indistinguishable from someone walking around in garrison. He had no idea why this was not okay.
It costs nothing to be respectful.