I agree that this is not elitist at all, it's simply a game rule. Honestly it's NO different than wearing armbands.
Lindz really hit the nail on the head with his post
Airsoft, like any other sport, has many different groups, clubs, and styles of play.
Some levels require team uniforms, like we want standardized camouflage.
Some people play for fun, some play for competition, some play with special rules (like beer ball). It's usually not a good idea to mix the players together, but there's no reason all styles of play can't be made available to everyone.
As was stated, some ops have dress codes, you don't like it? Don't go.
Better yet, host your own op that doesn't restrict camo, because there ARE others like you out there