It's doable but when you mix/match a lot of brands together you can get issues with things fitting together as they "should". They'd probably work fine with similar parts from the same manufacturer, but there's only loose standards between manufacturers.
Also depends on what specific model you're building. If you're looking to make an M4, sure...they've been done to death. If you're scratch building an L85 or Thompson...good luck.