Mil spec push pins on lowers?

Are you having difficulty pushing the pins in? Seems to be some variance in tolerances, some "mil-spec" uppers fit "mil-spec" lowers fine, some bind, pretty much just have to trial fit. IMO.