Starting to sound like the follower is binding or trying to turn sideways or something.....when I did mine I did all kinds of things to work and it works really well actually. I fiddled with everything, squeezed the mag, bent the feed lips, sanded ect., it has pliers marks all over lol, but fully functional from first to last round.
Keep fiddling with it until you either get tired of it or it works.
Is that a 5rd mag or 10rd?