OP says 55gr ball ammo doesn't keyhole. I assume you don't have a chronograph, I'm thinking it's a velocity issue. Either low powder charge, or you need to adjust the seater to put a light crimp on them.
Being flat base bullets, are you flaring the neck to seat the bullets? Any issues with...