I know you said that it’s in your head.... and that’s all it is man.
If I remember this right, taking a coil off of that spring doesn’t change the safety of the trigger.
If it’s set too light, the cocking piece won’t be held back when the bolt is closed.
If it is held back, your spring weight is fine, and the only thing that can move the actuator out of engagement with the sear is the trigger, which has the entire first stage to go through before it can act on the actuator.
Check that your safety still works normally, and do the drop test a few times. If the striker doesn’t fall, your good to go.