The problem with removing it is the tiny spring can get slack (no pressure on it) and results in inconsistant trigger weights. It might break at 2.5, then 2.3, then 2.75 or even 3 lbs. What you can try ( i have not) is go to ace and buy a smaller set screw, one with a flat head, and file it down to size. Bevel the other end and try just to put enough pressure on the spring to keep it still. Make the length so it does not stick out. The Xmark is pretty bullet proof, so there should be no risk of accidental discharge, but do this at your own risk. The proper answer is to consult a qualified gunsmith and all that jazz.
If this is on a hunting rig, wont really matter.
Other than that you can always get a Timney.