Sounds like maybe something might be up that's not related to charge weight..?
Something seems wonky. I don't own/run a .308, but just by pumping what you've shared about your load into Hogdon's load data site, with 168s and Varget, it doesn't appear ~42gn should be showing pressure (and while some primers are better than others as far as consistency, IDK if different primers really matter much as far as pressure/MV IME, so I wouldn't even factor that in or worry about that as long as they go bang).
View attachment 8723305
When's the last time you pulled out the borescope and looked at your chamber? Remember, Varget means awesome, but it also means a carbon ring you have to stay on top of...