I don't know where you found that data... but you do have to go with your instincts here.
Hodgdon publishes (on their webpage) a max of 46 grains of 4064 with 140's, and Varget is in that burn range (a tiny bit slower, normally, and can usually be loaded a tad hotter than 4064).
Jack O'Conner (reference earlier by another member here) used 49 grains of IMR 4064 and 130's for an accuracy load. That's over max, for sure... but so were some of his H4831 recipes. But they did work.
Hodgdon shows 47.3 grains of IMR 4064 as max with the 135 grain Sierra Matchking.
Again, IMR 4064 and Varget burn nearly the same, with Varget being a tiny bit slower...
If you work up to your targeted charge weight, you'll be safe. I would not expect to see pressure problems in Winchester or RP brass in anything other than a tight chambered Savage, but do be careful, whatever you decide to do.