I tried the barrel swapping thing, and still have some extra barrels hanging around that sit in the shop rarely being used, but I too eventually bought other rifles, rings and scopes, for those other intended purposes. Some rifles didn't need to be expensive, nor did the scopes.
What I do like most with the barrel nut/prefits is saving nearly $400 of GS fee's compared to a shouldered barrel when rebarrel time comes. With the savings, I can buy another prefit barrel or enough powder and primers to almost last one barrel.
After a while I decided that I didn't need, or even want anymore, a bunch of different calibers and cartridges, because certain ones covered so many bases reasonably well.
I also learned my expensive lesson of exploring extremes. Push bullets too fast and suffer the consequences. Better off going up in caliber and relying on BC instead.