You are not wrong.
Depends how you want it to look. Are you doing it or sending off?
Could do it quick at home with some of these
Brownells is your choice destination for all your Rifle Stocks & Parts needs.
www.brownells.com
Or still at home; but more intensive. Find a piece of wood that has the similar grain/color and fit it.
Or send it to
Custom Rifle Stock Makers Photo Gallery: Browse our Photo Gallery of projects. Visit us in Houston, Texas or Call Us to discuss your gunsmithing project!
lohmangunsmith.com
I've no affiliation with them. It was the first Google search. I'm sure they can send you in the right direction if they won't do it.
For me if it's a hard use gun just get some black spacers and done with it. If I want it to be pretty take the time and cut some wood to fit.