Check your state laws. For deer hunting in Texas it must be .25 caliber or greater and, I think the bullet must weigh more than 55 grains. If it weren’t for that, a .22 would be my suggestion.
My son took his first deer, a spike buck, when he was 6 with a Browning 222. Still have the European...