Prior to the Civil War, most of the artillery in the Southern States was privately-owned.
In an interesting factoid... just before the outbreak of the Civil War, Southern sympathizers in the War Department transferred tons of supplies (including artillery) for storage at Depots in the South. At the outbreak of war... these were seized by the Confederacy. As a disproportionate amount of materiel had been moved 'South,' it gave the CSA a false sense of security when it came to their supply chains.