The answer is usually no, however the accuracy problem might be you. I found this out the hard way. I had a break installed on one of my rifles ten or so years ago and my accuracy plummeted. I had a buddy shoot my rifle and it shot lights out; however every time I shot the accuracy was awful.
My buddy set up a video camera and recorded me shooting with and without the muzzle break on. Without the brake my shooting fundamentals were rock solid, a couple times he would take a round out of the chamber without telling me to see if I would flinch dry firing. With the break on I had a built in flinch, no matter how hard I tried and though I didn’t feel like I was flinching, I’d flinch, the video camera in slow motion never lies! We figured it had something to do with extra sound and pressures being directed back towards me. Subconsciously my brain was reacting to something and no matter how hard I tried I couldn’t overcome it. I’ve tried over the years with other guns with breaks and it’s the same thing so I’ve given up.