Its good until they try to ram it down your throat or burn you at he stake because you think differently.
One little point is that those that hate the idea of religion also will kill you to force you "Not" to believe in religion.
They are just as much and possibly more vicious and murderous than any acting in the name of a specific religion.
You should take a look at how much out right mass killing of anyone with a religious ideas was done by the "Atheist" Communists over the 20th century, or for that matter, how much the Communist Atheist Chinese government is currently viciously persecuting Muslims, Christians, any other religious folks.
It in the end boils down to people using whatever ideological justification suits them most to kill anyone that doesn't exactly toe the line.
Then if they toe the line, using the same ideology to make sure the ones in charge stay in charge and don't get questioned about it.
Pretty much the entire history of humanity with a few gaps in between.
Which is why if you want to have freedom, you have to make sure there are a lot of competing ideologies and that one specific group with one specific ideology doesn't take over the place completely.
A great Science Fiction writer once put it in the book that the reason America (after a few false starts before there was a bill of rights) had religious freedom is that while most were Christian, each denomination wanted to be the one in charge, but even more passionately didn't want any other denomination to be in charge over them. So that kept everyone free.
It can work similar even in Muslim world, for example in Syria (at least till the whole intervention mess), there was plenty of religious freedom as long as you were respectful of others (and of course Islam). Christians openly worked there just fine as long as they played by the rules, because the government was from one small sect of Islam and several other sects also competed for power and the brutal dictator in charge was very careful to try to make sure no one group got too powerful (Especially the Saudi front groups) and could overrun everyone else.
Of course eventually the whole brutal dictator thing comes crashing down to reality eventually.