That's very personal. I have slight astigmatism, so aside from being faster to pick up, large dots also look rounder for me.
I asked myself that very same question not long ago, so I procured two Hawke red dot sights identical except one has 3 MOA dot and another has 5MOA dot. Both are offset from the primary optic and both work fine, but I prefer the larger one.
ILya