A pic would help a lot. Lugs will develop marks just from wear. A galled spot will be a groove ending with a ball of metal at the end.
I never want lugs to be too smooth. No place for lube to hide out.
I've galled lugs sitting at the dining room table before there was ever a barrel screwed on...