Not thinking about brass hurting it. My concern is how are you going to polish off a high spot freehand
without also polishing off the low parts of the crown. That is why you need a spud or bore guide to keep the polishing at the correct angle in line with the bore.