In my experience, its possible that the finish on your barrel nut could get slightly marred up around the grooves...but no, there shouldn't be any significant damage to the weapon. You'll want to use care putting the nut wrench on the nut; if you don't you might slightly scratch the finish on the barrel.

Disclaimer: both my swaps thus far were blued receivers with blued or stainless barrels