I'm currently on a mission to have a frame dedicated to each barrel, that said I have never noticed a difference in the raw accuracy of a particular barrel when it was switched from one frame to another if everything else remained the same. A point of impact shift has been the norm for me though and as Chris mentioned, a zero verification is a must!
Bookmarks