Since you are already gonna fill the magwell and bed the action, you can always just set a score-hi follower in the bedding.

Set the action in as you would in a normal bedding job, set the follower in and make sure it is the correct height, and let it set up as normal. When it all sets up the follower stays in the bedding. Done.

This way you will never have to mess with the follower again. I tried this with a custom Striker stock and it worked flawlessly.