Your thumb can take a break. ;D

When I'm really getting down to accuracy I worry about the damage it MIGHT be possible to inflict on the round feeding into the chamber from a mag.
Even with single shot followers I guide the bullet into the chamber with my finger/thumb.
Been doing it that way so long I could'nt tell you which digit is used. Just became part of my natural rythym.
Same with pulling them off the follower. No ejectors in my target guns.