I always did it with them in on 3 different savage actions. No issues with it in at all. Some will say they have a better feel for it with them removed, but I've never found it necessary.