I don't think your rifle is changing that much. Are the bases tight? Did you check the two action screws? Are they loose?

David