-Make sure the barrel and rear tang are free-floated.

-Try a different bullet, like maybe a Sierra match king or similar. You could also try the same load you have at a longer range to see if it settles in or not, as some match bullets will do that.

-I load my 168's with 43.4-44gr of Varget, so you may be a little low on your charge(I think 42-46 is the charge range for 168's)

-What scope do you have? Parralax set correctly? Eye relief correct?