Why don't you try a real 220 swift load? What you are shooting now is less than 22-250 velocities. The 220 Swift is the original factory "hot rod", and shoots the best at top end speeds.
Try some Reloder 15 and 50 gr. bullets, when you get to around 3900 things will tighten up.