Something on the bottom of the action (more than likely in the trigger or mag well area) is causing the interference.

Some white chalk (pink, light green, blue, ....you get the idea) rubbed on the action will help pin point the problem area. Set the action in the stock, rock back and forth, pull the action, and look for your favorite color.