It almost sounds to me like they are not fully seated - the first strike of the firing pin seats the primer and then the second strike sets it off.
Look into this. I also use federal pistol primers, large and small and have never had a problem.