It looks like splitting the difference of the mismatch is the only easy option.
The other option I can think of is cutting a "ring" or 2 from the spacer but this would be tedious. ( if the spacer is not hollow)

I do not own one of these stocks so I am only giving suggestions from what I see in the picture.
Jack