you need something there cause it goes between the action and the pillar. If you leave it out there will be a gap and you could damage the threads in the action by trying to get it tight. It'll just have that mushy feeling when you tighten it.
You could just glue it in with a dab of crazy glue, or find a small washer of the same thickness to replace it with.
Bookmarks