Here you go.
Standard Golf cap with the cup part cut off leaving a big washer

Then the remaining lip ground flat and centre hole enlarged slightly

Polo and modified Golf cap mated together

Comparison of difference in diameter between the two caps

Rubber buffer added to both caps


Will be fitting them after work this evening, can't see any reason why they won't do the job