get some neat truck wash on a cloth and wipe round the seals dont get it on the paint work ,repeat as required wash off thoroughly. you'll never stop it doing that completely but this will take all the old rubber off which is going onto your wash mitt and taking it back to fresher rubber.
