I just know there'll have been millions more with knackered rubbers that didn't bust their balls.
I'm certainly not saying you shouldn't do something to stop the swivel pins getting to their limit. Damper travel does seem a better option: less leverage and it'd be more obvious if wear allowed the issue to resume.