Even if it hasnt moved the rubber could potentially be perished and weakened with age.
Yes your absolutely right, for example if a brand new tyre is left unused, after a good few years cracks start to appear and it will loose its strength.
Same scenario as a belt. and to be honest, i would not risk it, as my uncle's lexus timing belt snapped and its wrecked the whole engine.