Yes it can be removed but can be a bit of a pain to do, especially if the rear vents are connected.
The only thing is. The colour of the plastic trim might be different if his car had the armrest from new, your ED30 trim colour might be slightly darker.
Matt