I took mine off to replace it with a silver version. You need to use something non-metallic to prise it off with so you don't damage the paint. I used a plastic tyre lever from a bicycle puncture repair kit.
You'll probably be left with a sticky mess where the badge was which can be removed with some mild alcohol cleaner then polished up. When you want to refit the badge you'll need a new double sided sticky pad.