You can remove the mirror by twisting it clockwise iirc.
This doesn't remove the part that's stuck to the windscreen though.. that will never come off.
+1, they aren't really designed to come on and off though and I have cracked a windscreen on a Polo doing it! Fair enough it was colder then 0 but watch it.
As for the base, as Joe said, don't try it.