I'd go for leather personally, although it can get hot and sticky in the summer and it'll be cold when you first get into the car in the winter.
I wouldn't buy a car just for leather seats though, if there was a better car for the same money with cloth seats I'd go for that. I would also look out for one that has Recaros.