In your first paragraph with what you say..it's not easy to understand what is effecting what without a bit of punctuation.. apologies for that.
But anyways.. the idle valve (ISV) i believe only takes over the idling once the vehicle has come to a stop, ie stationery no wheels turning, it's all in the electronics/ecu.
Disconnecting the speedo cable i guess isn't really helping, only perhaps pointing towards an obvious idle problem, possibly ecu related.
Without going out to check i can't remember if the idle valve is affected by clutch in/out at standstill but if so, again it's in the electronics engine management i'm sure.
Kinda assuming you've done the ole ecu and fuel relays, among the other usual tricks and jobs.