If you block the pipe fully does the engine die?
If it tries to keep running you need to check for air leaks, I had an idle problem with my vaver, took me a couple of months to work out what was going on...
It was self inflicted, I had stripped the threads by over tightening the bolts holding the upper inlet manifold to the lower -easy done as they are a very low torque. this allowed un-metered air into the engine, it was ok cold but hot it would idle at about 1500 and sometimes the revs were pulsing up and down from 1500 up to 2000 -looked like a total nut during rush hour queue's. Swapped to an undamaged lower manifold and all was good again.
The vacuum pipes like to turn to powder and cold be your problem, replace them with silicone -especially the one going to the engine ECU in the scuttle.
Try cleaning the ISV with crab cleaner.
Check the wiring loom going to the TPS above the exhaust manifold, insulation gets crispy and the wires end up bare & short out on each other.