When it doesn't kick in does it just rev and not go very fast? If so that is limp mode. Means something is causing you to go into like a 'safe' mode, where the car is only just driveable. Turning on and off re sets this.
A common problem is sticky vanes, the mechanism inside the turbo gets clogged up with soot and grime and doesn't function properly. You'll need to get this looked at if it is the case.