Yews I have had a boost pipe pop off, the engine didn't stall tho just had no boost, drove the extra 100m home, had a look and found it had popped off.
If the turbo stalled the engine wouldn't cut out as it doesn't take boost at idle so it wouldn't make a difference and you would still have vacuume from the manifold which would suck the water in