Sounds to me like the secondary air pump.
my bug dies at start and turbo just whinesx2 sai pump
x2 I agree it sounds like the secondary air pump's rubber mounts are bad/dry rotted and the pump is vibrating against the metal support. Common problem especially with the older cars. Since you don't have a CEL my guess is your pump might still be good and no leaks.