So, as soon as I unplug the vacuum line to brake booster the idle goes up and stays steady. Probably up from normal rpm of 500- 600 at idle to 700 (this is a guess as I wasn't smart enough to look). The rpm when it is idling low is closer to 400.
Also, it never seems to happen in the AC or...