Ok, I did return the dorman vac switch and ordered a delco.
I also did notice that I have some vac lines up by the anti-lock brake system in real bad shape. So I'll get that new switch in and new lines and get back after that.

 

Just for some info, I believe the lines are 5/32 (it should be printed right on the hose if you look close). I read on here where someone else used a bit larger hose and it caused a short delay when switching in and out of 4wd.

 

All fixed....
I pulled the t.case and changed the seals, put in a new delco vaccum switch, and replaced all the vaccum lines (some were really bad) and now everything works like new.