Hey I really appreciate you taking time to anwear this!
To make it easier to tweak the GI I gave it all the geometry a white color, and Tweaked it from there. Also turning off the Store with Irradiance map helped a whole lot. But after I tweaked the GI and returned to the textured scene it became a bit "splotchy" again. So I turned Gi up quite a bit and let it render overnight. Took way to long, but at least it looked ok...
Think I have to get a bit more familiar with how all the settings affect the scene. Right now I feel that I'm walking in the dark
This looks like a good place to start...
http://renderstuff.com/irradiance-map-vray-best-settings-cg-tutorial/