I went ahead and installed The Perfect Server Ubuntu/Postfix/Dovecot ISPConfig on another server and the Email works fine. I'm not sure what happened to the previous server but it was just nothing but trouble and months of nonsense.
Everything is working as it should since I did the install from beginning to end on the new server. Thanks for all the help.
I'm not sure how to feel about this as, I didn't resolve the problem, I just did a work-around.