Just to let you know, I figured out why the error was occurring, well at least for me
Make sure you do not have the following in main.cf for postfix:
Code:
smtp_bind_address = Your.I.P.Address
Not sure why it causes the problem, all I know is that once I commented the above line out, it worked like a charm