Maildir: Permission denied

[phantomk]

I have been able to get mail sending and recieveing working perfectly useing the guides:
http://www.howtoforge.com/perfect_setup_debian_sarge
and with help from
http://www.howtoforge.com/forums/showthread.php?t=2

However, I am only able to get email working if I CHMOD the following directorys to 0777:
/home/user_x/Maildir
/home/user_x/Maildir/cur
/home/user_x/Maildir/new
/home/user_x/Maildir/tmp

Now I don't want to CHMOD the directorys 0777 so my question is, how do I go about fixing this ? What user do I need to set the permissions too ?

Kudos on the great guide