I have 4GB as well... Maybe it's subjective, but it doesn't feel slow to me at all. I've run WinXP on this same machine before.
- RootServer running ISPconfig 2 on Debian Lenny
- vServer running PLESK 8.4 on openSUSE 10.3
- vServer running PLESK 9 on Ubuntu