I have exactly the same problem. Increasing the php memory limit solves it. But there are sites with more than 400 megs of data in my server.
I don't think that increasing the memory limit that much is a good idea.
Another solution would be great, but I can't think of one.