If you try to access the site now you can see that it is barley loading:
http://www.ffatest.se/
Yes the RAM isnīt overloading right now but the site isnīt loading. If I restart apache the site will work normally for a while again before it stops loading again. If you wait long enough, a couple of hours, the RAM will overload.
If I use mod php instead of PHP-FPM the site will load normally and the RAM will never overload, this only happends when I use FCGI in some form.