Urgent: All Webs have no more quota left

[virtualweb]

Hi,

please give me a hint what i could try to solve my following problem:

Over night all Websites are over Quota - and no Mails were accepted anymore.

As workaround i gave all Clients Tons of quota. The Mails can be accepted now.

But none of the Website was really over the quota, for example:

The Mail from ISPConfig says:
Group: web27
Used Storage Space: 317.23 MB
Allocated Storage Space: 250.00 MB

This does'nt accept mails, the error is:

imapd-ssl: Failed to create cache file: maildir_lock (xxx)
imapd-ssl: Error: Disk quota exceeded

A manual du -hs as root gives: 149MB
As admispconfig the du command returns 76MB


AS this is a serious Problem and many Cleints are abused, i urge for help on this problem!
T.I.A.

[falko]

What are the outputs of df -h, repquota -avug and ls -la /tmp?

Can you check if there are huge log files in the log directory of each web site?

[virtualweb]

Hi Falko,

What are the outputs of df -h
Dateisystem Größe Benut Verf Ben% Eingehängt auf
/dev/md1 365G 86G 261G 25% /
tmpfs 991M 0 991M 0% /lib/init/rw
udev 10M 44K 10M 1% /dev
tmpfs 991M 0 991M 0% /dev/shm
repquota -avug
*** Report for user quotas on device /dev/md1
Block grace time: 7days; Inode grace time: 7days
Block limits File limits
User used soft hard grace used soft hard grace
----------------------------------------------------------------------
root -- 56698832 0 0 111530 0 0
daemon -- 40 0 0 10 0 0
bin -- 4 0 0 1 0 0
man -- 564 0 0 16 0 0
mail -- 39108 0 0 1046 0 0
news -- 4 0 0 1 0 0
www-data -- 2527024 0 0 9880 0 0
nobody -- 1428892 0 0 95370 0 0
fetchmail -- 4 0 0 1 0 0
bind -- 72 0 0 18 0 0
mysql -- 453620 0 0 8754 0 0
postfix -- 22556 0 0 4554 0 0
ftp -- 4 0 0 1 0 0
ntp -- 148 0 0 21 0 0
admispconfig -- 220672 0 0 8097 0 0
[...]
<web27> -- 202148 0 0 11826 0 0
[...]
*** Report for group quotas on device /dev/md1
Block grace time: 7days; Inode grace time: 7days
Block limits File limits
Group used soft hard grace used soft hard grace
----------------------------------------------------------------------
root -- 56139204 0 0 110923 0 0
daemon -- 36 0 0 9 0 0
bin -- 4 0 0 1 0 0
adm -- 299720 0 0 218 0 0
tty -- 28 0 0 2 0 0
mail -- 40520 0 0 1152 0 0
news -- 16 0 0 4 0 0
dip -- 24 0 0 6 0 0
www-data -- 1377088 0 0 7175 0 0
src -- 4 0 0 1 0 0
shadow -- 120 0 0 11 0 0
utmp -- 4684 0 0 8 0 0
sasl -- 20 0 0 2 0 0
staff -- 151604 0 0 1403 0 0
users -- 20 0 0 5 0 0
nogroup -- 136 0 0 10 0 0
crontab -- 40 0 0 3 0 0
ssh -- 4 0 0 1 0 0
bind -- 176 0 0 24 0 0
mysql -- 320816 0 0 8729 0 0
ssl-cert -- 8 0 0 2 0 0
postfix -- 22428 0 0 4535 0 0
postdrop -- 32 0 0 9 0 0
ntp -- 148 0 0 21 0 0
admispconfig -- 220228 0 0 8091 0 0
[...]
web27 +- 324868 256000 257024 6days 20651 0 0
[...]
and ls -la /tmp?
insgesamt 32K
drwxrwxrwt 4 root root 20K 2008-03-31 08:30 .
drwxr-xr-x 22 root root 4,0K 2008-03-12 11:36 ..
drwxrwxrwt 2 root root 4,0K 2008-03-28 10:40 .ICE-unix
drwxrwxrwt 2 root root 4,0K 2008-03-28 10:40 .X11-unix
[QUOTE]Can you check if there are huge log files in the log directory of each web site?
The Logs in web27 (for example) are 15M - the Log Size of the web web27 in ISPConfig Options is set to 1%

The Quota Mail (5 hours ago) says that web27 has used 317MB of 250MB

[virtualweb]

For that example web (web27) In ISPConfig no user is marked as Admin, so the files in the web directory are owned by www-data

l /var/www/ | grep web27
drwxr-xr-x 15 www-data web27 4,0K 2008-01-10 00:06 web27
lrwxrwxrwx 1 www-data web27 14 2007-12-28 23:43 www.example.com -> /var/www/web27

l /var/www/web27/
insgesamt 56K
drwxr-xr-x 2 root root 4,0K 2006-07-24 12:39 bin
drwxr-xr-x 2 www-data web27 4,0K 2006-07-24 12:37 cgi-bin
drwxr-xr-x 2 root root 4,0K 2006-07-24 12:39 etc
-rw-rw-r-- 1 root web27 36 2008-03-30 04:11 .htpasswd
drwxr-xr-x 2 root root 4,0K 2006-07-24 12:39 lib
drwxr-xr-x 2 root root 4,0K 2006-07-24 12:39 lib64
drwxr-xr-x 5 www-data web27 4,0K 2008-03-02 00:30 log
drwxrwxrwx 2 www-data web27 4,0K 2006-07-24 12:37 phptmp
drwxr-xr-x 2 www-data web27 4,0K 2006-07-24 12:37 ssl
drwxr-xr-x 3 www-data web27 4,0K 2006-07-24 12:39 user
drwxr-xr-x 4 root root 4,0K 2006-07-24 12:39 usr
drwxrwxr-x 3 example.com_office web27 4,0K 2006-07-24 12:55 var
drwxr-xr-x 28 www-data web27 4,0K 2008-01-10 00:06 web


Is it mandatory that at least one user is marked as admin?




Another web which is not working has an admin marked user and his quote is -1 ins ISPConfig, so i think it doesn't matter if no user is marked as admin.

[till]

It is recommended that one user is the administrator of the website.

Another web which is not working has an admin marked user and his quote is -1 ins ISPConfig, so i think it doesn't matter if no user is marked as admin.

Please set the quota limit of the website to a higher value or to -1. The quota of the website is the group quota and the quota of the administrator user is the userquota of the site.

[virtualweb]

Please set the quota limit of the website to a higher value or to -1. The quota of the website is the group quota and the quota of the administrator user is the userquota of the site.
I increased the quota limit of each website by 1gb. It works now but this is hopefully only a workaround?

What permissions must the files/folders have for getting the correct quota Infos?

If the real quota is smaller then 20% of what in the Statistics is shown, we must either increase the website by 20% or inform the customers when they have reached their real limit?

Isn't there a better way to get this problem solved?

[till]

Why should this be a workaoround? According to your repquota output, everything is working correctly, just the quota was full.

If the quota size is not shown correctly, you will have to reconfigure the du command to be executed with root permissions:

http://www.howtoforge.com/forums/showthread.php?t=2064

[virtualweb]

OK i reconfigured the du command, logged in as admispconfig and ran the command. (du -hs .)

All Maildirs are not allowed to something:

du: »./user/example.com_user/Maildir«: Keine Berechtigung (No Permission)

I chmodded the Maildirs to 755 for testing, the du command then runs without the permission error.

But when i change/add a user in ISPConfig all the permissions of the Maildirs in the corresponding web are reverted so that the du command will give the error above.

-----

The web uses "real" 450MB

When i set the quota to the web to 600MB (or 1000MB or 1100MB) and send emails to this user i get them back with the error "disk quota exceeded".

This is the mail system at host example.com.

I'm sorry to have to inform you that your message could not
be delivered to one or more recipients. It's attached below.

For further assistance, please send mail to postmaster.

If you do so, please include this problem report. You can
delete your own text from the attached returned message.

The mail system

<example.com_user@example.com>
(expanded from
<user@example.com>):
can't create user output file. Command output:
/bin/cat: write error: Disk quota exceeded procmail: Program failure (1) of
"/home/admispconfig/ispconfig/tools/clamav/bin/clamassassin"
procmail:
Rescue of unfiltered data succeeded procmail: Quota exceeded while writing
".Junk/tmp/1207122466.15616_1.HOSTNAME" procmail: Quota exceeded
while
writing
"/var/www/web28/user/example.com_user/.//Maildir/tmp/1207122466.15616_2.HOSTNAME";
[ Delivery (message/delivery-status 7bit) not shown]

I changed the quota to 1500MB and no quota errors appeared - everything works fine then.

-----

Is there any solution for this? Do i really must give the user a quota of 500MB even he only should have 250MB? All the alert Emails and Statistics would be obsolete?

[till]

Is there any solution for this?

Everything is fine. Please do just what is described in the thread above. You can not test the du command as any login user on the shell manually as the sudo configuration is only for the admispconfig user!

[virtualweb]

Everything is fine. Please do just what is described in the thread above. You can not test the du command as any login user on the shell manually as the sudo configuration is only for the admispconfig user!

Dear Till,

thanks for your patience. I tried all of the above but nothing works for me, i must give 900MB Quota to a web which is only allowed to use 250MB. A lesser Quota results in exceeded quota errors.

I can assign unlimited Webspace to all the webs and set the quota of the admin user to 5MB but this makes no sense - neither i receive warning mails nor i have an overview of the stats of the web.

Am i the only one who has this problem?

TIA.

[falko]

Can you check the /tmp directory and also the logs directories of your web sites if there are large files/unused log files that can be deleted?

[virtualweb]

The /tmp directory is empty, the log directory is 30MB.

This are the stats in ISPConfig
Speicherplatz gesamt: 5000 MB
verbraucht: 458.68M

/lib64 100K
/cgi-bin 4.0K
/phptmp 4.0K
/ssl 4.0K
/var 12K
/bin 1.2M
/log 30M
/lib 2.1M
/user 337M
/web 82M
/etc 12K
/usr 2.0M
DB::MySQL 5813.1k
The web uses "real" 460MB

I must give at leat 1200MB Quota to the web which is only allowed to use 600MB. A lesser Quota results in exceeded quota errors.

[falko]

I've added this to our bugtracker; we'll check this.

[flipkick]

Hi virtualweb,

I can't reproduce your problem.

Your output of repquota:


Block limits File limits
Group used soft hard grace used soft hard grace
----------------------------------------------------------------------
web27 +- 324868 256000 257024 6days 20651 0 0


..says the same as the notification mail:


The Quota Mail (5 hours ago) says that web27 has used 317MB of 250MB

Both say, that web27 has exceeded its quota limit.
To give web27 more than 250MB quota, change it in the ispconfig frontend in the settings for the website web27.

cheers,
flip

[Norman]

I can confirm that I too get a lot more quota messages and full boxes with the latest patch.
Seems to be due to the antivirus scanning but it has gone through the roof on this latest patch.

[till]

Please switch to Clamd instead of Clamscan:

http://www.howtoforge.com/forums/showthread.php?t=16204

or use the Clamd from your Linux distribution.

There has nothing been patched in ISPConfig, the problem is the latest ClamAV version that got even worse when it comes to deleting its own temp files.

[virtualweb]

hi,

for those with the same problem. i found out there was a backup of my www-directory in the /home directory.

when logged in as admispconfig on the shell and type "du -hs" there are errors on some directories (.spamassassin and .Maildir) but the quota in ispconfig shows the correct size.

so the quota command is system-wide and not only in /var/www/*

now it is all correct, it was no error in ispconfig.

thanks for the help!