Mailfilter folders / files not created

Discussion in 'General' started by James A, Jan 28, 2011.

  1. James A

    James A Member HowtoForge Supporter

    Hi, we have been using ISPConfig successfully for about a year. Recently we found that adding auto responders / custom mail filters stopped working as the required files and directories weren't being created wasn't (we were running V3.0.1.6 at the time).

    Since finding the issue we upgraded to believing this may fix the issue. Unfortunately it didn't so we started to look into it in a lot greater detail.

    First thing we found after enabling debug was that the job queue had backed up with the .ispconfig_lock file being present. We manually deleted this, however this was recreated everytime ran and no job progress occurred.

    As we had created numerous jobs ourselves when testing the autoresponder we decided the most appropriate thing was to try and clear the job queue. There were no records in the sys_remoteuser and we followed earlier advice to clear the sys_datalog which then cleared the queue and allowed to run successfully (or so it appears, no more permanent .ispconfig_lock file).

    Unfortunately though, we are still not able to create the autoresponder files from the GUI. and are having to manually create the files by copying the autoresponder.master and creating a vacation.message in order to get it working where required. It appears that any attempt to create files under the mailfilters directory is failing.

    For further detail, we are using courier-imap with the maildrop mailfilter syntax configured. From what we understand, it's the maildrop plugin that creates these files / folders. There is a symlink in the plugins-enabled folder for this.

    Final things to note:
    We don't appear to get any update jobs processed by and they are not appearing in the job queue. just responds with no updates even after updates have clearly been made.

    Even with debug enabled we don't appear to get any error or warning messages, and apart from this issue the servers appear to work fine.

    Any help would be gratefully appreciated.
  2. manticore01

    manticore01 New Member

    Same Issue

    Hi James

    I seem to be experiencing the same issue aswell, its as if the maildrop plugin isnt firing as this is what creates the mailfilter directories if im not mistaken.
  3. James A

    James A Member HowtoForge Supporter

    Hi Manticore

    Yeah this is a really weird one although I'm sure there's an easy fix. No doubt when Till or Falco get a chance to read this post they'll point us in the right direction.:)
  4. till

    till Super Moderator Staff Member ISPConfig Developer

    @James: Most likely your problem is not related to mail filters. I guess that your system daemon is not writing changes at all at the moment. Please check if other changes like creating a new website gets written to disk.

    @manticore: Please check that you reaally use courier. In almost al current poerfect setup guides we use dovecot and not courier.

    I dont think that there is a problem at all, the folders that you think are missing are only used by courier pop3 / imap daemon. So on all other systems that use dovecot, thes efolders are not there and shall not be there as dovecot stores the rules in the .sieve file which is in the maildir an not a separate mail
  5. James A

    James A Member HowtoForge Supporter

    Hi Till

    As suggested I tried creating a website and your assumption was correct, no files / folders were created in the var/www/clients directory. Looking at the job queue nothing appears to have been added and no updates found when ran.

    It is probably worth noting if I create a new email address then I do get folders created under the var/vmail/ folder.

    So if the problem is that the system daemon isn't writing changes how do I fix that (apologies if this is a stupid question)?

  6. James A

    James A Member HowtoForge Supporter

    Hi All

    This is still a problem for me and I would really appreciate some help.

    If the issue is as Till suggests, that the system Daemon isn't writing changes at all at the moment how do I get it going again. Please note I'm assuming this is correct as I can't create a new website but I can create email accounts under var/vmail.

    Any help would be appreciated :confused:
  7. till

    till Super Moderator Staff Member ISPConfig Developer

    Email accounts get created automatically by postfix and maildrop or deliver when a email arrives, this is no indication that any config files get written to disk.

    So the jobqueue is empty at the moment?
  8. James A

    James A Member HowtoForge Supporter

    Yup, no jobs at present
  9. till

    till Super Moderator Staff Member ISPConfig Developer

    Please edit the root crontab by running the command:

    crontab -e

    and comment out the cronjob line by adding a # in the first line. Then create a new website or email mailbox in ispconfig and check the ispconfig monitor, a item must show up in the jobqueue then.
  10. James A

    James A Member HowtoForge Supporter

    Hi Till

    I have just run a few tests, adding an autoresponder to a mailbox and then checking the job queue and confirm they aren't being added. I also checked the system-log which simply shows:

    2011-03-10 16:28 Debug Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
    2011-03-10 16:28 Debug No Updated records found, starting only the core.
    2011-03-10 16:28 Debug Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock

    so it doesn't look as though I'm just being slow and the job is processing.

    What does happen is the change appears to get written to the ISPConfig database as the change is shown when I go back to the email account in question.
  11. James A

    James A Member HowtoForge Supporter

    Hi Till

    Just tried your suggested test, unfortunately still nothing in the job queue.
  12. James A

    James A Member HowtoForge Supporter

    Hi Till

    Just checking the mailuser database table, I can confirm that the account is appearing to update on mysql. Here's the output form one of the tests adding an autoresponder and custom filter:

    mailuser_id: 40
    sys_userid: 1
    sys_groupid: 0
    sys_perm_user: riud
    sys_perm_group: riud
    server_id: 1
    email: [email protected]
    password: xxxxxxxxxx
    uid: 5000
    gid: 5000
    maildir: /var/vmail/
    quota: 529530880
    homedir: /var/vmail
    autoresponder: y
    autoresponder_start_date: 2011-03-10 16:25:00
    autoresponder_end_date: 2011-03-12 00:00:00
    autoresponder_text: help me
    move_junk: n
    custom_mailfilter: cc: [email protected]
    postfix: y
    access: n
    disableimap: n
    disablepop3: n
    disabledeliver: n
    disablesmtp: n
  13. James A

    James A Member HowtoForge Supporter

    Hi Till

    Sorry to keep pestering but I'm hoping I can get to the bottom of this shortly. Can you tell me where the raw data for the job queue displayed in ISPConfig is stored, I assume it is in the sys_datalog table. This currently has jobs listed in it, hence I wanted to know which process is used to retrieve this job queue so I can check this.

    I guess my concern is that ever since we truncated the sys_datalog table to clear the jobs that were simply stacking up we found the jobs queue stopped being added to (apologies if this was not clear from my earlier email).
  14. till

    till Super Moderator Staff Member ISPConfig Developer

    Ok, then its clear what the problem is, you should have mentioned that in the first post! Never delete records manually in the sys_datalog or you will break the system! The jobs in sys_datalog are cleared automatically by ispconfig, so do not touch this table.

    If you truncate the table, then you reset the auto incremenet ID's of the table which causes the server jobs to get out of sync.

    To fix the problem, edit the server record in the server table and set the value of the updated column to 1.
  15. James A

    James A Member HowtoForge Supporter

    Hi Till

    It Works! :D

    My bad, I had mentioned clearing sys_datalog but not specified that we had truncated this in order to clear it. Out of interest, the only reason we truncated the table was bacause the system wouldn't clear the jobqueue, is there any other way to clear it?

    Once again many thanks for all your support and for a great product.

Share This Page