Mirroring Questions

[nayr]

Ive got 2 identical servers I am trying to do a master-master cluster with.

I have mysql running in master-master replication successfully across both servers and using DRBD + OCFS2 I also have a shared filesystem for www/vmail.

I installed them both identically, websvs1 & websvs2; and configured websvs2 to be a mirror of websvs1 in ISPConfig3.

My first test was to add a client & site, websvs1 created the directory structure and its visible from websvs2.. however the system users accounts were not created on websvs2 so the UID/GID of the files are unknown from second server... did I mess something up or is this expected? Should i just start syncing the passwd/shadow/group files using something else? (csync2 perhaps). I kinda expected the system user accounts to mirror each-other.

Regards,
Ryan

[till]

Please ensure that the mysql master-master replication excludes the "mysql" and the ispconfig databases on both servers. ISPConfig is syncing the contents of these databases internally and ispconfig will fail if these databases are mirrored otherwise.

[nayr]

The mysql table is not replicated and I have both servers configured to use seperate databases (dbispconfig1 & dbispconfig2)..

I even have a 3rd server mirroring the first that I am hoping to use for shells/ftp thats not a member of the mysql-cluster and gets its filesys via NFS off the cluster.. That server is configured pretty close to the first two and runs in a VM, its not getting any updates to the passwd/shadow/group files so far..

I havent done much testing past simply creating a user and site, I had no problems mirroring DNS services on external servers when I tested it..

Only thing in the cron-logs on websvs2 is:

PHP Warning: Invalid argument supplied for foreach() in /usr/local/ispconfig/server/mods-available/monitor_core_module.inc.php on line 1118
/bin/sh: /usr/local/bin/run-getmail.sh: Permission denied
repquota: Operation not supported for filesystems with hidden quota files!
repquota: Operation not supported for filesystems with hidden quota files!

[till]

/usr/local/bin/run-getmail.sh

Seems as if the getmail user ahs no permissions to run that script on your server.

repquota: Operation not supported for filesystems with hidden quota files!
repquota: Operation not supported for filesystems with hidden quota files!

There must be a config problem with your Linux file system quota. Please check with:

repquota -avug

Regarding the config replication problem, most likely there is a problem with mysql permissions, so that the slave can not connect to the mysql master database. Please enable loglevel debug for the salve server in ispconfig master controlpanel and then run this command on the slave as root user and post the output:

/usr/local/ispconfig/server/server.sh

[nayr]

I fixed the getmail.sh, was being denied by Trusted Path Execution (TPE) in GrSecurity, had to tweak permissions but its working now.

The quota error is apparently an issue with OCFS2, it does not support repquota.. I dunno what to do bout it other than look for a upstream fix of somesort.

I'll check out debug logs here shortly and see if that sheds any light.

[nayr]

websvs1:

26.08.2011-15:19 - DEBUG - Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:19 - DEBUG - Found 4 changes, starting update process.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'apps_vhost_plugin' raised by event 'server_update'.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'network_settings_plugin' raised by event 'server_update'.
26.08.2011-15:19 - WARNING - Network configuration disabled in server settings.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'postfix_server_plugin' raised by event 'server_update'.
26.08.2011-15:19 - DEBUG - Processed datalog_id 23
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'apps_vhost_plugin' raised by event 'server_update'.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'network_settings_plugin' raised by event 'server_update'.
26.08.2011-15:19 - WARNING - Network configuration disabled in server settings.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'postfix_server_plugin' raised by event 'server_update'.
26.08.2011-15:19 - DEBUG - Processed datalog_id 24
26.08.2011-15:19 - DEBUG - Calling function 'ssl' from plugin 'apache2_plugin' raised by event 'web_domain_delete'.
26.08.2011-15:19 - DEBUG - Calling function 'delete' from plugin 'apache2_plugin' raised by event 'web_domain_delete'.
26.08.2011-15:19 - DEBUG - Removing symlink: /etc/apache2/sites-enabled/nayr.com.vhost =>
26.08.2011-15:19 - DEBUG - Removing vhost file: /etc/apache2/sites-available/nayr.com.vhost
26.08.2011-15:19 - DEBUG - Removing website: /var/www/clients/client1/web3
26.08.2011-15:19 - DEBUG - Removing symlink: /var/www/nayr.com
26.08.2011-15:19 - DEBUG - Removing symlink: /var/www/clients/client1/nayr.com
26.08.2011-15:19 - DEBUG - Removing website logfile directory: /var/log/ispconfig/httpd/nayr.com
26.08.2011-15:19 - DEBUG - Processed datalog_id 27
26.08.2011-15:19 - DEBUG - Calling function 'ssl' from plugin 'apache2_plugin' raised by event 'web_domain_insert'.
26.08.2011-15:19 - DEBUG - Calling function 'insert' from plugin 'apache2_plugin' raised by event 'web_domain_insert'.
26.08.2011-15:19 - DEBUG - Creating Symlink: ln -s /var/log/ispconfig/httpd/nayr.com /var/www/clients/client0/web4/log
26.08.2011-15:19 - DEBUG - Creating Symlink: ln -s /var/www/clients/client0/web4/ /var/www/nayr.com
26.08.2011-15:19 - DEBUG - Creating Symlink: ln -s /var/www/clients/client0/web4/ /var/www/clients/client0/nayr.com
26.08.2011-15:19 - DEBUG - Adding the group: client0
26.08.2011-15:19 - DEBUG - Adding the user: web4
26.08.2011-15:19 - DEBUG - exec: chown -R web4:client0 /var/www/clients/client0/web4
26.08.2011-15:19 - DEBUG - exec: chown web4:client0 /var/www/clients/client0/web4
26.08.2011-15:19 - DEBUG - exec: chmod 751 /var/www/clients/client0/web4/
26.08.2011-15:19 - DEBUG - exec: chmod 751 /var/www/clients/client0/web4/*
26.08.2011-15:19 - DEBUG - exec: chmod 710 /var/www/clients/client0/web4/web
26.08.2011-15:19 - DEBUG - exec: chmod 777 /var/www/clients/client0/web4/tmp
26.08.2011-15:19 - DEBUG - exec: chmod 755 /var/www/clients/client0/web4/log
26.08.2011-15:19 - DEBUG - exec: usermod --groups sshusers web4
26.08.2011-15:19 - DEBUG - exec: chown web4:client0 /var/www/clients/client0/web4
26.08.2011-15:19 - DEBUG - exec: chown web4:client0 /var/www/clients/client0/web4/log/error.log
26.08.2011-15:19 - DEBUG - Disable SSL for:
26.08.2011-15:19 - DEBUG - Creating fastcgi starter script directory: /var/www/php-fcgi-scripts/web4/
26.08.2011-15:19 - DEBUG - Creating fastcgi starter script: /var/www/php-fcgi-scripts/web4/.php-fcgi-starter
26.08.2011-15:19 - DEBUG - Writing the vhost file: /etc/apache2/sites-available/nayr.com.vhost
26.08.2011-15:19 - DEBUG - Creating the symlink: /etc/apache2/sites-enabled/nayr.com.vhost => /etc/apache2/sites-available/nayr.com.vhost
26.08.2011-15:19 - DEBUG - Apache status is: 1
26.08.2011-15:19 - DEBUG - Calling function 'restartHttpd' from module 'web_module'.
26.08.2011-15:19 - DEBUG - Apache online status after restart is: 1
26.08.2011-15:19 - DEBUG - Processed datalog_id 28
26.08.2011-15:19 - DEBUG - Calling function 'restartHttpd' from module 'web_module'.
26.08.2011-15:19 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:20 - DEBUG - Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:20 - DEBUG - No Updated records found, starting only the core.
26.08.2011-15:20 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:21 - DEBUG - Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:21 - DEBUG - No Updated records found, starting only the core.
26.08.2011-15:21 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:22 - DEBUG - Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:22 - DEBUG - No Updated records found, starting only the core.
26.08.2011-15:22 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock

websvs2:

26.08.2011-15:19 - DEBUG - Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:19 - DEBUG - Found 8 changes, starting update process.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'apps_vhost_plugin' raised by event 'server_update'.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'network_settings_plugin' raised by event 'server_update'.
26.08.2011-15:19 - WARNING - Network configuration disabled in server settings.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'postfix_server_plugin' raised by event 'server_update'.
26.08.2011-15:19 - DEBUG - Processed datalog_id 21
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'apps_vhost_plugin' raised by event 'server_update'.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'network_settings_plugin' raised by event 'server_update'.
26.08.2011-15:19 - WARNING - Network configuration disabled in server settings.
26.08.2011-15:19 - DEBUG - Calling function 'update' from plugin 'postfix_server_plugin' raised by event 'server_update'.
26.08.2011-15:19 - DEBUG - Processed datalog_id 22
26.08.2011-15:19 - DEBUG - Calling function 'restartHttpd' from module 'web_module'.
26.08.2011-15:19 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:20 - DEBUG - Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:20 - DEBUG - Found 4 changes, starting update process.
26.08.2011-15:20 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:21 - DEBUG - Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
26.08.2011-15:21 - DEBUG - Found 4 changes, starting update process.
26.08.2011-15:21 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock