ISPConfig v3, PowerDNS and cluster

[adminnc]

Hello,
I'm trying to do a 2 Ubuntu 10.04 servers cluster with ispc3 and powerdns :
- server 1 with web, mysql, dns, mail etc
- server 2 with dns replicated from server 1

I've follow 'The Perfect Server – Ubuntu 10.04 [ISPConfig 3]' and the 'Installing A Multiserver Setup With Dedicated Web, Email, DNS And MySQL Database Servers On Debian 5.0 With ISPConfig 3' for the clustering howto

All seems ok but I've notice that if I'm turning off pdns & pdns-recursor on server 1, server 2 can't resolv anymore !
I don't have any resolver in /etc/resolv.conf and there isn't server 1 in any pdns config files.

Then I've put '2' for $conf["log_priority"] in /usr/local/ispconfig/server/lib/config.inc.php and launch the server.sh script as root user (no su or sudo, but logged as root), I can see no errors, just some warnings about 'PHP Deprecated: Comments starting with '#' are deprecated'

So I've check the databases 'dbispconfig' and 'powerdns' : none of the dns_* tables are replicated, and none of the 'powerdns' tables too.

So is it normal and how can I do to have the server 2 completely autonomous with its own records ?

[adminnc]

Hi again,

I've found the /etc/resolv.conf error why the dns server 2 was depending about server 1, but I can't find why there is no replication about dns records between the 2 servers.

here is the output from server.sh on server 2 :

PHP Deprecated: Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/imagick.ini on line 1 in Unknown on line 0
PHP Deprecated: Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/imap.ini on line 1 in Unknown on line 0
PHP Deprecated: Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/mcrypt.ini on line 1 in Unknown on line 0
10.09.2010-11:55 - DEBUG - Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
10.09.2010-11:55 - DEBUG - Found 20 changes, starting update process.
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 1
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_ user`,`sys_perm_group`,`sys_perm_other`,`company_n ame`,`contact_name`,`street`,`zip`,`city`,`state`, `country`,`telephone`,`mobile`,`fax`,`email`,`inte rnet`,`icq`,`notes`,`default_mailserver`,`limit_ma ildomain`,`limit_mailbox`,`limit_mailalias`,`limit _mailaliasdomain`,`limit_mailforward`,`limit_mailc atchall`,`limit_mailrouting`,`limit_mailfilter`,`l imit_fetchmail`,`limit_mailquota`,`limit_spamfilte r_wblist`,`limit_spamfilter_user`,`limit_spamfilte r_policy`,`default_webserver`,`limit_web_ip`,`limi t_web_domain`,`limit_web_quota`,`web_php_options`, `limit_web_subdomain`,`limit_web_aliasdomain`,`lim it_ftp_user`,`limit_shell_user`,`ssh_chroot`,`defa ult_dnsserver`,`limit_dns_zone`,`limit_dns_record` ,`default_dbserver`,`limit_database`,`limit_cron`, `limit_cron_type`,`limit_cron_frequency`,`limit_tr affic_quota`,`limit_client`,`parent_client_id`,`us ername`,`password`,`language`,`usertheme`,`templat e_master`,`template_additional`,`created_at`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 2
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 3
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_ user`,`sys_perm_group`,`sys_perm_other`,`company_n ame`,`contact_name`,`street`,`zip`,`city`,`state`, `country`,`telephone`,`mobile`,`fax`,`email`,`inte rnet`,`icq`,`notes`,`default_mailserver`,`limit_ma ildomain`,`limit_mailbox`,`limit_mailalias`,`limit _mailaliasdomain`,`limit_mailforward`,`limit_mailc atchall`,`limit_mailrouting`,`limit_mailfilter`,`l imit_fetchmail`,`limit_mailquota`,`limit_spamfilte r_wblist`,`limit_spamfilter_user`,`limit_spamfilte r_policy`,`default_webserver`,`limit_web_ip`,`limi t_web_domain`,`limit_web_quota`,`web_php_options`, `limit_web_subdomain`,`limit_web_aliasdomain`,`lim it_ftp_user`,`limit_shell_user`,`ssh_chroot`,`defa ult_dnsserver`,`limit_dns_zone`,`limit_dns_record` ,`default_dbserver`,`limit_database`,`limit_cron`, `limit_cron_type`,`limit_cron_frequency`,`limit_tr affic_quota`,`limit_client`,`parent_client_id`,`us ername`,`password`,`language`,`usertheme`,`templat e_master`,`template_additional`,`created_at`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 4
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_ user`,`sys_perm_group`,`sys_perm_other`,`company_n ame`,`contact_name`,`street`,`zip`,`city`,`state`, `country`,`telephone`,`mobile`,`fax`,`email`,`inte rnet`,`icq`,`notes`,`default_mailserver`,`limit_ma ildomain`,`limit_mailbox`,`limit_mailalias`,`limit _mailaliasdomain`,`limit_mailforward`,`limit_mailc atchall`,`limit_mailrouting`,`limit_mailfilter`,`l imit_fetchmail`,`limit_mailquota`,`limit_spamfilte r_wblist`,`limit_spamfilter_user`,`limit_spamfilte r_policy`,`default_webserver`,`limit_web_ip`,`limi t_web_domain`,`limit_web_quota`,`web_php_options`, `limit_web_subdomain`,`limit_web_aliasdomain`,`lim it_ftp_user`,`limit_shell_user`,`ssh_chroot`,`defa ult_dnsserver`,`limit_dns_zone`,`limit_dns_record` ,`default_dbserver`,`limit_database`,`limit_cron`, `limit_cron_type`,`limit_cron_frequency`,`limit_tr affic_quota`,`limit_client`,`parent_client_id`,`us ername`,`password`,`language`,`usertheme`,`templat e_master`,`template_additional`,`created_at`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 5
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 6
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_ user`,`sys_perm_group`,`sys_perm_other`,`company_n ame`,`contact_name`,`street`,`zip`,`city`,`state`, `country`,`telephone`,`mobile`,`fax`,`email`,`inte rnet`,`icq`,`notes`,`default_mailserver`,`limit_ma ildomain`,`limit_mailbox`,`limit_mailalias`,`limit _mailaliasdomain`,`limit_mailforward`,`limit_mailc atchall`,`limit_mailrouting`,`limit_mailfilter`,`l imit_fetchmail`,`limit_mailquota`,`limit_spamfilte r_wblist`,`limit_spamfilter_user`,`limit_spamfilte r_policy`,`default_webserver`,`limit_web_ip`,`limi t_web_domain`,`limit_web_quota`,`web_php_options`, `limit_web_subdomain`,`limit_web_aliasdomain`,`lim it_ftp_user`,`limit_shell_user`,`ssh_chroot`,`defa ult_dnsserver`,`limit_dns_zone`,`limit_dns_record` ,`default_dbserver`,`limit_database`,`limit_cron`, `limit_cron_type`,`limit_cron_frequency`,`limit_tr affic_quota`,`limit_client`,`parent_client_id`,`us ername`,`password`,`language`,`usertheme`,`templat e_master`,`template_additional`,`created_at`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 7
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 8
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_ user`,`sys_perm_group`,`sys_perm_other`,`company_n ame`,`contact_name`,`street`,`zip`,`city`,`state`, `country`,`telephone`,`mobile`,`fax`,`email`,`inte rnet`,`icq`,`notes`,`default_mailserver`,`limit_ma ildomain`,`limit_mailbox`,`limit_mailalias`,`limit _mailaliasdomain`,`limit_mailforward`,`limit_mailc atchall`,`limit_mailrouting`,`limit_mailfilter`,`l imit_fetchmail`,`limit_mailquota`,`limit_spamfilte r_wblist`,`limit_spamfilter_user`,`limit_spamfilte r_policy`,`default_webserver`,`limit_web_ip`,`limi t_web_domain`,`limit_web_quota`,`web_php_options`, `limit_web_subdomain`,`limit_web_aliasdomain`,`lim it_ftp_user`,`limit_shell_user`,`ssh_chroot`,`defa ult_dnsserver`,`limit_dns_zone`,`limit_dns_record` ,`default_dbserver`,`limit_database`,`limit_cron`, `limit_cron_type`,`limit_cron_frequency`,`limit_tr affic_quota`,`limit_client`,`parent_client_id`,`us ername`,`password`,`language`,`usertheme`,`templat e_master`,`template_additional`,`created_at`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 9
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO remote_user (`remote_userid`,`sys_userid`,`sys_groupid`,`sys_p erm_user`,`sys_perm_group`,`sys_perm_other`,`remot e_username`,`remote_password`,`remote_functions`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 23
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO remote_user (`remote_userid`,`sys_userid`,`sys_groupid`,`sys_p erm_user`,`sys_perm_group`,`sys_perm_other`,`remot e_username`,`remote_password`,`remote_functions`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 24
10.09.2010-11:55 - DEBUG - Replicated from master: DELETE FROM client WHERE client_id = 3
10.09.2010-11:55 - DEBUG - Processed datalog_id 83
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO remote_user (`remote_userid`,`sys_userid`,`sys_groupid`,`sys_p erm_user`,`sys_perm_group`,`sys_perm_other`,`remot e_username`,`remote_password`,`remote_functions`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 86
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 106
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_ user`,`sys_perm_group`,`sys_perm_other`,`company_n ame`,`contact_name`,`street`,`zip`,`city`,`state`, `country`,`telephone`,`mobile`,`fax`,`email`,`inte rnet`,`icq`,`notes`,`default_mailserver`,`limit_ma ildomain`,`limit_mailbox`,`limit_mailalias`,`limit _mailaliasdomain`,`limit_mailforward`,`limit_mailc atchall`,`limit_mailrouting`,`limit_mailfilter`,`l imit_fetchmail`,`limit_mailquota`,`limit_spamfilte r_wblist`,`limit_spamfilter_user`,`limit_spamfilte r_policy`,`default_webserver`,`limit_web_ip`,`limi t_web_domain`,`limit_web_quota`,`web_php_options`, `limit_web_subdomain`,`limit_web_aliasdomain`,`lim it_ftp_user`,`limit_shell_user`,`ssh_chroot`,`defa ult_dnsserver`,`limit_dns_zone`,`limit_dns_record` ,`default_dbserver`,`limit_database`,`limit_cron`, `limit_cron_type`,`limit_cron_frequency`,`limit_tr affic_quota`,`limit_client`,`parent_client_id`,`us ername`,`password`,`language`,`usertheme`,`templat e_master`,`template_additional`,`created_at`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 107
10.09.2010-11:55 - DEBUG - Replicated from master: DELETE FROM server WHERE server_id = 5
10.09.2010-11:55 - DEBUG - Processed datalog_id 401
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 424
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_ user`,`sys_perm_group`,`sys_perm_other`,`company_n ame`,`contact_name`,`street`,`zip`,`city`,`state`, `country`,`telephone`,`mobile`,`fax`,`email`,`inte rnet`,`icq`,`notes`,`default_mailserver`,`limit_ma ildomain`,`limit_mailbox`,`limit_mailalias`,`limit _mailaliasdomain`,`limit_mailforward`,`limit_mailc atchall`,`limit_mailrouting`,`limit_mailfilter`,`l imit_fetchmail`,`limit_mailquota`,`limit_spamfilte r_wblist`,`limit_spamfilter_user`,`limit_spamfilte r_policy`,`default_webserver`,`limit_web_ip`,`limi t_web_domain`,`limit_web_quota`,`web_php_options`, `limit_web_subdomain`,`limit_web_aliasdomain`,`lim it_ftp_user`,`limit_shell_user`,`ssh_chroot`,`defa ult_dnsserver`,`limit_dns_zone`,`limit_dns_record` ,`default_dbserver`,`limit_database`,`limit_cron`, `limit_cron_type`,`limit_cron_frequency`,`limit_tr affic_quota`,`limit_client`,`parent_client_id`,`us ername`,`password`,`language`,`usertheme`,`templat e_master`,`template_additional`,`created_at`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 425
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 426
10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_ user`,`sys_perm_group`,`sys_perm_other`,`company_n ame`,`contact_name`,`street`,`zip`,`city`,`state`, `country`,`telephone`,`mobile`,`fax`,`email`,`inte rnet`,`icq`,`notes`,`default_mailserver`,`limit_ma ildomain`,`limit_mailbox`,`limit_mailalias`,`limit _mailaliasdomain`,`limit_mailforward`,`limit_mailc atchall`,`limit_mailrouting`,`limit_mailfilter`,`l imit_fetchmail`,`limit_mailquota`,`limit_spamfilte r_wblist`,`limit_spamfilter_user`,`limit_spamfilte r_policy`,`default_webserver`,`limit_web_ip`,`limi t_web_domain`,`limit_web_quota`,`web_php_options`, `limit_web_subdomain`,`limit_web_aliasdomain`,`lim it_ftp_user`,`limit_shell_user`,`ssh_chroot`,`defa ult_dnsserver`,`limit_dns_zone`,`limit_dns_record` ,`default_dbserver`,`limit_database`,`limit_cron`, `limit_cron_type`,`limit_cron_frequency`,`limit_tr affic_quota`,`limit_client`,`parent_client_id`,`us ername`,`password`,`language`,`usertheme`,`templat e_master`,`template_additional`,`created_at`) VALUES ...
10.09.2010-11:55 - DEBUG - Processed datalog_id 427
10.09.2010-11:55 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
finished.

[till]

Login to ispconfig on the master server, go to the server settings of the slave server and select that this server is a slave server of the master. The settings is named "is mirror of". This new setting will only affect new created domains or updated domains.

[adminnc]

Hello,

I've already done it and try to create zone, or records but no succes on replication.
So I've done a mysql replication and it is working but I will definitively prefer the ispconfig replication.
Where I can see more logs or how to force a replication ?
I've try to find docs about how to setup a module for replication, but no success, so I've inspected the code and say to me if I'm wrong but it seems it is in the sys_datalog that there is the hook.
I'm just trying to find a way to debug it more.

Thanks for your help

[till]

You can not use mysql replication and ispconfig replication togeteher as tehy are incompatible. So as long as you use mysql replication, the ispconfig replication will fail.

So the steps to fix this are:

1) disable mysql replication.
2) ensure that you installed ispconfig on the slave server in exopert mode and that you have choosen to join the master server.
3) that you selcted that the slave is a mirror of the master server in ispconfig. It is essential that this is done before any data is added on the master server as only new or updated data gets replicated.

[adminnc]

Hi Till,

Thank you for your reply
So I've stoped mysql replication and uninstall all and reinstall the server in the cluster.
I've check connection for dns server to master's mysql server and it is ok, but still nothing in powerdns database.
So I've reinstall all, master and slave, on master there is nothing in powerdns database too now... but still dbispconfig.dns_* are full of the dns settings I need.
So I think I've done something wrong with the cluster setup, my idea is to reinstall all the cluster, but I need to keep the dbispconfig database because I've already lot of customers inside.
So my question is : is it possible to ask the master to synchronize from scratch the powerdns database with the data in dbispconfig database ?

Thx