upgrade path of ubuntu 14.04 -> 16.04 ispconfig 3->3.1 php 5.3->7

Discussion in 'General' started by peteruoi, Aug 14, 2016.

  1. peteruoi

    peteruoi New Member

    The title says it all... :)
    I was wondering if there 's gonna be a blog post about how to upgrade the above...
    I know you are focusing on 3.1 now and thanks for that but if possible insert this request to your todo list :)
    Ubuntu 14.04 already prompts me to upgrade and i 'd like to go php 7 the sooner!
     
  2. florian030

    florian030 ISPConfig Developer ISPConfig Developer

    upgrade ubuntu - uprade ispconfig and reconfigure services - resync websites
     
  3. peteruoi

    peteruoi New Member

    thanks for your reply!
    I have a vps and i think upgrading ubuntu without losing ssh and me locking out is little difficult...
    They sollution we usually have is putting a fresh image of ubuntu 16.04.1
    Do we install ispconfig 3 first and then upgrade to 3.1 or clean install of 3.1?
    Then can we import some folders with the websites???
    Sorry if the question is noobish but i think the answer might deserve a blog spot :)
     
  4. till

    till Super Moderator Staff Member ISPConfig Developer

    Having a headless VPS or server is the standard for hosting environments. Debian and Ubuntu can be upgraded live trough SSH.
     
  5. Icelake

    Icelake New Member HowtoForge Supporter

    Hi!
    I have been receiving the request to update my in-house ubuntu server from 14.04 LTS to ver 16.04 LTS for some time now.
    I have been reluctant to do so, though, because of the risc of getting into trouble.

    When I googled the matter and found the answer from Florian in this blog post, I found those instructions rather straight forward and decided to go along.

    After the update the server seems to work OK, but I was not able to log in to ISPConfig, so I tried to run the update process once more and this time I also said "yes" to "Reconfigure Permissions in master database". Still no luck! Apache2 will not start.

    Trying "service apache2 start" yields the answer:
    "Job for apache2.service failed because the control process exited with error code. See "systemctl status apache2.service" and "journalctl -xe" for details."

    Does someone experienced have any idea how to correct this?

    Print-outs below.

    Best regards
    //Icelake


    systemctl status apache2.service
    ================================
    ● apache2.service - LSB: Apache2 web server
    Loaded: loaded (/etc/init.d/apache2; bad; vendor preset: enabled)
    Drop-In: /lib/systemd/system/apache2.service.d
    └─apache2-systemd.conf
    Active: failed (Result: exit-code) since Thu 2016-09-22 08:08:44 CEST; 1min 56s ago
    Docs: man:systemd-sysv-generator(8)
    Process: 21611 ExecStop=/etc/init.d/apache2 stop (code=exited, status=0/SUCCESS)
    Process: 3088 ExecStart=/etc/init.d/apache2 start (code=exited, status=1/FAILURE)

    Sep 22 08:08:44 ubu2.ishem.lan apache2[3088]: (2)No such file or directory: AH02291: Cannot access directory '/var/log/ispconfig/httpd/gamlajarla.issjo.com/' for error log of vhost d
    Sep 22 08:08:44 ubu2.ishem.lan apache2[3088]: (2)No such file or directory: AH02291: Cannot access directory '/var/log/ispconfig/httpd/dag.issjo.com/' for error log of vhost defined
    Sep 22 08:08:44 ubu2.ishem.lan apache2[3088]: (2)No such file or directory: AH02291: Cannot access directory '/var/log/ispconfig/httpd/annika.issjo.com/' for error log of vhost defin
    Sep 22 08:08:44 ubu2.ishem.lan apache2[3088]: AH00014: Configuration check failed
    Sep 22 08:08:44 ubu2.ishem.lan apache2[3088]: Action 'configtest' failed.
    Sep 22 08:08:44 ubu2.ishem.lan apache2[3088]: The Apache error log may have more information.
    Sep 22 08:08:44 ubu2.ishem.lan systemd[1]: apache2.service: Control process exited, code=exited status=1
    Sep 22 08:08:44 ubu2.ishem.lan systemd[1]: Failed to start LSB: Apache2 web server.
    Sep 22 08:08:44 ubu2.ishem.lan systemd[1]: apache2.service: Unit entered failed state.
    Sep 22 08:08:44 ubu2.ishem.lan systemd[1]: apache2.service: Failed with result 'exit-code'.


    journalctl -xe
    ==============
    Sep 22 08:10:04 ubu2.ishem.lan dovecot[13566]: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=::1, lip=::1, secured, session=<2ZU8gxI90oMAAAAAAAAAAAAAAAAAAAAB>
    Sep 22 08:10:05 ubu2.ishem.lan CRON[3845]: pam_unix(cron:session): session closed for user root
    Sep 22 08:10:05 ubu2.ishem.lan pure-ftpd[4136]: (?@::1) [INFO] New connection from ::1
    Sep 22 08:10:05 ubu2.ishem.lan pure-ftpd[4136]: (?@::1) [INFO] Logout.
    Sep 22 08:10:05 ubu2.ishem.lan postfix/smtpd[32538]: connect from localhost[::1]
    Sep 22 08:10:05 ubu2.ishem.lan postfix/smtpd[32538]: lost connection after CONNECT from localhost[::1]
    Sep 22 08:10:05 ubu2.ishem.lan postfix/smtpd[32538]: disconnect from localhost[::1] commands=0/0
    Sep 22 08:10:06 ubu2.ishem.lan dovecot[13566]: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=::1, lip=::1, secured, session=<kTRkgxI9nI8AAAAAAAAAAAAAAAAAAAAB>
    Sep 22 08:10:06 ubu2.ishem.lan dovecot[13566]: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=::1, lip=::1, secured, session=<6IVkgxI94IMAAAAAAAAAAAAAAAAAAAAB>
    Sep 22 08:10:07 ubu2.ishem.lan CRON[3844]: pam_unix(cron:session): session closed for user root
    Sep 22 08:10:20 ubu2.ishem.lan CRON[3843]: pam_unix(cron:session): session closed for user getmail
    Sep 22 08:10:20 ubu2.ishem.lan CRON[3846]: pam_unix(cron:session): session closed for user root
    Sep 22 08:11:01 ubu2.ishem.lan CRON[4732]: pam_unix(cron:session): session opened for user root by (uid=0)
    Sep 22 08:11:01 ubu2.ishem.lan CRON[4731]: pam_unix(cron:session): session opened for user root by (uid=0)
    Sep 22 08:11:01 ubu2.ishem.lan CRON[4733]: (root) CMD (/usr/local/ispconfig/server/cron.sh 2>&1 | while read line; do echo `/bin/date` "$line" >> /var/log/ispconfig/cron.log; done)
    Sep 22 08:11:01 ubu2.ishem.lan CRON[4734]: (root) CMD (/usr/local/ispconfig/server/server.sh 2>&1 | while read line; do echo `/bin/date` "$line" >> /var/log/ispconfig/cron.log; done)
    Sep 22 08:11:02 ubu2.ishem.lan pure-ftpd[4744]: (?@::1) [INFO] New connection from ::1
    Sep 22 08:11:02 ubu2.ishem.lan pure-ftpd[4744]: (?@::1) [INFO] Logout.
    Sep 22 08:11:02 ubu2.ishem.lan postfix/smtpd[32538]: connect from localhost[::1]
    Sep 22 08:11:02 ubu2.ishem.lan postfix/smtpd[32538]: lost connection after CONNECT from localhost[::1]
    Sep 22 08:11:02 ubu2.ishem.lan postfix/smtpd[32538]: disconnect from localhost[::1] commands=0/0
    Sep 22 08:11:03 ubu2.ishem.lan dovecot[13566]: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=::1, lip=::1, secured, session=<xDDGhhI9to8AAAAAAAAAAAAAAAAAAAAB>
    Sep 22 08:11:03 ubu2.ishem.lan dovecot[13566]: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=::1, lip=::1, secured, session=<epLGhhI9+oMAAAAAAAAAAAAAAAAAAAAB>
    Sep 22 08:11:04 ubu2.ishem.lan CRON[4732]: pam_unix(cron:session): session closed for user root
    Sep 22 08:11:05 ubu2.ishem.lan CRON[4731]: pam_unix(cron:session): session closed for user root
    Sep 22 08:11:10 ubu2.ishem.lan clamd[13516]: SelfCheck: Database status OK.
    Sep 22 08:12:01 ubu2.ishem.lan CRON[5418]: pam_unix(cron:session): session opened for user root by (uid=0)
    Sep 22 08:12:01 ubu2.ishem.lan CRON[5419]: pam_unix(cron:session): session opened for user root by (uid=0)
    Sep 22 08:12:01 ubu2.ishem.lan CRON[5420]: (root) CMD (/usr/local/ispconfig/server/server.sh 2>&1 | while read line; do echo `/bin/date` "$line" >> /var/log/ispconfig/cron.log; done)
    Sep 22 08:12:01 ubu2.ishem.lan CRON[5421]: (root) CMD (/usr/local/ispconfig/server/cron.sh 2>&1 | while read line; do echo `/bin/date` "$line" >> /var/log/ispconfig/cron.log; done)
    li

    cron.log
    ========
    Thu 22 Sep 08:10:04 CEST 2016 22.09.2016-08:10 - ERROR - httpd is down! Rescue will not help!


    htf_report.txt
    ==============
    '
    ##### SERVER #####
    IP-address (as per hostname): ***.***.***.***
    IP-address(es) (as per ifconfig): ***.***.***.***
    [WARN] ip addresses from hostname differ from ifconfig output. Please check your ip settings.
    [INFO] ISPConfig is installed.

    ##### ISPCONFIG #####
    ISPConfig version is 3.1b1


    ##### VERSION CHECK #####

    [INFO] php (cli) version is 7.0.8-0ubuntu***.***.***.***

    ##### PORT CHECK #####

    [WARN] Port 8080 (ISPConfig) seems NOT to be listening
    [WARN] Port 8081 (ISPConfig Apps) seems NOT to be listening
    [WARN] Port 80 (Webserver) seems NOT to be listening
    [WARN] Port 443 (Webserver SSL) seems NOT to be listening

    ##### MAIL SERVER CHECK #####


    ##### RUNNING SERVER PROCESSES #####

    [WARN] I could not determine which web server is running.
    [INFO] I found the following mail server(s):
    Unknown process (smtpd) (PID 4537)
    [INFO] I found the following pop3 server(s):
    Dovecot (PID 13535)
    [INFO] I found the following imap server(s):
    Dovecot (PID 13535)
    [INFO] I found the following ftp server(s):
    PureFTP (PID 13750)

    ##### LISTENING PORTS #####
    (only ()
    Local (Address)
    [anywhere]:110 (13535/dovecot)
    [anywhere]:143 (13535/dovecot)
    [anywhere]:465 (13472/master)
    ***.***.***.***:53 (14331/named)
    [localhost]:53 (14331/named)
    [anywhere]:21 (13750/pure-ftpd)
    [anywhere]:22 (1198/sshd)
    [localhost]:953 (14331/named)
    [anywhere]:25 (4537/smtpd)
    [anywhere]:993 (13535/dovecot)
    [anywhere]:995 (13535/dovecot)
    [localhost]:10024 (13509/amavisd-new)
    [localhost]:10025 (13472/master)
    [localhost]:10026 (13509/amavisd-new)
    [localhost]:10027 (13472/master)
    [anywhere]:587 (13472/master)
    [localhost]:11211 (1201/memcached)
    [localhost]10 (13535/dovecot)
    [localhost]43 (13535/dovecot)
    *:*:*:*::*:465 (13472/master)
    *:*:*:*::*:53 (14331/named)
    *:*:*:*::*:21 (13750/pure-ftpd)
    *:*:*:*::*:22 (1198/sshd)
    *:*:*:*::*:953 (14331/named)
    *:*:*:*::*:25 (4537/smtpd)
    *:*:*:*::*:993 (13535/dovecot)
    *:*:*:*::*:995 (13535/dovecot)
    *:*:*:*::*:10024 (13509/amavisd-new)
    *:*:*:*::*:10026 (13509/amavisd-new)
    *:*:*:*::*:3306 (13267/mysqld)
    *:*:*:*::*:587 (13472/master)




    ##### IPTABLES #####
    Chain INPUT (policy ACCEPT)
    target prot opt source destination
    f2b-dovecot-pop3imap tcp -- [anywhere]/0 [anywhere]/0 multiport dports 110,995,143,993
    f2b-pureftpd tcp -- [anywhere]/0 [anywhere]/0 multiport dports 21
    f2b-postfix-sasl tcp -- [anywhere]/0 [anywhere]/0 multiport dports 25
    f2b-sshd tcp -- [anywhere]/0 [anywhere]/0 multiport dports 22

    Chain FORWARD (policy ACCEPT)
    target prot opt source destination

    Chain OUTPUT (policy ACCEPT)
    target prot opt source destination

    Chain f2b-dovecot-pop3imap (1 references)
    target prot opt source destination
    RETURN all -- [anywhere]/0 [anywhere]/0

    Chain f2b-postfix-sasl (1 references)
    target prot opt source destination
    RETURN all -- [anywhere]/0 [anywhere]/0

    Chain f2b-pureftpd (1 references)
    target prot opt source destination
    RETURN all -- [anywhere]/0 [anywhere]/0

    Chain f2b-sshd (1 references)
    target prot opt source destination
    RETURN all -- [anywhere]/0 [anywhere]/0
     
  6. florian030

    florian030 ISPConfig Developer ISPConfig Developer

    You have some missing log-dir for apache. try mount -a and restart apache.
    This is not related to the ubuntu-upgrade.
     
  7. Icelake

    Icelake New Member HowtoForge Supporter

    Florian!
    Thanks for replying!

    I hope this is what you're getting at:

    So I tried the command: mount -a (mount all) and tried to start apache2.
    Still no luck. I persistently get the answer:
    "Job for apache2.service failed because the control process exited with error code.
    See "systemctl status apache2.service" and "journalctl -xe" for details."

    The apache2 logs are are as empty as a programmers head ;-)
    Below are the last lines of the apache2 logs before everything went down the drain.

    Have a nice weekend!
    73//Icelake


    Last lines of access log
    ------------------------
    ::1 - - [20/Sep/2016:19:15:06 +0200] "GET / HTTP/1.1" 200 11784 "-" "Mozilla/5.0 (ISPConfig monitor)"
    ::1 - - [20/Sep/2016:19:16:02 +0200] "GET / HTTP/1.1" 200 11784 "-" "Mozilla/5.0 (ISPConfig monitor)"
    ::1 - - [20/Sep/2016:19:17:02 +0200] "GET / HTTP/1.1" 200 11784 "-" "Mozilla/5.0 (ISPConfig monitor)"
    ::1 - - [20/Sep/2016:19:18:02 +0200] "GET / HTTP/1.1" 200 11784 "-" "Mozilla/5.0 (ISPConfig monitor)"
    ::1 - - [20/Sep/2016:19:19:03 +0200] "GET / HTTP/1.1" 200 11784 "-" "Mozilla/5.0 (ISPConfig monitor)"


    Last lines of error log
    -----------------------
    [Tue Sep 20 18:58:58.426962 2016] [auth_digest:notice] [pid 6111] AH01757: generating secret for digest authentication ...
    [Tue Sep 20 18:58:58.439700 2016] [:notice] [pid 6115] FastCGI: process manager initialized (pid 6115)
    [Tue Sep 20 18:58:58.953899 2016] [:error] [pid 6111] python_init: Python version mismatch, expected '2.7.6', found '2.7.12'.
    [Tue Sep 20 18:58:58.954143 2016] [:error] [pid 6111] python_init: Python executable found '/usr/bin/python'.
    [Tue Sep 20 18:58:58.954186 2016] [:error] [pid 6111] python_init: Python path being used '/usr/lib/python2.7/:/usr/lib/python2.7/plat-i386-linux-gnu:/usr/lib/python2.7/lib-tk:/usr/lib/python2.7/lib-old:/usr/lib/python2.7/lib-dynload'.
    [Tue Sep 20 18:58:58.954276 2016] [:notice] [pid 6111] mod_python: Creating 8 session mutexes based on 150 max processes and 0 max threads.
    [Tue Sep 20 18:58:58.954304 2016] [:notice] [pid 6111] mod_python: using mutex_directory /tmp
    [Tue Sep 20 18:58:59.140239 2016] [ssl:warn] [pid 6111] AH01906: ubu2.ishem.lan:8080:0 server certificate is a CA certificate (BasicConstraints: CA == TRUE !?)
    [Tue Sep 20 18:58:59.140375 2016] [ssl:warn] [pid 6111] AH01909: ubu2.ishem.lan:8080:0 server certificate does NOT include an ID which matches the server name
    [Tue Sep 20 18:58:59.140850 2016] [ssl:error] [pid 6111] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: O=Internet Widgits Pty Ltd,ST=Some-State,C=AU / issuer: O=Internet Widgits Pty Ltd,ST=Some-State,C=AU / serial: B4A2E1347D4AF993 / notbefore: Apr 27 19:09:08 2014 GMT / notafter: Apr 24 19:09:08 2024 GMT]
    [Tue Sep 20 18:58:59.140911 2016] [ssl:error] [pid 6111] AH02604: Unable to configure certificate ubu2.ishem.lan:8080:0 for stapling
    [Tue Sep 20 18:58:59.212873 2016] [mpm_prefork:notice] [pid 6111] AH00163: Apache/2.4.18 (Ubuntu) mod_fastcgi/mod_fastcgi-SNAP-0910052141 mod_fcgid/2.3.9 mod_python/3.3.1 Python/2.7.12 OpenSSL/1.0.2g-fips configured -- resuming normal operations
    [Tue Sep 20 18:58:59.212980 2016] [core:notice] [pid 6111] AH00094: Command line: '/usr/sbin/apache2'
    .php-fcgi-starter: line 6: /usr/bin/php-cgi: No such file or directory
    [Tue Sep 20 19:00:18.605132 2016] [fcgid:warn] [pid 6118] (104)Connection reset by peer: [client 192.168.1.99:46550] mod_fcgid: error reading data from FastCGI server
    [Tue Sep 20 19:00:18.605295 2016] [core:error] [pid 6118] [client 192.168.1.99:46550] End of script output before headers: index.php
    [Tue Sep 20 19:19:19.236548 2016] [mpm_prefork:notice] [pid 6111] AH00169: caught SIGTERM, shutting down


    The last lines of other_vhosts_access.log
    -----------------------------------------
    ubu2.ishem.lan:80 192.168.1.99 - - [20/Sep/2016:18:16:58 +0200] "\x16\x03\x01" 400 0 "-" "-"
    ubu2.ishem.lan:8080 192.168.1.99 - - [20/Sep/2016:18:17:04 +0200] "GET / HTTP/1.1" 500 979 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:48.0) Gecko/20100101 Firefox/48.0"
    ubu2.ishem.lan:8080 192.168.1.99 - - [20/Sep/2016:18:18:32 +0200] "GET / HTTP/1.1" 500 979 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:48.0) Gecko/20100101 Firefox/48.0"
    ubu2.ishem.lan:8080 192.168.1.99 - - [20/Sep/2016:18:18:34 +0200] "GET / HTTP/1.1" 500 979 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:48.0) Gecko/20100101 Firefox/48.0"
    hagenkatalog.issjo.com:80 192.168.1.254 - - [20/Sep/2016:18:59:43 +0200] "GET / HTTP/1.1" 200 684 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:48.0) Gecko/20100101 Firefox/48.0"
    hagenkatalog.issjo.com:80 192.168.1.254 - - [20/Sep/2016:18:59:43 +0200] "GET /hagentele HTTP/1.1" 301 612 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:48.0) Gecko/20100101 Firefox/48.0"
    ubu2.ishem.lan:8080 192.168.1.99 - - [20/Sep/2016:19:00:18 +0200] "GET / HTTP/1.1" 500 3161 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:48.0) Gecko/20100101 Firefox/48.0"
    ubu2.ishem.lan:80 192.168.1.99 - - [20/Sep/2016:19:15:19 +0200] "\x16\x03\x01" 400 0 "-" "-"


    The last lines of suexec.log
    ----------------------------
    [2016-09-20 18:16:27]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fcgi-starter
    [2016-09-20 18:16:28]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fcgi-starter
    [2016-09-20 18:17:04]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fcgi-starter
    [2016-09-20 18:18:32]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fcgi-starter
    [2016-09-20 18:18:34]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fcgi-starter
    [2016-09-20 19:00:18]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fcgi-starter
     
  8. florian030

    florian030 ISPConfig Developer ISPConfig Developer

    Cretae the missing directories or remove the vhosts:
    No such file or directory: AH02291: Cannot access directory '/var/log/ispconfig/httpd/gamlajarla.issjo.com/' for error log of vhost d
    No such file or directory: AH02291: Cannot access directory '/var/log/ispconfig/httpd/dag.issjo.com/' for error log of vhost defined
    No such file or directory: AH02291: Cannot access directory '/var/log/ispconfig/httpd/annika.issjo.com/' for error log of vhost defined
     
  9. Icelake

    Icelake New Member HowtoForge Supporter

    Tried to create the missing directories and also to remove the vhosts from sites-enabled.
    Same resut:
    Job for apache2.service failed because the control process exited with error code. See "systemctl status apache2.service" and "journalctl -xe" for details.
    73//Icelake
     
  10. Icelake

    Icelake New Member HowtoForge Supporter

    HI, again!
    Dowloaded and installed ucaresystem-core, ran it and rebooted.
    Now apahe2 is running...
    However complaining about "Internal server error" or misconfiguration. (Which, no doubt, seems to be the matter). I'll take a closer look at the logs to see what may give!
    73/Icelake
     
  11. Icelake

    Icelake New Member HowtoForge Supporter

    Hi!
    I have to go away for a couple of weeks.
    I'll come back to matter when I return.

    Pax!//Icelake
     

Share This Page