server crashed, tried to restore, sites don't load

I restored vmail and all users data as well as user info from passwd groups and shadow. SQL seems to work fine, MyDNS works fine, Mail works fine. I also restored /var/www. All backups used -p to keep permissions. Used the Perfect Setup guide for Lenny x64, plus steps to move old data over.

Now, every website gets a 403 error. It doesn't matter if the websites are just plain html, wordpress, or mediawiki.

Code:

my:/var/lib/mysql# apache2 --help
apache2: bad user name ${APACHE_RUN_USER}
my:/var/lib/mysql# 

envvars:

Code:

# /etc/init.d/apache2, /etc/logrotate.d/apache2, etc.
export APACHE_RUN_USER=www-data
export APACHE_RUN_GROUP=www-data
export APACHE_PID_FILE=/var/run/apache2.pid
my:/etc/apache2# 

Code:

my:/etc/apache2# cat /etc/passwd |grep www-data
www-data:x:33:33:www-data:/var/www:/bin/sh
my:/etc/apache2# cat /etc/group |grep www-data
group   group-  
my:/etc/apache2# cat /etc/group |grep www-data
www-data:x:33:
ispapps:x:5003:www-data
ispconfig:x:5004:www-data
client1:x:5005:www-data
client3:x:5006:www-data
client4:x:5007:www-data
client2:x:5008:www-data
client5:x:5009:www-data
client6:x:5021:www-data
my:/etc/apache2#  

Also, apache kicks out errors on loading:

Code:

Restarting web server: apache2[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.213:80 overlaps with VirtualHost 66.118.142.213:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.210:80 overlaps with VirtualHost 66.118.142.210:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.217:80 overlaps with VirtualHost 66.118.142.217:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.210:80 overlaps with VirtualHost 66.118.142.210:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.216:80 overlaps with VirtualHost 66.118.142.216:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.212:80 overlaps with VirtualHost 66.118.142.212:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.214:80 overlaps with VirtualHost 66.118.142.214:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:50 2010] [warn] VirtualHost 66.118.142.213:80 overlaps with VirtualHost 66.118.142.213:80, the first has precedence, perhaps you need a NameVirtualHost directive
 ... waiting .[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.213:80 overlaps with VirtualHost 66.118.142.213:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.210:80 overlaps with VirtualHost 66.118.142.210:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.217:80 overlaps with VirtualHost 66.118.142.217:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.210:80 overlaps with VirtualHost 66.118.142.210:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.211:80 overlaps with VirtualHost 66.118.142.211:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.216:80 overlaps with VirtualHost 66.118.142.216:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.212:80 overlaps with VirtualHost 66.118.142.212:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.214:80 overlaps with VirtualHost 66.118.142.214:80, the first has precedence, perhaps you need a NameVirtualHost directive
[Mon Nov 29 17:51:52 2010] [warn] VirtualHost 66.118.142.213:80 overlaps with VirtualHost 66.118.142.213:80, the first has precedence, perhaps you need a NameVirtualHost directive
.

apache2.log:

Code:

PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php5/20060613/memcache.so' - /usr/lib/php5/20060613/memcache.so$
[Mon Nov 29 17:51:52 2010] [notice] mod_python: Creating 8 session mutexes based on 150 max processes and 0 max threads.
[Mon Nov 29 17:51:52 2010] [notice] mod_python: using mutex_directory /tmp
[Mon Nov 29 17:51:52 2010] [notice] Apache/2.2.9 (Debian) DAV/2 PHP/5.2.6-1+lenny9 with Suhosin-Patch mod_python/3.3.1 Python/2.5.2$
[Mon Nov 29 17:52:22 2010] [notice] mod_fcgid: call /var/www/areyouliberal.com/web/index.php with wrapper /var/www/php-fcgi-scripts$
PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php5/20060613/apc.so' - /usr/lib/php5/20060613/apc.so: cannot o$
PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php5/20060613/curl.so' - /usr/lib/php5/20060613/curl.so: cannot$
PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php5/20060613/ldap.so' - /usr/lib/php5/20060613/ldap.so: cannot$
PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php5/20060613/memcache.so' - /usr/lib/php5/20060613/memcache.so$

But these errors shouldn't matter for the whole 403 on every website.

Example: derekgordon.com

Code:

[Mon Nov 29 17:05:35 2010] [crit] [client 207.46.195.159] (13)Permission denied: /var/www/derekgordon.com/web/.htaccess pcfg_openfi$
[Mon Nov 29 17:05:35 2010] [crit] [client 207.46.195.159] (13)Permission denied: /var/www/derekgordon.com/web/.htaccess pcfg_openfi$
[Mon Nov 29 17:05:35 2010] [crit] [client 207.46.195.159] (13)Permission denied: /var/www/derekgordon.com/web/.htaccess pcfg_openfi$
[Mon Nov 29 17:05:35 2010] [crit] [client 207.46.195.159] (13)Permission denied: /var/www/derekgordon.com/web/.htaccess pcfg_openfi$
[Mon Nov 29 17:07:04 2010] [crit] [client 66.249.71.69] (13)Permission denied: /var/www/derekgordon.com/web/.htaccess pcfg_openfile$
[Mon Nov 29 17:07:04 2010] [crit] [client 66.249.71.69] (13)Permission denied: /var/www/derekgordon.com/web/.htaccess pcfg_openfile$
[Mon Nov 29 17:07:04 2010] [crit] [client 66.249.71.69] (13)Permission denied: /var/www/derekgordon.com/web/.htaccess pcfg_openfile$
[Mon Nov 29 17:07:04 2010] [crit] [client 66.249.71.69] (13)Permission denied: /var/www/derekgordon.com/web/.htaccess pcfg_openfile

The .htaccess for this site is nothing:

Code:

# BEGIN WordPress
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /
RewriteRule ^index\.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>

# END WordPress

Then, I deleted the .htaccess and still 403 errors.

Directory permissions seem okay on all websites, too.

FTP users can connect but cannot view the directories at all.

Any thoughts on getting this thing going again?

I updated settings in the ISPC Admin console to get it to update. Nothing seems to have been fixed.

derekgordon.com, inter5.org, masonicwiki.info, areyouliberal.com, and many others are not functioning now.

 

Seems that there was an issue accessing the DB because the restoration recreated the DB user but not GRANT access.

Will see if this continues to work and update.

Just started playing with it.

 

Go to system > server IP in ispconfig, edit one of the ips and uncheck the namevirtualhost checkbox. Click on save and then do the same but activate it again.

 

Did that. Tried doing it for every IP, too. I unchecked and saved. Waited about 5 minutes. Then, re-enabled it.

Websites seem to work okay, with a few redirecting to the wrong site as if it were a static IP site.

Code:

[Tue Nov 30 10:48:26 2010] [warn] NameVirtualHost 66.118.142.217:443 has no VirtualHosts
[Tue Nov 30 10:48:26 2010] [warn] NameVirtualHost 66.118.142.210:443 has no VirtualHosts
[Tue Nov 30 10:48:26 2010] [warn] NameVirtualHost 66.118.142.211:443 has no VirtualHosts
[Tue Nov 30 10:48:26 2010] [warn] NameVirtualHost 66.118.142.214:443 has no VirtualHosts
[Tue Nov 30 10:48:26 2010] [warn] NameVirtualHost 66.118.142.215:80 has no VirtualHosts
[Tue Nov 30 10:48:26 2010] [warn] NameVirtualHost 66.118.142.215:443 has no VirtualHosts
[Tue Nov 30 10:48:26 2010] [warn] NameVirtualHost 66.118.142.212:443 has no VirtualHosts
[Tue Nov 30 10:48:26 2010] [warn] NameVirtualHost 66.118.142.213:443 has no VirtualHosts