View Single Post
  #2  
Old 24th February 2010, 05:05
K_meleonu K_meleonu is offline
Senior Member
 
Join Date: May 2006
Posts: 108
Thanks: 1
Thanked 5 Times in 4 Posts
Default

I have found the problem.
I found the server frozeed again and the first command it came'd in my mind was "w"

[root@CrazyDesign log]# w
05:52:19 up 7:12, 4 users, load average: 121.68, 150.87, 156.52
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
root pts/0 86.106.120.7 22:41 0.00s 0.35s 0.02s w
root pts/1 86.106.120.7 22:50 5:50m 7.36s 7.28s speed
root pts/21 86.106.120.7 00:24 5:25m 0.03s 0.03s -bash
root pts/22 86.106.120.7 00:24 5:26m 2:12 2:12 top

I was having 4 terminals (putty) opened on the server from the last reboot, in one of then i was having top started and i saw httpd many times there, so i took my chnaces and ran service httpd restart in one of the terminals.
After that the server camed back to life.

In my httpd error log i have:

Code:
[Wed Feb 24 04:54:20 2010] [error] [client 207.46.199.42] File does not exist: /var/www/sharedip/robots.txt
[Wed Feb 24 05:51:59 2010] [warn] child process 20824 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 19731 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20565 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20893 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20204 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20205 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20896 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20897 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20207 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20898 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20568 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20409 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20899 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20575 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20576 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20577 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20578 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20583 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20584 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20585 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20586 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20587 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20588 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20589 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20590 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20596 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20597 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20598 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20599 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20600 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20601 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20602 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20603 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20604 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20605 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20606 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20607 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20902 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20903 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20976 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20981 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20984 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20985 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 20986 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21132 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21133 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21134 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21139 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21224 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21225 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21228 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21229 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21230 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21394 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21486 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21489 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21636 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21725 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21804 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21894 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 21982 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22282 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22353 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22354 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22365 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22440 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22447 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22452 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22596 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22601 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22604 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22702 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22705 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22789 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22790 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22791 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22792 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22907 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22908 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22911 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22912 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 22913 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23023 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23152 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23159 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23169 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23171 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23200 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23201 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23202 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23206 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23240 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23293 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23312 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23317 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23441 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23442 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23525 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23526 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23527 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23726 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23727 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23728 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23760 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23777 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23778 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23794 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23795 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23798 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23799 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23806 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23816 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23830 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 23831 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24067 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24071 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24072 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24073 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24083 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24084 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24085 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24088 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24089 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24090 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24091 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24094 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24095 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24127 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24168 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24184 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24250 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24251 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24252 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24255 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24256 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24257 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24258 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24259 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24262 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24347 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24420 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24436 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24445 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24455 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24539 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24540 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24772 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24932 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 24937 still did not exit, sending a SIGTERM
[Wed Feb 24 05:51:59 2010] [warn] child process 25023 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20565 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20205 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20896 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20897 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20898 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20568 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20409 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20584 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20585 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20590 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20599 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20600 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20604 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20605 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 20984 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 21133 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 21134 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 21224 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 21394 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 22282 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 22353 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 22365 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 22440 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 22912 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 23152 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 23159 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 23200 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 23201 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 23317 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 23727 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 23778 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 23830 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 24088 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 24127 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 24251 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 24252 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 24262 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 24347 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 24420 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 24539 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 24540 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:01 2010] [warn] child process 25023 still did not exit, sending a SIGTERM
[Wed Feb 24 05:52:02 2010] [notice] caught SIGTERM, shutting down
[Wed Feb 24 05:52:10 2010] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Wed Feb 24 05:52:11 2010] [notice] Digest: generating secret for digest authentication ...
[Wed Feb 24 05:52:11 2010] [notice] Digest: done
[Wed Feb 24 05:52:16 2010] [error] python_init: Python version mismatch, expected '2.6', found '2.6.2'.
[Wed Feb 24 05:52:16 2010] [error] python_init: Python executable found '/usr/bin/python'.
[Wed Feb 24 05:52:16 2010] [error] python_init: Python path being used '/usr/lib/python26.zip:/usr/lib/python2.6/:/usr/lib/python2.6/plat-linux2:/usr/lib/python2.6/lib-tk:/usr/lib/python2.6/lib-old:/usr/lib/python2.6/lib-dynload'.
[Wed Feb 24 05:52:16 2010] [notice] mod_python: Creating 4 session mutexes based on 150 max processes and 0 max threads.
[Wed Feb 24 05:52:16 2010] [notice] mod_python: using mutex_directory /tmp 
[Wed Feb 24 05:52:17 2010] [notice] Apache/2.2.14 (Unix) DAV/2 PHP/5.3.1 mod_python/3.3.1 Python/2.6.2 mod_ruby/1.3.0 Ruby/1.8.6(2009-08-04) configured -- resuming normal operations
[Wed Feb 24 05:54:35 2010] [error] [client 67.195.114.248] File does not exist: /var/www/sharedip/robots.txt
[Wed Feb 24 05:54:36 2010] [error] [client 67.195.114.248] File does not exist: /var/www/sharedip/index.php
[Wed Feb 24 05:54:46 2010] [error] [client 207.46.199.42] File does not exist: /var/www/sharedip/robots.txt
You ccan see that from 04:54:20 to 05:51:59 are no records.
I have restarted httpd around 05:50 and then it started to log again.

Can anyone knows how to "repair" apache?
For the moment i haved added a cron job to run from 2 to 2 hours and restard httpd.

Thank you all for reading my post and for yout replys
Reply With Quote