kernel: php-cgi segfault error 4

webwzrd · October 30, 2011, 12:25pm

I just setup a couple new servers, both with CentOS 6.0 and VM Pro. On one of them I have a constant logging of php-cgi segfaults. This is a production server and as far as I can tell, these segfaults don’t seem to be causing a problem, but as you can see they are very frequent - all the time.

I’ve read several post here and other places, but I’m not sure what to check and was hoping for some guidance.

Brian

Oct 30 03:33:19 secure2 kernel: php-cgi[4993]: segfault at 100000010 ip 00000000005c2151 sp 00007fff19370670 error 4 in php-cgi[400000+2bf000]
Oct 30 03:37:28 secure2 kernel: php-cgi[9390]: segfault at 600000010 ip 00000000005c2151 sp 00007fff984a3d50 error 4 in php-cgi[400000+2bf000]
Oct 30 03:38:02 secure2 kernel: php-cgi[9590]: segfault at 100000010 ip 00000000005c2151 sp 00007fff40b6fc10 error 4 in php-cgi[400000+2bf000]
Oct 30 03:40:50 secure2 kernel: php-cgi[9725]: segfault at 100000010 ip 00000000005c2151 sp 00007ffffb24f3d0 error 4 in php-cgi[400000+2bf000]
Oct 30 03:41:02 secure2 kernel: php-cgi[10212]: segfault at 100000010 ip 00000000005c2151 sp 00007fff7abb2980 error 4 in php-cgi[400000+2bf000]
Oct 30 03:42:09 secure2 kernel: php-cgi[11005]: segfault at 100000010 ip 00000000005c2151 sp 00007fff38ae9c30 error 4 in php-cgi[400000+2bf000]
Oct 30 03:42:42 secure2 kernel: php-cgi[11191]: segfault at 400000010 ip 00000000005c2151 sp 00007fff9aa5c860 error 4 in php-cgi[400000+2bf000]
Oct 30 03:44:52 secure2 kernel: php-cgi[11263]: segfault at 600000010 ip 00000000005c2151 sp 00007ffff2a42a60 error 4 in php-cgi[400000+2bf000]
Oct 30 03:45:05 secure2 kernel: php-cgi[11604]: segfault at 100000010 ip 00000000005c2151 sp 00007fff7fec78a0 error 4 in php-cgi[400000+2bf000]
Oct 30 03:46:25 secure2 kernel: php-cgi[11628]: segfault at 600000010 ip 00000000005c2151 sp 00007fff46a47b80 error 4 in php-cgi[400000+2bf000]
Oct 30 03:47:05 secure2 kernel: php-cgi[12510]: segfault at 400000010 ip 00000000005c2151 sp 00007fffb3474da0 error 4 in php-cgi[400000+2bf000]
Oct 30 03:49:47 secure2 kernel: php-cgi[12600]: segfault at 100000010 ip 00000000005c2151 sp 00007fffad8ad540 error 4 in php-cgi[400000+2bf000]
Oct 30 03:50:12 secure2 kernel: php-cgi[12952]: segfault at 100000010 ip 00000000005c2151 sp 00007fff2504bca0 error 4 in php-cgi[400000+2bf000]
Oct 30 03:50:37 secure2 kernel: php-cgi[13043]: segfault at 100000010 ip 00000000005c2151 sp 00007fff19f2c9b0 error 4 in php-cgi[400000+2bf000]
Oct 30 03:52:22 secure2 kernel: php-cgi[13783]: segfault at 600000010 ip 00000000005c2151 sp 00007fffdab1ede0 error 4 in php-cgi[400000+2bf000]
Oct 30 03:54:09 secure2 kernel: php-cgi[14029]: segfault at 600000010 ip 00000000005c2151 sp 00007fffc324adc0 error 4 in php-cgi[400000+2bf000]
Oct 30 03:54:24 secure2 kernel: php-cgi[14229]: segfault at 600000010 ip 00000000005c2151 sp 00007fff4946e290 error 4 in php-cgi[400000+2bf000]
Oct 30 03:54:38 secure2 kernel: php-cgi[14249]: segfault at 600000010 ip 00000000005c2151 sp 00007fff590f1490 error 4 in php-cgi[400000+2bf000]
Oct 30 03:57:07 secure2 kernel: php-cgi[14270]: segfault at 100000010 ip 00000000005c2151 sp 00007fffdf47ec40 error 4 in php-cgi[400000+2bf000]
Oct 30 04:00:21 secure2 kernel: php-cgi[15354]: segfault at 600000010 ip 00000000005c2151 sp 00007fffb710d1c0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:00:40 secure2 kernel: php-cgi[15890]: segfault at 600000010 ip 00000000005c2151 sp 00007fff44d212d0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:03:13 secure2 kernel: php-cgi[15959]: segfault at 600000010 ip 00000000005c2151 sp 00007fff114c0a00 error 4 in php-cgi[400000+2bf000]
Oct 30 04:06:02 secure2 kernel: php-cgi[17996]: segfault at 400000010 ip 00000000005c2151 sp 00007fff6f28ac10 error 4 in php-cgi[400000+2bf000]
Oct 30 04:08:59 secure2 kernel: php-cgi[19113]: segfault at 100000010 ip 00000000005c2151 sp 00007fff907c2140 error 4 in php-cgi[400000+2bf000]
Oct 30 04:09:15 secure2 kernel: php-cgi[19563]: segfault at 100000010 ip 00000000005c2151 sp 00007fff30413a00 error 4 in php-cgi[400000+2bf000]
Oct 30 04:09:49 secure2 kernel: php-cgi[19619]: segfault at 600000010 ip 00000000005c2151 sp 00007ffffe6080c0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:11:46 secure2 kernel: php-cgi[19658]: segfault at 100000010 ip 00000000005c2151 sp 00007fffa41af290 error 4 in php-cgi[400000+2bf000]
Oct 30 04:13:59 secure2 kernel: php-cgi[20723]: segfault at 100000010 ip 00000000005c2151 sp 00007fff1f3485b0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:15:00 secure2 kernel: php-cgi[21030]: segfault at 100000010 ip 00000000005c2151 sp 00007fff2a58d5d0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:15:17 secure2 kernel: php-cgi[21191]: segfault at 100000010 ip 00000000005c2151 sp 00007fff53c573d0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:15:33 secure2 kernel: php-cgi[21194]: segfault at 600000010 ip 00000000005c2151 sp 00007fff119987b0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:15:44 secure2 kernel: php-cgi[21259]: segfault at 100000010 ip 00000000005c2151 sp 00007fff327a31c0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:17:26 secure2 kernel: php-cgi[21274]: segfault at 100000010 ip 00000000005c2151 sp 00007fffe17b8f70 error 4 in php-cgi[400000+2bf000]
Oct 30 04:17:44 secure2 kernel: php-cgi[22252]: segfault at 100000010 ip 00000000005c2151 sp 00007fffa4b3c190 error 4 in php-cgi[400000+2bf000]
Oct 30 04:18:56 secure2 kernel: php-cgi[22426]: segfault at 100000010 ip 00000000005c2151 sp 00007fff6c0ac510 error 4 in php-cgi[400000+2bf000]
Oct 30 04:18:59 secure2 kernel: php-cgi[22449]: segfault at 600000010 ip 00000000005c2151 sp 00007fff85ee1120 error 4 in php-cgi[400000+2bf000]
Oct 30 04:19:22 secure2 kernel: php-cgi[22490]: segfault at 100000010 ip 00000000005c2151 sp 00007fff53b7fa40 error 4 in php-cgi[400000+2bf000]
Oct 30 04:19:52 secure2 kernel: php-cgi[22549]: segfault at 600000010 ip 00000000005c2151 sp 00007fff800a67d0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:22:52 secure2 kernel: php-cgi[22702]: segfault at 100000010 ip 00000000005c2151 sp 00007fff98a16f00 error 4 in php-cgi[400000+2bf000]
Oct 30 04:23:35 secure2 kernel: php-cgi[23745]: segfault at 600000010 ip 00000000005c2151 sp 00007fffd5b61260 error 4 in php-cgi[400000+2bf000]
Oct 30 04:24:30 secure2 kernel: php-cgi[23844]: segfault at 100000010 ip 00000000005c2151 sp 00007fff745d72d0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:25:27 secure2 kernel: php-cgi[24021]: segfault at 600000010 ip 00000000005c2151 sp 00007fff654dbcb0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:30:29 secure2 kernel: php-cgi[24215]: segfault at 600000010 ip 00000000005c2151 sp 00007fffdd7e4390 error 4 in php-cgi[400000+2bf000]
Oct 30 04:30:54 secure2 kernel: php-cgi[25591]: segfault at 100000010 ip 00000000005c2151 sp 00007fff9ad8fb20 error 4 in php-cgi[400000+2bf000]
Oct 30 04:31:18 secure2 kernel: php-cgi[26377]: segfault at 600000010 ip 00000000005c2151 sp 00007fffc0a15e80 error 4 in php-cgi[400000+2bf000]
Oct 30 04:34:00 secure2 kernel: php-cgi[26473]: segfault at 100000010 ip 00000000005c2151 sp 00007fff0f1efb80 error 4 in php-cgi[400000+2bf000]
Oct 30 04:35:24 secure2 kernel: php-cgi[27016]: segfault at 100000010 ip 00000000005c2151 sp 00007fffbe5e77a0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:37:47 secure2 kernel: php-cgi[27288]: segfault at 100000010 ip 00000000005c2151 sp 00007fffe36f8040 error 4 in php-cgi[400000+2bf000]
Oct 30 04:39:02 secure2 kernel: php-cgi[28432]: segfault at 600000010 ip 00000000005c2151 sp 00007fffa03acb00 error 4 in php-cgi[400000+2bf000]
Oct 30 04:41:58 secure2 kernel: php-cgi[28588]: segfault at 100000010 ip 00000000005c2151 sp 00007fffb7da0930 error 4 in php-cgi[400000+2bf000]
Oct 30 04:51:58 secure2 kernel: php-cgi[29807]: segfault at 600000010 ip 00000000005c2151 sp 00007fffd57631c0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:52:34 secure2 kernel: php-cgi[32457]: segfault at 600000010 ip 00000000005c2151 sp 00007fff4d241f30 error 4 in php-cgi[400000+2bf000]
Oct 30 04:53:54 secure2 kernel: php-cgi[32549]: segfault at 100000010 ip 00000000005c2151 sp 00007fffab3e4c20 error 4 in php-cgi[400000+2bf000]
Oct 30 04:55:12 secure2 kernel: php-cgi[312]: segfault at 100000010 ip 00000000005c2151 sp 00007fff0db08920 error 4 in php-cgi[400000+2bf000]
Oct 30 04:55:36 secure2 kernel: php-cgi[572]: segfault at 100000010 ip 00000000005c2151 sp 00007fff150b0ef0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:55:51 secure2 kernel: php-cgi[578]: segfault at 600000010 ip 00000000005c2151 sp 00007fff7ff28060 error 4 in php-cgi[400000+2bf000]
Oct 30 04:56:12 secure2 kernel: php-cgi[1293]: segfault at 100000010 ip 00000000005c2151 sp 00007fff09353c10 error 4 in php-cgi[400000+2bf000]
Oct 30 04:57:08 secure2 kernel: php-cgi[1379]: segfault at 100000010 ip 00000000005c2151 sp 00007fff2db2a210 error 4 in php-cgi[400000+2bf000]
Oct 30 04:57:30 secure2 kernel: php-cgi[1473]: segfault at 100000010 ip 00000000005c2151 sp 00007fffe60a0760 error 4 in php-cgi[400000+2bf000]
Oct 30 04:58:17 secure2 kernel: php-cgi[1533]: segfault at 100000010 ip 00000000005c2151 sp 00007fff6b95a480 error 4 in php-cgi[400000+2bf000]
Oct 30 04:58:54 secure2 kernel: php-cgi[1704]: segfault at 100000010 ip 00000000005c2151 sp 00007ffff3f08950 error 4 in php-cgi[400000+2bf000]
Oct 30 04:59:08 secure2 kernel: php-cgi[1760]: segfault at 100000010 ip 00000000005c2151 sp 00007fff000100f0 error 4 in php-cgi[400000+2bf000]
Oct 30 04:59:11 secure2 kernel: php-cgi[1766]: segfault at 100000010 ip 00000000005c2151 sp 00007fffecd42020 error 4 in php-cgi[400000+2bf000]
Oct 30 04:59:36 secure2 kernel: php-cgi[1820]: segfault at 600000010 ip 00000000005c2151 sp 00007fff11882d40 error 4 in php-cgi[400000+2bf000]
Oct 30 05:02:18 secure2 kernel: php-cgi[1897]: segfault at 600000010 ip 00000000005c2151 sp 00007fff50908a90 error 4 in php-cgi[400000+2bf000]
Oct 30 05:02:53 secure2 kernel: php-cgi[3764]: segfault at 600000010 ip 00000000005c2151 sp 00007fffc035c850 error 4 in php-cgi[400000+2bf000]
Oct 30 05:07:21 secure2 kernel: php-cgi[3845]: segfault at 400000010 ip 00000000005c2151 sp 00007fff95d53320 error 4 in php-cgi[400000+2bf000]
Oct 30 05:08:32 secure2 kernel: php-cgi[5309]: segfault at 100000010 ip 00000000005c2151 sp 00007fff228753c0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:08:34 secure2 kernel: php-cgi[5482]: segfault at 400000010 ip 00000000005c2151 sp 00007fffcde24810 error 4 in php-cgi[400000+2bf000]
Oct 30 05:08:47 secure2 kernel: php-cgi[5515]: segfault at 600000010 ip 00000000005c2151 sp 00007fffcf13ce10 error 4 in php-cgi[400000+2bf000]
Oct 30 05:12:25 secure2 kernel: php-cgi[5549]: segfault at 600000010 ip 00000000005c2151 sp 00007fffac21c6a0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:14:35 secure2 kernel: php-cgi[6809]: segfault at 100000010 ip 00000000005c2151 sp 00007ffff6cda030 error 4 in php-cgi[400000+2bf000]
Oct 30 05:18:43 secure2 kernel: php-cgi[7089]: segfault at 0 ip 00000039e932183f sp 00007ffff66fd648 error 4 in libc-2.12.so[39e9200000+175000]
Oct 30 05:21:03 secure2 kernel: php-cgi[8486]: segfault at 600000010 ip 00000000005c2151 sp 00007fffff1f88f0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:21:29 secure2 kernel: php-cgi[9647]: segfault at 600000010 ip 00000000005c2151 sp 00007fff5809e060 error 4 in php-cgi[400000+2bf000]
Oct 30 05:24:09 secure2 kernel: php-cgi[9685]: segfault at 100000010 ip 00000000005c2151 sp 00007fff02fb6640 error 4 in php-cgi[400000+2bf000]
Oct 30 05:26:09 secure2 kernel: php-cgi[10110]: segfault at 100000010 ip 00000000005c2151 sp 00007fff75201f80 error 4 in php-cgi[400000+2bf000]
Oct 30 05:26:25 secure2 kernel: php-cgi[11130]: segfault at 100000010 ip 00000000005c2151 sp 00007fff33b95a90 error 4 in php-cgi[400000+2bf000]
Oct 30 05:26:41 secure2 kernel: php-cgi[11153]: segfault at 100000010 ip 00000000005c2151 sp 00007fff97ca0610 error 4 in php-cgi[400000+2bf000]
Oct 30 05:26:56 secure2 kernel: php-cgi[11195]: segfault at 100000010 ip 00000000005c2151 sp 00007fff9ab9d2f0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:27:42 secure2 kernel: php-cgi[11229]: segfault at 600000010 ip 00000000005c2151 sp 00007fff7f4f8590 error 4 in php-cgi[400000+2bf000]
Oct 30 05:28:11 secure2 kernel: php-cgi[11317]: segfault at 600000010 ip 00000000005c2151 sp 00007fff6c8e3710 error 4 in php-cgi[400000+2bf000]
Oct 30 05:28:42 secure2 kernel: php-cgi[11372]: segfault at 600000010 ip 00000000005c2151 sp 00007fff9b666420 error 4 in php-cgi[400000+2bf000]
Oct 30 05:29:43 secure2 kernel: php-cgi[11490]: segfault at 600000010 ip 00000000005c2151 sp 00007fffee9d6ae0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:29:59 secure2 kernel: php-cgi[11640]: segfault at 100000010 ip 00000000005c2151 sp 00007fff900c18e0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:31:09 secure2 kernel: php-cgi[12609]: segfault at 100000010 ip 00000000005c2151 sp 00007fffb16d8210 error 4 in php-cgi[400000+2bf000]
Oct 30 05:32:24 secure2 kernel: php-cgi[12644]: segfault at 0 ip 00000039e932183f sp 00007fffa6cb4538 error 4 in libc-2.12.so[39e9200000+175000]
Oct 30 05:33:22 secure2 kernel: php-cgi[12815]: segfault at 0 ip 00000039e932183f sp 00007fff66a15f28 error 4 in libc-2.12.so[39e9200000+175000]
Oct 30 05:33:38 secure2 kernel: php-cgi[12919]: segfault at 100000010 ip 00000000005c2151 sp 00007fff09739950 error 4 in php-cgi[400000+2bf000]
Oct 30 05:39:53 secure2 kernel: php-cgi[13114]: segfault at 600000010 ip 00000000005c2151 sp 00007fff8f5d4cb0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:42:21 secure2 kernel: php-cgi[14741]: segfault at 600000010 ip 00000000005c2151 sp 00007fffabc6a4e0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:44:24 secure2 kernel: php-cgi[15788]: segfault at 600000010 ip 00000000005c2151 sp 00007fff21b067a0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:44:34 secure2 kernel: php-cgi[16054]: segfault at 100000010 ip 00000000005c2151 sp 00007fff4953faa0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:46:21 secure2 kernel: php-cgi[16062]: segfault at 600000010 ip 00000000005c2151 sp 00007fff94537950 error 4 in php-cgi[400000+2bf000]
Oct 30 05:51:13 secure2 kernel: php-cgi[17045]: segfault at 100000010 ip 00000000005c2151 sp 00007fffaef866d0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:51:55 secure2 kernel: php-cgi[18455]: segfault at 100000010 ip 00000000005c2151 sp 00007fffef248e30 error 4 in php-cgi[400000+2bf000]
Oct 30 05:53:41 secure2 kernel: php-cgi[18530]: segfault at 600000010 ip 00000000005c2151 sp 00007fff4f97bcb0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:53:51 secure2 kernel: php-cgi[18824]: segfault at 0 ip 00000039e932183f sp 00007fffcd9dfee8 error 4 in libc-2.12.so[39e9200000+175000]
Oct 30 05:54:52 secure2 kernel: php-cgi[18835]: segfault at 0 ip 00000039e932183f sp 00007ffff762c128 error 4 in libc-2.12.so[39e9200000+175000]
Oct 30 05:56:07 secure2 kernel: php-cgi[19014]: segfault at 600000010 ip 00000000005c2151 sp 00007fffebfa1cd0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:59:02 secure2 kernel: php-cgi[19958]: segfault at 100000010 ip 00000000005c2151 sp 00007fff97a049e0 error 4 in php-cgi[400000+2bf000]
Oct 30 05:59:17 secure2 kernel: php-cgi[20366]: segfault at 600000010 ip 00000000005c2151 sp 00007fff7c009f30 error 4 in php-cgi[400000+2bf000]
Oct 30 06:00:01 secure2 kernel: php-cgi[20432]: segfault at 100000010 ip 00000000005c2151 sp 00007fff7d0be190 error 4 in php-cgi[400000+2bf000]
Oct 30 06:03:36 secure2 kernel: php-cgi[20574]: segfault at 100000010 ip 00000000005c2151 sp 00007fff0a290a50 error 4 in php-cgi[400000+2bf000]
Oct 30 06:06:41 secure2 kernel: php-cgi[22501]: segfault at 600000010 ip 00000000005c2151 sp 00007fff5bc58670 error 4 in php-cgi[400000+2bf000]
Oct 30 06:08:34 secure2 kernel: php-cgi[23683]: segfault at 600000010 ip 00000000005c2151 sp 00007fff28a48580 error 4 in php-cgi[400000+2bf000]
Oct 30 06:10:11 secure2 kernel: php-cgi[24176]: segfault at 100000010 ip 00000000005c2151 sp 00007fff6f5861c0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:13:04 secure2 kernel: php-cgi[24268]: segfault at 100000010 ip 00000000005c2151 sp 00007fffea0d29c0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:14:01 secure2 kernel: php-cgi[25468]: segfault at 100000010 ip 00000000005c2151 sp 00007fff7c9befd0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:15:07 secure2 kernel: php-cgi[25613]: segfault at 600000010 ip 00000000005c2151 sp 00007fff5b4991e0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:15:53 secure2 kernel: php-cgi[25842]: segfault at 100000010 ip 00000000005c2151 sp 00007fff13b453d0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:16:09 secure2 kernel: php-cgi[26619]: segfault at 600000010 ip 00000000005c2151 sp 00007fff4b12af50 error 4 in php-cgi[400000+2bf000]
Oct 30 06:16:32 secure2 kernel: php-cgi[26658]: segfault at 0 ip 00000039e932183f sp 00007fff2cd82d98 error 4 in libc-2.12.so[39e9200000+175000]
Oct 30 06:18:29 secure2 kernel: php-cgi[26671]: segfault at 100000010 ip 00000000005c2151 sp 00007fff61d529c0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:20:54 secure2 kernel: php-cgi[26920]: segfault at 600000010 ip 00000000005c2151 sp 00007fffb76ff850 error 4 in php-cgi[400000+2bf000]
Oct 30 06:21:26 secure2 kernel: php-cgi[28107]: segfault at 0 ip 00000039e932183f sp 00007fff7607f858 error 4 in libc-2.12.so[39e9200000+175000]
Oct 30 06:23:08 secure2 kernel: php-cgi[28163]: segfault at 100000010 ip 00000000005c2151 sp 00007fffed1301f0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:23:37 secure2 kernel: php-cgi[28389]: segfault at 100000010 ip 00000000005c2151 sp 00007fff866e76a0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:24:13 secure2 kernel: php-cgi[28489]: segfault at 100000010 ip 00000000005c2151 sp 00007fff6352a0a0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:25:19 secure2 kernel: php-cgi[28571]: segfault at 600000010 ip 00000000005c2151 sp 00007ffff6ca2750 error 4 in php-cgi[400000+2bf000]
Oct 30 06:25:53 secure2 kernel: php-cgi[28822]: segfault at 100000010 ip 00000000005c2151 sp 00007fff9abd9480 error 4 in php-cgi[400000+2bf000]
Oct 30 06:29:37 secure2 kernel: php-cgi[29609]: segfault at 100000010 ip 00000000005c2151 sp 00007fff15d1e3a0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:30:07 secure2 kernel: php-cgi[30102]: segfault at 100000010 ip 00000000005c2151 sp 00007fffa0a10360 error 4 in php-cgi[400000+2bf000]
Oct 30 06:30:58 secure2 kernel: php-cgi[30261]: segfault at 100000010 ip 00000000005c2151 sp 00007fffa14b62b0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:34:44 secure2 kernel: php-cgi[31053]: segfault at 100000010 ip 00000000005c2151 sp 00007fffc564f9d0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:35:02 secure2 kernel: php-cgi[31722]: segfault at 100000010 ip 00000000005c2151 sp 00007fffaeb814a0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:35:50 secure2 kernel: php-cgi[31797]: segfault at 600000010 ip 00000000005c2151 sp 00007fff34922fe0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:37:03 secure2 kernel: php-cgi[32722]: segfault at 100000010 ip 00000000005c2151 sp 00007fff32065520 error 4 in php-cgi[400000+2bf000]
Oct 30 06:40:01 secure2 kernel: php-cgi[427]: segfault at 100000010 ip 00000000005c2151 sp 00007fffb2c720b0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:42:12 secure2 kernel: php-cgi[848]: segfault at 100000010 ip 00000000005c2151 sp 00007fff1591b3a0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:44:04 secure2 kernel: php-cgi[2028]: segfault at 600000010 ip 00000000005c2151 sp 00007fffcd779aa0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:44:58 secure2 kernel: php-cgi[2399]: segfault at 600000010 ip 00000000005c2151 sp 00007fff9dfe81f0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:51:52 secure2 kernel: php-cgi[2658]: segfault at 600000010 ip 00000000005c2151 sp 00007fffd611e5d0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:52:22 secure2 kernel: php-cgi[5275]: segfault at 600000010 ip 00000000005c2151 sp 00007fff5a93d4c0 error 4 in php-cgi[400000+2bf000]
Oct 30 06:53:06 secure2 kernel: php-cgi[5371]: segfault at 100000010 ip 00000000005c2151 sp 00007fff2f2a8210 error 4 in php-cgi[400000+2bf000]
Oct 30 06:55:59 secure2 kernel: php-cgi[5497]: segfault at 600000010 ip 00000000005c2151 sp 00007fff54358000 error 4 in php-cgi[400000+2bf000]
Oct 30 06:58:52 secure2 kernel: php-cgi[6640]: segfault at 100000010 ip 00000000005c2151 sp 00007fff602223c0 error 4 in php-cgi[400000+2bf000]
Oct 30 07:01:09 secure2 kernel: php-cgi[7102]: segfault at 600000010 ip 00000000005c2151 sp 00007fffc248a200 error 4 in php-cgi[400000+2bf000]
Oct 30 07:01:25 secure2 kernel: php-cgi[8513]: segfault at 600000010 ip 00000000005c2151 sp 00007fff12bf3ee0 error 4 in php-cgi[400000+2bf000]
Oct 30 07:03:09 secure2 kernel: php-cgi[8748]: segfault at 100000010 ip 00000000005c2151 sp 00007fff38b3fc10 error 4 in php-cgi[400000+2bf000]
Oct 30 07:05:40 secure2 kernel: php-cgi[9261]: segfault at 100000010 ip 00000000005c2151 sp 00007fff815df4f0 error 4 in php-cgi[400000+2bf000]
Oct 30 07:05:59 secure2 kernel: php-cgi[9630]: segfault at 100000010 ip 00000000005c2151 sp 00007fff5ed069c0 error 4 in php-cgi[400000+2bf000]
Oct 30 07:10:37 secure2 kernel: php-cgi[10871]: segfault at 400000010 ip 00000000005c2151 sp 00007fff794706f0 error 4 in php-cgi[400000+2bf000]

webwzrd · October 30, 2011, 5:51pm

Miraculously I discovered the site having problems causing the segfault (at least I hope it’s just this one). The sites access_log and error_log were completely empty after restoring the site on this new server a week ago. I re-restored the virtual server from the original transferred backup and the logs started working (for a little while and then stalled again).

I was able to match the segfault with exact error times showing up in the sites error_log. Which show:

[Sun Oct 30 12:07:11 2011] [error] [client 180.76.5.66] Premature end of script headers: main.php
[Sun Oct 30 12:08:08 2011] [warn] [client 180.76.5.163] (104)Connection reset by peer: mod_fcgid: error reading data from FastCGI server

The “main.php” file referenced above is from the Gallery2 script. I located some old posts on the Gallery Menalto site, which talk about a Gallery2 segfault issue. Maybe it’s a PHP 5.3 issue now - I’ll dig deeper into this: http://gallery.menalto.com/node/23432

So now the new question is why won’t the virtual server’s logs write? Is this related to the segfault issue?

BTW - The website, including the Galley2 seem to be functioning just fine.

Eric · October 31, 2011, 2:12pm

Howdy,

Newer versions of Virtualmin default to putting the logs in /var/log/virtualmin (or was that /var/log/httpd/virtualmin – I forget

In $HOME/logs, there should be a symlink to that other location – but the presence of your old logs may have prevented it from creating a symlink.

-Eric

webwzrd · October 31, 2011, 2:31pm

I restored 150 virtual servers and as I spot check other ones, I’m not seeing the setup you described on any of them. They are all as the were before… no symlinks, just /logs/error_log and access_log. However the domain in question is the only one I’m seeing with stalled log writing.

I see some new log lines were added today, but stalled midway through a line.

webwzrd · November 4, 2011, 4:48pm

Thought I’d add an update to share what caused the logs to stop writing…

The account was over quota.

Eric · November 4, 2011, 5:20pm

Aha, that’ll do it – nice catch!