Task 12785666

Name	famous_x4r9_1099_200_007067996_1
Workunit	7271296
Created	8 Apr 2011, 2:08:45 UTC
Sent	8 Apr 2011, 2:09:29 UTC
Report deadline	8 Jul 2011, 9:36:40 UTC
Received	31 May 2011, 20:43:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	440364
Run time	19 days 3 hours 50 min 53 sec
CPU time	17 days 14 hours 39 min 13 sec
Validate state	Invalid
Credit	5,280.85
Device peak FLOPS	1.07 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... (2925): called boinc_finish Signal 15 received, exiting... (2967): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... (3044): called boinc_finish Signal 1 received, exiting... (3044): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8214001] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8321864] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x829e450] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8264bc3] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81f3f37] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81eeea2] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x831bcec] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xb759ac2e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2966, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8214001] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8321864] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x829e450] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8264bc3] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81f3f37] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81eeea2] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x831bcec] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xb76b6c2e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2966, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8214001] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8321864] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x829e450] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8264bc3] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81f3f37] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81eeea2] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x831bcec] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xb7738c2e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2966, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8214001] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8321864] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x829e450] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8264bc3] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81f3f37] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81eeea2] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x831bcec] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xb763cc2e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2966, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8214001] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8321864] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x829e450] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8264bc3] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81f3f37] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81eeea2] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x831bcec] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xb7634c2e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2966, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8214001] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8321864] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x829e450] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8264bc3] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81f3f37] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81eeea2] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x831bcec] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/alexst/BOINC/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xb759cc2e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2966, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( (2966): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 May 2011 05:12:19	440364	12785666	famous_x4r9_1099_200_007067996_1	1,600,586	1,519,046	0.9491
31 May 2011 01:21:18	440364	12785666	famous_x4r9_1099_200_007067996_1	1,591,226	1,509,671	0.9487
30 May 2011 22:15:12	440364	12785666	famous_x4r9_1099_200_007067996_1	1,581,866	1,500,651	0.9487
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,572,506	1,491,690	0.9486
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,563,146	1,481,970	0.9481
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,553,786	1,472,302	0.9476
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,544,426	1,462,919	0.9472
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,535,066	1,453,769	0.9470
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,525,706	1,444,817	0.9470
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,516,346	1,435,896	0.9469
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,506,986	1,426,993	0.9469
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,497,626	1,418,138	0.9469
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,488,266	1,409,264	0.9469
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,478,906	1,400,147	0.9467
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,469,546	1,391,196	0.9467
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,460,186	1,382,212	0.9466
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,450,826	1,373,176	0.9465
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,441,466	1,364,280	0.9465
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,432,106	1,355,318	0.9464
30 May 2011 19:23:37	440364	12785666	famous_x4r9_1099_200_007067996_1	1,422,746	1,346,346	0.9463