Task 13121337

Name	hadcm3n_yjyr_1900_40_007358733_0
Workunit	7556163
Created	6 Jul 2011, 15:01:43 UTC
Sent	8 Jul 2011, 5:46:28 UTC
Report deadline	7 Oct 2011, 13:13:39 UTC
Received	22 Jul 2011, 21:45:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1154447
Run time	4 days 6 hours 58 min 56 sec
CPU time	4 days 5 hours 49 min 55 sec
Validate state	Invalid
Credit	5,909.76
Device peak FLOPS	4.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(232,0xa0173540) malloc: * error for object 0x402a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 140740) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=206, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 140740) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=206, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 140740) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=206, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 140740) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=206, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 140740) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=206, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 140740) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=206, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 21:00:20	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	492,480	364,656	0.7404
25 Jul 2011 21:00:20	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	466,560	345,496	0.7405
25 Jul 2011 19:00:08	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	440,640	326,318	0.7406
25 Jul 2011 18:52:27	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	414,720	307,018	0.7403
25 Jul 2011 18:20:36	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	388,800	287,721	0.7400
25 Jul 2011 18:08:14	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	362,880	268,590	0.7402
25 Jul 2011 17:58:52	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	336,960	249,471	0.7404
25 Jul 2011 17:42:58	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	311,040	230,506	0.7411
25 Jul 2011 17:31:07	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	285,120	211,511	0.7418
25 Jul 2011 17:16:23	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	259,200	191,913	0.7404
25 Jul 2011 16:35:19	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	233,280	172,336	0.7388
25 Jul 2011 16:25:06	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	207,360	153,285	0.7392
25 Jul 2011 16:14:08	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	181,440	134,261	0.7400
25 Jul 2011 13:02:24	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	155,520	115,200	0.7407
25 Jul 2011 13:02:24	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	129,600	95,629	0.7379
25 Jul 2011 13:02:24	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	103,680	76,167	0.7346
25 Jul 2011 13:02:24	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	77,760	56,727	0.7295
25 Jul 2011 13:02:24	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	51,840	37,786	0.7289
25 Jul 2011 13:02:24	1154447	13121337	hadcm3n_yjyr_1900_40_007358733_0	25,920	18,795	0.7251