Task 13021175

Name	hadcm3n_t1vi_1940_40_007314341_0
Workunit	7511771
Created	28 Jun 2011, 14:58:52 UTC
Sent	28 Jun 2011, 15:02:00 UTC
Report deadline	27 Sep 2011, 22:29:11 UTC
Received	13 Oct 2011, 8:29:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	787163
Run time	10 days 23 hours 0 min 13 sec
CPU time	10 days 12 hours 15 min 14 sec
Validate state	Invalid
Credit	8,709.12
Device peak FLOPS	3.45 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14883,0xa0241540) malloc: * error for object 0x2011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135920) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=910, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135920) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=910, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135920) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=910, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135920) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=910, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135920) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=910, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135920) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=910, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Oct 2011 07:33:13	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	725,760	902,848	1.2440
25 Jul 2011 18:49:58	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	699,840	870,391	1.2437
25 Jul 2011 17:52:07	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	673,920	838,230	1.2438
25 Jul 2011 17:23:07	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	648,000	806,031	1.2439
25 Jul 2011 16:16:23	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	622,080	773,880	1.2440
25 Jul 2011 14:39:42	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	596,160	741,590	1.2439
25 Jul 2011 13:23:04	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	570,240	709,256	1.2438
25 Jul 2011 13:23:04	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	544,320	676,951	1.2437
25 Jul 2011 13:23:04	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	518,400	644,846	1.2439
25 Jul 2011 13:23:04	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	492,480	612,597	1.2439
25 Jul 2011 13:23:04	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	466,560	580,316	1.2438
25 Jul 2011 13:23:04	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	440,640	548,435	1.2446
10 Jul 2011 13:38:46	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	414,720	516,521	1.2455
09 Jul 2011 18:25:17	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	388,800	484,527	1.2462
08 Jul 2011 23:51:04	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	362,880	452,642	1.2474
08 Jul 2011 11:10:01	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	336,960	420,671	1.2484
07 Jul 2011 18:21:04	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	311,040	388,346	1.2485
07 Jul 2011 18:21:04	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	285,120	355,589	1.2472
07 Jul 2011 15:37:06	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	259,200	323,257	1.2471
05 Jul 2011 17:34:25	787163	13021175	hadcm3n_t1vi_1940_40_007314341_0	233,280	290,787	1.2465