Task 13557554

Name	hadcm3n_yfhy_1900_40_007525900_0
Workunit	7723375
Created	28 Oct 2011, 13:43:15 UTC
Sent	29 Oct 2011, 22:31:14 UTC
Report deadline	29 Jan 2012, 5:58:25 UTC
Received	23 Dec 2011, 6:04:46 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1177195
Run time	22 days 18 hours 42 min 24 sec
CPU time	20 days 17 hours 1 min 52 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.00 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x808e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16220,0xa053d540) malloc: * error for object 0x809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(84496,0xa053d540) malloc: * error for object 0x4801204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84496,0xa053d540) malloc: * error for object 0x4801200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84496,0xa053d540) malloc: * error for object 0x4801204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84496,0xa053d540) malloc: * error for object 0x4802004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Nov 22 10:13:06 2011 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=84509, selfPID=84509, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(89760,0xa053d540) malloc: * error for object 0x1012600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 20:31:00 (89760): No heartbeat from core client for 30 sec - exiting 20:31:01 (89760): No heartbeat from core client for 30 sec - exiting 20:31:02 (89760): No heartbeat from core client for 30 sec - exiting 20:31:03 (89760): No heartbeat from core client for 30 sec - exiting 20:31:04 (89760): No heartbeat from core client for 30 sec - exiting 20:31:05 (89760): No heartbeat from core client for 30 sec - exiting 20:31:06 (89760): No heartbeat from core client for 30 sec - exiting 20:31:07 (89760): No heartbeat from core client for 30 sec - exiting 20:31:08 (89760): No heartbeat from core client for 30 sec - exiting 20:31:09 (89760): No heartbeat from core client for 30 sec - exiting 20:31:10 (89760): No heartbeat from core client for 30 sec - exiting 20:31:11 (89760): No heartbeat from core client for 30 sec - exiting 20:31:12 (89760): No heartbeat from core client for 30 sec - exiting 20:31:13 (89760): No heartbeat from core client for 30 sec - exiting 20:31:14 (89760): No heartbeat from core client for 30 sec - exiting 20:31:15 (89760): No heartbeat from core client for 30 sec - exiting 20:31:16 (89760): No heartbeat from core client for 30 sec - exiting 20:31:17 (89760): No heartbeat from core client for 30 sec - exiting 20:31:18 (89760): No heartbeat from core client for 30 sec - exiting 20:31:19 (89760): No heartbeat from core client for 30 sec - exiting 20:31:20 (89760): No heartbeat from core client for 30 sec - exiting 20:31:21 (89760): No heartbeat from core client for 30 sec - exiting 20:31:22 (89760): No heartbeat from core client for 30 sec - exiting 20:31:23 (89760): No heartbeat from core client for 30 sec - exiting 20:31:24 (89760): No heartbeat from core client for 30 sec - exiting 20:31:25 (89760): No heartbeat from core client for 30 sec - exiting 20:31:26 (89760): No heartbeat from core client for 30 sec - exiting 20:31:27 (89760): No heartbeat from core client for 30 sec - exiting 20:31:28 (89760): No heartbeat from core client for 30 sec - exiting 20:31:29 (89760): No heartbeat from core client for 30 sec - exiting 20:31:30 (89760): No heartbeat from core client for 30 sec - exiting 20:31:31 (89760): No heartbeat from core client for 30 sec - exiting 20:31:32 (89760): No heartbeat from core client for 30 sec - exiting 20:31:33 (89760): No heartbeat from core client for 30 sec - exiting 20:31:34 (89760): No heartbeat from core client for 30 sec - exiting 20:31:35 (89760): No heartbeat from core client for 30 sec - exiting 20:31:36 (89760): No heartbeat from core client for 30 sec - exiting 20:31:37 (89760): No heartbeat from core client for 30 sec - exiting 20:31:38 (89760): No heartbeat from core client for 30 sec - exiting 20:31:39 (89760): No heartbeat from core client for 30 sec - exiting 20:31:40 (89760): No heartbeat from core client for 30 sec - exiting 20:31:41 (89760): No heartbeat from core client for 30 sec - exiting 20:31:42 (89760): No heartbeat from core client for 30 sec - exiting 20:31:43 (89760): No heartbeat from core client for 30 sec - exiting 20:31:44 (89760): No heartbeat from core client for 30 sec - exiting 20:31:45 (89760): No heartbeat from core client for 30 sec - exiting 20:31:46 (89760): No heartbeat from core client for 30 sec - exiting 20:31:47 (89760): No heartbeat from core client for 30 sec - exiting 20:31:48 (89760): No heartbeat from core client for 30 sec - exiting 20:31:49 (89760): No heartbeat from core client for 30 sec - exiting 20:31:50 (89760): No heartbeat from core client for 30 sec - exiting 20:31:51 (89760): No heartbeat from core client for 30 sec - exiting 20:31:52 (89760): No heartbeat from core client for 30 sec - exiting 20:31:53 (89760): No heartbeat from core client for 30 sec - exiting 20:31:54 (89760): No heartbeat from core client for 30 sec - exiting 20:31:55 (89760): No heartbeat from core client for 30 sec - exiting 20:31:56 (89760): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(195,0xa0aae540) malloc: * error for object 0x2800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Dec 2011 06:05:37	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	1,036,800	1,788,579	1.7251
22 Dec 2011 15:35:14	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	1,010,880	1,742,470	1.7237
22 Dec 2011 02:01:24	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	984,960	1,696,575	1.7225
21 Dec 2011 12:28:50	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	959,040	1,650,407	1.7209
20 Dec 2011 22:50:14	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	933,120	1,604,249	1.7192
20 Dec 2011 07:22:29	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	907,200	1,558,895	1.7184
19 Dec 2011 19:12:08	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	881,280	1,516,748	1.7211
18 Dec 2011 20:19:11	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	855,360	1,475,085	1.7245
10 Dec 2011 05:30:25	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	829,440	1,432,284	1.7268
09 Dec 2011 13:23:46	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	803,520	1,388,240	1.7277
09 Dec 2011 02:06:04	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	777,600	1,348,893	1.7347
08 Dec 2011 12:44:11	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	751,680	1,305,272	1.7365
07 Dec 2011 23:14:52	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	725,760	1,261,350	1.7380
07 Dec 2011 10:37:18	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	699,840	1,218,690	1.7414
06 Dec 2011 21:56:52	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	673,920	1,175,426	1.7442
06 Dec 2011 03:53:16	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	648,000	1,129,478	1.7430
05 Dec 2011 03:09:38	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	622,080	1,084,177	1.7428
04 Dec 2011 04:28:55	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	596,160	1,040,683	1.7456
03 Dec 2011 16:18:10	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	570,240	1,000,710	1.7549
03 Dec 2011 05:55:37	1177195	13557554	hadcm3n_yfhy_1900_40_007525900_0	544,320	967,366	1.7772