Task 16044314

Name	hadcm3n_oe9j_1900_40_008473610_0
Workunit	8624449
Created	27 Sep 2013, 10:22:36 UTC
Sent	28 Sep 2013, 21:06:31 UTC
Report deadline	29 Dec 2013, 4:33:42 UTC
Received	27 Jan 2014, 20:00:07 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1169903
Run time	26 days 0 hours 46 min 49 sec
CPU time	21 days 11 hours 54 min 16 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.15 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <stderr_txt> 12:12:39 (79453): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:43 (7424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:57:55 (33501): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:09 (58051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:49 (59532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:07:45 (59988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:01 (68057): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:59 (78060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:20 (50613): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:53:26 (81235): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:09 (82925): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:04:33 (39395): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:19:43 (66957): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:26:41 (4678): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:42:14 (43883): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x480a000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16078,0xa05ca540) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32222,0xa05ca540) malloc: * error for object 0x9036200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:12:13 (94730): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:52:37 (12041): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:16:21 (78488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:26 (43937): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... hadcm3n_6.07_i686-apple-darwin(93066,0xa05ca540) malloc: * error for object 0x850404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(93066,0xa05ca540) malloc: * error for object 0x850400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(93066,0xa05ca540) malloc: * error for object 0x5002004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(93066,0xa05ca540) malloc: * error for object 0x5002000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(93066,0xa05ca540) malloc: * error for object 0x5002004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Sat Nov 2 05:03:10 2013 09:04:44 (93066): No heartbeat from core client for 30 sec - exiting 04:48:18 (93066): No heartbeat from core client for 30 sec - exiting 08:18:20 (93066): No heartbeat from core client for 30 sec - exiting 15:54:11 (93066): No heartbeat from core client for 30 sec - exiting 01:22:47 (93066): No heartbeat from core client for 30 sec - exiting 03:44:21 (93066): No heartbeat from core client for 30 sec - exiting 12:57:15 (93066): No heartbeat from core client for 30 sec - exiting 18:06:29 (93066): No heartbeat from core client for 30 sec - exiting 01:50:30 (93066): No heartbeat from core client for 30 sec - exiting 03:47:30 (93066): No heartbeat from core client for 30 sec - exiting 19:47:31 (93066): No heartbeat from core client for 30 sec - exiting 23:23:33 (93066): No heartbeat from core client for 30 sec - exiting 21:46:16 (93066): No heartbeat from core client for 30 sec - exiting 05:21:41 (93066): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(74896,0xa05ca540) malloc: * error for object 0x101de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74896,0xa05ca540) malloc: * error for object 0x101de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74896,0xa05ca540) malloc: * error for object 0x2028800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(24442,0xa05ca540) malloc: * error for object 0x6009e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(24442,0xa05ca540) malloc: * error for object 0x6009e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Nov 2013 10:33:53	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	1,036,800	1,856,532	1.7906
01 Nov 2013 21:23:39	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	1,010,880	1,811,283	1.7918
01 Nov 2013 07:52:05	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	984,960	1,765,417	1.7924
31 Oct 2013 18:32:20	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	959,040	1,720,203	1.7937
31 Oct 2013 05:38:21	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	933,120	1,675,811	1.7959
30 Oct 2013 15:51:31	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	907,200	1,632,410	1.7994
30 Oct 2013 02:30:16	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	881,280	1,587,470	1.8013
29 Oct 2013 13:20:25	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	855,360	1,542,173	1.8030
29 Oct 2013 00:19:04	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	829,440	1,498,158	1.8062
28 Oct 2013 11:07:10	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	803,520	1,453,419	1.8088
27 Oct 2013 21:18:46	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	777,600	1,407,923	1.8106
27 Oct 2013 07:32:51	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	751,680	1,362,793	1.8130
26 Oct 2013 17:51:54	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	725,760	1,317,412	1.8152
26 Oct 2013 04:45:06	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	699,840	1,273,453	1.8196
25 Oct 2013 10:54:31	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	673,920	1,229,405	1.8243
24 Oct 2013 17:44:48	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	648,000	1,183,532	1.8264
23 Oct 2013 15:16:23	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	622,080	1,137,546	1.8286
22 Oct 2013 20:21:03	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	596,160	1,091,680	1.8312
21 Oct 2013 16:30:36	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	570,240	1,045,809	1.8340
21 Oct 2013 00:05:12	1169903	16044314	hadcm3n_oe9j_1900_40_008473610_0	544,320	999,217	1.8357