Task 15818948

Name	hadcm3n_o21k_1980_40_008384103_0
Workunit	8534962
Created	2 Jun 2013, 22:31:27 UTC
Sent	2 Jun 2013, 22:55:38 UTC
Report deadline	2 Sep 2013, 6:22:49 UTC
Received	23 Sep 2013, 15:41:35 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1169903
Run time	26 days 7 hours 25 min 31 sec
CPU time	21 days 8 hours 8 min 50 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.15 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <stderr_txt> 07:20:43 (8303): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:35 (27070): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:38:57 (36345): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:42:13 (94791): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:52 (59771): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:00:49 (71986): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:25:02 (52301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:21:02 (54335): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:41:36 (54966): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:03:13 (15299): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:02 (25899): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:16:19 (30949): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:57:09 (700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:07:39 (6541): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:19:41 (28775): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:55:38 (92504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(56222,0xa0829540) malloc: * error for object 0x4820004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(56222,0xa0829540) malloc: * error for object 0x581f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(56222,0xa0829540) malloc: * error for object 0x5800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(56222,0xa0829540) malloc: * error for object 0x5800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(56222,0xa0829540) malloc: * error for object 0x5800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 00:02:16 (56222): No heartbeat from core client for 30 sec - exiting 05:51:57 (56222): No heartbeat from core client for 30 sec - exiting 11:16:04 (56222): No heartbeat from core client for 30 sec - exiting 23:15:16 (56222): No heartbeat from core client for 30 sec - exiting 05:03:21 (56222): No heartbeat from core client for 30 sec - exiting 04:12:17 (56222): No heartbeat from core client for 30 sec - exiting 09:33:20 (56222): No heartbeat from core client for 30 sec - exiting 15:58:50 (56222): No heartbeat from core client for 30 sec - exiting 00:18:21 (56222): No heartbeat from core client for 30 sec - exiting 20:20:57 (56222): No heartbeat from core client for 30 sec - exiting 02:01:45 (56222): No heartbeat from core client for 30 sec - exiting 01:37:45 (56222): No heartbeat from core client for 30 sec - exiting 03:40:34 (56222): No heartbeat from core client for 30 sec - exiting 16:26:13 (56222): No heartbeat from core client for 30 sec - exiting 23:09:11 (56222): No heartbeat from core client for 30 sec - exiting 03:04:36 (56222): No heartbeat from core client for 30 sec - exiting 00:06:00 (56222): No heartbeat from core client for 30 sec - exiting 03:43:44 (56222): No heartbeat from core client for 30 sec - exiting 17:29:23 (56222): No heartbeat from core client for 30 sec - exiting 04:52:02 (56222): No heartbeat from core client for 30 sec - exiting 04:52:03 (56222): No heartbeat from core client for 30 sec - exiting 01:21:53 (56222): No heartbeat from core client for 30 sec - exiting 06:16:30 (56222): No heartbeat from core client for 30 sec - exiting 01:02:54 (56222): No heartbeat from core client for 30 sec - exiting 02:58:07 (56222): No heartbeat from core client for 30 sec - exiting 21:58:16 (56222): No heartbeat from core client for 30 sec - exiting 15:28:24 (56222): No heartbeat from core client for 30 sec - exiting 21:22:32 (56222): No heartbeat from core client for 30 sec - exiting 01:09:54 (56222): No heartbeat from core client for 30 sec - exiting 02:03:58 (56222): No heartbeat from core client for 30 sec - exiting 12:15:50 (56222): No heartbeat from core client for 30 sec - exiting 04:34:54 (56222): No heartbeat from core client for 30 sec - exiting 04:56:52 (56222): No heartbeat from core client for 30 sec - exiting 07:50:00 (56222): No heartbeat from core client for 30 sec - exiting 21:39:11 (56222): No heartbeat from core client for 30 sec - exiting 00:55:35 (56222): No heartbeat from core client for 30 sec - exiting 00:55:36 (56222): No heartbeat from core client for 30 sec - exiting 17:22:03 (56222): No heartbeat from core client for 30 sec - exiting 00:14:33 (56222): No heartbeat from core client for 30 sec - exiting 00:14:34 (56222): No heartbeat from core client for 30 sec - exiting 06:31:13 (56222): No heartbeat from core client for 30 sec - exiting 06:31:14 (56222): No heartbeat from core client for 30 sec - exiting 18:32:53 (56222): No heartbeat from core client for 30 sec - exiting 03:25:13 (56222): No heartbeat from core client for 30 sec - exiting 04:26:10 (56222): No heartbeat from core client for 30 sec - exiting 08:33:15 (56222): No heartbeat from core client for 30 sec - exiting 22:07:11 (56222): No heartbeat from core client for 30 sec - exiting 02:05:22 (56222): No heartbeat from core client for 30 sec - exiting 14:32:19 (56222): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(1106,0xa0cb2540) malloc: * error for object 0x103ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1106,0xa0cb2540) malloc: * error for object 0x103ac00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1106,0xa0cb2540) malloc: * error for object 0x2805c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1106,0xa0cb2540) malloc: * error for object 0x2805c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1106,0xa0cb2540) malloc: * error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1106,0xa0cb2540) malloc: * error for object 0x2800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1106,0xa0cb2540) malloc: * error for object 0x6800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 04:07:42 (1106): No heartbeat from core client for 30 sec - exiting 01:52:59 (1106): No heartbeat from core client for 30 sec - exiting 13:18:18 (1106): No heartbeat from core client for 30 sec - exiting 19:37:05 (1106): No heartbeat from core client for 30 sec - exiting 19:38:03 (1106): No heartbeat from core client for 30 sec - exiting 01:19:55 (1106): No heartbeat from core client for 30 sec - exiting 01:59:31 (1106): No heartbeat from core client for 30 sec - exiting 01:19:36 (1106): No heartbeat from core client for 30 sec - exiting 02:57:00 (1106): No heartbeat from core client for 30 sec - exiting 12:55:58 (1106): No heartbeat from core client for 30 sec - exiting 05:43:20 (1106): No heartbeat from core client for 30 sec - exiting 05:00:42 (1106): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x501b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x601b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x781d600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x5808e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(678,0xa05ca540) malloc: * error for object 0x301b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug 10:37:39 (678): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Jul 2013 11:20:42	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	1,036,800	1,843,060	1.7776
02 Jul 2013 21:12:36	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	1,010,880	1,799,276	1.7799
02 Jul 2013 12:03:12	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	984,960	1,754,989	1.7818
02 Jul 2013 11:28:02	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	959,040	1,710,751	1.7838
02 Jul 2013 10:54:39	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	933,120	1,666,553	1.7860
02 Jul 2013 10:28:52	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	907,200	1,621,167	1.7870
02 Jul 2013 10:06:34	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	881,280	1,576,779	1.7892
02 Jul 2013 09:46:47	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	855,360	1,531,861	1.7909
28 Jun 2013 01:14:43	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	829,440	1,486,096	1.7917
27 Jun 2013 09:54:34	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	803,520	1,442,282	1.7950
26 Jun 2013 13:47:02	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	777,600	1,394,688	1.7936
25 Jun 2013 21:26:33	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	751,680	1,348,235	1.7936
25 Jun 2013 02:43:30	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	725,760	1,303,116	1.7955
24 Jun 2013 11:16:03	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	699,840	1,257,941	1.7975
23 Jun 2013 19:15:37	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	673,920	1,212,985	1.7999
23 Jun 2013 00:38:17	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	648,000	1,168,228	1.8028
22 Jun 2013 09:26:40	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	622,080	1,122,705	1.8048
21 Jun 2013 17:00:49	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	596,160	1,076,514	1.8057
20 Jun 2013 12:29:36	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	570,240	1,030,404	1.8070
19 Jun 2013 16:00:05	1169903	15818948	hadcm3n_o21k_1980_40_008384103_0	544,320	983,640	1.8071