Task 15937432

Name	hadcm3n_4ank_1940_40_008311509_4
Workunit	8462644
Created	23 Aug 2013, 17:37:17 UTC
Sent	24 Aug 2013, 0:38:42 UTC
Report deadline	23 Nov 2013, 8:05:53 UTC
Received	26 Sep 2013, 6:55:16 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	853527
Run time	18 days 9 hours 0 min 29 sec
CPU time	17 days 4 hours 59 min 20 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.75 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:38:15 (25097): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:43:38 (56984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:18:46 (31321): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:13 (31599): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:46 (31619): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:45 (31724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:43:12 (32624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:47:13 (32645): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:31 (32722): No heartbeat from core client for 30 sec - exiting 11:48:32 (32722): No heartbeat from core client for 30 sec - exiting 11:48:33 (32722): No heartbeat from core client for 30 sec - exiting 11:48:34 (32722): No heartbeat from core client for 30 sec - exiting 11:48:35 (32722): No heartbeat from core client for 30 sec - exiting 11:48:36 (32722): No heartbeat from core client for 30 sec - exiting 11:48:37 (32722): No heartbeat from core client for 30 sec - exiting 11:48:38 (32722): No heartbeat from core client for 30 sec - exiting 11:48:39 (32722): No heartbeat from core client for 30 sec - exiting 11:48:40 (32722): No heartbeat from core client for 30 sec - exiting 11:48:41 (32722): No heartbeat from core client for 30 sec - exiting 11:48:42 (32722): No heartbeat from core client for 30 sec - exiting 11:48:43 (32722): No heartbeat from core client for 30 sec - exiting 11:48:44 (32722): No heartbeat from core client for 30 sec - exiting 11:48:45 (32722): No heartbeat from core client for 30 sec - exiting 11:48:46 (32722): No heartbeat from core client for 30 sec - exiting 11:48:47 (32722): No heartbeat from core client for 30 sec - exiting 11:48:48 (32722): No heartbeat from core client for 30 sec - exiting 11:48:49 (32722): No heartbeat from core client for 30 sec - exiting 11:48:50 (32722): No heartbeat from core client for 30 sec - exiting 11:48:51 (32722): No heartbeat from core client for 30 sec - exiting 11:48:52 (32722): No heartbeat from core client for 30 sec - exiting 11:48:53 (32722): No heartbeat from core client for 30 sec - exiting 11:48:54 (32722): No heartbeat from core client for 30 sec - exiting 11:48:55 (32722): No heartbeat from core client for 30 sec - exiting 11:48:56 (32722): No heartbeat from core client for 30 sec - exiting 11:48:57 (32722): No heartbeat from core client for 30 sec - exiting 11:48:58 (32722): No heartbeat from core client for 30 sec - exiting 11:48:59 (32722): No heartbeat from core client for 30 sec - exiting 11:49:00 (32722): No heartbeat from core client for 30 sec - exiting 11:49:01 (32722): No heartbeat from core client for 30 sec - exiting 11:49:02 (32722): No heartbeat from core client for 30 sec - exiting 11:49:03 (32722): No heartbeat from core client for 30 sec - exiting 11:49:04 (32722): No heartbeat from core client for 30 sec - exiting 11:49:05 (32722): No heartbeat from core client for 30 sec - exiting 11:49:06 (32722): No heartbeat from core client for 30 sec - exiting 11:49:07 (32722): No heartbeat from core client for 30 sec - exiting 11:49:08 (32722): No heartbeat from core client for 30 sec - exiting 11:49:09 (32722): No heartbeat from core client for 30 sec - exiting 11:49:10 (32722): No heartbeat from core client for 30 sec - exiting 11:49:11 (32722): No heartbeat from core client for 30 sec - exiting 11:49:12 (32722): No heartbeat from core client for 30 sec - exiting 11:49:13 (32722): No heartbeat from core client for 30 sec - exiting 11:49:14 (32722): No heartbeat from core client for 30 sec - exiting 11:49:15 (32722): No heartbeat from core client for 30 sec - exiting 11:49:16 (32722): No heartbeat from core client for 30 sec - exiting 11:49:17 (32722): No heartbeat from core client for 30 sec - exiting 11:49:18 (32722): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:50:01 (32744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:53:01 (32764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:02 (32764): No heartbeat from core client for 30 sec - exiting 11:53:03 (32764): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:58:02 (32829): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:03 (32829): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:13:10 (34147): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:03:09 (35116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:44:52 (66273): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:08:21 (78506): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x3012604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x3012600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x4821404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x4821400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x4805c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x4805c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x4805c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x4805c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x4805c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x4805c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x3005604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87156,0xa017b540) malloc: * error for object 0x3005600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:07:47 (62992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:42:34 (67564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:26 (69805): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:22:26 (71310): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:46:21 (72707): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:47:39 (56390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:40 (56390): No heartbeat from core client for 30 sec - exiting 08:47:41 (56390): No heartbeat from core client for 30 sec - exiting 08:47:42 (56390): No heartbeat from core client for 30 sec - exiting 08:47:43 (56390): No heartbeat from core client for 30 sec - exiting 08:47:44 (56390): No heartbeat from core client for 30 sec - exiting 08:47:45 (56390): No heartbeat from core client for 30 sec - exiting 08:47:46 (56390): No heartbeat from core client for 30 sec - exiting 08:47:47 (56390): No heartbeat from core client for 30 sec - exiting 08:47:48 (56390): No heartbeat from core client for 30 sec - exiting 08:47:49 (56390): No heartbeat from core client for 30 sec - exiting 08:47:50 (56390): No heartbeat from core client for 30 sec - exiting 08:47:51 (56390): No heartbeat from core client for 30 sec - exiting 08:47:52 (56390): No heartbeat from core client for 30 sec - exiting 08:47:53 (56390): No heartbeat from core client for 30 sec - exiting 08:47:54 (56390): No heartbeat from core client for 30 sec - exiting 08:47:55 (56390): No heartbeat from core client for 30 sec - exiting 08:47:56 (56390): No heartbeat from core client for 30 sec - exiting 08:47:57 (56390): No heartbeat from core client for 30 sec - exiting 08:47:58 (56390): No heartbeat from core client for 30 sec - exiting 08:47:59 (56390): No heartbeat from core client for 30 sec - exiting 08:48:00 (56390): No heartbeat from core client for 30 sec - exiting 08:48:01 (56390): No heartbeat from core client for 30 sec - exiting 08:48:02 (56390): No heartbeat from core client for 30 sec - exiting 08:48:03 (56390): No heartbeat from core client for 30 sec - exiting 08:48:04 (56390): No heartbeat from core client for 30 sec - exiting Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Sep 2013 05:56:01	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	1,036,800	1,486,353	1.4336
25 Sep 2013 22:12:58	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	1,010,880	1,459,654	1.4439
25 Sep 2013 14:17:54	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	984,960	1,432,401	1.4543
25 Sep 2013 09:28:57	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	959,040	1,405,321	1.4653
25 Sep 2013 09:25:22	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	933,120	1,378,118	1.4769
25 Sep 2013 09:20:39	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	907,200	1,351,165	1.4894
24 Sep 2013 06:53:12	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	881,280	1,324,859	1.5033
23 Sep 2013 23:14:11	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	855,360	1,298,250	1.5178
23 Sep 2013 15:34:07	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	829,440	1,271,650	1.5331
23 Sep 2013 11:37:28	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	803,520	1,245,093	1.5495
23 Sep 2013 11:37:28	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	777,600	1,218,550	1.5671
23 Sep 2013 11:37:28	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	751,680	1,192,014	1.5858
23 Sep 2013 11:37:28	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	725,760	1,165,566	1.6060
22 Sep 2013 01:28:18	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	699,840	1,139,136	1.6277
21 Sep 2013 17:55:14	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	673,920	1,112,626	1.6510
21 Sep 2013 10:15:54	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	648,000	1,086,116	1.6761
21 Sep 2013 02:38:26	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	622,080	1,059,483	1.7031
20 Sep 2013 09:09:23	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	596,160	1,018,386	1.7082
19 Sep 2013 14:22:59	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	570,240	976,126	1.7118
19 Sep 2013 01:25:32	853527	15937432	hadcm3n_4ank_1940_40_008311509_4	544,320	933,239	1.7145