Task 12845377

Name	hadcm3n_p4k1_1900_40_007223489_2
Workunit	7421729
Created	29 Apr 2011, 12:06:27 UTC
Sent	29 Apr 2011, 12:12:16 UTC
Report deadline	29 Jul 2011, 19:39:27 UTC
Received	2 Sep 2011, 21:52:11 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1124377
Run time	28 days 6 hours 26 min 46 sec
CPU time	19 days 18 hours 12 min 18 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.40 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:57:28 (22439): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:29 (22439): No heartbeat from core client for 30 sec - exiting 05:57:30 (22439): No heartbeat from core client for 30 sec - exiting 05:57:31 (22439): No heartbeat from core client for 30 sec - exiting 05:57:32 (22439): No heartbeat from core client for 30 sec - exiting 05:57:33 (22439): No heartbeat from core client for 30 sec - exiting 05:57:34 (22439): No heartbeat from core client for 30 sec - exiting 05:57:35 (22439): No heartbeat from core client for 30 sec - exiting 05:57:36 (22439): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(36110,0xa02fb540) malloc: * error for object 0x852604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36110,0xa02fb540) malloc: * error for object 0x852600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36110,0xa02fb540) malloc: * error for object 0x852604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36110,0xa02fb540) malloc: * error for object 0x852600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=36113, selfPID=36113, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x104ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x104ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x82e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x82e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x82e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x82e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x82e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x82e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x1011e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x1011e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x82e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39528,0xa02fb540) malloc: * error for object 0x82e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:58:54 (14855): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:55 (14855): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:03:09 (16137): No heartbeat from core client for 30 sec - exiting 09:03:10 (16137): No heartbeat from core client for 30 sec - exiting 09:03:11 (16137): No heartbeat from core client for 30 sec - exiting 09:03:12 (16137): No heartbeat from core client for 30 sec - exiting 09:03:13 (16137): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:13:51 (30700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:13:53 (30700): No heartbeat from core client for 30 sec - exiting 07:13:54 (30700): No heartbeat from core client for 30 sec - exiting 07:13:55 (30700): No heartbeat from core client for 30 sec - exiting 07:13:56 (30700): No heartbeat from core client for 30 sec - exiting 07:13:57 (30700): No heartbeat from core client for 30 sec - exiting 07:13:58 (30700): No heartbeat from core client for 30 sec - exiting 07:13:59 (30700): No heartbeat from core client for 30 sec - exiting 07:14:00 (30700): No heartbeat from core client for 30 sec - exiting 07:14:01 (30700): No heartbeat from core client for 30 sec - exiting 07:14:02 (30700): No heartbeat from core client for 30 sec - exiting 07:14:03 (30700): No heartbeat from core client for 30 sec - exiting 07:14:04 (30700): No heartbeat from core client for 30 sec - exiting 07:14:05 (30700): No heartbeat from core client for 30 sec - exiting 07:14:06 (30700): No heartbeat from core client for 30 sec - exiting 07:14:07 (30700): No heartbeat from core client for 30 sec - exiting 07:14:08 (30700): No heartbeat from core client for 30 sec - exiting 07:14:09 (30700): No heartbeat from core client for 30 sec - exiting 07:14:10 (30700): No heartbeat from core client for 30 sec - exiting 07:14:11 (30700): No heartbeat from core client for 30 sec - exiting 07:14:12 (30700): No heartbeat from core client for 30 sec - exiting 07:14:13 (30700): No heartbeat from core client for 30 sec - exiting 07:14:14 (30700): No heartbeat from core client for 30 sec - exiting 07:14:15 (30700): No heartbeat from core client for 30 sec - exiting 07:14:16 (30700): No heartbeat from core client for 30 sec - exiting 07:14:17 (30700): No heartbeat from core client for 30 sec - exiting 07:14:18 (30700): No heartbeat from core client for 30 sec - exiting 07:14:19 (30700): No heartbeat from core client for 30 sec - exiting 07:14:20 (30700): No heartbeat from core client for 30 sec - exiting 07:14:21 (30700): No heartbeat from core client for 30 sec - exiting 07:14:22 (30700): No heartbeat from core client for 30 sec - exiting 07:14:23 (30700): No heartbeat from core client for 30 sec - exiting 07:14:24 (30700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:57:33 (43607): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:58:04 (43607): No heartbeat from core client for 30 sec - exiting 21:58:05 (43607): No heartbeat from core client for 30 sec - exiting 21:58:06 (43607): No heartbeat from core client for 30 sec - exiting 21:58:07 (43607): No heartbeat from core client for 30 sec - exiting 21:58:08 (43607): No heartbeat from core client for 30 sec - exiting 21:58:09 (43607): No heartbeat from core client for 30 sec - exiting 21:58:10 (43607): No heartbeat from core client for 30 sec - exiting 21:58:11 (43607): No heartbeat from core client for 30 sec - exiting 21:58:12 (43607): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x101e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x101e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13166,0xa02fb540) malloc: * error for object 0x820400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:23:15 (74027): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:23:16 (74027): No heartbeat from core client for 30 sec - exiting 08:23:17 (74027): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:30:43 (80768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:02:24 (206): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:10:16 (17454): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:10:17 (17454): No heartbeat from core client for 30 sec - exiting 08:10:18 (17454): No heartbeat from core client for 30 sec - exiting 08:10:19 (17454): No heartbeat from core client for 30 sec - exiting 08:10:20 (17454): No heartbeat from core client for 30 sec - exiting 08:10:21 (17454): No heartbeat from core client for 30 sec - exiting 08:10:22 (17454): No heartbeat from core client for 30 sec - exiting 08:10:23 (17454): No heartbeat from core client for 30 sec - exiting 08:10:24 (17454): No heartbeat from core client for 30 sec - exiting 08:10:25 (17454): No heartbeat from core client for 30 sec - exiting 08:10:26 (17454): No heartbeat from core client for 30 sec - exiting 08:10:27 (17454): No heartbeat from core client for 30 sec - exiting 08:10:28 (17454): No heartbeat from core client for 30 sec - exiting 08:10:29 (17454): No heartbeat from core client for 30 sec - exiting 08:10:30 (17454): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:30:43 (3801): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:30:45 (3801): No heartbeat from core client for 30 sec - exiting 06:30:46 (3801): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Sep 2011 20:50:19	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	1,036,800	1,706,437	1.6459
01 Sep 2011 10:50:12	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	1,010,880	1,662,694	1.6448
27 Aug 2011 22:46:35	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	984,960	1,617,488	1.6422
22 Aug 2011 03:01:46	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	959,040	1,572,305	1.6395
18 Aug 2011 13:09:05	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	933,120	1,523,610	1.6328
11 Aug 2011 14:55:19	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	907,200	1,481,034	1.6325
05 Aug 2011 14:59:22	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	881,280	1,435,831	1.6293
03 Aug 2011 14:35:47	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	855,360	1,394,796	1.6307
03 Aug 2011 03:09:26	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	829,440	1,355,807	1.6346
01 Aug 2011 16:03:41	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	803,520	1,312,117	1.6330
09 Jul 2011 01:11:39	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	777,600	1,269,806	1.6330
01 Jul 2011 23:04:27	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	751,680	1,225,712	1.6306
30 Jun 2011 18:41:31	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	725,760	1,185,029	1.6328
24 Jun 2011 21:47:40	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	699,840	1,140,471	1.6296
23 Jun 2011 11:41:31	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	673,920	1,097,038	1.6278
21 Jun 2011 04:48:09	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	648,000	1,054,032	1.6266
20 Jun 2011 10:20:49	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	622,080	1,011,768	1.6264
20 Jun 2011 03:23:15	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	596,160	972,165	1.6307
19 Jun 2011 21:57:34	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	570,240	930,565	1.6319
12 Jun 2011 17:37:18	1124377	12845377	hadcm3n_p4k1_1900_40_007223489_2	544,320	889,009	1.6332