Task 15595066

Name	hadcm3n_47rk_1940_40_008308308_0
Workunit	8459443
Created	7 Feb 2013, 16:55:05 UTC
Sent	7 Feb 2013, 17:06:45 UTC
Report deadline	10 May 2013, 0:33:56 UTC
Received	15 May 2013, 14:58:10 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1267841
Run time	34 days 20 hours 7 min 27 sec
CPU time	28 days 5 hours 41 min 56 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <stderr_txt> 17:20:32 (64402): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:52:07 (83030): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:03:35 (61686): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:16:50 (98087): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:40:50 (76709): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:36:01 (491): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:17:45 (24044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:53:54 (31438): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:19 (38776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:23:11 (42333): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:56 (52378): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:58:13 (85697): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:13:49 (29265): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0xb80204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0xb80200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0xb80204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0xb80200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0xb80204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0xb80200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0x1b52604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0x1b53404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0x1b53400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(68212,0xaca472c0) malloc: * error for object 0x1b53404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(74352,0xaca472c0) malloc: * error for object 0x11dc804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74352,0xaca472c0) malloc: * error for object 0x11dc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74352,0xaca472c0) malloc: * error for object 0x11dc804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74352,0xaca472c0) malloc: * error for object 0x11dc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74352,0xaca472c0) malloc: * error for object 0x11dc804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74352,0xaca472c0) malloc: * error for object 0x11dc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74352,0xaca472c0) malloc: * error for object 0x11dc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 09:40:22 (74352): No heartbeat from core client for 30 sec - exiting 09:40:23 (74352): No heartbeat from core client for 30 sec - exiting 09:40:24 (74352): No heartbeat from core client for 30 sec - exiting 09:40:25 (74352): No heartbeat from core client for 30 sec - exiting 09:40:26 (74352): No heartbeat from core client for 30 sec - exiting 09:40:27 (74352): No heartbeat from core client for 30 sec - exiting 09:40:28 (74352): No heartbeat from core client for 30 sec - exiting 09:40:29 (74352): No heartbeat from core client for 30 sec - exiting 09:40:30 (74352): No heartbeat from core client for 30 sec - exiting 09:40:31 (74352): No heartbeat from core client for 30 sec - exiting 09:40:32 (74352): No heartbeat from core client for 30 sec - exiting 09:40:33 (74352): No heartbeat from core client for 30 sec - exiting 09:40:34 (74352): No heartbeat from core client for 30 sec - exiting 13:57:12 (74352): No heartbeat from core client for 30 sec - exiting 13:57:13 (74352): No heartbeat from core client for 30 sec - exiting 13:57:14 (74352): No heartbeat from core client for 30 sec - exiting 13:57:15 (74352): No heartbeat from core client for 30 sec - exiting 13:57:16 (74352): No heartbeat from core client for 30 sec - exiting 23:24:11 (74352): No heartbeat from core client for 30 sec - exiting 23:24:12 (74352): No heartbeat from core client for 30 sec - exiting 23:24:13 (74352): No heartbeat from core client for 30 sec - exiting 23:24:14 (74352): No heartbeat from core client for 30 sec - exiting 23:24:15 (74352): No heartbeat from core client for 30 sec - exiting 23:24:16 (74352): No heartbeat from core client for 30 sec - exiting 23:24:17 (74352): No heartbeat from core client for 30 sec - exiting 00:53:39 (74352): No heartbeat from core client for 30 sec - exiting 04:37:26 (74352): No heartbeat from core client for 30 sec - exiting 04:37:27 (74352): No heartbeat from core client for 30 sec - exiting 04:37:28 (74352): No heartbeat from core client for 30 sec - exiting 04:37:29 (74352): No heartbeat from core client for 30 sec - exiting 04:37:30 (74352): No heartbeat from core client for 30 sec - exiting 04:37:31 (74352): No heartbeat from core client for 30 sec - exiting 04:37:32 (74352): No heartbeat from core client for 30 sec - exiting 04:37:33 (74352): No heartbeat from core client for 30 sec - exiting 04:37:34 (74352): No heartbeat from core client for 30 sec - exiting 04:37:36 (74352): No heartbeat from core client for 30 sec - exiting 04:37:37 (74352): No heartbeat from core client for 30 sec - exiting 14:10:09 (74352): No heartbeat from core client for 30 sec - exiting 14:10:10 (74352): No heartbeat from core client for 30 sec - exiting 14:10:11 (74352): No heartbeat from core client for 30 sec - exiting 14:10:12 (74352): No heartbeat from core client for 30 sec - exiting 14:10:13 (74352): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(34171,0xaca472c0) malloc: * error for object 0x18ca400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0xa4d604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0xa4d600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(385,0xaca022c0) malloc: * error for object 0x1223400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug 15:33:39 (385): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:33 (33581): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:05 (39976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:20 (34847): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:49:59 (42491): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:01:42 (50337): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:48:58 (64364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:44:18 (67259): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:49:37 (11384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:36 (15100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:59:45 (18625): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:31:51 (24737): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:22:19 (32026): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 May 2013 14:02:21	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	1,036,800	2,438,758	2.3522
13 May 2013 17:58:58	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	1,010,880	2,378,440	2.3528
12 May 2013 21:38:13	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	984,960	2,319,201	2.3546
12 May 2013 00:43:04	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	959,040	2,259,164	2.3557
11 May 2013 03:40:46	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	933,120	2,199,643	2.3573
10 May 2013 07:40:56	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	907,200	2,141,112	2.3601
09 May 2013 10:46:48	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	881,280	2,081,251	2.3616
08 May 2013 13:20:20	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	855,360	2,020,781	2.3625
07 May 2013 15:35:44	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	829,440	1,958,971	2.3618
06 May 2013 16:12:06	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	803,520	1,898,968	2.3633
01 May 2013 01:21:50	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	777,600	1,839,818	2.3660
28 Apr 2013 12:47:22	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	751,680	1,778,821	2.3665
27 Apr 2013 02:46:10	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	725,760	1,718,234	2.3675
25 Apr 2013 12:48:23	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	699,840	1,658,683	2.3701
23 Apr 2013 23:47:08	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	673,920	1,595,389	2.3673
23 Apr 2013 03:52:26	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	648,000	1,535,319	2.3693
22 Apr 2013 07:43:28	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	622,080	1,474,372	2.3701
21 Apr 2013 06:46:32	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	596,160	1,412,337	2.3691
18 Apr 2013 23:25:27	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	570,240	1,347,384	2.3628
18 Apr 2013 00:12:01	1267841	15595066	hadcm3n_47rk_1940_40_008308308_0	544,320	1,283,940	2.3588