Task 12820132

Name	hadcm3n_p1y1_1900_40_007220105_0
Workunit	7418345
Created	26 Apr 2011, 15:19:24 UTC
Sent	3 May 2011, 5:45:01 UTC
Report deadline	2 Aug 2011, 13:12:12 UTC
Received	30 Jun 2011, 3:30:25 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	959076
Run time	45 days 16 hours 22 min 55 sec
CPU time	39 days 17 hours 6 min 20 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:48:39 (6137): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:56:23 (13205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:21:32 (13214): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:15:05 (777): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(869,0xa0518540) malloc: * error for object 0x1001204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(869,0xa0518540) malloc: * error for object 0x1002004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=871, selfPID=871, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(4936,0xa0518540) malloc: * error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(5146,0xa0518540) malloc: * error for object 0x82a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5359,0xa0518540) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:35:54 (197): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:55 (197): No heartbeat from core client for 30 sec - exiting 20:35:56 (197): No heartbeat from core client for 30 sec - exiting 20:35:57 (197): No heartbeat from core client for 30 sec - exiting 20:35:58 (197): No heartbeat from core client for 30 sec - exiting 20:35:59 (197): No heartbeat from core client for 30 sec - exiting 20:36:00 (197): No heartbeat from core client for 30 sec - exiting 20:36:01 (197): No heartbeat from core client for 30 sec - exiting 20:36:03 (197): No heartbeat from core client for 30 sec - exiting 20:36:04 (197): No heartbeat from core client for 30 sec - exiting 20:36:05 (197): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:16:32 (195): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:53:16 (12252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:53:18 (12252): No heartbeat from core client for 30 sec - exiting 22:53:19 (12252): No heartbeat from core client for 30 sec - exiting 22:53:20 (12252): No heartbeat from core client for 30 sec - exiting 22:53:21 (12252): No heartbeat from core client for 30 sec - exiting 22:53:22 (12252): No heartbeat from core client for 30 sec - exiting 22:53:23 (12252): No heartbeat from core client for 30 sec - exiting 22:53:24 (12252): No heartbeat from core client for 30 sec - exiting 22:53:25 (12252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:07:16 (42749): No heartbeat from core client for 30 sec - exiting 22:07:17 (42749): No heartbeat from core client for 30 sec - exiting 22:07:18 (42749): No heartbeat from core client for 30 sec - exiting 22:07:19 (42749): No heartbeat from core client for 30 sec - exiting 22:07:20 (42749): No heartbeat from core client for 30 sec - exiting 22:07:21 (42749): No heartbeat from core client for 30 sec - exiting 22:07:22 (42749): No heartbeat from core client for 30 sec - exiting 22:07:23 (42749): No heartbeat from core client for 30 sec - exiting 22:07:24 (42749): No heartbeat from core client for 30 sec - exiting 22:07:25 (42749): No heartbeat from core client for 30 sec - exiting 22:07:26 (42749): No heartbeat from core client for 30 sec - exiting 22:07:27 (42749): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=42756, selfPID=42756, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/p1y1ko.pjd3c10 is not a valid UM file. Error converting file to netcdf: dataout/p1y1ko.pjd3c10 Error: Input file: dataout/p1y1ko.pid3c10 is not a valid UM file. Error converting file to netcdf: dataout/p1y1ko.pid3c10 Error: Input file: dataout/p1y1ko.pfd3c10 is not a valid UM file. Error converting file to netcdf: dataout/p1y1ko.pfd3c10 Error: Input file: dataout/p1y1ka.phd3c10 is not a valid UM file. Error converting file to netcdf: dataout/p1y1ka.phd3c10 Error: Input file: dataout/p1y1ka.pgd3c10 is not a valid UM file. Error converting file to netcdf: dataout/p1y1ka.pgd3c10 Error: Input file: dataout/p1y1ka.ped3c10 is not a valid UM file. Error converting file to netcdf: dataout/p1y1ka.ped3c10 Error: Input file: dataout/p1y1ka.pdd3c10 is not a valid UM file. Error converting file to netcdf: dataout/p1y1ka.pdd3c10 00:01:51 (52589): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:10:24 (53981): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:16:35 (57160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:02:33 (22015): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:34:42 (30762): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:46 (31025): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jun 2011 02:22:00	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	1,036,800	3,429,928	3.3082
29 Jun 2011 00:19:30	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	1,010,880	3,344,755	3.3088
27 Jun 2011 22:00:20	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	984,960	3,254,020	3.3037
26 Jun 2011 11:40:36	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	959,040	3,166,008	3.3012
25 Jun 2011 03:10:11	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	933,120	3,078,885	3.2996
23 Jun 2011 03:04:58	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	907,200	2,994,260	3.3006
21 Jun 2011 11:25:18	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	881,280	2,908,426	3.3002
20 Jun 2011 03:18:12	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	855,360	2,821,843	3.2990
20 Jun 2011 00:36:53	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	829,440	2,734,515	3.2968
19 Jun 2011 21:57:40	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	803,520	2,643,019	3.2893
16 Jun 2011 15:42:45	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	777,600	2,552,331	3.2823
15 Jun 2011 06:15:29	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	751,680	2,461,326	3.2744
13 Jun 2011 17:34:43	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	725,760	2,373,688	3.2706
13 Jun 2011 03:52:29	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	699,840	2,289,069	3.2708
13 Jun 2011 03:52:29	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	673,920	2,205,400	3.2725
08 Jun 2011 18:42:18	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	648,000	2,114,718	3.2635
07 Jun 2011 09:34:55	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	622,080	2,022,753	3.2516
06 Jun 2011 04:53:32	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	596,160	1,932,523	3.2416
04 Jun 2011 21:55:29	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	570,240	1,844,379	3.2344
03 Jun 2011 13:25:18	959076	12820132	hadcm3n_p1y1_1900_40_007220105_0	544,320	1,759,874	3.2332