Task 14028999

Name	hadcm3n_yanx_1900_40_007524984_4
Workunit	7722459
Created	29 Jan 2012, 21:15:45 UTC
Sent	29 Jan 2012, 21:15:49 UTC
Report deadline	30 Apr 2012, 4:43:00 UTC
Received	22 Mar 2012, 19:31:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	4 (0x00000004) Unknown error code
Computer ID	1072552
Run time	7 days 13 hours 13 min
CPU time	6 days 18 hours 49 min 19 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process got signal 4 </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:06:22 (22946): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:18 (29875): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:21 (29875): No heartbeat from core client for 30 sec - exiting 14:17:25 (32720): No heartbeat from core client for 30 sec - exiting 14:17:26 (32720): No heartbeat from core client for 30 sec - exiting 14:17:27 (32720): No heartbeat from core client for 30 sec - exiting 14:17:28 (32720): No heartbeat from core client for 30 sec - exiting 14:17:29 (32720): No heartbeat from core client for 30 sec - exiting 14:17:30 (32720): No heartbeat from core client for 30 sec - exiting 14:17:31 (32720): No heartbeat from core client for 30 sec - exiting 14:17:32 (32720): No heartbeat from core client for 30 sec - exiting 14:17:33 (32720): No heartbeat from core client for 30 sec - exiting 14:17:34 (32720): No heartbeat from core client for 30 sec - exiting 14:17:35 (32720): No heartbeat from core client for 30 sec - exiting 14:17:36 (32720): No heartbeat from core client for 30 sec - exiting 14:17:37 (32720): No heartbeat from core client for 30 sec - exiting 14:17:38 (32720): No heartbeat from core client for 30 sec - exiting 14:17:39 (32720): No heartbeat from core client for 30 sec - exiting 14:17:40 (32720): No heartbeat from core client for 30 sec - exiting 14:17:41 (32720): No heartbeat from core client for 30 sec - exiting 14:17:42 (32720): No heartbeat from core client for 30 sec - exiting 14:17:43 (32720): No heartbeat from core client for 30 sec - exiting 14:17:44 (32720): No heartbeat from core client for 30 sec - exiting 14:17:45 (32720): No heartbeat from core client for 30 sec - exiting 14:17:46 (32720): No heartbeat from core client for 30 sec - exiting 14:17:47 (32720): No heartbeat from core client for 30 sec - exiting 14:17:48 (32720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:05:23 (313): No heartbeat from core client for 30 sec - exiting 17:05:24 (313): No heartbeat from core client for 30 sec - exiting 17:05:25 (313): No heartbeat from core client for 30 sec - exiting 17:05:26 (313): No heartbeat from core client for 30 sec - exiting 17:05:28 (313): No heartbeat from core client for 30 sec - exiting 17:05:29 (313): No heartbeat from core client for 30 sec - exiting 17:05:30 (313): No heartbeat from core client for 30 sec - exiting 17:05:31 (313): No heartbeat from core client for 30 sec - exiting 17:05:32 (313): No heartbeat from core client for 30 sec - exiting 17:05:33 (313): No heartbeat from core client for 30 sec - exiting 17:05:35 (313): No heartbeat from core client for 30 sec - exiting 17:05:36 (313): No heartbeat from core client for 30 sec - exiting 17:05:37 (313): No heartbeat from core client for 30 sec - exiting 17:05:38 (313): No heartbeat from core client for 30 sec - exiting 17:05:39 (313): No heartbeat from core client for 30 sec - exiting 17:05:40 (313): No heartbeat from core client for 30 sec - exiting 17:05:41 (313): No heartbeat from core client for 30 sec - exiting 17:05:42 (313): No heartbeat from core client for 30 sec - exiting 17:05:43 (313): No heartbeat from core client for 30 sec - exiting 17:05:44 (313): No heartbeat from core client for 30 sec - exiting 17:05:45 (313): No heartbeat from core client for 30 sec - exiting 17:05:46 (313): No heartbeat from core client for 30 sec - exiting 17:05:47 (313): No heartbeat from core client for 30 sec - exiting 17:05:48 (313): No heartbeat from core client for 30 sec - exiting 17:05:49 (313): No heartbeat from core client for 30 sec - exiting 17:05:50 (313): No heartbeat from core client for 30 sec - exiting 17:05:51 (313): No heartbeat from core client for 30 sec - exiting 17:05:52 (313): No heartbeat from core client for 30 sec - exiting 17:05:53 (313): No heartbeat from core client for 30 sec - exiting 17:05:54 (313): No heartbeat from core client for 30 sec - exiting 17:05:55 (313): No heartbeat from core client for 30 sec - exiting 17:05:56 (313): No heartbeat from core client for 30 sec - exiting 17:05:57 (313): No heartbeat from core client for 30 sec - exiting 17:05:58 (313): No heartbeat from core client for 30 sec - exiting 17:05:59 (313): No heartbeat from core client for 30 sec - exiting 17:06:00 (313): No heartbeat from core client for 30 sec - exiting 17:06:01 (313): No heartbeat from core client for 30 sec - exiting 17:06:02 (313): No heartbeat from core client for 30 sec - exiting 17:06:03 (313): No heartbeat from core client for 30 sec - exiting 17:06:04 (313): No heartbeat from core client for 30 sec - exiting 17:06:05 (313): No heartbeat from core client for 30 sec - exiting 17:06:06 (313): No heartbeat from core client for 30 sec - exiting 17:06:07 (313): No heartbeat from core client for 30 sec - exiting 17:06:08 (313): No heartbeat from core client for 30 sec - exiting 17:06:09 (313): No heartbeat from core client for 30 sec - exiting 17:06:10 (313): No heartbeat from core client for 30 sec - exiting 17:06:11 (313): No heartbeat from core client for 30 sec - exiting 17:06:12 (313): No heartbeat from core client for 30 sec - exiting 17:06:13 (313): No heartbeat from core client for 30 sec - exiting 17:06:14 (313): No heartbeat from core client for 30 sec - exiting 17:06:15 (313): No heartbeat from core client for 30 sec - exiting 17:06:16 (313): No heartbeat from core client for 30 sec - exiting 17:06:17 (313): No heartbeat from core client for 30 sec - exiting 17:06:18 (313): No heartbeat from core client for 30 sec - exiting 17:06:19 (313): No heartbeat from core client for 30 sec - exiting 17:06:20 (313): No heartbeat from core client for 30 sec - exiting 17:06:21 (313): No heartbeat from core client for 30 sec - exiting 17:06:22 (313): No heartbeat from core client for 30 sec - exiting 17:06:23 (313): No heartbeat from core client for 30 sec - exiting 17:06:24 (313): No heartbeat from core client for 30 sec - exiting 17:06:25 (313): No heartbeat from core client for 30 sec - exiting 17:06:26 (313): No heartbeat from core client for 30 sec - exiting 17:06:27 (313): No heartbeat from core client for 30 sec - exiting 17:06:28 (313): No heartbeat from core client for 30 sec - exiting 17:06:29 (313): No heartbeat from core client for 30 sec - exiting 17:06:30 (313): No heartbeat from core client for 30 sec - exiting 17:06:32 (313): No heartbeat from core client for 30 sec - exiting 17:06:33 (313): No heartbeat from core client for 30 sec - exiting 17:06:34 (313): No heartbeat from core client for 30 sec - exiting 17:06:35 (313): No heartbeat from core client for 30 sec - exiting 17:06:36 (313): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/yanxko.pja7c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxko.pja7c10 Error: Input file: dataout/yanxko.pia7c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxko.pia7c10 Error: Input file: dataout/yanxko.pfa7c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxko.pfa7c10 Error: Input file: dataout/yanxka.pha7c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxka.pha7c10 Error: Input file: dataout/yanxka.pga7c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxka.pga7c10 Error: Input file: dataout/yanxka.pea7c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxka.pea7c10 Error: Input file: dataout/yanxka.pda7c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxka.pda7c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:51:26 (84431): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:28 (84431): No heartbeat from core client for 30 sec - exiting 21:51:29 (84431): No heartbeat from core client for 30 sec - exiting 21:51:30 (84431): No heartbeat from core client for 30 sec - exiting 21:51:31 (84431): No heartbeat from core client for 30 sec - exiting 22:08:49 (273): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/yanxko.pjb2c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxko.pjb2c10 Error: Input file: dataout/yanxko.pib2c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxko.pib2c10 Error: Input file: dataout/yanxko.pfb2c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxko.pfb2c10 Error: Input file: dataout/yanxka.phb2c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxka.phb2c10 Error: Input file: dataout/yanxka.pgb2c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxka.pgb2c10 Error: Input file: dataout/yanxka.peb2c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxka.peb2c10 Error: Input file: dataout/yanxka.pdb2c10 is not a valid UM file. Error converting file to netcdf: dataout/yanxka.pdb2c10 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:53:04 (5678): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:48:21 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:22 (4836): No heartbeat from core client for 30 sec - exiting 11:48:23 (4836): No heartbeat from core client for 30 sec - exiting 11:48:24 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:48:10 (335): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:11 (335): No heartbeat from core client for 30 sec - exiting 08:48:12 (335): No heartbeat from core client for 30 sec - exiting 08:48:13 (335): No heartbeat from core client for 30 sec - exiting 08:48:14 (335): No heartbeat from core client for 30 sec - exiting 08:48:15 (335): No heartbeat from core client for 30 sec - exiting 08:48:16 (335): No heartbeat from core client for 30 sec - exiting 08:48:17 (335): No heartbeat from core client for 30 sec - exiting 08:48:18 (335): No heartbeat from core client for 30 sec - exiting 08:48:19 (335): No heartbeat from core client for 30 sec - exiting 08:48:20 (335): No heartbeat from core client for 30 sec - exiting 08:48:21 (335): No heartbeat from core client for 30 sec - exiting 08:48:22 (335): No heartbeat from core client for 30 sec - exiting 08:48:23 (335): No heartbeat from core client for 30 sec - exiting 08:48:24 (335): No heartbeat from core client for 30 sec - exiting 08:48:25 (335): No heartbeat from core client for 30 sec - exiting 08:48:27 (335): No heartbeat from core client for 30 sec - exiting 08:48:28 (335): No heartbeat from core client for 30 sec - exiting 08:48:29 (335): No heartbeat from core client for 30 sec - exiting 08:48:30 (335): No heartbeat from core client for 30 sec - exiting 08:48:31 (335): No heartbeat from core client for 30 sec - exiting 08:48:32 (335): No heartbeat from core client for 30 sec - exiting 08:48:33 (335): No heartbeat from core client for 30 sec - exiting 08:48:34 (335): No heartbeat from core client for 30 sec - exiting 08:48:35 (335): No heartbeat from core client for 30 sec - exiting 08:48:36 (335): No heartbeat from core client for 30 sec - exiting 08:48:37 (335): No heartbeat from core client for 30 sec - exiting 08:48:38 (335): No heartbeat from core client for 30 sec - exiting 08:48:39 (335): No heartbeat from core client for 30 sec - exiting 08:48:40 (335): No heartbeat from core client for 30 sec - exiting 08:48:41 (335): No heartbeat from core client for 30 sec - exiting 08:48:42 (335): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(58883,0xad1fc2c0) malloc: * error for object 0x11a3804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58883,0xad1fc2c0) malloc: * error for object 0x11a3800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58883,0xad1fc2c0) malloc: * error for object 0x11a3804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58883,0xad1fc2c0) malloc: * error for object 0x11a3800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58883,0xad1fc2c0) malloc: * error for object 0x11a3800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=58884, selfPID=58884, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(61117,0xad1fc2c0) malloc: * error for object 0xa4d600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(928,0xad1fc2c0) malloc: * error for object 0x119bc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(928,0xad1fc2c0) malloc: * error for object 0x119bc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(928,0xad1fc2c0) malloc: * error for object 0x9b2000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(928,0xad1fc2c0) malloc: * error for object 0x11acc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.3 build 11D50 Fri Mar 2 22:03:04 2012 Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(6284,0xad1fc2c0) malloc: * error for object 0xb62800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(367,0xac7cf2c0) malloc: * error for object 0x1174a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(331,0xacd412c0) malloc: * error for object 0x12e1c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(331,0xacd412c0) malloc: * error for object 0x12e1c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(331,0xacd412c0) malloc: * error for object 0x12e1c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(341,0xacd412c0) malloc: * error for object 0x9c7400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8d8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8b6e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(317,0xacd412c0) malloc: * error for object 0x8b6e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Mar 2012 19:39:19	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	518,400	584,554	1.1276
28 Feb 2012 19:38:57	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	492,480	554,950	1.1268
26 Feb 2012 21:23:21	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	466,560	525,804	1.1270
26 Feb 2012 02:25:43	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	440,640	496,446	1.1266
25 Feb 2012 08:09:51	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	414,720	467,010	1.1261
23 Feb 2012 16:14:14	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	388,800	437,711	1.1258
22 Feb 2012 22:01:39	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	362,880	408,738	1.1264
14 Feb 2012 03:02:20	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	336,960	379,351	1.1258
12 Feb 2012 19:17:55	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	311,040	350,204	1.1259
12 Feb 2012 01:55:54	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	285,120	321,137	1.1263
11 Feb 2012 07:07:01	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	259,200	291,673	1.1253
10 Feb 2012 12:32:18	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	233,280	262,203	1.1240
09 Feb 2012 17:53:04	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	207,360	233,135	1.1243
06 Feb 2012 17:06:15	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	181,440	203,673	1.1225
05 Feb 2012 05:11:03	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	155,520	174,662	1.1231
04 Feb 2012 10:37:59	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	129,600	145,497	1.1227
03 Feb 2012 15:00:42	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	103,680	116,412	1.1228
02 Feb 2012 22:42:06	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	77,760	87,363	1.1235
31 Jan 2012 13:20:42	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	51,840	58,247	1.1236
30 Jan 2012 21:44:16	1072552	14028999	hadcm3n_yanx_1900_40_007524984_4	25,920	29,010	1.1192