Task 14281729

Name	hadcm3n_ym1c_1940_40_007831773_1
Workunit	7986885
Created	18 Mar 2012, 11:22:37 UTC
Sent	18 Mar 2012, 11:22:43 UTC
Report deadline	17 Jun 2012, 18:49:54 UTC
Received	1 May 2012, 23:13:23 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	941153
Run time	25 days 16 hours 1 min 32 sec
CPU time	22 days 19 hours 15 min 34 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:36:06 (53520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:07 (53520): No heartbeat from core client for 30 sec - exiting 03:36:08 (53520): No heartbeat from core client for 30 sec - exiting 03:36:09 (53520): No heartbeat from core client for 30 sec - exiting 03:36:10 (53520): No heartbeat from core client for 30 sec - exiting 03:36:11 (53520): No heartbeat from core client for 30 sec - exiting 03:36:12 (53520): No heartbeat from core client for 30 sec - exiting 03:36:13 (53520): No heartbeat from core client for 30 sec - exiting 03:36:14 (53520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:00:12 (2501): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:22:39 (58570): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:16:10 (64657): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:11 (64657): No heartbeat from core client for 30 sec - exiting 03:16:12 (64657): No heartbeat from core client for 30 sec - exiting 03:16:13 (64657): No heartbeat from core client for 30 sec - exiting 03:16:14 (64657): No heartbeat from core client for 30 sec - exiting 03:16:15 (64657): No heartbeat from core client for 30 sec - exiting 03:16:16 (64657): No heartbeat from core client for 30 sec - exiting 03:16:17 (64657): No heartbeat from core client for 30 sec - exiting 03:16:18 (64657): No heartbeat from core client for 30 sec - exiting 03:16:19 (64657): No heartbeat from core client for 30 sec - exiting 03:16:20 (64657): No heartbeat from core client for 30 sec - exiting 03:16:21 (64657): No heartbeat from core client for 30 sec - exiting 03:16:22 (64657): No heartbeat from core client for 30 sec - exiting 03:16:23 (64657): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:53:57 (84678): No heartbeat from core client for 30 sec - exiting 12:53:59 (84678): No heartbeat from core client for 30 sec - exiting 12:54:00 (84678): No heartbeat from core client for 30 sec - exiting 12:54:01 (84678): No heartbeat from core client for 30 sec - exiting 12:54:02 (84678): No heartbeat from core client for 30 sec - exiting 12:54:03 (84678): No heartbeat from core client for 30 sec - exiting 12:54:04 (84678): No heartbeat from core client for 30 sec - exiting 12:54:05 (84678): No heartbeat from core client for 30 sec - exiting 12:54:06 (84678): No heartbeat from core client for 30 sec - exiting 12:54:07 (84678): No heartbeat from core client for 30 sec - exiting 12:54:08 (84678): No heartbeat from core client for 30 sec - exiting 12:54:09 (84678): No heartbeat from core client for 30 sec - exiting 12:54:10 (84678): No heartbeat from core client for 30 sec - exiting 12:54:11 (84678): No heartbeat from core client for 30 sec - exiting 12:54:12 (84678): No heartbeat from core client for 30 sec - exiting 12:54:13 (84678): No heartbeat from core client for 30 sec - exiting 12:54:14 (84678): No heartbeat from core client for 30 sec - exiting 12:54:15 (84678): No heartbeat from core client for 30 sec - exiting 12:54:16 (84678): No heartbeat from core client for 30 sec - exiting 12:54:17 (84678): No heartbeat from core client for 30 sec - exiting 12:54:18 (84678): No heartbeat from core client for 30 sec - exiting 12:54:19 (84678): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ym1cko.pjf4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cko.pjf4c10 Error: Input file: dataout/ym1cko.pif4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cko.pif4c10 Error: Input file: dataout/ym1cko.pff4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cko.pff4c10 Error: Input file: dataout/ym1cka.phf4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cka.phf4c10 Error: Input file: dataout/ym1cka.pgf4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cka.pgf4c10 Error: Input file: dataout/ym1cka.pef4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cka.pef4c10 Error: Input file: dataout/ym1cka.pdf4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cka.pdf4c10 12:55:10 (7003): No heartbeat from core client for 30 sec - exiting 12:55:11 (7003): No heartbeat from core client for 30 sec - exiting 12:55:12 (7003): No heartbeat from core client for 30 sec - exiting 12:55:13 (7003): No heartbeat from core client for 30 sec - exiting 12:55:14 (7003): No heartbeat from core client for 30 sec - exiting 12:55:15 (7003): No heartbeat from core client for 30 sec - exiting 12:55:16 (7003): No heartbeat from core client for 30 sec - exiting 12:55:17 (7003): No heartbeat from core client for 30 sec - exiting 12:55:18 (7003): No heartbeat from core client for 30 sec - exiting 12:55:19 (7003): No heartbeat from core client for 30 sec - exiting 12:55:20 (7003): No heartbeat from core client for 30 sec - exiting 12:55:21 (7003): No heartbeat from core client for 30 sec - exiting 12:55:22 (7003): No heartbeat from core client for 30 sec - exiting 12:55:23 (7003): No heartbeat from core client for 30 sec - exiting 12:55:24 (7003): No heartbeat from core client for 30 sec - exiting 12:55:25 (7003): No heartbeat from core client for 30 sec - exiting 12:55:26 (7003): No heartbeat from core client for 30 sec - exiting 12:55:27 (7003): No heartbeat from core client for 30 sec - exiting 12:55:28 (7003): No heartbeat from core client for 30 sec - exiting 12:55:29 (7003): No heartbeat from core client for 30 sec - exiting 12:55:30 (7003): No heartbeat from core client for 30 sec - exiting 12:55:31 (7003): No heartbeat from core client for 30 sec - exiting 12:55:32 (7003): No heartbeat from core client for 30 sec - exiting 12:55:33 (7003): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ym1cko.pjf4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cko.pjf4c10 Error: Input file: dataout/ym1cko.pif4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cko.pif4c10 Error: Input file: dataout/ym1cko.pff4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cko.pff4c10 Error: Input file: dataout/ym1cka.phf4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cka.phf4c10 Error: Input file: dataout/ym1cka.pgf4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cka.pgf4c10 Error: Input file: dataout/ym1cka.pef4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cka.pef4c10 Error: Input file: dataout/ym1cka.pdf4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1cka.pdf4c10 03:00:05 (7011): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:00:07 (7011): No heartbeat from core client for 30 sec - exiting 03:00:08 (7011): No heartbeat from core client for 30 sec - exiting 03:00:09 (7011): No heartbeat from core client for 30 sec - exiting 03:00:10 (7011): No heartbeat from core client for 30 sec - exiting 03:00:11 (7011): No heartbeat from core client for 30 sec - exiting 03:00:12 (7011): No heartbeat from core client for 30 sec - exiting 03:00:13 (7011): No heartbeat from core client for 30 sec - exiting 03:00:14 (7011): No heartbeat from core client for 30 sec - exiting 03:00:15 (7011): No heartbeat from core client for 30 sec - exiting 03:00:16 (7011): No heartbeat from core client for 30 sec - exiting 03:00:17 (7011): No heartbeat from core client for 30 sec - exiting 03:00:18 (7011): No heartbeat from core client for 30 sec - exiting 03:00:19 (7011): No heartbeat from core client for 30 sec - exiting 03:00:20 (7011): No heartbeat from core client for 30 sec - exiting 03:00:21 (7011): No heartbeat from core client for 30 sec - exiting 03:00:22 (7011): No heartbeat from core client for 30 sec - exiting 03:00:23 (7011): No heartbeat from core client for 30 sec - exiting 03:00:24 (7011): No heartbeat from core client for 30 sec - exiting 03:00:25 (7011): No heartbeat from core client for 30 sec - exiting 03:00:26 (7011): No heartbeat from core client for 30 sec - exiting 03:00:27 (7011): No heartbeat from core client for 30 sec - exiting 03:00:29 (7011): No heartbeat from core client for 30 sec - exiting 03:00:30 (7011): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:07:01 (189): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:02 (189): No heartbeat from core client for 30 sec - exiting 19:07:03 (189): No heartbeat from core client for 30 sec - exiting 19:07:04 (189): No heartbeat from core client for 30 sec - exiting 19:07:05 (189): No heartbeat from core client for 30 sec - exiting 19:07:06 (189): No heartbeat from core client for 30 sec - exiting 19:07:07 (189): No heartbeat from core client for 30 sec - exiting 19:07:08 (189): No heartbeat from core client for 30 sec - exiting 19:07:09 (189): No heartbeat from core client for 30 sec - exiting 19:07:10 (189): No heartbeat from core client for 30 sec - exiting 19:07:11 (189): No heartbeat from core client for 30 sec - exiting 19:07:12 (189): No heartbeat from core client for 30 sec - exiting 19:07:13 (189): No heartbeat from core client for 30 sec - exiting 19:07:14 (189): No heartbeat from core client for 30 sec - exiting 19:07:15 (189): No heartbeat from core client for 30 sec - exiting 19:07:16 (189): No heartbeat from core client for 30 sec - exiting 19:07:17 (189): No heartbeat from core client for 30 sec - exiting 19:07:18 (189): No heartbeat from core client for 30 sec - exiting 19:07:19 (189): No heartbeat from core client for 30 sec - exiting 19:07:20 (189): No heartbeat from core client for 30 sec - exiting 19:07:21 (189): No heartbeat from core client for 30 sec - exiting 19:07:22 (189): No heartbeat from core client for 30 sec - exiting 19:07:23 (189): No heartbeat from core client for 30 sec - exiting 19:07:24 (189): No heartbeat from core client for 30 sec - exiting 19:07:25 (189): No heartbeat from core client for 30 sec - exiting 19:07:27 (189): No heartbeat from core client for 30 sec - exiting 19:07:28 (189): No heartbeat from core client for 30 sec - exiting 03:53:03 (2672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:04 (2672): No heartbeat from core client for 30 sec - exiting 03:55:05 (3049): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:34 (3099): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:56:30 (30851): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:41:32 (34529): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:05:03 (40270): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:14 (41056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:16 (41056): No heartbeat from core client for 30 sec - exiting 19:45:17 (41056): No heartbeat from core client for 30 sec - exiting 19:45:18 (41056): No heartbeat from core client for 30 sec - exiting 19:45:19 (41056): No heartbeat from core client for 30 sec - exiting 19:45:20 (41056): No heartbeat from core client for 30 sec - exiting 19:45:21 (41056): No heartbeat from core client for 30 sec - exiting 19:45:22 (41056): No heartbeat from core client for 30 sec - exiting 19:45:23 (41056): No heartbeat from core client for 30 sec - exiting 19:45:24 (41056): No heartbeat from core client for 30 sec - exiting 19:45:25 (41056): No heartbeat from core client for 30 sec - exiting 19:45:26 (41056): No heartbeat from core client for 30 sec - exiting 19:45:27 (41056): No heartbeat from core client for 30 sec - exiting 19:45:28 (41056): No heartbeat from core client for 30 sec - exiting 19:45:29 (41056): No heartbeat from core client for 30 sec - exiting 19:45:30 (41056): No heartbeat from core client for 30 sec - exiting 19:45:31 (41056): No heartbeat from core client for 30 sec - exiting 19:45:32 (41056): No heartbeat from core client for 30 sec - exiting 19:45:33 (41056): No heartbeat from core client for 30 sec - exiting 19:45:34 (41056): No heartbeat from core client for 30 sec - exiting 19:45:42 (41056): No heartbeat from core client for 30 sec - exiting 19:45:43 (41056): No heartbeat from core client for 30 sec - exiting 17:05:34 (49797): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:54:58 (64623): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:54:59 (64623): No heartbeat from core client for 30 sec - exiting 17:55:01 (64623): No heartbeat from core client for 30 sec - exiting 17:55:02 (64623): No heartbeat from core client for 30 sec - exiting 17:55:03 (64623): No heartbeat from core client for 30 sec - exiting 17:55:04 (64623): No heartbeat from core client for 30 sec - exiting 17:55:05 (64623): No heartbeat from core client for 30 sec - exiting 17:55:06 (64623): No heartbeat from core client for 30 sec - exiting 17:55:07 (64623): No heartbeat from core client for 30 sec - exiting 17:55:08 (64623): No heartbeat from core client for 30 sec - exiting 17:55:09 (64623): No heartbeat from core client for 30 sec - exiting 17:55:10 (64623): No heartbeat from core client for 30 sec - exiting 17:55:11 (64623): No heartbeat from core client for 30 sec - exiting 17:55:12 (64623): No heartbeat from core client for 30 sec - exiting 17:55:13 (64623): No heartbeat from core client for 30 sec - exiting 17:55:14 (64623): No heartbeat from core client for 30 sec - exiting 17:55:15 (64623): No heartbeat from core client for 30 sec - exiting 17:55:16 (64623): No heartbeat from core client for 30 sec - exiting 17:55:17 (64623): No heartbeat from core client for 30 sec - exiting 17:55:18 (64623): No heartbeat from core client for 30 sec - exiting 17:55:19 (64623): No heartbeat from core client for 30 sec - exiting 17:55:20 (64623): No heartbeat from core client for 30 sec - exiting 16:03:31 (66285): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:33 (66285): No heartbeat from core client for 30 sec - exiting 16:03:34 (66285): No heartbeat from core client for 30 sec - exiting 16:03:35 (66285): No heartbeat from core client for 30 sec - exiting 16:03:36 (66285): No heartbeat from core client for 30 sec - exiting 16:03:37 (66285): No heartbeat from core client for 30 sec - exiting 16:03:38 (66285): No heartbeat from core client for 30 sec - exiting 16:03:39 (66285): No heartbeat from core client for 30 sec - exiting 16:03:40 (66285): No heartbeat from core client for 30 sec - exiting 16:03:41 (66285): No heartbeat from core client for 30 sec - exiting 16:03:42 (66285): No heartbeat from core client for 30 sec - exiting 16:03:43 (66285): No heartbeat from core client for 30 sec - exiting 16:03:44 (66285): No heartbeat from core client for 30 sec - exiting 16:03:45 (66285): No heartbeat from core client for 30 sec - exiting 16:03:46 (66285): No heartbeat from core client for 30 sec - exiting 16:03:47 (66285): No heartbeat from core client for 30 sec - exiting 16:03:48 (66285): No heartbeat from core client for 30 sec - exiting 16:03:49 (66285): No heartbeat from core client for 30 sec - exiting 16:03:50 (66285): No heartbeat from core client for 30 sec - exiting 16:03:51 (66285): No heartbeat from core client for 30 sec - exiting 16:03:52 (66285): No heartbeat from core client for 30 sec - exiting 16:03:53 (66285): No heartbeat from core client for 30 sec - exiting 16:03:54 (66285): No heartbeat from core client for 30 sec - exiting 16:03:55 (66285): No heartbeat from core client for 30 sec - exiting 16:03:56 (66285): No heartbeat from core client for 30 sec - exiting 16:03:57 (66285): No heartbeat from core client for 30 sec - exiting 16:03:58 (66285): No heartbeat from core client for 30 sec - exiting 16:03:59 (66285): No heartbeat from core client for 30 sec - exiting 16:04:00 (66285): No heartbeat from core client for 30 sec - exiting 16:04:01 (66285): No heartbeat from core client for 30 sec - exiting 16:04:02 (66285): No heartbeat from core client for 30 sec - exiting 16:04:03 (66285): No heartbeat from core client for 30 sec - exiting 16:04:04 (66285): No heartbeat from core client for 30 sec - exiting 16:04:05 (66285): No heartbeat from core client for 30 sec - exiting 16:04:06 (66285): No heartbeat from core client for 30 sec - exiting 16:04:07 (66285): No heartbeat from core client for 30 sec - exiting 16:04:08 (66285): No heartbeat from core client for 30 sec - exiting 16:04:09 (66285): No heartbeat from core client for 30 sec - exiting 16:04:10 (66285): No heartbeat from core client for 30 sec - exiting 16:04:11 (66285): No heartbeat from core client for 30 sec - exiting 16:04:12 (66285): No heartbeat from core client for 30 sec - exiting 16:04:13 (66285): No heartbeat from core client for 30 sec - exiting 16:04:14 (66285): No heartbeat from core client for 30 sec - exiting 16:04:15 (66285): No heartbeat from core client for 30 sec - exiting 16:04:16 (66285): No heartbeat from core client for 30 sec - exiting 16:04:17 (66285): No heartbeat from core client for 30 sec - exiting 16:04:18 (66285): No heartbeat from core client for 30 sec - exiting 16:04:19 (66285): No heartbeat from core client for 30 sec - exiting 16:04:20 (66285): No heartbeat from core client for 30 sec - exiting 16:04:21 (66285): No heartbeat from core client for 30 sec - exiting 16:04:22 (66285): No heartbeat from core client for 30 sec - exiting 16:34:17 (76495): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 14:32:53 (193): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation 15:45:02 (13224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:27 (13679): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:30:17 (1333): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:30:19 (1333): No heartbeat from core client for 30 sec - exiting cpdnmonitor: error reading file dataout/ocean_restart.day Suspended CPDN Monitor - Suspend request from BOINC... 12:20:59 (8663): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:25:03 (19165): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:05 (19165): No heartbeat from core client for 30 sec - exiting 13:25:06 (19165): No heartbeat from core client for 30 sec - exiting 13:25:07 (19165): No heartbeat from core client for 30 sec - exiting 13:25:08 (19165): No heartbeat from core client for 30 sec - exiting 13:25:09 (19165): No heartbeat from core client for 30 sec - exiting 13:25:10 (19165): No heartbeat from core client for 30 sec - exiting 13:25:11 (19165): No heartbeat from core client for 30 sec - exiting 13:25:12 (19165): No heartbeat from core client for 30 sec - exiting 13:25:13 (19165): No heartbeat from core client for 30 sec - exiting 13:25:14 (19165): No heartbeat from core client for 30 sec - exiting 13:25:15 (19165): No heartbeat from core client for 30 sec - exiting 13:25:16 (19165): No heartbeat from core client for 30 sec - exiting 13:25:17 (19165): No heartbeat from core client for 30 sec - exiting 13:25:18 (19165): No heartbeat from core client for 30 sec - exiting 13:25:19 (19165): No heartbeat from core client for 30 sec - exiting 13:25:20 (19165): No heartbeat from core client for 30 sec - exiting 13:25:21 (19165): No heartbeat from core client for 30 sec - exiting 13:25:22 (19165): No heartbeat from core client for 30 sec - exiting 13:25:23 (19165): No heartbeat from core client for 30 sec - exiting 13:25:24 (19165): No heartbeat from core client for 30 sec - exiting 13:25:25 (19165): No heartbeat from core client for 30 sec - exiting 13:25:27 (19165): No heartbeat from core client for 30 sec - exiting 13:25:28 (19165): No heartbeat from core client for 30 sec - exiting 13:25:29 (19165): No heartbeat from core client for 30 sec - exiting 13:27:24 (19575): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:25 (19575): No heartbeat from core client for 30 sec - exiting 13:27:26 (19575): No heartbeat from core client for 30 sec - exiting 13:27:27 (19575): No heartbeat from core client for 30 sec - exiting 13:27:29 (19575): No heartbeat from core client for 30 sec - exiting 13:27:30 (19575): No heartbeat from core client for 30 sec - exiting 13:27:31 (19575): No heartbeat from core client for 30 sec - exiting 13:27:32 (19575): No heartbeat from core client for 30 sec - exiting 13:27:33 (19575): No heartbeat from core client for 30 sec - exiting 13:27:34 (19575): No heartbeat from core client for 30 sec - exiting 13:27:35 (19575): No heartbeat from core client for 30 sec - exiting 13:27:36 (19575): No heartbeat from core client for 30 sec - exiting 13:27:37 (19575): No heartbeat from core client for 30 sec - exiting 13:27:38 (19575): No heartbeat from core client for 30 sec - exiting 13:27:39 (19575): No heartbeat from core client for 30 sec - exiting 13:27:40 (19575): No heartbeat from core client for 30 sec - exiting 13:27:41 (19575): No heartbeat from core client for 30 sec - exiting 13:27:42 (19575): No heartbeat from core client for 30 sec - exiting 13:27:43 (19575): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:52:07 (19588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:19 (21773): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 17:05:11 (180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:40:30 (196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:17:47 (2580): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:37:28 (3899): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:37:40 (4077): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:37:41 (4077): No heartbeat from core client for 30 sec - exiting 13:37:42 (4077): No heartbeat from core client for 30 sec - exiting 13:37:43 (4077): No heartbeat from core client for 30 sec - exiting 13:37:44 (4077): No heartbeat from core client for 30 sec - exiting 13:37:45 (4077): No heartbeat from core client for 30 sec - exiting 13:37:46 (4077): No heartbeat from core client for 30 sec - exiting 13:37:47 (4077): No heartbeat from core client for 30 sec - exiting 13:37:48 (4077): No heartbeat from core client for 30 sec - exiting 13:37:49 (4077): No heartbeat from core client for 30 sec - exiting 13:37:50 (4077): No heartbeat from core client for 30 sec - exiting 13:37:51 (4077): No heartbeat from core client for 30 sec - exiting 13:37:52 (4077): No heartbeat from core client for 30 sec - exiting 13:37:53 (4077): No heartbeat from core client for 30 sec - exiting 13:37:54 (4077): No heartbeat from core client for 30 sec - exiting 13:37:55 (4077): No heartbeat from core client for 30 sec - exiting 13:37:56 (4077): No heartbeat from core client for 30 sec - exiting 13:37:57 (4077): No heartbeat from core client for 30 sec - exiting 13:37:58 (4077): No heartbeat from core client for 30 sec - exiting 13:37:59 (4077): No heartbeat from core client for 30 sec - exiting 13:38:00 (4077): No heartbeat from core client for 30 sec - exiting 13:38:01 (4077): No heartbeat from core client for 30 sec - exiting 13:38:02 (4077): No heartbeat from core client for 30 sec - exiting 13:38:03 (4077): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:05:13 (18375): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(19005,0xa07ec540) malloc: * error for object 0x85b004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19005,0xa07ec540) malloc: * error for object 0x85b000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19005,0xa07ec540) malloc: * error for object 0x83fa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19005,0xa07ec540) malloc: * error for object 0x85b004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19005,0xa07ec540) malloc: * error for object 0x85b000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19005,0xa07ec540) malloc: * error for object 0x1854404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19005,0xa07ec540) malloc: * error for object 0x1854400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19005,0xa07ec540) malloc: * error for object 0x1854404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19005,0xa07ec540) malloc: * error for object 0x1854400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x104b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x82b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x104b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x827204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x827200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa07ec540) malloc: * error for object 0x1019e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 May 2012 20:40:53	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	1,036,800	1,969,370	1.8995
01 May 2012 20:40:53	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	1,010,880	1,917,541	1.8969
28 Apr 2012 23:09:41	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	984,960	1,868,794	1.8973
24 Apr 2012 18:09:41	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	959,040	1,819,087	1.8968
24 Apr 2012 09:02:02	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	933,120	1,768,683	1.8955
23 Apr 2012 09:39:12	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	907,200	1,721,457	1.8975
22 Apr 2012 11:34:01	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	881,280	1,675,112	1.9008
21 Apr 2012 17:51:17	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	855,360	1,626,225	1.9012
19 Apr 2012 09:45:11	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	829,440	1,577,214	1.9015
18 Apr 2012 18:49:53	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	803,520	1,528,099	1.9018
18 Apr 2012 09:54:22	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	777,600	1,479,447	1.9026
18 Apr 2012 09:54:22	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	751,680	1,428,699	1.9007
16 Apr 2012 08:38:25	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	725,760	1,377,722	1.8983
16 Apr 2012 08:38:25	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	699,840	1,327,138	1.8963
14 Apr 2012 10:53:35	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	673,920	1,276,808	1.8946
13 Apr 2012 14:48:23	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	648,000	1,228,360	1.8956
13 Apr 2012 09:02:13	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	622,080	1,181,840	1.8998
12 Apr 2012 20:43:46	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	596,160	1,134,034	1.9022
11 Apr 2012 14:04:49	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	570,240	1,087,348	1.9068
11 Apr 2012 09:13:31	941153	14281729	hadcm3n_ym1c_1940_40_007831773_1	544,320	1,040,417	1.9114