Task 15642604

Name	hadcm3n_4bt2_1940_40_008302014_1
Workunit	8453149
Created	27 Feb 2013, 14:41:29 UTC
Sent	27 Feb 2013, 14:41:34 UTC
Report deadline	29 May 2013, 22:08:45 UTC
Received	3 Mar 2013, 23:28:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1268402
Run time	2 days 12 hours 12 min 49 sec
CPU time	2 days 8 hours 37 min 43 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	2.37 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:11:41 (8028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:57 (8028): No heartbeat from core client for 30 sec - exiting 01:11:58 (8028): No heartbeat from core client for 30 sec - exiting 01:11:59 (8028): No heartbeat from core client for 30 sec - exiting 01:12:00 (8028): No heartbeat from core client for 30 sec - exiting 01:12:01 (8028): No heartbeat from core client for 30 sec - exiting 01:12:02 (8028): No heartbeat from core client for 30 sec - exiting 01:12:03 (8028): No heartbeat from core client for 30 sec - exiting 01:12:04 (8028): No heartbeat from core client for 30 sec - exiting 01:12:05 (8028): No heartbeat from core client for 30 sec - exiting 01:12:07 (8028): No heartbeat from core client for 30 sec - exiting 01:12:08 (8028): No heartbeat from core client for 30 sec - exiting 01:12:09 (8028): No heartbeat from core client for 30 sec - exiting 01:12:11 (8028): No heartbeat from core client for 30 sec - exiting 01:12:12 (8028): No heartbeat from core client for 30 sec - exiting 01:12:13 (8028): No heartbeat from core client for 30 sec - exiting 01:12:14 (8028): No heartbeat from core client for 30 sec - exiting 01:12:15 (8028): No heartbeat from core client for 30 sec - exiting 01:12:16 (8028): No heartbeat from core client for 30 sec - exiting 01:12:18 (8028): No heartbeat from core client for 30 sec - exiting 01:12:19 (8028): No heartbeat from core client for 30 sec - exiting 01:12:20 (8028): No heartbeat from core client for 30 sec - exiting 02:22:13 (7984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:23:40 (7984): No heartbeat from core client for 30 sec - exiting 02:23:41 (7984): No heartbeat from core client for 30 sec - exiting 02:23:42 (7984): No heartbeat from core client for 30 sec - exiting 02:23:43 (7984): No heartbeat from core client for 30 sec - exiting 02:23:44 (7984): No heartbeat from core client for 30 sec - exiting 02:23:45 (7984): No heartbeat from core client for 30 sec - exiting 02:23:46 (7984): No heartbeat from core client for 30 sec - exiting 02:23:47 (7984): No heartbeat from core client for 30 sec - exiting 02:23:48 (7984): No heartbeat from core client for 30 sec - exiting 02:23:51 (7984): No heartbeat from core client for 30 sec - exiting 02:24:28 (7984): No heartbeat from core client for 30 sec - exiting 02:24:29 (7984): No heartbeat from core client for 30 sec - exiting 02:24:30 (7984): No heartbeat from core client for 30 sec - exiting 02:24:31 (7984): No heartbeat from core client for 30 sec - exiting 02:24:33 (7984): No heartbeat from core client for 30 sec - exiting 02:24:34 (7984): No heartbeat from core client for 30 sec - exiting 02:24:35 (7984): No heartbeat from core client for 30 sec - exiting 02:30:55 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:00 (3776): No heartbeat from core client for 30 sec - exiting 02:31:01 (3776): No heartbeat from core client for 30 sec - exiting 02:31:02 (3776): No heartbeat from core client for 30 sec - exiting 02:31:03 (3776): No heartbeat from core client for 30 sec - exiting 02:31:04 (3776): No heartbeat from core client for 30 sec - exiting 02:31:05 (3776): No heartbeat from core client for 30 sec - exiting 02:31:06 (3776): No heartbeat from core client for 30 sec - exiting 02:31:07 (3776): No heartbeat from core client for 30 sec - exiting 02:37:59 (7808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:38:09 (7808): No heartbeat from core client for 30 sec - exiting 02:38:11 (7808): No heartbeat from core client for 30 sec - exiting 02:38:13 (7808): No heartbeat from core client for 30 sec - exiting 02:38:14 (7808): No heartbeat from core client for 30 sec - exiting 02:38:15 (7808): No heartbeat from core client for 30 sec - exiting 02:38:17 (7808): No heartbeat from core client for 30 sec - exiting 02:45:37 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:26 (7184): No heartbeat from core client for 30 sec - exiting 02:46:32 (7184): No heartbeat from core client for 30 sec - exiting 02:46:33 (7184): No heartbeat from core client for 30 sec - exiting 02:46:34 (7184): No heartbeat from core client for 30 sec - exiting 02:46:36 (7184): No heartbeat from core client for 30 sec - exiting 02:46:37 (7184): No heartbeat from core client for 30 sec - exiting 02:46:38 (7184): No heartbeat from core client for 30 sec - exiting 02:46:40 (7184): No heartbeat from core client for 30 sec - exiting 02:46:41 (7184): No heartbeat from core client for 30 sec - exiting 02:46:42 (7184): No heartbeat from core client for 30 sec - exiting 02:46:43 (7184): No heartbeat from core client for 30 sec - exiting 02:46:44 (7184): No heartbeat from core client for 30 sec - exiting 02:46:45 (7184): No heartbeat from core client for 30 sec - exiting 02:46:47 (7184): No heartbeat from core client for 30 sec - exiting 02:46:48 (7184): No heartbeat from core client for 30 sec - exiting 02:46:49 (7184): No heartbeat from core client for 30 sec - exiting 02:46:50 (7184): No heartbeat from core client for 30 sec - exiting 02:46:51 (7184): No heartbeat from core client for 30 sec - exiting 02:46:52 (7184): No heartbeat from core client for 30 sec - exiting 02:46:53 (7184): No heartbeat from core client for 30 sec - exiting 02:46:54 (7184): No heartbeat from core client for 30 sec - exiting 02:46:55 (7184): No heartbeat from core client for 30 sec - exiting 02:46:56 (7184): No heartbeat from core client for 30 sec - exiting 02:46:57 (7184): No heartbeat from core client for 30 sec - exiting 02:46:58 (7184): No heartbeat from core client for 30 sec - exiting 02:46:59 (7184): No heartbeat from core client for 30 sec - exiting 02:47:00 (7184): No heartbeat from core client for 30 sec - exiting 02:47:02 (7184): No heartbeat from core client for 30 sec - exiting 02:47:04 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:36:41 (9048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:36:44 (9048): No heartbeat from core client for 30 sec - exiting 01:36:45 (9048): No heartbeat from core client for 30 sec - exiting 01:36:46 (9048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5096, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:23:23 (1692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:23:29 (1692): No heartbeat from core client for 30 sec - exiting 01:23:30 (1692): No heartbeat from core client for 30 sec - exiting 01:23:31 (1692): No heartbeat from core client for 30 sec - exiting 01:23:34 (1692): No heartbeat from core client for 30 sec - exiting 01:23:35 (1692): No heartbeat from core client for 30 sec - exiting 01:23:36 (1692): No heartbeat from core client for 30 sec - exiting 01:23:37 (1692): No heartbeat from core client for 30 sec - exiting 01:23:38 (1692): No heartbeat from core client for 30 sec - exiting 01:23:39 (1692): No heartbeat from core client for 30 sec - exiting 01:23:41 (1692): No heartbeat from core client for 30 sec - exiting 01:23:42 (1692): No heartbeat from core client for 30 sec - exiting 01:23:43 (1692): No heartbeat from core client for 30 sec - exiting 01:23:44 (1692): No heartbeat from core client for 30 sec - exiting 01:23:45 (1692): No heartbeat from core client for 30 sec - exiting 01:23:46 (1692): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 01:26:43 (9424): No heartbeat from core client for 30 sec - exiting 01:26:44 (9424): No heartbeat from core client for 30 sec - exiting 01:26:45 (9424): No heartbeat from core client for 30 sec - exiting 01:26:46 (9424): No heartbeat from core client for 30 sec - exiting 01:26:47 (9424): No heartbeat from core client for 30 sec - exiting 01:26:48 (9424): No heartbeat from core client for 30 sec - exiting 01:26:49 (9424): No heartbeat from core client for 30 sec - exiting 01:26:50 (9424): No heartbeat from core client for 30 sec - exiting 01:26:51 (9424): No heartbeat from core client for 30 sec - exiting 01:26:52 (9424): No heartbeat from core client for 30 sec - exiting 01:26:53 (9424): No heartbeat from core client for 30 sec - exiting 01:26:54 (9424): No heartbeat from core client for 30 sec - exiting 01:26:55 (9424): No heartbeat from core client for 30 sec - exiting 01:26:56 (9424): No heartbeat from core client for 30 sec - exiting 01:26:57 (9424): No heartbeat from core client for 30 sec - exiting 01:26:58 (9424): No heartbeat from core client for 30 sec - exiting 01:26:59 (9424): No heartbeat from core client for 30 sec - exiting 01:27:00 (9424): No heartbeat from core client for 30 sec - exiting 01:27:01 (9424): No heartbeat from core client for 30 sec - exiting 01:27:02 (9424): No heartbeat from core client for 30 sec - exiting 01:27:03 (9424): No heartbeat from core client for 30 sec - exiting 01:27:04 (9424): No heartbeat from core client for 30 sec - exiting 01:27:05 (9424): No heartbeat from core client for 30 sec - exiting 01:27:06 (9424): No heartbeat from core client for 30 sec - exiting 01:27:07 (9424): No heartbeat from core client for 30 sec - exiting 01:27:08 (9424): No heartbeat from core client for 30 sec - exiting 01:27:09 (9424): No heartbeat from core client for 30 sec - exiting 01:27:10 (9424): No heartbeat from core client for 30 sec - exiting 01:27:11 (9424): No heartbeat from core client for 30 sec - exiting 01:27:12 (9424): No heartbeat from core client for 30 sec - exiting 01:27:13 (9424): No heartbeat from core client for 30 sec - exiting 01:27:14 (9424): No heartbeat from core client for 30 sec - exiting 01:27:15 (9424): No heartbeat from core client for 30 sec - exiting 01:27:16 (9424): No heartbeat from core client for 30 sec - exiting 01:27:17 (9424): No heartbeat from core client for 30 sec - exiting 01:27:18 (9424): No heartbeat from core client for 30 sec - exiting 01:27:19 (9424): No heartbeat from core client for 30 sec - exiting 01:27:20 (9424): No heartbeat from core client for 30 sec - exiting 01:27:21 (9424): No heartbeat from core client for 30 sec - exiting 01:27:22 (9424): No heartbeat from core client for 30 sec - exiting 01:27:23 (9424): No heartbeat from core client for 30 sec - exiting 01:27:24 (9424): No heartbeat from core client for 30 sec - exiting 01:27:25 (9424): No heartbeat from core client for 30 sec - exiting 01:27:26 (9424): No heartbeat from core client for 30 sec - exiting 01:27:27 (9424): No heartbeat from core client for 30 sec - exiting 01:27:28 (9424): No heartbeat from core client for 30 sec - exiting 01:27:29 (9424): No heartbeat from core client for 30 sec - exiting 01:27:30 (9424): No heartbeat from core client for 30 sec - exiting 01:27:31 (9424): No heartbeat from core client for 30 sec - exiting 01:27:32 (9424): No heartbeat from core client for 30 sec - exiting 01:27:33 (9424): No heartbeat from core client for 30 sec - exiting 01:27:34 (9424): No heartbeat from core client for 30 sec - exiting 01:27:35 (9424): No heartbeat from core client for 30 sec - exiting 01:27:36 (9424): No heartbeat from core client for 30 sec - exiting 01:27:37 (9424): No heartbeat from core client for 30 sec - exiting 01:27:38 (9424): No heartbeat from core client for 30 sec - exiting 01:27:39 (9424): No heartbeat from core client for 30 sec - exiting 01:27:40 (9424): No heartbeat from core client for 30 sec - exiting 01:27:41 (9424): No heartbeat from core client for 30 sec - exiting 01:27:42 (9424): No heartbeat from core client for 30 sec - exiting 01:27:43 (9424): No heartbeat from core client for 30 sec - exiting 01:27:44 (9424): No heartbeat from core client for 30 sec - exiting 01:27:45 (9424): No heartbeat from core client for 30 sec - exiting 01:27:46 (9424): No heartbeat from core client for 30 sec - exiting 01:27:47 (9424): No heartbeat from core client for 30 sec - exiting 01:27:48 (9424): No heartbeat from core client for 30 sec - exiting 01:27:49 (9424): No heartbeat from core client for 30 sec - exiting 01:27:50 (9424): No heartbeat from core client for 30 sec - exiting 01:27:51 (9424): No heartbeat from core client for 30 sec - exiting 01:27:52 (9424): No heartbeat from core client for 30 sec - exiting 01:27:53 (9424): No heartbeat from core client for 30 sec - exiting 01:27:54 (9424): No heartbeat from core client for 30 sec - exiting 01:27:55 (9424): No heartbeat from core client for 30 sec - exiting 01:27:56 (9424): No heartbeat from core client for 30 sec - exiting 01:27:57 (9424): No heartbeat from core client for 30 sec - exiting 01:27:58 (9424): No heartbeat from core client for 30 sec - exiting 01:27:59 (9424): No heartbeat from core client for 30 sec - exiting 01:28:00 (9424): No heartbeat from core client for 30 sec - exiting 01:28:01 (9424): No heartbeat from core client for 30 sec - exiting 01:28:02 (9424): No heartbeat from core client for 30 sec - exiting 01:28:03 (9424): No heartbeat from core client for 30 sec - exiting 01:28:04 (9424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:34:54 (6644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:57 (6644): No heartbeat from core client for 30 sec - exiting 02:34:58 (6644): No heartbeat from core client for 30 sec - exiting 02:35:00 (6644): No heartbeat from core client for 30 sec - exiting 02:35:01 (6644): No heartbeat from core client for 30 sec - exiting 02:35:02 (6644): No heartbeat from core client for 30 sec - exiting 02:35:03 (6644): No heartbeat from core client for 30 sec - exiting 02:35:04 (6644): No heartbeat from core client for 30 sec - exiting 02:35:05 (6644): No heartbeat from core client for 30 sec - exiting 02:35:06 (6644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 03:52:13 (9564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:16 (9564): No heartbeat from core client for 30 sec - exiting 03:52:18 (9564): No heartbeat from core client for 30 sec - exiting 03:52:19 (9564): No heartbeat from core client for 30 sec - exiting 03:52:20 (9564): No heartbeat from core client for 30 sec - exiting 03:52:21 (9564): No heartbeat from core client for 30 sec - exiting 03:52:22 (9564): No heartbeat from core client for 30 sec - exiting 03:52:23 (9564): No heartbeat from core client for 30 sec - exiting 03:52:24 (9564): No heartbeat from core client for 30 sec - exiting 03:52:26 (9564): No heartbeat from core client for 30 sec - exiting 03:52:27 (9564): No heartbeat from core client for 30 sec - exiting 03:52:28 (9564): No heartbeat from core client for 30 sec - exiting 03:52:29 (9564): No heartbeat from core client for 30 sec - exiting 03:52:30 (9564): No heartbeat from core client for 30 sec - exiting 03:52:31 (9564): No heartbeat from core client for 30 sec - exiting 04:00:34 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:35 (6108): No heartbeat from core client for 30 sec - exiting 04:00:36 (6108): No heartbeat from core client for 30 sec - exiting 04:00:37 (6108): No heartbeat from core client for 30 sec - exiting 04:00:38 (6108): No heartbeat from core client for 30 sec - exiting 04:00:39 (6108): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:34:15 (7772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:34:23 (7772): No heartbeat from core client for 30 sec - exiting 14:34:24 (7772): No heartbeat from core client for 30 sec - exiting 14:34:26 (7772): No heartbeat from core client for 30 sec - exiting 14:34:27 (7772): No heartbeat from core client for 30 sec - exiting 14:34:29 (7772): No heartbeat from core client for 30 sec - exiting 14:34:30 (7772): No heartbeat from core client for 30 sec - exiting 14:34:31 (7772): No heartbeat from core client for 30 sec - exiting 14:34:32 (7772): No heartbeat from core client for 30 sec - exiting 14:34:33 (7772): No heartbeat from core client for 30 sec - exiting 14:34:34 (7772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 03:20:22 (11852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:20:25 (11852): No heartbeat from core client for 30 sec - exiting 03:20:26 (11852): No heartbeat from core client for 30 sec - exiting 03:20:27 (11852): No heartbeat from core client for 30 sec - exiting 03:20:28 (11852): No heartbeat from core client for 30 sec - exiting 03:20:29 (11852): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... 03:31:10 (10244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:31:15 (10244): No heartbeat from core client for 30 sec - exiting 03:31:16 (10244): No heartbeat from core client for 30 sec - exiting 03:31:18 (10244): No heartbeat from core client for 30 sec - exiting 03:31:19 (10244): No heartbeat from core client for 30 sec - exiting 03:31:20 (10244): No heartbeat from core client for 30 sec - exiting 03:31:21 (10244): No heartbeat from core client for 30 sec - exiting 03:31:22 (10244): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 03:37:54 (9364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:29 (9364): No heartbeat from core client for 30 sec - exiting 03:38:30 (9364): No heartbeat from core client for 30 sec - exiting 03:38:31 (9364): No heartbeat from core client for 30 sec - exiting 03:38:32 (9364): No heartbeat from core client for 30 sec - exiting 03:38:33 (9364): No heartbeat from core client for 30 sec - exiting 03:38:34 (9364): No heartbeat from core client for 30 sec - exiting 03:38:35 (9364): No heartbeat from core client for 30 sec - exiting 03:38:36 (9364): No heartbeat from core client for 30 sec - exiting 03:38:39 (9364): No heartbeat from core client for 30 sec - exiting 03:38:40 (9364): No heartbeat from core client for 30 sec - exiting 03:38:41 (9364): No heartbeat from core client for 30 sec - exiting 03:38:42 (9364): No heartbeat from core client for 30 sec - exiting 03:38:44 (9364): No heartbeat from core client for 30 sec - exiting 03:38:45 (9364): No heartbeat from core client for 30 sec - exiting 03:38:46 (9364): No heartbeat from core client for 30 sec - exiting 03:38:47 (9364): No heartbeat from core client for 30 sec - exiting 03:38:49 (9364): No heartbeat from core client for 30 sec - exiting 03:38:50 (9364): No heartbeat from core client for 30 sec - exiting 03:38:51 (9364): No heartbeat from core client for 30 sec - exiting 03:38:52 (9364): No heartbeat from core client for 30 sec - exiting 03:38:53 (9364): No heartbeat from core client for 30 sec - exiting 03:38:54 (9364): No heartbeat from core client for 30 sec - exiting 03:38:56 (9364): No heartbeat from core client for 30 sec - exiting 03:38:58 (9364): No heartbeat from core client for 30 sec - exiting 03:38:59 (9364): No heartbeat from core client for 30 sec - exiting 03:39:01 (9364): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:44:16 (10996): No heartbeat from core client for 30 sec - exiting 03:44:17 (10996): No heartbeat from core client for 30 sec - exiting 03:44:18 (10996): No heartbeat from core client for 30 sec - exiting 03:44:19 (10996): No heartbeat from core client for 30 sec - exiting 03:44:20 (10996): No heartbeat from core client for 30 sec - exiting 03:44:21 (10996): No heartbeat from core client for 30 sec - exiting 03:44:22 (10996): No heartbeat from core client for 30 sec - exiting 03:44:23 (10996): No heartbeat from core client for 30 sec - exiting 03:44:24 (10996): No heartbeat from core client for 30 sec - exiting 03:44:25 (10996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 03:46:43 (9336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Mar 2013 19:11:27	1268402	15642604	hadcm3n_4bt2_1940_40_008302014_1	77,760	200,315	2.5761
02 Mar 2013 18:35:50	1268402	15642604	hadcm3n_4bt2_1940_40_008302014_1	51,840	140,234	2.7051
01 Mar 2013 18:37:24	1268402	15642604	hadcm3n_4bt2_1940_40_008302014_1	25,920	71,234	2.7482