Task 14198097

Name	hadcm3n_201j_1940_40_007816792_0
Workunit	7971901
Created	28 Feb 2012, 0:27:51 UTC
Sent	28 Feb 2012, 0:31:04 UTC
Report deadline	29 May 2012, 7:58:15 UTC
Received	21 Mar 2012, 17:58:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1079078
Run time	6 days 4 hours 6 min 18 sec
CPU time	5 days 17 hours 59 min 22 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.32 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:52:05 (6884): No heartbeat from core client for 30 sec - exiting 08:52:06 (6884): No heartbeat from core client for 30 sec - exiting 08:52:07 (6884): No heartbeat from core client for 30 sec - exiting 08:52:08 (6884): No heartbeat from core client for 30 sec - exiting 08:52:09 (6884): No heartbeat from core client for 30 sec - exiting 08:52:10 (6884): No heartbeat from core client for 30 sec - exiting 08:52:11 (6884): No heartbeat from core client for 30 sec - exiting 08:52:12 (6884): No heartbeat from core client for 30 sec - exiting 08:52:13 (6884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:14:03 (6304): No heartbeat from core client for 30 sec - exiting 08:14:04 (6304): No heartbeat from core client for 30 sec - exiting 08:14:05 (6304): No heartbeat from core client for 30 sec - exiting 08:14:06 (6304): No heartbeat from core client for 30 sec - exiting 08:14:07 (6304): No heartbeat from core client for 30 sec - exiting 08:14:08 (6304): No heartbeat from core client for 30 sec - exiting 08:14:09 (6304): No heartbeat from core client for 30 sec - exiting 08:14:10 (6304): No heartbeat from core client for 30 sec - exiting 08:14:11 (6304): No heartbeat from core client for 30 sec - exiting 08:14:12 (6304): No heartbeat from core client for 30 sec - exiting 08:14:13 (6304): No heartbeat from core client for 30 sec - exiting 08:14:14 (6304): No heartbeat from core client for 30 sec - exiting 08:14:15 (6304): No heartbeat from core client for 30 sec - exiting 08:14:16 (6304): No heartbeat from core client for 30 sec - exiting 08:14:17 (6304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:42:20 (6316): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:02:51 (6892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:19:06 (3640): No heartbeat from core client for 30 sec - exiting 08:19:07 (3640): No heartbeat from core client for 30 sec - exiting 08:19:08 (3640): No heartbeat from core client for 30 sec - exiting 08:19:09 (3640): No heartbeat from core client for 30 sec - exiting 08:19:10 (3640): No heartbeat from core client for 30 sec - exiting 08:19:11 (3640): No heartbeat from core client for 30 sec - exiting 08:19:12 (3640): No heartbeat from core client for 30 sec - exiting 08:19:13 (3640): No heartbeat from core client for 30 sec - exiting 08:19:14 (3640): No heartbeat from core client for 30 sec - exiting 08:19:15 (3640): No heartbeat from core client for 30 sec - exiting 08:19:16 (3640): No heartbeat from core client for 30 sec - exiting 08:19:17 (3640): No heartbeat from core client for 30 sec - exiting 08:19:18 (3640): No heartbeat from core client for 30 sec - exiting 08:19:19 (3640): No heartbeat from core client for 30 sec - exiting 08:19:20 (3640): No heartbeat from core client for 30 sec - exiting 08:19:21 (3640): No heartbeat from core client for 30 sec - exiting 08:19:22 (3640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:30 (5208): No heartbeat from core client for 30 sec - exiting 14:18:31 (5208): No heartbeat from core client for 30 sec - exiting 14:18:32 (5208): No heartbeat from core client for 30 sec - exiting 14:18:33 (5208): No heartbeat from core client for 30 sec - exiting 14:18:34 (5208): No heartbeat from core client for 30 sec - exiting 14:18:35 (5208): No heartbeat from core client for 30 sec - exiting 14:18:36 (5208): No heartbeat from core client for 30 sec - exiting 14:18:37 (5208): No heartbeat from core client for 30 sec - exiting 14:18:38 (5208): No heartbeat from core client for 30 sec - exiting 14:18:39 (5208): No heartbeat from core client for 30 sec - exiting 14:18:40 (5208): No heartbeat from core client for 30 sec - exiting 14:18:41 (5208): No heartbeat from core client for 30 sec - exiting 14:18:42 (5208): No heartbeat from core client for 30 sec - exiting 14:18:43 (5208): No heartbeat from core client for 30 sec - exiting 14:18:44 (5208): No heartbeat from core client for 30 sec - exiting 14:18:45 (5208): No heartbeat from core client for 30 sec - exiting 14:18:46 (5208): No heartbeat from core client for 30 sec - exiting 14:18:47 (5208): No heartbeat from core client for 30 sec - exiting 14:18:48 (5208): No heartbeat from core client for 30 sec - exiting 14:18:49 (5208): No heartbeat from core client for 30 sec - exiting 14:18:50 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:51 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3800, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7700, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2332, selfPID=2332, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/201jko.pje8c10 Error converting file to netcdf: dataout/201jko.pie8c10 Error converting file to netcdf: dataout/201jko.pfe8c10 Error converting file to netcdf: dataout/201jka.phe8c10 Error converting file to netcdf: dataout/201jka.pge8c10 Error converting file to netcdf: dataout/201jka.pee8c10 Error converting file to netcdf: dataout/201jka.pde8c10 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4932, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:36:37 (4372): No heartbeat from core client for 30 sec - exiting 08:36:38 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:18:50 (6644): No heartbeat from core client for 30 sec - exiting 09:18:51 (6644): No heartbeat from core client for 30 sec - exiting 09:18:52 (6644): No heartbeat from core client for 30 sec - exiting 09:18:53 (6644): No heartbeat from core client for 30 sec - exiting 09:18:54 (6644): No heartbeat from core client for 30 sec - exiting 09:18:55 (6644): No heartbeat from core client for 30 sec - exiting 09:18:56 (6644): No heartbeat from core client for 30 sec - exiting 09:18:57 (6644): No heartbeat from core client for 30 sec - exiting 09:18:58 (6644): No heartbeat from core client for 30 sec - exiting 09:18:59 (6644): No heartbeat from core client for 30 sec - exiting 09:19:00 (6644): No heartbeat from core client for 30 sec - exiting 09:19:01 (6644): No heartbeat from core client for 30 sec - exiting 09:19:02 (6644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:03 (6644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:32 (5304): No heartbeat from core client for 30 sec - exiting 10:12:33 (5304): No heartbeat from core client for 30 sec - exiting 10:12:34 (5304): No heartbeat from core client for 30 sec - exiting 10:12:35 (5304): No heartbeat from core client for 30 sec - exiting 10:12:36 (5304): No heartbeat from core client for 30 sec - exiting 10:12:30 (5304): No heartbeat from core client for 30 sec - exiting 10:12:31 (5304): No heartbeat from core client for 30 sec - exiting 10:12:32 (5304): No heartbeat from core client for 30 sec - exiting 10:12:33 (5304): No heartbeat from core client for 30 sec - exiting 10:12:34 (5304): No heartbeat from core client for 30 sec - exiting 10:12:35 (5304): No heartbeat from core client for 30 sec - exiting 10:12:36 (5304): No heartbeat from core client for 30 sec - exiting 10:12:37 (5304): No heartbeat from core client for 30 sec - exiting 10:12:38 (5304): No heartbeat from core client for 30 sec - exiting 10:12:39 (5304): No heartbeat from core client for 30 sec - exiting 10:12:40 (5304): No heartbeat from core client for 30 sec - exiting 10:12:41 (5304): No heartbeat from core client for 30 sec - exiting 10:12:42 (5304): No heartbeat from core client for 30 sec - exiting 10:12:43 (5304): No heartbeat from core client for 30 sec - exiting 10:12:44 (5304): No heartbeat from core client for 30 sec - exiting 10:12:45 (5304): No heartbeat from core client for 30 sec - exiting 10:12:46 (5304): No heartbeat from core client for 30 sec - exiting 10:12:47 (5304): No heartbeat from core client for 30 sec - exiting 10:12:48 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:49 (5304): No heartbeat from core client for 30 sec - exiting 10:12:50 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:41:15 (6216): No heartbeat from core client for 30 sec - exiting 20:41:16 (6216): No heartbeat from core client for 30 sec - exiting 20:41:17 (6216): No heartbeat from core client for 30 sec - exiting 20:41:18 (6216): No heartbeat from core client for 30 sec - exiting 20:41:19 (6216): No heartbeat from core client for 30 sec - exiting 20:41:20 (6216): No heartbeat from core client for 30 sec - exiting 20:41:21 (6216): No heartbeat from core client for 30 sec - exiting 20:41:22 (6216): No heartbeat from core client for 30 sec - exiting 20:41:23 (6216): No heartbeat from core client for 30 sec - exiting 20:41:24 (6216): No heartbeat from core client for 30 sec - exiting 20:41:25 (6216): No heartbeat from core client for 30 sec - exiting 20:41:26 (6216): No heartbeat from core client for 30 sec - exiting 20:41:27 (6216): No heartbeat from core client for 30 sec - exiting 20:41:28 (6216): No heartbeat from core client for 30 sec - exiting 20:41:29 (6216): No heartbeat from core client for 30 sec - exiting 20:41:30 (6216): No heartbeat from core client for 30 sec - exiting 20:41:31 (6216): No heartbeat from core client for 30 sec - exiting 20:41:32 (6216): No heartbeat from core client for 30 sec - exiting 20:41:33 (6216): No heartbeat from core client for 30 sec - exiting 20:41:34 (6216): No heartbeat from core client for 30 sec - exiting 20:41:35 (6216): No heartbeat from core client for 30 sec - exiting 20:41:36 (6216): No heartbeat from core client for 30 sec - exiting 20:41:37 (6216): No heartbeat from core client for 30 sec - exiting 20:41:38 (6216): No heartbeat from core client for 30 sec - exiting 20:41:39 (6216): No heartbeat from core client for 30 sec - exiting 20:41:40 (6216): No heartbeat from core client for 30 sec - exiting 20:41:41 (6216): No heartbeat from core client for 30 sec - exiting 20:41:42 (6216): No heartbeat from core client for 30 sec - exiting 20:41:43 (6216): No heartbeat from core client for 30 sec - exiting 20:41:44 (6216): No heartbeat from core client for 30 sec - exiting 20:41:45 (6216): No heartbeat from core client for 30 sec - exiting 20:41:46 (6216): No heartbeat from core client for 30 sec - exiting 20:41:47 (6216): No heartbeat from core client for 30 sec - exiting 20:41:48 (6216): No heartbeat from core client for 30 sec - exiting 20:41:49 (6216): No heartbeat from core client for 30 sec - exiting 20:41:50 (6216): No heartbeat from core client for 30 sec - exiting 20:41:51 (6216): No heartbeat from core client for 30 sec - exiting 20:41:52 (6216): No heartbeat from core client for 30 sec - exiting 20:41:53 (6216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:55:17 (6900): No heartbeat from core client for 30 sec - exiting 08:55:18 (6900): No heartbeat from core client for 30 sec - exiting 08:55:19 (6900): No heartbeat from core client for 30 sec - exiting 08:55:20 (6900): No heartbeat from core client for 30 sec - exiting 08:55:22 (6900): No heartbeat from core client for 30 sec - exiting 08:55:23 (6900): No heartbeat from core client for 30 sec - exiting 08:55:24 (6900): No heartbeat from core client for 30 sec - exiting 08:55:25 (6900): No heartbeat from core client for 30 sec - exiting 08:55:26 (6900): No heartbeat from core client for 30 sec - exiting 08:55:27 (6900): No heartbeat from core client for 30 sec - exiting 08:55:28 (6900): No heartbeat from core client for 30 sec - exiting 08:55:29 (6900): No heartbeat from core client for 30 sec - exiting 08:55:30 (6900): No heartbeat from core client for 30 sec - exiting 08:55:31 (6900): No heartbeat from core client for 30 sec - exiting 08:55:32 (6900): No heartbeat from core client for 30 sec - exiting 08:55:33 (6900): No heartbeat from core client for 30 sec - exiting 08:55:34 (6900): No heartbeat from core client for 30 sec - exiting 08:55:35 (6900): No heartbeat from core client for 30 sec - exiting 08:55:36 (6900): No heartbeat from core client for 30 sec - exiting 08:55:37 (6900): No heartbeat from core client for 30 sec - exiting 08:55:38 (6900): No heartbeat from core client for 30 sec - exiting 08:55:39 (6900): No heartbeat from core client for 30 sec - exiting 08:55:40 (6900): No heartbeat from core client for 30 sec - exiting 08:55:41 (6900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:42 (6900): No heartbeat from core client for 30 sec - exiting 09:15:26 (6816): No heartbeat from core client for 30 sec - exiting 09:15:27 (6816): No heartbeat from core client for 30 sec - exiting 09:15:28 (6816): No heartbeat from core client for 30 sec - exiting 09:15:29 (6816): No heartbeat from core client for 30 sec - exiting 09:15:30 (6816): No heartbeat from core client for 30 sec - exiting 09:15:31 (6816): No heartbeat from core client for 30 sec - exiting 09:15:32 (6816): No heartbeat from core client for 30 sec - exiting 09:15:33 (6816): No heartbeat from core client for 30 sec - exiting 09:15:34 (6816): No heartbeat from core client for 30 sec - exiting 09:15:35 (6816): No heartbeat from core client for 30 sec - exiting 09:15:36 (6816): No heartbeat from core client for 30 sec - exiting 09:15:37 (6816): No heartbeat from core client for 30 sec - exiting 09:15:38 (6816): No heartbeat from core client for 30 sec - exiting 09:15:39 (6816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:25:14 (1612): No heartbeat from core client for 30 sec - exiting 09:25:15 (1612): No heartbeat from core client for 30 sec - exiting 09:25:16 (1612): No heartbeat from core client for 30 sec - exiting 09:25:17 (1612): No heartbeat from core client for 30 sec - exiting 09:25:18 (1612): No heartbeat from core client for 30 sec - exiting 09:25:19 (1612): No heartbeat from core client for 30 sec - exiting 09:25:20 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77EB7373 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6308, selfPID=6308, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77EB3AB3 read attempt to address 0x40C69587 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_201j_1940_40_007816792/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Mar 2012 14:27:37	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	259,200	484,885	1.8707
17 Mar 2012 17:55:56	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	233,280	435,565	1.8671
14 Mar 2012 20:04:06	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	207,360	387,507	1.8688
13 Mar 2012 19:14:25	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	181,440	339,905	1.8734
10 Mar 2012 21:01:25	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	155,520	292,443	1.8804
08 Mar 2012 15:09:35	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	129,600	243,963	1.8824
06 Mar 2012 20:24:13	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	103,680	194,717	1.8781
04 Mar 2012 15:46:02	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	77,760	146,203	1.8802
02 Mar 2012 03:15:38	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	51,840	97,941	1.8893
29 Feb 2012 22:22:13	1079078	14198097	hadcm3n_201j_1940_40_007816792_0	25,920	49,152	1.8963