Task 15802458

Name	hadcm3n_n4ji_1880_40_008373941_0
Workunit	8524800
Created	29 May 2013, 20:19:17 UTC
Sent	29 May 2013, 20:22:40 UTC
Report deadline	29 Aug 2013, 3:49:51 UTC
Received	1 Jul 2013, 13:10:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1246764
Run time	8 days 15 hours 59 min 28 sec
CPU time	7 days 8 hours 25 min 37 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:42:37 (7188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5212, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7348, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:35:38 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7064, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:09:10 (5952): No heartbeat from core client for 30 sec - exiting 11:09:11 (5952): No heartbeat from core client for 30 sec - exiting 11:09:12 (5952): No heartbeat from core client for 30 sec - exiting 11:09:13 (5952): No heartbeat from core client for 30 sec - exiting 11:09:14 (5952): No heartbeat from core client for 30 sec - exiting 11:09:15 (5952): No heartbeat from core client for 30 sec - exiting 11:09:16 (5952): No heartbeat from core client for 30 sec - exiting 11:09:17 (5952): No heartbeat from core client for 30 sec - exiting 11:09:18 (5952): No heartbeat from core client for 30 sec - exiting 11:09:19 (5952): No heartbeat from core client for 30 sec - exiting 11:09:20 (5952): No heartbeat from core client for 30 sec - exiting 11:09:21 (5952): No heartbeat from core client for 30 sec - exiting 11:09:22 (5952): No heartbeat from core client for 30 sec - exiting 11:09:23 (5952): No heartbeat from core client for 30 sec - exiting 11:09:24 (5952): No heartbeat from core client for 30 sec - exiting 11:09:25 (5952): No heartbeat from core client for 30 sec - exiting 11:09:26 (5952): No heartbeat from core client for 30 sec - exiting 11:09:27 (5952): No heartbeat from core client for 30 sec - exiting 11:09:28 (5952): No heartbeat from core client for 30 sec - exiting 11:09:29 (5952): No heartbeat from core client for 30 sec - exiting 11:09:30 (5952): No heartbeat from core client for 30 sec - exiting 11:09:31 (5952): No heartbeat from core client for 30 sec - exiting 11:09:32 (5952): No heartbeat from core client for 30 sec - exiting 11:09:33 (5952): No heartbeat from core client for 30 sec - exiting 11:09:34 (5952): No heartbeat from core client for 30 sec - exiting 11:09:35 (5952): No heartbeat from core client for 30 sec - exiting 11:09:36 (5952): No heartbeat from core client for 30 sec - exiting 11:09:37 (5952): No heartbeat from core client for 30 sec - exiting 11:09:38 (5952): No heartbeat from core client for 30 sec - exiting 11:09:39 (5952): No heartbeat from core client for 30 sec - exiting 11:09:40 (5952): No heartbeat from core client for 30 sec - exiting 11:09:41 (5952): No heartbeat from core client for 30 sec - exiting 11:09:42 (5952): No heartbeat from core client for 30 sec - exiting 11:09:43 (5952): No heartbeat from core client for 30 sec - exiting 11:09:44 (5952): No heartbeat from core client for 30 sec - exiting 11:09:45 (5952): No heartbeat from core client for 30 sec - exiting 11:09:46 (5952): No heartbeat from core client for 30 sec - exiting 11:09:47 (5952): No heartbeat from core client for 30 sec - exiting 11:09:48 (5952): No heartbeat from core client for 30 sec - exiting 11:09:49 (5952): No heartbeat from core client for 30 sec - exiting 11:09:50 (5952): No heartbeat from core client for 30 sec - exiting 11:09:51 (5952): No heartbeat from core client for 30 sec - exiting 11:09:52 (5952): No heartbeat from core client for 30 sec - exiting 11:09:53 (5952): No heartbeat from core client for 30 sec - exiting 11:09:54 (5952): No heartbeat from core client for 30 sec - exiting 11:09:55 (5952): No heartbeat from core client for 30 sec - exiting 11:09:56 (5952): No heartbeat from core client for 30 sec - exiting 11:09:57 (5952): No heartbeat from core client for 30 sec - exiting 11:09:58 (5952): No heartbeat from core client for 30 sec - exiting 11:09:59 (5952): No heartbeat from core client for 30 sec - exiting 11:10:00 (5952): No heartbeat from core client for 30 sec - exiting 11:10:01 (5952): No heartbeat from core client for 30 sec - exiting 11:10:02 (5952): No heartbeat from core client for 30 sec - exiting 11:10:03 (5952): No heartbeat from core client for 30 sec - exiting 11:10:04 (5952): No heartbeat from core client for 30 sec - exiting 11:10:05 (5952): No heartbeat from core client for 30 sec - exiting 11:10:06 (5952): No heartbeat from core client for 30 sec - exiting 11:10:07 (5952): No heartbeat from core client for 30 sec - exiting 11:10:08 (5952): No heartbeat from core client for 30 sec - exiting 11:10:09 (5952): No heartbeat from core client for 30 sec - exiting 11:10:10 (5952): No heartbeat from core client for 30 sec - exiting 11:10:11 (5952): No heartbeat from core client for 30 sec - exiting 11:10:12 (5952): No heartbeat from core client for 30 sec - exiting 11:10:13 (5952): No heartbeat from core client for 30 sec - exiting 11:10:14 (5952): No heartbeat from core client for 30 sec - exiting 11:10:15 (5952): No heartbeat from core client for 30 sec - exiting 11:10:16 (5952): No heartbeat from core client for 30 sec - exiting 11:10:17 (5952): No heartbeat from core client for 30 sec - exiting 11:10:18 (5952): No heartbeat from core client for 30 sec - exiting 11:10:19 (5952): No heartbeat from core client for 30 sec - exiting 11:10:20 (5952): No heartbeat from core client for 30 sec - exiting 11:10:21 (5952): No heartbeat from core client for 30 sec - exiting 11:10:22 (5952): No heartbeat from core client for 30 sec - exiting 11:10:23 (5952): No heartbeat from core client for 30 sec - exiting 11:10:24 (5952): No heartbeat from core client for 30 sec - exiting 11:10:25 (5952): No heartbeat from core client for 30 sec - exiting 11:10:26 (5952): No heartbeat from core client for 30 sec - exiting 11:10:27 (5952): No heartbeat from core client for 30 sec - exiting 11:10:28 (5952): No heartbeat from core client for 30 sec - exiting 11:10:29 (5952): No heartbeat from core client for 30 sec - exiting 11:10:30 (5952): No heartbeat from core client for 30 sec - exiting 11:10:31 (5952): No heartbeat from core client for 30 sec - exiting 11:10:32 (5952): No heartbeat from core client for 30 sec - exiting 11:10:33 (5952): No heartbeat from core client for 30 sec - exiting 11:10:34 (5952): No heartbeat from core client for 30 sec - exiting 11:10:35 (5952): No heartbeat from core client for 30 sec - exiting 11:10:36 (5952): No heartbeat from core client for 30 sec - exiting 11:10:37 (5952): No heartbeat from core client for 30 sec - exiting 11:10:38 (5952): No heartbeat from core client for 30 sec - exiting 11:10:39 (5952): No heartbeat from core client for 30 sec - exiting 11:10:40 (5952): No heartbeat from core client for 30 sec - exiting 11:10:41 (5952): No heartbeat from core client for 30 sec - exiting 11:10:42 (5952): No heartbeat from core client for 30 sec - exiting 11:10:43 (5952): No heartbeat from core client for 30 sec - exiting 11:10:44 (5952): No heartbeat from core client for 30 sec - exiting 11:10:45 (5952): No heartbeat from core client for 30 sec - exiting 11:10:46 (5952): No heartbeat from core client for 30 sec - exiting 11:10:47 (5952): No heartbeat from core client for 30 sec - exiting 11:10:48 (5952): No heartbeat from core client for 30 sec - exiting 11:10:49 (5952): No heartbeat from core client for 30 sec - exiting 11:10:50 (5952): No heartbeat from core client for 30 sec - exiting 11:10:51 (5952): No heartbeat from core client for 30 sec - exiting 11:10:52 (5952): No heartbeat from core client for 30 sec - exiting 11:10:53 (5952): No heartbeat from core client for 30 sec - exiting 11:10:54 (5952): No heartbeat from core client for 30 sec - exiting 11:10:55 (5952): No heartbeat from core client for 30 sec - exiting 11:10:56 (5952): No heartbeat from core client for 30 sec - exiting 11:10:57 (5952): No heartbeat from core client for 30 sec - exiting 11:10:58 (5952): No heartbeat from core client for 30 sec - exiting 11:10:59 (5952): No heartbeat from core client for 30 sec - exiting 11:11:00 (5952): No heartbeat from core client for 30 sec - exiting 11:11:01 (5952): No heartbeat from core client for 30 sec - exiting 11:11:02 (5952): No heartbeat from core client for 30 sec - exiting 11:11:03 (5952): No heartbeat from core client for 30 sec - exiting 11:11:04 (5952): No heartbeat from core client for 30 sec - exiting 11:11:05 (5952): No heartbeat from core client for 30 sec - exiting 11:11:06 (5952): No heartbeat from core client for 30 sec - exiting 11:11:07 (5952): No heartbeat from core client for 30 sec - exiting 11:11:08 (5952): No heartbeat from core client for 30 sec - exiting 11:11:09 (5952): No heartbeat from core client for 30 sec - exiting 11:11:10 (5952): No heartbeat from core client for 30 sec - exiting 11:11:11 (5952): No heartbeat from core client for 30 sec - exiting 11:11:12 (5952): No heartbeat from core client for 30 sec - exiting 11:11:13 (5952): No heartbeat from core client for 30 sec - exiting 11:11:14 (5952): No heartbeat from core client for 30 sec - exiting 11:11:15 (5952): No heartbeat from core client for 30 sec - exiting 11:11:16 (5952): No heartbeat from core client for 30 sec - exiting 11:11:17 (5952): No heartbeat from core client for 30 sec - exiting 11:11:18 (5952): No heartbeat from core client for 30 sec - exiting 11:11:19 (5952): No heartbeat from core client for 30 sec - exiting 11:11:20 (5952): No heartbeat from core client for 30 sec - exiting 11:11:21 (5952): No heartbeat from core client for 30 sec - exiting 11:11:22 (5952): No heartbeat from core client for 30 sec - exiting 11:11:23 (5952): No heartbeat from core client for 30 sec - exiting 11:11:24 (5952): No heartbeat from core client for 30 sec - exiting 11:11:25 (5952): No heartbeat from core client for 30 sec - exiting 11:11:26 (5952): No heartbeat from core client for 30 sec - exiting 11:11:27 (5952): No heartbeat from core client for 30 sec - exiting 11:11:28 (5952): No heartbeat from core client for 30 sec - exiting 11:11:29 (5952): No heartbeat from core client for 30 sec - exiting 11:11:30 (5952): No heartbeat from core client for 30 sec - exiting 11:11:31 (5952): No heartbeat from core client for 30 sec - exiting 11:11:32 (5952): No heartbeat from core client for 30 sec - exiting 11:11:33 (5952): No heartbeat from core client for 30 sec - exiting 11:11:34 (5952): No heartbeat from core client for 30 sec - exiting 11:11:35 (5952): No heartbeat from core client for 30 sec - exiting 11:11:36 (5952): No heartbeat from core client for 30 sec - exiting 11:11:37 (5952): No heartbeat from core client for 30 sec - exiting 11:11:38 (5952): No heartbeat from core client for 30 sec - exiting 11:11:39 (5952): No heartbeat from core client for 30 sec - exiting 11:11:40 (5952): No heartbeat from core client for 30 sec - exiting 11:11:41 (5952): No heartbeat from core client for 30 sec - exiting 11:11:42 (5952): No heartbeat from core client for 30 sec - exiting 11:11:43 (5952): No heartbeat from core client for 30 sec - exiting 11:11:44 (5952): No heartbeat from core client for 30 sec - exiting 11:11:45 (5952): No heartbeat from core client for 30 sec - exiting 11:11:46 (5952): No heartbeat from core client for 30 sec - exiting 11:11:47 (5952): No heartbeat from core client for 30 sec - exiting 11:11:48 (5952): No heartbeat from core client for 30 sec - exiting 11:11:49 (5952): No heartbeat from core client for 30 sec - exiting 11:11:50 (5952): No heartbeat from core client for 30 sec - exiting 11:11:51 (5952): No heartbeat from core client for 30 sec - exiting 11:11:52 (5952): No heartbeat from core client for 30 sec - exiting 11:11:53 (5952): No heartbeat from core client for 30 sec - exiting 11:11:54 (5952): No heartbeat from core client for 30 sec - exiting 11:11:55 (5952): No heartbeat from core client for 30 sec - exiting 11:11:56 (5952): No heartbeat from core client for 30 sec - exiting 11:11:57 (5952): No heartbeat from core client for 30 sec - exiting 11:11:58 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:17:14 (5812): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:17:15 (5812): No heartbeat from core client for 30 sec - exiting 10:17:16 (5812): No heartbeat from core client for 30 sec - exiting 10:17:17 (5812): No heartbeat from core client for 30 sec - exiting 10:17:18 (5812): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4488, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77EBFF2B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77EA71F3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jul 2013 10:38:56	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	518,400	630,961	1.2171
02 Jul 2013 09:46:18	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	492,480	600,027	1.2184
27 Jun 2013 14:21:20	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	466,560	568,620	1.2188
25 Jun 2013 14:03:59	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	440,640	536,960	1.2186
24 Jun 2013 14:52:37	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	414,720	504,586	1.2167
23 Jun 2013 17:51:23	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	388,800	472,637	1.2156
22 Jun 2013 22:27:11	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	362,880	441,626	1.2170
21 Jun 2013 13:56:23	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	336,960	411,596	1.2215
20 Jun 2013 09:08:07	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	311,040	378,762	1.2177
15 Jun 2013 13:21:36	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	285,120	346,828	1.2164
13 Jun 2013 18:40:12	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	259,200	314,827	1.2146
12 Jun 2013 16:02:44	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	233,280	283,607	1.2157
10 Jun 2013 16:16:28	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	207,360	253,651	1.2232
08 Jun 2013 19:06:56	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	181,440	221,117	1.2187
07 Jun 2013 13:17:24	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	155,520	189,244	1.2168
06 Jun 2013 08:46:20	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	129,600	158,012	1.2192
04 Jun 2013 08:09:36	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	103,680	126,564	1.2207
02 Jun 2013 18:45:34	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	77,760	95,411	1.2270
01 Jun 2013 17:24:11	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	51,840	63,769	1.2301
30 May 2013 18:57:17	1246764	15802458	hadcm3n_n4ji_1880_40_008373941_0	25,920	32,231	1.2435