Task 15501223

Name	hadcm3n_3ggi_1940_40_008268846_0
Workunit	8423970
Created	23 Dec 2012, 14:12:45 UTC
Sent	23 Dec 2012, 14:18:54 UTC
Report deadline	24 Mar 2013, 21:46:05 UTC
Received	25 Feb 2013, 19:37:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1186953
Run time	5 days 15 hours 45 min 45 sec
CPU time	5 days 4 hours 43 min
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> e client for 30 sec - exiting 21:16:28 (3780): No heartbeat from core client for 30 sec - exiting 21:16:29 (3780): No heartbeat from core client for 30 sec - exiting 21:16:31 (3780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:28 (2212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:10 (3272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:06:40 (3592): No heartbeat from core client for 30 sec - exiting 17:06:41 (3592): No heartbeat from core client for 30 sec - exiting 17:06:42 (3592): No heartbeat from core client for 30 sec - exiting 17:06:43 (3592): No heartbeat from core client for 30 sec - exiting 17:06:44 (3592): No heartbeat from core client for 30 sec - exiting 17:06:45 (3592): No heartbeat from core client for 30 sec - exiting 17:06:46 (3592): No heartbeat from core client for 30 sec - exiting 17:06:47 (3592): No heartbeat from core client for 30 sec - exiting 17:06:48 (3592): No heartbeat from core client for 30 sec - exiting 17:06:50 (3592): No heartbeat from core client for 30 sec - exiting 17:06:51 (3592): No heartbeat from core client for 30 sec - exiting 17:06:52 (3592): No heartbeat from core client for 30 sec - exiting 17:06:53 (3592): No heartbeat from core client for 30 sec - exiting 17:06:54 (3592): No heartbeat from core client for 30 sec - exiting 17:06:55 (3592): No heartbeat from core client for 30 sec - exiting 17:06:56 (3592): No heartbeat from core client for 30 sec - exiting 17:06:57 (3592): No heartbeat from core client for 30 sec - exiting 17:06:58 (3592): No heartbeat from core client for 30 sec - exiting 17:06:59 (3592): No heartbeat from core client for 30 sec - exiting 17:07:00 (3592): No heartbeat from core client for 30 sec - exiting 17:07:02 (3592): No heartbeat from core client for 30 sec - exiting 17:07:03 (3592): No heartbeat from core client for 30 sec - exiting 17:07:04 (3592): No heartbeat from core client for 30 sec - exiting 17:07:05 (3592): No heartbeat from core client for 30 sec - exiting 17:07:06 (3592): No heartbeat from core client for 30 sec - exiting 17:07:07 (3592): No heartbeat from core client for 30 sec - exiting 17:07:08 (3592): No heartbeat from core client for 30 sec - exiting 17:07:09 (3592): No heartbeat from core client for 30 sec - exiting 17:07:10 (3592): No heartbeat from core client for 30 sec - exiting 17:07:11 (3592): No heartbeat from core client for 30 sec - exiting 17:07:12 (3592): No heartbeat from core client for 30 sec - exiting 17:07:14 (3592): No heartbeat from core client for 30 sec - exiting 17:07:15 (3592): No heartbeat from core client for 30 sec - exiting 17:07:16 (3592): No heartbeat from core client for 30 sec - exiting 17:07:17 (3592): No heartbeat from core client for 30 sec - exiting 17:07:18 (3592): No heartbeat from core client for 30 sec - exiting 17:07:19 (3592): No heartbeat from core client for 30 sec - exiting 17:07:20 (3592): No heartbeat from core client for 30 sec - exiting 17:07:21 (3592): No heartbeat from core client for 30 sec - exiting 17:07:22 (3592): No heartbeat from core client for 30 sec - exiting 17:07:23 (3592): No heartbeat from core client for 30 sec - exiting 17:07:25 (3592): No heartbeat from core client for 30 sec - exiting 17:07:26 (3592): No heartbeat from core client for 30 sec - exiting 17:07:27 (3592): No heartbeat from core client for 30 sec - exiting 17:07:28 (3592): No heartbeat from core client for 30 sec - exiting 17:07:29 (3592): No heartbeat from core client for 30 sec - exiting 17:07:30 (3592): No heartbeat from core client for 30 sec - exiting 17:07:31 (3592): No heartbeat from core client for 30 sec - exiting 17:07:32 (3592): No heartbeat from core client for 30 sec - exiting 17:07:33 (3592): No heartbeat from core client for 30 sec - exiting 17:07:34 (3592): No heartbeat from core client for 30 sec - exiting 17:07:35 (3592): No heartbeat from core client for 30 sec - exiting 17:07:37 (3592): No heartbeat from core client for 30 sec - exiting 17:07:38 (3592): No heartbeat from core client for 30 sec - exiting 17:07:39 (3592): No heartbeat from core client for 30 sec - exiting 17:07:40 (3592): No heartbeat from core client for 30 sec - exiting 17:07:41 (3592): No heartbeat from core client for 30 sec - exiting 17:07:42 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:29:21 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:22 (2096): No heartbeat from core client for 30 sec - exiting 22:29:23 (2096): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:58:04 (86992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:05 (86992): No heartbeat from core client for 30 sec - exiting 22:59:24 (95552): No heartbeat from core client for 30 sec - exiting 22:59:25 (95552): No heartbeat from core client for 30 sec - exiting 22:59:26 (95552): No heartbeat from core client for 30 sec - exiting 22:59:27 (95552): No heartbeat from core client for 30 sec - exiting 22:59:28 (95552): No heartbeat from core client for 30 sec - exiting 22:59:29 (95552): No heartbeat from core client for 30 sec - exiting 22:59:30 (95552): No heartbeat from core client for 30 sec - exiting 22:59:31 (95552): No heartbeat from core client for 30 sec - exiting 22:59:32 (95552): No heartbeat from core client for 30 sec - exiting 22:59:33 (95552): No heartbeat from core client for 30 sec - exiting 22:59:34 (95552): No heartbeat from core client for 30 sec - exiting 22:59:35 (95552): No heartbeat from core client for 30 sec - exiting 22:59:36 (95552): No heartbeat from core client for 30 sec - exiting 22:59:37 (95552): No heartbeat from core client for 30 sec - exiting 22:59:38 (95552): No heartbeat from core client for 30 sec - exiting 22:59:39 (95552): No heartbeat from core client for 30 sec - exiting 22:59:40 (95552): No heartbeat from core client for 30 sec - exiting 22:59:41 (95552): No heartbeat from core client for 30 sec - exiting 22:59:42 (95552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=99968, iMonCtr=1 Model crash detected, will try to restart... 20:20:15 (3148): No heartbeat from core client for 30 sec - exiting 20:20:16 (3148): No heartbeat from core client for 30 sec - exiting 20:20:17 (3148): No heartbeat from core client for 30 sec - exiting 20:20:18 (3148): No heartbeat from core client for 30 sec - exiting 20:20:19 (3148): No heartbeat from core client for 30 sec - exiting 20:20:20 (3148): No heartbeat from core client for 30 sec - exiting 20:20:21 (3148): No heartbeat from core client for 30 sec - exiting 20:20:23 (3148): No heartbeat from core client for 30 sec - exiting 20:20:24 (3148): No heartbeat from core client for 30 sec - exiting 20:20:25 (3148): No heartbeat from core client for 30 sec - exiting 20:20:26 (3148): No heartbeat from core client for 30 sec - exiting 20:20:27 (3148): No heartbeat from core client for 30 sec - exiting 20:20:28 (3148): No heartbeat from core client for 30 sec - exiting 20:20:29 (3148): No heartbeat from core client for 30 sec - exiting 20:20:30 (3148): No heartbeat from core client for 30 sec - exiting 20:20:31 (3148): No heartbeat from core client for 30 sec - exiting 20:20:32 (3148): No heartbeat from core client for 30 sec - exiting 20:20:33 (3148): No heartbeat from core client for 30 sec - exiting 20:20:35 (3148): No heartbeat from core client for 30 sec - exiting 20:20:36 (3148): No heartbeat from core client for 30 sec - exiting 20:20:37 (3148): No heartbeat from core client for 30 sec - exiting 20:20:38 (3148): No heartbeat from core client for 30 sec - exiting 20:20:39 (3148): No heartbeat from core client for 30 sec - exiting 20:20:40 (3148): No heartbeat from core client for 30 sec - exiting 20:20:41 (3148): No heartbeat from core client for 30 sec - exiting 20:20:42 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:56 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3128, iMonCtr=1 Model crash detected, will try to restart... 20:29:51 (824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:13 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2092, iMonCtr=1 Model crash detected, will try to restart... 14:00:50 (3108): No heartbeat from core client for 30 sec - exiting 14:00:52 (3108): No heartbeat from core client for 30 sec - exiting 14:00:53 (3108): No heartbeat from core client for 30 sec - exiting 14:00:54 (3108): No heartbeat from core client for 30 sec - exiting 14:00:55 (3108): No heartbeat from core client for 30 sec - exiting 14:00:56 (3108): No heartbeat from core client for 30 sec - exiting 14:00:57 (3108): No heartbeat from core client for 30 sec - exiting 14:00:58 (3108): No heartbeat from core client for 30 sec - exiting 14:00:59 (3108): No heartbeat from core client for 30 sec - exiting 14:01:00 (3108): No heartbeat from core client for 30 sec - exiting 14:01:01 (3108): No heartbeat from core client for 30 sec - exiting 14:01:02 (3108): No heartbeat from core client for 30 sec - exiting 14:01:04 (3108): No heartbeat from core client for 30 sec - exiting 14:01:05 (3108): No heartbeat from core client for 30 sec - exiting 14:01:06 (3108): No heartbeat from core client for 30 sec - exiting 14:01:07 (3108): No heartbeat from core client for 30 sec - exiting 14:01:08 (3108): No heartbeat from core client for 30 sec - exiting 14:01:09 (3108): No heartbeat from core client for 30 sec - exiting 14:01:10 (3108): No heartbeat from core client for 30 sec - exiting 14:01:11 (3108): No heartbeat from core client for 30 sec - exiting 14:01:12 (3108): No heartbeat from core client for 30 sec - exiting 14:01:13 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=832, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=832, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7960, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:38:00 (4420): No heartbeat from core client for 30 sec - exiting 18:38:01 (4420): No heartbeat from core client for 30 sec - exiting 18:38:02 (4420): No heartbeat from core client for 30 sec - exiting 18:38:03 (4420): No heartbeat from core client for 30 sec - exiting 18:38:05 (4420): No heartbeat from core client for 30 sec - exiting 18:38:06 (4420): No heartbeat from core client for 30 sec - exiting 18:38:07 (4420): No heartbeat from core client for 30 sec - exiting 18:38:08 (4420): No heartbeat from core client for 30 sec - exiting 18:38:09 (4420): No heartbeat from core client for 30 sec - exiting 18:38:10 (4420): No heartbeat from core client for 30 sec - exiting 18:38:11 (4420): No heartbeat from core client for 30 sec - exiting 18:38:12 (4420): No heartbeat from core client for 30 sec - exiting 18:38:13 (4420): No heartbeat from core client for 30 sec - exiting 18:38:14 (4420): No heartbeat from core client for 30 sec - exiting 18:38:15 (4420): No heartbeat from core client for 30 sec - exiting 18:38:17 (4420): No heartbeat from core client for 30 sec - exiting 18:38:18 (4420): No heartbeat from core client for 30 sec - exiting 18:38:19 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:51:12 (2384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:08:41 (3712): No heartbeat from core client for 30 sec - exiting 19:08:42 (3712): No heartbeat from core client for 30 sec - exiting 19:08:43 (3712): No heartbeat from core client for 30 sec - exiting 19:08:45 (3712): No heartbeat from core client for 30 sec - exiting 19:08:46 (3712): No heartbeat from core client for 30 sec - exiting 19:08:47 (3712): No heartbeat from core client for 30 sec - exiting 19:08:48 (3712): No heartbeat from core client for 30 sec - exiting 19:08:49 (3712): No heartbeat from core client for 30 sec - exiting 19:08:50 (3712): No heartbeat from core client for 30 sec - exiting 19:08:51 (3712): No heartbeat from core client for 30 sec - exiting 19:08:52 (3712): No heartbeat from core client for 30 sec - exiting 19:08:53 (3712): No heartbeat from core client for 30 sec - exiting 19:08:54 (3712): No heartbeat from core client for 30 sec - exiting 19:08:55 (3712): No heartbeat from core client for 30 sec - exiting 19:08:56 (3712): No heartbeat from core client for 30 sec - exiting 19:08:57 (3712): No heartbeat from core client for 30 sec - exiting 19:08:58 (3712): No heartbeat from core client for 30 sec - exiting 19:09:00 (3712): No heartbeat from core client for 30 sec - exiting 19:09:01 (3712): No heartbeat from core client for 30 sec - exiting 19:09:02 (3712): No heartbeat from core client for 30 sec - exiting 19:09:03 (3712): No heartbeat from core client for 30 sec - exiting 19:09:04 (3712): No heartbeat from core client for 30 sec - exiting 19:09:05 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:05:00 (4868): No heartbeat from core client for 30 sec - exiting 20:05:01 (4868): No heartbeat from core client for 30 sec - exiting 20:05:03 (4868): No heartbeat from core client for 30 sec - exiting 20:05:04 (4868): No heartbeat from core client for 30 sec - exiting 20:05:05 (4868): No heartbeat from core client for 30 sec - exiting 20:05:06 (4868): No heartbeat from core client for 30 sec - exiting 20:05:07 (4868): No heartbeat from core client for 30 sec - exiting 20:05:08 (4868): No heartbeat from core client for 30 sec - exiting 20:05:09 (4868): No heartbeat from core client for 30 sec - exiting 20:05:10 (4868): No heartbeat from core client for 30 sec - exiting 20:05:11 (4868): No heartbeat from core client for 30 sec - exiting 20:05:12 (4868): No heartbeat from core client for 30 sec - exiting 20:05:13 (4868): No heartbeat from core client for 30 sec - exiting 20:05:15 (4868): No heartbeat from core client for 30 sec - exiting 20:05:16 (4868): No heartbeat from core client for 30 sec - exiting 20:05:17 (4868): No heartbeat from core client for 30 sec - exiting 20:05:18 (4868): No heartbeat from core client for 30 sec - exiting 20:05:19 (4868): No heartbeat from core client for 30 sec - exiting 20:05:20 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:49:48 (3240): No heartbeat from core client for 30 sec - exiting 20:49:50 (3240): No heartbeat from core client for 30 sec - exiting 20:49:51 (3240): No heartbeat from core client for 30 sec - exiting 20:49:52 (3240): No heartbeat from core client for 30 sec - exiting 20:49:53 (3240): No heartbeat from core client for 30 sec - exiting 20:49:54 (3240): No heartbeat from core client for 30 sec - exiting 20:49:55 (3240): No heartbeat from core client for 30 sec - exiting 20:49:56 (3240): No heartbeat from core client for 30 sec - exiting 20:49:57 (3240): No heartbeat from core client for 30 sec - exiting 20:49:58 (3240): No heartbeat from core client for 30 sec - exiting 20:50:00 (3240): No heartbeat from core client for 30 sec - exiting 20:50:01 (3240): No heartbeat from core client for 30 sec - exiting 20:50:02 (3240): No heartbeat from core client for 30 sec - exiting 20:50:03 (3240): No heartbeat from core client for 30 sec - exiting 20:50:04 (3240): No heartbeat from core client for 30 sec - exiting 20:50:05 (3240): No heartbeat from core client for 30 sec - exiting 20:50:06 (3240): No heartbeat from core client for 30 sec - exiting 20:50:07 (3240): No heartbeat from core client for 30 sec - exiting 20:50:08 (3240): No heartbeat from core client for 30 sec - exiting 20:50:09 (3240): No heartbeat from core client for 30 sec - exiting 20:50:10 (3240): No heartbeat from core client for 30 sec - exiting 20:50:12 (3240): No heartbeat from core client for 30 sec - exiting 20:50:13 (3240): No heartbeat from core client for 30 sec - exiting 20:50:14 (3240): No heartbeat from core client for 30 sec - exiting 20:50:15 (3240): No heartbeat from core client for 30 sec - exiting 20:50:16 (3240): No heartbeat from core client for 30 sec - exiting 20:50:17 (3240): No heartbeat from core client for 30 sec - exiting 20:50:18 (3240): No heartbeat from core client for 30 sec - exiting 20:50:19 (3240): No heartbeat from core client for 30 sec - exiting 20:50:20 (3240): No heartbeat from core client for 30 sec - exiting 20:50:21 (3240): No heartbeat from core client for 30 sec - exiting 20:50:22 (3240): No heartbeat from core client for 30 sec - exiting 20:50:24 (3240): No heartbeat from core client for 30 sec - exiting 20:50:25 (3240): No heartbeat from core client for 30 sec - exiting 20:50:26 (3240): No heartbeat from core client for 30 sec - exiting 20:50:27 (3240): No heartbeat from core client for 30 sec - exiting 20:50:28 (3240): No heartbeat from core client for 30 sec - exiting 20:50:29 (3240): No heartbeat from core client for 30 sec - exiting 20:50:30 (3240): No heartbeat from core client for 30 sec - exiting 20:50:31 (3240): No heartbeat from core client for 30 sec - exiting 20:50:32 (3240): No heartbeat from core client for 30 sec - exiting 20:50:33 (3240): No heartbeat from core client for 30 sec - exiting 20:50:35 (3240): No heartbeat from core client for 30 sec - exiting 20:50:36 (3240): No heartbeat from core client for 30 sec - exiting 20:50:37 (3240): No heartbeat from core client for 30 sec - exiting 20:50:38 (3240): No heartbeat from core client for 30 sec - exiting 20:50:39 (3240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:53:58 (4624): No heartbeat from core client for 30 sec - exiting 21:53:59 (4624): No heartbeat from core client for 30 sec - exiting 21:54:00 (4624): No heartbeat from core client for 30 sec - exiting 21:54:01 (4624): No heartbeat from core client for 30 sec - exiting 21:54:02 (4624): No heartbeat from core client for 30 sec - exiting 21:54:03 (4624): No heartbeat from core client for 30 sec - exiting 21:54:04 (4624): No heartbeat from core client for 30 sec - exiting 21:54:05 (4624): No heartbeat from core client for 30 sec - exiting 21:54:06 (4624): No heartbeat from core client for 30 sec - exiting 21:54:07 (4624): No heartbeat from core client for 30 sec - exiting 21:54:08 (4624): No heartbeat from core client for 30 sec - exiting 21:54:09 (4624): No heartbeat from core client for 30 sec - exiting 21:54:10 (4624): No heartbeat from core client for 30 sec - exiting 21:54:11 (4624): No heartbeat from core client for 30 sec - exiting 21:54:12 (4624): No heartbeat from core client for 30 sec - exiting 21:54:13 (4624): No heartbeat from core client for 30 sec - exiting 21:54:14 (4624): No heartbeat from core client for 30 sec - exiting 21:54:15 (4624): No heartbeat from core client for 30 sec - exiting 21:54:16 (4624): No heartbeat from core client for 30 sec - exiting 21:54:17 (4624): No heartbeat from core client for 30 sec - exiting 21:54:18 (4624): No heartbeat from core client for 30 sec - exiting 21:54:19 (4624): No heartbeat from core client for 30 sec - exiting 21:54:20 (4624): No heartbeat from core client for 30 sec - exiting 21:54:21 (4624): No heartbeat from core client for 30 sec - exiting 21:54:22 (4624): No heartbeat from core client for 30 sec - exiting 21:54:23 (4624): No heartbeat from core client for 30 sec - exiting 21:54:24 (4624): No heartbeat from core client for 30 sec - exiting 21:54:25 (4624): No heartbeat from core client for 30 sec - exiting 21:54:26 (4624): No heartbeat from core client for 30 sec - exiting 21:54:27 (4624): No heartbeat from core client for 30 sec - exiting 21:54:28 (4624): No heartbeat from core client for 30 sec - exiting 21:54:29 (4624): No heartbeat from core client for 30 sec - exiting 21:54:30 (4624): No heartbeat from core client for 30 sec - exiting 21:54:31 (4624): No heartbeat from core client for 30 sec - exiting 21:54:32 (4624): No heartbeat from core client for 30 sec - exiting 21:54:33 (4624): No heartbeat from core client for 30 sec - exiting 21:54:34 (4624): No heartbeat from core client for 30 sec - exiting 21:54:35 (4624): No heartbeat from core client for 30 sec - exiting 21:54:36 (4624): No heartbeat from core client for 30 sec - exiting 21:54:37 (4624): No heartbeat from core client for 30 sec - exiting 21:54:38 (4624): No heartbeat from core client for 30 sec - exiting 21:54:39 (4624): No heartbeat from core client for 30 sec - exiting 21:54:40 (4624): No heartbeat from core client for 30 sec - exiting 21:54:41 (4624): No heartbeat from core client for 30 sec - exiting 21:54:42 (4624): No heartbeat from core client for 30 sec - exiting 21:54:43 (4624): No heartbeat from core client for 30 sec - exiting 21:54:44 (4624): No heartbeat from core client for 30 sec - exiting 21:54:45 (4624): No heartbeat from core client for 30 sec - exiting 21:54:46 (4624): No heartbeat from core client for 30 sec - exiting 21:54:47 (4624): No heartbeat from core client for 30 sec - exiting 21:54:48 (4624): No heartbeat from core client for 30 sec - exiting 21:54:49 (4624): No heartbeat from core client for 30 sec - exiting 21:54:50 (4624): No heartbeat from core client for 30 sec - exiting 21:54:51 (4624): No heartbeat from core client for 30 sec - exiting 21:54:52 (4624): No heartbeat from core client for 30 sec - exiting 21:54:53 (4624): No heartbeat from core client for 30 sec - exiting 21:54:54 (4624): No heartbeat from core client for 30 sec - exiting 21:54:55 (4624): No heartbeat from core client for 30 sec - exiting 21:55:26 (4624): No heartbeat from core client for 30 sec - exiting 21:55:27 (4624): No heartbeat from core client for 30 sec - exiting 21:55:28 (4624): No heartbeat from core client for 30 sec - exiting 21:55:29 (4624): No heartbeat from core client for 30 sec - exiting 21:55:30 (4624): No heartbeat from core client for 30 sec - exiting 21:55:31 (4624): No heartbeat from core client for 30 sec - exiting 21:55:32 (4624): No heartbeat from core client for 30 sec - exiting 21:55:33 (4624): No heartbeat from core client for 30 sec - exiting 21:55:34 (4624): No heartbeat from core client for 30 sec - exiting 21:55:35 (4624): No heartbeat from core client for 30 sec - exiting 21:55:36 (4624): No heartbeat from core client for 30 sec - exiting 21:55:37 (4624): No heartbeat from core client for 30 sec - exiting 21:55:38 (4624): No heartbeat from core client for 30 sec - exiting 21:55:39 (4624): No heartbeat from core client for 30 sec - exiting 21:55:40 (4624): No heartbeat from core client for 30 sec - exiting 21:55:41 (4624): No heartbeat from core client for 30 sec - exiting 21:55:42 (4624): No heartbeat from core client for 30 sec - exiting 21:55:43 (4624): No heartbeat from core client for 30 sec - exiting 21:55:44 (4624): No heartbeat from core client for 30 sec - exiting 21:55:45 (4624): No heartbeat from core client for 30 sec - exiting 21:55:46 (4624): No heartbeat from core client for 30 sec - exiting 21:55:47 (4624): No heartbeat from core client for 30 sec - exiting 21:55:48 (4624): No heartbeat from core client for 30 sec - exiting 21:55:49 (4624): No heartbeat from core client for 30 sec - exiting 21:55:50 (4624): No heartbeat from core client for 30 sec - exiting 21:55:51 (4624): No heartbeat from core client for 30 sec - exiting 21:55:52 (4624): No heartbeat from core client for 30 sec - exiting 21:55:53 (4624): No heartbeat from core client for 30 sec - exiting 21:55:54 (4624): No heartbeat from core client for 30 sec - exiting 21:55:55 (4624): No heartbeat from core client for 30 sec - exiting 21:55:56 (4624): No heartbeat from core client for 30 sec - exiting 21:55:57 (4624): No heartbeat from core client for 30 sec - exiting 21:55:58 (4624): No heartbeat from core client for 30 sec - exiting 21:55:59 (4624): No heartbeat from core client for 30 sec - exiting 21:56:00 (4624): No heartbeat from core client for 30 sec - exiting 21:56:01 (4624): No heartbeat from core client for 30 sec - exiting 21:56:02 (4624): No heartbeat from core client for 30 sec - exiting 21:56:03 (4624): No heartbeat from core client for 30 sec - exiting 21:56:04 (4624): No heartbeat from core client for 30 sec - exiting 21:56:05 (4624): No heartbeat from core client for 30 sec - exiting 21:56:06 (4624): No heartbeat from core client for 30 sec - exiting 21:56:07 (4624): No heartbeat from core client for 30 sec - exiting 21:56:09 (4624): No heartbeat from core client for 30 sec - exiting 21:56:10 (4624): No heartbeat from core client for 30 sec - exiting 21:56:11 (4624): No heartbeat from core client for 30 sec - exiting 21:56:12 (4624): No heartbeat from core client for 30 sec - exiting 21:56:13 (4624): No heartbeat from core client for 30 sec - exiting 21:56:14 (4624): No heartbeat from core client for 30 sec - exiting 21:56:15 (4624): No heartbeat from core client for 30 sec - exiting 21:56:16 (4624): No heartbeat from core client for 30 sec - exiting 21:56:17 (4624): No heartbeat from core client for 30 sec - exiting 21:56:18 (4624): No heartbeat from core client for 30 sec - exiting 21:56:19 (4624): No heartbeat from core client for 30 sec - exiting 21:56:21 (4624): No heartbeat from core client for 30 sec - exiting 21:56:22 (4624): No heartbeat from core client for 30 sec - exiting 21:56:23 (4624): No heartbeat from core client for 30 sec - exiting 21:56:24 (4624): No heartbeat from core client for 30 sec - exiting 21:56:25 (4624): No heartbeat from core client for 30 sec - exiting 21:56:26 (4624): No heartbeat from core client for 30 sec - exiting 21:56:27 (4624): No heartbeat from core client for 30 sec - exiting 21:56:28 (4624): No heartbeat from core client for 30 sec - exiting 21:56:29 (4624): No heartbeat from core client for 30 sec - exiting 21:56:30 (4624): No heartbeat from core client for 30 sec - exiting 21:56:31 (4624): No heartbeat from core client for 30 sec - exiting 21:56:33 (4624): No heartbeat from core client for 30 sec - exiting 21:56:34 (4624): No heartbeat from core client for 30 sec - exiting 21:56:35 (4624): No heartbeat from core client for 30 sec - exiting 21:56:36 (4624): No heartbeat from core client for 30 sec - exiting 21:56:37 (4624): No heartbeat from core client for 30 sec - exiting 21:56:38 (4624): No heartbeat from core client for 30 sec - exiting 21:56:39 (4624): No heartbeat from core client for 30 sec - exiting 21:56:40 (4624): No heartbeat from core client for 30 sec - exiting 21:56:41 (4624): No heartbeat from core client for 30 sec - exiting 21:56:42 (4624): No heartbeat from core client for 30 sec - exiting 21:56:43 (4624): No heartbeat from core client for 30 sec - exiting 21:56:45 (4624): No heartbeat from core client for 30 sec - exiting 21:56:46 (4624): No heartbeat from core client for 30 sec - exiting 21:56:47 (4624): No heartbeat from core client for 30 sec - exiting 21:56:48 (4624): No heartbeat from core client for 30 sec - exiting 21:56:49 (4624): No heartbeat from core client for 30 sec - exiting 21:56:50 (4624): No heartbeat from core client for 30 sec - exiting 21:56:51 (4624): No heartbeat from core client for 30 sec - exiting 21:56:52 (4624): No heartbeat from core client for 30 sec - exiting 21:56:53 (4624): No heartbeat from core client for 30 sec - exiting 21:56:54 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:55 (4624): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:37:14 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:41:33 (5332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:41 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:42 (5108): No heartbeat from core client for 30 sec - exiting 17:42:43 (5108): No heartbeat from core client for 30 sec - exiting 17:42:44 (5108): No heartbeat from core client for 30 sec - exiting 17:42:45 (5108): No heartbeat from core client for 30 sec - exiting 17:42:46 (5108): No heartbeat from core client for 30 sec - exiting 17:42:47 (5108): No heartbeat from core client for 30 sec - exiting 17:42:48 (5108): No heartbeat from core client for 30 sec - exiting 17:42:49 (5108): No heartbeat from core client for 30 sec - exiting 17:42:50 (5108): No heartbeat from core client for 30 sec - exiting 17:42:51 (5108): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2144, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 18:24:05 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:29:19 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... 18:39:29 (1504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:45:07 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:46:28 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:47:01 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:45:50 (1192): No heartbeat from core client for 30 sec - exiting 17:45:51 (1192): No heartbeat from core client for 30 sec - exiting 17:45:52 (1192): No heartbeat from core client for 30 sec - exiting 17:45:53 (1192): No heartbeat from core client for 30 sec - exiting 17:45:54 (1192): No heartbeat from core client for 30 sec - exiting 17:45:55 (1192): No heartbeat from core client for 30 sec - exiting 17:45:56 (1192): No heartbeat from core client for 30 sec - exiting 17:45:57 (1192): No heartbeat from core client for 30 sec - exiting 17:45:58 (1192): No heartbeat from core client for 30 sec - exiting 17:46:00 (1192): No heartbeat from core client for 30 sec - exiting 17:46:01 (1192): No heartbeat from core client for 30 sec - exiting 17:46:02 (1192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3ggiko.pje9c10 Error converting file to netcdf: dataout/3ggiko.pie9c10 Error converting file to netcdf: dataout/3ggiko.pfe9c10 Error converting file to netcdf: dataout/3ggika.phe9c10 Error converting file to netcdf: dataout/3ggika.pge9c10 Error converting file to netcdf: dataout/3ggika.pee9c10 Error converting file to netcdf: dataout/3ggika.pde9c10 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:41:30 (2804): No heartbeat from core client for 30 sec - exiting 16:41:31 (2804): No heartbeat from core client for 30 sec - exiting 16:41:33 (2804): No heartbeat from core client for 30 sec - exiting 16:41:34 (2804): No heartbeat from core client for 30 sec - exiting 16:41:35 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:50:28 (4560): No heartbeat from core client for 30 sec - exiting 17:50:29 (4560): No heartbeat from core client for 30 sec - exiting 17:50:30 (4560): No heartbeat from core client for 30 sec - exiting 17:50:31 (4560): No heartbeat from core client for 30 sec - exiting 17:50:33 (4560): No heartbeat from core client for 30 sec - exiting 17:50:34 (4560): No heartbeat from core client for 30 sec - exiting 17:50:35 (4560): No heartbeat from core client for 30 sec - exiting 17:50:36 (4560): No heartbeat from core client for 30 sec - exiting 17:50:37 (4560): No heartbeat from core client for 30 sec - exiting 17:50:38 (4560): No heartbeat from core client for 30 sec - exiting 17:50:39 (4560): No heartbeat from core client for 30 sec - exiting 17:50:40 (4560): No heartbeat from core client for 30 sec - exiting 17:50:41 (4560): No heartbeat from core client for 30 sec - exiting 17:50:42 (4560): No heartbeat from core client for 30 sec - exiting 17:50:43 (4560): No heartbeat from core client for 30 sec - exiting 17:50:44 (4560): No heartbeat from core client for 30 sec - exiting 17:50:45 (4560): No heartbeat from core client for 30 sec - exiting 17:50:46 (4560): No heartbeat from core client for 30 sec - exiting 17:50:48 (4560): No heartbeat from core client for 30 sec - exiting 17:50:49 (4560): No heartbeat from core client for 30 sec - exiting 17:50:50 (4560): No heartbeat from core client for 30 sec - exiting 17:50:51 (4560): No heartbeat from core client for 30 sec - exiting 17:50:52 (4560): No heartbeat from core client for 30 sec - exiting 17:50:53 (4560): No heartbeat from core client for 30 sec - exiting 17:50:54 (4560): No heartbeat from core client for 30 sec - exiting 17:50:55 (4560): No heartbeat from core client for 30 sec - exiting 17:50:56 (4560): No heartbeat from core client for 30 sec - exiting 17:50:57 (4560): No heartbeat from core client for 30 sec - exiting 17:50:58 (4560): No heartbeat from core client for 30 sec - exiting 17:51:00 (4560): No heartbeat from core client for 30 sec - exiting 17:51:01 (4560): No heartbeat from core client for 30 sec - exiting 17:51:02 (4560): No heartbeat from core client for 30 sec - exiting 17:51:03 (4560): No heartbeat from core client for 30 sec - exiting 17:51:04 (4560): No heartbeat from core client for 30 sec - exiting 17:51:05 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77F38851 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3ggi_1940_40_008268846/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Feb 2013 19:44:04	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	259,200	448,960	1.7321
20 Feb 2013 17:56:35	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	233,280	405,472	1.7381
14 Feb 2013 19:57:22	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	207,360	359,972	1.7360
07 Feb 2013 22:02:27	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	181,440	314,536	1.7336
28 Jan 2013 20:26:13	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	155,520	270,519	1.7394
23 Jan 2013 22:03:39	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	129,600	225,049	1.7365
18 Jan 2013 22:52:46	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	103,680	180,301	1.7390
13 Jan 2013 21:14:09	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	77,760	136,160	1.7510
07 Jan 2013 21:28:58	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	51,840	92,575	1.7858
06 Jan 2013 14:42:26	1186953	15501223	hadcm3n_3ggi_1940_40_008268846_0	25,920	48,142	1.8573