Task 15594103

Name	hadcm3n_4c40_1940_40_008307545_0
Workunit	8458680
Created	7 Feb 2013, 14:05:47 UTC
Sent	7 Feb 2013, 14:07:41 UTC
Report deadline	9 May 2013, 21:34:52 UTC
Received	1 Mar 2013, 17:24:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1246793
Run time	6 days 1 hours 55 min 33 sec
CPU time	5 days 16 hours 28 min 55 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5948, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:05:49 (892): No heartbeat from core client for 30 sec - exiting 16:05:51 (892): No heartbeat from core client for 30 sec - exiting 16:05:52 (892): No heartbeat from core client for 30 sec - exiting 16:05:53 (892): No heartbeat from core client for 30 sec - exiting 16:05:54 (892): No heartbeat from core client for 30 sec - exiting 16:05:55 (892): No heartbeat from core client for 30 sec - exiting 16:05:56 (892): No heartbeat from core client for 30 sec - exiting 16:05:57 (892): No heartbeat from core client for 30 sec - exiting 16:05:58 (892): No heartbeat from core client for 30 sec - exiting 16:05:59 (892): No heartbeat from core client for 30 sec - exiting 16:06:00 (892): No heartbeat from core client for 30 sec - exiting 16:06:02 (892): No heartbeat from core client for 30 sec - exiting 16:06:03 (892): No heartbeat from core client for 30 sec - exiting 16:06:04 (892): No heartbeat from core client for 30 sec - exiting 16:06:05 (892): No heartbeat from core client for 30 sec - exiting 16:06:06 (892): No heartbeat from core client for 30 sec - exiting 16:06:07 (892): No heartbeat from core client for 30 sec - exiting 16:06:08 (892): No heartbeat from core client for 30 sec - exiting 16:06:09 (892): No heartbeat from core client for 30 sec - exiting 16:06:10 (892): No heartbeat from core client for 30 sec - exiting 16:06:11 (892): No heartbeat from core client for 30 sec - exiting 16:06:12 (892): No heartbeat from core client for 30 sec - exiting 16:06:14 (892): No heartbeat from core client for 30 sec - exiting 16:06:15 (892): No heartbeat from core client for 30 sec - exiting 16:06:16 (892): No heartbeat from core client for 30 sec - exiting 16:06:17 (892): No heartbeat from core client for 30 sec - exiting 16:06:18 (892): No heartbeat from core client for 30 sec - exiting 16:06:19 (892): No heartbeat from core client for 30 sec - exiting 16:06:20 (892): No heartbeat from core client for 30 sec - exiting 16:06:21 (892): No heartbeat from core client for 30 sec - exiting 16:06:22 (892): No heartbeat from core client for 30 sec - exiting 16:06:23 (892): No heartbeat from core client for 30 sec - exiting 16:06:24 (892): No heartbeat from core client for 30 sec - exiting 16:06:26 (892): No heartbeat from core client for 30 sec - exiting 16:06:59 (892): No heartbeat from core client for 30 sec - exiting 16:07:00 (892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:22:17 (1892): No heartbeat from core client for 30 sec - exiting 10:22:18 (1892): No heartbeat from core client for 30 sec - exiting 10:22:19 (1892): No heartbeat from core client for 30 sec - exiting 10:22:20 (1892): No heartbeat from core client for 30 sec - exiting 10:22:21 (1892): No heartbeat from core client for 30 sec - exiting 10:22:22 (1892): No heartbeat from core client for 30 sec - exiting 10:22:23 (1892): No heartbeat from core client for 30 sec - exiting 10:22:24 (1892): No heartbeat from core client for 30 sec - exiting 10:22:25 (1892): No heartbeat from core client for 30 sec - exiting 10:22:27 (1892): No heartbeat from core client for 30 sec - exiting 10:22:28 (1892): No heartbeat from core client for 30 sec - exiting 10:22:29 (1892): No heartbeat from core client for 30 sec - exiting 10:22:30 (1892): No heartbeat from core client for 30 sec - exiting 10:22:31 (1892): No heartbeat from core client for 30 sec - exiting 10:22:32 (1892): No heartbeat from core client for 30 sec - exiting 10:22:33 (1892): No heartbeat from core client for 30 sec - exiting 10:22:34 (1892): No heartbeat from core client for 30 sec - exiting 10:22:35 (1892): No heartbeat from core client for 30 sec - exiting 10:22:36 (1892): No heartbeat from core client for 30 sec - exiting 10:22:38 (1892): No heartbeat from core client for 30 sec - exiting 10:22:39 (1892): No heartbeat from core client for 30 sec - exiting 10:22:40 (1892): No heartbeat from core client for 30 sec - exiting 10:22:41 (1892): No heartbeat from core client for 30 sec - exiting 10:22:42 (1892): No heartbeat from core client for 30 sec - exiting 10:22:43 (1892): No heartbeat from core client for 30 sec - exiting 10:22:44 (1892): No heartbeat from core client for 30 sec - exiting 10:22:45 (1892): No heartbeat from core client for 30 sec - exiting 10:22:46 (1892): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:27:10 (4608): No heartbeat from core client for 30 sec - exiting 10:27:11 (4608): No heartbeat from core client for 30 sec - exiting 10:27:12 (4608): No heartbeat from core client for 30 sec - exiting 10:27:13 (4608): No heartbeat from core client for 30 sec - exiting 10:27:14 (4608): No heartbeat from core client for 30 sec - exiting 10:27:15 (4608): No heartbeat from core client for 30 sec - exiting 10:27:16 (4608): No heartbeat from core client for 30 sec - exiting 10:27:17 (4608): No heartbeat from core client for 30 sec - exiting 10:27:18 (4608): No heartbeat from core client for 30 sec - exiting 10:27:19 (4608): No heartbeat from core client for 30 sec - exiting 10:27:20 (4608): No heartbeat from core client for 30 sec - exiting 10:27:21 (4608): No heartbeat from core client for 30 sec - exiting 10:27:22 (4608): No heartbeat from core client for 30 sec - exiting 10:27:23 (4608): No heartbeat from core client for 30 sec - exiting 10:27:24 (4608): No heartbeat from core client for 30 sec - exiting 10:27:25 (4608): No heartbeat from core client for 30 sec - exiting 10:27:26 (4608): No heartbeat from core client for 30 sec - exiting 10:27:27 (4608): No heartbeat from core client for 30 sec - exiting 10:27:28 (4608): No heartbeat from core client for 30 sec - exiting 10:27:29 (4608): No heartbeat from core client for 30 sec - exiting 10:27:30 (4608): No heartbeat from core client for 30 sec - exiting 10:27:31 (4608): No heartbeat from core client for 30 sec - exiting 10:27:32 (4608): No heartbeat from core client for 30 sec - exiting 10:27:33 (4608): No heartbeat from core client for 30 sec - exiting 10:27:34 (4608): No heartbeat from core client for 30 sec - exiting 10:27:35 (4608): No heartbeat from core client for 30 sec - exiting 10:27:36 (4608): No heartbeat from core client for 30 sec - exiting 10:27:37 (4608): No heartbeat from core client for 30 sec - exiting 10:27:38 (4608): No heartbeat from core client for 30 sec - exiting 10:27:39 (4608): No heartbeat from core client for 30 sec - exiting 10:27:40 (4608): No heartbeat from core client for 30 sec - exiting 10:27:41 (4608): No heartbeat from core client for 30 sec - exiting 10:27:42 (4608): No heartbeat from core client for 30 sec - exiting 10:27:43 (4608): No heartbeat from core client for 30 sec - exiting 10:27:44 (4608): No heartbeat from core client for 30 sec - exiting 10:27:45 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:28:27 (4608): No heartbeat from core client for 30 sec - exiting 10:28:28 (4608): No heartbeat from core client for 30 sec - exiting 10:28:29 (4608): No heartbeat from core client for 30 sec - exiting 10:28:30 (4608): No heartbeat from core client for 30 sec - exiting 10:28:31 (4608): No heartbeat from core client for 30 sec - exiting 10:28:32 (4608): No heartbeat from core client for 30 sec - exiting 10:28:33 (4608): No heartbeat from core client for 30 sec - exiting 10:28:34 (4608): No heartbeat from core client for 30 sec - exiting 10:28:35 (4608): No heartbeat from core client for 30 sec - exiting 10:28:36 (4608): No heartbeat from core client for 30 sec - exiting 10:28:37 (4608): No heartbeat from core client for 30 sec - exiting 10:28:38 (4608): No heartbeat from core client for 30 sec - exiting 10:28:39 (4608): No heartbeat from core client for 30 sec - exiting 10:28:40 (4608): No heartbeat from core client for 30 sec - exiting 10:28:41 (4608): No heartbeat from core client for 30 sec - exiting 10:28:42 (4608): No heartbeat from core client for 30 sec - exiting 10:28:43 (4608): No heartbeat from core client for 30 sec - exiting 10:28:44 (4608): No heartbeat from core client for 30 sec - exiting 10:28:45 (4608): No heartbeat from core client for 30 sec - exiting 10:28:46 (4608): No heartbeat from core client for 30 sec - exiting 10:28:47 (4608): No heartbeat from core client for 30 sec - exiting 10:28:48 (4608): No heartbeat from core client for 30 sec - exiting 10:28:49 (4608): No heartbeat from core client for 30 sec - exiting 10:28:50 (4608): No heartbeat from core client for 30 sec - exiting 10:28:51 (4608): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:23:15 (4124): No heartbeat from core client for 30 sec - exiting 19:23:16 (4124): No heartbeat from core client for 30 sec - exiting 19:23:17 (4124): No heartbeat from core client for 30 sec - exiting 19:23:18 (4124): No heartbeat from core client for 30 sec - exiting 19:23:19 (4124): No heartbeat from core client for 30 sec - exiting 19:23:20 (4124): No heartbeat from core client for 30 sec - exiting 19:23:21 (4124): No heartbeat from core client for 30 sec - exiting 19:23:22 (4124): No heartbeat from core client for 30 sec - exiting 19:23:23 (4124): No heartbeat from core client for 30 sec - exiting 19:23:24 (4124): No heartbeat from core client for 30 sec - exiting 19:23:25 (4124): No heartbeat from core client for 30 sec - exiting 19:23:26 (4124): No heartbeat from core client for 30 sec - exiting 19:23:27 (4124): No heartbeat from core client for 30 sec - exiting 19:23:28 (4124): No heartbeat from core client for 30 sec - exiting 19:23:29 (4124): No heartbeat from core client for 30 sec - exiting 19:23:30 (4124): No heartbeat from core client for 30 sec - exiting 19:23:31 (4124): No heartbeat from core client for 30 sec - exiting 19:23:32 (4124): No heartbeat from core client for 30 sec - exiting 19:23:33 (4124): No heartbeat from core client for 30 sec - exiting 19:23:34 (4124): No heartbeat from core client for 30 sec - exiting 19:23:35 (4124): No heartbeat from core client for 30 sec - exiting 19:23:36 (4124): No heartbeat from core client for 30 sec - exiting 19:23:37 (4124): No heartbeat from core client for 30 sec - exiting 19:23:38 (4124): No heartbeat from core client for 30 sec - exiting 19:23:39 (4124): No heartbeat from core client for 30 sec - exiting 19:23:40 (4124): No heartbeat from core client for 30 sec - exiting 19:23:41 (4124): No heartbeat from core client for 30 sec - exiting 19:23:42 (4124): No heartbeat from core client for 30 sec - exiting 19:23:43 (4124): No heartbeat from core client for 30 sec - exiting 19:23:44 (4124): No heartbeat from core client for 30 sec - exiting 19:23:45 (4124): No heartbeat from core client for 30 sec - exiting 19:23:46 (4124): No heartbeat from core client for 30 sec - exiting 19:23:47 (4124): No heartbeat from core client for 30 sec - exiting 19:23:48 (4124): No heartbeat from core client for 30 sec - exiting 19:23:49 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:24:20 (4124): No heartbeat from core client for 30 sec - exiting 19:24:21 (4124): No heartbeat from core client for 30 sec - exiting 19:24:22 (4124): No heartbeat from core client for 30 sec - exiting 19:24:23 (4124): No heartbeat from core client for 30 sec - exiting 19:24:24 (4124): No heartbeat from core client for 30 sec - exiting 19:24:25 (4124): No heartbeat from core client for 30 sec - exiting 19:24:26 (4124): No heartbeat from core client for 30 sec - exiting 19:24:27 (4124): No heartbeat from core client for 30 sec - exiting 19:24:28 (4124): No heartbeat from core client for 30 sec - exiting 19:24:29 (4124): No heartbeat from core client for 30 sec - exiting 19:24:30 (4124): No heartbeat from core client for 30 sec - exiting 19:24:31 (4124): No heartbeat from core client for 30 sec - exiting 19:24:32 (4124): No heartbeat from core client for 30 sec - exiting 19:24:33 (4124): No heartbeat from core client for 30 sec - exiting 19:24:34 (4124): No heartbeat from core client for 30 sec - exiting 19:24:35 (4124): No heartbeat from core client for 30 sec - exiting 19:24:36 (4124): No heartbeat from core client for 30 sec - exiting 19:24:37 (4124): No heartbeat from core client for 30 sec - exiting 19:24:38 (4124): No heartbeat from core client for 30 sec - exiting 19:24:39 (4124): No heartbeat from core client for 30 sec - exiting 19:24:40 (4124): No heartbeat from core client for 30 sec - exiting 19:24:41 (4124): No heartbeat from core client for 30 sec - exiting 19:24:42 (4124): No heartbeat from core client for 30 sec - exiting 19:24:43 (4124): No heartbeat from core client for 30 sec - exiting 19:24:44 (4124): No heartbeat from core client for 30 sec - exiting 19:24:45 (4124): No heartbeat from core client for 30 sec - exiting 19:24:46 (4124): No heartbeat from core client for 30 sec - exiting 19:24:47 (4124): No heartbeat from core client for 30 sec - exiting 19:24:48 (4124): No heartbeat from core client for 30 sec - exiting 19:24:49 (4124): No heartbeat from core client for 30 sec - exiting 19:24:50 (4124): No heartbeat from core client for 30 sec - exiting 19:24:51 (4124): No heartbeat from core client for 30 sec - exiting 19:24:52 (4124): No heartbeat from core client for 30 sec - exiting 19:24:53 (4124): No heartbeat from core client for 30 sec - exiting 19:24:54 (4124): No heartbeat from core client for 30 sec - exiting 19:26:33 (3048): No heartbeat from core client for 30 sec - exiting 19:27:01 (3048): No heartbeat from core client for 30 sec - exiting 19:27:02 (3048): No heartbeat from core client for 30 sec - exiting 19:27:03 (3048): No heartbeat from core client for 30 sec - exiting 19:27:04 (3048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3628, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Mar 2013 16:26:06	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	259,200	491,329	1.8956
28 Feb 2013 12:03:30	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	233,280	443,878	1.9028
26 Feb 2013 17:51:43	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	207,360	396,932	1.9142
21 Feb 2013 23:55:05	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	181,440	351,081	1.9350
20 Feb 2013 12:23:47	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	155,520	304,497	1.9579
18 Feb 2013 22:25:45	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	129,600	255,587	1.9721
16 Feb 2013 01:02:18	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	103,680	203,614	1.9639
13 Feb 2013 17:06:03	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	77,760	152,774	1.9647
11 Feb 2013 00:19:15	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	51,840	102,042	1.9684
09 Feb 2013 17:21:17	1246793	15594103	hadcm3n_4c40_1940_40_008307545_0	25,920	50,621	1.9530