Task 13644848

Name	hadcm3n_t32g_1980_40_007451239_3
Workunit	7648742
Created	18 Nov 2011, 18:44:11 UTC
Sent	18 Nov 2011, 18:52:54 UTC
Report deadline	18 Feb 2012, 2:20:05 UTC
Received	26 Nov 2011, 21:44:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1122757
Run time	1 days 20 hours 57 min 49 sec
CPU time	1 days 20 hours 20 min 19 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	1.70 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 18:38:53 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:56 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:57 (5648): No heartbeat from core client for 30 sec - exiting 18:45:27 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:28 (5200): No heartbeat from core client for 30 sec - exiting 18:45:29 (5200): No heartbeat from core client for 30 sec - exiting 18:45:30 (5200): No heartbeat from core client for 30 sec - exiting 18:45:31 (5200): No heartbeat from core client for 30 sec - exiting 18:45:33 (5200): No heartbeat from core client for 30 sec - exiting 18:45:34 (5200): No heartbeat from core client for 30 sec - exiting 18:47:23 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:33 (3408): No heartbeat from core client for 30 sec - exiting 18:47:34 (3408): No heartbeat from core client for 30 sec - exiting 18:47:35 (3408): No heartbeat from core client for 30 sec - exiting 18:47:36 (3408): No heartbeat from core client for 30 sec - exiting 18:47:37 (3408): No heartbeat from core client for 30 sec - exiting 18:47:38 (3408): No heartbeat from core client for 30 sec - exiting 18:47:39 (3408): No heartbeat from core client for 30 sec - exiting 18:48:43 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:45 (4620): No heartbeat from core client for 30 sec - exiting 18:48:46 (4620): No heartbeat from core client for 30 sec - exiting 18:48:48 (4620): No heartbeat from core client for 30 sec - exiting 18:49:43 (2076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:53 (2076): No heartbeat from core client for 30 sec - exiting 18:49:54 (2076): No heartbeat from core client for 30 sec - exiting 18:49:55 (2076): No heartbeat from core client for 30 sec - exiting 18:50:59 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:52:10 (1544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:50 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:51 (6036): No heartbeat from core client for 30 sec - exiting 05:34:52 (6036): No heartbeat from core client for 30 sec - exiting 05:34:53 (6036): No heartbeat from core client for 30 sec - exiting 05:34:55 (6036): No heartbeat from core client for 30 sec - exiting 05:34:56 (6036): No heartbeat from core client for 30 sec - exiting 05:34:57 (6036): No heartbeat from core client for 30 sec - exiting 05:34:58 (6036): No heartbeat from core client for 30 sec - exiting 12:52:48 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:11 (5260): No heartbeat from core client for 30 sec - exiting 12:53:12 (5260): No heartbeat from core client for 30 sec - exiting 12:53:13 (5260): No heartbeat from core client for 30 sec - exiting 12:53:14 (5260): No heartbeat from core client for 30 sec - exiting 12:53:16 (5260): No heartbeat from core client for 30 sec - exiting 12:53:17 (5260): No heartbeat from core client for 30 sec - exiting 12:53:18 (5260): No heartbeat from core client for 30 sec - exiting 12:53:19 (5260): No heartbeat from core client for 30 sec - exiting 12:53:20 (5260): No heartbeat from core client for 30 sec - exiting 12:53:21 (5260): No heartbeat from core client for 30 sec - exiting 12:53:22 (5260): No heartbeat from core client for 30 sec - exiting 12:53:23 (5260): No heartbeat from core client for 30 sec - exiting 12:53:24 (5260): No heartbeat from core client for 30 sec - exiting 12:53:25 (5260): No heartbeat from core client for 30 sec - exiting 12:55:58 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 15:52:09 (4508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:05 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:56:11 (3656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:56:17 (3656): No heartbeat from core client for 30 sec - exiting 15:56:18 (3656): No heartbeat from core client for 30 sec - exiting 15:56:19 (3656): No heartbeat from core client for 30 sec - exiting 15:57:06 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:57:12 (5400): No heartbeat from core client for 30 sec - exiting 15:57:13 (5400): No heartbeat from core client for 30 sec - exiting 15:57:14 (5400): No heartbeat from core client for 30 sec - exiting 15:57:15 (5400): No heartbeat from core client for 30 sec - exiting 15:57:16 (5400): No heartbeat from core client for 30 sec - exiting 15:57:17 (5400): No heartbeat from core client for 30 sec - exiting 15:57:18 (5400): No heartbeat from core client for 30 sec - exiting 15:58:01 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:18 (5420): No heartbeat from core client for 30 sec - exiting 15:58:19 (5420): No heartbeat from core client for 30 sec - exiting 15:58:20 (5420): No heartbeat from core client for 30 sec - exiting 15:58:21 (5420): No heartbeat from core client for 30 sec - exiting 15:58:22 (5420): No heartbeat from core client for 30 sec - exiting 15:58:23 (5420): No heartbeat from core client for 30 sec - exiting 15:58:24 (5420): No heartbeat from core client for 30 sec - exiting 15:59:29 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:39 (3408): No heartbeat from core client for 30 sec - exiting 15:59:40 (3408): No heartbeat from core client for 30 sec - exiting 15:59:41 (3408): No heartbeat from core client for 30 sec - exiting 16:00:38 (844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:01:48 (1232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:04:53 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:33 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:41 (2892): No heartbeat from core client for 30 sec - exiting 02:54:42 (2892): No heartbeat from core client for 30 sec - exiting 02:54:43 (2892): No heartbeat from core client for 30 sec - exiting 02:54:44 (2892): No heartbeat from core client for 30 sec - exiting 02:54:46 (2892): No heartbeat from core client for 30 sec - exiting 02:54:47 (2892): No heartbeat from core client for 30 sec - exiting 02:54:48 (2892): No heartbeat from core client for 30 sec - exiting 02:54:49 (2892): No heartbeat from core client for 30 sec - exiting 02:54:50 (2892): No heartbeat from core client for 30 sec - exiting 02:54:51 (2892): No heartbeat from core client for 30 sec - exiting 02:54:52 (2892): No heartbeat from core client for 30 sec - exiting 02:54:53 (2892): No heartbeat from core client for 30 sec - exiting 02:54:54 (2892): No heartbeat from core client for 30 sec - exiting 02:54:55 (2892): No heartbeat from core client for 30 sec - exiting 02:54:56 (2892): No heartbeat from core client for 30 sec - exiting 02:54:58 (2892): No heartbeat from core client for 30 sec - exiting 02:54:59 (2892): No heartbeat from core client for 30 sec - exiting 02:55:00 (2892): No heartbeat from core client for 30 sec - exiting 02:55:01 (2892): No heartbeat from core client for 30 sec - exiting 02:58:46 (4652): No heartbeat from core client for 30 sec - exiting 02:58:56 (4652): No heartbeat from core client for 30 sec - exiting 02:58:57 (4652): No heartbeat from core client for 30 sec - exiting 02:58:58 (4652): No heartbeat from core client for 30 sec - exiting 02:58:59 (4652): No heartbeat from core client for 30 sec - exiting 02:59:00 (4652): No heartbeat from core client for 30 sec - exiting 02:59:01 (4652): No heartbeat from core client for 30 sec - exiting 02:59:02 (4652): No heartbeat from core client for 30 sec - exiting 02:59:03 (4652): No heartbeat from core client for 30 sec - exiting 02:59:04 (4652): No heartbeat from core client for 30 sec - exiting 02:59:05 (4652): No heartbeat from core client for 30 sec - exiting 02:59:07 (4652): No heartbeat from core client for 30 sec - exiting 02:59:08 (4652): No heartbeat from core client for 30 sec - exiting 02:59:09 (4652): No heartbeat from core client for 30 sec - exiting 02:59:10 (4652): No heartbeat from core client for 30 sec - exiting 02:59:11 (4652): No heartbeat from core client for 30 sec - exiting 02:59:12 (4652): No heartbeat from core client for 30 sec - exiting 02:59:13 (4652): No heartbeat from core client for 30 sec - exiting 02:59:14 (4652): No heartbeat from core client for 30 sec - exiting 02:59:15 (4652): No heartbeat from core client for 30 sec - exiting 02:59:58 (4652): No heartbeat from core client for 30 sec - exiting 02:59:59 (4652): No heartbeat from core client for 30 sec - exiting 03:00:00 (4652): No heartbeat from core client for 30 sec - exiting 03:00:01 (4652): No heartbeat from core client for 30 sec - exiting 03:00:02 (4652): No heartbeat from core client for 30 sec - exiting 03:00:03 (4652): No heartbeat from core client for 30 sec - exiting 03:00:04 (4652): No heartbeat from core client for 30 sec - exiting 03:00:06 (4652): No heartbeat from core client for 30 sec - exiting 03:00:07 (4652): No heartbeat from core client for 30 sec - exiting 03:00:08 (4652): No heartbeat from core client for 30 sec - exiting 03:00:09 (4652): No heartbeat from core client for 30 sec - exiting 03:00:10 (4652): No heartbeat from core client for 30 sec - exiting 03:00:11 (4652): No heartbeat from core client for 30 sec - exiting 03:00:12 (4652): No heartbeat from core client for 30 sec - exiting 03:00:13 (4652): No heartbeat from core client for 30 sec - exiting 03:00:14 (4652): No heartbeat from core client for 30 sec - exiting 03:00:15 (4652): No heartbeat from core client for 30 sec - exiting 03:00:16 (4652): No heartbeat from core client for 30 sec - exiting 03:00:18 (4652): No heartbeat from core client for 30 sec - exiting 03:00:19 (4652): No heartbeat from core client for 30 sec - exiting 03:00:20 (4652): No heartbeat from core client for 30 sec - exiting 03:00:21 (4652): No heartbeat from core client for 30 sec - exiting 03:00:22 (4652): No heartbeat from core client for 30 sec - exiting 03:00:23 (4652): No heartbeat from core client for 30 sec - exiting 03:00:24 (4652): No heartbeat from core client for 30 sec - exiting 03:00:25 (4652): No heartbeat from core client for 30 sec - exiting 03:00:26 (4652): No heartbeat from core client for 30 sec - exiting 03:00:27 (4652): No heartbeat from core client for 30 sec - exiting 03:00:28 (4652): No heartbeat from core client for 30 sec - exiting 03:00:30 (4652): No heartbeat from core client for 30 sec - exiting 03:00:31 (4652): No heartbeat from core client for 30 sec - exiting 03:00:32 (4652): No heartbeat from core client for 30 sec - exiting 03:00:33 (4652): No heartbeat from core client for 30 sec - exiting 03:00:34 (4652): No heartbeat from core client for 30 sec - exiting 03:00:35 (4652): No heartbeat from core client for 30 sec - exiting 03:00:36 (4652): No heartbeat from core client for 30 sec - exiting 03:00:37 (4652): No heartbeat from core client for 30 sec - exiting 03:00:38 (4652): No heartbeat from core client for 30 sec - exiting 03:00:39 (4652): No heartbeat from core client for 30 sec - exiting 03:00:40 (4652): No heartbeat from core client for 30 sec - exiting 03:00:42 (4652): No heartbeat from core client for 30 sec - exiting 03:00:43 (4652): No heartbeat from core client for 30 sec - exiting 03:00:44 (4652): No heartbeat from core client for 30 sec - exiting 03:00:45 (4652): No heartbeat from core client for 30 sec - exiting 03:00:46 (4652): No heartbeat from core client for 30 sec - exiting 03:00:47 (4652): No heartbeat from core client for 30 sec - exiting 03:00:48 (4652): No heartbeat from core client for 30 sec - exiting 03:00:49 (4652): No heartbeat from core client for 30 sec - exiting 03:00:50 (4652): No heartbeat from core client for 30 sec - exiting 03:00:51 (4652): No heartbeat from core client for 30 sec - exiting 03:00:52 (4652): No heartbeat from core client for 30 sec - exiting 03:00:54 (4652): No heartbeat from core client for 30 sec - exiting 03:00:55 (4652): No heartbeat from core client for 30 sec - exiting 03:00:56 (4652): No heartbeat from core client for 30 sec - exiting 03:00:57 (4652): No heartbeat from core client for 30 sec - exiting 03:00:58 (4652): No heartbeat from core client for 30 sec - exiting 03:00:59 (4652): No heartbeat from core client for 30 sec - exiting 03:01:00 (4652): No heartbeat from core client for 30 sec - exiting 03:01:01 (4652): No heartbeat from core client for 30 sec - exiting 03:01:02 (4652): No heartbeat from core client for 30 sec - exiting 03:01:03 (4652): No heartbeat from core client for 30 sec - exiting 03:01:04 (4652): No heartbeat from core client for 30 sec - exiting 03:01:06 (4652): No heartbeat from core client for 30 sec - exiting 03:01:07 (4652): No heartbeat from core client for 30 sec - exiting 03:01:08 (4652): No heartbeat from core client for 30 sec - exiting 03:01:09 (4652): No heartbeat from core client for 30 sec - exiting 03:01:10 (4652): No heartbeat from core client for 30 sec - exiting 03:01:11 (4652): No heartbeat from core client for 30 sec - exiting 03:01:12 (4652): No heartbeat from core client for 30 sec - exiting 03:01:13 (4652): No heartbeat from core client for 30 sec - exiting 03:01:14 (4652): No heartbeat from core client for 30 sec - exiting 03:01:15 (4652): No heartbeat from core client for 30 sec - exiting 03:01:17 (4652): No heartbeat from core client for 30 sec - exiting 03:01:18 (4652): No heartbeat from core client for 30 sec - exiting 03:01:19 (4652): No heartbeat from core client for 30 sec - exiting 03:01:20 (4652): No heartbeat from core client for 30 sec - exiting 03:01:21 (4652): No heartbeat from core client for 30 sec - exiting 03:01:22 (4652): No heartbeat from core client for 30 sec - exiting 03:01:23 (4652): No heartbeat from core client for 30 sec - exiting 03:01:24 (4652): No heartbeat from core client for 30 sec - exiting 03:01:25 (4652): No heartbeat from core client for 30 sec - exiting 03:01:26 (4652): No heartbeat from core client for 30 sec - exiting 03:01:27 (4652): No heartbeat from core client for 30 sec - exiting 03:01:29 (4652): No heartbeat from core client for 30 sec - exiting 03:01:30 (4652): No heartbeat from core client for 30 sec - exiting 03:01:31 (4652): No heartbeat from core client for 30 sec - exiting 03:01:32 (4652): No heartbeat from core client for 30 sec - exiting 03:01:33 (4652): No heartbeat from core client for 30 sec - exiting 03:01:34 (4652): No heartbeat from core client for 30 sec - exiting 03:01:35 (4652): No heartbeat from core client for 30 sec - exiting 03:01:36 (4652): No heartbeat from core client for 30 sec - exiting 03:01:37 (4652): No heartbeat from core client for 30 sec - exiting 03:01:38 (4652): No heartbeat from core client for 30 sec - exiting 03:01:39 (4652): No heartbeat from core client for 30 sec - exiting 03:01:41 (4652): No heartbeat from core client for 30 sec - exiting 03:01:42 (4652): No heartbeat from core client for 30 sec - exiting 03:01:43 (4652): No heartbeat from core client for 30 sec - exiting 03:01:44 (4652): No heartbeat from core client for 30 sec - exiting 03:01:45 (4652): No heartbeat from core client for 30 sec - exiting 03:01:46 (4652): No heartbeat from core client for 30 sec - exiting 03:01:47 (4652): No heartbeat from core client for 30 sec - exiting 03:01:48 (4652): No heartbeat from core client for 30 sec - exiting 03:01:49 (4652): No heartbeat from core client for 30 sec - exiting 03:01:50 (4652): No heartbeat from core client for 30 sec - exiting 03:01:51 (4652): No heartbeat from core client for 30 sec - exiting 03:01:53 (4652): No heartbeat from core client for 30 sec - exiting 03:01:54 (4652): No heartbeat from core client for 30 sec - exiting 03:01:55 (4652): No heartbeat from core client for 30 sec - exiting 03:01:56 (4652): No heartbeat from core client for 30 sec - exiting 03:01:57 (4652): No heartbeat from core client for 30 sec - exiting 03:01:58 (4652): No heartbeat from core client for 30 sec - exiting 03:01:59 (4652): No heartbeat from core client for 30 sec - exiting 03:02:00 (4652): No heartbeat from core client for 30 sec - exiting 03:02:01 (4652): No heartbeat from core client for 30 sec - exiting 03:02:02 (4652): No heartbeat from core client for 30 sec - exiting 03:02:03 (4652): No heartbeat from core client for 30 sec - exiting 03:02:05 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:06 (4652): No heartbeat from core client for 30 sec - exiting 03:02:07 (4652): No heartbeat from core client for 30 sec - exiting 03:02:08 (4652): No heartbeat from core client for 30 sec - exiting 03:02:09 (4652): No heartbeat from core client for 30 sec - exiting 03:02:10 (4652): No heartbeat from core client for 30 sec - exiting 03:02:11 (4652): No heartbeat from core client for 30 sec - exiting 03:02:12 (4652): No heartbeat from core client for 30 sec - exiting 03:02:13 (4652): No heartbeat from core client for 30 sec - exiting 03:02:14 (4652): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 13:17:29 (6904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:17:46 (6904): No heartbeat from core client for 30 sec - exiting 13:17:47 (6904): No heartbeat from core client for 30 sec - exiting 13:17:48 (6904): No heartbeat from core client for 30 sec - exiting 13:17:49 (6904): No heartbeat from core client for 30 sec - exiting 13:17:50 (6904): No heartbeat from core client for 30 sec - exiting 13:17:51 (6904): No heartbeat from core client for 30 sec - exiting 13:17:52 (6904): No heartbeat from core client for 30 sec - exiting 13:17:53 (6904): No heartbeat from core client for 30 sec - exiting 13:17:54 (6904): No heartbeat from core client for 30 sec - exiting 13:17:55 (6904): No heartbeat from core client for 30 sec - exiting 13:17:57 (6904): No heartbeat from core client for 30 sec - exiting 13:17:58 (6904): No heartbeat from core client for 30 sec - exiting 13:17:59 (6904): No heartbeat from core client for 30 sec - exiting 13:18:00 (6904): No heartbeat from core client for 30 sec - exiting 13:18:01 (6904): No heartbeat from core client for 30 sec - exiting 13:18:02 (6904): No heartbeat from core client for 30 sec - exiting 13:18:03 (6904): No heartbeat from core client for 30 sec - exiting 13:18:04 (6904): No heartbeat from core client for 30 sec - exiting 13:18:05 (6904): No heartbeat from core client for 30 sec - exiting 13:18:06 (6904): No heartbeat from core client for 30 sec - exiting 13:18:08 (6904): No heartbeat from core client for 30 sec - exiting 13:18:09 (6904): No heartbeat from core client for 30 sec - exiting 13:18:10 (6904): No heartbeat from core client for 30 sec - exiting 13:22:04 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:05 (5232): No heartbeat from core client for 30 sec - exiting 13:22:06 (5232): No heartbeat from core client for 30 sec - exiting 13:22:07 (5232): No heartbeat from core client for 30 sec - exiting 13:22:08 (5232): No heartbeat from core client for 30 sec - exiting 13:22:09 (5232): No heartbeat from core client for 30 sec - exiting 13:22:10 (5232): No heartbeat from core client for 30 sec - exiting 13:22:11 (5232): No heartbeat from core client for 30 sec - exiting 13:22:13 (5232): No heartbeat from core client for 30 sec - exiting 13:22:14 (5232): No heartbeat from core client for 30 sec - exiting 13:22:15 (5232): No heartbeat from core client for 30 sec - exiting 13:23:20 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:14 (4564):SiNo heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:24 (4564): No heartbeat from core client for 30 sec - exiting 13:25:25 (4564): No heartbeat from core client for 30 sec - exiting 13:25:26 (4564): No heartbeat from core client for 30 sec - exiting 13:25:27 (4564): No heartbeat from core client for 30 sec - exiting 13:25:28 (4564): No heartbeat from core client for 30 sec - exiting 13:25:29 (4564): No heartbeat from core client for 30 sec - exiting 13:25:31 (4564): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4172, iMonCtr=1 Model crash detected, will try to restart... 13:26:47 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:48 (4172): No heartbeat from core client for 30 sec - exiting 13:26:49 (4172): No heartbeat from core client for 30 sec - exiting 13:26:50 (4172): No heartbeat from core client for 30 sec - exiting 13:26:51 (4172): No heartbeat from core client for 30 sec - exiting 13:26:52 (4172): No heartbeat from core client for 30 sec - exiting 13:26:53 (4172): No heartbeat from core client for 30 sec - exiting 13:26:54 (4172): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... 13:28:02 (1228): No heartbeat from core client for 30 sec - exiting 13:28:03 (1228): No heartbeat from core client for 30 sec - exiting 13:28:04 (1228): No heartbeat from core client for 30 sec - exiting 13:28:05 (1228): No heartbeat from core client for 30 sec - exiting 13:28:06 (1228): No heartbeat from core client for 30 sec - exiting 13:28:07 (1228): No heartbeat from core client for 30 sec - exiting 13:28:08 (1228): No heartbeat from core client for 30 sec - exiting 13:28:10 (1228): No heartbeat from core client for 30 sec - exiting 13:28:11 (1228): No heartbeat from core client for 30 sec - exiting 13:28:12 (1228): No heartbeat from core client for 30 sec - exiting 13:28:13 (1228): No heartbeat from core client for 30 sec - exiting 13:28:14 (1228): No heartbeat from core client for 30 sec - exiting 13:28:15 (1228): No heartbeat from core client for 30 sec - exiting 13:28:16 (1228): No heartbeat from core client for 30 sec - exiting 13:28:17 (1228): No heartbeat from core client for 30 sec - exiting 13:28:18 (1228): No heartbeat from core client for 30 sec - exiting 13:28:19 (1228): No heartbeat from core client for 30 sec - exiting 13:28:20 (1228): No heartbeat from core client for 30 sec - exiting 13:28:22 (1228): No heartbeat from core client for 30 sec - exiting 13:28:23 (1228): No heartbeat from core client for 30 sec - exiting 13:28:24 (1228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:25 (1228): No heartbeat from core client for 30 sec - exiting 13:28:26 (1228): No heartbeat from core client for 30 sec - exiting 13:28:27 (1228): No heartbeat from core client for 30 sec - exiting 13:28:28 (1228): No heartbeat from core client for 30 sec - exiting 13:28:29 (1228): No heartbeat from core client for 30 sec - exiting 13:28:30 (1228): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3592, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3592, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish 13:30:47 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2440, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2440, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Nov 2011 22:57:05	1122757	13644848	hadcm3n_t32g_1980_40_007451239_3	25,920	80,084	3.0897