Task 13097453

Name	hadcm3n_yar3_1900_40_007346793_1
Workunit	7544223
Created	6 Jul 2011, 13:40:02 UTC
Sent	19 Jul 2011, 11:35:40 UTC
Report deadline	18 Oct 2011, 19:02:51 UTC
Received	28 Sep 2011, 17:13:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	835467
Run time	9 days 3 hours 16 min 33 sec
CPU time	7 days 9 hours 44 min 18 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	3.02 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:22:45 (2548): No heartbeat from core client for 30 sec - exiting 09:22:46 (2548): No heartbeat from core client for 30 sec - exiting 09:22:47 (2548): No heartbeat from core client for 30 sec - exiting 09:22:48 (2548): No heartbeat from core client for 30 sec - exiting 09:22:49 (2548): No heartbeat from core client for 30 sec - exiting 09:22:50 (2548): No heartbeat from core client for 30 sec - exiting 09:22:51 (2548): No heartbeat from core client for 30 sec - exiting 09:22:52 (2548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:57:12 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:57:13 (3348): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:53:12 (1340): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:35:20 (1672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:58:39 (2500): No heartbeat from core client for 30 sec - exiting 07:58:40 (2500): No heartbeat from core client for 30 sec - exiting 07:58:41 (2500): No heartbeat from core client for 30 sec - exiting 07:58:42 (2500): No heartbeat from core client for 30 sec - exiting 07:58:43 (2500): No heartbeat from core client for 30 sec - exiting 07:58:44 (2500): No heartbeat from core client for 30 sec - exiting 07:58:45 (2500): No heartbeat from core client for 30 sec - exiting 07:58:46 (2500): No heartbeat from core client for 30 sec - exiting 07:58:47 (2500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:35:31 (320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:24:31 (1124): No heartbeat from core client for 30 sec - exiting 16:24:32 (1124): No heartbeat from core client for 30 sec - exiting 16:24:33 (1124): No heartbeat from core client for 30 sec - exiting 16:24:34 (1124): No heartbeat from core client for 30 sec - exiting 16:24:35 (1124): No heartbeat from core client for 30 sec - exiting 16:24:36 (1124): No heartbeat from core client for 30 sec - exiting 16:24:37 (1124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:48:02 (3772): No heartbeat from core client for 30 sec - exiting 11:48:03 (3772): No heartbeat from core client for 30 sec - exiting 11:48:04 (3772): No heartbeat from core client for 30 sec - exiting 11:48:05 (3772): No heartbeat from core client for 30 sec - exiting 11:48:06 (3772): No heartbeat from core client for 30 sec - exiting 11:48:07 (3772): No heartbeat from core client for 30 sec - exiting 11:48:08 (3772): No heartbeat from core client for 30 sec - exiting 11:48:09 (3772): No heartbeat from core client for 30 sec - exiting 11:48:10 (3772): No heartbeat from core client for 30 sec - exiting 11:48:11 (3772): No heartbeat from core client for 30 sec - exiting 11:48:12 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:13 (3772): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:50:27 (1040): No heartbeat from core client for 30 sec - exiting 18:50:28 (1040): No heartbeat from core client for 30 sec - exiting 18:50:29 (1040): No heartbeat from core client for 30 sec - exiting 18:50:30 (1040): No heartbeat from core client for 30 sec - exiting 18:50:31 (1040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:32:25 (4052): No heartbeat from core client for 30 sec - exiting 17:32:26 (4052): No heartbeat from core client for 30 sec - exiting 17:32:27 (4052): No heartbeat from core client for 30 sec - exiting 17:32:28 (4052): No heartbeat from core client for 30 sec - exiting 17:32:29 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:11:53 (2572): No heartbeat from core client for 30 sec - exiting 18:11:54 (2572): No heartbeat from core client for 30 sec - exiting 18:11:55 (2572): No heartbeat from core client for 30 sec - exiting 18:11:56 (2572): No heartbeat from core client for 30 sec - exiting 18:11:57 (2572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:16:44 (1996): No heartbeat from core client for 30 sec - exiting 20:16:45 (1996): No heartbeat from core client for 30 sec - exiting 20:16:46 (1996): No heartbeat from core client for 30 sec - exiting 20:16:47 (1996): No heartbeat from core client for 30 sec - exiting 20:16:48 (1996): No heartbeat from core client for 30 sec - exiting 20:16:49 (1996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:17:56 (2372): No heartbeat from core client for 30 sec - exiting 08:17:57 (2372): No heartbeat from core client for 30 sec - exiting 08:17:58 (2372): No heartbeat from core client for 30 sec - exiting 08:17:59 (2372): No heartbeat from core client for 30 sec - exiting 08:18:00 (2372): No heartbeat from core client for 30 sec - exiting 08:18:01 (2372): No heartbeat from core client for 30 sec - exiting 08:18:02 (2372): No heartbeat from core client for 30 sec - exiting 08:18:03 (2372): No heartbeat from core client for 30 sec - exiting 08:18:04 (2372): No heartbeat from core client for 30 sec - exiting 08:18:05 (2372): No heartbeat from core client for 30 sec - exiting 08:18:06 (2372): No heartbeat from core client for 30 sec - exiting 08:18:07 (2372): No heartbeat from core client for 30 sec - exiting 08:18:08 (2372): No heartbeat from core client for 30 sec - exiting 08:18:09 (2372): No heartbeat from core client for 30 sec - exiting 08:18:10 (2372): No heartbeat from core client for 30 sec - exiting 08:18:11 (2372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:59:35 (1396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:54 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:52:10 (2500): No heartbeat from core client for 30 sec - exiting 17:52:11 (2500): No heartbeat from core client for 30 sec - exiting 17:52:12 (2500): No heartbeat from core client for 30 sec - exiting 17:52:13 (2500): No heartbeat from core client for 30 sec - exiting 17:52:14 (2500): No heartbeat from core client for 30 sec - exiting 17:52:15 (2500): No heartbeat from core client for 30 sec - exiting 17:52:16 (2500): No heartbeat from core client for 30 sec - exiting 17:52:17 (2500): No heartbeat from core client for 30 sec - exiting 17:52:18 (2500): No heartbeat from core client for 30 sec - exiting 17:52:19 (2500): No heartbeat from core client for 30 sec - exiting 17:52:20 (2500): No heartbeat from core client for 30 sec - exiting 17:52:21 (2500): No heartbeat from core client for 30 sec - exiting 17:52:22 (2500): No heartbeat from core client for 30 sec - exiting 17:52:23 (2500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:08:42 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:10:50 (3748): No heartbeat from core client for 30 sec - exiting 17:10:51 (3748): No heartbeat from core client for 30 sec - exiting 17:10:52 (3748): No heartbeat from core client for 30 sec - exiting 17:10:53 (3748): No heartbeat from core client for 30 sec - exiting 17:10:54 (3748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:27:41 (3084): No heartbeat from core client for 30 sec - exiting 07:27:42 (3084): No heartbeat from core client for 30 sec - exiting 07:27:43 (3084): No heartbeat from core client for 30 sec - exiting 07:27:44 (3084): No heartbeat from core client for 30 sec - exiting 07:27:45 (3084): No heartbeat from core client for 30 sec - exiting 07:27:46 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:15:29 (2452): No heartbeat from core client for 30 sec - exiting 08:15:30 (2452): No heartbeat from core client for 30 sec - exiting 08:15:31 (2452): No heartbeat from core client for 30 sec - exiting 08:15:32 (2452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:36:07 (352): No heartbeat from core client for 30 sec - exiting 22:36:08 (352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:19:45 (1720): No heartbeat from core client for 30 sec - exiting 16:19:46 (1720): No heartbeat from core client for 30 sec - exiting 16:19:47 (1720): No heartbeat from core client for 30 sec - exiting 16:19:48 (1720): No heartbeat from core client for 30 sec - exiting 16:19:49 (1720): No heartbeat from core client for 30 sec - exiting 16:19:50 (1720): No heartbeat from core client for 30 sec - exiting 16:19:51 (1720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:21:15 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:40:04 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:18:34 (1772): No heartbeat from core client for 30 sec - exiting 08:18:35 (1772): No heartbeat from core client for 30 sec - exiting 08:18:36 (1772): No heartbeat from core client for 30 sec - exiting 08:18:37 (1772): No heartbeat from core client for 30 sec - exiting 08:18:38 (1772): No heartbeat from core client for 30 sec - exiting 08:18:39 (1772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:41:53 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:22:03 (2712): No heartbeat from core client for 30 sec - exiting 08:22:04 (2712): No heartbeat from core client for 30 sec - exiting 08:22:05 (2712): No heartbeat from core client for 30 sec - exiting 08:22:06 (2712): No heartbeat from core client for 30 sec - exiting 08:22:07 (2712): No heartbeat from core client for 30 sec - exiting 08:22:08 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=748, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Sep 2011 08:51:29	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	466,560	616,192	1.3207
05 Sep 2011 18:19:23	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	440,640	581,878	1.3205
02 Sep 2011 19:18:42	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	414,720	547,601	1.3204
31 Aug 2011 21:19:40	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	388,800	512,785	1.3189
27 Aug 2011 12:37:54	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	362,880	478,198	1.3178
21 Aug 2011 19:46:28	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	336,960	443,669	1.3167
20 Aug 2011 08:48:10	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	311,040	409,509	1.3166
16 Aug 2011 20:57:32	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	285,120	375,258	1.3161
14 Aug 2011 11:55:47	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	259,200	341,402	1.3171
09 Aug 2011 19:25:54	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	233,280	306,765	1.3150
07 Aug 2011 16:50:21	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	207,360	272,538	1.3143
04 Aug 2011 15:30:42	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	181,440	238,180	1.3127
30 Jul 2011 19:59:24	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	155,520	203,388	1.3078
29 Jul 2011 17:53:56	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	129,600	168,740	1.3020
26 Jul 2011 19:46:47	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	103,680	134,170	1.2941
25 Jul 2011 22:13:54	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	77,760	100,544	1.2930
25 Jul 2011 21:02:06	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	51,840	65,697	1.2673
25 Jul 2011 18:16:56	835467	13097453	hadcm3n_yar3_1900_40_007346793_1	25,920	32,893	1.2690