Task 12733705

Name	hadcm3n_o0px_1900_40_007196264_1
Workunit	7394544
Created	28 Mar 2011, 13:57:52 UTC
Sent	2 Apr 2011, 19:34:22 UTC
Report deadline	3 Jul 2011, 3:01:33 UTC
Received	11 May 2011, 16:03:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	977046
Run time	15 days 19 hours 4 min 4 sec
CPU time	11 days 21 hours 27 min
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	2.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.6.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:10:55 (7064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:39:12 (7920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:39:13 (7920): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:15:12 (5256): No heartbeat from core client for 30 sec - exiting 19:15:13 (5256): No heartbeat from core client for 30 sec - exiting 19:15:14 (5256): No heartbeat from core client for 30 sec - exiting 19:15:15 (5256): No heartbeat from core client for 30 sec - exiting 19:15:16 (5256): No heartbeat from core client for 30 sec - exiting 19:15:17 (5256): No heartbeat from core client for 30 sec - exiting 19:15:18 (5256): No heartbeat from core client for 30 sec - exiting 19:15:20 (5256): No heartbeat from core client for 30 sec - exiting 19:15:21 (5256): No heartbeat from core client for 30 sec - exiting 19:15:22 (5256): No heartbeat from core client for 30 sec - exiting 19:15:23 (5256): No heartbeat from core client for 30 sec - exiting 19:15:24 (5256): No heartbeat from core client for 30 sec - exiting 19:15:25 (5256): No heartbeat from core client for 30 sec - exiting 19:15:26 (5256): No heartbeat from core client for 30 sec - exiting 19:15:28 (5256): No heartbeat from core client for 30 sec - exiting 19:15:29 (5256): No heartbeat from core client for 30 sec - exiting 19:15:30 (5256): No heartbeat from core client for 30 sec - exiting 19:15:31 (5256): No heartbeat from core client for 30 sec - exiting 19:15:32 (5256): No heartbeat from core client for 30 sec - exiting 19:15:33 (5256): No heartbeat from core client for 30 sec - exiting 19:15:34 (5256): No heartbeat from core client for 30 sec - exiting 19:15:35 (5256): No heartbeat from core client for 30 sec - exiting 19:15:36 (5256): No heartbeat from core client for 30 sec - exiting 19:15:37 (5256): No heartbeat from core client for 30 sec - exiting 19:15:38 (5256): No heartbeat from core client for 30 sec - exiting 19:15:39 (5256): No heartbeat from core client for 30 sec - exiting 19:15:41 (5256): No heartbeat from core client for 30 sec - exiting 19:15:42 (5256): No heartbeat from core client for 30 sec - exiting 19:15:43 (5256): No heartbeat from core client for 30 sec - exiting 19:15:44 (5256): No heartbeat from core client for 30 sec - exiting 19:15:45 (5256): No heartbeat from core client for 30 sec - exiting 19:15:46 (5256): No heartbeat from core client for 30 sec - exiting 19:15:47 (5256): No heartbeat from core client for 30 sec - exiting 19:15:48 (5256): No heartbeat from core client for 30 sec - exiting 19:15:49 (5256): No heartbeat from core client for 30 sec - exiting 19:15:50 (5256): No heartbeat from core client for 30 sec - exiting 19:15:51 (5256): No heartbeat from core client for 30 sec - exiting 19:15:53 (5256): No heartbeat from core client for 30 sec - exiting 19:15:54 (5256): No heartbeat from core client for 30 sec - exiting 19:15:55 (5256): No heartbeat from core client for 30 sec - exiting 19:15:56 (5256): No heartbeat from core client for 30 sec - exiting 19:15:57 (5256): No heartbeat from core client for 30 sec - exiting 19:15:58 (5256): No heartbeat from core client for 30 sec - exiting 19:15:59 (5256): No heartbeat from core client for 30 sec - exiting 19:16:00 (5256): No heartbeat from core client for 30 sec - exiting 19:16:01 (5256): No heartbeat from core client for 30 sec - exiting 19:16:02 (5256): No heartbeat from core client for 30 sec - exiting 19:16:03 (5256): No heartbeat from core client for 30 sec - exiting 19:16:05 (5256): No heartbeat from core client for 30 sec - exiting 19:16:06 (5256): No heartbeat from core client for 30 sec - exiting 19:16:07 (5256): No heartbeat from core client for 30 sec - exiting 19:16:08 (5256): No heartbeat from core client for 30 sec - exiting 19:16:09 (5256): No heartbeat from core client for 30 sec - exiting 19:16:10 (5256): No heartbeat from core client for 30 sec - exiting 19:16:11 (5256): No heartbeat from core client for 30 sec - exiting 19:16:12 (5256): No heartbeat from core client for 30 sec - exiting 19:16:13 (5256): No heartbeat from core client for 30 sec - exiting 19:16:14 (5256): No heartbeat from core client for 30 sec - exiting 19:16:15 (5256): No heartbeat from core client for 30 sec - exiting 19:16:16 (5256): No heartbeat from core client for 30 sec - exiting 19:16:18 (5256): No heartbeat from core client for 30 sec - exiting 19:16:19 (5256): No heartbeat from core client for 30 sec - exiting 19:16:20 (5256): No heartbeat from core client for 30 sec - exiting 19:16:21 (5256): No heartbeat from core client for 30 sec - exiting 19:16:22 (5256): No heartbeat from core client for 30 sec - exiting 19:16:23 (5256): No heartbeat from core client for 30 sec - exiting 19:16:24 (5256): No heartbeat from core client for 30 sec - exiting 19:16:25 (5256): No heartbeat from core client for 30 sec - exiting 19:16:26 (5256): No heartbeat from core client for 30 sec - exiting 19:16:27 (5256): No heartbeat from core client for 30 sec - exiting 19:16:28 (5256): No heartbeat from core client for 30 sec - exiting 19:16:30 (5256): No heartbeat from core client for 30 sec - exiting 19:16:31 (5256): No heartbeat from core client for 30 sec - exiting 19:16:32 (5256): No heartbeat from core client for 30 sec - exiting 19:16:33 (5256): No heartbeat from core client for 30 sec - exiting 19:16:34 (5256): No heartbeat from core client for 30 sec - exiting 19:16:35 (5256): No heartbeat from core client for 30 sec - exiting 19:16:36 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:37 (5256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6020, iMonCtr=1 Model crash detected, will try to restart... 08:43:20 (5812): No heartbeat from core client for 30 sec - exiting 08:43:21 (5812): No heartbeat from core client for 30 sec - exiting 08:43:22 (5812): No heartbeat from core client for 30 sec - exiting 08:43:23 (5812): No heartbeat from core client for 30 sec - exiting 08:43:24 (5812): No heartbeat from core client for 30 sec - exiting 08:43:26 (5812): No heartbeat from core client for 30 sec - exiting 08:43:27 (5812): No heartbeat from core client for 30 sec - exiting 08:43:28 (5812): No heartbeat from core client for 30 sec - exiting 08:43:29 (5812): No heartbeat from core client for 30 sec - exiting 08:43:30 (5812): No heartbeat from core client for 30 sec - exiting 08:43:31 (5812): No heartbeat from core client for 30 sec - exiting 08:43:32 (5812): No heartbeat from core client for 30 sec - exiting 08:43:33 (5812): No heartbeat from core client for 30 sec - exiting 08:43:34 (5812): No heartbeat from core client for 30 sec - exiting 08:43:35 (5812): No heartbeat from core client for 30 sec - exiting 08:43:36 (5812): No heartbeat from core client for 30 sec - exiting 08:43:37 (5812): No heartbeat from core client for 30 sec - exiting 08:43:38 (5812): No heartbeat from core client for 30 sec - exiting 08:43:39 (5812): No heartbeat from core client for 30 sec - exiting 08:43:40 (5812): No heartbeat from core client for 30 sec - exiting 08:43:41 (5812): No heartbeat from core client for 30 sec - exiting 08:43:42 (5812): No heartbeat from core client for 30 sec - exiting 08:43:43 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:44 (5812): No heartbeat from core client for 30 sec - exiting 08:43:45 (5812): No heartbeat from core client for 30 sec - exiting 08:43:46 (5812): No heartbeat from core client for 30 sec - exiting 08:44:28 (2504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4592, iMonCtr=1 Model crash detected, will try to restart... 19:35:08 (5132): No heartbeat from core client for 30 sec - exiting 19:35:09 (5132): No heartbeat from core client for 30 sec - exiting 19:35:10 (5132): No heartbeat from core client for 30 sec - exiting 19:35:11 (5132): No heartbeat from core client for 30 sec - exiting 19:35:12 (5132): No heartbeat from core client for 30 sec - exiting 19:35:14 (5132): No heartbeat from core client for 30 sec - exiting 19:35:15 (5132): No heartbeat from core client for 30 sec - exiting 19:35:16 (5132): No heartbeat from core client for 30 sec - exiting 19:35:17 (5132): No heartbeat from core client for 30 sec - exiting 19:35:18 (5132): No heartbeat from core client for 30 sec - exiting 19:35:19 (5132): No heartbeat from core client for 30 sec - exiting 19:35:20 (5132): No heartbeat from core client for 30 sec - exiting 19:35:21 (5132): No heartbeat from core client for 30 sec - exiting 19:35:22 (5132): No heartbeat from core client for 30 sec - exiting 19:35:23 (5132): No heartbeat from core client for 30 sec - exiting 19:35:24 (5132): No heartbeat from core client for 30 sec - exiting 19:35:25 (5132): No heartbeat from core client for 30 sec - exiting 19:35:27 (5132): No heartbeat from core client for 30 sec - exiting 19:35:28 (5132): No heartbeat from core client for 30 sec - exiting 19:35:29 (5132): No heartbeat from core client for 30 sec - exiting 19:35:30 (5132): No heartbeat from core client for 30 sec - exiting 19:35:31 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:32 (5132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1748, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 May 2011 23:25:24	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	414,720	977,144	2.3562
03 May 2011 20:36:56	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	388,800	915,980	2.3559
30 Apr 2011 02:32:25	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	362,880	855,592	2.3578
29 Apr 2011 03:55:44	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	336,960	794,647	2.3583
28 Apr 2011 05:11:52	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	311,040	733,615	2.3586
27 Apr 2011 12:06:16	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	285,120	673,111	2.3608
26 Apr 2011 14:01:31	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	259,200	611,991	2.3611
20 Apr 2011 20:12:39	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	233,280	550,730	2.3608
20 Apr 2011 20:12:39	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	207,360	489,827	2.3622
20 Apr 2011 20:11:56	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	181,440	428,896	2.3638
12 Apr 2011 20:30:34	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	155,520	367,202	2.3611
10 Apr 2011 11:55:48	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	129,600	305,840	2.3599
09 Apr 2011 01:33:55	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	103,680	246,944	2.3818
07 Apr 2011 20:53:22	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	77,760	188,919	2.4295
06 Apr 2011 07:00:37	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	51,840	128,118	2.4714
04 Apr 2011 15:35:49	977046	12733705	hadcm3n_o0px_1900_40_007196264_1	25,920	66,652	2.5715