Task 12530608

Name	hadam3p_saf_2cht_1969_1_007145876_0
Workunit	7330656
Created	26 Jan 2011, 20:43:22 UTC
Sent	5 Feb 2011, 12:36:00 UTC
Report deadline	18 Jan 2012, 17:56:00 UTC
Received	23 Feb 2011, 15:03:11 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1113343
Run time	9 days 6 hours 59 min 59 sec
CPU time	6 days 1 hours 17 min 43 sec
Validate state	Workunit error - check skipped
Credit	2,244.09
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2892, selfPID=3488, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... 16:13:09 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5884, iMonCtr=2 Model crash detected, will try to restart... 16:25:54 (6544): No heartbeat from core client for 30 sec - exiting 16:25:56 (6544): No heartbeat from core client for 30 sec - exiting 16:25:57 (6544): No heartbeat from core client for 30 sec - exiting 16:25:58 (6544): No heartbeat from core client for 30 sec - exiting 16:25:59 (6544): No heartbeat from core client for 30 sec - exiting 16:26:00 (6544): No heartbeat from core client for 30 sec - exiting 16:26:01 (6544): No heartbeat from core client for 30 sec - exiting 16:26:02 (6544): No heartbeat from core client for 30 sec - exiting 16:26:03 (6544): No heartbeat from core client for 30 sec - exiting 16:26:04 (6544): No heartbeat from core client for 30 sec - exiting 16:26:05 (6544): No heartbeat from core client for 30 sec - exiting 16:26:07 (6544): No heartbeat from core client for 30 sec - exiting 16:26:08 (6544): No heartbeat from core client for 30 sec - exiting 16:26:09 (6544): No heartbeat from core client for 30 sec - exiting 16:26:10 (6544): No heartbeat from core client for 30 sec - exiting 16:26:11 (6544): No heartbeat from core client for 30 sec - exiting 16:26:12 (6544): No heartbeat from core client for 30 sec - exiting 16:26:13 (6544): No heartbeat from core client for 30 sec - exiting 16:26:14 (6544): No heartbeat from core client for 30 sec - exiting 16:26:15 (6544): No heartbeat from core client for 30 sec - exiting 16:26:16 (6544): No heartbeat from core client for 30 sec - exiting 16:26:17 (6544): No heartbeat from core client for 30 sec - exiting 16:26:19 (6544): No heartbeat from core client for 30 sec - exiting 16:26:20 (6544): No heartbeat from core client for 30 sec - exiting 16:26:21 (6544): No heartbeat from core client for 30 sec - exiting 16:26:22 (6544): No heartbeat from core client for 30 sec - exiting 16:26:23 (6544): No heartbeat from core client for 30 sec - exiting 16:26:24 (6544): No heartbeat from core client for 30 sec - exiting 16:26:25 (6544): No heartbeat from core client for 30 sec - exiting 16:26:26 (6544): No heartbeat from core client for 30 sec - exiting 16:26:27 (6544): No heartbeat from core client for 30 sec - exiting 16:26:28 (6544): No heartbeat from core client for 30 sec - exiting 16:26:29 (6544): No heartbeat from core client for 30 sec - exiting 16:26:30 (6544): No heartbeat from core client for 30 sec - exiting 16:26:31 (6544): No heartbeat from core client for 30 sec - exiting 16:26:32 (6544): No heartbeat from core client for 30 sec - exiting 16:26:33 (6544): No heartbeat from core client for 30 sec - exiting 16:26:34 (6544): No heartbeat from core client for 30 sec - exiting 16:26:35 (6544): No heartbeat from core client for 30 sec - exiting 16:26:36 (6544): No heartbeat from core client for 30 sec - exiting 16:26:37 (6544): No heartbeat from core client for 30 sec - exiting 16:26:38 (6544): No heartbeat from core client for 30 sec - exiting 16:26:39 (6544): No heartbeat from core client for 30 sec - exiting 16:26:40 (6544): No heartbeat from core client for 30 sec - exiting 16:26:41 (6544): No heartbeat from core client for 30 sec - exiting 16:26:42 (6544): No heartbeat from core client for 30 sec - exiting 16:26:43 (6544): No heartbeat from core client for 30 sec - exiting 16:26:44 (6544): No heartbeat from core client for 30 sec - exiting 16:26:45 (6544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6844, selfPID=6700, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... 20:29:09 (3640): No heartbeat from core client for 30 sec - exiting 20:29:10 (3640): No heartbeat from core client for 30 sec - exiting 20:29:11 (3640): No heartbeat from core client for 30 sec - exiting 20:29:12 (3640): No heartbeat from core client for 30 sec - exiting 20:29:13 (3640): No heartbeat from core client for 30 sec - exiting 20:29:14 (3640): No heartbeat from core client for 30 sec - exiting 20:29:15 (3640): No heartbeat from core client for 30 sec - exiting 20:29:16 (3640): No heartbeat from core client for 30 sec - exiting 20:29:17 (3640): No heartbeat from core client for 30 sec - exiting 20:29:18 (3640): No heartbeat from core client for 30 sec - exiting 20:29:19 (3640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:20 (3640): No heartbeat from core client for 30 sec - exiting 20:29:21 (3640): No heartbeat from core client for 30 sec - exiting 20:29:22 (3640): No heartbeat from core client for 30 sec - exiting 20:29:23 (3640): No heartbeat from core client for 30 sec - exiting 20:29:24 (3640): No heartbeat from core client for 30 sec - exiting 20:29:25 (3640): No heartbeat from core client for 30 sec - exiting 20:29:26 (3640): No heartbeat from core client for 30 sec - exiting 20:29:27 (3640): No heartbeat from core client for 30 sec - exiting 20:29:28 (3640): No heartbeat from core client for 30 sec - exiting 20:29:29 (3640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1908, selfPID=1908, iMonCtr=2 10:29:10 (7488): No heartbeat from core client for 30 sec - exiting 10:29:11 (7488): No heartbeat from core client for 30 sec - exiting 10:29:12 (7488): No heartbeat from core client for 30 sec - exiting 10:29:13 (7488): No heartbeat from core client for 30 sec - exiting 10:29:14 (7488): No heartbeat from core client for 30 sec - exiting 10:29:15 (7488): No heartbeat from core client for 30 sec - exiting 10:29:16 (7488): No heartbeat from core client for 30 sec - exiting 10:29:17 (7488): No heartbeat from core client for 30 sec - exiting 10:29:18 (7488): No heartbeat from core client for 30 sec - exiting 10:29:19 (7488): No heartbeat from core client for 30 sec - exiting 10:29:20 (7488): No heartbeat from core client for 30 sec - exiting 10:29:21 (7488): No heartbeat from core client for 30 sec - exiting 10:29:22 (7488): No heartbeat from core client for 30 sec - exiting 10:29:23 (7488): No heartbeat from core client for 30 sec - exiting 10:29:24 (7488): No heartbeat from core client for 30 sec - exiting 10:29:25 (7488): No heartbeat from core client for 30 sec - exiting 10:29:26 (7488): No heartbeat from core client for 30 sec - exiting 10:29:27 (7488): No heartbeat from core client for 30 sec - exiting 10:29:28 (7488): No heartbeat from core client for 30 sec - exiting 10:29:29 (7488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:30 (7488): No heartbeat from core client for 30 sec - exiting 10:29:31 (7488): No heartbeat from core client for 30 sec - exiting 10:29:32 (7488): No heartbeat from core client for 30 sec - exiting 10:29:33 (7488): No heartbeat from core client for 30 sec - exiting 10:29:34 (7488): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6152, selfPID=5780, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5912, selfPID=5912, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8108, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6316, selfPID=1220, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7024, selfPID=7808, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5204, selfPID=3556, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 16:16:47 (6580): No heartbeat from core client for 30 sec - exiting 16:16:48 (6580): No heartbeat from core client for 30 sec - exiting 16:16:49 (6580): No heartbeat from core client for 30 sec - exiting 16:16:50 (6580): No heartbeat from core client for 30 sec - exiting 16:16:51 (6580): No heartbeat from core client for 30 sec - exiting 16:16:52 (6580): No heartbeat from core client for 30 sec - exiting 16:16:53 (6580): No heartbeat from core client for 30 sec - exiting 16:16:54 (6580): No heartbeat from core client for 30 sec - exiting 16:16:56 (6580): No heartbeat from core client for 30 sec - exiting 16:16:57 (6580): No heartbeat from core client for 30 sec - exiting 16:16:58 (6580): No heartbeat from core client for 30 sec - exiting 16:16:59 (6580): No heartbeat from core client for 30 sec - exiting 16:17:00 (6580): No heartbeat from core client for 30 sec - exiting 16:17:01 (6580): No heartbeat from core client for 30 sec - exiting 16:17:02 (6580): No heartbeat from core client for 30 sec - exiting 16:17:03 (6580): No heartbeat from core client for 30 sec - exiting 16:17:04 (6580): No heartbeat from core client for 30 sec - exiting 16:17:05 (6580): No heartbeat from core client for 30 sec - exiting 16:17:06 (6580): No heartbeat from core client for 30 sec - exiting 16:17:08 (6580): No heartbeat from core client for 30 sec - exiting 16:17:09 (6580): No heartbeat from core client for 30 sec - exiting 16:17:10 (6580): No heartbeat from core client for 30 sec - exiting 16:17:11 (6580): No heartbeat from core client for 30 sec - exiting 16:17:12 (6580): No heartbeat from core client for 30 sec - exiting 16:17:13 (6580): No heartbeat from core client for 30 sec - exiting 16:17:14 (6580): No heartbeat from core client for 30 sec - exiting 16:17:15 (6580): No heartbeat from core client for 30 sec - exiting 16:17:16 (6580): No heartbeat from core client for 30 sec - exiting 16:17:17 (6580): No heartbeat from core client for 30 sec - exiting 16:17:18 (6580): No heartbeat from core client for 30 sec - exiting 16:17:20 (6580): No heartbeat from core client for 30 sec - exiting 16:17:21 (6580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:53:03 (4988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2508, selfPID=2508, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9076, iMonCtr=2 Model crash detected, will try to restart... 19:54:06 (4248): No heartbeat from core client for 30 sec - exiting 19:54:08 (4248): No heartbeat from core client for 30 sec - exiting 19:54:09 (4248): No heartbeat from core client for 30 sec - exiting 19:54:10 (4248): No heartbeat from core client for 30 sec - exiting 19:54:11 (4248): No heartbeat from core client for 30 sec - exiting 19:54:12 (4248): No heartbeat from core client for 30 sec - exiting 19:54:13 (4248): No heartbeat from core client for 30 sec - exiting 19:54:14 (4248): No heartbeat from core client for 30 sec - exiting 19:54:15 (4248): No heartbeat from core client for 30 sec - exiting 19:54:16 (4248): No heartbeat from core client for 30 sec - exiting 19:54:17 (4248): No heartbeat from core client for 30 sec - exiting 19:54:18 (4248): No heartbeat from core client for 30 sec - exiting 19:54:20 (4248): No heartbeat from core client for 30 sec - exiting 19:54:21 (4248): No heartbeat from core client for 30 sec - exiting 19:54:22 (4248): No heartbeat from core client for 30 sec - exiting 19:54:23 (4248): No heartbeat from core client for 30 sec - exiting 19:54:24 (4248): No heartbeat from core client for 30 sec - exiting 19:54:25 (4248): No heartbeat from core client for 30 sec - exiting 19:54:26 (4248): No heartbeat from core client for 30 sec - exiting 19:54:27 (4248): No heartbeat from core client for 30 sec - exiting 19:54:28 (4248): No heartbeat from core client for 30 sec - exiting 19:54:29 (4248): No heartbeat from core client for 30 sec - exiting 19:54:30 (4248): No heartbeat from core client for 30 sec - exiting 19:54:32 (4248): No heartbeat from core client for 30 sec - exiting 19:54:33 (4248): No heartbeat from core client for 30 sec - exiting 19:54:34 (4248): No heartbeat from core client for 30 sec - exiting 19:54:35 (4248): No heartbeat from core client for 30 sec - exiting 19:54:36 (4248): No heartbeat from core client for 30 sec - exiting 19:54:37 (4248): No heartbeat from core client for 30 sec - exiting 19:54:38 (4248): No heartbeat from core client for 30 sec - exiting 19:54:39 (4248): No heartbeat from core client for 30 sec - exiting 19:54:40 (4248): No heartbeat from core client for 30 sec - exiting 19:54:41 (4248): No heartbeat from core client for 30 sec - exiting 19:54:43 (4248): No heartbeat from core client for 30 sec - exiting 19:54:44 (4248): No heartbeat from core client for 30 sec - exiting 19:54:45 (4248): No heartbeat from core client for 30 sec - exiting 19:54:46 (4248): No heartbeat from core client for 30 sec - exiting 19:54:47 (4248): No heartbeat from core client for 30 sec - exiting 19:54:48 (4248): No heartbeat from core client for 30 sec - exiting 19:54:49 (4248): No heartbeat from core client for 30 sec - exiting 19:54:50 (4248): No heartbeat from core client for 30 sec - exiting 19:54:51 (4248): No heartbeat from core client for 30 sec - exiting 19:54:52 (4248): No heartbeat from core client for 30 sec - exiting 19:54:53 (4248): No heartbeat from core client for 30 sec - exiting 19:54:55 (4248): No heartbeat from core client for 30 sec - exiting 19:54:56 (4248): No heartbeat from core client for 30 sec - exiting 19:54:57 (4248): No heartbeat from core client for 30 sec - exiting 19:54:58 (4248): No heartbeat from core client for 30 sec - exiting 19:54:59 (4248): No heartbeat from core client for 30 sec - exiting 19:55:00 (4248): No heartbeat from core client for 30 sec - exiting 19:55:01 (4248): No heartbeat from core client for 30 sec - exiting 19:55:02 (4248): No heartbeat from core client for 30 sec - exiting 19:55:03 (4248): No heartbeat from core client for 30 sec - exiting 19:55:04 (4248): No heartbeat from core client for 30 sec - exiting 19:55:05 (4248): No heartbeat from core client for 30 sec - exiting 19:55:07 (4248): No heartbeat from core client for 30 sec - exiting 19:55:08 (4248): No heartbeat from core client for 30 sec - exiting 19:55:09 (4248): No heartbeat from core client for 30 sec - exiting 19:55:10 (4248): No heartbeat from core client for 30 sec - exiting 19:55:11 (4248): No heartbeat from core client for 30 sec - exiting 19:55:12 (4248): No heartbeat from core client for 30 sec - exiting 19:55:13 (4248): No heartbeat from core client for 30 sec - exiting 19:55:14 (4248): No heartbeat from core client for 30 sec - exiting 19:55:15 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:53:51 (5948): No heartbeat from core client for 30 sec - exiting 00:53:53 (5948): No heartbeat from core client for 30 sec - exiting 00:53:54 (5948): No heartbeat from core client for 30 sec - exiting 00:53:55 (5948): No heartbeat from core client for 30 sec - exiting 00:53:56 (5948): No heartbeat from core client for 30 sec - exiting 00:53:57 (5948): No heartbeat from core client for 30 sec - exiting 00:53:58 (5948): No heartbeat from core client for 30 sec - exiting 00:53:59 (5948): No heartbeat from core client for 30 sec - exiting 00:54:00 (5948): No heartbeat from core client for 30 sec - exiting 00:54:01 (5948): No heartbeat from core client for 30 sec - exiting 00:54:02 (5948): No heartbeat from core client for 30 sec - exiting 00:54:03 (5948): No heartbeat from core client for 30 sec - exiting 00:54:05 (5948): No heartbeat from core client for 30 sec - exiting 00:54:06 (5948): No heartbeat from core client for 30 sec - exiting 00:54:07 (5948): No heartbeat from core client for 30 sec - exiting 00:54:08 (5948): No heartbeat from core client for 30 sec - exiting 00:54:09 (5948): No heartbeat from core client for 30 sec - exiting 00:54:10 (5948): No heartbeat from core client for 30 sec - exiting 00:54:11 (5948): No heartbeat from core client for 30 sec - exiting 00:54:12 (5948): No heartbeat from core client for 30 sec - exiting 00:54:13 (5948): No heartbeat from core client for 30 sec - exiting 00:54:14 (5948): No heartbeat from core client for 30 sec - exiting 00:54:15 (5948): No heartbeat from core client for 30 sec - exiting 00:54:16 (5948): No heartbeat from core client for 30 sec - exiting 00:54:17 (5948): No heartbeat from core client for 30 sec - exiting 00:54:18 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5076, selfPID=5076, iMonCtr=2 20:37:38 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:06:33 (2280): No heartbeat from core client for 30 sec - exiting 01:06:34 (2280): No heartbeat from core client for 30 sec - exiting 01:06:35 (2280): No heartbeat from core client for 30 sec - exiting 01:06:36 (2280): No heartbeat from core client for 30 sec - exiting 01:06:37 (2280): No heartbeat from core client for 30 sec - exiting 01:06:38 (2280): No heartbeat from core client for 30 sec - exiting 01:06:39 (2280): No heartbeat from core client for 30 sec - exiting 01:06:41 (2280): No heartbeat from core client for 30 sec - exiting 01:06:42 (2280): No heartbeat from core client for 30 sec - exiting 01:06:43 (2280): No heartbeat from core client for 30 sec - exiting 01:06:44 (2280): No heartbeat from core client for 30 sec - exiting 01:06:45 (2280): No heartbeat from core client for 30 sec - exiting 01:06:46 (2280): No heartbeat from core client for 30 sec - exiting 01:06:47 (2280): No heartbeat from core client for 30 sec - exiting 01:06:48 (2280): No heartbeat from core client for 30 sec - exiting 01:06:49 (2280): No heartbeat from core client for 30 sec - exiting 01:06:50 (2280): No heartbeat from core client for 30 sec - exiting 01:06:52 (2280): No heartbeat from core client for 30 sec - exiting 01:06:53 (2280): No heartbeat from core client for 30 sec - exiting 01:06:54 (2280): No heartbeat from core client for 30 sec - exiting 01:06:55 (2280): No heartbeat from core client for 30 sec - exiting 01:06:56 (2280): No heartbeat from core client for 30 sec - exiting 01:06:57 (2280): No heartbeat from core client for 30 sec - exiting 01:06:58 (2280): No heartbeat from core client for 30 sec - exiting 01:06:59 (2280): No heartbeat from core client for 30 sec - exiting 01:07:00 (2280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:01 (2280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... 00:26:46 (5812): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Feb 2011 00:11:30	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	138,336	522,244	3.7752
22 Feb 2011 03:31:39	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	126,816	477,964	3.7690
21 Feb 2011 18:50:58	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	115,296	434,584	3.7693
20 Feb 2011 09:55:52	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	103,776	390,160	3.7596
19 Feb 2011 20:37:06	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	92,256	342,995	3.7179
14 Feb 2011 15:32:42	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	80,736	301,551	3.7350
13 Feb 2011 21:36:19	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	69,216	260,180	3.7590
11 Feb 2011 14:30:08	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	57,696	218,392	3.7852
10 Feb 2011 19:58:05	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	46,176	174,916	3.7880
08 Feb 2011 03:45:42	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	34,656	130,120	3.7546
07 Feb 2011 00:29:21	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	23,148	83,726	3.6170
06 Feb 2011 23:55:19	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	23,136	82,941	3.5849
06 Feb 2011 05:46:21	1113343	12530608	hadam3p_saf_2cht_1969_1_007145876_0	11,616	40,217	3.4622