Task 14441026

Name	hadam3p_pnw_bchf_1978_1_007902482_0
Workunit	8057594
Created	17 Apr 2012, 17:02:30 UTC
Sent	13 May 2012, 11:41:42 UTC
Report deadline	25 Apr 2013, 17:01:42 UTC
Received	31 May 2012, 14:44:39 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	992779
Run time	7 days 4 hours 15 min 36 sec
CPU time	5 days 2 hours 0 min 15 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	2.41 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7016, iMonCtr=2 Model crash detected, will try to restart... 15:50:19 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R15:56:41 (6356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:28:04 (6800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7500, selfPID=7500, iMonCtr=2 07:36:19 (1628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13340, selfPID=13284, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6756, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3508, selfPID=6624, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6268, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5384, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:42:30 (920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:30:16 (7964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6344, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6120, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8148, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 07:59:10 (7596): No heartbeat from core client for 30 sec - exiting 07:59:11 (7596): No heartbeat from core client for 30 sec - exiting 07:59:12 (7596): No heartbeat from core client for 30 sec - exiting 07:59:13 (7596): No heartbeat from core client for 30 sec - exiting 07:59:14 (7596): No heartbeat from core client for 30 sec - exiting 07:59:15 (7596): No heartbeat from core client for 30 sec - exiting 07:59:16 (7596): No heartbeat from core client for 30 sec - exiting 07:59:17 (7596): No heartbeat from core client for 30 sec - exiting 07:59:18 (7596): No heartbeat from core client for 30 sec - exiting 07:59:19 (7596): No heartbeat from core client for 30 sec - exiting 07:59:20 (7596): No heartbeat from core client for 30 sec - exiting 07:59:21 (7596): No heartbeat from core client for 30 sec - exiting 07:59:22 (7596): No heartbeat from core client for 30 sec - exiting 07:59:23 (7596): No heartbeat from core client for 30 sec - exiting 07:59:24 (7596): No heartbeat from core client for 30 sec - exiting 07:59:25 (7596): No heartbeat from core client for 30 sec - exiting 07:59:26 (7596): No heartbeat from core client for 30 sec - exiting 07:59:27 (7596): No heartbeat from core client for 30 sec - exiting 07:59:28 (7596): No heartbeat from core client for 30 sec - exiting 07:59:29 (7596): No heartbeat from core client for 30 sec - exiting 07:59:30 (7596): No heartbeat from core client for 30 sec - exiting 07:59:31 (7596): No heartbeat from core client for 30 sec - exiting 07:59:32 (7596): No heartbeat from core client for 30 sec - exiting 07:59:33 (7596): No heartbeat from core client for 30 sec - exiting 07:59:34 (7596): No heartbeat from core client for 30 sec - exiting 07:59:35 (7596): No heartbeat from core client for 30 sec - exiting 07:59:36 (7596): No heartbeat from core client for 30 sec - exiting 07:59:37 (7596): No heartbeat from core client for 30 sec - exiting 07:59:38 (7596): No heartbeat from core client for 30 sec - exiting 07:59:39 (7596): No heartbeat from core client for 30 sec - exiting 07:59:40 (7596): No heartbeat from core client for 30 sec - exiting 07:59:41 (7596): No heartbeat from core client for 30 sec - exiting 07:59:42 (7596): No heartbeat from core client for 30 sec - exiting 07:59:43 (7596): No heartbeat from core client for 30 sec - exiting 07:59:44 (7596): No heartbeat from core client for 30 sec - exiting 07:59:45 (7596): No heartbeat from core client for 30 sec - exiting 07:59:46 (7596): No heartbeat from core client for 30 sec - exiting 07:59:47 (7596): No heartbeat from core client for 30 sec - exiting 07:59:48 (7596): No heartbeat from core client for 30 sec - exiting 07:59:49 (7596): No heartbeat from core client for 30 sec - exiting 07:59:50 (7596): No heartbeat from core client for 30 sec - exiting 07:59:51 (7596): No heartbeat from core client for 30 sec - exiting 07:59:52 (7596): No heartbeat from core client for 30 sec - exiting 07:59:53 (7596): No heartbeat from core client for 30 sec - exiting 07:59:54 (7596): No heartbeat from core client for 30 sec - exiting 07:59:55 (7596): No heartbeat from core client for 30 sec - exiting 07:59:56 (7596): No heartbeat from core client for 30 sec - exiting 07:59:57 (7596): No heartbeat from core client for 30 sec - exiting 07:59:58 (7596): No heartbeat from core client for 30 sec - exiting 07:59:59 (7596): No heartbeat from core client for 30 sec - exiting 08:00:00 (7596): No heartbeat from core client for 30 sec - exiting 08:00:01 (7596): No heartbeat from core client for 30 sec - exiting 08:00:02 (7596): No heartbeat from core client for 30 sec - exiting 08:00:03 (7596): No heartbeat from core client for 30 sec - exiting 08:00:04 (7596): No heartbeat from core client for 30 sec - exiting 08:00:05 (7596): No heartbeat from core client for 30 sec - exiting 08:00:06 (7596): No heartbeat from core client for 30 sec - exiting 08:00:07 (7596): No heartbeat from core client for 30 sec - exiting 08:00:08 (7596): No heartbeat from core client for 30 sec - exiting 08:00:09 (7596): No heartbeat from core client for 30 sec - exiting 08:00:10 (7596): No heartbeat from core client for 30 sec - exiting 08:00:11 (7596): No heartbeat from core client for 30 sec - exiting 08:00:12 (7596): No heartbeat from core client for 30 sec - exiting 08:00:13 (7596): No heartbeat from core client for 30 sec - exiting 08:00:14 (7596): No heartbeat from core client for 30 sec - exiting 08:00:15 (7596): No heartbeat from core client for 30 sec - exiting 08:00:16 (7596): No heartbeat from core client for 30 sec - exiting 08:00:17 (7596): No heartbeat from core client for 30 sec - exiting 08:00:18 (7596): No heartbeat from core client for 30 sec - exiting 08:00:19 (7596): No heartbeat from core client for 30 sec - exiting 08:00:20 (7596): No heartbeat from core client for 30 sec - exiting 08:00:21 (7596): No heartbeat from core client for 30 sec - exiting 08:00:22 (7596): No heartbeat from core client for 30 sec - exiting 08:00:23 (7596): No heartbeat from core client for 30 sec - exiting 08:00:24 (7596): No heartbeat from core client for 30 sec - exiting 08:00:25 (7596): No heartbeat from core client for 30 sec - exiting 08:00:26 (7596): No heartbeat from core client for 30 sec - exiting 08:00:27 (7596): No heartbeat from core client for 30 sec - exiting 08:00:28 (7596): No heartbeat from core client for 30 sec - exiting 08:00:29 (7596): No heartbeat from core client for 30 sec - exiting 08:00:30 (7596): No heartbeat from core client for 30 sec - exiting 08:00:31 (7596): No heartbeat from core client for 30 sec - exiting 08:00:32 (7596): No heartbeat from core client for 30 sec - exiting 08:00:33 (7596): No heartbeat from core client for 30 sec - exiting 08:00:34 (7596): No heartbeat from core client for 30 sec - exiting 08:00:35 (7596): No heartbeat from core client for 30 sec - exiting 08:00:36 (7596): No heartbeat from core client for 30 sec - exiting 08:00:37 (7596): No heartbeat from core client for 30 sec - exiting 08:00:38 (7596): No heartbeat from core client for 30 sec - exiting 08:00:39 (7596): No heartbeat from core client for 30 sec - exiting 08:00:40 (7596): No heartbeat from core client for 30 sec - exiting 08:00:41 (7596): No heartbeat from core client for 30 sec - exiting 08:00:42 (7596): No heartbeat from core client for 30 sec - exiting 08:00:43 (7596): No heartbeat from core client for 30 sec - exiting 08:00:44 (7596): No heartbeat from core client for 30 sec - exiting 08:00:45 (7596): No heartbeat from core client for 30 sec - exiting 08:00:46 (7596): No heartbeat from core client for 30 sec - exiting 08:00:47 (7596): No heartbeat from core client for 30 sec - exiting 08:00:48 (7596): No heartbeat from core client for 30 sec - exiting 08:00:49 (7596): No heartbeat from core client for 30 sec - exiting 08:00:50 (7596): No heartbeat from core client for 30 sec - exiting 08:00:51 (7596): No heartbeat from core client for 30 sec - exiting 08:00:52 (7596): No heartbeat from core client for 30 sec - exiting 08:00:53 (7596): No heartbeat from core client for 30 sec - exiting 08:00:54 (7596): No heartbeat from core client for 30 sec - exiting 08:00:55 (7596): No heartbeat from core client for 30 sec - exiting 08:00:56 (7596): No heartbeat from core client for 30 sec - exiting 08:00:57 (7596): No heartbeat from core client for 30 sec - exiting 08:00:58 (7596): No heartbeat from core client for 30 sec - exiting 08:00:59 (7596): No heartbeat from core client for 30 sec - exiting 08:01:00 (7596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:01 (7596): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6188, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6632, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1440, selfPID=6268, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5324, selfPID=7268, iMonCtr=1 Model crash detected, will try to restart... 07:49:29 (2232): No heartbeat from core client for 30 sec - exiting 07:49:30 (2232): No heartbeat from core client for 30 sec - exiting 07:49:31 (2232): No heartbeat from core client for 30 sec - exiting 07:49:32 (2232): No heartbeat from core client for 30 sec - exiting 07:49:33 (2232): No heartbeat from core client for 30 sec - exiting 07:49:34 (2232): No heartbeat from core client for 30 sec - exiting 07:49:35 (2232): No heartbeat from core client for 30 sec - exiting 07:49:36 (2232): No heartbeat from core client for 30 sec - exiting 07:49:37 (2232): No heartbeat from core client for 30 sec - exiting 07:49:38 (2232): No heartbeat from core client for 30 sec - exiting 07:49:39 (2232): No heartbeat from core client for 30 sec - exiting 07:49:40 (2232): No heartbeat from core client for 30 sec - exiting 07:49:41 (2232): No heartbeat from core client for 30 sec - exiting 07:49:42 (2232): No heartbeat from core client for 30 sec - exiting 07:49:43 (2232): No heartbeat from core client for 30 sec - exiting 07:49:44 (2232): No heartbeat from core client for 30 sec - exiting 07:49:45 (2232): No heartbeat from core client for 30 sec - exiting 07:49:46 (2232): No heartbeat from core client for 30 sec - exiting 07:49:47 (2232): No heartbeat from core client for 30 sec - exiting 07:49:48 (2232): No heartbeat from core client for 30 sec - exiting 07:49:49 (2232): No heartbeat from core client for 30 sec - exiting 07:49:50 (2232): No heartbeat from core client for 30 sec - exiting 07:49:51 (2232): No heartbeat from core client for 30 sec - exiting 07:49:52 (2232): No heartbeat from core client for 30 sec - exiting 07:49:53 (2232): No heartbeat from core client for 30 sec - exiting 07:49:54 (2232): No heartbeat from core client for 30 sec - exiting 07:49:55 (2232): No heartbeat from core client for 30 sec - exiting 07:49:56 (2232): No heartbeat from core client for 30 sec - exiting 07:49:57 (2232): No heartbeat from core client for 30 sec - exiting 07:49:58 (2232): No heartbeat from core client for 30 sec - exiting 07:49:59 (2232): No heartbeat from core client for 30 sec - exiting 07:50:00 (2232): No heartbeat from core client for 30 sec - exiting 07:50:01 (2232): No heartbeat from core client for 30 sec - exiting 07:50:02 (2232): No heartbeat from core client for 30 sec - exiting 07:50:03 (2232): No heartbeat from core client for 30 sec - exiting 07:50:04 (2232): No heartbeat from core client for 30 sec - exiting 07:50:05 (2232): No heartbeat from core client for 30 sec - exiting 07:50:06 (2232): No heartbeat from core client for 30 sec - exiting 07:50:07 (2232): No heartbeat from core client for 30 sec - exiting 07:50:08 (2232): No heartbeat from core client for 30 sec - exiting 07:50:09 (2232): No heartbeat from core client for 30 sec - exiting 07:50:10 (2232): No heartbeat from core client for 30 sec - exiting 07:50:11 (2232): No heartbeat from core client for 30 sec - exiting 07:50:12 (2232): No heartbeat from core client for 30 sec - exiting 07:50:13 (2232): No heartbeat from core client for 30 sec - exiting 07:50:14 (2232): No heartbeat from core client for 30 sec - exiting 07:50:15 (2232): No heartbeat from core client for 30 sec - exiting 07:50:16 (2232): No heartbeat from core client for 30 sec - exiting 07:50:17 (2232): No heartbeat from core client for 30 sec - exiting 07:50:18 (2232): No heartbeat from core client for 30 sec - exiting 07:50:19 (2232): No heartbeat from core client for 30 sec - exiting 07:50:20 (2232): No heartbeat from core client for 30 sec - exiting 07:50:21 (2232): No heartbeat from core client for 30 sec - exiting 07:50:22 (2232): No heartbeat from core client for 30 sec - exiting 07:50:23 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:50:24 (2232): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7916, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1008, iMonCtr=2 Model crash detected, will try to restart... 07:38:17 (6988): No heartbeat from core client for 30 sec - exiting 07:38:25 (6988): No heartbeat from core client for 30 sec - exiting 07:38:26 (6988): No heartbeat from core client for 30 sec - exiting 07:38:27 (6988): No heartbeat from core client for 30 sec - exiting 07:38:28 (6988): No heartbeat from core client for 30 sec - exiting 07:38:29 (6988): No heartbeat from core client for 30 sec - exiting 07:39:27 (6988): No heartbeat from core client for 30 sec - exiting 07:39:28 (6988): No heartbeat from core client for 30 sec - exiting 07:39:29 (6988): No heartbeat from core client for 30 sec - exiting 07:39:30 (6988): No heartbeat from core client for 30 sec - exiting 07:39:31 (6988): No heartbeat from core client for 30 sec - exiting 07:39:32 (6988): No heartbeat from core client for 30 sec - exiting 07:39:33 (6988): No heartbeat from core client for 30 sec - exiting 07:39:34 (6988): No heartbeat from core client for 30 sec - exiting 07:39:35 (6988): No heartbeat from core client for 30 sec - exiting 07:39:36 (6988): No heartbeat from core client for 30 sec - exiting 07:39:37 (6988): No heartbeat from core client for 30 sec - exiting 07:39:38 (6988): No heartbeat from core client for 30 sec - exiting 07:39:39 (6988): No heartbeat from core client for 30 sec - exiting 07:39:40 (6988): No heartbeat from core client for 30 sec - exiting 07:39:41 (6988): No heartbeat from core client for 30 sec - exiting 07:39:42 (6988): No heartbeat from core client for 30 sec - exiting 07:39:43 (6988): No heartbeat from core client for 30 sec - exiting 07:39:44 (6988): No heartbeat from core client for 30 sec - exiting 07:39:45 (6988): No heartbeat from core client for 30 sec - exiting 07:39:46 (6988): No heartbeat from core client for 30 sec - exiting 07:39:47 (6988): No heartbeat from core client for 30 sec - exiting 07:39:48 (6988): No heartbeat from core client for 30 sec - exiting 07:39:49 (6988): No heartbeat from core client for 30 sec - exiting 07:39:50 (6988): No heartbeat from core client for 30 sec - exiting 07:39:51 (6988): No heartbeat from core client for 30 sec - exiting 07:39:52 (6988): No heartbeat from core client for 30 sec - exiting 07:39:53 (6988): No heartbeat from core client for 30 sec - exiting 07:39:54 (6988): No heartbeat from core client for 30 sec - exiting 07:39:55 (6988): No heartbeat from core client for 30 sec - exiting 07:39:56 (6988): No heartbeat from core client for 30 sec - exiting 07:39:57 (6988): No heartbeat from core client for 30 sec - exiting 07:39:58 (6988): No heartbeat from core client for 30 sec - exiting 07:39:59 (6988): No heartbeat from core client for 30 sec - exiting 07:40:00 (6988): No heartbeat from core client for 30 sec - exiting 07:40:01 (6988): No heartbeat from core client for 30 sec - exiting 07:40:02 (6988): No heartbeat from core client for 30 sec - exiting 07:40:03 (6988): No heartbeat from core client for 30 sec - exiting 07:40:04 (6988): No heartbeat from core client for 30 sec - exiting 07:40:05 (6988): No heartbeat from core client for 30 sec - exiting 07:40:06 (6988): No heartbeat from core client for 30 sec - exiting 07:40:07 (6988): No heartbeat from core client for 30 sec - exiting 07:40:08 (6988): No heartbeat from core client for 30 sec - exiting 07:40:09 (6988): No heartbeat from core client for 30 sec - exiting 07:40:10 (6988): No heartbeat from core client for 30 sec - exiting 07:40:11 (6988): No heartbeat from core client for 30 sec - exiting 07:40:12 (6988): No heartbeat from core client for 30 sec - exiting 07:40:13 (6988): No heartbeat from core client for 30 sec - exiting 07:40:14 (6988): No heartbeat from core client for 30 sec - exiting 07:40:15 (6988): No heartbeat from core client for 30 sec - exiting 07:40:16 (6988): No heartbeat from core client for 30 sec - exiting 07:40:17 (6988): No heartbeat from core client for 30 sec - exiting 07:40:18 (6988): No heartbeat from core client for 30 sec - exiting 07:40:19 (6988): No heartbeat from core client for 30 sec - exiting 07:40:20 (6988): No heartbeat from core client for 30 sec - exiting 07:40:21 (6988): No heartbeat from core client for 30 sec - exiting 07:40:22 (6988): No heartbeat from core client for 30 sec - exiting 07:40:23 (6988): No heartbeat from core client for 30 sec - exiting 07:40:24 (6988): No heartbeat from core client for 30 sec - exiting 07:40:25 (6988): No heartbeat from core client for 30 sec - exiting 07:40:26 (6988): No heartbeat from core client for 30 sec - exiting 07:40:27 (6988): No heartbeat from core client for 30 sec - exiting 07:40:28 (6988): No heartbeat from core client for 30 sec - exiting 07:40:29 (6988): No heartbeat from core client for 30 sec - exiting 07:40:30 (6988): No heartbeat from core client for 30 sec - exiting 07:40:31 (6988): No heartbeat from core client for 30 sec - exiting 07:40:32 (6988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 May 2012 13:48:47	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	138,336	438,388	3.1690
30 May 2012 08:59:28	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	126,816	401,348	3.1648
28 May 2012 15:02:18	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	115,296	363,542	3.1531
27 May 2012 13:05:03	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	103,776	326,120	3.1425
26 May 2012 09:47:09	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	92,256	290,544	3.1493
24 May 2012 14:48:02	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	80,736	255,551	3.1653
23 May 2012 10:34:07	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	69,216	220,294	3.1827
22 May 2012 06:35:58	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	57,705	184,532	3.1979
21 May 2012 13:41:58	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	57,696	184,100	3.1909
19 May 2012 17:10:30	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	46,176	147,924	3.2035
18 May 2012 08:36:25	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	34,656	111,285	3.2111
16 May 2012 07:35:58	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	23,136	74,374	3.2146
14 May 2012 12:58:12	992779	14441026	hadam3p_pnw_bchf_1978_1_007902482_0	11,616	37,032	3.1880