Task 14243896

Name	hadam3p_pnw_8poj_2002_1_007821494_1
Workunit	7976606
Created	10 Mar 2012, 6:36:17 UTC
Sent	10 Mar 2012, 6:36:39 UTC
Report deadline	20 Feb 2013, 11:56:39 UTC
Received	7 May 2012, 0:03:47 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1085383
Run time	7 days 3 hours 43 min 48 sec
CPU time	6 days 23 hours 59 min 35 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	1.68 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3768, selfPID=4076, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4008, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3480, selfPID=6740, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6600, selfPID=6816, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 09:30:33 (7920): No heartbeat from core client for 30 sec - exiting 09:30:34 (7920): No heartbeat from core client for 30 sec - exiting 09:30:35 (7920): No heartbeat from core client for 30 sec - exiting 09:30:36 (7920): No heartbeat from core client for 30 sec - exiting 09:30:37 (7920): No heartbeat from core client for 30 sec - exiting 09:30:38 (7920): No heartbeat from core client for 30 sec - exiting 09:30:39 (7920): No heartbeat from core client for 30 sec - exiting 09:30:40 (7920): No heartbeat from core client for 30 sec - exiting 09:30:41 (7920): No heartbeat from core client for 30 sec - exiting 09:30:42 (7920): No heartbeat from core client for 30 sec - exiting 09:30:43 (7920): No heartbeat from core client for 30 sec - exiting 09:30:44 (7920): No heartbeat from core client for 30 sec - exiting 09:30:45 (7920): No heartbeat from core client for 30 sec - exiting 09:30:46 (7920): No heartbeat from core client for 30 sec - exiting 09:30:47 (7920): No heartbeat from core client for 30 sec - exiting 09:30:48 (7920): No heartbeat from core client for 30 sec - exiting 09:30:49 (7920): No heartbeat from core client for 30 sec - exiting 09:30:50 (7920): No heartbeat from core client for 30 sec - exiting 09:30:51 (7920): No heartbeat from core client for 30 sec - exiting 09:30:52 (7920): No heartbeat from core client for 30 sec - exiting 09:30:53 (7920): No heartbeat from core client for 30 sec - exiting 09:30:54 (7920): No heartbeat from core client for 30 sec - exiting 09:30:55 (7920): No heartbeat from core client for 30 sec - exiting 09:30:56 (7920): No heartbeat from core client for 30 sec - exiting 09:30:57 (7920): No heartbeat from core client for 30 sec - exiting 09:30:58 (7920): No heartbeat from core client for 30 sec - exiting 09:30:59 (7920): No heartbeat from core client for 30 sec - exiting 09:31:00 (7920): No heartbeat from core client for 30 sec - exiting 09:31:01 (7920): No heartbeat from core client for 30 sec - exiting 09:31:02 (7920): No heartbeat from core client for 30 sec - exiting 09:31:03 (7920): No heartbeat from core client for 30 sec - exiting 09:31:04 (7920): No heartbeat from core client for 30 sec - exiting 09:31:05 (7920): No heartbeat from core client for 30 sec - exiting 09:31:06 (7920): No heartbeat from core client for 30 sec - exiting 09:31:07 (7920): No heartbeat from core client for 30 sec - exiting 09:31:08 (7920): No heartbeat from core client for 30 sec - exiting 09:31:09 (7920): No heartbeat from core client for 30 sec - exiting 09:31:10 (7920): No heartbeat from core client for 30 sec - exiting 09:31:11 (7920): No heartbeat from core client for 30 sec - exiting 09:31:12 (7920): No heartbeat from core client for 30 sec - exiting 09:31:13 (7920): No heartbeat from core client for 30 sec - exiting 09:31:14 (7920): No heartbeat from core client for 30 sec - exiting 09:31:15 (7920): No heartbeat from core client for 30 sec - exiting 09:31:16 (7920): No heartbeat from core client for 30 sec - exiting 09:31:17 (7920): No heartbeat from core client for 30 sec - exiting 09:31:18 (7920): No heartbeat from core client for 30 sec - exiting 09:31:19 (7920): No heartbeat from core client for 30 sec - exiting 09:31:20 (7920): No heartbeat from core client for 30 sec - exiting 09:31:21 (7920): No heartbeat from core client for 30 sec - exiting 09:31:22 (7920): No heartbeat from core client for 30 sec - exiting 09:31:23 (7920): No heartbeat from core client for 30 sec - exiting 09:31:24 (7920): No heartbeat from core client for 30 sec - exiting 09:31:25 (7920): No heartbeat from core client for 30 sec - exiting 09:31:26 (7920): No heartbeat from core client for 30 sec - exiting 09:31:27 (7920): No heartbeat from core client for 30 sec - exiting 09:31:28 (7920): No heartbeat from core client for 30 sec - exiting 09:31:29 (7920): No heartbeat from core client for 30 sec - exiting 09:31:30 (7920): No heartbeat from core client for 30 sec - exiting 09:31:31 (7920): No heartbeat from core client for 30 sec - exiting 09:31:32 (7920): No heartbeat from core client for 30 sec - exiting 09:31:33 (7920): No heartbeat from core client for 30 sec - exiting 09:31:34 (7920): No heartbeat from core client for 30 sec - exiting 09:31:35 (7920): No heartbeat from core client for 30 sec - exiting 09:31:36 (7920): No heartbeat from core client for 30 sec - exiting 09:31:37 (7920): No heartbeat from core client for 30 sec - exiting 09:31:38 (7920): No heartbeat from core client for 30 sec - exiting 09:31:39 (7920): No heartbeat from core client for 30 sec - exiting 09:31:40 (7920): No heartbeat from core client for 30 sec - exiting 09:31:41 (7920): No heartbeat from core client for 30 sec - exiting 09:31:42 (7920): No heartbeat from core client for 30 sec - exiting 09:31:43 (7920): No heartbeat from core client for 30 sec - exiting 09:31:44 (7920): No heartbeat from core client for 30 sec - exiting 09:31:45 (7920): No heartbeat from core client for 30 sec - exiting 09:31:46 (7920): No heartbeat from core client for 30 sec - exiting 09:31:47 (7920): No heartbeat from core client for 30 sec - exiting 09:31:48 (7920): No heartbeat from core client for 30 sec - exiting 09:31:49 (7920): No heartbeat from core client for 30 sec - exiting 09:31:50 (7920): No heartbeat from core client for 30 sec - exiting 09:31:51 (7920): No heartbeat from core client for 30 sec - exiting 09:31:52 (7920): No heartbeat from core client for 30 sec - exiting 09:31:53 (7920): No heartbeat from core client for 30 sec - exiting 09:31:54 (7920): No heartbeat from core client for 30 sec - exiting 09:31:55 (7920): No heartbeat from core client for 30 sec - exiting 09:31:56 (7920): No heartbeat from core client for 30 sec - exiting 09:31:57 (7920): No heartbeat from core client for 30 sec - exiting 09:31:58 (7920): No heartbeat from core client for 30 sec - exiting 09:31:59 (7920): No heartbeat from core client for 30 sec - exiting 09:32:00 (7920): No heartbeat from core client for 30 sec - exiting 09:32:01 (7920): No heartbeat from core client for 30 sec - exiting 09:32:02 (7920): No heartbeat from core client for 30 sec - exiting 09:32:03 (7920): No heartbeat from core client for 30 sec - exiting 09:32:04 (7920): No heartbeat from core client for 30 sec - exiting 09:32:05 (7920): No heartbeat from core client for 30 sec - exiting 09:32:06 (7920): No heartbeat from core client for 30 sec - exiting 09:32:07 (7920): No heartbeat from core client for 30 sec - exiting 09:32:08 (7920): No heartbeat from core client for 30 sec - exiting 09:32:09 (7920): No heartbeat from core client for 30 sec - exiting 09:32:10 (7920): No heartbeat from core client for 30 sec - exiting 09:32:11 (7920): No heartbeat from core client for 30 sec - exiting 09:32:12 (7920): No heartbeat from core client for 30 sec - exiting 09:32:13 (7920): No heartbeat from core client for 30 sec - exiting 09:32:14 (7920): No heartbeat from core client for 30 sec - exiting 09:32:15 (7920): No heartbeat from core client for 30 sec - exiting 09:32:16 (7920): No heartbeat from core client for 30 sec - exiting 09:32:17 (7920): No heartbeat from core client for 30 sec - exiting 09:32:18 (7920): No heartbeat from core client for 30 sec - exiting 09:32:19 (7920): No heartbeat from core client for 30 sec - exiting 09:32:20 (7920): No heartbeat from core client for 30 sec - exiting 09:32:21 (7920): No heartbeat from core client for 30 sec - exiting 09:32:22 (7920): No heartbeat from core client for 30 sec - exiting 09:32:23 (7920): No heartbeat from core client for 30 sec - exiting 09:32:24 (7920): No heartbeat from core client for 30 sec - exiting 09:32:25 (7920): No heartbeat from core client for 30 sec - exiting 09:32:26 (7920): No heartbeat from core client for 30 sec - exiting 09:32:27 (7920): No heartbeat from core client for 30 sec - exiting 09:32:28 (7920): No heartbeat from core client for 30 sec - exiting 09:32:29 (7920): No heartbeat from core client for 30 sec - exiting 09:32:30 (7920): No heartbeat from core client for 30 sec - exiting 09:32:31 (7920): No heartbeat from core client for 30 sec - exiting 09:32:32 (7920): No heartbeat from core client for 30 sec - exiting 09:32:33 (7920): No heartbeat from core client for 30 sec - exiting 09:32:34 (7920): No heartbeat from core client for 30 sec - exiting 09:32:35 (7920): No heartbeat from core client for 30 sec - exiting 09:32:36 (7920): No heartbeat from core client for 30 sec - exiting 09:32:37 (7920): No heartbeat from core client for 30 sec - exiting 09:32:38 (7920): No heartbeat from core client for 30 sec - exiting 09:32:39 (7920): No heartbeat from core client for 30 sec - exiting 09:32:40 (7920): No heartbeat from core client for 30 sec - exiting 09:32:41 (7920): No heartbeat from core client for 30 sec - exiting 09:32:42 (7920): No heartbeat from core client for 30 sec - exiting 09:32:43 (7920): No heartbeat from core client for 30 sec - exiting 09:32:44 (7920): No heartbeat from core client for 30 sec - exiting 09:32:45 (7920): No heartbeat from core client for 30 sec - exiting 09:32:46 (7920): No heartbeat from core client for 30 sec - exiting 09:32:47 (7920): No heartbeat from core client for 30 sec - exiting 09:32:48 (7920): No heartbeat from core client for 30 sec - exiting 09:32:49 (7920): No heartbeat from core client for 30 sec - exiting 09:32:50 (7920): No heartbeat from core client for 30 sec - exiting 09:32:51 (7920): No heartbeat from core client for 30 sec - exiting 09:32:52 (7920): No heartbeat from core client for 30 sec - exiting 09:32:53 (7920): No heartbeat from core client for 30 sec - exiting 09:32:54 (7920): No heartbeat from core client for 30 sec - exiting 09:32:55 (7920): No heartbeat from core client for 30 sec - exiting 09:32:56 (7920): No heartbeat from core client for 30 sec - exiting 09:32:57 (7920): No heartbeat from core client for 30 sec - exiting 09:32:58 (7920): No heartbeat from core client for 30 sec - exiting 09:32:59 (7920): No heartbeat from core client for 30 sec - exiting 09:33:00 (7920): No heartbeat from core client for 30 sec - exiting 09:33:01 (7920): No heartbeat from core client for 30 sec - exiting 09:33:02 (7920): No heartbeat from core client for 30 sec - exiting 09:33:03 (7920): No heartbeat from core client for 30 sec - exiting 09:33:04 (7920): No heartbeat from core client for 30 sec - exiting 09:33:05 (7920): No heartbeat from core client for 30 sec - exiting 09:33:06 (7920): No heartbeat from core client for 30 sec - exiting 09:33:07 (7920): No heartbeat from core client for 30 sec - exiting 09:33:08 (7920): No heartbeat from core client for 30 sec - exiting 09:33:09 (7920): No heartbeat from core client for 30 sec - exiting 09:33:10 (7920): No heartbeat from core client for 30 sec - exiting 09:33:11 (7920): No heartbeat from core client for 30 sec - exiting 09:33:12 (7920): No heartbeat from core client for 30 sec - exiting 09:33:13 (7920): No heartbeat from core client for 30 sec - exiting 09:33:14 (7920): No heartbeat from core client for 30 sec - exiting 09:33:15 (7920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5644, selfPID=7272, iMonCtr=1 Model crash detected, will try to restart... 16:26:30 (7904): No heartbeat from core client for 30 sec - exiting 16:26:32 (7904): No heartbeat from core client for 30 sec - exiting 16:26:33 (7904): No heartbeat from core client for 30 sec - exiting 16:26:34 (7904): No heartbeat from core client for 30 sec - exiting 16:26:35 (7904): No heartbeat from core client for 30 sec - exiting 16:26:36 (7904): No heartbeat from core client for 30 sec - exiting 16:26:37 (7904): No heartbeat from core client for 30 sec - exiting 16:26:38 (7904): No heartbeat from core client for 30 sec - exiting 16:26:39 (7904): No heartbeat from core client for 30 sec - exiting 16:26:40 (7904): No heartbeat from core client for 30 sec - exiting 16:26:41 (7904): No heartbeat from core client for 30 sec - exiting 16:26:42 (7904): No heartbeat from core client for 30 sec - exiting 16:26:43 (7904): No heartbeat from core client for 30 sec - exiting 16:26:44 (7904): No heartbeat from core client for 30 sec - exiting 16:26:45 (7904): No heartbeat from core client for 30 sec - exiting 16:26:46 (7904): No heartbeat from core client for 30 sec - exiting 16:26:47 (7904): No heartbeat from core client for 30 sec - exiting 16:26:48 (7904): No heartbeat from core client for 30 sec - exiting 16:26:49 (7904): No heartbeat from core client for 30 sec - exiting 16:26:50 (7904): No heartbeat from core client for 30 sec - exiting 16:26:51 (7904): No heartbeat from core client for 30 sec - exiting 16:26:52 (7904): No heartbeat from core client for 30 sec - exiting 16:26:53 (7904): No heartbeat from core client for 30 sec - exiting 16:26:54 (7904): No heartbeat from core client for 30 sec - exiting 16:26:55 (7904): No heartbeat from core client for 30 sec - exiting 16:26:56 (7904): No heartbeat from core client for 30 sec - exiting 16:26:57 (7904): No heartbeat from core client for 30 sec - exiting 16:26:58 (7904): No heartbeat from core client for 30 sec - exiting 16:26:59 (7904): No heartbeat from core client for 30 sec - exiting 16:27:00 (7904): No heartbeat from core client for 30 sec - exiting 16:27:01 (7904): No heartbeat from core client for 30 sec - exiting 16:27:02 (7904): No heartbeat from core client for 30 sec - exiting 16:27:03 (7904): No heartbeat from core client for 30 sec - exiting 16:27:04 (7904): No heartbeat from core client for 30 sec - exiting 16:27:05 (7904): No heartbeat from core client for 30 sec - exiting 16:27:06 (7904): No heartbeat from core client for 30 sec - exiting 16:27:07 (7904): No heartbeat from core client for 30 sec - exiting 16:27:08 (7904): No heartbeat from core client for 30 sec - exiting 16:27:09 (7904): No heartbeat from core client for 30 sec - exiting 16:27:10 (7904): No heartbeat from core client for 30 sec - exiting 16:27:11 (7904): No heartbeat from core client for 30 sec - exiting 16:27:12 (7904): No heartbeat from core client for 30 sec - exiting 16:27:13 (7904): No heartbeat from core client for 30 sec - exiting 16:27:14 (7904): No heartbeat from core client for 30 sec - exiting 16:27:15 (7904): No heartbeat from core client for 30 sec - exiting 16:27:16 (7904): No heartbeat from core client for 30 sec - exiting 16:27:17 (7904): No heartbeat from core client for 30 sec - exiting 16:27:18 (7904): No heartbeat from core client for 30 sec - exiting 16:27:19 (7904): No heartbeat from core client for 30 sec - exiting 16:27:20 (7904): No heartbeat from core client for 30 sec - exiting 16:27:21 (7904): No heartbeat from core client for 30 sec - exiting 16:27:22 (7904): No heartbeat from core client for 30 sec - exiting 16:27:23 (7904): No heartbeat from core client for 30 sec - exiting 16:27:24 (7904): No heartbeat from core client for 30 sec - exiting 16:27:25 (7904): No heartbeat from core client for 30 sec - exiting 16:27:26 (7904): No heartbeat from core client for 30 sec - exiting 16:27:27 (7904): No heartbeat from core client for 30 sec - exiting 16:27:28 (7904): No heartbeat from core client for 30 sec - exiting 16:27:29 (7904): No heartbeat from core client for 30 sec - exiting 16:27:30 (7904): No heartbeat from core client for 30 sec - exiting 16:27:31 (7904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:07:57 (6568): No heartbeat from core client for 30 sec - exiting 22:08:00 (6568): No heartbeat from core client for 30 sec - exiting 22:08:01 (6568): No heartbeat from core client for 30 sec - exiting 22:08:02 (6568): No heartbeat from core client for 30 sec - exiting 22:08:03 (6568): No heartbeat from core client for 30 sec - exiting 22:08:04 (6568): No heartbeat from core client for 30 sec - exiting 22:08:05 (6568): No heartbeat from core client for 30 sec - exiting 22:08:06 (6568): No heartbeat from core client for 30 sec - exiting 22:08:07 (6568): No heartbeat from core client for 30 sec - exiting 22:08:08 (6568): No heartbeat from core client for 30 sec - exiting 22:08:09 (6568): No heartbeat from core client for 30 sec - exiting 22:08:10 (6568): No heartbeat from core client for 30 sec - exiting 22:08:11 (6568): No heartbeat from core client for 30 sec - exiting 22:08:12 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6976, selfPID=6188, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4036, selfPID=9560, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4088, selfPID=5892, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:06:34 (6944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1532, selfPID=1532, iMonCtr=2 12:23:51 (6404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:03 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:04 (5268): No heartbeat from core client for 30 sec - exiting 13:37:46 (5400): No heartbeat from core client for 30 sec - exiting 13:37:47 (5400): No heartbeat from core client for 30 sec - exiting 13:37:48 (5400): No heartbeat from core client for 30 sec - exiting 13:37:49 (5400): No heartbeat from core client for 30 sec - exiting 13:37:50 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 May 2012 23:06:02	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	138,336	604,000	4.3662
01 May 2012 12:21:45	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	126,816	564,745	4.4533
01 May 2012 01:07:11	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	115,296	524,241	4.5469
30 Apr 2012 05:45:10	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	103,776	478,189	4.6079
24 Apr 2012 09:07:09	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	92,256	426,276	4.6206
22 Apr 2012 19:12:49	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	80,736	382,005	4.7315
21 Apr 2012 19:42:40	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	69,216	337,448	4.8753
27 Mar 2012 08:04:01	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	57,696	291,314	5.0491
24 Mar 2012 18:54:35	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	46,176	235,266	5.0950
18 Mar 2012 00:17:43	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	34,656	175,915	5.0760
17 Mar 2012 04:19:30	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	23,136	118,179	5.1080
12 Mar 2012 14:24:23	1085383	14243896	hadam3p_pnw_8poj_2002_1_007821494_1	11,616	60,049	5.1695