Task 13314153

Name	hadam3p_pnw_2vsp_1997_1_007431646_2
Workunit	7629149
Created	29 Aug 2011, 12:54:46 UTC
Sent	29 Aug 2011, 13:02:45 UTC
Report deadline	10 Aug 2012, 18:22:45 UTC
Received	7 Sep 2011, 3:19:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1139594
Run time	4 days 21 hours 34 min 49 sec
CPU time	4 days 18 hours 38 min 53 sec
Validate state	Invalid
Credit	2,254.93
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4028, selfPID=4028, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5384, selfPID=5384, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3540, selfPID=3540, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5804, selfPID=5804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5876, selfPID=5876, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1296, selfPID=1296, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5192, selfPID=5192, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3980, selfPID=3980, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2288, selfPID=2288, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1848, selfPID=1848, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2500, selfPID=2500, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2664, selfPID=2664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1044, selfPID=1044, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:11:28 (2720): No heartbeat from core client for 30 sec - exiting 09:11:29 (2720): No heartbeat from core client for 30 sec - exiting 09:11:30 (2720): No heartbeat from core client for 30 sec - exiting 09:11:31 (2720): No heartbeat from core client for 30 sec - exiting 09:11:32 (2720): No heartbeat from core client for 30 sec - exiting 09:11:33 (2720): No heartbeat from core client for 30 sec - exiting 09:11:34 (2720): No heartbeat from core client for 30 sec - exiting 09:11:35 (2720): No heartbeat from core client for 30 sec - exiting 09:11:36 (2720): No heartbeat from core client for 30 sec - exiting 09:11:37 (2720): No heartbeat from core client for 30 sec - exiting 09:11:38 (2720): No heartbeat from core client for 30 sec - exiting 09:11:39 (2720): No heartbeat from core client for 30 sec - exiting 09:11:40 (2720): No heartbeat from core client for 30 sec - exiting 09:11:41 (2720): No heartbeat from core client for 30 sec - exiting 09:11:42 (2720): No heartbeat from core client for 30 sec - exiting 09:11:43 (2720): No heartbeat from core client for 30 sec - exiting 09:11:44 (2720): No heartbeat from core client for 30 sec - exiting 09:11:45 (2720): No heartbeat from core client for 30 sec - exiting 09:11:46 (2720): No heartbeat from core client for 30 sec - exiting 09:11:47 (2720): No heartbeat from core client for 30 sec - exiting 09:11:48 (2720): No heartbeat from core client for 30 sec - exiting 09:11:49 (2720): No heartbeat from core client for 30 sec - exiting 09:11:50 (2720): No heartbeat from core client for 30 sec - exiting 09:11:51 (2720): No heartbeat from core client for 30 sec - exiting 09:11:52 (2720): No heartbeat from core client for 30 sec - exiting 09:11:53 (2720): No heartbeat from core client for 30 sec - exiting 09:11:54 (2720): No heartbeat from core client for 30 sec - exiting 09:11:55 (2720): No heartbeat from core client for 30 sec - exiting 09:11:56 (2720): No heartbeat from core client for 30 sec - exiting 09:11:57 (2720): No heartbeat from core client for 30 sec - exiting 09:11:58 (2720): No heartbeat from core client for 30 sec - exiting 09:11:59 (2720): No heartbeat from core client for 30 sec - exiting 09:12:00 (2720): No heartbeat from core client for 30 sec - exiting 09:12:01 (2720): No heartbeat from core client for 30 sec - exiting 09:12:02 (2720): No heartbeat from core client for 30 sec - exiting 09:12:03 (2720): No heartbeat from core client for 30 sec - exiting 09:12:04 (2720): No heartbeat from core client for 30 sec - exiting 09:12:05 (2720): No heartbeat from core client for 30 sec - exiting 09:12:06 (2720): No heartbeat from core client for 30 sec - exiting 09:12:07 (2720): No heartbeat from core client for 30 sec - exiting 09:12:08 (2720): No heartbeat from core client for 30 sec - exiting 09:12:09 (2720): No heartbeat from core client for 30 sec - exiting 09:12:10 (2720): No heartbeat from core client for 30 sec - exiting 09:12:11 (2720): No heartbeat from core client for 30 sec - exiting 09:12:12 (2720): No heartbeat from core client for 30 sec - exiting 09:12:13 (2720): No heartbeat from core client for 30 sec - exiting 09:12:14 (2720): No heartbeat from core client for 30 sec - exiting 09:12:15 (2720): No heartbeat from core client for 30 sec - exiting 09:12:16 (2720): No heartbeat from core client for 30 sec - exiting 09:12:17 (2720): No heartbeat from core client for 30 sec - exiting 09:12:18 (2720): No heartbeat from core client for 30 sec - exiting 09:12:19 (2720): No heartbeat from core client for 30 sec - exiting 09:12:20 (2720): No heartbeat from core client for 30 sec - exiting 09:12:21 (2720): No heartbeat from core client for 30 sec - exiting 09:12:22 (2720): No heartbeat from core client for 30 sec - exiting 09:12:23 (2720): No heartbeat from core client for 30 sec - exiting 09:12:24 (2720): No heartbeat from core client for 30 sec - exiting 09:12:25 (2720): No heartbeat from core client for 30 sec - exiting 09:12:26 (2720): No heartbeat from core client for 30 sec - exiting 09:12:27 (2720): No heartbeat from core client for 30 sec - exiting 09:12:28 (2720): No heartbeat from core client for 30 sec - exiting 09:12:29 (2720): No heartbeat from core client for 30 sec - exiting 09:12:30 (2720): No heartbeat from core client for 30 sec - exiting 09:12:31 (2720): No heartbeat from core client for 30 sec - exiting 09:12:32 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4960, selfPID=4960, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:48:19 (2672): No heartbeat from core client for 30 sec - exiting 21:48:20 (2672): No heartbeat from core client for 30 sec - exiting 21:48:21 (2672): No heartbeat from core client for 30 sec - exiting 21:48:22 (2672): No heartbeat from core client for 30 sec - exiting 21:48:23 (2672): No heartbeat from core client for 30 sec - exiting 21:48:24 (2672): No heartbeat from core client for 30 sec - exiting 21:48:25 (2672): No heartbeat from core client for 30 sec - exiting 21:48:26 (2672): No heartbeat from core client for 30 sec - exiting 21:48:27 (2672): No heartbeat from core client for 30 sec - exiting 21:48:28 (2672): No heartbeat from core client for 30 sec - exiting 21:48:29 (2672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:07:49 (3028): No heartbeat from core client for 30 sec - exiting 22:07:50 (3028): No heartbeat from core client for 30 sec - exiting 22:07:51 (3028): No heartbeat from core client for 30 sec - exiting 22:07:52 (3028): No heartbeat from core client for 30 sec - exiting 22:07:53 (3028): No heartbeat from core client for 30 sec - exiting 22:07:54 (3028): No heartbeat from core client for 30 sec - exiting 22:07:55 (3028): No heartbeat from core client for 30 sec - exiting 22:07:56 (3028): No heartbeat from core client for 30 sec - exiting 22:07:57 (3028): No heartbeat from core client for 30 sec - exiting 22:07:58 (3028): No heartbeat from core client for 30 sec - exiting 22:07:59 (3028): No heartbeat from core client for 30 sec - exiting 22:08:00 (3028): No heartbeat from core client for 30 sec - exiting 22:08:01 (3028): No heartbeat from core client for 30 sec - exiting 22:08:02 (3028): No heartbeat from core client for 30 sec - exiting 22:08:03 (3028): No heartbeat from core client for 30 sec - exiting 22:08:04 (3028): No heartbeat from core client for 30 sec - exiting 22:08:05 (3028): No heartbeat from core client for 30 sec - exiting 22:08:06 (3028): No heartbeat from core client for 30 sec - exiting 22:08:07 (3028): No heartbeat from core client for 30 sec - exiting 22:08:08 (3028): No heartbeat from core client for 30 sec - exiting 22:08:09 (3028): No heartbeat from core client for 30 sec - exiting 22:08:10 (3028): No heartbeat from core client for 30 sec - exiting 22:08:11 (3028): No heartbeat from core client for 30 sec - exiting 22:08:12 (3028): No heartbeat from core client for 30 sec - exiting 22:08:13 (3028): No heartbeat from core client for 30 sec - exiting 22:08:14 (3028): No heartbeat from core client for 30 sec - exiting 22:08:15 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:14:58 (3344): No heartbeat from core client for 30 sec - exiting 23:14:59 (3344): No heartbeat from core client for 30 sec - exiting 23:15:00 (3344): No heartbeat from core client for 30 sec - exiting 23:15:01 (3344): No heartbeat from core client for 30 sec - exiting 23:15:02 (3344): No heartbeat from core client for 30 sec - exiting 23:15:03 (3344): No heartbeat from core client for 30 sec - exiting 23:15:04 (3344): No heartbeat from core client for 30 sec - exiting 23:15:05 (3344): No heartbeat from core client for 30 sec - exiting 23:15:06 (3344): No heartbeat from core client for 30 sec - exiting 23:15:07 (3344): No heartbeat from core client for 30 sec - exiting 23:15:08 (3344): No heartbeat from core client for 30 sec - exiting 23:15:09 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: severe (24): end-of-file during read, unit 9, file D:\BOINC\data\projects\climateprediction.net\hadam3p_pnw_2vsp_1997_1_007431646\tmp\xaakm.namelists Image PC Routine Line Source hadam3p_pnw_um_6. 0076A39A Unknown Unknown Unknown hadam3p_pnw_um_6. 007676C8 Unknown Unknown Unknown hadam3p_pnw_um_6. 00712CD0 Unknown Unknown Unknown hadam3p_pnw_um_6. 00711E9A Unknown Unknown Unknown hadam3p_pnw_um_6. 006F2819 Unknown Unknown Unknown hadam3p_pnw_um_6. 005F2287 Unknown Unknown Unknown hadam3p_pnw_um_6. 0068E7B2 Unknown Unknown Unknown hadam3p_pnw_um_6. 0068F2DA Unknown Unknown Unknown hadam3p_pnw_um_6. 00409BD2 Unknown Unknown Unknown hadam3p_pnw_um_6. 0074E638 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown forrtl: severe (24): end-of-file during read, unit 9, file D:\BOINC\data\projects\climateprediction.net\hadam3p_pnw_2vsp_1997_1_007431646\tmp\xaakg.namelists Image PC Routine Line Source hadrm3p_pnw_um_6. 0073C52A Unknown Unknown Unknown hadrm3p_pnw_um_6. 00739858 Unknown Unknown Unknown hadrm3p_pnw_um_6. 006E4460 Unknown Unknown Unknown hadrm3p_pnw_um_6. 006E362A Unknown Unknown Unknown hadrm3p_pnw_um_6. 006C2469 Unknown Unknown Unknown hadrm3p_pnw_um_6. 005C66EB Unknown Unknown Unknown hadrm3p_pnw_um_6. 00662AE2 Unknown Unknown Unknown hadrm3p_pnw_um_6. 006635AF Unknown Unknown Unknown hadrm3p_pnw_um_6. 00409860 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00720893 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3532, selfPID=3312, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_2vsp_1997_1_007431646_2_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2vsp_1997_1_007431646_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2vsp_1997_1_007431646_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2vsp_1997_1_007431646_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Sep 2011 12:00:25	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	103,776	400,070	3.8551
04 Sep 2011 12:35:14	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	92,256	356,494	3.8642
04 Sep 2011 12:35:14	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	80,736	314,226	3.8920
02 Sep 2011 11:55:42	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	69,216	269,531	3.8941
02 Sep 2011 11:55:42	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	57,696	225,821	3.9140
01 Sep 2011 12:14:50	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	46,176	182,479	3.9518
01 Sep 2011 12:14:50	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	34,657	139,595	4.0279
01 Sep 2011 12:14:50	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	34,656	139,094	4.0136
31 Aug 2011 13:06:39	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	23,136	93,899	4.0586
30 Aug 2011 12:12:03	1139594	13314153	hadam3p_pnw_2vsp_1997_1_007431646_2	11,616	47,171	4.0609