Task 13967251

Name	hadam3p_pnw_8jj2_2003_1_007698266_0
Workunit	7853374
Created	25 Jan 2012, 17:02:06 UTC
Sent	14 Feb 2012, 18:36:58 UTC
Report deadline	26 Jan 2013, 23:56:58 UTC
Received	23 Apr 2012, 16:37:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1089092
Run time	6 days 3 hours 52 min 10 sec
CPU time	4 days 21 hours 13 min 3 sec
Validate state	Invalid
Credit	1,253.69
Device peak FLOPS	1.70 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6728, selfPID=6728, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7456, selfPID=7456, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4732, selfPID=8172, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5236, selfPID=5236, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18376, selfPID=18376, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14892, selfPID=12660, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8176, selfPID=8176, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:34:27 (16228): No heartbeat from core client for 30 sec - exiting 17:34:29 (16228): No heartbeat from core client for 30 sec - exiting 17:34:30 (16228): No heartbeat from core client for 30 sec - exiting 17:34:31 (16228): No heartbeat from core client for 30 sec - exiting 17:34:32 (16228): No heartbeat from core client for 30 sec - exiting 17:34:33 (16228): No heartbeat from core client for 30 sec - exiting 17:34:34 (16228): No heartbeat from core client for 30 sec - exiting 17:34:35 (16228): No heartbeat from core client for 30 sec - exiting 17:34:36 (16228): No heartbeat from core client for 30 sec - exiting 17:34:37 (16228): No heartbeat from core client for 30 sec - exiting 17:34:38 (16228): No heartbeat from core client for 30 sec - exiting 17:34:39 (16228): No heartbeat from core client for 30 sec - exiting 17:34:40 (16228): No heartbeat from core client for 30 sec - exiting 17:34:42 (16228): No heartbeat from core client for 30 sec - exiting 17:34:43 (16228): No heartbeat from core client for 30 sec - exiting 17:34:44 (16228): No heartbeat from core client for 30 sec - exiting 17:34:45 (16228): No heartbeat from core client for 30 sec - exiting 17:34:50 (16228): No heartbeat from core client for 30 sec - exiting 17:34:51 (16228): No heartbeat from core client for 30 sec - exiting 17:34:52 (16228): No heartbeat from core client for 30 sec - exiting 17:34:53 (16228): No heartbeat from core client for 30 sec - exiting 17:34:54 (16228): No heartbeat from core client for 30 sec - exiting 17:34:55 (16228): No heartbeat from core client for 30 sec - exiting 17:34:57 (16228): No heartbeat from core client for 30 sec - exiting 17:34:58 (16228): No heartbeat from core client for 30 sec - exiting 17:34:59 (16228): No heartbeat from core client for 30 sec - exiting 17:35:00 (16228): No heartbeat from core client for 30 sec - exiting 17:35:01 (16228): No heartbeat from core client for 30 sec - exiting 17:35:32 (16228): No heartbeat from core client for 30 sec - exiting 17:35:33 (16228): No heartbeat from core client for 30 sec - exiting 17:35:34 (16228): No heartbeat from core client for 30 sec - exiting 17:35:35 (16228): No heartbeat from core client for 30 sec - exiting 17:35:36 (16228): No heartbeat from core client for 30 sec - exiting 17:35:37 (16228): No heartbeat from core client for 30 sec - exiting 17:35:38 (16228): No heartbeat from core client for 30 sec - exiting 17:35:39 (16228): No heartbeat from core client for 30 sec - exiting 17:35:40 (16228): No heartbeat from core client for 30 sec - exiting 17:35:42 (16228): No heartbeat from core client for 30 sec - exiting 17:35:43 (16228): No heartbeat from core client for 30 sec - exiting 17:35:44 (16228): No heartbeat from core client for 30 sec - exiting 17:35:45 (16228): No heartbeat from core client for 30 sec - exiting 17:35:46 (16228): No heartbeat from core client for 30 sec - exiting 17:35:48 (16228): No heartbeat from core client for 30 sec - exiting 17:35:49 (16228): No heartbeat from core client for 30 sec - exiting 17:35:50 (16228): No heartbeat from core client for 30 sec - exiting 17:35:51 (16228): No heartbeat from core client for 30 sec - exiting 17:35:52 (16228): No heartbeat from core client for 30 sec - exiting 17:35:53 (16228): No heartbeat from core client for 30 sec - exiting 17:35:54 (16228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2068, selfPID=2068, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6848, selfPID=7664, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:28:51 (4284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:28:53 (4284): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=31648, selfPID=31648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6304, selfPID=6304, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4524, selfPID=4524, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2828, selfPID=2828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3784, selfPID=3784, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4688, selfPID=4688, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6376, selfPID=6376, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3064, selfPID=3064, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4652, selfPID=4052, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14056, selfPID=14056, iMonCtr=2 19:16:32 (6544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:33 (6544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... GCPDN Monitor - Quit request from BOINC... 11:55:22 (3404): No heartbeat from core client for 30 sec - exiting 11:55:23 (3404): No heartbeat from core client for 30 sec - exiting 11:55:24 (3404): No heartbeat from core client for 30 sec - exiting 11:55:25 (3404): No heartbeat from core client for 30 sec - exiting 11:55:26 (3404): No heartbeat from core client for 30 sec - exiting 11:55:27 (3404): No heartbeat from core client for 30 sec - exiting 11:55:28 (3404): No heartbeat from core client for 30 sec - exiting 11:55:29 (3404): No heartbeat from core client for 30 sec - exiting 11:55:30 (3404): No heartbeat from core client for 30 sec - exiting 11:55:31 (3404): No heartbeat from core client for 30 sec - exiting 11:55:32 (3404): No heartbeat from core client for 30 sec - exiting 11:55:34 (3404): No heartbeat from core client for 30 sec - exiting 11:55:35 (3404): No heartbeat from core client for 30 sec - exiting 11:55:36 (3404): No heartbeat from core client for 30 sec - exiting 11:55:37 (3404): No heartbeat from core client for 30 sec - exiting 11:55:38 (3404): No heartbeat from core client for 30 sec - exiting 11:55:39 (3404): No heartbeat from core client for 30 sec - exiting 11:55:40 (3404): No heartbeat from core client for 30 sec - exiting 11:55:41 (3404): No heartbeat from core client for 30 sec - exiting 11:55:42 (3404): No heartbeat from core client for 30 sec - exiting 11:55:43 (3404): No heartbeat from core client for 30 sec - exiting 11:55:44 (3404): No heartbeat from core client for 30 sec - exiting 11:55:46 (3404): No heartbeat from core client for 30 sec - exiting 11:55:47 (3404): No heartbeat from core client for 30 sec - exiting 11:55:48 (3404): No heartbeat from core client for 30 sec - exiting 11:55:49 (3404): No heartbeat from core client for 30 sec - exiting 11:55:50 (3404): No heartbeat from core client for 30 sec - exiting 11:55:51 (3404): No heartbeat from core client for 30 sec - exiting 11:55:52 (3404): No heartbeat from core client for 30 sec - exiting 11:55:53 (3404): No heartbeat from core client for 30 sec - exiting 11:55:54 (3404): No heartbeat from core client for 30 sec - exiting 11:55:55 (3404): No heartbeat from core client for 30 sec - exiting 11:55:57 (3404): No heartbeat from core client for 30 sec - exiting 11:55:58 (3404): No heartbeat from core client for 30 sec - exiting 11:55:59 (3404): No heartbeat from core client for 30 sec - exiting 11:56:00 (3404): No heartbeat from core client for 30 sec - exiting 11:56:01 (3404): No heartbeat from core client for 30 sec - exiting 11:56:02 (3404): No heartbeat from core client for 30 sec - exiting 11:56:03 (3404): No heartbeat from core client for 30 sec - exiting 11:56:04 (3404): No heartbeat from core client for 30 sec - exiting 11:56:05 (3404): No heartbeat from core client for 30 sec - exiting 11:56:06 (3404): No heartbeat from core client for 30 sec - exiting 11:56:08 (3404): No heartbeat from core client for 30 sec - exiting 11:56:09 (3404): No heartbeat from core client for 30 sec - exiting 11:56:10 (3404): No heartbeat from core client for 30 sec - exiting 11:56:11 (3404): No heartbeat from core client for 30 sec - exiting 11:56:12 (3404): No heartbeat from core client for 30 sec - exiting 11:56:13 (3404): No heartbeat from core client for 30 sec - exiting 11:56:14 (3404): No heartbeat from core client for 30 sec - exiting 11:56:15 (3404): No heartbeat from core client for 30 sec - exiting 11:56:16 (3404): No heartbeat from core client for 30 sec - exiting 11:56:17 (3404): No heartbeat from core client for 30 sec - exiting 11:56:18 (3404): No heartbeat from core client for 30 sec - exiting 11:56:20 (3404): No heartbeat from core client for 30 sec - exiting 11:56:21 (3404): No heartbeat from core client for 30 sec - exiting 11:56:22 (3404): No heartbeat from core client for 30 sec - exiting 11:56:23 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:56:24 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 07:23:37 (6736): No heartbeat from core client for 30 sec - exiting 07:23:38 (6736): No heartbeat from core client for 30 sec - exiting 07:23:39 (6736): No heartbeat from core client for 30 sec - exiting 07:23:40 (6736): No heartbeat from core client for 30 sec - exiting 07:23:41 (6736): No heartbeat from core client for 30 sec - exiting 07:23:42 (6736): No heartbeat from core client for 30 sec - exiting 07:23:43 (6736): No heartbeat from core client for 30 sec - exiting 07:23:44 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1576, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5332, selfPID=6204, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_8jj2_2003_1_007698266_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8jj2_2003_1_007698266_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8jj2_2003_1_007698266_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8jj2_2003_1_007698266_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8jj2_2003_1_007698266_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8jj2_2003_1_007698266_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8jj2_2003_1_007698266_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Apr 2012 16:27:57	1089092	13967251	hadam3p_pnw_8jj2_2003_1_007698266_0	57,697	365,503	6.3349
18 Apr 2012 03:56:53	1089092	13967251	hadam3p_pnw_8jj2_2003_1_007698266_0	57,696	364,873	6.3241
07 Apr 2012 20:09:29	1089092	13967251	hadam3p_pnw_8jj2_2003_1_007698266_0	46,176	288,987	6.2584
26 Mar 2012 22:31:33	1089092	13967251	hadam3p_pnw_8jj2_2003_1_007698266_0	34,657	216,113	6.2358
26 Mar 2012 21:30:18	1089092	13967251	hadam3p_pnw_8jj2_2003_1_007698266_0	34,656	215,166	6.2086
24 Mar 2012 19:43:30	1089092	13967251	hadam3p_pnw_8jj2_2003_1_007698266_0	23,136	144,465	6.2442
21 Mar 2012 23:30:46	1089092	13967251	hadam3p_pnw_8jj2_2003_1_007698266_0	11,617	70,434	6.0630
21 Mar 2012 22:29:23	1089092	13967251	hadam3p_pnw_8jj2_2003_1_007698266_0	11,616	69,600	5.9917