Task 12618666

Name	hadam3p_pnw_2zcs_1964_1_007179316_0
Workunit	7377598
Created	22 Feb 2011, 12:01:28 UTC
Sent	8 Mar 2011, 15:19:44 UTC
Report deadline	18 Feb 2012, 20:39:44 UTC
Received	24 Apr 2011, 1:07:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1137334
Run time	4 days 22 hours 28 min 3 sec
CPU time	4 days 9 hours 36 min 31 sec
Validate state	Invalid
Credit	1,754.30
Device peak FLOPS	1.73 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3340, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3780, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3336, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3896, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3424, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1664, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=512, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2280, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3532, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3784, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2496, selfPID=3792, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2260, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2588, selfPID=2588, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2044, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5936, iMonCtr=2 Model crash detected, will try to restart... 16:28:14 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2908, iMonCtr=2 00:29:07 (3708): No heartbeat from core client for 30 sec - exiting 00:29:08 (3708): No heartbeat from core client for 30 sec - exiting 00:29:09 (3708): No heartbeat from core client for 30 sec - exiting 00:29:10 (3708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3392, iMonCtr=2 02:19:39 (1780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3156, selfPID=3156, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 23:54:57 (3960): No heartbeat from core client for 30 sec - exiting 23:54:58 (3960): No heartbeat from core client for 30 sec - exiting 23:54:59 (3960): No heartbeat from core client for 30 sec - exiting 23:55:00 (3960): No heartbeat from core client for 30 sec - exiting 23:55:01 (3960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3440, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1180, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3440, selfPID=2300, iMonCtr=1 Model crash detected, will try to restart... 00:28:18 (3568): No heartbeat from core client for 30 sec - exiting 00:28:19 (3568): No heartbeat from core client for 30 sec - exiting 00:28:20 (3568): No heartbeat from core client for 30 sec - exiting 00:28:21 (3568): No heartbeat from core client for 30 sec - exiting 00:28:22 (3568): No heartbeat from core client for 30 sec - exiting 00:28:23 (3568): No heartbeat from core client for 30 sec - exiting 00:28:24 (3568): No heartbeat from core client for 30 sec - exiting 00:28:25 (3568): No heartbeat from core client for 30 sec - exiting 00:28:26 (3568): No heartbeat from core client for 30 sec - exiting 00:28:27 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=960, selfPID=960, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1564, selfPID=1564, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2136, selfPID=2136, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4048, selfPID=4048, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=740, selfPID=740, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=948, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2540, selfPID=2540, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3516, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=848, selfPID=848, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1016, selfPID=1016, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3316, selfPID=3316, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional yearly means requires 12 input files got 7 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 zip error: Could not create output file (was replacing the original zip file) 01:36:41 (3236): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_2zcs_1964_1_007179316_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2zcs_1964_1_007179316_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2zcs_1964_1_007179316_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2zcs_1964_1_007179316_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2zcs_1964_1_007179316_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2011 19:35:36	1137334	12618666	hadam3p_pnw_2zcs_1964_1_007179316_0	80,736	350,472	4.3410
09 Apr 2011 22:58:34	1137334	12618666	hadam3p_pnw_2zcs_1964_1_007179316_0	69,216	304,448	4.3985
05 Apr 2011 01:06:52	1137334	12618666	hadam3p_pnw_2zcs_1964_1_007179316_0	57,696	258,437	4.4793
30 Mar 2011 00:58:58	1137334	12618666	hadam3p_pnw_2zcs_1964_1_007179316_0	46,176	209,084	4.5280
26 Mar 2011 17:58:29	1137334	12618666	hadam3p_pnw_2zcs_1964_1_007179316_0	34,660	157,321	4.5390
25 Mar 2011 16:55:39	1137334	12618666	hadam3p_pnw_2zcs_1964_1_007179316_0	34,656	156,658	4.5204
19 Mar 2011 16:52:55	1137334	12618666	hadam3p_pnw_2zcs_1964_1_007179316_0	23,136	105,680	4.5678
14 Mar 2011 02:13:23	1137334	12618666	hadam3p_pnw_2zcs_1964_1_007179316_0	11,616	55,413	4.7704