Task 13683730

Name	hadam3p_saf_7966_2005_1_007568823_0
Workunit	7746953
Created	2 Dec 2011, 15:03:33 UTC
Sent	20 Dec 2011, 3:07:19 UTC
Report deadline	1 Dec 2012, 8:27:19 UTC
Received	8 Feb 2012, 6:17:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1184934
Run time	15 hours 46 min 52 sec
CPU time	15 hours 40 min 39 sec
Validate state	Invalid
Credit	562.74
Device peak FLOPS	2.96 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7548, selfPID=7548, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:01:32 (5956): No heartbeat from core client for 30 sec - exiting 14:01:33 (5956): No heartbeat from core client for 30 sec - exiting 14:01:34 (5956): No heartbeat from core client for 30 sec - exiting 14:01:35 (5956): No heartbeat from core client for 30 sec - exiting 14:01:36 (5956): No heartbeat from core client for 30 sec - exiting 14:01:37 (5956): No heartbeat from core client for 30 sec - exiting 14:01:38 (5956): No heartbeat from core client for 30 sec - exiting 14:01:39 (5956): No heartbeat from core client for 30 sec - exiting 14:01:40 (5956): No heartbeat from core client for 30 sec - exiting 14:01:41 (5956): No heartbeat from core client for 30 sec - exiting 14:01:42 (5956): No heartbeat from core client for 30 sec - exiting 14:01:43 (5956): No heartbeat from core client for 30 sec - exiting 14:01:44 (5956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3664, selfPID=3664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=376, selfPID=CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:42:07 (3844): No heartbeat from core client for 30 sec - exiting 07:42:08 (3844): No heartbeat from core client for 30 sec - exiting 07:42:09 (3844): No heartbeat from core client for 30 sec - exiting 07:42:10 (3844): No heartbeat from core client for 30 sec - exiting 07:42:11 (3844): No heartbeat from core client for 30 sec - exiting 07:42:13 (3844): No heartbeat from core client for 30 sec - exiting 07:42:14 (3844): No heartbeat from core client for 30 sec - exiting 07:42:15 (3844): No heartbeat from core client for 30 sec - exiting 07:42:16 (3844): No heartbeat from core client for 30 sec - exiting 07:42:17 (3844): No heartbeat from core client for 30 sec - exiting 07:42:18 (3844): No heartbeat from core client for 30 sec - exiting 07:42:19 (3844): No heartbeat from core client for 30 sec - exiting 07:42:20 (3844): No heartbeat from core client for 30 sec - exiting 07:42:21 (3844): No heartbeat from core client for 30 sec - exiting 07:42:22 (3844): No heartbeat from core client for 30 sec - exiting 07:42:23 (3844): No heartbeat from core client for 30 sec - exiting 07:42:24 (3844): No heartbeat from core client for 30 sec - exiting 07:42:25 (3844): No heartbeat from core client for 30 sec - exiting 07:42:27 (3844): No heartbeat from core client for 30 sec - exiting 07:42:28 (3844): No heartbeat from core client for 30 sec - exiting 07:42:29 (3844): No heartbeat from core client for 30 sec - exiting 07:42:30 (3844): No heartbeat from core client for 30 sec - exiting 07:42:31 (3844): No heartbeat from core client for 30 sec - exiting 07:42:32 (3844): No heartbeat from core client for 30 sec - exiting 07:42:33 (3844): No heartbeat from core client for 30 sec - exiting 07:42:34 (3844): No heartbeat from core client for 30 sec - exiting 07:42:35 (3844): No heartbeat from core client for 30 sec - exiting 07:42:36 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5948, selfPID=5948, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3860, selfPID=3860, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2596, selfPID=2596, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4880, selfPID=4880, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5740, selfPID=5740, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:12:56 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3412, selfPID=3412, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5240, selfPID=5240, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5316, selfPID=5316, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7008, selfPID=7008, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. forrtl: severe (38): error during write, unit 6, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadam3p_saf_7966_2005_1_007568823\dataout\xaakm.out Image PC Routine Line Source hadam3p_saf_um_6. 0076A39A Unknown Unknown Unknown hadam3p_saf_um_6. 007676C8 Unknown Unknown Unknown hadam3p_saf_um_6. 00712CD0 Unknown Unknown Unknown hadam3p_saf_um_6. 00711E9A Unknown Unknown Unknown hadam3p_saf_um_6. 006E5DA1 Unknown Unknown Unknown hadam3p_saf_um_6. 006E2CA5 Unknown Unknown Unknown hadam3p_saf_um_6. 0068E79E Unknown Unknown Unknown hadam3p_saf_um_6. 0068F2DA Unknown Unknown Unknown hadam3p_saf_um_6. 00409BD2 Unknown Unknown Unknown hadam3p_saf_um_6. 0074E638 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2808, selfPID=2808, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2808, selfPID=1172, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_7966_2005_1_007568823_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7966_2005_1_007568823_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7966_2005_1_007568823_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7966_2005_1_007568823_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7966_2005_1_007568823_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7966_2005_1_007568823_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7966_2005_1_007568823_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7966_2005_1_007568823_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7966_2005_1_007568823_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Feb 2012 02:09:20	1184934	13683730	hadam3p_saf_7966_2005_1_007568823_0	34,690	53,971	1.5558
07 Feb 2012 02:09:20	1184934	13683730	hadam3p_saf_7966_2005_1_007568823_0	34,685	53,734	1.5492
07 Feb 2012 01:08:15	1184934	13683730	hadam3p_saf_7966_2005_1_007568823_0	34,679	53,496	1.5426
06 Feb 2012 23:57:01	1184934	13683730	hadam3p_saf_7966_2005_1_007568823_0	34,671	53,263	1.5362
06 Feb 2012 06:37:01	1184934	13683730	hadam3p_saf_7966_2005_1_007568823_0	34,661	53,036	1.5301
06 Feb 2012 04:50:18	1184934	13683730	hadam3p_saf_7966_2005_1_007568823_0	34,656	52,814	1.5239
31 Jan 2012 05:13:26	1184934	13683730	hadam3p_saf_7966_2005_1_007568823_0	23,136	35,215	1.5221
30 Jan 2012 00:49:56	1184934	13683730	hadam3p_saf_7966_2005_1_007568823_0	11,616	17,471	1.5040