Task 15139164

Name	hadam3p_saf_1qum_2005_1_006991430_1
Workunit	7194746
Created	18 Aug 2012, 11:28:08 UTC
Sent	18 Aug 2012, 11:28:45 UTC
Report deadline	31 Jul 2013, 16:48:45 UTC
Received	30 Aug 2012, 0:19:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1122757
Run time	1 days 11 hours 22 min 26 sec
CPU time	1 days 9 hours 47 min 30 sec
Validate state	Invalid
Credit	191.37
Device peak FLOPS	0.78 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> 17:17:52 (5476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:53 (4452): No heartbeat from core client for 30 sec - exiting 19:24:55 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:00:40 (4660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:02:10 (400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:12:13 (884): No heartbeat from core client for 30 sec - exiting 14:12:52 (884): No heartbeat from core client for 30 sec - exiting 14:12:53 (884): No heartbeat from core client for 30 sec - exiting 14:12:54 (884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:37:31 (4324): No heartbeat from core client for 30 sec - exiting 16:37:32 (4324): No heartbeat from core client for 30 sec - exiting 16:37:33 (4324): No heartbeat from core client for 30 sec - exiting 16:37:34 (4324): No heartbeat from core client for 30 sec - exiting 16:37:35 (4324): No heartbeat from core client for 30 sec - exiting 16:37:36 (4324): No heartbeat from core client for 30 sec - exiting 16:37:37 (4324): No heartbeat from core client for 30 sec - exiting 16:37:38 (4324): No heartbeat from core client for 30 sec - exiting 16:37:39 (4324): No heartbeat from core client for 30 sec - exiting 16:37:41 (4324): No heartbeat from core client for 30 sec - exiting 16:37:42 (4324): No heartbeat from core client for 30 sec - exiting 16:37:43 (4324): No heartbeat from core client for 30 sec - exiting 16:37:44 (4324): No heartbeat from core client for 30 sec - exiting 16:37:45 (4324): No heartbeat from core client for 30 sec - exiting 16:37:46 (4324): No heartbeat from core client for 30 sec - exiting 16:37:47 (4324): No heartbeat from core client for 30 sec - exiting 16:37:48 (4324): No heartbeat from core client for 30 sec - exiting 16:37:49 (4324): No heartbeat from core client for 30 sec - exiting 16:37:50 (4324): No heartbeat from core client for 30 sec - exiting 16:37:51 (4324): No heartbeat from core client for 30 sec - exiting 16:37:52 (4324): No heartbeat from core client for 30 sec - exiting 16:37:54 (4324): No heartbeat from core client for 30 sec - exiting 16:37:55 (4324): No heartbeat from core client for 30 sec - exiting 16:37:55 (3836): Can't acquire lockfile (32) - waiting 35s 16:37:56 (4324): No heartbeat from core client for 30 sec - exiting 16:37:57 (4324): No heartbeat from core client for 30 sec - exiting 16:37:58 (4324): No heartbeat from core client for 30 sec - exiting 16:37:59 (4324): No heartbeat from core client for 30 sec - exiting 16:38:00 (4324): No heartbeat from core client for 30 sec - exiting 16:38:01 (4324): No heartbeat from core client for 30 sec - exiting 16:38:02 (4324): No heartbeat from core client for 30 sec - exiting 16:38:03 (4324): No heartbeat from core client for 30 sec - exiting 16:38:04 (4324): No heartbeat from core client for 30 sec - exiting 16:38:06 (4324): No heartbeat from core client for 30 sec - exiting 16:38:07 (4324): No heartbeat from core client for 30 sec - exiting 16:38:08 (4324): No heartbeat from core client for 30 sec - exiting 16:38:09 (4324): No heartbeat from core client for 30 sec - exiting 16:38:10 (4324): No heartbeat from core client for 30 sec - exiting 16:38:11 (4324): No heartbeat from core client for 30 sec - exiting 16:38:12 (4324): No heartbeat from core client for 30 sec - exiting 16:38:13 (4324): No heartbeat from core client for 30 sec - exiting 16:38:14 (4324): No heartbeat from core client for 30 sec - exiting 16:38:15 (4324): No heartbeat from core client for 30 sec - exiting 16:38:16 (4324): No heartbeat from core client for 30 sec - exiting 16:38:18 (4324): No heartbeat from core client for 30 sec - exiting 16:38:19 (4324): No heartbeat from core client for 30 sec - exiting 16:38:20 (4324): No heartbeat from core client for 30 sec - exiting 16:38:21 (4324): No heartbeat from core client for 30 sec - exiting 16:38:22 (4324): No heartbeat from core client for 30 sec - exiting 16:38:23 (4324): No heartbeat from core client for 30 sec - exiting 16:38:24 (4324): No heartbeat from core client for 30 sec - exiting 16:38:25 (4324): No heartbeat from core client for 30 sec - exiting 16:38:26 (4324): No heartbeat from core client for 30 sec - exiting 16:38:27 (4324): No heartbeat from core client for 30 sec - exiting 16:38:28 (4324): No heartbeat from core client for 30 sec - exiting 16:38:30 (4324): No heartbeat from core client for 30 sec - exiting 16:38:30 (3836): Can't acquire lockfile (32) - exiting 16:38:30 (3836): Error: The process cannot access the file because it is being used by another process. (0x20) 16:38:31 (4324): No heartbeat from core client for 30 sec - exiting 16:38:32 (4324): No heartbeat from core client for 30 sec - exiting 16:38:33 (4324): No heartbeat from core client for 30 sec - exiting 16:38:34 (4324): No heartbeat from core client for 30 sec - exiting 16:38:35 (4324): No heartbeat from core client for 30 sec - exiting 16:38:36 (4324): No heartbeat from core client for 30 sec - exiting 16:38:37 (4324): No heartbeat from core client for 30 sec - exiting 16:38:38 (4324): No heartbeat from core client for 30 sec - exiting 16:38:39 (4324): No heartbeat from core client for 30 sec - exiting 16:38:40 (4324): No heartbeat from core client for 30 sec - exiting 16:38:42 (4324): No heartbeat from core client for 30 sec - exiting 16:38:43 (4324): No heartbeat from core client for 30 sec - exiting 16:38:44 (4324): No heartbeat from core client for 30 sec - exiting 16:38:45 (4324): No heartbeat from core client for 30 sec - exiting 16:38:46 (4324): No heartbeat from core client for 30 sec - exiting 16:38:47 (4324): No heartbeat from core client for 30 sec - exiting 16:38:48 (4324): No heartbeat from core client for 30 sec - exiting 16:38:49 (4324): No heartbeat from core client for 30 sec - exiting 16:38:50 (4324): No heartbeat from core client for 30 sec - exiting 16:38:51 (4324): No heartbeat from core client for 30 sec - exiting 16:38:53 (4324): No heartbeat from core client for 30 sec - exiting 16:38:54 (4324): No heartbeat from core client for 30 sec - exiting 16:38:55 (4324): No heartbeat from core client for 30 sec - exiting 16:38:56 (4324): No heartbeat from core client for 30 sec - exiting 16:38:57 (4324): No heartbeat from core client for 30 sec - exiting 16:38:58 (4324): No heartbeat from core client for 30 sec - exiting 16:38:59 (4324): No heartbeat from core client for 30 sec - exiting 16:39:00 (4324): No heartbeat from core client for 30 sec - exiting 16:39:01 (4324): No heartbeat from core client for 30 sec - exiting 16:39:02 (4324): No heartbeat from core client for 30 sec - exiting 16:39:03 (4324): No heartbeat from core client for 30 sec - exiting 16:39:05 (4324): No heartbeat from core client for 30 sec - exiting 16:39:06 (4324): No heartbeat from core client for 30 sec - exiting 16:39:07 (4324): No heartbeat from core client for 30 sec - exiting 16:39:08 (4324): No heartbeat from core client for 30 sec - exiting 16:39:09 (4324): No heartbeat from core client for 30 sec - exiting 16:39:10 (4324): No heartbeat from core client for 30 sec - exiting 16:39:11 (4324): No heartbeat from core client for 30 sec - exiting 16:39:12 (4324): No heartbeat from core client for 30 sec - exiting 16:39:13 (4324): No heartbeat from core client for 30 sec - exiting 16:39:14 (4324): No heartbeat from core client for 30 sec - exiting 16:39:15 (4324): No heartbeat from core client for 30 sec - exiting 16:39:17 (4324): No heartbeat from core client for 30 sec - exiting 16:39:18 (4324): No heartbeat from core client for 30 sec - exiting 16:39:19 (4324): No heartbeat from core client for 30 sec - exiting 16:39:20 (4324): No heartbeat from core client for 30 sec - exiting 16:39:21 (4324): No heartbeat from core client for 30 sec - exiting 16:39:22 (4324): No heartbeat from core client for 30 sec - exiting 16:39:23 (4324): No heartbeat from core client for 30 sec - exiting 16:39:24 (4324): No heartbeat from core client for 30 sec - exiting 16:39:25 (4324): No heartbeat from core client for 30 sec - exiting 16:39:26 (4324): No heartbeat from core client for 30 sec - exiting 16:39:27 (4324): No heartbeat from core client for 30 sec - exiting 16:39:29 (4324): No heartbeat from core client for 30 sec - exiting 16:39:30 (4324): No heartbeat from core client for 30 sec - exiting 16:39:31 (4324): No heartbeat from core client for 30 sec - exiting 16:39:32 (4324): No heartbeat from core client for 30 sec - exiting 16:39:33 (4324): No heartbeat from core client for 30 sec - exiting 16:39:34 (4324): No heartbeat from core client for 30 sec - exiting 16:39:35 (4324): No heartbeat from core client for 30 sec - exiting 16:39:36 (4324): No heartbeat from core client for 30 sec - exiting 16:39:37 (4324): No heartbeat from core client for 30 sec - exiting 16:39:38 (4324): No heartbeat from core client for 30 sec - exiting 16:39:39 (4324): No heartbeat from core client for 30 sec - exiting 16:39:41 (4324): No heartbeat from core client for 30 sec - exiting 16:39:42 (4324): No heartbeat from core client for 30 sec - exiting 16:39:43 (4324): No heartbeat from core client for 30 sec - exiting 16:39:44 (4324): No heartbeat from core client for 30 sec - exiting 16:39:45 (4324): No heartbeat from core client for 30 sec - exiting 16:39:46 (4324): No heartbeat from core client for 30 sec - exiting 16:39:47 (4324): No heartbeat from core client for 30 sec - exiting 16:39:48 (4324): No heartbeat from core client for 30 sec - exiting 16:39:49 (4324): No heartbeat from core client for 30 sec - exiting 16:39:50 (4324): No heartbeat from core client for 30 sec - exiting 16:39:51 (4324): No heartbeat from core client for 30 sec - exiting 16:39:53 (4324): No heartbeat from core client for 30 sec - exiting 16:39:54 (4324): No heartbeat from core client for 30 sec - exiting 16:39:55 (4324): No heartbeat from core client for 30 sec - exiting 16:39:56 (4324): No heartbeat from core client for 30 sec - exiting 16:39:57 (4324): No heartbeat from core client for 30 sec - exiting 16:39:58 (4324): No heartbeat from core client for 30 sec - exiting 16:39:59 (4324): No heartbeat from core client for 30 sec - exiting 16:40:00 (4324): No heartbeat from core client for 30 sec - exiting 16:40:01 (4324): No heartbeat from core client for 30 sec - exiting 16:40:02 (4324): No heartbeat from core client for 30 sec - exiting 16:40:03 (4324): No heartbeat from core client for 30 sec - exiting 16:40:05 (4324): No heartbeat from core client for 30 sec - exiting 16:40:06 (4324): No heartbeat from core client for 30 sec - exiting 16:40:07 (4324): No heartbeat from core client for 30 sec - exiting 16:40:08 (4324): No heartbeat from core client for 30 sec - exiting 16:40:09 (4324): No heartbeat from core client for 30 sec - exiting 16:40:10 (4324): No heartbeat from core client for 30 sec - exiting 16:40:11 (4324): No heartbeat from core client for 30 sec - exiting 16:40:12 (4324): No heartbeat from core client for 30 sec - exiting 16:40:13 (4324): No heartbeat from core client for 30 sec - exiting 16:40:14 (4324): No heartbeat from core client for 30 sec - exiting 16:40:16 (4324): No heartbeat from core client for 30 sec - exiting 16:40:17 (4324): No heartbeat from core client for 30 sec - exiting 16:40:18 (4324): No heartbeat from core client for 30 sec - exiting 16:40:19 (4324): No heartbeat from core client for 30 sec - exiting 16:40:20 (4324): No heartbeat from core client for 30 sec - exiting 16:40:21 (4324): No heartbeat from core client for 30 sec - exiting 16:40:22 (4324): No heartbeat from core client for 30 sec - exiting 16:40:23 (4324): No heartbeat from core client for 30 sec - exiting 16:40:24 (4324): No heartbeat from core client for 30 sec - exiting 16:40:25 (4324): No heartbeat from core client for 30 sec - exiting 16:40:26 (4324): No heartbeat from core client for 30 sec - exiting 16:40:28 (4324): No heartbeat from core client for 30 sec - exiting 16:40:29 (4324): No heartbeat from core client for 30 sec - exiting 16:40:30 (4324): No heartbeat from core client for 30 sec - exiting 16:40:31 (4324): No heartbeat from core client for 30 sec - exiting 16:40:32 (4324): No heartbeat from core client for 30 sec - exiting 16:40:33 (4324): No heartbeat from core client for 30 sec - exiting 16:40:34 (4324): No heartbeat from core client for 30 sec - exiting 16:40:35 (4324): No heartbeat from core client for 30 sec - exiting 16:40:36 (4324): No heartbeat from core client for 30 sec - exiting 16:40:37 (4324): No heartbeat from core client for 30 sec - exiting 16:40:38 (4324): No heartbeat from core client for 30 sec - exiting 16:40:40 (4324): No heartbeat from core client for 30 sec - exiting 16:40:41 (4324): No heartbeat from core client for 30 sec - exiting 16:40:42 (4324): No heartbeat from core client for 30 sec - exiting 16:40:43 (4324): No heartbeat from core client for 30 sec - exiting 16:40:44 (4324): No heartbeat from core client for 30 sec - exiting 16:40:45 (4324): No heartbeat from core client for 30 sec - exiting 16:40:46 (4324): No heartbeat from core client for 30 sec - exiting 16:40:47 (4324): No heartbeat from core client for 30 sec - exiting 16:40:48 (4324): No heartbeat from core client for 30 sec - exiting 16:40:49 (4324): No heartbeat from core client for 30 sec - exiting 16:40:50 (4324): No heartbeat from core client for 30 sec - exiting 16:40:52 (4324): No heartbeat from core client for 30 sec - exiting 16:40:53 (4324): No heartbeat from core client for 30 sec - exiting 16:40:54 (4324): No heartbeat from core client for 30 sec - exiting 16:40:55 (4324): No heartbeat from core client for 30 sec - exiting 16:40:56 (4324): No heartbeat from core client for 30 sec - exiting 16:40:57 (4324): No heartbeat from core client for 30 sec - exiting 16:40:58 (4324): No heartbeat from core client for 30 sec - exiting 16:40:59 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4196, selfPID=4196, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 02:23:42 (4448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:24 (4328): No heartbeat from core client for 30 sec - exiting 03:30:01 (4328): No heartbeat from core client for 30 sec - exiting 03:30:02 (4328): No heartbeat from core client for 30 sec - exiting 03:30:03 (4328): No heartbeat from core client for 30 sec - exiting 03:30:05 (4328): No heartbeat from core client for 30 sec - exiting 03:30:06 (4328): No heartbeat from core client for 30 sec - exiting 03:30:07 (4328): No heartbeat from core client for 30 sec - exiting 03:30:08 (4328): No heartbeat from core client for 30 sec - exiting 03:30:09 (4328): No heartbeat from core client for 30 sec - exiting 03:30:10 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:39 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:45 (960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:15 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:04:13 (2924): No heartbeat from core client for 30 sec - exiting 05:04:17 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:30:19 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:42:25 (2648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:13 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:17 (5020): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=484, selfPID=484, iMonCtr=2 05:51:27 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:23:58 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:44:07 (1600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:37 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:08 (5284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:13 (5284): No heartbeat from core client for 30 sec - exiting 11:37:14 (5284): No heartbeat from core client for 30 sec - exiting 11:37:16 (5284): No heartbeat from core client for 30 sec - exiting 11:37:17 (5284): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1qum_2005_1_006991430_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Aug 2012 00:08:55	1122757	15139164	hadam3p_saf_1qum_2005_1_006991430_1	11,797	93,627	7.9365
30 Aug 2012 00:08:55	1122757	15139164	hadam3p_saf_1qum_2005_1_006991430_1	11,729	91,077	7.7651
29 Aug 2012 11:31:00	1122757	15139164	hadam3p_saf_1qum_2005_1_006991430_1	11,616	89,561	7.7101