Task 13839589

Name	hadam3p_saf_7a5u_2003_1_007625479_0
Workunit	7803798
Created	30 Dec 2011, 15:04:33 UTC
Sent	30 Dec 2011, 18:47:32 UTC
Report deadline	12 Dec 2012, 0:07:32 UTC
Received	3 May 2012, 15:47:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	933066
Run time	12 days 19 hours 10 min 20 sec
CPU time	11 days 0 hours 5 min 15 sec
Validate state	Invalid
Credit	1,309.70
Device peak FLOPS	0.81 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2904, selfPID=2896, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3816, selfPID=1804, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3580, selfPID=3580, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:59:36 (2792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:37 (2792): No heartbeat from core client for 30 sec - exiting 21:59:38 (2792): No heartbeat from core client for 30 sec - exiting 21:59:39 (2792): No heartbeat from core client for 30 sec - exiting 21:59:40 (2792): No heartbeat from core client for 30 sec - exiting 21:59:41 (2792): No heartbeat from core client for 30 sec - exiting 21:59:42 (2792): No heartbeat from core client for 30 sec - exiting 21:59:43 (2792): No heartbeat from core client for 30 sec - exiting 21:59:44 (2792): No heartbeat from core client for 30 sec - exiting 21:59:45 (2792): No heartbeat from core client for 30 sec - exiting 21:59:46 (2792): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2080, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 15:16:46 (1928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:16:47 (1928): No heartbeat from core client for 30 sec - exiting 15:16:48 (1928): No heartbeat from core client for 30 sec - exiting 15:16:49 (1928): No heartbeat from core client for 30 sec - exiting 15:16:50 (1928): No heartbeat from core client for 30 sec - exiting 15:19:37 (3708): No heartbeat from core client for 30 sec - exiting 15:19:39 (3708): No heartbeat from core client for 30 sec - exiting 15:19:40 (3708): No heartbeat from core client for 30 sec - exiting 15:19:41 (3708): No heartbeat from core client for 30 sec - exiting 15:19:42 (3708): No heartbeat from core client for 30 sec - exiting 15:19:43 (3708): No heartbeat from core client for 30 sec - exiting 15:19:44 (3708): No heartbeat from core client for 30 sec - exiting 15:19:45 (3708): No heartbeat from core client for 30 sec - exiting 15:19:46 (3708): No heartbeat from core client for 30 sec - exiting 15:19:47 (3708): No heartbeat from core client for 30 sec - exiting 15:19:50 (3708): No heartbeat from core client for 30 sec - exiting 15:19:51 (3708): No heartbeat from core client for 30 sec - exiting 15:19:52 (3708): No heartbeat from core client for 30 sec - exiting 15:19:53 (3708): No heartbeat from core client for 30 sec - exiting 15:19:54 (3708): No heartbeat from core client for 30 sec - exiting 15:19:55 (3708): No heartbeat from core client for 30 sec - exiting 15:19:56 (3708): No heartbeat from core client for 30 sec - exiting 15:19:58 (3708): No heartbeat from core client for 30 sec - exiting 15:19:59 (3708): No heartbeat from core client for 30 sec - exiting 15:20:00 (3708): No heartbeat from core client for 30 sec - exiting 15:20:01 (3708): No heartbeat from core client for 30 sec - exiting 15:20:03 (3708): No heartbeat from core client for 30 sec - exiting 15:20:08 (3708): No heartbeat from core client for 30 sec - exiting 15:20:09 (3708): No heartbeat from core client for 30 sec - exiting 15:20:11 (3708): No heartbeat from core client for 30 sec - exiting 15:20:12 (3708): No heartbeat from core client for 30 sec - exiting 15:20:13 (3708): No heartbeat from core client for 30 sec - exiting 15:20:14 (3708): No heartbeat from core client for 30 sec - exiting 15:20:15 (3708): No heartbeat from core client for 30 sec - exiting 15:20:16 (3708): No heartbeat from core client for 30 sec - exiting 15:20:17 (3708): No heartbeat from core client for 30 sec - exiting 15:20:18 (3708): No heartbeat from core client for 30 sec - exiting 15:20:19 (3708): No heartbeat from core client for 30 sec - exiting 15:20:21 (3708): No heartbeat from core client for 30 sec - exiting 15:20:22 (3708): No heartbeat from core client for 30 sec - exiting 15:20:23 (3708): No heartbeat from core client for 30 sec - exiting 15:20:24 (3708): No heartbeat from core client for 30 sec - exiting 15:20:25 (3708): No heartbeat from core client for 30 sec - exiting 15:20:27 (3708): No heartbeat from core client for 30 sec - exiting 15:20:28 (3708): No heartbeat from core client for 30 sec - exiting 15:20:29 (3708): No heartbeat from core client for 30 sec - exiting 15:20:30 (3708): No heartbeat from core client for 30 sec - exiting 15:20:31 (3708): No heartbeat from core client for 30 sec - exiting 15:20:32 (3708): No heartbeat from core client for 30 sec - exiting 15:20:33 (3708): No heartbeat from core client for 30 sec - exiting 15:20:34 (3708): No heartbeat from core client for 30 sec - exiting 15:20:35 (3708): No heartbeat from core client for 30 sec - exiting 15:20:36 (3708): No heartbeat from core client for 30 sec - exiting 15:20:37 (3708): No heartbeat from core client for 30 sec - exiting 15:20:38 (3708): No heartbeat from core client for 30 sec - exiting 15:20:39 (3708): No heartbeat from core client for 30 sec - exiting 15:20:40 (3708): No heartbeat from core client for 30 sec - exiting 15:20:41 (3708): No heartbeat from core client for 30 sec - exiting 15:20:42 (3708): No heartbeat from core client for 30 sec - exiting 15:20:43 (3708): No heartbeat from core client for 30 sec - exiting 15:20:44 (3708): No heartbeat from core client for 30 sec - exiting 15:20:45 (3708): No heartbeat from core client for 30 sec - exiting 15:20:46 (3708): No heartbeat from core client for 30 sec - exiting 15:20:48 (3708): No heartbeat from core client for 30 sec - exiting 15:20:49 (3708): No heartbeat from core client for 30 sec - exiting 15:20:50 (3708): No heartbeat from core client for 30 sec - exiting 15:20:51 (3708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:52 (3708): No heartbeat from core client for 30 sec - exiting 15:20:53 (3708): No heartbeat from core client for 30 sec - exiting 15:20:54 (3708): No heartbeat from core client for 30 sec - exiting 15:20:55 (3708): No heartbeat from core client for 30 sec - exiting 15:20:56 (3708): No heartbeat from core client for 30 sec - exiting 15:20:57 (3708): No heartbeat from core client for 30 sec - exiting 15:20:58 (3708): No heartbeat from core client for 30 sec - exiting 15:20:59 (3708): No heartbeat from core client for 30 sec - exiting 15:21:00 (3708): No heartbeat from core client for 30 sec - exiting 15:21:01 (3708): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1304, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3336, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_7a5u_2003_1_007625479_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7a5u_2003_1_007625479_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7a5u_2003_1_007625479_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7a5u_2003_1_007625479_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7a5u_2003_1_007625479_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Apr 2012 06:01:58	933066	13839589	hadam3p_saf_7a5u_2003_1_007625479_0	80,736	842,818	10.4392
25 Jan 2012 10:07:17	933066	13839589	hadam3p_saf_7a5u_2003_1_007625479_0	69,216	726,713	10.4992
25 Jan 2012 10:07:17	933066	13839589	hadam3p_saf_7a5u_2003_1_007625479_0	57,696	606,178	10.5064
25 Jan 2012 10:07:17	933066	13839589	hadam3p_saf_7a5u_2003_1_007625479_0	46,176	485,292	10.5096
25 Jan 2012 10:07:17	933066	13839589	hadam3p_saf_7a5u_2003_1_007625479_0	34,656	363,194	10.4800
14 Jan 2012 08:17:03	933066	13839589	hadam3p_saf_7a5u_2003_1_007625479_0	23,136	241,018	10.4174
11 Jan 2012 12:40:01	933066	13839589	hadam3p_saf_7a5u_2003_1_007625479_0	11,616	122,138	10.5146