Task 13899250

Name	hadam3p_pnw_78d6_2008_1_007674388_0
Workunit	7829475
Created	11 Jan 2012, 22:27:47 UTC
Sent	11 Jan 2012, 22:27:48 UTC
Report deadline	24 Dec 2012, 3:47:48 UTC
Received	28 Mar 2012, 19:07:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	256108
Run time	4 days 3 hours 59 min 51 sec
CPU time	3 days 10 hours 7 min 44 sec
Validate state	Invalid
Credit	1,752.21
Device peak FLOPS	2.94 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:16:05 (30092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:14 (30104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:18:22 (30114): No heartbeat from core client for 30 sec - exiting 15:18:23 (30114): No heartbeat from core client for 30 sec - exiting 15:18:24 (30114): No heartbeat from core client for 30 sec - exiting 15:18:25 (30114): No heartbeat from core client for 30 sec - exiting 15:18:26 (30114): No heartbeat from core client for 30 sec - exiting 15:18:27 (30114): No heartbeat from core client for 30 sec - exiting 15:18:28 (30114): No heartbeat from core client for 30 sec - exiting 15:18:29 (30114): No heartbeat from core client for 30 sec - exiting 15:18:30 (30114): No heartbeat from core client for 30 sec - exiting 15:18:31 (30114): No heartbeat from core client for 30 sec - exiting 15:18:32 (30114): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:15 (30124): No heartbeat from core client for 30 sec - exiting 15:20:17 (30124): No heartbeat from core client for 30 sec - exiting 15:20:18 (30124): No heartbeat from core client for 30 sec - exiting 15:20:19 (30124): No heartbeat from core client for 30 sec - exiting 15:20:20 (30124): No heartbeat from core client for 30 sec - exiting 15:20:21 (30124): No heartbeat from core client for 30 sec - exiting 15:20:22 (30124): No heartbeat from core client for 30 sec - exiting 15:20:23 (30124): No heartbeat from core client for 30 sec - exiting 15:20:24 (30124): No heartbeat from core client for 30 sec - exiting 15:20:25 (30124): No heartbeat from core client for 30 sec - exiting 15:20:26 (30124): No heartbeat from core client for 30 sec - exiting 15:20:27 (30124): No heartbeat from core client for 30 sec - exiting 15:20:28 (30124): No heartbeat from core client for 30 sec - exiting 15:20:29 (30124): No heartbeat from core client for 30 sec - exiting 15:20:30 (30124): No heartbeat from core client for 30 sec - exiting 15:20:31 (30124): No heartbeat from core client for 30 sec - exiting 15:20:32 (30124): No heartbeat from core client for 30 sec - exiting 15:20:33 (30124): No heartbeat from core client for 30 sec - exiting 15:20:34 (30124): No heartbeat from core client for 30 sec - exiting 15:20:35 (30124): No heartbeat from core client for 30 sec - exiting 15:20:36 (30124): No heartbeat from core client for 30 sec - exiting 15:20:37 (30124): No heartbeat from core client for 30 sec - exiting 15:20:38 (30124): No heartbeat from core client for 30 sec - exiting 15:20:39 (30124): No heartbeat from core client for 30 sec - exiting 15:20:40 (30124): No heartbeat from core client for 30 sec - exiting 15:20:41 (30124): No heartbeat from core client for 30 sec - exiting 15:20:42 (30124): No heartbeat from core client for 30 sec - exiting 15:20:43 (30124): No heartbeat from core client for 30 sec - exiting 15:20:44 (30124): No heartbeat from core client for 30 sec - exiting 15:20:45 (30124): No heartbeat from core client for 30 sec - exiting 15:20:46 (30124): No heartbeat from core client for 30 sec - exiting 15:20:47 (30124): No heartbeat from core client for 30 sec - exiting 15:20:48 (30124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:53:46 (30355): No heartbeat from core client for 30 sec - exiting 15:53:47 (30355): No heartbeat from core client for 30 sec - exiting 15:53:48 (30355): No heartbeat from core client for 30 sec - exiting 15:53:49 (30355): No heartbeat from core client for 30 sec - exiting 15:53:50 (30355): No heartbeat from core client for 30 sec - exiting 15:53:51 (30355): No heartbeat from core client for 30 sec - exiting 15:53:52 (30355): No heartbeat from core client for 30 sec - exiting 15:53:53 (30355): No heartbeat from core client for 30 sec - exiting 15:53:54 (30355): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:54:37 (30364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:57:24 (30370): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:45 (30374): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:40 (30388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish 02:40:37 (10046): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:59:16 (10594): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadam3p_pnw_um_6.09_i686-apple-darwin, 171025) failed! execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadrm3p_pnw_um_6.09_i686-apple-darwin, 171025) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1002, selfPID=990, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_78d6_2008_1_007674388_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_78d6_2008_1_007674388_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_78d6_2008_1_007674388_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_78d6_2008_1_007674388_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_78d6_2008_1_007674388_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Mar 2012 23:09:07	256108	13899250	hadam3p_pnw_78d6_2008_1_007674388_0	80,640	283,748	3.5187
14 Mar 2012 04:19:37	256108	13899250	hadam3p_pnw_78d6_2008_1_007674388_0	69,120	243,255	3.5193
12 Mar 2012 04:16:03	256108	13899250	hadam3p_pnw_78d6_2008_1_007674388_0	57,600	202,495	3.5155
04 Mar 2012 10:04:53	256108	13899250	hadam3p_pnw_78d6_2008_1_007674388_0	46,080	161,316	3.5008
02 Mar 2012 15:28:49	256108	13899250	hadam3p_pnw_78d6_2008_1_007674388_0	34,560	119,930	3.4702
29 Feb 2012 22:58:08	256108	13899250	hadam3p_pnw_78d6_2008_1_007674388_0	23,040	79,364	3.4446
27 Feb 2012 08:41:35	256108	13899250	hadam3p_pnw_78d6_2008_1_007674388_0	11,520	39,937	3.4668