Task 15138363

Name	hadam3p_saf_1l8b_1970_1_006974547_1
Workunit	7177863
Created	18 Aug 2012, 4:32:02 UTC
Sent	18 Aug 2012, 4:32:34 UTC
Report deadline	31 Jul 2013, 9:52:34 UTC
Received	2 Sep 2012, 18:01:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1232385
Run time	1 days 15 hours 39 min 40 sec
CPU time	1 days 12 hours 45 min 9 sec
Validate state	Invalid
Credit	1,496.58
Device peak FLOPS	3.31 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2164, selfPID=7396, iMonCtr=1 Model crash detected, will try to restart... 20:15:23 (5228): No heartbeat from core client for 30 sec - exiting 20:15:24 (5228): No heartbeat from core client for 30 sec - exiting 20:15:25 (5228): No heartbeat from core client for 30 sec - exiting 20:15:26 (5228): No heartbeat from core client for 30 sec - exiting 20:15:27 (5228): No heartbeat from core client for 30 sec - exiting 20:15:29 (5228): No heartbeat from core client for 30 sec - exiting 20:15:30 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:00:14 (5452): No heartbeat from core client for 30 sec - exiting 23:00:15 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:48:11 (4512): No heartbeat from core client for 30 sec - exiting 08:48:12 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:19:20 (4224): No heartbeat from core client for 30 sec - exiting 19:19:21 (4224): No heartbeat from core client for 30 sec - exiting 19:19:22 (4224): No heartbeat from core client for 30 sec - exiting 19:19:23 (4224): No heartbeat from core client for 30 sec - exiting 19:19:24 (4224): No heartbeat from core client for 30 sec - exiting 19:19:25 (4224): No heartbeat from core client for 30 sec - exiting 19:19:26 (4224): No heartbeat from core client for 30 sec - exiting 19:19:27 (4224): No heartbeat from core client for 30 sec - exiting 19:19:29 (4224): No heartbeat from core client for 30 sec - exiting 19:19:30 (4224): No heartbeat from core client for 30 sec - exiting 19:19:31 (4224): No heartbeat from core client for 30 sec - exiting 19:19:32 (4224): No heartbeat from core client for 30 sec - exiting 19:19:33 (4224): No heartbeat from core client for 30 sec - exiting 19:19:34 (4224): No heartbeat from core client for 30 sec - exiting 19:19:35 (4224): No heartbeat from core client for 30 sec - exiting 19:19:36 (4224): No heartbeat from core client for 30 sec - exiting 19:19:37 (4224): No heartbeat from core client for 30 sec - exiting 19:19:38 (4224): No heartbeat from core client for 30 sec - exiting 19:19:40 (4224): No heartbeat from core client for 30 sec - exiting 19:19:41 (4224): No heartbeat from core client for 30 sec - exiting 19:19:42 (4224): No heartbeat from core client for 30 sec - exiting 19:19:43 (4224): No heartbeat from core client for 30 sec - exiting 19:19:44 (4224): No heartbeat from core client for 30 sec - exiting 19:19:45 (4224): No heartbeat from core client for 30 sec - exiting 19:19:46 (4224): No heartbeat from core client for 30 sec - exiting 19:19:47 (4224): No heartbeat from core client for 30 sec - exiting 19:19:48 (4224): No heartbeat from core client for 30 sec - exiting 19:19:49 (4224): No heartbeat from core client for 30 sec - exiting 19:19:50 (4224): No heartbeat from core client for 30 sec - exiting 19:19:52 (4224): No heartbeat from core client for 30 sec - exiting 19:19:53 (4224): No heartbeat from core client for 30 sec - exiting 19:19:54 (4224): No heartbeat from core client for 30 sec - exiting 19:19:55 (4224): No heartbeat from core client for 30 sec - exiting 19:19:56 (4224): No heartbeat from core client for 30 sec - exiting 19:19:57 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9024, selfPID=7656, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 01:56:44 (5888): No heartbeat from core client for 30 sec - exiting 01:56:46 (5888): No heartbeat from core client for 30 sec - exiting 01:56:47 (5888): No heartbeat from core client for 30 sec - exiting 01:56:48 (5888): No heartbeat from core client for 30 sec - exiting 01:56:49 (5888): No heartbeat from core client for 30 sec - exiting 01:56:50 (5888): No heartbeat from core client for 30 sec - exiting 01:56:51 (5888): No heartbeat from core client for 30 sec - exiting 01:56:52 (5888): No heartbeat from core client for 30 sec - exiting 01:56:53 (5888): No heartbeat from core client for 30 sec - exiting 01:56:54 (5888): No heartbeat from core client for 30 sec - exiting 01:56:55 (5888): No heartbeat from core client for 30 sec - exiting 01:56:56 (5888): No heartbeat from core client for 30 sec - exiting 01:56:58 (5888): No heartbeat from core client for 30 sec - exiting 01:56:59 (5888): No heartbeat from core client for 30 sec - exiting 01:57:00 (5888): No heartbeat from core client for 30 sec - exiting 01:57:01 (5888): No heartbeat from core client for 30 sec - exiting 01:57:02 (5888): No heartbeat from core client for 30 sec - exiting 01:57:03 (5888): No heartbeat from core client for 30 sec - exiting 01:57:04 (5888): No heartbeat from core client for 30 sec - exiting 01:57:05 (5888): No heartbeat from core client for 30 sec - exiting 01:57:06 (5888): No heartbeat from core client for 30 sec - exiting 01:57:07 (5888): No heartbeat from core client for 30 sec - exiting 01:57:08 (5888): No heartbeat from core client for 30 sec - exiting 01:57:10 (5888): No heartbeat from core client for 30 sec - exiting 01:57:11 (5888): No heartbeat from core client for 30 sec - exiting 01:57:12 (5888): No heartbeat from core client for 30 sec - exiting 01:57:13 (5888): No heartbeat from core client for 30 sec - exiting 01:57:14 (5888): No heartbeat from core client for 30 sec - exiting 01:57:15 (5888): No heartbeat from core client for 30 sec - exiting 01:57:16 (5888): No heartbeat from core client for 30 sec - exiting 01:57:17 (5888): No heartbeat from core client for 30 sec - exiting 01:57:18 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:25:34 (3540): No heartbeat from core client for 30 sec - exiting 21:25:35 (3540): No heartbeat from core client for 30 sec - exiting 21:25:36 (3540): No heartbeat from core client for 30 sec - exiting 21:25:37 (3540): No heartbeat from core client for 30 sec - exiting 21:25:38 (3540): No heartbeat from core client for 30 sec - exiting 21:25:40 (3540): No heartbeat from core client for 30 sec - exiting 21:25:41 (3540): No heartbeat from core client for 30 sec - exiting 21:25:42 (3540): No heartbeat from core client for 30 sec - exiting 21:25:43 (3540): No heartbeat from core client for 30 sec - exiting 21:25:44 (3540): No heartbeat from core client for 30 sec - exiting 21:25:45 (3540): No heartbeat from core client for 30 sec - exiting 21:25:46 (3540): No heartbeat from core client for 30 sec - exiting 21:25:47 (3540): No heartbeat from core client for 30 sec - exiting 21:25:48 (3540): No heartbeat from core client for 30 sec - exiting 21:25:49 (3540): No heartbeat from core client for 30 sec - exiting 21:25:50 (3540): No heartbeat from core client for 30 sec - exiting 21:25:52 (3540): No heartbeat from core client for 30 sec - exiting 21:25:53 (3540): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=884, iMonCtr=1 CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:45:33 (1964): No heartbeat from core client for 30 sec - exiting 15:45:34 (1964): No heartbeat from core client for 30 sec - exiting 15:45:36 (1964): No heartbeat from core client for 30 sec - exiting 15:45:37 (1964): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=7876, iMonCtr=1 CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4740, iMonCtr=1 CRoetrolleg::onal orkerss is not rucening, exiting, bRetVal = 1, checkPID=4976, heckPID=4976, selfPID=49 7od, iMonCth de tected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_1l8b_1970_1_006974547_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1l8b_1970_1_006974547_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1l8b_1970_1_006974547_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1l8b_1970_1_006974547_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Sep 2012 18:08:53	1232385	15138363	hadam3p_saf_1l8b_1970_1_006974547_1	92,256	125,578	1.3612
28 Aug 2012 13:11:58	1232385	15138363	hadam3p_saf_1l8b_1970_1_006974547_1	80,736	110,179	1.3647
28 Aug 2012 08:05:52	1232385	15138363	hadam3p_saf_1l8b_1970_1_006974547_1	69,216	94,760	1.3690
24 Aug 2012 03:30:07	1232385	15138363	hadam3p_saf_1l8b_1970_1_006974547_1	57,696	79,263	1.3738
23 Aug 2012 22:58:57	1232385	15138363	hadam3p_saf_1l8b_1970_1_006974547_1	46,176	63,631	1.3780
23 Aug 2012 18:39:21	1232385	15138363	hadam3p_saf_1l8b_1970_1_006974547_1	34,656	47,989	1.3847
23 Aug 2012 05:15:40	1232385	15138363	hadam3p_saf_1l8b_1970_1_006974547_1	23,136	32,178	1.3908
20 Aug 2012 01:28:00	1232385	15138363	hadam3p_saf_1l8b_1970_1_006974547_1	11,616	16,383	1.4104