Task 18344084

Name	hadam3p_anz_f754_2012_1_009778621_0
Workunit	9834585
Created	24 Apr 2015, 15:16:00 UTC
Sent	29 Apr 2015, 16:25:11 UTC
Report deadline	10 Apr 2016, 21:45:11 UTC
Received	13 May 2015, 9:33:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1361676
Run time	2 days 19 hours 59 min 15 sec
CPU time	2 days 11 hours 27 min 59 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	4.17 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5128, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1224, selfPID=5448, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6292, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7304, selfPID=4788, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:18:16 (1500): No heartbeat from core client for 30 sec - exiting 17:18:17 (1500): No heartbeat from core client for 30 sec - exiting 17:18:18 (1500): No heartbeat from core client for 30 sec - exiting 17:18:19 (1500): No heartbeat from core client for 30 sec - exiting 17:18:20 (1500): No heartbeat from core client for 30 sec - exiting 17:18:21 (1500): No heartbeat from core client for 30 sec - exiting 17:18:22 (1500): No heartbeat from core client for 30 sec - exiting 17:18:23 (1500): No heartbeat from core client for 30 sec - exiting 17:18:25 (1500): No heartbeat from core client for 30 sec - exiting 17:18:26 (1500): No heartbeat from core client for 30 sec - exiting 17:18:27 (1500): No heartbeat from core client for 30 sec - exiting 17:18:28 (1500): No heartbeat from core client for 30 sec - exiting 17:18:29 (1500): No heartbeat from core client for 30 sec - exiting 17:18:30 (1500): No heartbeat from core client for 30 sec - exiting 17:18:31 (1500): No heartbeat from core client for 30 sec - exiting 17:18:32 (1500): No heartbeat from core client for 30 sec - exiting 17:18:33 (1500): No heartbeat from core client for 30 sec - exiting 17:18:34 (1500): No heartbeat from core client for 30 sec - exiting 17:18:35 (1500): No heartbeat from core client for 30 sec - exiting 17:18:37 (1500): No heartbeat from core client for 30 sec - exiting 17:18:38 (1500): No heartbeat from core client for 30 sec - exiting 17:18:39 (1500): No heartbeat from core client for 30 sec - exiting 17:18:40 (1500): No heartbeat from core client for 30 sec - exiting 17:18:41 (1500): No heartbeat from core client for 30 sec - exiting 17:18:42 (1500): No heartbeat from core client for 30 sec - exiting 17:18:43 (1500): No heartbeat from core client for 30 sec - exiting 17:18:44 (1500): No heartbeat from core client for 30 sec - exiting 17:18:45 (1500): No heartbeat from core client for 30 sec - exiting 17:18:46 (1500): No heartbeat from core client for 30 sec - exiting 17:18:48 (1500): No heartbeat from core client for 30 sec - exiting 17:18:49 (1500): No heartbeat from core client for 30 sec - exiting 17:18:50 (1500): No heartbeat from core client for 30 sec - exiting 17:18:51 (1500): No heartbeat from core client for 30 sec - exiting 17:18:52 (1500): No heartbeat from core client for 30 sec - exiting 17:18:53 (1500): No heartbeat from core client for 30 sec - exiting 17:18:54 (1500): No heartbeat from core client for 30 sec - exiting 17:18:55 (1500): No heartbeat from core client for 30 sec - exiting 17:18:56 (1500): No heartbeat from core client for 30 sec - exiting 17:18:57 (1500): No heartbeat from core client for 30 sec - exiting 17:18:58 (1500): No heartbeat from core client for 30 sec - exiting 17:19:00 (1500): No heartbeat from core client for 30 sec - exiting 17:19:01 (1500): No heartbeat from core client for 30 sec - exiting 17:19:02 (1500): No heartbeat from core client for 30 sec - exiting 17:19:03 (1500): No heartbeat from core client for 30 sec - exiting 17:19:04 (1500): No heartbeat from core client for 30 sec - exiting 17:19:05 (1500): No heartbeat from core client for 30 sec - exiting 17:19:06 (1500): No heartbeat from core client for 30 sec - exiting 17:19:07 (1500): No heartbeat from core client for 30 sec - exiting 17:19:08 (1500): No heartbeat from core client for 30 sec - exiting 17:19:09 (1500): No heartbeat from core client for 30 sec - exiting 17:19:10 (1500): No heartbeat from core client for 30 sec - exiting 17:19:12 (1500): No heartbeat from core client for 30 sec - exiting 17:19:13 (1500): No heartbeat from core client for 30 sec - exiting 17:19:14 (1500): No heartbeat from core client for 30 sec - exiting 17:19:15 (1500): No heartbeat from core client for 30 sec - exiting 17:19:16 (1500): No heartbeat from core client for 30 sec - exiting 17:19:17 (1500): No heartbeat from core client for 30 sec - exiting 17:19:19 (1500): No heartbeat from core client for 30 sec - exiting 17:19:20 (1500): No heartbeat from core client for 30 sec - exiting 17:19:21 (1500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7272, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:39:42 (4400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:37:13 (8048): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6076, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7928, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:49:05 (6792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6160, iMonCtr=2 17:32:58 (7124): No heartbeat from core client for 30 sec - exiting 17:32:59 (7124): No heartbeat from core client for 30 sec - exiting 17:33:00 (7124): No heartbeat from core client for 30 sec - exiting 17:33:01 (7124): No heartbeat from core client for 30 sec - exiting 17:33:03 (7124): No heartbeat from core client for 30 sec - exiting 17:33:04 (7124): No heartbeat from core client for 30 sec - exiting 17:33:05 (7124): No heartbeat from core client for 30 sec - exiting 17:33:06 (7124): No heartbeat from core client for 30 sec - exiting 17:33:07 (7124): No heartbeat from core client for 30 sec - exiting 17:33:08 (7124): No heartbeat from core client for 30 sec - exiting 17:33:09 (7124): No heartbeat from core client for 30 sec - exiting 17:33:10 (7124): No heartbeat from core client for 30 sec - exiting 17:33:11 (7124): No heartbeat from core client for 30 sec - exiting 17:33:12 (7124): No heartbeat from core client for 30 sec - exiting 17:33:13 (7124): No heartbeat from core client for 30 sec - exiting 17:33:15 (7124): No heartbeat from core client for 30 sec - exiting 17:33:16 (7124): No heartbeat from core client for 30 sec - exiting 17:33:17 (7124): No heartbeat from core client for 30 sec - exiting 17:33:18 (7124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:19 (7124): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:35:41 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2296, selfPID=2296, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2680, selfPID=6728, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=6532, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6184, selfPID=3656, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f754_2012_1_009778621_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f754_2012_1_009778621_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f754_2012_1_009778621_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f754_2012_1_009778621_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f754_2012_1_009778621_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 May 2015 09:33:17	1361676	18344084	hadam3p_anz_f754_2012_1_009778621_0	80,939	213,836	2.6419
10 May 2015 15:10:13	1361676	18344084	hadam3p_anz_f754_2012_1_009778621_0	69,419	183,828	2.6481
09 May 2015 19:13:31	1361676	18344084	hadam3p_anz_f754_2012_1_009778621_0	57,899	153,673	2.6542
08 May 2015 19:26:39	1361676	18344084	hadam3p_anz_f754_2012_1_009778621_0	46,379	123,043	2.6530
08 May 2015 19:23:36	1361676	18344084	hadam3p_anz_f754_2012_1_009778621_0	34,859	92,376	2.6500
08 May 2015 19:12:27	1361676	18344084	hadam3p_anz_f754_2012_1_009778621_0	23,339	61,924	2.6532
08 May 2015 19:06:30	1361676	18344084	hadam3p_anz_f754_2012_1_009778621_0	11,819	31,170	2.6373