Task 16622920

Name	hadam3p_anz_r7iz_2012_1_008739369_0
Workunit	8885347
Created	8 May 2014, 19:23:40 UTC
Sent	15 May 2014, 0:28:31 UTC
Report deadline	27 Apr 2015, 5:48:31 UTC
Received	14 Jun 2014, 7:30:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1283614
Run time	16 days 10 hours 22 min 35 sec
CPU time	14 days 13 hours 58 min 35 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	1.33 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:38:43 (1988): No heartbeat from core client for 30 sec - exiting 22:38:45 (1988): No heartbeat from core client for 30 sec - exiting 22:38:46 (1988): No heartbeat from core client for 30 sec - exiting 22:38:47 (1988): No heartbeat from core client for 30 sec - exiting 22:38:48 (1988): No heartbeat from core client for 30 sec - exiting 22:38:49 (1988): No heartbeat from core client for 30 sec - exiting 22:38:50 (1988): No heartbeat from core client for 30 sec - exiting 22:38:51 (1988): No heartbeat from core client for 30 sec - exiting 22:38:52 (1988): No heartbeat from core client for 30 sec - exiting 22:38:53 (1988): No heartbeat from core client for 30 sec - exiting 22:38:54 (1988): No heartbeat from core client for 30 sec - exiting 22:38:55 (1988): No heartbeat from core client for 30 sec - exiting 22:38:57 (1988): No heartbeat from core client for 30 sec - exiting 22:38:58 (1988): No heartbeat from core client for 30 sec - exiting 22:38:59 (1988): No heartbeat from core client for 30 sec - exiting 22:39:00 (1988): No heartbeat from core client for 30 sec - exiting 22:39:01 (1988): No heartbeat from core client for 30 sec - exiting 22:39:02 (1988): No heartbeat from core client for 30 sec - exiting 22:39:03 (1988): No heartbeat from core client for 30 sec - exiting 22:39:04 (1988): No heartbeat from core client for 30 sec - exiting 22:39:05 (1988): No heartbeat from core client for 30 sec - exiting 22:39:06 (1988): No heartbeat from core client for 30 sec - exiting 22:39:07 (1988): No heartbeat from core client for 30 sec - exiting 22:39:09 (1988): No heartbeat from core client for 30 sec - exiting 22:39:10 (1988): No heartbeat from core client for 30 sec - exiting 22:39:11 (1988): No heartbeat from core client for 30 sec - exiting 22:39:12 (1988): No heartbeat from core client for 30 sec - exiting 22:39:13 (1988): No heartbeat from core client for 30 sec - exiting 22:39:14 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:38:54 (5364): No heartbeat from core client for 30 sec - exiting 06:38:55 (5364): No heartbeat from core client for 30 sec - exiting 06:38:56 (5364): No heartbeat from core client for 30 sec - exiting 06:38:58 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:59 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5392, selfPID=5392, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4652, selfPID=4652, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:31:58 (812): No heartbeat from core client for 30 sec - exiting 06:31:59 (812): No heartbeat from core client for 30 sec - exiting 06:32:00 (812): No heartbeat from core client for 30 sec - exiting 06:32:01 (812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:45:10 (1752): No heartbeat from core client for 30 sec - exiting 06:45:11 (1752): No heartbeat from core client for 30 sec - exiting 06:45:12 (1752): No heartbeat from core client for 30 sec - exiting 06:45:13 (1752): No heartbeat from core client for 30 sec - exiting 06:45:14 (1752): No heartbeat from core client for 30 sec - exiting 06:45:16 (1752): No heartbeat from core client for 30 sec - exiting 06:45:17 (1752): No heartbeat from core client for 30 sec - exiting 06:45:18 (1752): No heartbeat from core client for 30 sec - exiting 06:45:19 (1752): No heartbeat from core client for 30 sec - exiting 06:45:20 (1752): No heartbeat from core client for 30 sec - exiting 06:45:21 (1752): No heartbeat from core client for 30 sec - exiting 06:45:22 (1752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:45:23 (1752): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:16:10 (4440): No heartbeat from core client for 30 sec - exiting 23:16:11 (4440): No heartbeat from core client for 30 sec - exiting 23:16:12 (4440): No heartbeat from core client for 30 sec - exiting 23:16:13 (4440): No heartbeat from core client for 30 sec - exiting 23:16:15 (4440): No heartbeat from core client for 30 sec - exiting 23:16:16 (4440): No heartbeat from core client for 30 sec - exiting 23:16:17 (4440): No heartbeat from core client for 30 sec - exiting 23:16:18 (4440): No heartbeat from core client for 30 sec - exiting 23:16:19 (4440): No heartbeat from core client for 30 sec - exiting 23:16:20 (4440): No heartbeat from core client for 30 sec - exiting 23:16:21 (4440): No heartbeat from core client for 30 sec - exiting 23:16:22 (4440): No heartbeat from core client for 30 sec - exiting 23:16:23 (4440): No heartbeat from core client for 30 sec - exiting 23:16:24 (4440): No heartbeat from core client for 30 sec - exiting 23:16:25 (4440): No heartbeat from core client for 30 sec - exiting 23:16:27 (4440): No heartbeat from core client for 30 sec - exiting 23:16:28 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3844, selfPID=3844, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:01:32 (2484): No heartbeat from core client for 30 sec - exiting 23:01:33 (2484): No heartbeat from core client for 30 sec - exiting 23:01:35 (2484): No heartbeat from core client for 30 sec - exiting 23:01:36 (2484): No heartbeat from core client for 30 sec - exiting 23:01:37 (2484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... RegionSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... RCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4056, selfPID=4056, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional WorkCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3380, selfPID=3380, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3088, selfPID=3088, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4140, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1896, selfPID=1092, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_r7iz_2012_1_008739369_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r7iz_2012_1_008739369_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r7iz_2012_1_008739369_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jun 2014 04:13:42	1283614	16622920	hadam3p_anz_r7iz_2012_1_008739369_0	103,979	1,254,085	12.0609
11 Jun 2014 14:47:37	1283614	16622920	hadam3p_anz_r7iz_2012_1_008739369_0	92,459	1,109,859	12.0038
10 Jun 2014 09:01:20	1283614	16622920	hadam3p_anz_r7iz_2012_1_008739369_0	80,939	987,399	12.1993
05 Jun 2014 15:29:06	1283614	16622920	hadam3p_anz_r7iz_2012_1_008739369_0	69,419	835,760	12.0394
03 Jun 2014 06:36:05	1283614	16622920	hadam3p_anz_r7iz_2012_1_008739369_0	57,899	682,703	11.7913
31 May 2014 16:33:32	1283614	16622920	hadam3p_anz_r7iz_2012_1_008739369_0	46,379	532,514	11.4818
29 May 2014 11:41:46	1283614	16622920	hadam3p_anz_r7iz_2012_1_008739369_0	34,859	398,252	11.4247
23 May 2014 06:30:00	1283614	16622920	hadam3p_anz_r7iz_2012_1_008739369_0	23,339	272,000	11.6543
17 May 2014 15:28:31	1283614	16622920	hadam3p_anz_r7iz_2012_1_008739369_0	11,819	137,165	11.6055