Task 13469442

Name	hadam3p_eu_6aci_2001_1_007482186_0
Workunit	7679661
Created	10 Oct 2011, 18:26:48 UTC
Sent	10 Oct 2011, 18:27:04 UTC
Report deadline	21 Sep 2012, 23:47:04 UTC
Received	28 Oct 2011, 7:24:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1163616
Run time	4 days 6 hours 51 min 1 sec
CPU time	4 days 4 hours 8 min 30 sec
Validate state	Invalid
Credit	1,790.26
Device peak FLOPS	1.56 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 15:19:35 (3444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:19:36 (3444): No heartbeat from core client for 30 sec - exiting 15:19:37 (3444): No heartbeat from core client for 30 sec - exiting 15:19:38 (3444): No heartbeat from core client for 30 sec - exiting 15:19:39 (3444): No heartbeat from core client for 30 sec - exiting 15:19:40 (3444): No heartbeat from core client for 30 sec - exiting 15:19:42 (3444): No heartbeat from core client for 30 sec - exiting 15:19:43 (3444): No heartbeat from core client for 30 sec - exiting 10:41:48 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:53 (6072): No heartbeat from core client for 30 sec - exiting 10:41:54 (6072): No heartbeat from core client for 30 sec - exiting 10:41:56 (6072): No heartbeat from core client for 30 sec - exiting 10:41:57 (6072): No heartbeat from core client for 30 sec - exiting 10:41:58 (6072): No heartbeat from core client for 30 sec - exiting 10:41:59 (6072): No heartbeat from core client for 30 sec - exiting 10:42:00 (6072): No heartbeat from core client for 30 sec - exiting 10:42:01 (6072): No heartbeat from core client for 30 sec - exiting 10:42:02 (6072): No heartbeat from core client for 30 sec - exiting 10:42:03 (6072): No heartbeat from core client for 30 sec - exiting 10:42:04 (6072): No heartbeat from core client for 30 sec - exiting 10:42:05 (6072): No heartbeat from core client for 30 sec - exiting 10:42:06 (6072): No heartbeat from core client for 30 sec - exiting 10:42:08 (6072): No heartbeat from core client for 30 sec - exiting 16:53:16 (8820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:07:42 (8576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:33 (8628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:28:26 (6016): No heartbeat from core client for 30 sec - exiting 10:28:42 (6016): No heartbeat from core client for 30 sec - exiting 10:28:43 (6016): No heartbeat from core client for 30 sec - exiting 10:28:44 (6016): No heartbeat from core client for 30 sec - exiting 10:28:45 (6016): No heartbeat from core client for 30 sec - exiting 10:28:46 (6016): No heartbeat from core client for 30 sec - exiting 10:28:47 (6016): No heartbeat from core client for 30 sec - exiting 10:28:48 (6016): No heartbeat from core client for 30 sec - exiting 10:28:49 (6016): No heartbeat from core client for 30 sec - exiting 10:28:51 (6016): No heartbeat from core client for 30 sec - exiting 10:28:52 (6016): No heartbeat from core client for 30 sec - exiting 10:28:53 (6016): No heartbeat from core client for 30 sec - exiting 10:28:54 (6016): No heartbeat from core client for 30 sec - exiting 10:28:55 (6016): No heartbeat from core client for 30 sec - exiting 10:28:56 (6016): No heartbeat from core client for 30 sec - exiting 10:28:57 (6016): No heartbeat from core client for 30 sec - exiting 10:28:58 (6016): No heartbeat from core client for 30 sec - exiting 10:28:59 (6016): No heartbeat from core client for 30 sec - exiting 10:29:00 (6016): No heartbeat from core client for 30 sec - exiting 10:29:01 (6016): No heartbeat from core client for 30 sec - exiting 10:29:03 (6016): No heartbeat from core client for 30 sec - exiting 10:29:04 (6016): No heartbeat from core client for 30 sec - exiting 10:29:05 (6016): No heartbeat from core client for 30 sec - exiting 10:29:06 (6016): No heartbeat from core client for 30 sec - exiting 10:29:07 (6016): No heartbeat from core client for 30 sec - exiting 10:29:08 (6016): No heartbeat from core client for 30 sec - exiting 10:29:09 (6016): No heartbeat from core client for 30 sec - exiting 10:29:10 (6016): No heartbeat from core client for 30 sec - exiting 10:29:11 (6016): No heartbeat from core client for 30 sec - exiting 10:29:12 (6016): No heartbeat from core client for 30 sec - exiting 10:29:13 (6016): No heartbeat from core client for 30 sec - exiting 10:29:15 (6016): No heartbeat from core client for 30 sec - exiting 10:29:16 (6016): No heartbeat from core client for 30 sec - exiting 10:29:17 (6016): No heartbeat from core client for 30 sec - exiting 10:29:18 (6016): No heartbeat from core client for 30 sec - exiting 10:29:19 (6016): No heartbeat from core client for 30 sec - exiting 10:29:20 (6016): No heartbeat from core client for 30 sec - exiting 10:29:21 (6016): No heartbeat from core client for 30 sec - exiting 10:29:22 (6016): No heartbeat from core client for 30 sec - exiting 10:29:23 (6016): No heartbeat from core client for 30 sec - exiting 10:29:24 (6016): No heartbeat from core client for 30 sec - exiting 10:29:26 (6016): No heartbeat from core client for 30 sec - exiting 10:29:27 (6016): No heartbeat from core client for 30 sec - exiting 10:29:28 (6016): No heartbeat from core client for 30 sec - exiting 10:29:29 (6016): No heartbeat from core client for 30 sec - exiting 10:29:30 (6016): No heartbeat from core client for 30 sec - exiting 10:29:31 (6016): No heartbeat from core client for 30 sec - exiting 10:29:32 (6016): No heartbeat from core client for 30 sec - exiting 10:29:33 (6016): No heartbeat from core client for 30 sec - exiting 10:29:34 (6016): No heartbeat from core client for 30 sec - exiting 10:29:35 (6016): No heartbeat from core client for 30 sec - exiting 10:29:36 (6016): No heartbeat from core client for 30 sec - exiting 10:29:38 (6016): No heartbeat from core client for 30 sec - exiting 10:29:39 (6016): No heartbeat from core client for 30 sec - exiting 10:29:40 (6016): No heartbeat from core client for 30 sec - exiting 10:29:41 (6016): No heartbeat from core client for 30 sec - exiting 10:29:42 (6016): No heartbeat from core client for 30 sec - exiting 10:29:43 (6016): No heartbeat from core client for 30 sec - exiting 10:29:44 (6016): No heartbeat from core client for 30 sec - exiting 10:29:45 (6016): No heartbeat from core client for 30 sec - exiting 10:29:46 (6016): No heartbeat from core client for 30 sec - exiting 10:29:47 (6016): No heartbeat from core client for 30 sec - exiting 10:29:48 (6016): No heartbeat from core client for 30 sec - exiting 10:29:50 (6016): No heartbeat from core client for 30 sec - exiting 10:29:51 (6016): No heartbeat from core client for 30 sec - exiting 10:29:52 (6016): No heartbeat from core client for 30 sec - exiting 10:29:53 (6016): No heartbeat from core client for 30 sec - exiting 10:29:54 (6016): No heartbeat from core client for 30 sec - exiting 10:29:55 (6016): No heartbeat from core client for 30 sec - exiting 10:29:56 (6016): No heartbeat from core client for 30 sec - exiting 10:29:57 (6016): No heartbeat from core client for 30 sec - exiting 10:29:58 (6016): No heartbeat from core client for 30 sec - exiting 10:29:59 (6016): No heartbeat from core client for 30 sec - exiting 10:30:00 (6016): No heartbeat from core client for 30 sec - exiting 10:30:02 (6016): No heartbeat from core client for 30 sec - exiting 10:30:03 (6016): No heartbeat from core client for 30 sec - exiting 10:30:04 (6016): No heartbeat from core client for 30 sec - exiting 10:30:05 (6016): No heartbeat from core client for 30 sec - exiting 10:30:06 (6016): No heartbeat from core client for 30 sec - exiting 10:30:07 (6016): No heartbeat from core client for 30 sec - exiting 10:30:08 (6016): No heartbeat from core client for 30 sec - exiting 10:30:09 (6016): No heartbeat from core client for 30 sec - exiting 10:30:10 (6016): No heartbeat from core client for 30 sec - exiting 10:30:11 (6016): No heartbeat from core client for 30 sec - exiting 10:30:12 (6016): No heartbeat from core client for 30 sec - exiting 10:30:14 (6016): No heartbeat from core client for 30 sec - exiting 10:30:15 (6016): No heartbeat from core client for 30 sec - exiting 10:30:16 (6016): No heartbeat from core client for 30 sec - exiting 10:30:17 (6016): No heartbeat from core client for 30 sec - exiting 10:30:18 (6016): No heartbeat from core client for 30 sec - exiting 10:30:19 (6016): No heartbeat from core client for 30 sec - exiting 10:30:20 (6016): No heartbeat from core client for 30 sec - exiting 10:30:21 (6016): No heartbeat from core client for 30 sec - exiting 10:30:22 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:30:23 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 13:36:34 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:36:35 (5692): No heartbeat from core client for 30 sec - exiting 13:36:36 (5692): No heartbeat from core client for 30 sec - exiting 19:42:35 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:36 (6476): No heartbeat from core client for 30 sec - exiting 19:42:37 (6476): No heartbeat from core client for 30 sec - exiting 19:42:38 (6476): No heartbeat from core client for 30 sec - exiting 19:42:39 (6476): No heartbeat from core client for 30 sec - exiting 19:42:40 (6476): No heartbeat from core client for 30 sec - exiting 19:42:41 (6476): No heartbeat from core client for 30 sec - exiting 19:42:43 (6476): No heartbeat from core client for 30 sec - exiting 19:42:44 (6476): No heartbeat from core client for 30 sec - exiting 19:42:45 (6476): No heartbeat from core client for 30 sec - exiting 19:42:46 (6476): No heartbeat from core client for 30 sec - exiting 19:42:47 (6476): No heartbeat from core client for 30 sec - exiting 19:42:48 (6476): No heartbeat from core client for 30 sec - exiting 19:42:49 (6476): No heartbeat from core client for 30 sec - exiting 19:42:50 (6476): No heartbeat from core client for 30 sec - exiting 19:42:51 (6476): No heartbeat from core client for 30 sec - exiting 19:42:52 (6476): No heartbeat from core client for 30 sec - exiting 19:42:53 (6476): No heartbeat from core client for 30 sec - exiting 19:42:55 (6476): No heartbeat from core client for 30 sec - exiting 19:42:56 (6476): No heartbeat from core client for 30 sec - exiting 19:42:57 (6476): No heartbeat from core client for 30 sec - exiting 20:11:55 (8272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:33 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:49 (8056): No heartbeat from core client for 30 sec - exiting 20:20:50 (8056): No heartbeat from core client for 30 sec - exiting 20:20:51 (8056): No heartbeat from core client for 30 sec - exiting 20:32:06 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:48 (1700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:59 (7008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:20 (8212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:39:02 (7716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2220, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7996, iMonCtr=2 Model crash detected, will try to restart... 09:01:37 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:02:15 (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:16 (6516): No heartbeat from core client for 30 sec - exiting 11:02:17 (6516): No heartbeat from core client for 30 sec - exiting 11:02:18 (6516): No heartbeat from core client for 30 sec - exiting 11:02:19 (6516): No heartbeat from core client for 30 sec - exiting 11:02:20 (6516): No heartbeat from core client for 30 sec - exiting 11:02:21 (6516): No heartbeat from core client for 30 sec - exiting 11:02:22 (6516): No heartbeat from core client for 30 sec - exiting 11:02:23 (6516): No heartbeat from core client for 30 sec - exiting 11:02:25 (6516): No heartbeat from core client for 30 sec - exiting 11:02:26 (6516): No heartbeat from core client for 30 sec - exiting 11:02:27 (6516): No heartbeat from core client for 30 sec - exiting 11:02:28 (6516): No heartbeat from core client for 30 sec - exiting 11:02:29 (6516): No heartbeat from core client for 30 sec - exiting 11:02:30 (6516): No heartbeat from core client for 30 sec - exiting 11:02:31 (6516): No heartbeat from core client for 30 sec - exiting 11:02:32 (6516): No heartbeat from core client for 30 sec - exiting 11:02:33 (6516): No heartbeat from core client for 30 sec - exiting 11:02:34 (6516): No heartbeat from core client for 30 sec - exiting 11:02:36 (6516): No heartbeat from core client for 30 sec - exiting 11:02:37 (6516): No heartbeat from core client for 30 sec - exiting 11:30:19 (6556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:41 (9200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8940, selfPID=8940, iMonCtr=2 11:53:42 (9200): No heartbeat from core client for 30 sec - exiting 11:53:43 (9200): No heartbeat from core client for 30 sec - exiting 11:53:44 (9200): No heartbeat from core client for 30 sec - exiting 12:05:45 (1704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:11 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7812, selfPID=6984, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... 11:09:34 (7548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:10:21 (8892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:11:02 (8892): No heartbeat from core client for 30 sec - exiting 13:11:03 (8892): No heartbeat from core client for 30 sec - exiting 13:11:04 (8892): No heartbeat from core client for 30 sec - exiting 13:11:05 (8892): No heartbeat from core client for 30 sec - exiting 13:11:06 (8892): No heartbeat from core client for 30 sec - exiting 13:11:07 (8892): No heartbeat from core client for 30 sec - exiting 13:11:08 (8892): No heartbeat from core client for 30 sec - exiting 13:11:09 (8892): No heartbeat from core client for 30 sec - exiting 13:11:11 (8892): No heartbeat from core client for 30 sec - exiting 13:11:12 (8892): No heartbeat from core client for 30 sec - exiting 13:11:13 (8892): No heartbeat from core client for 30 sec - exiting 13:11:14 (8892): No heartbeat from core client for 30 sec - exiting 13:11:15 (8892): No heartbeat from core client for 30 sec - exiting 13:11:16 (8892): No heartbeat from core client for 30 sec - exiting 13:11:17 (8892): No heartbeat from core client for 30 sec - exiting 13:11:18 (8892): No heartbeat from core client for 30 sec - exiting 13:11:19 (8892): No heartbeat from core client for 30 sec - exiting 13:11:20 (8892): No heartbeat from core client for 30 sec - exiting 13:11:22 (8892): No heartbeat from core client for 30 sec - exiting 13:11:23 (8892): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_6aci_2001_1_007482186_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6aci_2001_1_007482186_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6aci_2001_1_007482186_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 17:09:09	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	103,779	327,583	3.1565
31 Oct 2011 17:07:52	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	103,776	327,100	3.1520
31 Oct 2011 16:02:38	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	92,256	288,654	3.1288
31 Oct 2011 15:01:29	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	80,736	249,965	3.0961
31 Oct 2011 15:01:29	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	69,217	210,570	3.0422
31 Oct 2011 15:01:29	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	69,216	210,115	3.0356
14 Oct 2011 08:13:37	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	57,696	169,659	2.9406
13 Oct 2011 11:43:22	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	46,176	131,557	2.8490
12 Oct 2011 17:13:13	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	34,656	100,033	2.8865
12 Oct 2011 07:08:45	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	23,136	70,811	3.0606
11 Oct 2011 12:28:52	1163616	13469442	hadam3p_eu_6aci_2001_1_007482186_0	11,616	34,802	2.9960