Task 18921092

Name	hadam3p_eu_f7al_2004_1_010201345_0
Workunit	10140766
Created	18 Sep 2015, 17:57:10 UTC
Sent	19 Sep 2015, 23:52:27 UTC
Report deadline	1 Sep 2016, 5:12:27 UTC
Received	3 Oct 2015, 7:30:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1328113
Run time	2 days 7 hours 42 min 34 sec
CPU time	1 days 19 hours 10 min 8 sec
Validate state	Invalid
Credit	601.34
Device peak FLOPS	1.86 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v7.26 windows_intelx86
Stderr	<core_client_version>6.8.44</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:12:38 (3744): No heartbeat from client for 30 sec - exiting 22:12:38 (3744): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:22:50 (88): No heartbeat from client for 30 sec - exiting 10:22:50 (88): timer handler: client dead, exiting 10:22:51 (88): No heartbeat from client for 30 sec - exiting 10:22:51 (88): timer handler: client dead, exiting 10:22:53 (88): No heartbeat from client for 30 sec - exiting 10:22:53 (88): timer handler: client dead, exiting 10:22:54 (88): No heartbeat from client for 30 sec - exiting 10:22:54 (88): timer handler: client dead, exiting 10:22:55 (88): No heartbeat from client for 30 sec - exiting 10:22:55 (88): timer handler: client dead, exiting 10:22:57 (88): No heartbeat from client for 30 sec - exiting 10:22:57 (88): timer handler: client dead, exiting 10:22:58 (88): No heartbeat from client for 30 sec - exiting 10:22:58 (88): timer handler: client dead, exiting 10:22:59 (88): No heartbeat from client for 30 sec - exiting 10:22:59 (88): timer handler: client dead, exiting 10:23:00 (88): No heartbeat from client for 30 sec - exiting 10:23:00 (88): timer handler: client dead, exiting 10:23:01 (88): No heartbeat from client for 30 sec - exiting 10:23:01 (88): timer handler: client dead, exiting 10:23:02 (88): No heartbeat from client for 30 sec - exiting 10:23:02 (88): timer handler: client dead, exiting 10:23:03 (88): No heartbeat from client for 30 sec - exiting 10:23:03 (88): timer handler: client dead, exiting 10:23:04 (88): No heartbeat from client for 30 sec - exiting 10:23:04 (88): timer handler: client dead, exiting 10:23:05 (88): No heartbeat from client for 30 sec - exiting 10:23:05 (88): timer handler: client dead, exiting 10:23:07 (88): No heartbeat from client for 30 sec - exiting 10:23:07 (88): timer handler: client dead, exiting 10:23:08 (88): No heartbeat from client for 30 sec - exiting 10:23:08 (88): timer handler: client dead, exiting 10:23:09 (88): No heartbeat from client for 30 sec - exiting 10:23:09 (88): timer handler: client dead, exiting 10:23:10 (88): No heartbeat from client for 30 sec - exiting 10:23:10 (88): timer handler: client dead, exiting 10:23:11 (88): No heartbeat from client for 30 sec - exiting 10:23:11 (88): timer handler: client dead, exiting 10:23:12 (88): No heartbeat from client for 30 sec - exiting 10:23:12 (88): timer handler: client dead, exiting 10:23:13 (88): No heartbeat from client for 30 sec - exiting 10:23:13 (88): timer handler: client dead, exiting 10:23:14 (88): No heartbeat from client for 30 sec - exiting 10:23:14 (88): timer handler: client dead, exiting 10:23:16 (88): No heartbeat from client for 30 sec - exiting 10:23:16 (88): timer handler: client dead, exiting 10:23:17 (88): No heartbeat from client for 30 sec - exiting 10:23:17 (88): timer handler: client dead, exiting 10:23:18 (88): No heartbeat from client for 30 sec - exiting 10:23:18 (88): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:40:33 (3072): No heartbeat from client for 30 sec - exiting 08:40:33 (3072): timer handler: client dead, exiting 08:40:34 (3072): No heartbeat from client for 30 sec - exiting 08:40:34 (3072): timer handler: client dead, exiting 08:40:35 (3072): No heartbeat from client for 30 sec - exiting 08:40:35 (3072): timer handler: client dead, exiting 08:40:37 (3072): No heartbeat from client for 30 sec - exiting 08:40:37 (3072): timer handler: client dead, exiting 08:40:38 (3072): No heartbeat from client for 30 sec - exiting 08:40:38 (3072): timer handler: client dead, exiting 08:40:39 (3072): No heartbeat from client for 30 sec - exiting 08:40:39 (3072): timer handler: client dead, exiting 08:40:40 (3072): No heartbeat from client for 30 sec - exiting 08:40:40 (3072): timer handler: client dead, exiting 08:40:41 (3072): No heartbeat from client for 30 sec - exiting 08:40:41 (3072): timer handler: client dead, exiting 08:40:42 (3072): No heartbeat from client for 30 sec - exiting 08:40:42 (3072): timer handler: client dead, exiting 08:40:43 (3072): No heartbeat from client for 30 sec - exiting 08:40:43 (3072): timer handler: client dead, exiting 08:40:44 (3072): No heartbeat from client for 30 sec - exiting 08:40:44 (3072): timer handler: client dead, exiting 08:40:45 (3072): No heartbeat from client for 30 sec - exiting 08:40:45 (3072): timer handler: client dead, exiting 08:40:46 (3072): No heartbeat from client for 30 sec - exiting 08:40:46 (3072): timer handler: client dead, exiting 08:40:48 (3072): No heartbeat from client for 30 sec - exiting 08:40:48 (3072): timer handler: client dead, exiting 08:40:49 (3072): No heartbeat from client for 30 sec - exiting 08:40:49 (3072): timer handler: client dead, exiting 08:40:50 (3072): No heartbeat from client for 30 sec - exiting 08:40:50 (3072): timer handler: client dead, exiting 08:40:51 (3072): No heartbeat from client for 30 sec - exiting 08:40:51 (3072): timer handler: client dead, exiting 08:40:52 (3072): No heartbeat from client for 30 sec - exiting 08:40:52 (3072): timer handler: client dead, exiting 08:40:53 (3072): No heartbeat from client for 30 sec - exiting 08:40:53 (3072): timer handler: client dead, exiting 08:40:54 (3072): No heartbeat from client for 30 sec - exiting 08:40:54 (3072): timer handler: client dead, exiting 08:40:55 (3072): No heartbeat from client for 30 sec - exiting 08:40:55 (3072): timer handler: client dead, exiting 08:40:56 (3072): No heartbeat from client for 30 sec - exiting 08:40:56 (3072): timer handler: client dead, exiting 08:40:57 (3072): No heartbeat from client for 30 sec - exiting 08:40:57 (3072): timer handler: client dead, exiting 08:40:59 (3072): No heartbeat from client for 30 sec - exiting 08:40:59 (3072): timer handler: client dead, exiting 08:41:00 (3072): No heartbeat from client for 30 sec - exiting 08:41:00 (3072): timer handler: client dead, exiting 08:41:01 (3072): No heartbeat from client for 30 sec - exiting 08:41:01 (3072): timer handler: client dead, exiting 08:41:02 (3072): No heartbeat from client for 30 sec - exiting 08:41:02 (3072): timer handler: client dead, exiting 08:41:03 (3072): No heartbeat from client for 30 sec - exiting 08:41:03 (3072): timer handler: client dead, exiting 08:41:04 (3072): No heartbeat from client for 30 sec - exiting 08:41:04 (3072): timer handler: client dead, exiting 08:41:06 (3072): No heartbeat from client for 30 sec - exiting 08:41:06 (3072): timer handler: client dead, exiting 08:41:07 (3072): No heartbeat from client for 30 sec - exiting 08:41:07 (3072): timer handler: client dead, exiting 08:41:08 (3072): No heartbeat from client for 30 sec - exiting 08:41:08 (3072): timer handler: client dead, exiting 08:41:09 (3072): No heartbeat from client for 30 sec - exiting 08:41:09 (3072): timer handler: client dead, exiting 08:41:10 (3072): No heartbeat from client for 30 sec - exiting 08:41:10 (3072): timer handler: client dead, exiting 08:41:11 (3072): No heartbeat from client for 30 sec - exiting 08:41:11 (3072): timer handler: client dead, exiting 08:41:12 (3072): No heartbeat from client for 30 sec - exiting 08:41:12 (3072): timer handler: client dead, exiting 08:41:13 (3072): No heartbeat from client for 30 sec - exiting 08:41:13 (3072): timer handler: client dead, exiting 08:41:14 (3072): No heartbeat from client for 30 sec - exiting 08:41:14 (3072): timer handler: client dead, exiting 08:41:15 (3072): No heartbeat from client for 30 sec - exiting 08:41:15 (3072): timer handler: client dead, exiting 08:41:17 (3072): No heartbeat from client for 30 sec - exiting 08:41:17 (3072): timer handler: client dead, exiting 08:41:18 (3072): No heartbeat from client for 30 sec - exiting 08:41:18 (3072): timer handler: client dead, exiting 08:41:19 (3072): No heartbeat from client for 30 sec - exiting 08:41:19 (3072): timer handler: client dead, exiting 08:41:20 (3072): No heartbeat from client for 30 sec - exiting 08:41:20 (3072): timer handler: client dead, exiting 08:41:21 (3072): No heartbeat from client for 30 sec - exiting 08:41:21 (3072): timer handler: client dead, exiting 08:41:22 (3072): No heartbeat from client for 30 sec - exiting 08:41:22 (3072): timer handler: client dead, exiting 08:41:23 (3072): No heartbeat from client for 30 sec - exiting 08:41:23 (3072): timer handler: client dead, exiting 08:41:24 (3072): No heartbeat from client for 30 sec - exiting 08:41:24 (3072): timer handler: client dead, exiting 08:41:25 (3072): No heartbeat from client for 30 sec - exiting 08:41:25 (3072): timer handler: client dead, exiting 08:41:27 (3072): No heartbeat from client for 30 sec - exiting 08:41:27 (3072): timer handler: client dead, exiting 08:41:28 (3072): No heartbeat from client for 30 sec - exiting 08:41:28 (3072): timer handler: client dead, exiting 08:41:29 (3072): No heartbeat from client for 30 sec - exiting 08:41:29 (3072): timer handler: client dead, exiting 08:41:30 (3072): No heartbeat from client for 30 sec - exiting 08:41:30 (3072): timer handler: client dead, exiting 08:41:31 (3072): No heartbeat from client for 30 sec - exiting 08:41:31 (3072): timer handler: client dead, exiting 08:41:32 (3072): No heartbeat from client for 30 sec - exiting 08:41:32 (3072): timer handler: client dead, exiting 08:41:33 (3072): No heartbeat from client for 30 sec - exiting 08:41:33 (3072): timer handler: client dead, exiting 08:41:34 (3072): No heartbeat from client for 30 sec - exiting 08:41:34 (3072): timer handler: client dead, exiting 08:41:35 (3072): No heartbeat from client for 30 sec - exiting 08:41:35 (3072): timer handler: client dead, exiting 08:41:36 (3072): No heartbeat from client for 30 sec - exiting 08:41:36 (3072): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:36:53 (3788): Can't acquire lockfile (32) - waiting 35s 13:37:18 (4488): No heartbeat from client for 30 sec - exiting 13:37:18 (4488): timer handler: client dead, exiting 13:37:19 (4488): No heartbeat from client for 30 sec - exiting 13:37:19 (4488): timer handler: client dead, exiting 13:37:20 (4488): No heartbeat from client for 30 sec - exiting 13:37:20 (4488): timer handler: client dead, exiting 13:37:21 (4488): No heartbeat from client for 30 sec - exiting 13:37:21 (4488): timer handler: client dead, exiting 13:37:22 (4488): No heartbeat from client for 30 sec - exiting 13:37:22 (4488): timer handler: client dead, exiting 13:37:23 (4488): No heartbeat from client for 30 sec - exiting 13:37:23 (4488): timer handler: client dead, exiting 13:37:24 (4488): No heartbeat from client for 30 sec - exiting 13:37:24 (4488): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... RegioCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:36:08 (3556): No heartbeat from client for 30 sec - exiting 22:36:09 (3556): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:31:00 (1852): No heartbeat from client for 30 sec - exiting 09:31:00 (1852): timer handler: client dead, exiting 09:31:01 (1852): No heartbeat from client for 30 sec - exiting 09:31:01 (1852): timer handler: client dead, exiting 09:31:02 (1852): No heartbeat from client for 30 sec - exiting 09:31:02 (1852): timer handler: client dead, exiting 09:31:03 (1852): No heartbeat from client for 30 sec - exiting 09:31:03 (1852): timer handler: client dead, exiting 09:31:04 (1852): No heartbeat from client for 30 sec - exiting 09:31:04 (1852): timer handler: client dead, exiting 09:31:05 (1852): No heartbeat from client for 30 sec - exiting 09:31:05 (1852): timer handler: client dead, exiting 09:31:06 (1852): No heartbeat from client for 30 sec - exiting 09:31:06 (1852): timer handler: client dead, exiting 09:31:07 (1852): No heartbeat from client for 30 sec - exiting 09:31:07 (1852): timer handler: client dead, exiting 09:31:08 (1852): No heartbeat from client for 30 sec - exiting 09:31:08 (1852): timer handler: client dead, exiting 09:31:09 (1852): No heartbeat from client for 30 sec - exiting 09:31:09 (1852): timer handler: client dead, exiting 09:31:10 (1852): No heartbeat from client for 30 sec - exiting 09:31:10 (1852): timer handler: client dead, exiting 09:31:11 (1852): No heartbeat from client for 30 sec - exiting 09:31:11 (1852): timer handler: client dead, exiting 09:31:12 (1852): No heartbeat from client for 30 sec - exiting 09:31:12 (1852): timer handler: client dead, exiting 09:31:14 (1852): No heartbeat from client for 30 sec - exiting 09:31:14 (1852): timer handler: client dead, exiting 09:31:15 (1852): No heartbeat from client for 30 sec - exiting 09:31:15 (1852): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:49 (4244): No heartbeat from client for 30 sec - exiting 09:42:49 (4244): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=960, selfPID=960, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=960, selfPID=2320, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 00:27:39 (2320): No heartbeat from client for 30 sec - exiting 00:27:39 (2320): timer handler: client dead, exiting 00:27:41 (2320): No heartbeat from client for 30 sec - exiting 00:27:41 (2320): timer handler: client dead, exiting 00:27:42 (2320): No heartbeat from client for 30 sec - exiting 00:27:42 (2320): timer handler: client dead, exiting 00:27:43 (2320): called boinc_finish(0) </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_f7al_2004_1_010201345_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_f7al_2004_1_010201345_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_f7al_2004_1_010201345_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_f7al_2004_1_010201345_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_f7al_2004_1_010201345_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_f7al_2004_1_010201345_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_f7al_2004_1_010201345_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_f7al_2004_1_010201345_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_f7al_2004_1_010201345_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Oct 2015 16:37:56	1328113	18921092	hadam3p_eu_f7al_2004_1_010201345_0	34,859	136,470	3.9149
26 Sep 2015 21:41:04	1328113	18921092	hadam3p_eu_f7al_2004_1_010201345_0	23,339	91,897	3.9375
22 Sep 2015 02:37:44	1328113	18921092	hadam3p_eu_f7al_2004_1_010201345_0	11,819	45,495	3.8493