Task 16119751

Name	hadam3p_eu_j0mw_1985_1_008492669_0
Workunit	8643482
Created	3 Dec 2013, 21:20:04 UTC
Sent	3 Dec 2013, 21:21:01 UTC
Report deadline	16 Nov 2014, 2:41:01 UTC
Received	11 Dec 2013, 1:56:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1292465
Run time	3 days 4 hours 26 min 21 sec
CPU time	3 days 0 hours 38 min 50 sec
Validate state	Invalid
Credit	1,790.21
Device peak FLOPS	1.70 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 16:59:42 (68228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:25:58 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:46 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:47 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5032, selfPID=5032, iMonCtr=2 05:44:01 (1276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:12 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:13 (4560): No heartbeat from core client for 30 sec - exiting 08:26:14 (4560): No heartbeat from core client for 30 sec - exiting 08:26:15 (4560): No heartbeat from core client for 30 sec - exiting 08:26:16 (4560): No heartbeat from core client for 30 sec - exiting 08:26:17 (4560): No heartbeat from core client for 30 sec - exiting 08:26:18 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 13:39:35 (3168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4268, selfPID=4268, iMonCtr=2 16:35:22 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2212, selfPID=2212, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2572, selfPID=2572, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=516, selfPID=516, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:15:17 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4444, selfPID=4444, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:54:11 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:12 (3520): No heartbeat from core client for 30 sec - exiting 19:54:13 (3520): No heartbeat from core client for 30 sec - exiting 19:54:14 (3520): No heartbeat from core client for 30 sec - exiting 19:54:15 (3520): No heartbeat from core client for 30 sec - exiting 19:54:16 (3520): No heartbeat from core client for 30 sec - exiting 19:54:17 (3520): No heartbeat from core client for 30 sec - exiting 19:54:18 (3520): No heartbeat from core client for 30 sec - exiting 19:54:19 (3520): No heartbeat from core client for 30 sec - exiting 19:54:20 (3520): No heartbeat from core client for 30 sec - exiting 19:54:21 (3520): No heartbeat from core client for 30 sec - exiting 20:39:21 (2416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:22 (2416): No heartbeat from core client for 30 sec - exiting 20:39:23 (2416): No heartbeat from core client for 30 sec - exiting 20:39:24 (2416): No heartbeat from core client for 30 sec - exiting 20:39:25 (2416): No heartbeat from core client for 30 sec - exiting 20:39:26 (2416): No heartbeat from core client for 30 sec - exiting 20:39:27 (2416): No heartbeat from core client for 30 sec - exiting 20:39:28 (2416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:21:18 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:21:19 (5324): No heartbeat from core client for 30 sec - exiting 11:21:20 (5324): No heartbeat from core client for 30 sec - exiting 11:21:21 (5324): No heartbeat from core client for 30 sec - exiting 11:21:22 (5324): No heartbeat from core client for 30 sec - exiting 11:21:23 (5324): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 15:40:05 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:40:06 (5336): No heartbeat from core client for 30 sec - exiting 15:40:07 (5336): No heartbeat from core client for 30 sec - exiting 15:40:08 (5336): No heartbeat from core client for 30 sec - exiting 15:40:09 (5336): No heartbeat from core client for 30 sec - exiting 15:40:10 (5336): No heartbeat from core client for 30 sec - exiting 16:00:37 (3296): No heartbeat from core client for 30 sec - exiting 16:00:38 (3296): No heartbeat from core client for 30 sec - exiting 16:00:39 (3296): No heartbeat from core client for 30 sec - exiting 16:00:40 (3296): No heartbeat from core client for 30 sec - exiting 16:00:41 (3296): No heartbeat from core client for 30 sec - exiting 16:00:42 (3296): No heartbeat from core client for 30 sec - exiting 16:00:43 (3296): No heartbeat from core client for 30 sec - exiting 16:00:44 (3296): No heartbeat from core client for 30 sec - exiting 16:00:45 (3296): No heartbeat from core client for 30 sec - exiting 16:00:46 (3296): No heartbeat from core client for 30 sec - exiting 16:00:47 (3296): No heartbeat from core client for 30 sec - exiting 16:00:48 (3296): No heartbeat from core client for 30 sec - exiting 16:00:49 (3296): No heartbeat from core client for 30 sec - exiting 16:00:50 (3296): No heartbeat from core client for 30 sec - exiting 16:00:51 (3296): No heartbeat from core client for 30 sec - exiting 16:00:52 (3296): No heartbeat from core client for 30 sec - exiting 16:00:53 (3296): No heartbeat from core client for 30 sec - exiting 16:00:54 (3296): No heartbeat from core client for 30 sec - exiting 16:00:55 (3296): No heartbeat from core client for 30 sec - exiting 16:00:56 (3296): No heartbeat from core client for 30 sec - exiting 16:00:57 (3296): No heartbeat from core client for 30 sec - exiting 16:00:58 (3296): No heartbeat from core client for 30 sec - exiting 16:00:59 (3296): No heartbeat from core client for 30 sec - exiting 16:01:00 (3296): No heartbeat from core client for 30 sec - exiting 16:01:01 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5332, selfPID=5332, iMonCtr=2 18:43:50 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4156, selfPID=4156, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4156, selfPID=4444, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_j0mw_1985_1_008492669_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j0mw_1985_1_008492669_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j0mw_1985_1_008492669_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2013 19:33:17	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	103,776	250,577	2.4146
07 Dec 2013 10:56:03	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	92,256	222,274	2.4093
07 Dec 2013 03:38:54	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	80,736	194,076	2.4038
06 Dec 2013 17:38:35	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	69,216	166,951	2.4120
06 Dec 2013 09:17:57	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	57,733	139,731	2.4203
06 Dec 2013 08:17:32	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	57,696	139,237	2.4133
05 Dec 2013 18:00:34	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	46,176	111,539	2.4155
05 Dec 2013 09:32:42	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	34,656	83,960	2.4227
05 Dec 2013 00:40:16	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	23,136	56,202	2.4292
04 Dec 2013 07:44:47	1292465	16119751	hadam3p_eu_j0mw_1985_1_008492669_0	11,616	28,613	2.4632