Task 18810527

Name	hadam3p_anz_n0lb_2008_1_010099988_0
Workunit	10079578
Created	12 Aug 2015, 18:11:27 UTC
Sent	14 Aug 2015, 5:46:01 UTC
Report deadline	26 Jul 2016, 11:06:01 UTC
Received	26 Aug 2015, 6:53:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1324786
Run time	6 days 16 hours 58 min 4 sec
CPU time	6 days 0 hours 21 min 3 sec
Validate state	Invalid
Credit	3,987.46
Device peak FLOPS	1.68 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.36</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:28:32 (8748): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:28:33 (8748): No heartbeat from core client for 30 sec - exiting 23:28:34 (8748): No heartbeat from core client for 30 sec - exiting 23:28:35 (8748): No heartbeat from core client for 30 sec - exiting 23:28:36 (8748): No heartbeat from core client for 30 sec - exiting 23:28:37 (8748): No heartbeat from core client for 30 sec - exiting 23:28:38 (8748): No heartbeat from core client for 30 sec - exiting 23:28:39 (8748): No heartbeat from core client for 30 sec - exiting 23:28:41 (8748): No heartbeat from core client for 30 sec - exiting 23:28:42 (8748): No heartbeat from core client for 30 sec - exiting 23:28:43 (8748): No heartbeat from core client for 30 sec - exiting 23:28:44 (8748): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:06:39 (23736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:06:40 (23736): No heartbeat from core client for 30 sec - exiting 02:06:41 (23736): No heartbeat from core client for 30 sec - exiting 02:06:42 (23736): No heartbeat from core client for 30 sec - exiting 02:06:43 (23736): No heartbeat from core client for 30 sec - exiting 02:06:44 (23736): No heartbeat from core client for 30 sec - exiting 07:15:36 (40568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:33:56 (2512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:54:04 (100776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:54 (132048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:54:16 (130100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:19 (134520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:43 (135300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:45 (135300): No heartbeat from core client for 30 sec - exiting 03:09:36 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:04 (138588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:05 (138588): No heartbeat from core client for 30 sec - exiting 07:06:06 (138588): No heartbeat from core client for 30 sec - exiting 07:06:07 (138588): No heartbeat from core client for 30 sec - exiting 07:06:08 (138588): No heartbeat from core client for 30 sec - exiting 07:06:09 (138588): No heartbeat from core client for 30 sec - exiting 07:06:10 (138588): No heartbeat from core client for 30 sec - exiting 07:06:11 (138588): No heartbeat from core client for 30 sec - exiting 07:06:13 (138588): No heartbeat from core client for 30 sec - exiting 07:06:14 (138588): No heartbeat from core client for 30 sec - exiting 07:06:15 (138588): No heartbeat from core client for 30 sec - exiting 07:09:17 (143564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not ru08:10:20 (143384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:10:21 (143384): No heartbeat from core client for 30 sec - exiting 08:10:22 (143384): No heartbeat from core client for 30 sec - exiting 08:10:23 (143384): No heartbeat from core client for 30 sec - exiting 08:10:24 (143384): No heartbeat from core client for 30 sec - exiting 08:10:25 (143384): No heartbeat from core client for 30 sec - exiting 08:10:26 (143384): No heartbeat from core client for 30 sec - exiting 08:10:27 (143384): No heartbeat from core client for 30 sec - exiting 08:10:28 (143384): No heartbeat from core client for 30 sec - exiting 08:10:30 (143384): No heartbeat from core client for 30 sec - exiting 08:24:15 (143480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:16 (143480): No heartbeat from core client for 30 sec - exiting 08:24:17 (143480): No heartbeat from core client for 30 sec - exiting 08:24:18 (143480): No heartbeat from core client for 30 sec - exiting 08:24:19 (143480): No heartbeat from core client for 30 sec - exiting 08:24:20 (143480): No heartbeat from core client for 30 sec - exiting 08:24:21 (143480): No heartbeat from core client for 30 sec - exiting 08:24:22 (143480): No heartbeat from core client for 30 sec - exiting 08:24:23 (143480): No heartbeat from core client for 30 sec - exiting 08:24:25 (143480): No heartbeat from core client for 30 sec - exiting 08:50:59 (145296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:08 (145676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:09 (145676): No heartbeat from core client for 30 sec - exiting 08:52:10 (145676): No heartbeat from core client for 30 sec - exiting 08:52:11 (145676): No heartbeat from core client for 30 sec - exiting 08:52:12 (145676): No heartbeat from core client for 30 sec - exiting 08:52:14 (145676): No heartbeat from core client for 30 sec - exiting 08:52:15 (145676): No heartbeat from core client for 30 sec - exiting 08:52:16 (145676): No heartbeat from core client for 30 sec - exiting 08:52:17 (145676): No heartbeat from core client for 30 sec - exiting 08:52:18 (145676): No heartbeat from core client for 30 sec - exiting 10:01:03 (146376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:39 (140208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:32 (144172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=144404, selfPID=144404, iMonCtr=2 11:15:09 (148020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:43 (144976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:44:27 (130920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:05 (144728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:06 (144728): No heartbeat from core client for 30 sec - exiting 12:08:07 (144728): No heartbeat from core client for 30 sec - exiting 12:08:08 (144728): No heartbeat from core client for 30 sec - exiting 12:08:09 (144728): No heartbeat from core client for 30 sec - exiting 12:08:10 (144728): No heartbeat from core client for 30 sec - exiting 12:33:03 (133104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:04 (133104): No heartbeat from core client for 30 sec - exiting 12:33:05 (133104): No heartbeat from core client for 30 sec - exiting 12:33:06 (133104): No heartbeat from core client for 30 sec - exiting 12:33:07 (133104): No heartbeat from core client for 30 sec - exiting 12:33:08 (133104): No heartbeat from core client for 30 sec - exiting 12:42:43 (135584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:42:44 (135584): No heartbeat from core client for 30 sec - exiting 12:45:45 (129528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:30 (137100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:46 (136788): No heartbeat from core client for 30 sec - exiting 12:49:47 (136788): No heartbeat from core client for 30 sec - exiting 12:49:48 (136788): No heartbeat from core client for 30 sec - exiting 12:49:49 (136788): No heartbeat from core client for 30 sec - exiting 12:49:51 (136788): No heartbeat from core client for 30 sec - exiting 12:49:52 (136788): No heartbeat from core client for 30 sec - exiting 12:49:53 (136788): No heartbeat from core client for 30 sec - exiting 12:49:54 (136788): No heartbeat from core client for 30 sec - exiting 12:49:55 (136788): No heartbeat from core client for 30 sec - exiting 12:49:56 (136788): No heartbeat from core client for 30 sec - exiting 12:49:57 (136788): No heartbeat from core client for 30 sec - exiting 12:49:58 (136788): No heartbeat from core client for 30 sec - exiting 12:49:59 (136788): No heartbeat from core client for 30 sec - exiting 12:50:00 (136788): No heartbeat from core client for 30 sec - exiting 12:50:02 (136788): No heartbeat from core client for 30 sec - exiting 12:50:03 (136788): No heartbeat from core client for 30 sec - exiting 12:50:04 (136788): No heartbeat from core client for 30 sec - exiting 12:50:05 (136788): No heartbeat from core client for 30 sec - exiting 12:50:06 (136788): No heartbeat from core client for 30 sec - exiting 12:50:07 (136788): No heartbeat from core client for 30 sec - exiting 12:50:08 (136788): No heartbeat from core client for 30 sec - exiting 12:50:09 (136788): No heartbeat from core client for 30 sec - exiting 12:50:10 (136788): No heartbeat from core client for 30 sec - exiting 12:50:11 (136788): No heartbeat from core client for 30 sec - exiting 12:50:12 (136788): No heartbeat from core client for 30 sec - exiting 12:50:14 (136788): No heartbeat from core client for 30 sec - exiting 12:50:15 (136788): No heartbeat from core client for 30 sec - exiting 12:50:16 (136788): No heartbeat from core client for 30 sec - exiting 12:50:17 (136788): No heartbeat from core client for 30 sec - exiting 12:50:18 (136788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:51:24 (148152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:24 (142600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:43 (136248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:44 (136248): No heartbeat from core client for 30 sec - exiting 13:25:45 (136248): No heartbeat from core client for 30 sec - exiting 13:25:46 (136248): No heartbeat from core client for 30 sec - exiting 13:25:47 (136248): No heartbeat from core client for 30 sec - exiting 13:25:48 (136248): No heartbeat from core client for 30 sec - exiting 13:25:49 (136248): No heartbeat from core client for 30 sec - exiting 13:25:50 (136248): No heartbeat from core client for 30 sec - exiting 13:25:51 (136248): No heartbeat from core client for 30 sec - exiting 13:25:52 (136248): No heartbeat from core client for 30 sec - exiting 16:20:38 (145908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:26:15 (96364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:35 (149496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:36 (149496): No heartbeat from core client for 30 sec - exiting 16:36:37 (149496): No heartbeat from core client for 30 sec - exiting 16:36:38 (149496): No heartbeat from core client for 30 sec - exiting 16:36:39 (149496): No heartbeat from core client for 30 sec - exiting 16:36:41 (149496): No heartbeat from core client for 30 sec - exiting 16:36:42 (149496): No heartbeat from core client for 30 sec - exiting 16:36:43 (149496): No heartbeat from core client for 30 sec - exiting 16:36:44 (149496): No heartbeat from core client for 30 sec - exiting 16:36:45 (149496): No heartbeat from core client for 30 sec - exiting 16:36:46 (149496): No heartbeat from core client for 30 sec - exiting 16:39:22 (133904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:27:49 (150004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:18 (151196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:40 (151016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:41 (151016): No heartbeat from core client for 30 sec - exiting 17:53:42 (151016): No heartbeat from core client for 30 sec - exiting 17:53:43 (151016): No heartbeat from core client for 30 sec - exiting 17:53:44 (151016): No heartbeat from core client for 30 sec - exiting 17:53:45 (151016): No heartbeat from core client for 30 sec - exiting 17:53:46 (151016): No heartbeat from core client for 30 sec - exiting 20:18:10 (149952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:13:50 (154108): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:13:51 (154108): No heartbeat from core client for 30 sec - exiting 23:13:52 (154108): No heartbeat from core client for 30 sec - exiting 23:13:53 (154108): No heartbeat from core client for 30 sec - exiting 23:13:54 (154108): No heartbeat from core client for 30 sec - exiting 05:14:19 (176224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:24 (185356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:25 (185356): No heartbeat from core client for 30 sec - exiting 07:05:26 (185356): No heartbeat from core client for 30 sec - exiting 07:05:27 (185356): No heartbeat from core client for 30 sec - exiting 07:05:28 (185356): No heartbeat from core client for 30 sec - exiting 07:05:29 (185356): No heartbeat from core client for 30 sec - exiting 07:05:30 (185356): No heartbeat from core client for 30 sec - exiting 07:14:50 (189252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:42:12 (187852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:59:59 (194328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:14:21 (174708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:14:22 (174708): No heartbeat from core client for 30 sec - exiting 17:14:23 (174708): No heartbeat from core client for 30 sec - exiting 17:14:24 (174708): No heartbeat from core client for 30 sec - exiting 17:14:25 (174708): No heartbeat from core client for 30 sec - exiting 17:14:26 (174708): No heartbeat from core client for 30 sec - exiting 22:46:00 (194764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=195252, selfPID=195252, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=202084, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=202632, selfPID=201276, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n0lb_2008_1_010099988_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n0lb_2008_1_010099988_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n0lb_2008_1_010099988_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n0lb_2008_1_010099988_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Aug 2015 14:39:43	1324786	18810527	hadam3p_anz_n0lb_2008_1_010099988_0	92,459	476,624	5.1550
23 Aug 2015 02:27:09	1324786	18810527	hadam3p_anz_n0lb_2008_1_010099988_0	80,939	415,175	5.1295
21 Aug 2015 16:58:22	1324786	18810527	hadam3p_anz_n0lb_2008_1_010099988_0	69,419	353,962	5.0989
19 Aug 2015 12:22:54	1324786	18810527	hadam3p_anz_n0lb_2008_1_010099988_0	57,899	295,975	5.1119
18 Aug 2015 18:53:53	1324786	18810527	hadam3p_anz_n0lb_2008_1_010099988_0	46,379	237,199	5.1144
18 Aug 2015 01:36:53	1324786	18810527	hadam3p_anz_n0lb_2008_1_010099988_0	34,859	179,364	5.1454
16 Aug 2015 05:54:46	1324786	18810527	hadam3p_anz_n0lb_2008_1_010099988_0	23,339	120,923	5.1812
15 Aug 2015 03:01:50	1324786	18810527	hadam3p_anz_n0lb_2008_1_010099988_0	11,819	61,194	5.1776