Task 16126710

Name	hadam3p_eu_j5y8_1992_1_008499557_0
Workunit	8650370
Created	3 Dec 2013, 22:18:39 UTC
Sent	4 Dec 2013, 1:57:06 UTC
Report deadline	16 Nov 2014, 7:17:06 UTC
Received	7 Dec 2013, 18:43:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1275765
Run time	2 days 4 hours 52 min 25 sec
CPU time	2 days 1 hours 4 min 46 sec
Validate state	Invalid
Credit	1,589.83
Device peak FLOPS	3.06 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> 08:00:22 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:23 (3520): No heartbeat from core client for 30 sec - exiting 08:00:24 (3520): No heartbeat from core client for 30 sec - exiting 08:00:25 (3520): No heartbeat from core client for 30 sec - exiting 09:55:57 (1044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:55:58 (1044): No heartbeat from core client for 30 sec - exiting 09:55:59 (1044): No heartbeat from core client for 30 sec - exiting 09:56:00 (1044): No heartbeat from core client for 30 sec - exiting 09:56:01 (1044): No heartbeat from core client for 30 sec - exiting 09:56:02 (1044): No heartbeat from core client for 30 sec - exiting 11:11:27 (564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:13 (1620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:16 (1620): No heartbeat from core client for 30 sec - exiting 12:12:19 (1620): No heartbeat from core client for 30 sec - exiting 12:12:21 (1620): No heartbeat from core client for 30 sec - exiting 12:12:22 (1620): No heartbeat from core client for 30 sec - exiting 12:31:36 (2532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:37 (2532): No heartbeat from core client for 30 sec - exiting 12:31:38 (2532): No heartbeat from core client for 30 sec - exiting 12:31:41 (2532): No heartbeat from core client for 30 sec - exiting 12:31:43 (2532): No heartbeat from core client for 30 sec - exiting 13:18:35 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:36 (5776): No heartbeat from core client for 30 sec - exiting 13:18:38 (5776): No heartbeat from core client for 30 sec - exiting 13:18:40 (5776): No heartbeat from core client for 30 sec - exiting 14:47:13 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:14 (6000): No heartbeat from core client for 30 sec - exiting 15:47:28 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:29 (3740): No heartbeat from core client for 30 sec - exiting 15:47:31 (3740): No heartbeat from core client for 30 sec - exiting 15:47:34 (3740): No heartbeat from core client for 30 sec - exiting 15:47:36 (3740): No heartbeat from core client for 30 sec - exiting 15:47:38 (3740): No heartbeat from core client for 30 sec - exiting 15:53:01 (5964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:53:02 (5964): No heartbeat from core client for 30 sec - exiting 15:53:04 (5964): No heartbeat from core client for 30 sec - exiting 16:40:04 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:05 (4616): No heartbeat from core client for 30 sec - exiting 16:40:08 (4616): No heartbeat from core client for 30 sec - exiting 18:23:30 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:31 (4624): No heartbeat from core client for 30 sec - exiting 18:23:33 (4624): No heartbeat from core client for 30 sec - exiting 18:23:36 (4624): No heartbeat from core client for 30 sec - exiting 18:23:37 (4624): No heartbeat from core client for 30 sec - exiting 18:23:39 (4624): No heartbeat from core client for 30 sec - exiting 19:37:54 (2528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:55 (2528): No heartbeat from core client for 30 sec - exiting 19:37:57 (2528): No heartbeat from core client for 30 sec - exiting 19:37:58 (2528): No heartbeat from core client for 30 sec - exiting 19:38:01 (2528): No heartbeat from core client for 30 sec - exiting 19:38:02 (2528): No heartbeat from core client for 30 sec - exiting 19:38:03 (2528): No heartbeat from core client for 30 sec - exiting 19:38:04 (2528): No heartbeat from core client for 30 sec - exiting 23:10:50 (2180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:18 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:19 (4568): No heartbeat from core client for 30 sec - exiting 23:30:21 (4568): No heartbeat from core client for 30 sec - exiting 23:30:23 (4568): No heartbeat from core client for 30 sec - exiting 23:30:25 (4568): No heartbeat from core client for 30 sec - exiting 23:30:26 (4568): No heartbeat from core client for 30 sec - exiting 23:49:38 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:49:41 (4436): No heartbeat from core client for 30 sec - exiting 23:49:42 (4436): No heartbeat from core client for 30 sec - exiting 23:49:43 (4436): No heartbeat from core client for 30 sec - exiting 00:23:14 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:15 (4860): No heartbeat from core client for 30 sec - exiting 00:29:21 (1320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:24 (1320): No heartbeat from core client for 30 sec - exiting 00:29:25 (1320): No heartbeat from core client for 30 sec - exiting 00:29:27 (1320): No heartbeat from core client for 30 sec - exiting 00:29:28 (1320): No heartbeat from core client for 30 sec - exiting 00:29:30 (1320): No heartbeat from core client for 30 sec - exiting 00:29:32 (1320): No heartbeat from core client for 30 sec - exiting 00:36:38 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:36:39 (5452): No heartbeat from core client for 30 sec - exiting 00:36:42 (5452): No heartbeat from core client for 30 sec - exiting 00:36:46 (5452): No heartbeat from core client for 30 sec - exiting 00:36:48 (5452): No heartbeat from core client for 30 sec - exiting 01:10:58 (2076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:59 (2076): No heartbeat from core client for 30 sec - exiting 01:11:01 (2076): No heartbeat from core client for 30 sec - exiting 01:11:02 (2076): No heartbeat from core client for 30 sec - exiting 01:11:04 (2076): No heartbeat from core client for 30 sec - exiting 01:11:05 (2076): No heartbeat from core client for 30 sec - exiting 01:11:08 (2076): No heartbeat from core client for 30 sec - exiting 02:26:17 (984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:54 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:11 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:13 (4548): No heartbeat from core client for 30 sec - exiting 03:51:46 (344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:47 (344): No heartbeat from core client for 30 sec - exiting 03:51:50 (344): No heartbeat from core client for 30 sec - exiting 03:56:46 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:47 (5620): No heartbeat from core client for 30 sec - exiting 03:56:49 (5620): No heartbeat from core client for 30 sec - exiting 03:56:50 (5620): No heartbeat from core client for 30 sec - exiting 03:56:52 (5620): No heartbeat from core client for 30 sec - exiting 03:56:54 (5620): No heartbeat from core client for 30 sec - exiting 03:56:55 (5620): No heartbeat from core client for 30 sec - exiting 05:25:32 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:33 (5300): No heartbeat from core client for 30 sec - exiting 05:44:56 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:44:57 (5504): No heartbeat from core client for 30 sec - exiting 06:03:47 (844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:48 (844): No heartbeat from core client for 30 sec - exiting 06:03:51 (844): No heartbeat from core client for 30 sec - exiting 06:23:35 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:57 (1276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:58 (1276): No heartbeat from core client for 30 sec - exiting 07:38:00 (1276): No heartbeat from core client for 30 sec - exiting 07:38:01 (1276): No heartbeat from core client for 30 sec - exiting 07:38:03 (1276): No heartbeat from core client for 30 sec - exiting 07:42:57 (2104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:42:58 (2104): No heartbeat from core client for 30 sec - exiting 07:43:00 (2104): No heartbeat from core client for 30 sec - exiting 07:43:01 (2104): No heartbeat from core client for 30 sec - exiting 07:43:02 (2104): No heartbeat from core client for 30 sec - exiting 07:43:05 (2104): No heartbeat from core client for 30 sec - exiting 07:43:07 (2104): No heartbeat from core client for 30 sec - exiting 08:29:51 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:29 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:55 (3452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:56 (3452): No heartbeat from core client for 30 sec - exiting 10:18:57 (3452): No heartbeat from core client for 30 sec - exiting 10:18:58 (3452): No heartbeat from core client for 30 sec - exiting 10:18:59 (3452): No heartbeat from core client for 30 sec - exiting 11:34:12 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:34:13 (5296): No heartbeat from core client for 30 sec - exiting 11:34:14 (5296): No heartbeat from core client for 30 sec - exiting 11:34:15 (5296): No heartbeat from core client for 30 sec - exiting 11:34:16 (5296): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5476, selfPID=5476, iMonCtr=2 13:30:45 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5804, selfPID=5804, iMonCtr=2 13:44:48 (3452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:27 (1252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:09:50 (392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:09:51 (392): No heartbeat from core client for 30 sec - exiting 14:15:23 (1576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:15:24 (1576): No heartbeat from core client for 30 sec - exiting 14:15:26 (1576): No heartbeat from core client for 30 sec - exiting 14:15:27 (1576): No heartbeat from core client for 30 sec - exiting 14:15:29 (1576): No heartbeat from core client for 30 sec - exiting 14:15:32 (1576): No heartbeat from core client for 30 sec - exiting 15:30:45 (656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:40 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:41 (5204): No heartbeat from core client for 30 sec - exiting 15:50:42 (5204): No heartbeat from core client for 30 sec - exiting 15:50:44 (5204): No heartbeat from core client for 30 sec - exiting 15:50:47 (5204): No heartbeat from core client for 30 sec - exiting 15:50:48 (5204): No heartbeat from core client for 30 sec - exiting 15:50:50 (5204): No heartbeat from core client for 30 sec - exiting 17:48:49 (1472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:50 (1472): No heartbeat from core client for 30 sec - exiting 18:50:25 (1852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5960, selfPID=5960, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 21:58:51 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:58:52 (5912): No heartbeat from core client for 30 sec - exiting 21:58:54 (5912): No heartbeat from core client for 30 sec - exiting 21:58:57 (5912): No heartbeat from core client for 30 sec - exiting 21:59:00 (5912): No heartbeat from core client for 30 sec - exiting 21:59:01 (5912): No heartbeat from core client for 30 sec - exiting 23:40:48 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:49 (3408): No heartbeat from core client for 30 sec - exiting 01:35:03 (5904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:04 (5904): No heartbeat from core client for 30 sec - exiting 01:35:06 (5904): No heartbeat from core client for 30 sec - exiting 01:35:09 (5904): No heartbeat from core client for 30 sec - exiting 01:35:11 (5904): No heartbeat from core client for 30 sec - exiting 01:56:33 (6124): No heartbeat from core client for 30 sec - exiting 01:56:34 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:07 (1324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:10 (1324): No heartbeat from core client for 30 sec - exiting 03:51:11 (1324): No heartbeat from core client for 30 sec - exiting 03:51:13 (1324): No heartbeat from core client for 30 sec - exiting 04:34:56 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:57 (4140): No heartbeat from core client for 30 sec - exiting 06:57:07 (1876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:57:08 (1876): No heartbeat from core client for 30 sec - exiting 06:57:10 (1876): No heartbeat from core client for 30 sec - exiting 06:57:11 (1876): No heartbeat from core client for 30 sec - exiting 06:57:13 (1876): No heartbeat from core client for 30 sec - exiting 06:57:14 (1876): No heartbeat from core client for 30 sec - exiting 06:57:16 (1876): No heartbeat from core client for 30 sec - exiting 06:57:17 (1876): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:33:56 (1312): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:00:51 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:00:52 (4120): No heartbeat from core client for 30 sec - exiting 03:00:54 (4120): No heartbeat from core client for 30 sec - exiting 03:00:56 (4120): No heartbeat from core client for 30 sec - exiting 03:00:57 (4120): No heartbeat from core client for 30 sec - exiting 03:20:53 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:20:54 (5264): No heartbeat from core client for 30 sec - exiting 03:20:55 (5264): No heartbeat from core client for 30 sec - exiting 03:20:57 (5264): No heartbeat from core client for 30 sec - exiting 03:25:55 (1972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:25:56 (1972): No heartbeat from core client for 30 sec - exiting 03:26:00 (1972): No heartbeat from core client for 30 sec - exiting 03:26:02 (1972): No heartbeat from core client for 30 sec - exiting 06:01:50 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:01:51 (3908): No heartbeat from core client for 30 sec - exiting 06:01:52 (3908): No heartbeat from core client for 30 sec - exiting 06:01:54 (3908): No heartbeat from core client for 30 sec - exiting 06:01:56 (3908): No heartbeat from core client for 30 sec - exiting 06:01:57 (3908): No heartbeat from core client for 30 sec - exiting 06:01:58 (3908): No heartbeat from core client for 30 sec - exiting 06:02:00 (3908): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4388, selfPID=2528, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_j5y8_1992_1_008499557_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j5y8_1992_1_008499557_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j5y8_1992_1_008499557_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j5y8_1992_1_008499557_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2013 04:39:11	1275765	16126710	hadam3p_eu_j5y8_1992_1_008499557_0	92,160	165,910	1.8002
06 Dec 2013 20:46:06	1275765	16126710	hadam3p_eu_j5y8_1992_1_008499557_0	80,640	145,297	1.8018
06 Dec 2013 01:59:50	1275765	16126710	hadam3p_eu_j5y8_1992_1_008499557_0	69,280	125,442	1.8107
06 Dec 2013 00:59:24	1275765	16126710	hadam3p_eu_j5y8_1992_1_008499557_0	69,216	125,009	1.8061
05 Dec 2013 16:38:20	1275765	16126710	hadam3p_eu_j5y8_1992_1_008499557_0	57,696	104,270	1.8072
05 Dec 2013 08:52:30	1275765	16126710	hadam3p_eu_j5y8_1992_1_008499557_0	46,176	83,401	1.8062
05 Dec 2013 00:50:19	1275765	16126710	hadam3p_eu_j5y8_1992_1_008499557_0	34,656	62,658	1.8080
04 Dec 2013 17:00:37	1275765	16126710	hadam3p_eu_j5y8_1992_1_008499557_0	23,136	41,770	1.8054
04 Dec 2013 09:20:22	1275765	16126710	hadam3p_eu_j5y8_1992_1_008499557_0	11,616	20,902	1.7994