Task 14328796

Name	hadam3p_eu_9a7s_1967_1_007828157_2
Workunit	7983269
Created	29 Mar 2012, 0:36:09 UTC
Sent	29 Mar 2012, 0:36:22 UTC
Report deadline	11 Mar 2013, 5:56:22 UTC
Received	30 Apr 2012, 3:13:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	870397
Run time	2 days 10 hours 28 min 44 sec
CPU time	2 days 10 hours 28 min 44 sec
Validate state	Invalid
Credit	1,194.02
Device peak FLOPS	2.28 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.2.18</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5172, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6128, selfPID=4744, iMonCtr=1 Model crash detected, will try to restart... 15:40:54 (4288): No heartbeat from core client for 30 sec - exiting 15:40:55 (4288): No heartbeat from core client for 30 sec - exiting 15:40:56 (4288): No heartbeat from core client for 30 sec - exiting 15:40:57 (4288): No heartbeat from core client for 30 sec - exiting 15:40:58 (4288): No heartbeat from core client for 30 sec - exiting 15:40:59 (4288): No heartbeat from core client for 30 sec - exiting 15:41:00 (4288): No heartbeat from core client for 30 sec - exiting 15:41:01 (4288): No heartbeat from core client for 30 sec - exiting 15:41:02 (4288): No heartbeat from core client for 30 sec - exiting 15:41:03 (4288): No heartbeat from core client for 30 sec - exiting 15:41:04 (4288): No heartbeat from core client for 30 sec - exiting 15:41:05 (4288): No heartbeat from core client for 30 sec - exiting 15:41:06 (4288): No heartbeat from core client for 30 sec - exiting 15:41:07 (4288): No heartbeat from core client for 30 sec - exiting 15:41:08 (4288): No heartbeat from core client for 30 sec - exiting 15:41:09 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4668, selfPID=4812, iMonCtr=1 Model crash detected, will try to restart... 11:21:48 (4272): No heartbeat from core client for 30 sec - exiting 11:21:49 (4272): No heartbeat from core client for 30 sec - exiting 11:21:50 (4272): No heartbeat from core client for 30 sec - exiting 11:21:51 (4272): No heartbeat from core client for 30 sec - exiting 11:21:52 (4272): No heartbeat from core client for 30 sec - exiting 11:21:53 (4272): No heartbeat from core client for 30 sec - exiting 11:21:54 (4272): No heartbeat from core client for 30 sec - exiting 11:21:55 (4272): No heartbeat from core client for 30 sec - exiting 11:21:56 (4272): No heartbeat from core client for 30 sec - exiting 11:21:57 (4272): No heartbeat from core client for 30 sec - exiting 11:21:58 (4272): No heartbeat from core client for 30 sec - exiting 11:21:59 (4272): No heartbeat from core client for 30 sec - exiting 11:22:00 (4272): No heartbeat from core client for 30 sec - exiting 11:22:01 (4272): No heartbeat from core client for 30 sec - exiting 11:22:02 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6008, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4844, selfPID=5764, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2624, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4200, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1552, selfPID=2648, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 13:36:06 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1392, iMonCtr=2 Model crash detected, will try to restart... 08:48:41 (4812): No heartbeat from core client for 30 sec - exiting 08:48:42 (4812): No heartbeat from core client for 30 sec - exiting 08:48:43 (4812): No heartbeat from core client for 30 sec - exiting 08:48:44 (4812): No heartbeat from core client for 30 sec - exiting 08:48:45 (4812): No heartbeat from core client for 30 sec - exiting 08:48:46 (4812): No heartbeat from core client for 30 sec - exiting 08:48:47 (4812): No heartbeat from core client for 30 sec - exiting 08:48:48 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2928, iMonCtr=2 Model crash detected, will try to restart... 08:41:56 (4552): No heartbeat from core client for 30 sec - exiting 08:41:57 (4552): No heartbeat from core client for 30 sec - exiting 08:41:58 (4552): No heartbeat from core client for 30 sec - exiting 08:41:59 (4552): No heartbeat from core client for 30 sec - exiting 08:42:00 (4552): No heartbeat from core client for 30 sec - exiting 08:42:01 (4552): No heartbeat from core client for 30 sec - exiting 08:42:02 (4552): No heartbeat from core client for 30 sec - exiting 08:42:03 (4552): No heartbeat from core client for 30 sec - exiting 08:42:04 (4552): No heartbeat from core client for 30 sec - exiting 08:42:05 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:55 (5560): No heartbeat from core client for 30 sec - exiting 11:42:06 (5560): No heartbeat from core client for 30 sec - exiting 11:42:15 (5560): No heartbeat from core client for 30 sec - exiting 11:42:22 (5560): No heartbeat from core client for 30 sec - exiting 11:42:31 (5560): No heartbeat from core client for 30 sec - exiting 11:42:38 (5560): No heartbeat from core client for 30 sec - exiting 11:42:48 (5560): No heartbeat from core client for 30 sec - exiting 11:42:56 (5560): No heartbeat from core client for 30 sec - exiting 11:42:57 (5560): No heartbeat from core client for 30 sec - exiting 11:42:58 (5560): No heartbeat from core client for 30 sec - exiting 11:43:00 (5560): No heartbeat from core client for 30 sec - exiting 11:43:01 (5560): No heartbeat from core client for 30 sec - exiting 11:43:02 (5560): No heartbeat from core client for 30 sec - exiting 11:43:03 (5560): No heartbeat from core client for 30 sec - exiting 11:43:05 (5560): No heartbeat from core client for 30 sec - exiting 11:43:15 (5560): No heartbeat from core client for 30 sec - exiting 11:43:26 (5560): No heartbeat from core client for 30 sec - exiting 11:43:27 (5560): No heartbeat from core client for 30 sec - exiting 11:43:39 (5560): No heartbeat from core client for 30 sec - exiting 11:43:40 (5560): No heartbeat from core client for 30 sec - exiting 11:43:42 (5560): No heartbeat from core client for 30 sec - exiting 11:43:43 (5560): No heartbeat from core client for 30 sec - exiting 11:43:45 (5560): No heartbeat from core client for 30 sec - exiting 11:43:46 (5560): No heartbeat from core client for 30 sec - exiting 11:43:49 (5560): No heartbeat from core client for 30 sec - exiting 11:43:58 (5560): No heartbeat from core client for 30 sec - exiting 11:45:15 (5560): No heartbeat from core client for 30 sec - exiting 11:45:23 (5560): No heartbeat from core client for 30 sec - exiting 11:45:29 (5560): No heartbeat from core client for 30 sec - exiting 11:46:01 (5560): No heartbeat from core client for 30 sec - exiting 11:46:19 (5560): No heartbeat from core client for 30 sec - exiting 11:46:22 (5560): No heartbeat from core client for 30 sec - exiting 11:46:24 (5560): No heartbeat from core client for 30 sec - exiting 11:46:25 (5560): No heartbeat from core client for 30 sec - exiting 11:46:27 (5560): No heartbeat from core client for 30 sec - exiting 11:46:30 (5560): No heartbeat from core client for 30 sec - exiting 11:46:31 (5560): No heartbeat from core client for 30 sec - exiting 11:46:32 (5560): No heartbeat from core client for 30 sec - exiting 11:46:34 (5560): No heartbeat from core client for 30 sec - exiting 11:46:35 (5560): No heartbeat from core client for 30 sec - exiting 11:46:37 (5560): No heartbeat from core client for 30 sec - exiting 11:46:38 (5560): No heartbeat from core client for 30 sec - exiting 11:46:40 (5560): No heartbeat from core client for 30 sec - exiting 11:46:41 (5560): No heartbeat from core client for 30 sec - exiting 11:46:42 (5560): No heartbeat from core client for 30 sec - exiting 11:46:43 (5560): No heartbeat from core client for 30 sec - exiting 11:46:45 (5560): No heartbeat from core client for 30 sec - exiting 11:46:46 (5560): No heartbeat from core client for 30 sec - exiting 11:46:48 (5560): No heartbeat from core client for 30 sec - exiting 11:46:49 (5560): No heartbeat from core client for 30 sec - exiting 11:48:19 (5560): No heartbeat from core client for 30 sec - exiting 11:48:32 (5560): No heartbeat from core client for 30 sec - exiting 11:48:43 (5560): No heartbeat from core client for 30 sec - exiting 11:48:57 (5560): No heartbeat from core client for 30 sec - exiting 11:49:11 (5560): No heartbeat from core client for 30 sec - exiting 11:49:24 (5560): No heartbeat from core client for 30 sec - exiting 11:49:38 (5560): No heartbeat from core client for 30 sec - exiting 11:49:52 (5560): No heartbeat from core client for 30 sec - exiting 11:50:09 (5560): No heartbeat from core client for 30 sec - exiting 11:50:25 (5560): No heartbeat from core client for 30 sec - exiting 11:50:42 (5560): No heartbeat from core client for 30 sec - exiting 11:50:54 (5560): No heartbeat from core client for 30 sec - exiting 11:51:08 (5560): No heartbeat from core client for 30 sec - exiting 11:51:20 (5560): No heartbeat from core client for 30 sec - exiting 11:51:31 (5560): No heartbeat from core client for 30 sec - exiting 11:51:42 (5560): No heartbeat from core client for 30 sec - exiting 11:51:50 (5560): No heartbeat from core client for 30 sec - exiting 11:52:02 (5560): No heartbeat from core client for 30 sec - exiting 11:52:12 (5560): No heartbeat from core client for 30 sec - exiting 11:52:25 (5560): No heartbeat from core client for 30 sec - exiting 11:52:31 (5560): No heartbeat from core client for 30 sec - exiting 11:52:33 (5560): No heartbeat from core client for 30 sec - exiting 11:52:41 (5560): No heartbeat from core client for 30 sec - exiting 11:52:57 (5560): No heartbeat from core client for 30 sec - exiting 11:52:59 (5560): No heartbeat from core client for 30 sec - exiting 11:53:01 (5560): No heartbeat from core client for 30 sec - exiting 11:53:04 (5560): No heartbeat from core client for 30 sec - exiting 11:53:10 (5560): No heartbeat from core client for 30 sec - exiting 11:53:14 (5560): No heartbeat from core client for 30 sec - exiting 11:53:19 (5560): No heartbeat from core client for 30 sec - exiting 11:53:20 (5560): No heartbeat from core client for 30 sec - exiting 11:53:23 (5560): No heartbeat from core client for 30 sec - exiting 11:53:25 (5560): No heartbeat from core client for 30 sec - exiting 11:53:26 (5560): No heartbeat from core client for 30 sec - exiting 11:53:28 (5560): No heartbeat from core client for 30 sec - exiting 11:53:30 (5560): No heartbeat from core client for 30 sec - exiting 11:53:31 (5560): No heartbeat from core client for 30 sec - exiting 11:53:33 (5560): No heartbeat from core client for 30 sec - exiting 11:53:34 (5560): No heartbeat from core client for 30 sec - exiting 11:54:06 (5560): No heartbeat from core client for 30 sec - exiting 11:54:07 (5560): No heartbeat from core client for 30 sec - exiting 11:54:09 (5560): No heartbeat from core client for 30 sec - exiting 11:54:11 (5560): No heartbeat from core client for 30 sec - exiting 11:54:13 (5560): No heartbeat from core client for 30 sec - exiting 11:54:15 (5560): No heartbeat from core client for 30 sec - exiting 11:54:17 (5560): No heartbeat from core client for 30 sec - exiting 11:54:19 (5560): No heartbeat from core client for 30 sec - exiting 11:54:21 (5560): No heartbeat from core client for 30 sec - exiting 11:54:23 (5560): No heartbeat from core client for 30 sec - exiting 11:54:25 (5560): No heartbeat from core client for 30 sec - exiting 11:54:26 (5560): No heartbeat from core client for 30 sec - exiting 11:54:28 (5560): No heartbeat from core client for 30 sec - exiting 11:54:31 (5560): No heartbeat from core client for 30 sec - exiting 11:54:32 (5560): No heartbeat from core client for 30 sec - exiting 11:54:34 (5560): No heartbeat from core client for 30 sec - exiting 11:54:35 (5560): No heartbeat from core client for 30 sec - exiting 11:54:37 (5560): No heartbeat from core client for 30 sec - exiting 11:54:38 (5560): No heartbeat from core client for 30 sec - exiting 11:54:39 (5560): No heartbeat from core client for 30 sec - exiting 11:54:41 (5560): No heartbeat from core client for 30 sec - exiting 11:54:42 (5560): No heartbeat from core client for 30 sec - exiting 11:54:46 (5560): No heartbeat from core client for 30 sec - exiting 11:54:47 (5560): No heartbeat from core client for 30 sec - exiting 11:55:20 (5560): No heartbeat from core client for 30 sec - exiting 11:55:21 (5560): No heartbeat from core client for 30 sec - exiting 11:55:23 (5560): No heartbeat from core client for 30 sec - exiting 11:55:24 (5560): No heartbeat from core client for 30 sec - exiting 11:55:26 (5560): No heartbeat from core client for 30 sec - exiting 11:55:27 (5560): No heartbeat from core client for 30 sec - exiting 11:55:28 (5560): No heartbeat from core client for 30 sec - exiting 11:55:30 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:50 (3180): No heartbeat from core client for 30 sec - exiting 11:57:51 (3180): No heartbeat from core client for 30 sec - exiting 11:57:52 (3180): No heartbeat from core client for 30 sec - exiting 11:57:54 (3180): No heartbeat from core client for 30 sec - exiting 11:57:55 (3180): No heartbeat from core client for 30 sec - exiting 11:59:43 (3180): No heartbeat from core client for 30 sec - exiting 11:59:44 (3180): No heartbeat from core client for 30 sec - exiting 12:01:31 (3180): No heartbeat from core client for 30 sec - exiting 12:01:33 (3180): No heartbeat from core client for 30 sec - exiting 12:01:34 (3180): No heartbeat from core client for 30 sec - exiting 12:02:06 (3180): No heartbeat from core client for 30 sec - exiting 12:02:07 (3180): No heartbeat from core client for 30 sec - exiting 12:02:09 (3180): No heartbeat from core client for 30 sec - exiting 12:02:11 (3180): No heartbeat from core client for 30 sec - exiting 12:02:12 (3180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:17 (4212): No heartbeat from core client for 30 sec - exiting 12:03:18 (4212): No heartbeat from core client for 30 sec - exiting 12:03:21 (4212): No heartbeat from core client for 30 sec - exiting 12:03:22 (4212): No heartbeat from core client for 30 sec - exiting 12:03:24 (4212): No heartbeat from core client for 30 sec - exiting 12:03:26 (4212): No heartbeat from core client for 30 sec - exiting 12:03:27 (4212): No heartbeat from core client for 30 sec - exiting 12:03:29 (4212): No heartbeat from core client for 30 sec - exiting 12:03:30 (4212): No heartbeat from core client for 30 sec - exiting 12:03:32 (4212): No heartbeat from core client for 30 sec - exiting 12:03:34 (4212): No heartbeat from core client for 30 sec - exiting 12:03:35 (4212): No heartbeat from core client for 30 sec - exiting 12:04:06 (4212): No heartbeat from core client for 30 sec - exiting 12:04:08 (4212): No heartbeat from core client for 30 sec - exiting 12:04:11 (4212): No heartbeat from core client for 30 sec - exiting 12:04:13 (4212): No heartbeat from core client for 30 sec - exiting 12:05:50 (4212): No heartbeat from core client for 30 sec - exiting 12:05:53 (4212): No heartbeat from core client for 30 sec - exiting 12:05:54 (4212): No heartbeat from core client for 30 sec - exiting 12:05:55 (4212): No heartbeat from core client for 30 sec - exiting 12:05:57 (4212): No heartbeat from core client for 30 sec - exiting 12:06:28 (4212): No heartbeat from core client for 30 sec - exiting 12:06:30 (4212): No heartbeat from core client for 30 sec - exiting 12:06:31 (4212): No heartbeat from core client for 30 sec - exiting 12:06:32 (4212): No heartbeat from core client for 30 sec - exiting 12:07:04 (4212): No heartbeat from core client for 30 sec - exiting 12:07:12 (4212): No heartbeat from core client for 30 sec - exiting 12:07:16 (4212): No heartbeat from core client for 30 sec - exiting 12:07:24 (4212): No heartbeat from core client for 30 sec - exiting 12:07:31 (4212): No heartbeat from core client for 30 sec - exiting 12:07:33 (4212): No heartbeat from core client for 30 sec - exiting 12:07:34 (4212): No heartbeat from core client for 30 sec - exiting 12:07:36 (4212): No heartbeat from core client for 30 sec - exiting 12:07:37 (4212): No heartbeat from core client for 30 sec - exiting 12:07:38 (4212): No heartbeat from core client for 30 sec - exiting 12:07:40 (4212): No heartbeat from core client for 30 sec - exiting 12:07:41 (4212): No heartbeat from core client for 30 sec - exiting 12:07:42 (4212): No heartbeat from core client for 30 sec - exiting 12:07:43 (4212): No heartbeat from core client for 30 sec - exiting 12:07:45 (4212): No heartbeat from core client for 30 sec - exiting 12:08:16 (4212): No heartbeat from core client for 30 sec - exiting 12:08:18 (4212): No heartbeat from core client for 30 sec - exiting 12:08:50 (4212): No heartbeat from core client for 30 sec - exiting 12:08:51 (4212): No heartbeat from core client for 30 sec - exiting 12:08:53 (4212): No heartbeat from core client for 30 sec - exiting 12:08:55 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:02 (5324): No heartbeat from core client for 30 sec - exiting 12:10:14 (5324): No heartbeat from core client for 30 sec - exiting 12:10:27 (5324): No heartbeat from core client for 30 sec - exiting 12:10:37 (5324): No heartbeat from core client for 30 sec - exiting 12:10:43 (5324): No heartbeat from core client for 30 sec - exiting 12:10:50 (5324): No heartbeat from core client for 30 sec - exiting 12:11:21 (5324): No heartbeat from core client for 30 sec - exiting 12:11:22 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:16 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:38 (4992): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLCFILES tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_9a7s_1967_1_007828157_2_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9a7s_1967_1_007828157_2_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9a7s_1967_1_007828157_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9a7s_1967_1_007828157_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9a7s_1967_1_007828157_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9a7s_1967_1_007828157_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Apr 2012 05:47:40	870397	14328796	hadam3p_eu_9a7s_1967_1_007828157_2	69,216	185,390	2.6784
25 Apr 2012 01:44:16	870397	14328796	hadam3p_eu_9a7s_1967_1_007828157_2	57,696	155,168	2.6894
21 Apr 2012 06:08:12	870397	14328796	hadam3p_eu_9a7s_1967_1_007828157_2	46,176	124,524	2.6967
20 Apr 2012 00:21:59	870397	14328796	hadam3p_eu_9a7s_1967_1_007828157_2	34,656	93,182	2.6888
17 Apr 2012 04:44:33	870397	14328796	hadam3p_eu_9a7s_1967_1_007828157_2	23,136	62,362	2.6955
12 Apr 2012 02:52:57	870397	14328796	hadam3p_eu_9a7s_1967_1_007828157_2	11,616	31,577	2.7184