Task 16740136

Name	hadam3p_eu_l7x4_2013_1_008821489_0
Workunit	8967418
Created	8 Jul 2014, 10:12:32 UTC
Sent	29 Jul 2014, 5:27:28 UTC
Report deadline	11 Jul 2015, 10:47:28 UTC
Received	10 Sep 2014, 2:25:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-2147483645 (0x80000003) Unknown error code
Computer ID	1234533
Run time	12 days 3 hours 9 min 54 sec
CPU time	3 days 9 hours 12 min 2 sec
Validate state	Invalid
Credit	2,386.39
Device peak FLOPS	3.11 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> One or more arguments are invalid (0x80000003) - exit code -2147483645 (0x80000003) </message> <stderr_txt> 12:33:36 (2384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:37 (2384): No heartbeat from core client for 30 sec - exiting 12:33:38 (2384): No heartbeat from core client for 30 sec - exiting 12:33:39 (2384): No heartbeat from core client for 30 sec - exiting 12:33:40 (2384): No heartbeat from core client for 30 sec - exiting 12:33:41 (2384): No heartbeat from core client for 30 sec - exiting 12:33:42 (2384): No heartbeat from core client for 30 sec - exiting 12:33:43 (2384): No heartbeat from core client for 30 sec - exiting 12:33:44 (2384): No heartbeat from core client for 30 sec - exiting 12:33:45 (2384): No heartbeat from core client for 30 sec - exiting 12:33:47 (2384): No heartbeat from core client for 30 sec - exiting 12:33:48 (2384): No heartbeat from core client for 30 sec - exiting 12:33:49 (2384): No heartbeat from core client for 30 sec - exiting 12:33:50 (2384): No heartbeat from core client for 30 sec - exiting 12:33:51 (2384): No heartbeat from core client for 30 sec - exiting 12:33:52 (2384): No heartbeat from core client for 30 sec - exiting 12:33:53 (2384): No heartbeat from core client for 30 sec - exiting 12:33:54 (2384): No heartbeat from core client for 30 sec - exiting 12:33:55 (2384): No heartbeat from core client for 30 sec - exiting 12:33:56 (2384): No heartbeat from core client for 30 sec - exiting 12:33:58 (2384): No heartbeat from core client for 30 sec - exiting 12:33:59 (2384): No heartbeat from core client for 30 sec - exiting 12:34:00 (2384): No heartbeat from core client for 30 sec - exiting 12:34:01 (2384): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish 12:34:02 (2384): No heartbeat from core client for 30 sec - exiting 12:34:03 (2384): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Breakpoint Encountered (0x80000003) at address 0x760E1F66 Engaging BOINC Windows Runtime Debugger... 12:24:10 (2376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:11 (2376): No heartbeat from core client for 30 sec - exiting 12:24:12 (2376): No heartbeat from core client for 30 sec - exiting 12:24:14 (2376): No heartbeat from core client for 30 sec - exiting 12:24:15 (2376): No heartbeat from core client for 30 sec - exiting 12:24:16 (2376): No heartbeat from core client for 30 sec - exiting 12:24:17 (2376): No heartbeat from core client for 30 sec - exiting 12:24:18 (2376): No heartbeat from core client for 30 sec - exiting 12:24:19 (2376): No heartbeat from core client for 30 sec - exiting 12:24:20 (2376): No heartbeat from core client for 30 sec - exiting 12:24:21 (2376): No heartbeat from core client for 30 sec - exiting 12:24:22 (2376): No heartbeat from core client for 30 sec - exiting 12:24:23 (2376): No heartbeat from core client for 30 sec - exiting 12:24:25 (2376): No heartbeat from core client for 30 sec - exiting 12:24:26 (2376): No heartbeat from core client for 30 sec - exiting 12:24:27 (2376): No heartbeat from core client for 30 sec - exiting 12:24:28 (2376): No heartbeat from core client for 30 sec - exiting 12:24:29 (2376): No heartbeat from core client for 30 sec - exiting 12:24:30 (2376): No heartbeat from core client for 30 sec - exiting 12:24:31 (2376): No heartbeat from core client for 30 sec - exiting 12:24:32 (2376): No heartbeat from core client for 30 sec - exiting 12:24:33 (2376): No heartbeat from core client for 30 sec - exiting 12:24:34 (2376): No heartbeat from core client for 30 sec - exiting 12:24:35 (2376): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish 12:24:37 (2376): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Breakpoint Encountered (0x80000003) at address 0x75DA1F66 Engaging BOINC Windows Runtime Debugger... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3264, selfPID=3264, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3264, selfPID=3268, iMonCtr=1 08:08:14 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:23 (2892): No heartbeat from core client for 30 sec - exiting 08:08:33 (2892): No heartbeat from core client for 30 sec - exiting 08:08:46 (2892): No heartbeat from core client for 30 sec - exiting 08:08:56 (2892): No heartbeat from core client for 30 sec - exiting 08:09:06 (2892): No heartbeat from core client for 30 sec - exiting 08:09:19 (2892): No heartbeat from core client for 30 sec - exiting 08:09:29 (2892): No heartbeat from core client for 30 sec - exiting 08:09:39 (2892): No heartbeat from core client for 30 sec - exiting 08:09:51 (2892): No heartbeat from core client for 30 sec - exiting 08:10:02 (2892): No heartbeat from core client for 30 sec - exiting 08:10:12 (2892): No heartbeat from core client for 30 sec - exiting 08:10:22 (2892): No heartbeat from core client for 30 sec - exiting 08:10:34 (2892): No heartbeat from core client for 30 sec - exiting 08:10:44 (2892): No heartbeat from core client for 30 sec - exiting 08:10:54 (2892): No heartbeat from core client for 30 sec - exiting 08:11:04 (2892): No heartbeat from core client for 30 sec - exiting 08:11:18 (2892): No heartbeat from core client for 30 sec - exiting 08:11:28 (2892): No heartbeat from core client for 30 sec - exiting 08:11:38 (2892): No heartbeat from core client for 30 sec - exiting 08:11:52 (2892): No heartbeat from core client for 30 sec - exiting 08:12:02 (2892): No heartbeat from core client for 30 sec - exiting 08:12:12 (2892): No heartbeat from core client for 30 sec - exiting 08:12:26 (2892): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Breakpoint Encountered (0x80000003) at address 0x75C71F66 Engaging BOINC Windows Runtime Debugger... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2368, selfPID=2368, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2368, selfPID=2596, iMonCtr=1 11:51:36 (2304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:45 (2304): No heartbeat from core client for 30 sec - exiting 11:51:57 (2304): No heartbeat from core client for 30 sec - exiting 11:52:06 (2304): No heartbeat from core client for 30 sec - exiting 11:52:15 (2304): No heartbeat from core client for 30 sec - exiting 11:52:26 (2304): No heartbeat from core client for 30 sec - exiting 11:52:35 (2304): No heartbeat from core client for 30 sec - exiting 11:52:44 (2304): No heartbeat from core client for 30 sec - exiting 11:52:56 (2304): No heartbeat from core client for 30 sec - exiting 11:53:05 (2304): No heartbeat from core client for 30 sec - exiting 11:53:14 (2304): No heartbeat from core client for 30 sec - exiting 11:53:25 (2304): No heartbeat from core client for 30 sec - exiting 11:53:34 (2304): No heartbeat from core client for 30 sec - exiting 11:53:43 (2304): No heartbeat from core client for 30 sec - exiting 11:53:55 (2304): No heartbeat from core client for 30 sec - exiting 11:54:04 (2304): No heartbeat from core client for 30 sec - exiting 11:54:13 (2304): No heartbeat from core client for 30 sec - exiting 11:54:24 (2304): No heartbeat from core client for 30 sec - exiting 11:54:33 (2304): No heartbeat from core client for 30 sec - exiting 11:54:42 (2304): No heartbeat from core client for 30 sec - exiting 11:54:54 (2304): No heartbeat from core client for 30 sec - exiting 11:55:03 (2304): No heartbeat from core client for 30 sec - exiting 11:55:12 (2304): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Breakpoint Encountered (0x80000003) at address 0x75C71F66 Engaging BOINC Windows Runtime Debugger... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2840, selfPID=2840, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2840, selfPID=1684, iMonCtr=1 12:35:29 (3244):12:35:29 (4060): Can't acquire lockfile (32) - waiting 35s No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:30 (3244): No heartbeat from core client for 30 sec - exiting 12:35:31 (3244): No heartbeat from core client for 30 sec - exiting 12:35:32 (3244): No heartbeat from core client for 30 sec - exiting 12:35:33 (3244): No heartbeat from core client for 30 sec - exiting 12:35:34 (3244): No heartbeat from core client for 30 sec - exiting 12:35:35 (3244): No heartbeat from core client for 30 sec - exiting 12:35:36 (3244): No heartbeat from core client for 30 sec - exiting 12:35:38 (3244): No heartbeat from core client for 30 sec - exiting 12:35:39 (3244): No heartbeat from core client for 30 sec - exiting 12:35:40 (3244): No heartbeat from core client for 30 sec - exiting 12:35:41 (3244): No heartbeat from core client for 30 sec - exiting 12:35:42 (3244): No heartbeat from core client for 30 sec - exiting 12:35:43 (3244): No heartbeat from core client for 30 sec - exiting 12:35:44 (3244): No heartbeat from core client for 30 sec - exiting 12:35:45 (3244): No heartbeat from core client for 30 sec - exiting 12:35:46 (3244): No heartbeat from core client for 30 sec - exiting 12:35:47 (3244): No heartbeat from core client for 30 sec - exiting 12:35:48 (3244): No heartbeat from core client for 30 sec - exiting 12:35:50 (3244): No heartbeat from core client for 30 sec - exiting 12:35:51 (3244): No heartbeat from core client for 30 sec - exiting 12:35:52 (3244): No heartbeat from core client for 30 sec - exiting 12:35:53 (3244): No heartbeat from core client for 30 sec - exiting 12:35:54 (3244): No heartbeat from core client for 30 sec - exiting 12:35:55 (3244): No heartbeat from core client for 30 sec - exiting 12:35:56 (3244): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish 12:35:57 (3244): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Breakpoint Encountered (0x80000003) at address 0x757D1F66 Engaging BOINC Windows Runtime Debugger... Regional Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2732, iMonCtr=2 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Breakpoint Encountered (0x80000003) at address 0x75961F66 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Sep 2014 02:07:52	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	138,336	291,925	2.1103
08 Sep 2014 02:18:37	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	126,816	266,708	2.1031
08 Sep 2014 02:18:37	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	115,296	242,681	2.1049
04 Sep 2014 03:27:07	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	103,776	217,523	2.0961
03 Sep 2014 07:43:17	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	92,256	193,631	2.0988
01 Sep 2014 03:26:18	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	80,736	169,299	2.0969
29 Aug 2014 09:25:06	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	69,216	145,350	2.0999
25 Aug 2014 23:09:50	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	57,696	121,728	2.1098
22 Aug 2014 06:25:26	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	46,176	97,877	2.1197
19 Aug 2014 06:54:07	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	34,656	72,609	2.0951
19 Aug 2014 06:54:07	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	23,136	24,263	1.0487
04 Aug 2014 05:22:43	1234533	16740136	hadam3p_eu_l7x4_2013_1_008821489_0	11,616	24,564	2.1147