Task 15870418

Name	hadcm3n_u3cm_2020_40_008339894_2
Workunit	8490755
Created	28 Jun 2013, 4:31:07 UTC
Sent	28 Jun 2013, 5:08:34 UTC
Report deadline	27 Sep 2013, 12:35:45 UTC
Received	20 Aug 2013, 17:39:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1231443
Run time	9 days 19 hours 58 min 9 sec
CPU time	7 days 23 hours 11 min 9 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	0.93 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:55:50 (6460): No heartbeat from core client for 30 sec - exiting 21:56:09 (6460): No heartbeat from core client for 30 sec - exiting 21:56:10 (6460): No heartbeat from core client for 30 sec - exiting 21:56:11 (6460): No heartbeat from core client for 30 sec - exiting 21:56:12 (6460): No heartbeat from core client for 30 sec - exiting 21:56:13 (6460): No heartbeat from core client for 30 sec - exiting 21:56:14 (6460): No heartbeat from core client for 30 sec - exiting 21:56:15 (6460): No heartbeat from core client for 30 sec - exiting 21:56:16 (6460): No heartbeat from core client for 30 sec - exiting 21:56:17 (6460): No heartbeat from core client for 30 sec - exiting 21:56:18 (6460): No heartbeat from core client for 30 sec - exiting 21:56:19 (6460): No heartbeat from core client for 30 sec - exiting 21:56:20 (6460): No heartbeat from core client for 30 sec - exiting 21:56:21 (6460): No heartbeat from core client for 30 sec - exiting 21:56:22 (6460): No heartbeat from core client for 30 sec - exiting 21:56:23 (6460): No heartbeat from core client for 30 sec - exiting 21:56:24 (6460): No heartbeat from core client for 30 sec - exiting 21:56:25 (6460): No heartbeat from core client for 30 sec - exiting 21:56:26 (6460): No heartbeat from core client for 30 sec - exiting 21:56:27 (6460): No heartbeat from core client for 30 sec - exiting 21:56:28 (6460): No heartbeat from core client for 30 sec - exiting 21:56:29 (6460): No heartbeat from core client for 30 sec - exiting 21:56:30 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:31 (6460): No heartbeat from core client for 30 sec - exiting 21:56:32 (6460): No heartbeat from core client for 30 sec - exiting 21:56:33 (6460): No heartbeat from core client for 30 sec - exiting 21:56:34 (6460): No heartbeat from core client for 30 sec - exiting 21:56:35 (6460): No heartbeat from core client for 30 sec - exiting 21:56:36 (6460): No heartbeat from core client for 30 sec - exiting 21:56:37 (6460): No heartbeat from core client for 30 sec - exiting 21:56:38 (6460): No heartbeat from core client for 30 sec - exiting 21:56:39 (6460): No heartbeat from core client for 30 sec - exiting 21:56:40 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3972, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7128, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:04:26 (2804): No heartbeat from core client for 30 sec - exiting 18:04:28 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:32:41 (5508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:33:33 (5508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:15:49 (3764): No heartbeat from core client for 30 sec - exiting 15:15:56 (3764): No heartbeat from core client for 30 sec - exiting 15:15:57 (3764): No heartbeat from core client for 30 sec - exiting 15:15:58 (3764): No heartbeat from core client for 30 sec - exiting 15:15:59 (3764): No heartbeat from core client for 30 sec - exiting 15:16:00 (3764): No heartbeat from core client for 30 sec - exiting 15:16:01 (3764): No heartbeat from core client for 30 sec - exiting 15:16:02 (3764): No heartbeat from core client for 30 sec - exiting 15:16:03 (3764): No heartbeat from core client for 30 sec - exiting 15:16:04 (3764): No heartbeat from core client for 30 sec - exiting 15:16:05 (3764): No heartbeat from core client for 30 sec - exiting 15:16:06 (3764): No heartbeat from core client for 30 sec - exiting 15:16:07 (3764): No heartbeat from core client for 30 sec - exiting 15:16:08 (3764): No heartbeat from core client for 30 sec - exiting 15:16:09 (3764): No heartbeat from core client for 30 sec - exiting 15:16:10 (3764): No heartbeat from core client for 30 sec - exiting 15:16:11 (3764): No heartbeat from core client for 30 sec - exiting 15:16:12 (3764): No heartbeat from core client for 30 sec - exiting 15:16:13 (3764): No heartbeat from core client for 30 sec - exiting 15:16:14 (3764): No heartbeat from core client for 30 sec - exiting 15:16:15 (3764): No heartbeat from core client for 30 sec - exiting 15:16:16 (3764): No heartbeat from core client for 30 sec - exiting 15:16:17 (3764): No heartbeat from core client for 30 sec - exiting 15:16:18 (3764): No heartbeat from core client for 30 sec - exiting 15:16:19 (3764): No heartbeat from core client for 30 sec - exiting 15:16:20 (3764): No heartbeat from core client for 30 sec - exiting 15:16:21 (3764): No heartbeat from core client for 30 sec - exiting 15:16:22 (3764): No heartbeat from core client for 30 sec - exiting 15:16:23 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:19:07 (6580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:25:49 (788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:56 (788): No heartbeat from core client for 30 sec - exiting 14:25:57 (788): No heartbeat from core client for 30 sec - exiting 14:25:58 (788): No heartbeat from core client for 30 sec - exiting 14:25:59 (788): No heartbeat from core client for 30 sec - exiting 14:26:00 (788): No heartbeat from core client for 30 sec - exiting 14:26:01 (788): No heartbeat from core client for 30 sec - exiting 14:26:02 (788): No heartbeat from core client for 30 sec - exiting 14:26:03 (788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:05:56 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:15 (5108): No heartbeat from core client for 30 sec - exiting 10:06:28 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76FB3AB3 read attempt to address 0x40AC24E8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76FB3AB3 read attempt to address 0x40AC24E8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_u3cm_2020_40_008339894/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Aug 2013 18:51:46	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	259,200	682,908	2.6347
15 Aug 2013 16:23:29	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	233,280	620,151	2.6584
14 Aug 2013 16:20:30	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	207,360	559,953	2.7004
14 Aug 2013 16:20:30	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	181,440	489,631	2.6986
14 Aug 2013 16:20:30	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	155,520	418,630	2.6918
29 Jul 2013 14:31:53	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	129,600	345,491	2.6658
26 Jul 2013 08:22:27	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	103,680	279,237	2.6933
23 Jul 2013 21:41:58	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	77,760	211,085	2.7146
23 Jul 2013 21:41:57	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	51,840	143,916	2.7762
06 Jul 2013 05:42:04	1231443	15870418	hadcm3n_u3cm_2020_40_008339894_2	25,920	71,896	2.7738