Task 15286759

Name	hadcm3n_o7h3_2020_40_008000652_2
Workunit	8155766
Created	15 Sep 2012, 4:39:33 UTC
Sent	15 Sep 2012, 5:01:49 UTC
Report deadline	15 Dec 2012, 12:29:00 UTC
Received	1 Oct 2012, 22:32:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1197288
Run time	5 days 9 hours 9 min 23 sec
CPU time	5 days 4 hours 44 min 7 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:04:03 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:04:04 (6908): No heartbeat from core client for 30 sec - exiting 11:04:06 (6908): No heartbeat from core client for 30 sec - exiting 11:04:07 (6908): No heartbeat from core client for 30 sec - exiting 11:05:14 (3656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:55 (2700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:36:12 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:56 (6172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:40:56 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:40:58 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 05:28:47 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:55 (4560): No heartbeat from core client for 30 sec - exiting 05:28:56 (4560): No heartbeat from core client for 30 sec - exiting 05:28:57 (4560): No heartbeat from core client for 30 sec - exiting 05:28:58 (4560): No heartbeat from core client for 30 sec - exiting 05:28:59 (4560): No heartbeat from core client for 30 sec - exiting 05:29:00 (4560): No heartbeat from core client for 30 sec - exiting 05:29:02 (4560): No heartbeat from core client for 30 sec - exiting 05:29:03 (4560): No heartbeat from core client for 30 sec - exiting 05:29:04 (4560): No heartbeat from core client for 30 sec - exiting 05:29:05 (4560): No heartbeat from core client for 30 sec - exiting 05:30:49 (6472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:15:22 (6532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:31 (6532): No heartbeat from core client for 30 sec - exiting 09:15:32 (6532): No heartbeat from core client for 30 sec - exiting 09:15:33 (6532): No heartbeat from core client for 30 sec - exiting 09:15:34 (6532): No heartbeat from core client for 30 sec - exiting 09:15:35 (6532): No heartbeat from core client for 30 sec - exiting 09:15:36 (6532): No heartbeat from core client for 30 sec - exiting 09:15:37 (6532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:20:59 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:01 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:11:49 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:50 (3888): No heartbeat from core client for 30 sec - exiting 17:28:31 (6152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:35 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:38 (3880): No heartbeat from core client for 30 sec - exiting 17:53:39 (3880): No heartbeat from core client for 30 sec - exiting 17:53:40 (3880): No heartbeat from core client for 30 sec - exiting 17:53:41 (3880): No heartbeat from core client for 30 sec - exiting 17:55:08 (6844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:58 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:59 (6192): No heartbeat from core client for 30 sec - exiting 18:22:53 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:22:55 (7032): No heartbeat from core client for 30 sec - exiting 18:22:56 (7032): No heartbeat from core client for 30 sec - exiting 18:43:55 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:43:59 (3500): No heartbeat from core client for 30 sec - exiting 18:44:00 (3500): No heartbeat from core client for 30 sec - exiting 18:44:02 (3500): No heartbeat from core client for 30 sec - exiting 18:45:29 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:30 (5836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:32 (5836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 03:26:52 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:53 (5064): No heartbeat from core client for 30 sec - exiting 03:28:07 (6888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:48:27 (6684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:48:28 (6684): No heartbeat from core client for 30 sec - exiting 03:52:17 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:19 (4144): No heartbeat from core client for 30 sec - exiting 03:52:20 (4144): No heartbeat from core client for 30 sec - exiting 03:52:21 (4144): No heartbeat from core client for 30 sec - exiting 03:52:22 (4144): No heartbeat from core client for 30 sec - exiting 03:52:23 (4144): No heartbeat from core client for 30 sec - exiting 03:52:24 (4144): No heartbeat from core client for 30 sec - exiting 03:52:25 (4144): No heartbeat from core client for 30 sec - exiting 03:52:26 (4144): No heartbeat from core client for 30 sec - exiting 03:52:28 (4144): No heartbeat from core client for 30 sec - exiting 03:52:29 (4144): No heartbeat from core client for 30 sec - exiting 03:52:30 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 07:25:45 (6740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:25:47 (6740): No heartbeat from core client for 30 sec - exiting 07:25:48 (6740): No heartbeat from core client for 30 sec - exiting 07:40:46 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:47 (4804): No heartbeat from core client for 30 sec - exiting 08:04:54 (5868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:01 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:43 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:31 (6456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:33 (6456): No heartbeat from core client for 30 sec - exiting 09:27:14 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:15 (5992): No heartbeat from core client for 30 sec - exiting 09:35:52 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:36:10 (6064): No heartbeat from core client for 30 sec - exiting 09:36:12 (6064): No heartbeat from core client for 30 sec - exiting 09:36:13 (6064): No heartbeat from core client for 30 sec - exiting 09:36:14 (6064): No heartbeat from core client for 30 sec - exiting 09:36:15 (6064): No heartbeat from core client for 30 sec - exiting 09:36:16 (6064): No heartbeat from core client for 30 sec - exiting 09:36:17 (6064): No heartbeat from core client for 30 sec - exiting 09:36:18 (6064): No heartbeat from core client for 30 sec - exiting 09:36:19 (6064): No heartbeat from core client for 30 sec - exiting 09:36:20 (6064): No heartbeat from core client for 30 sec - exiting 09:36:21 (6064): No heartbeat from core client for 30 sec - exiting 09:36:22 (6064): No heartbeat from core client for 30 sec - exiting 09:36:24 (6064): No heartbeat from core client for 30 sec - exiting 09:36:25 (6064): No heartbeat from core client for 30 sec - exiting 09:36:26 (6064): No heartbeat from core client for 30 sec - exiting 09:36:27 (6064): No heartbeat from core client for 30 sec - exiting 09:36:28 (6064): No heartbeat from core client for 30 sec - exiting 09:36:29 (6064): No heartbeat from core client for 30 sec - exiting 09:36:30 (6064): No heartbeat from core client for 30 sec - exiting 09:36:31 (6064): No heartbeat from core client for 30 sec - exiting 09:38:05 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:26 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:09 (116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:11 (116): No heartbeat from core client for 30 sec - exiting 11:24:12 (116): No heartbeat from core client for 30 sec - exiting 12:12:37 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:39 (3300): No heartbeat from core client for 30 sec - exiting 12:18:43 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:53 (6460): No heartbeat from core client for 30 sec - exiting 12:18:54 (6460): No heartbeat from core client for 30 sec - exiting 12:18:55 (6460): No heartbeat from core client for 30 sec - exiting 12:18:57 (6460): No heartbeat from core client for 30 sec - exiting 12:18:58 (6460): No heartbeat from core client for 30 sec - exiting 12:18:59 (6460): No heartbeat from core client for 30 sec - exiting 12:19:00 (6460): No heartbeat from core client for 30 sec - exiting 12:19:01 (6460): No heartbeat from core client for 30 sec - exiting 12:19:02 (6460): No heartbeat from core client for 30 sec - exiting 12:19:03 (6460): No heartbeat from core client for 30 sec - exiting 12:21:00 (6708): No heartbeat from core client for 30 sec - exiting 12:21:02 (6708): No heartbeat from core client for 30 sec - exiting 12:21:03 (6708): No heartbeat from core client for 30 sec - exiting 12:21:04 (6708): No heartbeat from core client for 30 sec - exiting 12:21:05 (6708): No heartbeat from core client for 30 sec - exiting 12:21:06 (6708): No heartbeat from core client for 30 sec - exiting 12:21:07 (6708): No heartbeat from core client for 30 sec - exiting 12:21:08 (6708): No heartbeat from core client for 30 sec - exiting 12:21:09 (6708): No heartbeat from core client for 30 sec - exiting 12:21:10 (6708): No heartbeat from core client for 30 sec - exiting 12:21:11 (6708): No heartbeat from core client for 30 sec - exiting 12:21:12 (6708): No heartbeat from core client for 30 sec - exiting 12:21:14 (6708): No heartbeat from core client for 30 sec - exiting 12:21:15 (6708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7710CD8B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3580, selfPID=3580, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x770E71E3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x770E71E3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o7h3_2020_40_008000652/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Sep 2012 04:33:14	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	259,200	446,660	1.7232
26 Sep 2012 05:16:54	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	233,280	403,727	1.7307
25 Sep 2012 03:11:47	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	207,360	357,355	1.7234
24 Sep 2012 00:53:08	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	181,440	312,782	1.7239
22 Sep 2012 21:38:15	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	155,520	266,838	1.7158
21 Sep 2012 21:20:06	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	129,600	220,845	1.7041
20 Sep 2012 21:19:12	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	103,680	173,619	1.6746
19 Sep 2012 09:08:13	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	77,760	130,924	1.6837
18 Sep 2012 01:58:58	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	51,840	86,597	1.6705
16 Sep 2012 17:36:11	1197288	15286759	hadcm3n_o7h3_2020_40_008000652_2	25,920	43,481	1.6775