Task 15995258

Name	hadcm3n_82ky_1980_40_008461285_0
Workunit	8612141
Created	30 Aug 2013, 22:01:50 UTC
Sent	2 Sep 2013, 9:16:19 UTC
Report deadline	2 Dec 2013, 16:43:30 UTC
Received	16 Sep 2013, 2:51:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1209561
Run time	12 days 7 hours 24 min 27 sec
CPU time	5 days 13 hours 17 min 7 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.94 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> 10:16:46 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:23 (2300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:30 (2300): No heartbeat from core client for 30 sec - exiting 13:53:31 (2300): No heartbeat from core client for 30 sec - exiting 13:53:32 (2300): No heartbeat from core client for 30 sec - exiting 13:53:33 (2300): No heartbeat from core client for 30 sec - exiting 20:41:35 (8580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:01:29 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:32 (4688): No heartbeat from core client for 30 sec - exiting 20:04:19 (4688): No heartbeat from core client for 30 sec - exiting 20:04:22 (4688): No heartbeat from core client for 30 sec - exiting 20:04:23 (4688): No heartbeat from core client for 30 sec - exiting 20:04:26 (4688): No heartbeat from core client for 30 sec - exiting 20:04:27 (4688): No heartbeat from core client for 30 sec - exiting 20:04:28 (4688): No heartbeat from core client for 30 sec - exiting 20:04:30 (4688): No heartbeat from core client for 30 sec - exiting 03:23:40 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:43 (5424): No heartbeat from core client for 30 sec - exiting 03:23:44 (5424): No heartbeat from core client for 30 sec - exiting 03:23:47 (5424): No heartbeat from core client for 30 sec - exiting 03:23:48 (5424): No heartbeat from core client for 30 sec - exiting 03:23:49 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 03:53:09 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:55:07 (2464): No heartbeat from core client for 30 sec - exiting 11:59:49 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:00 (8028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:39:05 (768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:55 (9488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:29:13 (9488): No heartbeat from core client for 30 sec - exiting 04:29:16 (9488): No heartbeat from core client for 30 sec - exiting 04:29:17 (9488): No heartbeat from core client for 30 sec - exiting 04:29:18 (9488): No heartbeat from core client for 30 sec - exiting 04:29:19 (9488): No heartbeat from core client for 30 sec - exiting 04:29:20 (9488): No heartbeat from core client for 30 sec - exiting 04:29:21 (9488): No heartbeat from core client for 30 sec - exiting 09:13:24 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:46 (3348): No heartbeat from core client for 30 sec - exiting 09:14:48 (3348): No heartbeat from core client for 30 sec - exiting 09:14:49 (3348): No heartbeat from core client for 30 sec - exiting 13:42:42 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:42:43 (3176): No heartbeat from core client for 30 sec - exiting 13:42:44 (3176): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:09:23 (9608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:56 (14436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:57 (14436): No heartbeat from core client for 30 sec - exiting 05:58:13 (16200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:19:16 (3708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:49 (3708): No heartbeat from core client for 30 sec - exiting 12:21:07 (3708): No heartbeat from core client for 30 sec - exiting 12:21:10 (3708): No heartbeat from core client for 30 sec - exiting 12:21:13 (3708): No heartbeat from core client for 30 sec - exiting 12:21:15 (3708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 22:58:36 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:59:53 (4004): No heartbeat from core client for 30 sec - exiting 22:59:54 (4004): No heartbeat from core client for 30 sec - exiting 22:59:55 (4004): No heartbeat from core client for 30 sec - exiting 22:59:57 (4004): No heartbeat from core client for 30 sec - exiting 22:59:58 (4004): No heartbeat from core client for 30 sec - exiting 23:00:00 (4004): No heartbeat from core client for 30 sec - exiting 23:00:01 (4004): No heartbeat from core client for 30 sec - exiting 23:00:02 (4004): No heartbeat from core client for 30 sec - exiting 23:00:03 (4004): No heartbeat from core client for 30 sec - exiting 23:00:05 (4004): No heartbeat from core client for 30 sec - exiting 23:00:06 (4004): No heartbeat from core client for 30 sec - exiting 23:00:07 (4004): No heartbeat from core client for 30 sec - exiting 23:00:09 (4004): No heartbeat from core client for 30 sec - exiting 23:00:10 (4004): No heartbeat from core client for 30 sec - exiting 23:00:11 (4004): No heartbeat from core client for 30 sec - exiting 13:10:09 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:13 (6564): No heartbeat from core client for 30 sec - exiting 13:10:15 (6564): No heartbeat from core client for 30 sec - exiting 13:10:16 (6564): No heartbeat from core client for 30 sec - exiting 13:10:17 (6564): No heartbeat from core client for 30 sec - exiting 13:10:18 (6564): No heartbeat from core client for 30 sec - exiting 13:10:19 (6564): No heartbeat from core client for 30 sec - exiting 13:10:21 (6564): No heartbeat from core client for 30 sec - exiting 13:10:22 (6564): No heartbeat from core client for 30 sec - exiting 13:10:23 (6564): No heartbeat from core client for 30 sec - exiting 13:10:25 (6564): No heartbeat from core client for 30 sec - exiting 13:10:26 (6564): No heartbeat from core client for 30 sec - exiting 13:10:27 (6564): No heartbeat from core client for 30 sec - exiting 13:10:29 (6564): No heartbeat from core client for 30 sec - exiting 19:35:13 (11124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:31 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:42 (2908): No heartbeat from core client for 30 sec - exiting 17:46:30 (10460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:46:45 (10460): No heartbeat from core client for 30 sec - exiting 17:46:46 (10460): No heartbeat from core client for 30 sec - exiting 17:46:48 (10460): No heartbeat from core client for 30 sec - exiting 17:46:49 (10460): No heartbeat from core client for 30 sec - exiting 22:00:14 (24304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:56 (28716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:00:01 (28716): No heartbeat from core client for 30 sec - exiting 02:00:02 (28716): No heartbeat from core client for 30 sec - exiting 02:00:03 (28716): No heartbeat from core client for 30 sec - exiting 02:00:05 (28716): No heartbeat from core client for 30 sec - exiting 02:00:06 (28716): No heartbeat from core client for 30 sec - exiting 02:00:07 (28716): No heartbeat from core client for 30 sec - exiting 02:00:08 (28716): No heartbeat from core client for 30 sec - exiting 02:00:09 (28716): No heartbeat from core client for 30 sec - exiting 05:59:56 (29332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:00:00 (29332): No heartbeat from core client for 30 sec - exiting 06:00:01 (29332): No heartbeat from core client for 30 sec - exiting 06:00:03 (29332): No heartbeat from core client for 30 sec - exiting 06:00:04 (29332): No heartbeat from core client for 30 sec - exiting 06:00:05 (29332): No heartbeat from core client for 30 sec - exiting 06:00:06 (29332): No heartbeat from core client for 30 sec - exiting 06:00:07 (29332): No heartbeat from core client for 30 sec - exiting 06:00:08 (29332): No heartbeat from core client for 30 sec - exiting 03:32:14 (28472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 07:03:13 (23648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:03:22 (23648): No heartbeat from core client for 30 sec - exiting 07:03:23 (23648): No heartbeat from core client for 30 sec - exiting 07:03:25 (23648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:41:58 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:38 (5796): No heartbeat from core client for 30 sec - exiting 15:43:40 (5796): No heartbeat from core client for 30 sec - exiting 15:43:42 (5796): No heartbeat from core client for 30 sec - exiting 15:43:45 (5796): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:51:46 (2280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:02:10 (6824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:02:16 (6824): No heartbeat from core client for 30 sec - exiting 04:02:18 (6824): No heartbeat from core client for 30 sec - exiting 04:03:00 (6824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:04:26 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:28 (2908): No heartbeat from core client for 30 sec - exiting 11:05:29 (2908): No heartbeat from core client for 30 sec - exiting 11:05:30 (2908): No heartbeat from core client for 30 sec - exiting 11:05:32 (2908): No heartbeat from core client for 30 sec - exiting 11:05:33 (2908): No heartbeat from core client for 30 sec - exiting 11:05:36 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 16:38:34 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:15 (4232): No heartbeat from core client for 30 sec - exiting 16:39:16 (4232): No heartbeat from core client for 30 sec - exiting 16:39:18 (4232): No heartbeat from core client for 30 sec - exiting 16:39:19 (4232): No heartbeat from core client for 30 sec - exiting 16:39:20 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:49 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:14 (3952): No heartbeat from core client for 30 sec - exiting 18:58:15 (3952): No heartbeat from core client for 30 sec - exiting 18:58:16 (3952): No heartbeat from core client for 30 sec - exiting 18:58:17 (3952): No heartbeat from core client for 30 sec - exiting 18:58:18 (3952): No heartbeat from core client for 30 sec - exiting 18:58:19 (3952): No heartbeat from core client for 30 sec - exiting 18:58:20 (3952): No heartbeat from core client for 30 sec - exiting 18:58:21 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:22:48 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:50 (3856): No heartbeat from core client for 30 sec - exiting 19:24:46 (3856): No heartbeat from core client for 30 sec - exiting 19:24:48 (3856): No heartbeat from core client for 30 sec - exiting 19:24:51 (3856): No heartbeat from core client for 30 sec - exiting 23:35:34 (18852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:29 (4800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:44 (4800): No heartbeat from core client for 30 sec - exiting 04:01:46 (4800): No heartbeat from core client for 30 sec - exiting 04:01:47 (4800): No heartbeat from core client for 30 sec - exiting 19:12:44 (13456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:46 (13456): No heartbeat from core client for 30 sec - exiting 19:12:47 (13456): No heartbeat from core client for 30 sec - exiting 19:12:48 (13456): No heartbeat from core client for 30 sec - exiting 19:12:49 (13456): No heartbeat from core client for 30 sec - exiting 19:12:50 (13456): No heartbeat from core client for 30 sec - exiting 19:12:51 (13456): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D93AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_82ky_1980_40_008461285/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Sep 2013 02:47:24	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	259,200	479,739	1.8508
13 Sep 2013 13:47:12	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	233,280	430,207	1.8442
12 Sep 2013 18:17:33	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	207,360	381,387	1.8393
11 Sep 2013 09:41:23	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	181,440	331,410	1.8266
09 Sep 2013 20:14:09	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	155,520	284,701	1.8306
08 Sep 2013 05:25:57	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	129,600	234,597	1.8102
06 Sep 2013 21:01:05	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	103,680	185,581	1.7899
05 Sep 2013 08:17:58	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	77,760	139,384	1.7925
03 Sep 2013 23:12:26	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	51,840	91,726	1.7694
03 Sep 2013 07:24:56	1209561	15995258	hadcm3n_82ky_1980_40_008461285_0	25,920	47,088	1.8167