Task 16011174

Name	hadcm3n_o02s_1940_40_008378762_2
Workunit	8529621
Created	10 Sep 2013, 22:02:34 UTC
Sent	10 Sep 2013, 22:09:36 UTC
Report deadline	11 Dec 2013, 5:36:47 UTC
Received	20 Sep 2013, 10:40:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1107112
Run time	6 days 0 hours 37 min 51 sec
CPU time	5 days 18 hours 33 min 6 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 23:39:37 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:39:38 (3576): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:38:27 (9780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:37:17 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:36:15 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:35:15 (11544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:58:09 (11000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:30:41 (6652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:10:48 (2768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:09:38 (1196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:08:24 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:09:40 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:07:12 (2112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:58:19 (2384): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:58:20 (2384): No heartbeat from core client for 30 sec - exiting 12:24:34 (696): No heartbeat from core client for 30 sec - exiting 12:24:35 (696): No heartbeat from core client for 30 sec - exiting 12:24:36 (696): No heartbeat from core client for 30 sec - exiting 12:24:37 (696): No heartbeat from core client for 30 sec - exiting 12:24:38 (696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:39 (696): No heartbeat from core client for 30 sec - exiting 12:32:15 (2340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:03 (1360): No heartbeat from core client for 30 sec - exiting 12:33:04 (1360): No heartbeat from core client for 30 sec - exiting 12:33:06 (1360): No heartbeat from core client for 30 sec - exiting 12:33:07 (1360): No heartbeat from core client for 30 sec - exiting 12:33:08 (1360): No heartbeat from core client for 30 sec - exiting 12:33:09 (1360): No heartbeat from core client for 30 sec - exiting 12:33:10 (1360): No heartbeat from core client for 30 sec - exiting 12:33:11 (1360): No heartbeat from core client for 30 sec - exiting 12:33:12 (1360): No heartbeat from core client for 30 sec - exiting 12:33:13 (1360): No heartbeat from core client for 30 sec - exiting 12:33:14 (1360): No heartbeat from core client for 30 sec - exiting 12:33:15 (1360): No heartbeat from core client for 30 sec - exiting 12:33:17 (1360): No heartbeat from core client for 30 sec - exiting 12:33:18 (1360): No heartbeat from core client for 30 sec - exiting 12:33:19 (1360): No heartbeat from core client for 30 sec - exiting 12:33:20 (1360): No heartbeat from core client for 30 sec - exiting 12:33:21 (1360): No heartbeat from core client for 30 sec - exiting 12:33:22 (1360): No heartbeat from core client for 30 sec - exiting 12:33:23 (1360): No heartbeat from core client for 30 sec - exiting 12:33:24 (1360): No heartbeat from core client for 30 sec - exiting 12:33:25 (1360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:46 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:41 (4580): No heartbeat from core client for 30 sec - exiting 18:09:42 (4580): No heartbeat from core client for 30 sec - exiting 18:09:43 (4580): No heartbeat from core client for 30 sec - exiting 18:09:44 (4580): No heartbeat from core client for 30 sec - exiting 18:09:45 (4580): No heartbeat from core client for 30 sec - exiting 18:09:46 (4580): No heartbeat from core client for 30 sec - exiting 18:09:47 (4580): No heartbeat from core client for 30 sec - exiting 18:09:48 (4580): No heartbeat from core client for 30 sec - exiting 18:09:49 (4580): No heartbeat from core client for 30 sec - exiting 18:09:50 (4580): No heartbeat from core client for 30 sec - exiting 18:09:51 (4580): No heartbeat from core client for 30 sec - exiting 18:09:52 (4580): No heartbeat from core client for 30 sec - exiting 18:09:53 (4580): No heartbeat from core client for 30 sec - exiting 18:09:54 (4580): No heartbeat from core client for 30 sec - exiting 18:09:55 (4580): No heartbeat from core client for 30 sec - exiting 18:09:56 (4580): No heartbeat from core client for 30 sec - exiting 18:09:57 (4580): No heartbeat from core client for 30 sec - exiting 18:09:58 (4580): No heartbeat from core client for 30 sec - exiting 18:09:59 (4580): No heartbeat from core client for 30 sec - exiting 18:10:00 (4580): No heartbeat from core client for 30 sec - exiting 18:10:01 (4580): No heartbeat from core client for 30 sec - exiting 18:10:02 (4580): No heartbeat from core client for 30 sec - exiting 18:10:03 (4580): No heartbeat from core client for 30 sec - exiting 18:10:04 (4580): No heartbeat from core client for 30 sec - exiting 18:10:05 (4580): No heartbeat from core client for 30 sec - exiting 18:10:06 (4580): No heartbeat from core client for 30 sec - exiting 18:10:07 (4580): No heartbeat from core client for 30 sec - exiting 18:10:08 (4580): No heartbeat from core client for 30 sec - exiting 18:10:09 (4580): No heartbeat from core client for 30 sec - exiting 18:10:10 (4580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:11 (4580): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:02:07 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:22 (5416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:02 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:59:59 (2352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:55:27 (1096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:33 (3008): No heartbeat from core client for 30 sec - exiting 13:00:34 (3008): No heartbeat from core client for 30 sec - exiting 13:00:35 (3008): No heartbeat from core client for 30 sec - exiting 13:00:36 (3008): No heartbeat from core client for 30 sec - exiting 13:00:37 (3008): No heartbeat from core client for 30 sec - exiting 13:00:38 (3008): No heartbeat from core client for 30 sec - exiting 13:00:39 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:57:48 (1264): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:56:37 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:51 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:55:32 (2176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:28 (8188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:16 (5636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:22 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:54:30 (8096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:52:14 (6732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:51:09 (1236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:50:07 (2400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:51:11 (7228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:49:01 (1112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:47:55 (444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:04 (6912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 13:54:00 (212): No heartbeat from core client for 30 sec - exiting 13:54:01 (212): No heartbeat from core client for 30 sec - exiting 13:54:02 (212): No heartbeat from core client for 30 sec - exiting 13:54:03 (212): No heartbeat from core client for 30 sec - exiting 13:54:05 (212): No heartbeat from core client for 30 sec - exiting 13:54:06 (212): No heartbeat from core client for 30 sec - exiting 13:54:07 (212): No heartbeat from core client for 30 sec - exiting 13:54:08 (212): No heartbeat from core client for 30 sec - exiting 13:54:09 (212): No heartbeat from core client for 30 sec - exiting 13:54:10 (212): No heartbeat from core client for 30 sec - exiting 13:54:11 (212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:12 (212): No heartbeat from core client for 30 sec - exiting 13:54:13 (212): No heartbeat from core client for 30 sec - exiting 13:54:14 (212): No heartbeat from core client for 30 sec - exiting 13:54:15 (212): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 15:57:07 (236): No heartbeat from core client for 30 sec - exiting 15:57:09 (236): No heartbeat from core client for 30 sec - exiting 15:57:10 (236): No heartbeat from core client for 30 sec - exiting 15:57:11 (236): No heartbeat from core client for 30 sec - exiting 15:57:12 (236): No heartbeat from core client for 30 sec - exiting 15:57:13 (236): No heartbeat from core client for 30 sec - exiting 15:57:14 (236): No heartbeat from core client for 30 sec - exiting 15:57:15 (236): No heartbeat from core client for 30 sec - exiting 15:57:16 (236): No heartbeat from core client for 30 sec - exiting 15:57:17 (236): No heartbeat from core client for 30 sec - exiting 15:57:18 (236): No heartbeat from core client for 30 sec - exiting 15:57:20 (236): No heartbeat from core client for 30 sec - exiting 15:57:21 (236): No heartbeat from core client for 30 sec - exiting 15:57:22 (236):CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:51:57 (800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:50:52 (772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:49:44 (3104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:35 (3924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:47:29 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:48:38 (1864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 18:49:41 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:37:14 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:38:21 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C911780 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=576, selfPID=576, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Sep 2013 09:29:28	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	259,200	498,759	1.9242
19 Sep 2013 17:02:16	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	233,280	449,649	1.9275
19 Sep 2013 01:40:35	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	207,360	401,124	1.9344
18 Sep 2013 07:47:43	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	181,440	353,254	1.9469
18 Sep 2013 07:47:43	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	181,440	353,254	1.9469
17 Sep 2013 14:17:19	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	155,520	300,130	1.9298
16 Sep 2013 23:15:35	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	129,600	248,922	1.9207
15 Sep 2013 23:28:10	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	103,680	196,954	1.8996
14 Sep 2013 05:36:46	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	77,760	148,673	1.9119
12 Sep 2013 18:52:48	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	51,840	100,229	1.9334
11 Sep 2013 13:32:17	1107112	16011174	hadcm3n_o02s_1940_40_008378762_2	25,920	50,333	1.9419