Task 16071366

Name	hadcm3n_o5m1_1940_40_008381164_2
Workunit	8532023
Created	21 Oct 2013, 12:49:29 UTC
Sent	21 Oct 2013, 12:49:54 UTC
Report deadline	20 Jan 2014, 20:17:05 UTC
Received	3 Dec 2013, 14:07:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1244008
Run time	7 days 3 hours 29 min 34 sec
CPU time	6 days 9 hours 49 min 26 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=1 Model crash detected, will try to restart... 07:45:51 (4644): No heartbeat from core client for 30 sec - exiting 07:45:52 (4644): No heartbeat from core client for 30 sec - exiting 07:45:53 (4644): No heartbeat from core client for 30 sec - exiting 07:45:55 (4644): No heartbeat from core client for 30 sec - exiting 07:45:56 (4644): No heartbeat from core client for 30 sec - exiting 07:45:57 (4644): No heartbeat from core client for 30 sec - exiting 07:45:58 (4644): No heartbeat from core client for 30 sec - exiting 07:45:59 (4644): No heartbeat from core client for 30 sec - exiting 07:46:00 (4644): No heartbeat from core client for 30 sec - exiting 07:46:01 (4644): No heartbeat from core client for 30 sec - exiting 07:46:02 (4644): No heartbeat from core client for 30 sec - exiting 07:46:03 (4644): No heartbeat from core client for 30 sec - exiting 07:46:04 (4644): No heartbeat from core client for 30 sec - exiting 07:46:05 (4644): No heartbeat from core client for 30 sec - exiting 07:46:07 (4644): No heartbeat from core client for 30 sec - exiting 07:46:08 (4644): No heartbeat from core client for 30 sec - exiting 07:46:09 (4644): No heartbeat from core client for 30 sec - exiting 07:46:10 (4644): No heartbeat from core client for 30 sec - exiting 07:46:11 (4644): No heartbeat from core client for 30 sec - exiting 07:46:12 (4644): No heartbeat from core client for 30 sec - exiting 07:46:13 (4644): No heartbeat from core client for 30 sec - exiting 07:46:14 (4644): No heartbeat from core client for 30 sec - exiting 07:46:15 (4644): No heartbeat from core client for 30 sec - exiting 07:46:16 (4644): No heartbeat from core client for 30 sec - exiting 07:46:17 (4644): No heartbeat from core client for 30 sec - exiting 07:46:19 (4644): No heartbeat from core client for 30 sec - exiting 07:46:20 (4644): No heartbeat from core client for 30 sec - exiting 07:46:21 (4644): No heartbeat from core client for 30 sec - exiting 07:46:22 (4644): No heartbeat from core client for 30 sec - exiting 07:46:23 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:24 (4644): No heartbeat from core client for 30 sec - exiting 07:40:24 (1752): No heartbeat from core client for 30 sec - exiting 07:40:25 (1752): No heartbeat from core client for 30 sec - exiting 07:40:26 (1752): No heartbeat from core client for 30 sec - exiting 07:40:28 (1752): No heartbeat from core client for 30 sec - exiting 07:40:29 (1752): No heartbeat from core client for 30 sec - exiting 07:40:30 (1752): No heartbeat from core client for 30 sec - exiting 07:40:31 (1752): No heartbeat from core client for 30 sec - exiting 07:40:32 (1752): No heartbeat from core client for 30 sec - exiting 07:40:33 (1752): No heartbeat from core client for 30 sec - exiting 07:40:34 (1752): No heartbeat from core client for 30 sec - exiting 07:40:35 (1752): No heartbeat from core client for 30 sec - exiting 07:40:36 (1752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:46:06 (2944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:43:19 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:51 (5432): No heartbeat from core client for 30 sec - exiting 07:46:52 (5432): No heartbeat from core client for 30 sec - exiting 07:46:53 (5432): No heartbeat from core client for 30 sec - exiting 07:46:54 (5432): No heartbeat from core client for 30 sec - exiting 07:46:55 (5432): No heartbeat from core client for 30 sec - exiting 07:46:57 (5432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:58 (5432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:58:01 (5416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:58:10 (6500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BF59C7 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... 14:01:27 (448): No heartbeat from core client for 30 sec - exiting 14:01:29 (448): No heartbeat from core client for 30 sec - exiting 14:01:30 (448): No heartbeat from core client for 30 sec - exiting 14:01:31 (448): No heartbeat from core client for 30 sec - exiting 14:01:32 (448): No heartbeat from core client for 30 sec - exiting 14:01:33 (448): No heartbeat from core client for 30 sec - exiting 14:01:34 (448): No heartbeat from core client for 30 sec - exiting 14:01:35 (448): No heartbeat from core client for 30 sec - exiting 14:01:36 (448): No heartbeat from core client for 30 sec - exiting 14:01:37 (448): No heartbeat from core client for 30 sec - exiting 14:01:38 (448): No heartbeat from core client for 30 sec - exiting 14:01:39 (448): No heartbeat from core client for 30 sec - exiting 14:01:41 (448): No heartbeat from core client for 30 sec - exiting 14:01:42 (448): No heartbeat from core client for 30 sec - exiting 14:01:43 (448): No heartbeat from core client for 30 sec - exiting 14:01:44 (448): No heartbeat from core client for 30 sec - exiting 14:01:45 (448): No heartbeat from core client for 30 sec - exiting 14:01:46 (448): No heartbeat from core client for 30 sec - exiting 14:01:47 (448): No heartbeat from core client for 30 sec - exiting 14:01:48 (448): No heartbeat from core client for 30 sec - exiting 14:01:49 (448): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77A95EAB read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Dec 2013 10:38:44	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	259,200	547,992	2.1142
19 Nov 2013 14:14:53	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	233,280	493,124	2.1139
15 Nov 2013 11:56:31	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	207,360	440,062	2.1222
12 Nov 2013 10:22:15	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	181,440	385,530	2.1248
07 Nov 2013 12:26:21	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	155,520	331,292	2.1302
05 Nov 2013 09:33:17	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	129,600	275,678	2.1271
01 Nov 2013 07:11:58	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	103,680	218,148	2.1041
31 Oct 2013 11:14:41	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	77,760	163,067	2.0971
29 Oct 2013 11:19:22	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	51,840	110,876	2.1388
23 Oct 2013 13:29:25	1244008	16071366	hadcm3n_o5m1_1940_40_008381164_2	25,920	55,011	2.1223