Task 15636545

Name	hadcm3n_n4v2_1920_40_008321368_0
Workunit	8472503
Created	24 Feb 2013, 19:09:19 UTC
Sent	24 Feb 2013, 19:11:44 UTC
Report deadline	27 May 2013, 2:38:55 UTC
Received	21 Apr 2013, 20:57:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1021648
Run time	9 days 11 hours 58 min 3 sec
CPU time	7 days 7 hours 30 min 30 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.73 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 08:20:51 (1156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:32:01 (1060): No heartbeat from core client for 30 sec - exiting 07:32:02 (1060): No heartbeat from core client for 30 sec - exiting 07:32:03 (1060): No heartbeat from core client for 30 sec - exiting 07:32:04 (1060): No heartbeat from core client for 30 sec - exiting 07:32:05 (1060): No heartbeat from core client for 30 sec - exiting 07:32:06 (1060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3364, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 07:54:00 (5340): No heartbeat from core client for 30 sec - exiting 07:54:01 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:35:01 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:35:02 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:30:36 (3204): No heartbeat from core client for 30 sec - exiting 20:30:37 (3204): No heartbeat from core client for 30 sec - exiting 20:30:38 (3204): No heartbeat from core client for 30 sec - exiting 20:30:39 (3204): No heartbeat from core client for 30 sec - exiting 20:30:40 (3204): No heartbeat from core client for 30 sec - exiting 20:30:41 (3204): No heartbeat from core client for 30 sec - exiting 20:30:42 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:52:33 (5776): No heartbeat from core client for 30 sec - exiting 14:52:34 (5776): No heartbeat from core client for 30 sec - exiting 14:52:35 (5776): No heartbeat from core client for 30 sec - exiting 14:52:36 (5776): No heartbeat from core client for 30 sec - exiting 14:52:37 (5776): No heartbeat from core client for 30 sec - exiting 14:52:38 (5776): No heartbeat from core client for 30 sec - exiting 14:52:39 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:52:40 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:12:24 (7340): No heartbeat from core client for 30 sec - exiting 07:12:25 (7340): No heartbeat from core client for 30 sec - exiting 07:12:26 (7340): No heartbeat from core client for 30 sec - exiting 07:12:27 (7340): No heartbeat from core client for 30 sec - exiting 07:12:28 (7340): No heartbeat from core client for 30 sec - exiting 07:12:29 (7340): No heartbeat from core client for 30 sec - exiting 07:12:30 (7340): No heartbeat from core client for 30 sec - exiting 07:12:31 (7340): No heartbeat from core client for 30 sec - exiting 07:12:32 (7340): No heartbeat from core client for 30 sec - exiting 07:12:34 (7340): No heartbeat from core client for 30 sec - exiting 07:12:35 (7340): No heartbeat from core client for 30 sec - exiting 07:12:36 (7340): No heartbeat from core client for 30 sec - exiting 07:12:37 (7340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:39 (7340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:57:05 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:57:06 (3196): No heartbeat from core client for 30 sec - exiting 22:57:07 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:21:32 (6132): No heartbeat from core client for 30 sec - exiting 08:21:33 (6132): No heartbeat from core client for 30 sec - exiting 08:21:34 (6132): No heartbeat from core client for 30 sec - exiting 08:21:35 (6132): No heartbeat from core client for 30 sec - exiting 08:21:36 (6132): No heartbeat from core client for 30 sec - exiting 08:21:37 (6132): No heartbeat from core client for 30 sec - exiting 08:21:38 (6132): No heartbeat from core client for 30 sec - exiting 08:21:39 (6132): No heartbeat from core client for 30 sec - exiting 08:21:40 (6132): No heartbeat from core client for 30 sec - exiting 08:21:41 (6132): No heartbeat from core client for 30 sec - exiting 08:21:42 (6132): No heartbeat from core client for 30 sec - exiting 08:21:43 (6132): No heartbeat from core client for 30 sec - exiting 08:21:44 (6132): No heartbeat from core client for 30 sec - exiting 08:21:45 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:46 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:11:54 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:23:01 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:59:56 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:20:03 (1548): No heartbeat from core client for 30 sec - exiting 08:20:04 (1548): No heartbeat from core client for 30 sec - exiting 08:20:05 (1548): No heartbeat from core client for 30 sec - exiting 08:20:06 (1548): No heartbeat from core client for 30 sec - exiting 08:20:07 (1548): No heartbeat from core client for 30 sec - exiting 08:20:08 (1548): No heartbeat from core client for 30 sec - exiting 08:20:09 (1548): No heartbeat from core client for 30 sec - exiting 08:20:10 (1548): No heartbeat from core client for 30 sec - exiting 08:20:11 (1548): No heartbeat from core client for 30 sec - exiting 08:20:12 (1548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:20:13 (1548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:59:14 (4812): No heartbeat from core client for 30 sec - exiting 18:59:15 (4812): No heartbeat from core client for 30 sec - exiting 18:59:16 (4812): No heartbeat from core client for 30 sec - exiting 18:59:17 (4812): No heartbeat from core client for 30 sec - exiting 18:59:18 (4812): No heartbeat from core client for 30 sec - exiting 18:59:19 (4812): No heartbeat from core client for 30 sec - exiting 18:59:20 (4812): No heartbeat from core client for 30 sec - exiting 18:59:22 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:04:30 (4824): No heartbeat from core client for 30 sec - exiting 18:04:31 (4824): No heartbeat from core client for 30 sec - exiting 18:04:32 (4824): No heartbeat from core client for 30 sec - exiting 18:04:33 (4824): No heartbeat from core client for 30 sec - exiting 18:04:34 (4824): No heartbeat from core client for 30 sec - exiting 18:04:35 (4824): No heartbeat from core client for 30 sec - exiting 18:04:36 (4824): No heartbeat from core client for 30 sec - exiting 18:04:37 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:04:38 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:18:15 (3628): No heartbeat from core client for 30 sec - exiting 20:18:17 (3628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:17:31 (2528): No heartbeat from core client for 30 sec - exiting 08:17:32 (2528): No heartbeat from core client for 30 sec - exiting 08:17:33 (2528): No heartbeat from core client for 30 sec - exiting 08:17:34 (2528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:16:59 (664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:18:43 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:19:49 (5892): No heartbeat from core client for 30 sec - exiting 07:19:50 (5892): No heartbeat from core client for 30 sec - exiting 07:19:51 (5892): No heartbeat from core client for 30 sec - exiting 07:19:52 (5892): No heartbeat from core client for 30 sec - exiting 07:19:53 (5892): No heartbeat from core client for 30 sec - exiting 07:19:54 (5892): No heartbeat from core client for 30 sec - exiting 07:19:55 (5892): No heartbeat from core client for 30 sec - exiting 07:19:56 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:45:55 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:30:59 (2992): No heartbeat from core client for 30 sec - exiting 11:31:00 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:32:42 (3080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:31:03 (5472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:50:35 (5416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:52 (2512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:50:45 (5404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:25:14 (6308): No heartbeat from core client for 30 sec - exiting 08:25:15 (6308): No heartbeat from core client for 30 sec - exiting 08:25:16 (6308): No heartbeat from core client for 30 sec - exiting 08:25:17 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:21:48 (7312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:09:27 (6944): No heartbeat from core client for 30 sec - exiting 09:09:28 (6944): No heartbeat from core client for 30 sec - exiting 09:09:29 (6944): No heartbeat from core client for 30 sec - exiting 09:09:30 (6944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77045EAB read attempt to address 0x409F789C Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77045EAB read attempt to address 0x409F789C Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Apr 2013 16:51:11	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	259,200	629,186	2.4274
14 Apr 2013 17:29:02	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	233,280	568,071	2.4351
11 Apr 2013 10:44:38	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	207,360	507,690	2.4484
01 Apr 2013 22:59:53	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	181,440	446,049	2.4584
27 Mar 2013 17:41:39	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	155,520	382,511	2.4596
19 Mar 2013 18:22:32	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	129,600	321,242	2.4787
14 Mar 2013 18:20:55	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	103,680	257,004	2.4788
10 Mar 2013 16:55:48	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	77,760	193,368	2.4867
06 Mar 2013 20:49:37	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	51,840	128,189	2.4728
28 Feb 2013 20:22:55	1021648	15636545	hadcm3n_n4v2_1920_40_008321368_0	25,920	61,963	2.3905