Task 15441031

Name	hadcm3n_zh80_1880_40_008245847_1
Workunit	8400971
Created	20 Nov 2012, 21:33:05 UTC
Sent	20 Nov 2012, 21:33:13 UTC
Report deadline	20 Feb 2013, 5:00:24 UTC
Received	31 Dec 2012, 9:18:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1113795
Run time	6 days 14 hours 15 min 1 sec
CPU time	5 days 15 hours 2 min 51 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 22:44:14 (7112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:27 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:32 (2324): No heartbeat from core client for 30 sec - exiting 22:49:33 (2324): No heartbeat from core client for 30 sec - exiting 22:49:34 (2324): No heartbeat from core client for 30 sec - exiting 22:49:35 (2324): No heartbeat from core client for 30 sec - exiting 22:49:36 (2324): No heartbeat from core client for 30 sec - exiting 22:49:37 (2324): No heartbeat from core client for 30 sec - exiting 22:49:38 (2324): No heartbeat from core client for 30 sec - exiting 22:49:39 (2324): No heartbeat from core client for 30 sec - exiting 22:49:40 (2324): No heartbeat from core client for 30 sec - exiting 22:49:42 (2324): No heartbeat from core client for 30 sec - exiting 22:57:12 (7712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:57:13 (7712): No heartbeat from core client for 30 sec - exiting 22:57:14 (7712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:47:33 (6364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:09:45 (7616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:35:53 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:38 (6216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:49 (6320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:50 (6320): No heartbeat from core client for 30 sec - exiting 20:40:51 (6320): No heartbeat from core client for 30 sec - exiting 20:40:52 (6320): No heartbeat from core client for 30 sec - exiting 20:40:53 (6320): No heartbeat from core client for 30 sec - exiting 20:40:54 (6320): No heartbeat from core client for 30 sec - exiting 20:40:55 (6320): No heartbeat from core client for 30 sec - exiting 20:40:56 (6320): No heartbeat from core client for 30 sec - exiting 20:40:57 (6320): No heartbeat from core client for 30 sec - exiting 20:40:58 (6320): No heartbeat from core client for 30 sec - exiting 20:40:59 (6320): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:21:49 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:46:22 (6212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:42:33 (1904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5764, iMonCtr=1 Model crash detected, will try to restart... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:34:48 (6468): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:34:49 (6468): No heartbeat from core client for 30 sec - exiting 00:34:50 (6468): No heartbeat from core client for 30 sec - exiting 09:43:55 (6644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:28:58 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:01 (5008): No heartbeat from core client for 30 sec - exiting 20:29:02 (5008): No heartbeat from core client for 30 sec - exiting 20:29:03 (5008): No heartbeat from core client for 30 sec - exiting 20:29:04 (5008): No heartbeat from core client for 30 sec - exiting 20:29:05 (5008): No heartbeat from core client for 30 sec - exiting 20:30:15 (7408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:15 (7632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:58 (6008): No heartbeat from core client for 30 sec - exiting 19:13:59 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:12 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:15 (4420): No heartbeat from core client for 30 sec - exiting 19:20:16 (4420): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x777DFF2B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77A43AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Dec 2012 09:44:33	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	259,200	477,988	1.8441
18 Dec 2012 20:53:03	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	233,280	428,388	1.8364
15 Dec 2012 20:20:56	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	207,360	381,166	1.8382
13 Dec 2012 21:26:59	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	181,440	331,993	1.8298
13 Dec 2012 21:26:59	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	155,520	284,140	1.8270
05 Dec 2012 19:33:03	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	129,600	237,044	1.8290
01 Dec 2012 20:44:27	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	103,680	190,159	1.8341
30 Nov 2012 22:59:02	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	77,760	142,214	1.8289
24 Nov 2012 21:47:45	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	51,840	94,590	1.8247
23 Nov 2012 23:51:22	1113795	15441031	hadcm3n_zh80_1880_40_008245847_1	25,920	46,920	1.8102