Task 12749543

Name	hadcm3n_o6t6_1900_40_007204157_1
Workunit	7402437
Created	28 Mar 2011, 14:18:13 UTC
Sent	28 Mar 2011, 23:26:54 UTC
Report deadline	28 Jun 2011, 6:54:05 UTC
Received	28 Jun 2011, 12:42:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1062993
Run time	48 days 21 hours 51 min 58 sec
CPU time	35 days 18 hours 22 min 39 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	1.85 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 09:54:15 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:24:54 (1584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:20:33 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:28:44 (5092): No heartbeat from core client for 30 sec - exiting 08:28:45 (5092): No heartbeat from core client for 30 sec - exiting 08:28:46 (5092): No heartbeat from core client for 30 sec - exiting 08:28:47 (5092): No heartbeat from core client for 30 sec - exiting 08:28:48 (5092): No heartbeat from core client for 30 sec - exiting 08:28:49 (5092): No heartbeat from core client for 30 sec - exiting 08:28:51 (5092): No heartbeat from core client for 30 sec - exiting 08:28:52 (5092): No heartbeat from core client for 30 sec - exiting 08:28:54 (5092): No heartbeat from core client for 30 sec - exiting 08:28:55 (5092): No heartbeat from core client for 30 sec - exiting 08:28:56 (5092): No heartbeat from core client for 30 sec - exiting 08:28:57 (5092): No heartbeat from core client for 30 sec - exiting 08:28:58 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:41:57 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:32:46 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:21 (4996): No heartbeat from core client for 30 sec - exiting 08:48:23 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:48:45 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:27:21 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:37 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:38 (4736): No heartbeat from core client for 30 sec - exiting 09:42:39 (4736): No heartbeat from core client for 30 sec - exiting 09:42:40 (4736): No heartbeat from core client for 30 sec - exiting 09:42:41 (4736): No heartbeat from core client for 30 sec - exiting 09:42:42 (4736): No heartbeat from core client for 30 sec - exiting 09:42:44 (4736): No heartbeat from core client for 30 sec - exiting 09:42:45 (4736): No heartbeat from core client for 30 sec - exiting 09:42:46 (4736): No heartbeat from core client for 30 sec - exiting 09:42:47 (4736): No heartbeat from core client for 30 sec - exiting 09:42:48 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4300, iMonCtr=1 Model crash detected, will try to restart... 06:20:12 (4888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:20:13 (4888): No heartbeat from core client for 30 sec - exiting 06:20:14 (4888): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 10:53:31 (4812): No heartbeat from core client for 30 sec - exiting 10:53:32 (4812): No heartbeat from core client for 30 sec - exiting 10:53:33 (4812): No heartbeat from core client for 30 sec - exiting 10:53:34 (4812): No heartbeat from core client for 30 sec - exiting 10:53:35 (4812): No heartbeat from core client for 30 sec - exiting 10:53:36 (4812): No heartbeat from core client for 30 sec - exiting 10:53:38 (4812): No heartbeat from core client for 30 sec - exiting 10:53:39 (4812): No heartbeat from core client for 30 sec - exiting 10:53:40 (4812): No heartbeat from core client for 30 sec - exiting 10:53:41 (4812): No heartbeat from core client for 30 sec - exiting 10:53:42 (4812): No heartbeat from core client for 30 sec - exiting 10:53:43 (4812): No heartbeat from core client for 30 sec - exiting 10:53:44 (4812): No heartbeat from core client for 30 sec - exiting 10:53:45 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:30:19 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:34 (4840): No heartbeat from core client for 30 sec - exiting 11:40:36 (4840): No heartbeat from core client for 30 sec - exiting 11:40:37 (4840): No heartbeat from core client for 30 sec - exiting 11:40:38 (4840): No heartbeat from core client for 30 sec - exiting 11:40:39 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:40 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 08:02:49 (4560): No heartbeat from core client for 30 sec - exiting 08:02:50 (4560): No heartbeat from core client for 30 sec - exiting 08:02:51 (4560): No heartbeat from core client for 30 sec - exiting 08:02:52 (4560): No heartbeat from core client for 30 sec - exiting 08:02:53 (4560): No heartbeat from core client for 30 sec - exiting 08:02:55 (4560): No heartbeat from core client for 30 sec - exiting 08:02:56 (4560): No heartbeat from core client for 30 sec - exiting 08:02:57 (4560): No heartbeat from core client for 30 sec - exiting 08:02:58 (4560): No heartbeat from core client for 30 sec - exiting 08:02:59 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:38:35 (2864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:31 (4704): No heartbeat from core client for 30 sec - exiting 09:27:32 (4704): No heartbeat from core client for 30 sec - exiting 09:27:33 (4704): No heartbeat from core client for 30 sec - exiting 09:27:34 (4704): No heartbeat from core client for 30 sec - exiting 09:27:35 (4704): No heartbeat from core client for 30 sec - exiting 09:27:36 (4704): No heartbeat from core client for 30 sec - exiting 09:27:37 (4704): No heartbeat from core client for 30 sec - exiting 09:27:39 (4704): No heartbeat from core client for 30 sec - exiting 09:27:40 (4704): No heartbeat from core client for 30 sec - exiting 09:27:41 (4704): No heartbeat from core client for 30 sec - exiting 09:27:42 (4704): No heartbeat from core client for 30 sec - exiting 09:27:43 (4704): No heartbeat from core client for 30 sec - exiting 09:27:44 (4704): No heartbeat from core client for 30 sec - exiting 09:27:45 (4704): No heartbeat from core client for 30 sec - exiting 09:27:47 (4704): No heartbeat from core client for 30 sec - exiting 09:27:48 (4704): No heartbeat from core client for 30 sec - exiting 09:27:49 (4704): No heartbeat from core client for 30 sec - exiting 09:27:50 (4704): No heartbeat from core client for 30 sec - exiting 09:27:51 (4704): No heartbeat from core client for 30 sec - exiting 09:27:52 (4704): No heartbeat from core client for 30 sec - exiting 09:27:53 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:31:26 (4328): No heartbeat from core client for 30 sec - exiting 13:31:28 (4328): No heartbeat from core client for 30 sec - exiting 13:31:29 (4328): No heartbeat from core client for 30 sec - exiting 13:31:30 (4328): No heartbeat from core client for 30 sec - exiting 13:31:31 (4328): No heartbeat from core client for 30 sec - exiting 13:31:32 (4328): No heartbeat from core client for 30 sec - exiting 13:31:33 (4328): No heartbeat from core client for 30 sec - exiting 13:31:34 (4328): No heartbeat from core client for 30 sec - exiting 13:31:35 (4328): No heartbeat from core client for 30 sec - exiting 13:31:36 (4328): No heartbeat from core client for 30 sec - exiting 13:31:37 (4328): No heartbeat from core client for 30 sec - exiting 13:31:39 (4328): No heartbeat from core client for 30 sec - exiting 13:31:40 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:29 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:20:19 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:57 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:22:46 (2252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:14 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:29:01 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:30:04 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:37 (4908): No heartbeat from core client for 30 sec - exiting 09:26:39 (4908): No heartbeat from core client for 30 sec - exiting 09:26:40 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:42 (4908): No heartbeat from core client for 30 sec - exiting 09:26:43 (4908): No heartbeat from core client for 30 sec - exiting 09:26:44 (4908): No heartbeat from core client for 30 sec - exiting 09:26:45 (4908): No heartbeat from core client for 30 sec - exiting 09:26:47 (4908): No heartbeat from core client for 30 sec - exiting 09:26:48 (4908): No heartbeat from core client for 30 sec - exiting 09:26:49 (4908): No heartbeat from core client for 30 sec - exiting 09:26:50 (4908): No heartbeat from core client for 30 sec - exiting 09:26:51 (4908): No heartbeat from core client for 30 sec - exiting 09:26:52 (4908): No heartbeat from core client for 30 sec - exiting 08:46:20 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:10:50 (4416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:53 (4416): No heartbeat from core client for 30 sec - exiting 22:10:54 (4416): No heartbeat from core client for 30 sec - exiting 22:10:55 (4416): No heartbeat from core client for 30 sec - exiting 22:10:56 (4416): No heartbeat from core client for 30 sec - exiting 22:10:57 (4416): No heartbeat from core client for 30 sec - exiting 22:10:58 (4416): No heartbeat from core client for 30 sec - exiting 22:10:59 (4416): No heartbeat from core client for 30 sec - exiting 22:11:01 (4416): No heartbeat from core client for 30 sec - exiting 15:57:28 (3824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:34 (4768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:39:17 (4816): No heartbeat from core client for 30 sec - exiting 08:39:18 (4816): No heartbeat from core client for 30 sec - exiting 08:39:19 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3840, iMonCtr=1 Model crash detected, will try to restart... 09:33:17 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN proces18:21:24 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:25 (4612): No heartbeat from core client for 30 sec - exiting 22:11:56 (3924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:36 (1208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:46 (4424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:42:06 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:21:13 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:47 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:17:49 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77832AB1 read attempt to address 0x406CF486 Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish ERROR: Invalid parameter detected in function (null). File: (null) Line: 0 ERROR: Expression: (null) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jun 2011 17:14:32	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	1,036,800	3,088,972	2.9793
21 Jun 2011 22:26:47	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	1,010,880	3,002,897	2.9706
14 Jun 2011 21:23:53	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	984,960	2,924,501	2.9692
08 Jun 2011 09:56:33	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	959,040	2,843,382	2.9648
07 Jun 2011 06:03:00	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	933,120	2,760,720	2.9586
04 Jun 2011 22:30:50	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	907,200	2,683,725	2.9583
31 May 2011 13:45:23	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	881,280	2,605,502	2.9565
28 May 2011 09:34:51	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	855,360	2,521,240	2.9476
26 May 2011 19:48:50	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	829,440	2,441,880	2.9440
23 May 2011 20:08:21	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	803,520	2,353,566	2.9291
21 May 2011 17:57:08	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	777,600	2,260,388	2.9069
19 May 2011 19:00:20	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	751,680	2,178,161	2.8977
16 May 2011 20:23:27	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	725,760	2,100,179	2.8938
15 May 2011 02:17:54	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	699,840	2,016,625	2.8816
13 May 2011 00:57:42	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	673,920	1,924,267	2.8553
10 May 2011 20:55:48	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	648,000	1,838,918	2.8378
08 May 2011 17:15:02	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	622,080	1,758,140	2.8262
07 May 2011 12:45:09	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	596,160	1,682,714	2.8226
06 May 2011 01:54:04	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	570,240	1,612,679	2.8281
03 May 2011 21:28:11	1062993	12749543	hadcm3n_o6t6_1900_40_007204157_1	544,320	1,541,960	2.8328