Task 12820869

Name	hadcm3n_p289_1900_40_007220473_1
Workunit	7418713
Created	26 Apr 2011, 15:20:20 UTC
Sent	2 May 2011, 22:00:47 UTC
Report deadline	2 Aug 2011, 5:27:58 UTC
Received	5 Jul 2011, 6:09:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1069365
Run time	37 days 3 hours 8 min 7 sec
CPU time	34 days 13 hours 11 min 38 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	1.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4600, iMonCtr=1 Model crash detected, will try to restart... 08:10:34 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4292, iMonCtr=1 Model crash detected, will try to restart... 21:53:38 (1260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:00:31 (796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4040, iMonCtr=1 Model crash detected, will try to restart... 08:04:06 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:04:08 (4736): No heartbeat from core client for 30 sec - exiting 08:04:09 (4736): No heartbeat from core client for 30 sec - exiting 08:04:10 (4736): No heartbeat from core client for 30 sec - exiting 08:04:11 (4736): No heartbeat from core client for 30 sec - exiting 08:04:12 (4736): No heartbeat from core client for 30 sec - exiting 08:04:13 (4736): No heartbeat from core client for 30 sec - exiting 08:04:14 (4736): No heartbeat from core client for 30 sec - exiting 08:04:15 (4736): No heartbeat from core client for 30 sec - exiting 08:04:16 (4736): No heartbeat from core client for 30 sec - exiting 11:14:29 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:49 (4236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:50 (4236): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:38:31 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:58 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:55 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:02:40 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:35:20 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:07:27 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:33:42 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:18:55 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:18 (4732): No heartbeat from core client for 30 sec - exiting 08:22:20 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:21 (4732): No heartbeat from core client for 30 sec - exiting 08:22:22 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:33:20 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:29:44 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:41 (4672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:47:42 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:31:19 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:18:55 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:56 (3764): No heartbeat from core client for 30 sec - exiting 13:18:57 (3764): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:28:48 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:49 (4436): No heartbeat from core client for 30 sec - exiting 12:28:50 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:53:53 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:12:08 (4532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:10:39 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4208, iMonCtr=1 Model crash detected, will try to restart... 03:31:11 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:00 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:40 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:41 (4692): No heartbeat from core client for 30 sec - exiting 12:16:33 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:13:43 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:51:55 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:42:16 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:17 (4740): No heartbeat from core client for 30 sec - exiting 08:52:34 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:17:37 (4132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:38 (4132): No heartbeat from core client for 30 sec - exiting 08:25:49 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:46 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:49 (4672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:33:42 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:00 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:38:59 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77513A93 read attempt to address 0x40BF0F6F Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77443A93 read attempt to address 0x40BF0F6F Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jul 2011 14:42:43	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	777,600	2,980,811	3.8333
03 Jul 2011 03:43:52	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	751,680	2,871,207	3.8197
01 Jul 2011 09:49:12	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	725,760	2,756,355	3.7979
28 Jun 2011 14:47:38	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	699,840	2,667,488	3.8116
27 Jun 2011 08:13:42	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	673,920	2,568,832	3.8118
26 Jun 2011 08:14:22	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	648,000	2,471,117	3.8135
24 Jun 2011 06:29:08	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	622,080	2,381,814	3.8288
22 Jun 2011 00:42:36	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	596,160	2,290,360	3.8419
20 Jun 2011 08:04:58	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	570,240	2,201,332	3.8604
19 Jun 2011 22:06:45	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	544,320	2,118,605	3.8922
17 Jun 2011 14:02:37	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	518,400	2,036,830	3.9291
13 Jun 2011 08:39:06	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	492,480	1,947,829	3.9551
12 Jun 2011 06:11:08	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	466,560	1,856,974	3.9801
10 Jun 2011 23:19:48	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	440,640	1,754,001	3.9806
09 Jun 2011 12:51:56	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	414,720	1,638,100	3.9499
08 Jun 2011 06:10:42	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	388,800	1,537,252	3.9538
07 Jun 2011 05:37:41	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	362,880	1,453,882	4.0065
06 Jun 2011 02:52:19	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	336,960	1,361,213	4.0397
04 Jun 2011 19:23:36	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	311,040	1,253,120	4.0288
03 Jun 2011 06:15:22	1069365	12820869	hadcm3n_p289_1900_40_007220473_1	285,120	1,127,492	3.9544