Task 13106516

Name	hadcm3n_ye8x_1900_40_007351323_1
Workunit	7548753
Created	6 Jul 2011, 14:12:50 UTC
Sent	16 Jul 2011, 9:36:51 UTC
Report deadline	15 Oct 2011, 17:04:02 UTC
Received	28 Aug 2011, 22:00:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1125445
Run time	23 days 20 hours 22 min 5 sec
CPU time	22 days 2 hours 54 min 55 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.63 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ye8xko.pja8c10 Error converting file to netcdf: dataout/ye8xko.pia8c10 Error converting file to netcdf: dataout/ye8xko.pfa8c10 Error converting file to netcdf: dataout/ye8xka.pha8c10 Error converting file to netcdf: dataout/ye8xka.pga8c10 Error converting file to netcdf: dataout/ye8xka.pea8c10 Error converting file to netcdf: dataout/ye8xka.pda8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5116, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:52:08 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:06 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:27:45 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:10:50 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:46 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:23 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6676, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:11:32 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:52 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:51 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:52 (4576): No heartbeat from core client for 30 sec - exiting 22:19:33 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:52:44 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:04:12 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3892, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3904, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:22:45 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:44:20 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:25:25 (2284): No heartbeat from core client for 30 sec - exiting 22:25:26 (2284): No heartbeat from core client for 30 sec - exiting 22:25:27 (2284): No heartbeat from core client for 30 sec - exiting 22:25:28 (2284): No heartbeat from core client for 30 sec - exiting 22:25:29 (2284): No heartbeat from core client for 30 sec - exiting 22:25:30 (2284): No heartbeat from core client for 30 sec - exiting 22:25:32 (2284): No heartbeat from core client for 30 sec - exiting 22:25:33 (2284): No heartbeat from core client for 30 sec - exiting 22:25:34 (2284): No heartbeat from core client for 30 sec - exiting 22:25:35 (2284): No heartbeat from core client for 30 sec - exiting 22:25:36 (2284): No heartbeat from core client for 30 sec - exiting 22:25:37 (2284): No heartbeat from core client for 30 sec - exiting 22:25:38 (2284): No heartbeat from core client for 30 sec - exiting 22:25:39 (2284): No heartbeat from core client for 30 sec - exiting 22:25:40 (2284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:25:41 (2284): No heartbeat from core client for 30 sec - exiting 22:25:42 (2284): No heartbeat from core client for 30 sec - exiting 22:25:43 (2284): No heartbeat from core client for 30 sec - exiting 22:25:44 (2284): No heartbeat from core client for 30 sec - exiting 22:25:45 (2284): No heartbeat from core client for 30 sec - exiting 22:25:46 (2284): No heartbeat from core client for 30 sec - exiting 22:25:47 (2284): No heartbeat from core client for 30 sec - exiting 22:25:48 (2284): No heartbeat from core client for 30 sec - exiting 22:25:49 (2284): No heartbeat from core client for 30 sec - exiting 22:25:51 (2284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772DB84B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BC3740 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F47353 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F43A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Aug 2011 00:50:44	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	1,036,800	1,910,494	1.8427
27 Aug 2011 10:05:39	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	1,010,880	1,861,781	1.8417
26 Aug 2011 15:24:34	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	984,960	1,814,705	1.8424
24 Aug 2011 18:59:28	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	959,040	1,767,566	1.8431
23 Aug 2011 06:36:34	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	933,120	1,723,852	1.8474
22 Aug 2011 04:03:46	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	907,200	1,678,895	1.8506
21 Aug 2011 14:36:21	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	881,280	1,634,244	1.8544
20 Aug 2011 17:58:10	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	855,360	1,590,674	1.8597
20 Aug 2011 02:58:54	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	829,440	1,544,318	1.8619
18 Aug 2011 17:22:06	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	803,520	1,498,673	1.8651
17 Aug 2011 03:59:07	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	777,600	1,451,761	1.8670
15 Aug 2011 19:49:23	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	751,680	1,404,041	1.8679
14 Aug 2011 22:03:02	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	725,760	1,355,166	1.8672
13 Aug 2011 18:18:33	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	699,840	1,307,509	1.8683
13 Aug 2011 03:21:16	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	673,920	1,259,369	1.8687
11 Aug 2011 07:12:45	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	648,000	1,211,092	1.8690
10 Aug 2011 04:47:39	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	622,080	1,164,065	1.8712
09 Aug 2011 03:30:52	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	596,160	1,117,083	1.8738
07 Aug 2011 19:24:42	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	570,240	1,067,597	1.8722
06 Aug 2011 18:08:11	1125445	13106516	hadcm3n_ye8x_1900_40_007351323_1	544,320	1,019,308	1.8726