Task 13590916

Name	hadcm3n_yat7_1900_40_007520600_3
Workunit	7718075
Created	3 Nov 2011, 18:44:55 UTC
Sent	3 Nov 2011, 18:58:40 UTC
Report deadline	3 Feb 2012, 2:25:51 UTC
Received	6 Dec 2011, 20:36:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1331033
Run time	12 days 18 hours 32 min 44 sec
CPU time	12 days 4 hours 34 min 54 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:59:13 (140): No heartbeat from core client for 30 sec - exiting 06:59:14 (140): No heartbeat from core client for 30 sec - exiting 06:59:15 (140): No heartbeat from core client for 30 sec - exiting 06:59:16 (140): No heartbeat from core client for 30 sec - exiting 06:59:17 (140): No heartbeat from core client for 30 sec - exiting 06:59:19 (140): No heartbeat from core client for 30 sec - exiting 06:59:20 (140): No heartbeat from core client for 30 sec - exiting 06:59:21 (140): No heartbeat from core client for 30 sec - exiting 06:59:22 (140): No heartbeat from core client for 30 sec - exiting 06:59:23 (140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3060, iMonCtr=1 Model crash detected, will try to restart... 07:18:37 (2796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:45 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:33:57 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:53:49 (4204): No heartbeat from core client for 30 sec - exiting 16:53:50 (4204): No heartbeat from core client for 30 sec - exiting 16:53:51 (4204): No heartbeat from core client for 30 sec - exiting 16:53:52 (4204): No heartbeat from core client for 30 sec - exiting 16:53:54 (4204): No heartbeat from core client for 30 sec - exiting 16:53:55 (4204): No heartbeat from core client for 30 sec - exiting 16:53:56 (4204): No heartbeat from core client for 30 sec - exiting 16:53:57 (4204): No heartbeat from core client for 30 sec - exiting 16:53:58 (4204): No heartbeat from core client for 30 sec - exiting 16:53:59 (4204): No heartbeat from core client for 30 sec - exiting 16:54:00 (4204): No heartbeat from core client for 30 sec - exiting 16:54:01 (4204): No heartbeat from core client for 30 sec - exiting 16:54:02 (4204): No heartbeat from core client for 30 sec - exiting 16:54:03 (4204): No heartbeat from core client for 30 sec - exiting 16:54:04 (4204): No heartbeat from core client for 30 sec - exiting 16:54:39 (4204): No heartbeat from core client for 30 sec - exiting 16:54:40 (4204): No heartbeat from core client for 30 sec - exiting 16:54:42 (4204): No heartbeat from core client for 30 sec - exiting 16:54:43 (4204): No heartbeat from core client for 30 sec - exiting 16:54:44 (4204): No heartbeat from core client for 30 sec - exiting 16:54:45 (4204): No heartbeat from core client for 30 sec - exiting 16:54:46 (4204): No heartbeat from core client for 30 sec - exiting 16:54:47 (4204): No heartbeat from core client for 30 sec - exiting 16:54:48 (4204): No heartbeat from core client for 30 sec - exiting 16:54:49 (4204): No heartbeat from core client for 30 sec - exiting 16:54:50 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... 08:01:39 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yat7ko.pjb3c10 Error converting file to netcdf: dataout/yat7ko.pib3c10 Error converting file to netcdf: dataout/yat7ko.pfb3c10 Error converting file to netcdf: dataout/yat7ka.phb3c10 Error converting file to netcdf: dataout/yat7ka.pgb3c10 Error converting file to netcdf: dataout/yat7ka.peb3c10 Error converting file to netcdf: dataout/yat7ka.pdb3c10 22:20:26 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=816, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4236, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77517353 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2500, selfPID=2500, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77513A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Dec 2011 18:08:12	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	518,400	1,044,263	2.0144
05 Dec 2011 18:47:23	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	492,480	991,710	2.0137
04 Dec 2011 19:36:51	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	466,560	939,301	2.0132
28 Nov 2011 12:21:36	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	440,640	886,548	2.0120
27 Nov 2011 10:26:08	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	414,720	833,234	2.0091
26 Nov 2011 19:46:10	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	388,800	780,869	2.0084
25 Nov 2011 16:27:54	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	362,880	729,947	2.0115
24 Nov 2011 19:41:07	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	336,960	681,435	2.0223
23 Nov 2011 19:01:27	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	311,040	629,011	2.0223
22 Nov 2011 18:16:25	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	285,120	576,712	2.0227
21 Nov 2011 17:35:53	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	259,200	524,354	2.0230
21 Nov 2011 01:11:37	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	233,280	471,865	2.0227
19 Nov 2011 12:04:34	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	207,360	419,785	2.0244
18 Nov 2011 12:35:13	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	181,440	367,589	2.0260
17 Nov 2011 13:14:31	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	155,520	314,974	2.0253
16 Nov 2011 21:24:58	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	129,600	262,298	2.0239
16 Nov 2011 18:08:43	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	103,680	209,891	2.0244
16 Nov 2011 18:08:43	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	77,760	157,616	2.0270
09 Nov 2011 06:54:18	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	51,840	104,711	2.0199
06 Nov 2011 16:43:44	1118283	13590916	hadcm3n_yat7_1900_40_007520600_3	25,920	52,578	2.0285