Task 15540743

Name	hadcm3n_zema_1920_40_008281745_0
Workunit	8432880
Created	14 Jan 2013, 0:16:24 UTC
Sent	14 Jan 2013, 0:16:30 UTC
Report deadline	15 Apr 2013, 7:43:41 UTC
Received	6 Mar 2013, 20:32:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-529697949 (0xE06D7363) Unknown error code
Computer ID	1128129
Run time	12 days 23 hours 8 min 4 sec
CPU time	10 days 10 hours 15 min 45 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.39 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -529697949 (0xe06d7363) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4240, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4568, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on zemako.dad5750 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5672, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4508, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4608, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5092, iMonCtr=1 Model crash detected, will try to restart... 17:04:11 (2632): No heartbeat from core client for 30 sec - exiting 17:04:12 (2632): No heartbeat from core client for 30 sec - exiting 17:04:13 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4824, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C77373 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file D:\Windows7\Science\BOINC\UserDats/projects/climateprediction.net/hadcm3n_zema_1920_40_008281745/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C771A8 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Mar 2013 19:43:14	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	777,600	900,939	1.1586
04 Mar 2013 22:27:40	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	751,680	870,633	1.1582
28 Feb 2013 21:29:03	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	725,760	840,256	1.1578
26 Feb 2013 21:33:27	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	699,840	809,691	1.1570
24 Feb 2013 23:25:53	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	673,920	779,260	1.1563
23 Feb 2013 23:26:31	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	648,000	749,196	1.1562
23 Feb 2013 01:30:34	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	622,080	718,534	1.1551
21 Feb 2013 21:18:44	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	596,160	689,291	1.1562
20 Feb 2013 17:11:04	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	570,240	660,229	1.1578
18 Feb 2013 22:15:41	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	544,320	630,128	1.1576
17 Feb 2013 18:06:35	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	518,400	598,807	1.1551
15 Feb 2013 00:15:20	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	492,480	568,507	1.1544
13 Feb 2013 19:40:28	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	466,560	538,076	1.1533
11 Feb 2013 19:54:01	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	440,640	507,486	1.1517
10 Feb 2013 14:00:29	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	414,720	476,925	1.1500
10 Feb 2013 04:25:56	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	388,800	446,508	1.1484
09 Feb 2013 16:30:54	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	362,880	415,932	1.1462
06 Feb 2013 20:06:16	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	336,960	385,528	1.1441
05 Feb 2013 22:50:48	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	311,040	355,105	1.1417
04 Feb 2013 21:08:27	1128129	15540743	hadcm3n_zema_1920_40_008281745_0	285,120	324,654	1.1387