Task 16639987

Name	hadcm3n_89sy_1980_40_008722125_3
Workunit	8868103
Created	15 May 2014, 19:49:10 UTC
Sent	15 May 2014, 20:06:54 UTC
Report deadline	15 Aug 2014, 3:34:05 UTC
Received	11 Jun 2014, 15:29:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1315516
Run time	11 days 20 hours 10 min 3 sec
CPU time	10 days 3 hours 36 min 52 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.13 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7848, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7848, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7848, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7848, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 18:04:36 (7924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:18 (10516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7680, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7896, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7776, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7776, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9072, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6544, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6544, iMonCtr=1 Model crash detected, will try to restart... 17:12:27 (6892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:22:46 (5848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:38 (7468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7832, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7832, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6040, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7128, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7128, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7128, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 18:52:55 (8020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:38 (15820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:21 (8876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:47 (12932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10516, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 19:53:59 (8076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:30 (9380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:20 (8748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8632, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7787FF6B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775A7383 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772D3AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jun 2014 19:05:38	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	518,400	866,269	1.6710
10 Jun 2014 09:03:27	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	492,480	821,072	1.6672
09 Jun 2014 23:34:07	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	466,560	776,902	1.6652
05 Jun 2014 19:04:42	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	440,640	733,557	1.6648
04 Jun 2014 13:56:53	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	414,720	690,275	1.6644
02 Jun 2014 17:27:56	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	388,800	646,968	1.6640
01 Jun 2014 10:23:13	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	362,880	602,620	1.6607
31 May 2014 10:11:45	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	336,960	559,521	1.6605
29 May 2014 21:04:31	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	311,040	516,306	1.6599
28 May 2014 15:23:07	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	285,120	473,956	1.6623
27 May 2014 10:16:23	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	259,200	431,495	1.6647
26 May 2014 11:33:32	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	233,280	389,112	1.6680
25 May 2014 13:27:48	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	207,360	345,504	1.6662
24 May 2014 16:21:53	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	181,440	302,036	1.6647
23 May 2014 15:30:37	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	155,520	257,152	1.6535
22 May 2014 07:19:47	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	129,600	211,476	1.6318
20 May 2014 20:15:35	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	103,680	169,479	1.6346
19 May 2014 14:40:37	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	77,760	127,314	1.6373
18 May 2014 08:56:36	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	51,840	84,425	1.6286
17 May 2014 08:03:41	1315516	16639987	hadcm3n_89sy_1980_40_008722125_3	25,920	42,996	1.6588