Task 15943563

Name	hadcm3n_n36f_1880_40_008375991_1
Workunit	8526850
Created	29 Aug 2013, 15:52:01 UTC
Sent	29 Aug 2013, 15:52:18 UTC
Report deadline	28 Nov 2013, 23:19:29 UTC
Received	20 Sep 2013, 6:38:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1290556
Run time	10 days 22 hours 25 min 57 sec
CPU time	10 days 2 hours 24 min 45 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	4.07 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1576, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4624, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4708, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5792, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1032, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5088, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4820, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4856, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6028, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5248, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5248, iMonCtr=1 Model crash detected, will try to restart... 10:52:09 (5456): No heartbeat from core client for 30 sec - exiting 10:52:11 (5456): No heartbeat from core client for 30 sec - exiting 10:52:12 (5456): No heartbeat from core client for 30 sec - exiting 10:52:13 (5456): No heartbeat from core client for 30 sec - exiting 10:52:14 (5456): No heartbeat from core client for 30 sec - exiting 10:52:15 (5456): No heartbeat from core client for 30 sec - exiting 10:52:16 (5456): No heartbeat from core client for 30 sec - exiting 10:52:17 (5456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775AFF6B write attempt to address 0xC1E97763 Engaging BOINC Windows Runtime Debugger... 08:26:04 (5372): No heartbeat from core client for 30 sec - exiting 08:26:05 (5372): No heartbeat from core client for 30 sec - exiting 08:26:06 (5372): No heartbeat from core client for 30 sec - exiting 08:26:07 (5372): No heartbeat from core client for 30 sec - exiting 08:26:08 (5372): No heartbeat from core client for 30 sec - exiting 08:26:09 (5372): No heartbeat from core client for 30 sec - exiting 08:26:10 (5372): No heartbeat from core client for 30 sec - exiting 08:26:11 (5372): No heartbeat from core client for 30 sec - exiting 08:26:12 (5372): No heartbeat from core client for 30 sec - exiting 08:26:13 (5372): No heartbeat from core client for 30 sec - exiting 08:26:14 (5372): No heartbeat from core client for 30 sec - exiting 08:26:15 (5372): No heartbeat from core client for 30 sec - exiting 08:26:16 (5372): No heartbeat from core client for 30 sec - exiting 08:26:17 (5372): No heartbeat from core client for 30 sec - exiting 08:26:18 (5372): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77B97383 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... 11:50:00 (5300): No heartbeat from core client for 30 sec - exiting 11:50:01 (5300): No heartbeat from core client for 30 sec - exiting 11:50:02 (5300): No heartbeat from core client for 30 sec - exiting 11:50:03 (5300): No heartbeat from core client for 30 sec - exiting 11:50:04 (5300): No heartbeat from core client for 30 sec - exiting 11:50:05 (5300): No heartbeat from core client for 30 sec - exiting 11:50:06 (5300): No heartbeat from core client for 30 sec - exiting 11:50:07 (5300): No heartbeat from core client for 30 sec - exiting 11:50:08 (5300): No heartbeat from core client for 30 sec - exiting 11:50:09 (5300): No heartbeat from core client for 30 sec - exiting 11:50:10 (5300): No heartbeat from core client for 30 sec - exiting 11:50:11 (5300): No heartbeat from core client for 30 sec - exiting 11:50:12 (5300): No heartbeat from core client for 30 sec - exiting 11:50:14 (5300): No heartbeat from core client for 30 sec - exiting 11:50:15 (5300): No heartbeat from core client for 30 sec - exiting 11:50:16 (5300): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C47383 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F47383 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x776D7383 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C77383 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77763AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Sep 2013 09:49:12	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	777,600	862,207	1.1088
14 Sep 2013 16:29:54	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	751,680	828,232	1.1018
14 Sep 2013 07:47:39	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	725,760	797,690	1.0991
14 Sep 2013 00:04:39	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	699,840	770,365	1.1008
13 Sep 2013 16:17:45	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	673,920	742,718	1.1021
13 Sep 2013 08:20:59	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	648,000	714,834	1.1031
12 Sep 2013 16:57:11	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	622,080	687,078	1.1045
12 Sep 2013 09:14:36	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	596,160	659,823	1.1068
11 Sep 2013 18:18:42	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	570,240	632,338	1.1089
11 Sep 2013 10:16:30	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	544,320	604,309	1.1102
10 Sep 2013 18:27:03	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	518,400	576,425	1.1119
10 Sep 2013 10:39:58	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	492,480	548,529	1.1138
09 Sep 2013 16:47:49	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	466,560	521,959	1.1187
08 Sep 2013 18:54:48	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	440,640	495,437	1.1244
08 Sep 2013 06:46:26	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	414,720	468,829	1.1305
07 Sep 2013 15:00:34	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	388,800	442,085	1.1370
06 Sep 2013 20:40:58	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	362,880	412,874	1.1378
06 Sep 2013 10:17:35	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	336,960	390,298	1.1583
05 Sep 2013 14:30:21	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	311,040	368,316	1.1841
04 Sep 2013 20:00:04	1290556	15943563	hadcm3n_n36f_1880_40_008375991_1	285,120	343,026	1.2031