Task 15216949

Name	hadcm3n_o1io_2100_40_008154527_3
Workunit	8309651
Created	31 Aug 2012, 22:05:01 UTC
Sent	31 Aug 2012, 22:05:52 UTC
Report deadline	1 Dec 2012, 5:33:03 UTC
Received	4 Oct 2012, 6:59:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1230450
Run time	6 days 9 hours 31 min 26 sec
CPU time	5 days 8 hours 20 min
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13912, selfPID=13912, iMonCtr=1 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10548, selfPID=10548, iMonCtr=1 Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5096, selfPID=5096, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5368, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5368, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5368, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5868, selfPID=5868, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 17:10:08 (6500): Can't set up shared mem: -1. Will run in standalone mode. Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9768, selfPID=9768, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:36:57 (3044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:36:58 (3044): No heartbeat from core client for 30 sec - exiting 15:36:59 (3044): No heartbeat from core client for 30 sec - exiting 15:37:01 (3044): No heartbeat from core client for 30 sec - exiting 15:37:02 (3044): No heartbeat from core client for 30 sec - exiting 15:37:03 (3044): No heartbeat from core client for 30 sec - exiting 15:37:04 (3044): No heartbeat from core client for 30 sec - exiting 15:37:05 (3044): No heartbeat from core client for 30 sec - exiting 15:37:06 (3044): No heartbeat from core client for 30 sec - exiting 15:37:07 (3044): No heartbeat from core client for 30 sec - exiting 15:37:08 (3044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 16:46:48 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:49 (5464): No heartbeat from core client for 30 sec - exiting 16:46:50 (5464): No heartbeat from core client for 30 sec - exiting 16:46:51 (5464): No heartbeat from core client for 30 sec - exiting 16:46:52 (5464): No heartbeat from core client for 30 sec - exiting 16:46:53 (5464): No heartbeat from core client for 30 sec - exiting 16:46:54 (5464): No heartbeat from core client for 30 sec - exiting 16:46:55 (5464): No heartbeat from core client for 30 sec - exiting 16:46:56 (5464): No heartbeat from core client for 30 sec - exiting 16:46:57 (5464): No heartbeat from core client for 30 sec - exiting 16:46:58 (5464): No heartbeat from core client for 30 sec - exiting 11:23:50 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:23:51 (5684): No heartbeat from core client for 30 sec - exiting 11:23:52 (5684): No heartbeat from core client for 30 sec - exiting 11:23:53 (5684): No heartbeat from core client for 30 sec - exiting 11:23:54 (5684): No heartbeat from core client for 30 sec - exiting 11:23:55 (5684): No heartbeat from core client for 30 sec - exiting 11:23:56 (5684): No heartbeat from core client for 30 sec - exiting 11:23:57 (5684): No heartbeat from core client for 30 sec - exiting 11:23:58 (5684): No heartbeat from core client for 30 sec - exiting 11:23:59 (5684): No heartbeat from core client for 30 sec - exiting 11:24:00 (5684): No heartbeat from core client for 30 sec - exiting 11:36:12 (7672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:53 (3484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:54 (3484): No heartbeat from core client for 30 sec - exiting 11:43:55 (3484): No heartbeat from core client for 30 sec - exiting 11:43:56 (3484): No heartbeat from core client for 30 sec - exiting 11:43:57 (3484): No heartbeat from core client for 30 sec - exiting 11:43:58 (3484): No heartbeat from core client for 30 sec - exiting 11:43:59 (3484): No heartbeat from core client for 30 sec - exiting 16:24:18 (7192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:24:19 (7192): No heartbeat from core client for 30 sec - exiting 16:24:20 (7192): No heartbeat from core client for 30 sec - exiting 16:24:21 (7192): No heartbeat from core client for 30 sec - exiting 16:24:22 (7192): No heartbeat from core client for 30 sec - exiting 16:24:23 (7192): No heartbeat from core client for 30 sec - exiting 16:24:24 (7192): No heartbeat from core client for 30 sec - exiting 16:24:25 (7192): No heartbeat from core client for 30 sec - exiting 16:24:26 (7192): No heartbeat from core client for 30 sec - exiting 16:24:27 (7192): No heartbeat from core client for 30 sec - exiting 16:24:28 (7192): No heartbeat from core client for 30 sec - exiting 02:32:57 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:58 (4316): No heartbeat from core client for 30 sec - exiting 02:32:59 (4316): No heartbeat from core client for 30 sec - exiting 02:33:00 (4316): No heartbeat from core client for 30 sec - exiting 02:33:01 (4316): No heartbeat from core client for 30 sec - exiting 02:33:02 (4316): No heartbeat from core client for 30 sec - exiting 02:33:03 (4316): No heartbeat from core client for 30 sec - exiting 02:33:04 (4316): No heartbeat from core client for 30 sec - exiting 02:33:05 (4316): No heartbeat from core client for 30 sec - exiting 02:33:06 (4316): No heartbeat from core client for 30 sec - exiting 02:33:07 (4316): No heartbeat from core client for 30 sec - exiting 17:34:39 (9284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:40 (9284): No heartbeat from core client for 30 sec - exiting 17:34:41 (9284): No heartbeat from core client for 30 sec - exiting 17:34:42 (9284): No heartbeat from core client for 30 sec - exiting 17:34:43 (9284): No heartbeat from core client for 30 sec - exiting 17:34:44 (9284): No heartbeat from core client for 30 sec - exiting 17:34:45 (9284): No heartbeat from core client for 30 sec - exiting 17:34:46 (9284): No heartbeat from core client for 30 sec - exiting 17:34:47 (9284): No heartbeat from core client for 30 sec - exiting 17:34:48 (9284): No heartbeat from core client for 30 sec - exiting 17:34:49 (9284): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:30:25 (9084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:30:26 (9084): No heartbeat from core client for 30 sec - exiting 16:30:27 (9084): No heartbeat from core client for 30 sec - exiting 16:30:28 (9084): No heartbeat from core client for 30 sec - exiting 16:30:29 (9084): No heartbeat from core client for 30 sec - exiting 16:30:30 (9084): No heartbeat from core client for 30 sec - exiting 16:30:31 (9084): No heartbeat from core client for 30 sec - exiting 16:30:32 (9084): No heartbeat from core client for 30 sec - exiting 16:30:33 (9084): No heartbeat from core client for 30 sec - exiting 16:30:34 (9084): No heartbeat from core client for 30 sec - exiting 16:30:35 (9084): No heartbeat from core client for 30 sec - exiting 17:31:42 (12312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:43 (12312): No heartbeat from core client for 30 sec - exiting 17:31:44 (12312): No heartbeat from core client for 30 sec - exiting 17:31:45 (12312): No heartbeat from core client for 30 sec - exiting 17:31:46 (12312): No heartbeat from core client for 30 sec - exiting 17:31:47 (12312): No heartbeat from core client for 30 sec - exiting 17:31:48 (12312): No heartbeat from core client for 30 sec - exiting 17:31:49 (12312): No heartbeat from core client for 30 sec - exiting 17:31:50 (12312): No heartbeat from core client for 30 sec - exiting 17:31:51 (12312): No heartbeat from core client for 30 sec - exiting 17:31:52 (12312): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7D628C91 write attempt to address 0x403D9C8A Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4880, selfPID=4880, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Oct 2012 07:02:40	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	259,200	461,993	1.7824
03 Oct 2012 14:02:29	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	233,280	414,310	1.7760
03 Oct 2012 00:29:50	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	207,360	371,507	1.7916
02 Oct 2012 10:57:26	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	181,440	328,340	1.8096
01 Oct 2012 19:46:56	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	155,520	283,136	1.8206
01 Oct 2012 05:39:44	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	129,600	236,969	1.8285
30 Sep 2012 14:17:34	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	103,680	190,722	1.8395
29 Sep 2012 21:38:57	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	77,760	143,423	1.8444
29 Sep 2012 06:15:22	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	51,840	95,847	1.8489
28 Sep 2012 12:32:06	1230450	15216949	hadcm3n_o1io_2100_40_008154527_3	25,920	48,142	1.8573