Task 15559164

Name	hadcm3n_n033_1880_40_008285433_1
Workunit	8436568
Created	27 Jan 2013, 6:53:44 UTC
Sent	27 Jan 2013, 6:53:55 UTC
Report deadline	28 Apr 2013, 14:21:06 UTC
Received	8 Mar 2013, 22:36:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1208755
Run time	11 days 22 hours 23 min 5 sec
CPU time	10 days 22 hours 7 min 20 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5988, selfPID=5988, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=996, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=996, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=996, iMonCtr=1 Model crash detected, will try to restart... 06:12:54 (3460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4376, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4376, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4376, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3960, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2456, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3556, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2184, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5440, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:43:34 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1568, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BB3AB3 read attempt to address 0x40417ED4 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2013 22:39:38	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	1,036,800	943,634	0.9101
08 Mar 2013 04:55:12	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	1,010,880	920,238	0.9103
07 Mar 2013 21:52:28	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	984,960	895,956	0.9096
07 Mar 2013 05:49:40	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	959,040	872,029	0.9093
06 Mar 2013 16:45:49	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	933,120	847,818	0.9086
06 Mar 2013 06:40:19	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	907,200	822,315	0.9064
05 Mar 2013 23:13:31	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	881,280	797,123	0.9045
05 Mar 2013 08:35:50	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	855,360	772,071	0.9026
05 Mar 2013 00:18:16	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	829,440	747,216	0.9009
04 Mar 2013 06:27:52	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	803,520	724,874	0.9021
03 Mar 2013 23:05:29	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	777,600	699,975	0.9002
03 Mar 2013 09:46:07	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	751,680	675,445	0.8986
01 Mar 2013 10:57:58	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	725,760	651,567	0.8978
27 Feb 2013 13:55:17	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	699,840	628,188	0.8976
27 Feb 2013 06:36:18	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	673,920	604,943	0.8976
26 Feb 2013 07:39:58	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	648,000	582,046	0.8982
25 Feb 2013 07:24:17	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	622,080	559,105	0.8988
22 Feb 2013 08:57:01	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	596,160	535,722	0.8986
20 Feb 2013 11:48:41	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	570,240	512,558	0.8988
19 Feb 2013 16:36:08	1208755	15559164	hadcm3n_n033_1880_40_008285433_1	544,320	489,885	0.9000