Task 15587062

Name	hadcm3n_4au8_1940_40_008301855_0
Workunit	8452990
Created	6 Feb 2013, 16:51:45 UTC
Sent	6 Feb 2013, 16:51:57 UTC
Report deadline	9 May 2013, 0:19:08 UTC
Received	16 Mar 2013, 14:29:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1179809
Run time	4 days 17 hours 32 min 11 sec
CPU time	4 days 8 hours 31 min 37 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.05 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4520, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5452, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2000, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2000, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:10:44 (4844): No heartbeat from core client for 30 sec - exiting 06:10:45 (4844): No heartbeat from core client for 30 sec - exiting 06:10:46 (4844): No heartbeat from core client for 30 sec - exiting 06:10:47 (4844): No heartbeat from core client for 30 sec - exiting 06:10:48 (4844): No heartbeat from core client for 30 sec - exiting 06:10:49 (4844): No heartbeat from core client for 30 sec - exiting 06:10:50 (4844): No heartbeat from core client for 30 sec - exiting 06:10:51 (4844): No heartbeat from core client for 30 sec - exiting 06:10:52 (4844): No heartbeat from core client for 30 sec - exiting 06:10:54 (4844): No heartbeat from core client for 30 sec - exiting 06:10:55 (4844): No heartbeat from core client for 30 sec - exiting 06:10:56 (4844): No heartbeat from core client for 30 sec - exiting 06:10:57 (4844): No heartbeat from core client for 30 sec - exiting 06:10:58 (4844): No heartbeat from core client for 30 sec - exiting 06:10:59 (4844): No heartbeat from core client for 30 sec - exiting 06:11:00 (4844): No heartbeat from core client for 30 sec - exiting 06:11:01 (4844): No heartbeat from core client for 30 sec - exiting 06:11:02 (4844): No heartbeat from core client for 30 sec - exiting 06:11:03 (4844): No heartbeat from core client for 30 sec - exiting 06:11:05 (4844): No heartbeat from core client for 30 sec - exiting 06:11:06 (4844): No heartbeat from core client for 30 sec - exiting 06:11:07 (4844): No heartbeat from core client for 30 sec - exiting 06:11:08 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5040, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=108, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1176, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1176, iMonCtr=1 Model crash detected, will try to restart... 07:03:50 (5560): No heartbeat from core client for 30 sec - exiting 07:03:51 (5560): No heartbeat from core client for 30 sec - exiting 07:03:53 (5560): No heartbeat from core client for 30 sec - exiting 07:03:54 (5560): No heartbeat from core client for 30 sec - exiting 07:03:55 (5560): No heartbeat from core client for 30 sec - exiting 07:03:56 (5560): No heartbeat from core client for 30 sec - exiting 07:03:57 (5560): No heartbeat from core client for 30 sec - exiting 07:03:58 (5560): No heartbeat from core client for 30 sec - exiting 07:03:59 (5560): No heartbeat from core client for 30 sec - exiting 07:04:00 (5560): No heartbeat from core client for 30 sec - exiting 07:04:01 (5560): No heartbeat from core client for 30 sec - exiting 07:04:03 (5560): No heartbeat from core client for 30 sec - exiting 07:04:04 (5560): No heartbeat from core client for 30 sec - exiting 07:04:05 (5560): No heartbeat from core client for 30 sec - exiting 07:04:06 (5560): No heartbeat from core client for 30 sec - exiting 07:04:07 (5560): No heartbeat from core client for 30 sec - exiting 07:04:08 (5560): No heartbeat from core client for 30 sec - exiting 07:04:09 (5560): No heartbeat from core client for 30 sec - exiting 07:04:10 (5560): No heartbeat from core client for 30 sec - exiting 07:04:11 (5560): No heartbeat from core client for 30 sec - exiting 07:04:12 (5560): No heartbeat from core client for 30 sec - exiting 07:04:14 (5560): No heartbeat from core client for 30 sec - exiting 07:04:15 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2780, iMonCtr=1 Model crash detected, will try to restart... 06:09:34 (2384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D3C3EB write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D65EAB read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Mar 2013 13:40:10	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	259,200	359,171	1.3857
13 Mar 2013 14:40:22	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	233,280	323,681	1.3875
01 Mar 2013 14:45:44	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	207,360	287,509	1.3865
26 Feb 2013 16:46:06	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	181,440	251,782	1.3877
23 Feb 2013 15:00:35	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	155,520	215,390	1.3850
20 Feb 2013 17:46:31	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	129,600	180,118	1.3898
18 Feb 2013 15:40:40	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	103,680	144,459	1.3933
14 Feb 2013 17:00:57	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	77,760	108,544	1.3959
12 Feb 2013 15:46:20	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	51,840	73,434	1.4166
08 Feb 2013 18:06:45	1179809	15587062	hadcm3n_4au8_1940_40_008301855_0	25,920	35,494	1.3694