Task 12760969

Name	hadcm3n_o1or_1900_40_007197518_2
Workunit	7395798
Created	1 Apr 2011, 14:34:19 UTC
Sent	1 Apr 2011, 14:37:02 UTC
Report deadline	1 Jul 2011, 22:04:13 UTC
Received	20 Apr 2011, 16:28:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1064102
Run time	10 days 0 hours 38 min 57 sec
CPU time	9 days 7 hours 47 min 52 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	0.57 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4064, iMonCtr=1 Model crash detected, will try to restart... 07:50:01 (3524): No heartbeat from core client for 30 sec - exiting 07:50:02 (3524): No heartbeat from core client for 30 sec - exiting 07:50:03 (3524): No heartbeat from core client for 30 sec - exiting 07:50:04 (3524): No heartbeat from core client for 30 sec - exiting 07:50:05 (3524): No heartbeat from core client for 30 sec - exiting 07:50:06 (3524): No heartbeat from core client for 30 sec - exiting 07:50:07 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:26:12 (2508): No heartbeat from core client for 30 sec - exiting 16:26:13 (2508): No heartbeat from core client for 30 sec - exiting 16:26:14 (2508): No heartbeat from core client for 30 sec - exiting 16:26:15 (2508): No heartbeat from core client for 30 sec - exiting 16:26:16 (2508): No heartbeat from core client for 30 sec - exiting 16:26:17 (2508): No heartbeat from core client for 30 sec - exiting 16:26:18 (2508): No heartbeat from core client for 30 sec - exiting 16:26:19 (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:04 (1760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:37:56 (852): No heartbeat from core client for 30 sec - exiting 07:37:57 (852): No heartbeat from core client for 30 sec - exiting 07:37:58 (852): No heartbeat from core client for 30 sec - exiting 07:37:59 (852): No heartbeat from core client for 30 sec - exiting 07:38:00 (852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:49:39 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:40 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3508, iMonCtr=1 Model crash detected, will try to restart... 07:38:32 (5620): No heartbeat from core client for 30 sec - exiting 07:38:33 (5620): No heartbeat from core client for 30 sec - exiting 07:38:34 (5620): No heartbeat from core client for 30 sec - exiting 07:38:35 (5620): No heartbeat from core client for 30 sec - exiting 07:38:36 (5620): No heartbeat from core client for 30 sec - exiting 07:38:37 (5620): No heartbeat from core client for 30 sec - exiting 07:38:38 (5620): No heartbeat from core client for 30 sec - exiting 07:38:39 (5620): No heartbeat from core client for 30 sec - exiting 07:38:40 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... 07:59:32 (5628): No heartbeat from core client for 30 sec - exiting 07:59:33 (5628): No heartbeat from core client for 30 sec - exiting 07:59:34 (5628): No heartbeat from core client for 30 sec - exiting 07:59:35 (5628): No heartbeat from core client for 30 sec - exiting 07:59:36 (5628): No heartbeat from core client for 30 sec - exiting 07:59:37 (5628): No heartbeat from core client for 30 sec - exiting 07:59:38 (5628): No heartbeat from core client for 30 sec - exiting 07:59:39 (5628): No heartbeat from core client for 30 sec - exiting 07:59:40 (5628): No heartbeat from core client for 30 sec - exiting 07:59:41 (5628): No heartbeat from core client for 30 sec - exiting 07:59:42 (5628): No heartbeat from core client for 30 sec - exiting 07:59:43 (5628): No heartbeat from core client for 30 sec - exiting 07:59:44 (5628): No heartbeat from core client for 30 sec - exiting 07:59:45 (5628): No heartbeat from core client for 30 sec - exiting 07:59:46 (5628): No heartbeat from core client for 30 sec - exiting 07:59:47 (5628): No heartbeat from core client for 30 sec - exiting 07:59:48 (5628): No heartbeat from core client for 30 sec - exiting 07:59:49 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1316, iMonCtr=1 Model crash detected, will try to restart... 03:36:15 (2512): No heartbeat from core client for 30 sec - exiting 03:36:16 (2512): No heartbeat from core client for 30 sec - exiting 03:36:17 (2512): No heartbeat from core client for 30 sec - exiting 03:36:18 (2512): No heartbeat from core client for 30 sec - exiting 03:36:19 (2512): No heartbeat from core client for 30 sec - exiting 03:36:20 (2512): No heartbeat from core client for 30 sec - exiting 03:36:21 (2512): No heartbeat from core client for 30 sec - exiting 03:36:22 (2512): No heartbeat from core client for 30 sec - exiting 03:36:23 (2512): No heartbeat from core client for 30 sec - exiting 03:36:24 (2512): No heartbeat from core client for 30 sec - exiting 03:36:25 (2512): No heartbeat from core client for 30 sec - exiting 03:36:26 (2512): No heartbeat from core client for 30 sec - exiting 03:36:27 (2512): No heartbeat from core client for 30 sec - exiting 03:36:28 (2512): No heartbeat from core client for 30 sec - exiting 03:36:29 (2512): No heartbeat from core client for 30 sec - exiting 03:36:30 (2512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:41:12 (4152): No heartbeat from core client for 30 sec - exiting 07:41:13 (4152): No heartbeat from core client for 30 sec - exiting 07:41:14 (4152): No heartbeat from core client for 30 sec - exiting 07:41:15 (4152): No heartbeat from core client for 30 sec - exiting 07:41:16 (4152): No heartbeat from core client for 30 sec - exiting 07:41:17 (4152): No heartbeat from core client for 30 sec - exiting 07:41:18 (4152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77493A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2011 18:16:07	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	259,200	804,251	3.1028
20 Apr 2011 18:16:07	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	233,280	720,857	3.0901
20 Apr 2011 18:16:06	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	207,360	642,073	3.0964
12 Apr 2011 10:52:49	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	181,440	561,021	3.0920
11 Apr 2011 02:03:12	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	155,520	478,927	3.0795
10 Apr 2011 02:06:09	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	129,600	399,357	3.0815
08 Apr 2011 17:36:50	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	103,680	318,489	3.0718
07 Apr 2011 18:04:46	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	77,760	240,044	3.0870
06 Apr 2011 10:03:40	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	51,840	160,694	3.0998
04 Apr 2011 20:26:54	1064102	12760969	hadcm3n_o1or_1900_40_007197518_2	25,920	78,785	3.0395