Task 13411165

Name	hadcm3n_u2um_1980_40_007460109_0
Workunit	7657612
Created	22 Sep 2011, 22:29:22 UTC
Sent	24 Sep 2011, 8:06:12 UTC
Report deadline	24 Dec 2011, 15:33:23 UTC
Received	9 Oct 2011, 7:53:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1163616
Run time	7 days 2 hours 32 min 37 sec
CPU time	6 days 21 hours 11 min 59 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:50:53 (6440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:50:54 (6440): No heartbeat from core client for 30 sec - exiting 21:50:56 (6440): No heartbeat from core client for 30 sec - exiting 21:50:57 (6440): No heartbeat from core client for 30 sec - exiting 21:50:58 (6440): No heartbeat from core client for 30 sec - exiting 21:50:59 (6440): No heartbeat from core client for 30 sec - exiting 21:51:00 (6440): No heartbeat from core client for 30 sec - exiting 21:51:01 (6440): No heartbeat from core client for 30 sec - exiting 21:51:02 (6440): No heartbeat from core client for 30 sec - exiting 21:51:03 (6440): No heartbeat from core client for 30 sec - exiting 21:51:04 (6440): No heartbeat from core client for 30 sec - exiting 21:51:05 (6440): No heartbeat from core client for 30 sec - exiting 21:51:06 (6440): No heartbeat from core client for 30 sec - exiting 21:51:08 (6440): No heartbeat from core client for 30 sec - exiting 21:51:09 (6440): No heartbeat from core client for 30 sec - exiting 21:51:10 (6440): No heartbeat from core client for 30 sec - exiting 21:51:11 (6440): No heartbeat from core client for 30 sec - exiting 21:51:12 (6440): No heartbeat from core client for 30 sec - exiting 21:51:13 (6440): No heartbeat from core client for 30 sec - exiting 21:51:14 (6440): No heartbeat from core client for 30 sec - exiting 21:51:15 (6440): No heartbeat from core client for 30 sec - exiting 21:51:16 (6440): No heartbeat from core client for 30 sec - exiting 21:51:17 (6440): No heartbeat from core client for 30 sec - exiting 21:51:18 (6440): No heartbeat from core client for 30 sec - exiting 21:51:20 (6440): No heartbeat from core client for 30 sec - exiting 21:51:21 (6440): No heartbeat from core client for 30 sec - exiting 21:51:22 (6440): No heartbeat from core client for 30 sec - exiting 21:51:23 (6440): No heartbeat from core client for 30 sec - exiting 21:51:24 (6440): No heartbeat from core client for 30 sec - exiting 21:51:25 (6440): No heartbeat from core client for 30 sec - exiting 21:51:26 (6440): No heartbeat from core client for 30 sec - exiting 21:51:27 (6440): No heartbeat from core client for 30 sec - exiting 21:51:28 (6440): No heartbeat from core client for 30 sec - exiting 21:51:29 (6440): No heartbeat from core client for 30 sec - exiting 21:51:30 (6440): No heartbeat from core client for 30 sec - exiting 21:51:32 (6440): No heartbeat from core client for 30 sec - exiting 21:51:33 (6440): No heartbeat from core client for 30 sec - exiting 21:51:34 (6440): No heartbeat from core client for 30 sec - exiting 21:51:35 (6440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 10:33:44 (7392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:34:01 (7392): No heartbeat from core client for 30 sec - exiting 10:34:02 (7392): No heartbeat from core client for 30 sec - exiting 10:34:04 (7392): No heartbeat from core client for 30 sec - exiting 10:34:05 (7392): No heartbeat from core client for 30 sec - exiting 10:34:06 (7392): No heartbeat from core client for 30 sec - exiting 10:34:07 (7392): No heartbeat from core client for 30 sec - exiting 10:34:08 (7392): No heartbeat from core client for 30 sec - exiting 10:34:09 (7392): No heartbeat from core client for 30 sec - exiting 10:34:10 (7392): No heartbeat from core client for 30 sec - exiting 10:34:11 (7392): No heartbeat from core client for 30 sec - exiting 11:04:45 (9200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:04:59 (9200): No heartbeat from core client for 30 sec - exiting 11:05:01 (9200): No heartbeat from core client for 30 sec - exiting 11:05:02 (9200): No heartbeat from core client for 30 sec - exiting 11:05:03 (9200): No heartbeat from core client for 30 sec - exiting 11:05:04 (9200): No heartbeat from core client for 30 sec - exiting 11:05:05 (9200): No heartbeat from core client for 30 sec - exiting 11:05:06 (9200): No heartbeat from core client for 30 sec - exiting 11:05:07 (9200): No heartbeat from core client for 30 sec - exiting 11:05:08 (9200): No heartbeat from core client for 30 sec - exiting 11:05:09 (9200): No heartbeat from core client for 30 sec - exiting 13:12:59 (8596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:08:19 (6828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:24:35 (10396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:20 (8692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:07 (8692): No heartbeat from core client for 30 sec - exiting 15:50:09 (8692): No heartbeat from core client for 30 sec - exiting 15:50:10 (8692): No heartbeat from core client for 30 sec - exiting 15:50:11 (8692): No heartbeat from core client for 30 sec - exiting 15:50:12 (8692): No heartbeat from core client for 30 sec - exiting 15:50:13 (8692): No heartbeat from core client for 30 sec - exiting 15:50:14 (8692): No heartbeat from core client for 30 sec - exiting 15:50:15 (8692): No heartbeat from core client for 30 sec - exiting 15:50:16 (8692): No heartbeat from core client for 30 sec - exiting 15:50:17 (8692): No heartbeat from core client for 30 sec - exiting 20:28:59 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:10 (944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:23 (944): No heartbeat from core client for 30 sec - exiting 20:47:24 (944): No heartbeat from core client for 30 sec - exiting 20:47:26 (944): No heartbeat from core client for 30 sec - exiting 20:47:27 (944): No heartbeat from core client for 30 sec - exiting 20:47:28 (944): No heartbeat from core client for 30 sec - exiting 20:47:29 (944): No heartbeat from core client for 30 sec - exiting 20:47:30 (944): No heartbeat from core client for 30 sec - exiting 20:47:31 (944): No heartbeat from core client for 30 sec - exiting 20:47:32 (944): No heartbeat from core client for 30 sec - exiting 20:47:33 (944): No heartbeat from core client for 30 sec - exiting 10:05:40 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:53 (4556): No heartbeat from core client for 30 sec - exiting 10:05:54 (4556): No heartbeat from core client for 30 sec - exiting 10:05:55 (4556): No heartbeat from core client for 30 sec - exiting 10:05:56 (4556): No heartbeat from core client for 30 sec - exiting 10:05:57 (4556): No heartbeat from core client for 30 sec - exiting 10:05:58 (4556): No heartbeat from core client for 30 sec - exiting 10:05:59 (4556): No heartbeat from core client for 30 sec - exiting 10:06:00 (4556): No heartbeat from core client for 30 sec - exiting 10:06:01 (4556): No heartbeat from core client for 30 sec - exiting 10:06:03 (4556): No heartbeat from core client for 30 sec - exiting 10:36:33 (7412): No heartbeat from core client for 30 sec - exiting 10:36:41 (7412): No heartbeat from core client for 30 sec - exiting 10:36:42 (7412): No heartbeat from core client for 30 sec - exiting 10:36:43 (7412): No heartbeat from core client for 30 sec - exiting 10:36:44 (7412): No heartbeat from core client for 30 sec - exiting 10:36:45 (7412): No heartbeat from core client for 30 sec - exiting 10:36:46 (7412): No heartbeat from core client for 30 sec - exiting 10:36:47 (7412): No heartbeat from core client for 30 sec - exiting 10:36:48 (7412): No heartbeat from core client for 30 sec - exiting 10:36:49 (7412): No heartbeat from core client for 30 sec - exiting 10:36:50 (7412): No heartbeat from core client for 30 sec - exiting 10:36:51 (7412): No heartbeat from core client for 30 sec - exiting 10:36:53 (7412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:54:33 (2176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:03 (140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:49 (1672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:52 (1672): No heartbeat from core client for 30 sec - exiting 19:03:53 (1672): No heartbeat from core client for 30 sec - exiting 19:03:54 (1672): No heartbeat from core client for 30 sec - exiting 19:04:33 (6800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:52 (6800): No heartbeat from core client for 30 sec - exiting 19:04:53 (6800): No heartbeat from core client for 30 sec - exiting 19:04:54 (6800): No heartbeat from core client for 30 sec - exiting 19:04:55 (6800): No heartbeat from core client for 30 sec - exiting 19:04:56 (6800): No heartbeat from core client for 30 sec - exiting 19:04:57 (6800): No heartbeat from core client for 30 sec - exiting 19:04:58 (6800): No heartbeat from core client for 30 sec - exiting 19:04:59 (6800): No heartbeat from core client for 30 sec - exiting 19:05:00 (6800): No heartbeat from core client for 30 sec - exiting 19:05:02 (6800): No heartbeat from core client for 30 sec - exiting 19:05:44 (8988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:59 (8988): No heartbeat from core client for 30 sec - exiting 19:06:00 (8988): No heartbeat from core client for 30 sec - exiting 19:06:01 (8988): No heartbeat from core client for 30 sec - exiting 19:06:48 (10876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:25:54 (2860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:26:32 (2860): No heartbeat from core client for 30 sec - exiting 23:26:33 (2860): No heartbeat from core client for 30 sec - exiting 23:26:35 (2860): No heartbeat from core client for 30 sec - exiting 23:26:36 (2860): No heartbeat from core client for 30 sec - exiting 23:26:37 (2860): No heartbeat from core client for 30 sec - exiting 23:26:38 (2860): No heartbeat from core client for 30 sec - exiting 23:26:39 (2860): No heartbeat from core client for 30 sec - exiting 23:26:40 (2860): No heartbeat from core client for 30 sec - exiting 23:26:41 (2860): No heartbeat from core client for 30 sec - exiting 23:26:42 (2860): No heartbeat from core client for 30 sec - exiting 23:26:43 (2860): No heartbeat from core client for 30 sec - exiting 23:26:44 (2860): No heartbeat from core client for 30 sec - exiting 23:26:45 (2860): No heartbeat from core client for 30 sec - exiting 23:26:47 (2860): No heartbeat from core client for 30 sec - exiting 23:26:48 (2860): No heartbeat from core client for 30 sec - exiting 23:26:49 (2860): No heartbeat from core client for 30 sec - exiting 23:26:50 (2860): No heartbeat from core client for 30 sec - exiting 23:26:51 (2860): No heartbeat from core client for 30 sec - exiting 23:26:52 (2860): No heartbeat from core client for 30 sec - exiting 23:26:53 (2860): No heartbeat from core client for 30 sec - exiting 23:26:54 (2860): No heartbeat from core client for 30 sec - exiting 23:26:55 (2860): No heartbeat from core client for 30 sec - exiting 23:26:56 (2860): No heartbeat from core client for 30 sec - exiting 23:26:58 (2860): No heartbeat from core client for 30 sec - exiting 23:26:59 (2860): No heartbeat from core client for 30 sec - exiting 23:27:00 (2860): No heartbeat from core client for 30 sec - exiting 23:27:01 (2860): No heartbeat from core client for 30 sec - exiting 23:27:02 (2860): No heartbeat from core client for 30 sec - exiting 23:27:03 (2860): No heartbeat from core client for 30 sec - exiting 23:27:04 (2860): No heartbeat from core client for 30 sec - exiting 23:27:05 (2860): No heartbeat from core client for 30 sec - exiting 23:27:06 (2860): No heartbeat from core client for 30 sec - exiting 23:27:07 (2860): No heartbeat from core client for 30 sec - exiting 23:27:08 (2860): No heartbeat from core client for 30 sec - exiting 23:27:10 (2860): No heartbeat from core client for 30 sec - exiting 23:27:11 (2860): No heartbeat from core client for 30 sec - exiting 23:27:12 (2860): No heartbeat from core client for 30 sec - exiting 23:27:13 (2860): No heartbeat from core client for 30 sec - exiting 23:27:14 (2860): No heartbeat from core client for 30 sec - exiting 23:27:15 (2860): No heartbeat from core client for 30 sec - exiting 23:27:16 (2860): No heartbeat from core client for 30 sec - exiting 23:27:17 (2860): No heartbeat from core client for 30 sec - exiting 23:27:18 (2860): No heartbeat from core client for 30 sec - exiting 23:27:19 (2860): No heartbeat from core client for 30 sec - exiting 23:27:20 (2860): No heartbeat from core client for 30 sec - exiting 23:27:22 (2860): No heartbeat from core client for 30 sec - exiting 23:27:23 (2860): No heartbeat from core client for 30 sec - exiting 23:27:24 (2860): No heartbeat from core client for 30 sec - exiting 23:27:25 (2860): No heartbeat from core client for 30 sec - exiting 23:27:26 (2860): No heartbeat from core client for 30 sec - exiting 23:27:27 (2860): No heartbeat from core client for 30 sec - exiting 23:27:28 (2860): No heartbeat from core client for 30 sec - exiting 23:27:29 (2860): No heartbeat from core client for 30 sec - exiting 23:27:30 (2860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:15:28 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:42 (5336): No heartbeat from core client for 30 sec - exiting 09:15:43 (5336): No heartbeat from core client for 30 sec - exiting 09:15:44 (5336): No heartbeat from core client for 30 sec - exiting 09:15:45 (5336): No heartbeat from core client for 30 sec - exiting 09:15:46 (5336): No heartbeat from core client for 30 sec - exiting 09:15:47 (5336): No heartbeat from core client for 30 sec - exiting 09:15:49 (5336): No heartbeat from core client for 30 sec - exiting 09:15:50 (5336): No heartbeat from core client for 30 sec - exiting 09:42:27 (7952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:07:54 (7668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:07:58 (7668): No heartbeat from core client for 30 sec - exiting 10:08:00 (7668): No heartbeat from core client for 30 sec - exiting 10:08:01 (7668): No heartbeat from core client for 30 sec - exiting 10:08:02 (7668): No heartbeat from core client for 30 sec - exiting 10:08:03 (7668): No heartbeat from core client for 30 sec - exiting 10:08:04 (7668): No heartbeat from core client for 30 sec - exiting 10:08:05 (7668): No heartbeat from core client for 30 sec - exiting 10:08:06 (7668): No heartbeat from core client for 30 sec - exiting 10:08:07 (7668): No heartbeat from core client for 30 sec - exiting 10:08:08 (7668): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6008, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 08:47:37 (7524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:18:16 (6956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Oct 2011 22:27:16	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	259,200	594,685	2.2943
07 Oct 2011 20:35:40	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	233,280	533,881	2.2886
06 Oct 2011 13:03:46	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	207,360	474,405	2.2878
04 Oct 2011 09:12:11	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	181,440	415,954	2.2925
02 Oct 2011 20:51:21	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	155,520	357,041	2.2958
30 Sep 2011 17:35:10	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	129,600	298,407	2.3025
29 Sep 2011 11:58:34	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	103,680	238,756	2.3028
28 Sep 2011 10:04:53	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	77,760	180,274	2.3183
26 Sep 2011 17:28:12	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	51,840	120,714	2.3286
25 Sep 2011 15:44:58	1163616	13411165	hadcm3n_u2um_1980_40_007460109_0	25,920	60,316	2.3270