Task 15810170

Name	hadcm3n_o1g2_1940_40_008379269_0
Workunit	8530128
Created	31 May 2013, 17:32:26 UTC
Sent	18 Jun 2013, 17:51:56 UTC
Report deadline	18 Sep 2013, 1:19:07 UTC
Received	18 Jul 2013, 11:45:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1177120
Run time	7 days 12 hours 39 min 55 sec
CPU time	6 days 16 hours 22 min 56 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 10:56:14 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:56:17 (6380): No heartbeat from core client for 30 sec - exiting 10:56:18 (6380): No heartbeat from core client for 30 sec - exiting 10:56:19 (6380): No heartbeat from core client for 30 sec - exiting 10:56:20 (6380): No heartbeat from core client for 30 sec - exiting 11:58:01 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:03 (4264): No heartbeat from core client for 30 sec - exiting 13:00:01 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:02 (3660): No heartbeat from core client for 30 sec - exiting 13:00:03 (3660): No heartbeat from core client for 30 sec - exiting 13:00:04 (3660): No heartbeat from core client for 30 sec - exiting 13:19:50 (7468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:53 (7468): No heartbeat from core client for 30 sec - exiting 13:19:54 (7468): No heartbeat from core client for 30 sec - exiting 13:19:55 (7468): No heartbeat from core client for 30 sec - exiting 13:56:30 (8072): No heartbeat from core client for 30 sec - exiting 13:56:33 (8072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:56:34 (8072): No heartbeat from core client for 30 sec - exiting 13:56:35 (8072): No heartbeat from core client for 30 sec - exiting 13:56:36 (8072): No heartbeat from core client for 30 sec - exiting 13:56:37 (8072): No heartbeat from core client for 30 sec - exiting 15:02:12 (8080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:02:13 (8080): No heartbeat from core client for 30 sec - exiting 15:02:14 (8080): No heartbeat from core client for 30 sec - exiting 15:02:15 (8080): No heartbeat from core client for 30 sec - exiting 15:02:16 (8080): No heartbeat from core client for 30 sec - exiting 15:21:42 (7296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:04:35 (8052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:04:37 (8052): No heartbeat from core client for 30 sec - exiting 16:04:38 (8052): No heartbeat from core client for 30 sec - exiting 17:06:52 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:06:54 (4384): No heartbeat from core client for 30 sec - exiting 18:09:00 (2332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:01 (2332): No heartbeat from core client for 30 sec - exiting 18:55:44 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:55:46 (3940): No heartbeat from core client for 30 sec - exiting 20:10:59 (2564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:01 (2564): No heartbeat from core client for 30 sec - exiting 20:11:02 (2564): No heartbeat from core client for 30 sec - exiting 21:13:21 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:23 (3808): No heartbeat from core client for 30 sec - exiting 22:15:27 (7532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:15:28 (7532): No heartbeat from core client for 30 sec - exiting 22:15:29 (7532): No heartbeat from core client for 30 sec - exiting 22:15:30 (7532): No heartbeat from core client for 30 sec - exiting 22:34:29 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:39 (3288): No heartbeat from core client for 30 sec - exiting 22:34:40 (3288): No heartbeat from core client for 30 sec - exiting 22:34:42 (3288): No heartbeat from core client for 30 sec - exiting 22:34:44 (3288): No heartbeat from core client for 30 sec - exiting 22:34:45 (3288): No heartbeat from core client for 30 sec - exiting 22:34:46 (3288): No heartbeat from core client for 30 sec - exiting 22:34:47 (3288): No heartbeat from core client for 30 sec - exiting 22:34:48 (3288): No heartbeat from core client for 30 sec - exiting 22:34:49 (3288): No heartbeat from core client for 30 sec - exiting 22:34:50 (3288): No heartbeat from core client for 30 sec - exiting 22:34:51 (3288): No heartbeat from core client for 30 sec - exiting 22:34:52 (3288): No heartbeat from core client for 30 sec - exiting 23:52:46 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:52:47 (4832): No heartbeat from core client for 30 sec - exiting 00:18:16 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:18 (4116): No heartbeat from core client for 30 sec - exiting 00:18:19 (4116): No heartbeat from core client for 30 sec - exiting 00:18:20 (4116): No heartbeat from core client for 30 sec - exiting 00:18:21 (4116): No heartbeat from core client for 30 sec - exiting 00:18:22 (4116): No heartbeat from core client for 30 sec - exiting 00:18:23 (4116): No heartbeat from core client for 30 sec - exiting 00:18:24 (4116): No heartbeat from core client for 30 sec - exiting 00:54:48 (6612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:50 (6612): No heartbeat from core client for 30 sec - exiting 00:54:51 (6612): No heartbeat from core client for 30 sec - exiting 01:14:14 (6180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:21 (6180): No heartbeat from core client for 30 sec - exiting 01:14:23 (6180): No heartbeat from core client for 30 sec - exiting 01:14:24 (6180): No heartbeat from core client for 30 sec - exiting 01:14:25 (6180): No heartbeat from core client for 30 sec - exiting 01:14:26 (6180): No heartbeat from core client for 30 sec - exiting 01:14:27 (6180): No heartbeat from core client for 30 sec - exiting 01:14:28 (6180): No heartbeat from core client for 30 sec - exiting 01:14:30 (6180): No heartbeat from core client for 30 sec - exiting 01:14:31 (6180): No heartbeat from core client for 30 sec - exiting 01:14:32 (6180): No heartbeat from core client for 30 sec - exiting 01:14:33 (6180): No heartbeat from core client for 30 sec - exiting 01:14:34 (6180): No heartbeat from core client for 30 sec - exiting 01:35:32 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:34 (5632): No heartbeat from core client for 30 sec - exiting 01:57:26 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:57:28 (5428): No heartbeat from core client for 30 sec - exiting 01:57:29 (5428): No heartbeat from core client for 30 sec - exiting 02:20:46 (8176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:38:16 (7896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:58:57 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:59:01 (4000): No heartbeat from core client for 30 sec - exiting 02:59:02 (4000): No heartbeat from core client for 30 sec - exiting 02:59:03 (4000): No heartbeat from core client for 30 sec - exiting 03:22:00 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:22:01 (2968): No heartbeat from core client for 30 sec - exiting 04:09:44 (6984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:09:46 (6984): No heartbeat from core client for 30 sec - exiting 04:59:53 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:59:55 (5300): No heartbeat from core client for 30 sec - exiting 06:24:27 (7556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:28 (7556): No heartbeat from core client for 30 sec - exiting 06:43:20 (2944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:43:32 (2944): No heartbeat from core client for 30 sec - exiting 06:43:34 (2944): No heartbeat from core client for 30 sec - exiting 06:43:35 (2944): No heartbeat from core client for 30 sec - exiting 06:43:36 (2944): No heartbeat from core client for 30 sec - exiting 06:43:37 (2944): No heartbeat from core client for 30 sec - exiting 06:43:38 (2944): No heartbeat from core client for 30 sec - exiting 06:43:39 (2944): No heartbeat from core client for 30 sec - exiting 06:43:40 (2944): No heartbeat from core client for 30 sec - exiting 06:43:41 (2944): No heartbeat from core client for 30 sec - exiting 06:43:42 (2944): No heartbeat from core client for 30 sec - exiting 06:43:43 (2944): No heartbeat from core client for 30 sec - exiting 06:43:44 (2944): No heartbeat from core client for 30 sec - exiting 07:03:57 (6748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:04:03 (6748): No heartbeat from core client for 30 sec - exiting 07:04:04 (6748): No heartbeat from core client for 30 sec - exiting 07:04:05 (6748): No heartbeat from core client for 30 sec - exiting 07:04:06 (6748): No heartbeat from core client for 30 sec - exiting 07:04:07 (6748): No heartbeat from core client for 30 sec - exiting 07:04:08 (6748): No heartbeat from core client for 30 sec - exiting 07:04:09 (6748): No heartbeat from core client for 30 sec - exiting 07:04:10 (6748): No heartbeat from core client for 30 sec - exiting 07:04:11 (6748): No heartbeat from core client for 30 sec - exiting 07:04:12 (6748): No heartbeat from core client for 30 sec - exiting 07:04:13 (6748): No heartbeat from core client for 30 sec - exiting 07:04:14 (6748): No heartbeat from core client for 30 sec - exiting 07:26:02 (912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:04 (912): No heartbeat from core client for 30 sec - exiting 07:26:05 (912): No heartbeat from core client for 30 sec - exiting 07:26:06 (912): No heartbeat from core client for 30 sec - exiting 07:26:07 (912): No heartbeat from core client for 30 sec - exiting 07:26:08 (912): No heartbeat from core client for 30 sec - exiting 07:26:09 (912): No heartbeat from core client for 30 sec - exiting 07:26:10 (912): No heartbeat from core client for 30 sec - exiting 07:26:11 (912): No heartbeat from core client for 30 sec - exiting 07:26:12 (912): No heartbeat from core client for 30 sec - exiting 07:26:13 (912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:36:37 (1868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:42 (1868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:48:31 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:36 (5088): No heartbeat from core client for 30 sec - exiting 17:48:38 (5088): No heartbeat from core client for 30 sec - exiting 17:48:39 (5088): No heartbeat from core client for 30 sec - exiting 17:48:40 (5088): No heartbeat from core client for 30 sec - exiting 17:48:41 (5088): No heartbeat from core client for 30 sec - exiting 17:48:42 (5088): No heartbeat from core client for 30 sec - exiting 17:48:43 (5088): No heartbeat from core client for 30 sec - exiting 17:48:44 (5088): No heartbeat from core client for 30 sec - exiting 17:48:45 (5088): No heartbeat from core client for 30 sec - exiting 17:48:46 (5088): No heartbeat from core client for 30 sec - exiting 17:48:47 (5088): No heartbeat from core client for 30 sec - exiting 17:48:48 (5088): No heartbeat from core client for 30 sec - exiting 17:48:49 (5088): No heartbeat from core client for 30 sec - exiting 17:48:50 (5088): No heartbeat from core client for 30 sec - exiting 17:48:51 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:04:02 (1640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:06 (1640): No heartbeat from core client for 30 sec - exiting 23:04:07 (1640): No heartbeat from core client for 30 sec - exiting 23:04:10 (1640): No heartbeat from core client for 30 sec - exiting 23:04:12 (1640): No heartbeat from core client for 30 sec - exiting 23:04:14 (1640): No heartbeat from core client for 30 sec - exiting 23:04:15 (1640): No heartbeat from core client for 30 sec - exiting 23:04:16 (1640): No heartbeat from core client for 30 sec - exiting 23:04:17 (1640): No heartbeat from core client for 30 sec - exiting 23:04:18 (1640): No heartbeat from core client for 30 sec - exiting 23:04:19 (1640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:19:37 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:19:38 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x779F3AB3 read attempt to address 0x4087D658 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1g2_1940_40_008379269/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 15:13:06	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	259,200	577,374	2.2275
10 Jul 2013 10:11:12	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	233,280	527,702	2.2621
09 Jul 2013 02:05:08	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	207,360	471,569	2.2742
06 Jul 2013 19:08:21	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	181,440	418,274	2.3053
04 Jul 2013 14:02:12	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	155,520	358,469	2.3050
02 Jul 2013 13:19:46	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	129,600	308,165	2.3778
02 Jul 2013 10:05:59	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	103,680	254,296	2.4527
26 Jun 2013 04:17:34	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	77,760	202,211	2.6005
20 Jun 2013 15:00:50	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	51,840	122,012	2.3536
19 Jun 2013 17:13:55	1177120	15810170	hadcm3n_o1g2_1940_40_008379269_0	25,920	56,302	2.1721