Task 15633396

Name	hadcm3n_38vv_1980_40_008318891_1
Workunit	8470026
Created	24 Feb 2013, 8:21:00 UTC
Sent	24 Feb 2013, 8:23:10 UTC
Report deadline	26 May 2013, 15:50:21 UTC
Received	17 Mar 2013, 8:20:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1081404
Run time	6 days 23 hours 56 min 33 sec
CPU time	6 days 4 hours 12 min 50 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.66 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.56</core_client_version> <![CDATA[ <message> 8? - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:36:07 (552): No heartbeat from core client for 30 sec - exiting 21:36:08 (552): No heartbeat from core client for 30 sec - exiting 21:36:09 (552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:38:38 (2940): No heartbeat from core client for 30 sec - exiting 07:38:40 (2940): No heartbeat from core client for 30 sec - exiting 07:38:41 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:56:01 (4128): No heartbeat from core client for 30 sec - exiting 21:56:02 (4128): No heartbeat from core client for 30 sec - exiting 21:56:03 (4128): No heartbeat from core client for 30 sec - exiting 21:56:05 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:59:10 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:33:03 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:10:48 (2456): No heartbeat from core client for 30 sec - exiting 22:10:49 (2456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:51 (2456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:48:02 (960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:20:45 (4672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:53:56 (744): No heartbeat from core client for 30 sec - exiting 09:53:57 (744): No heartbeat from core client for 30 sec - exiting 09:53:58 (744): No heartbeat from core client for 30 sec - exiting 09:53:59 (744): No heartbeat from core client for 30 sec - exiting 09:54:00 (744): No heartbeat from core client for 30 sec - exiting 09:54:01 (744): No heartbeat from core client for 30 sec - exiting 09:54:03 (744): No heartbeat from core client for 30 sec - exiting 09:54:04 (744): No heartbeat from core client for 30 sec - exiting 09:54:05 (744): No heartbeat from core client for 30 sec - exiting 09:54:06 (744): No heartbeat from core client for 30 sec - exiting 09:54:07 (744): No heartbeat from core client for 30 sec - exiting 09:54:08 (744): No heartbeat from core client for 30 sec - exiting 09:54:09 (744): No heartbeat from core client for 30 sec - exiting 09:54:10 (744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:54:47 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:47:56 (4008): No heartbeat from core client for 30 sec - exiting 16:47:57 (4008): No heartbeat from core client for 30 sec - exiting 16:47:58 (4008): No heartbeat from core client for 30 sec - exiting 16:48:00 (4008): No heartbeat from core client for 30 sec - exiting 16:48:01 (4008): No heartbeat from core client for 30 sec - exiting 16:48:02 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:06:03 (4464): No heartbeat from core client for 30 sec - exiting 17:06:05 (4464): No heartbeat from core client for 30 sec - exiting 17:06:06 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:25:51 (2212): No heartbeat from core client for 30 sec - exiting 18:25:53 (2212): No heartbeat from core client for 30 sec - exiting 18:25:54 (2212): No heartbeat from core client for 30 sec - exiting 18:25:55 (2212): No heartbeat from core client for 30 sec - exiting 18:25:56 (2212): No heartbeat from core client for 30 sec - exiting 18:25:57 (2212): No heartbeat from core client for 30 sec - exiting 18:25:58 (2212): No heartbeat from core client for 30 sec - exiting 18:25:59 (2212): No heartbeat from core client for 30 sec - exiting 18:26:00 (2212): No heartbeat from core client for 30 sec - exiting 18:26:01 (2212): No heartbeat from core client for 30 sec - exiting 18:26:03 (2212): No heartbeat from core client for 30 sec - exiting 18:26:04 (2212): No heartbeat from core client for 30 sec - exiting 18:26:05 (2212): No heartbeat from core client for 30 sec - exiting 18:26:06 (2212): No heartbeat from core client for 30 sec - exiting 18:26:07 (2212): No heartbeat from core client for 30 sec - exiting 18:26:08 (2212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:26:44 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:15 (1740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:49:41 (4404): No heartbeat from core client for 30 sec - exiting 18:49:42 (4404): No heartbeat from core client for 30 sec - exiting 18:49:43 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:15:15 (2520): No heartbeat from core client for 30 sec - exiting 19:15:16 (2520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:46:11 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:46:55 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:00:06 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:33:41 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:50:04 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:53:52 (1424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:52:43 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:11:16 (2100): No heartbeat from core client for 30 sec - exiting 21:11:17 (2100): No heartbeat from core client for 30 sec - exiting 21:11:19 (2100): No heartbeat from core client for 30 sec - exiting 21:11:20 (2100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:02 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:31:56 (1524): No heartbeat from core client for 30 sec - exiting 07:31:57 (1524): No heartbeat from core client for 30 sec - exiting 07:31:58 (1524): No heartbeat from core client for 30 sec - exiting 07:31:59 (1524): No heartbeat from core client for 30 sec - exiting 07:32:00 (1524): No heartbeat from core client for 30 sec - exiting 07:32:01 (1524): No heartbeat from core client for 30 sec - exiting 07:32:02 (1524): No heartbeat from core client for 30 sec - exiting 07:32:03 (1524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:06:00 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:49:34 (140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:24:15 (1596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:35:37 (3812): No heartbeat from core client for 30 sec - exiting 07:35:38 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:14:23 (4388): No heartbeat from core client for 30 sec - exiting 22:14:24 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:39:26 (1260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:00:18 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:57:40 (3416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:23 (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:05:09 (1368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7703FF2B write attempt to address 0x40964B92 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77223AB3 read attempt to address 0x40964B9A Engaging BOINC Windows Runtime Debugger... Cannot serialize file K:\BOINC\DATA/projects/climateprediction.net/hadcm3n_38vv_1980_40_008318891/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Mar 2013 22:41:26	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	259,200	523,201	2.0185
16 Mar 2013 00:00:09	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	233,280	469,047	2.0107
12 Mar 2013 22:52:21	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	207,360	417,734	2.0145
10 Mar 2013 16:25:42	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	181,440	366,740	2.0213
08 Mar 2013 10:16:55	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	155,520	315,813	2.0307
05 Mar 2013 18:23:46	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	129,600	263,250	2.0313
03 Mar 2013 01:39:10	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	103,680	208,400	2.0100
02 Mar 2013 04:11:12	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	77,760	154,793	1.9907
28 Feb 2013 00:10:25	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	51,840	102,023	1.9680
25 Feb 2013 22:21:35	1081404	15633396	hadcm3n_38vv_1980_40_008318891_1	25,920	51,267	1.9779