Task 14772449

Name	hadcm3n_006o_1980_40_007999645_2
Workunit	8154759
Created	4 Jun 2012, 16:17:13 UTC
Sent	4 Jun 2012, 16:21:39 UTC
Report deadline	3 Sep 2012, 23:48:50 UTC
Received	8 Jul 2012, 17:16:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	871942
Run time	14 days 7 hours 6 min 47 sec
CPU time	11 days 10 hours 37 min 19 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2532, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5680, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6060, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3704, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5624, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3076, iMonCtr=1 Model crash detected, will try to restart... 10:42:15 (3368): No heartbeat from core client for 30 sec - exiting 10:42:16 (3368): No heartbeat from core client for 30 sec - exiting 10:42:17 (3368): No heartbeat from core client for 30 sec - exiting 10:42:18 (3368): No heartbeat from core client for 30 sec - exiting 10:42:19 (3368): No heartbeat from core client for 30 sec - exiting 10:42:21 (3368): No heartbeat from core client for 30 sec - exiting 10:42:22 (3368): No heartbeat from core client for 30 sec - exiting 10:42:23 (3368): No heartbeat from core client for 30 sec - exiting 10:42:24 (3368): No heartbeat from core client for 30 sec - exiting 10:42:25 (3368): No heartbeat from core client for 30 sec - exiting 10:42:26 (3368): No heartbeat from core client for 30 sec - exiting 10:42:27 (3368): No heartbeat from core client for 30 sec - exiting 10:42:28 (3368): No heartbeat from core client for 30 sec - exiting 10:42:29 (3368): No heartbeat from core client for 30 sec - exiting 10:42:30 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4868, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3868, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4652, iMonCtr=1 Model crash detected, will try to restart... 19:23:29 (3804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:30 (3804): No heartbeat from core client for 30 sec - exiting 19:23:31 (3804): No heartbeat from core client for 30 sec - exiting 19:23:32 (3804): No heartbeat from core client for 30 sec - exiting 19:23:33 (3804): No heartbeat from core client for 30 sec - exiting 19:23:34 (3804): No heartbeat from core client for 30 sec - exiting 19:23:35 (3804): No heartbeat from core client for 30 sec - exiting 19:23:36 (3804): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4552, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4376, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5816, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4704, iMonCtr=1 Model crash detected, will try to restart... 07:05:45 (5388): No heartbeat from core client for 30 sec - exiting 07:05:48 (5388): No heartbeat from core client for 30 sec - exiting 07:05:55 (5388): No heartbeat from core client for 30 sec - exiting 07:05:57 (5388): No heartbeat from core client for 30 sec - exiting 07:05:58 (5388): No heartbeat from core client for 30 sec - exiting 07:06:00 (5388): No heartbeat from core client for 30 sec - exiting 07:06:02 (5388): No heartbeat from core client for 30 sec - exiting 07:06:03 (5388): No heartbeat from core client for 30 sec - exiting 07:06:06 (5388): No heartbeat from core client for 30 sec - exiting 07:06:08 (5388): No heartbeat from core client for 30 sec - exiting 07:06:09 (5388): No heartbeat from core client for 30 sec - exiting 07:06:11 (5388): No heartbeat from core client for 30 sec - exiting 07:06:12 (5388): No heartbeat from core client for 30 sec - exiting 07:06:14 (5388): No heartbeat from core client for 30 sec - exiting 07:06:15 (5388): No heartbeat from core client for 30 sec - exiting 07:06:17 (5388): No heartbeat from core client for 30 sec - exiting 07:06:18 (5388): No heartbeat from core client for 30 sec - exiting 07:06:20 (5388): No heartbeat from core client for 30 sec - exiting 07:06:21 (5388): No heartbeat from core client for 30 sec - exiting 07:06:22 (5388): No heartbeat from core client for 30 sec - exiting 07:06:24 (5388): No heartbeat from core client for 30 sec - exiting 07:06:25 (5388): No heartbeat from core client for 30 sec - exiting 07:06:27 (5388): No heartbeat from core client for 30 sec - exiting 07:06:28 (5388): No heartbeat from core client for 30 sec - exiting 07:06:30 (5388): No heartbeat from core client for 30 sec - exiting 07:06:32 (5388): No heartbeat from core client for 30 sec - exiting 07:06:33 (5388): No heartbeat from core client for 30 sec - exiting 07:06:35 (5388): No heartbeat from core client for 30 sec - exiting 07:06:36 (5388): No heartbeat from core client for 30 sec - exiting 07:06:37 (5388): No heartbeat from core client for 30 sec - exiting 07:06:39 (5388): No heartbeat from core client for 30 sec - exiting 07:06:40 (5388): No heartbeat from core client for 30 sec - exiting 07:06:41 (5388): No heartbeat from core client for 30 sec - exiting 07:06:43 (5388): No heartbeat from core client for 30 sec - exiting 07:06:44 (5388): No heartbeat from core client for 30 sec - exiting 07:06:45 (5388): No heartbeat from core client for 30 sec - exiting 07:06:47 (5388): No heartbeat from core client for 30 sec - exiting 07:06:48 (5388): No heartbeat from core client for 30 sec - exiting 07:06:50 (5388): No heartbeat from core client for 30 sec - exiting 07:06:51 (5388): No heartbeat from core client for 30 sec - exiting 07:06:53 (5388): No heartbeat from core client for 30 sec - exiting 07:06:54 (5388): No heartbeat from core client for 30 sec - exiting 07:06:55 (5388): No heartbeat from core client for 30 sec - exiting 07:06:57 (5388): No heartbeat from core client for 30 sec - exiting 07:06:58 (5388): No heartbeat from core client for 30 sec - exiting 07:07:00 (5388): No heartbeat from core client for 30 sec - exiting 07:07:01 (5388): No heartbeat from core client for 30 sec - exiting 07:07:03 (5388): No heartbeat from core client for 30 sec - exiting 07:07:04 (5388): No heartbeat from core client for 30 sec - exiting 07:07:06 (5388): No heartbeat from core client for 30 sec - exiting 07:07:07 (5388): No heartbeat from core client for 30 sec - exiting 07:07:08 (5388): No heartbeat from core client for 30 sec - exiting 07:07:10 (5388): No heartbeat from core client for 30 sec - exiting 07:07:11 (5388): No heartbeat from core client for 30 sec - exiting 07:07:13 (5388): No heartbeat from core client for 30 sec - exiting 07:07:14 (5388): No heartbeat from core client for 30 sec - exiting 07:07:16 (5388): No heartbeat from core client for 30 sec - exiting 07:07:17 (5388): No heartbeat from core client for 30 sec - exiting 07:07:18 (5388): No heartbeat from core client for 30 sec - exiting 07:07:20 (5388): No heartbeat from core client for 30 sec - exiting 07:07:21 (5388): No heartbeat from core client for 30 sec - exiting 07:07:23 (5388): No heartbeat from core client for 30 sec - exiting 07:07:24 (5388): No heartbeat from core client for 30 sec - exiting 07:07:26 (5388): No heartbeat from core client for 30 sec - exiting 07:07:27 (5388): No heartbeat from core client for 30 sec - exiting 07:07:28 (5388): No heartbeat from core client for 30 sec - exiting 07:07:30 (5388): No heartbeat from core client for 30 sec - exiting 07:07:32 (5388): No heartbeat from core client for 30 sec - exiting 07:07:34 (5388): No heartbeat from core client for 30 sec - exiting 07:07:35 (5388): No heartbeat from core client for 30 sec - exiting 07:07:37 (5388): No heartbeat from core client for 30 sec - exiting 07:07:38 (5388): No heartbeat from core client for 30 sec - exiting 07:07:40 (5388): No heartbeat from core client for 30 sec - exiting 07:07:41 (5388): No heartbeat from core client for 30 sec - exiting 07:07:42 (5388): No heartbeat from core client for 30 sec - exiting 07:07:44 (5388): No heartbeat from core client for 30 sec - exiting 07:07:46 (5388): No heartbeat from core client for 30 sec - exiting 07:07:47 (5388): No heartbeat from core client for 30 sec - exiting 07:07:48 (5388): No heartbeat from core client for 30 sec - exiting 07:07:50 (5388): No heartbeat from core client for 30 sec - exiting 07:07:51 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:53 (5388): No heartbeat from core client for 30 sec - exiting 10:13:06 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:13:09 (5192): No heartbeat from core client for 30 sec - exiting 13:32:07 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3124, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1252, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 11:06:04 (5052): No heartbeat from core client for 30 sec - exiting 11:06:05 (5052): No heartbeat from core client for 30 sec - exiting 11:06:06 (5052): No heartbeat from core client for 30 sec - exiting 11:06:07 (5052): No heartbeat from core client for 30 sec - exiting 11:06:08 (5052): No heartbeat from core client for 30 sec - exiting 11:06:09 (5052): No heartbeat from core client for 30 sec - exiting 11:06:10 (5052): No heartbeat from core client for 30 sec - exiting 11:06:11 (5052): No heartbeat from core client for 30 sec - exiting 11:06:12 (5052): No heartbeat from core client for 30 sec - exiting 11:06:13 (5052): No heartbeat from core client for 30 sec - exiting 11:06:14 (5052): No heartbeat from core client for 30 sec - exiting 11:06:15 (5052): No heartbeat from core client for 30 sec - exiting 11:06:16 (5052): No heartbeat from core client for 30 sec - exiting 11:06:17 (5052): No heartbeat from core client for 30 sec - exiting 11:06:18 (5052): No heartbeat from core client for 30 sec - exiting 11:06:19 (5052): No heartbeat from core client for 30 sec - exiting 11:06:20 (5052): No heartbeat from core client for 30 sec - exiting 11:06:21 (5052): No heartbeat from core client for 30 sec - exiting 11:06:22 (5052): No heartbeat from core client for 30 sec - exiting 11:06:23 (5052): No heartbeat from core client for 30 sec - exiting 11:06:24 (5052): No heartbeat from core client for 30 sec - exiting 11:06:25 (5052): No heartbeat from core client for 30 sec - exiting 11:06:26 (5052): No heartbeat from core client for 30 sec - exiting 11:06:27 (5052): No heartbeat from core client for 30 sec - exiting 11:06:28 (5052): No heartbeat from core client for 30 sec - exiting 11:06:29 (5052): No heartbeat from core client for 30 sec - exiting 11:06:30 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:26 (2560): No heartbeat from core client for 30 sec - exiting 11:18:27 (2560): No heartbeat from core client for 30 sec - exiting 11:18:28 (2560): No heartbeat from core client for 30 sec - exiting 11:18:30 (2560): No heartbeat from core client for 30 sec - exiting 11:18:31 (2560): No heartbeat from core client for 30 sec - exiting 11:18:32 (2560): No heartbeat from core client for 30 sec - exiting 11:18:33 (2560): No heartbeat from core client for 30 sec - exiting 11:18:34 (2560): No heartbeat from core client for 30 sec - exiting 11:18:35 (2560): No heartbeat from core client for 30 sec - exiting 11:18:36 (2560): No heartbeat from core client for 30 sec - exiting 11:18:37 (2560): No heartbeat from core client for 30 sec - exiting 11:18:38 (2560): No heartbeat from core client for 30 sec - exiting 11:18:39 (2560): No heartbeat from core client for 30 sec - exiting 11:18:40 (2560): No heartbeat from core client for 30 sec - exiting 11:18:41 (2560): No heartbeat from core client for 30 sec - exiting 11:18:42 (2560): No heartbeat from core client for 30 sec - exiting 11:18:43 (2560): No heartbeat from core client for 30 sec - exiting 11:18:44 (2560): No heartbeat from core client for 30 sec - exiting 11:18:45 (2560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:46 (2560): No heartbeat from core client for 30 sec - exiting 11:18:47 (2560): No heartbeat from core client for 30 sec - exiting 11:18:48 (2560): No heartbeat from core client for 30 sec - exiting 11:18:49 (2560): No heartbeat from core client for 30 sec - exiting 12:07:41 (4672): No heartbeat from core client for 30 sec - exiting 12:07:42 (4672): No heartbeat from core client for 30 sec - exiting 12:07:43 (4672): No heartbeat from core client for 30 sec - exiting 12:07:44 (4672): No heartbeat from core client for 30 sec - exiting 12:07:45 (4672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4236, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1044, iMonCtr=1 Model crash detected, will try to restart... 07:18:03 (4200): No heartbeat from core client for 30 sec - exiting 07:18:05 (4200): No heartbeat from core client for 30 sec - exiting 07:18:07 (4200): No heartbeat from core client for 30 sec - exiting 07:18:08 (4200): No heartbeat from core client for 30 sec - exiting 07:18:09 (4200): No heartbeat from core client for 30 sec - exiting 07:18:10 (4200): No heartbeat from core client for 30 sec - exiting 07:18:11 (4200): No heartbeat from core client for 30 sec - exiting 07:18:12 (4200): No heartbeat from core client for 30 sec - exiting 07:18:13 (4200): No heartbeat from core client for 30 sec - exiting 07:18:15 (4200): No heartbeat from core client for 30 sec - exiting 07:18:16 (4200): No heartbeat from core client for 30 sec - exiting 07:18:17 (4200): No heartbeat from core client for 30 sec - exiting 07:18:19 (4200): No heartbeat from core client for 30 sec - exiting 07:18:20 (4200): No heartbeat from core client for 30 sec - exiting 07:18:21 (4200): No heartbeat from core client for 30 sec - exiting 07:18:22 (4200): No heartbeat from core client for 30 sec - exiting 07:18:23 (4200): No heartbeat from core client for 30 sec - exiting 07:18:24 (4200): No heartbeat from core client for 30 sec - exiting 07:18:25 (4200): No heartbeat from core client for 30 sec - exiting 07:18:26 (4200): No heartbeat from core client for 30 sec - exiting 07:18:27 (4200): No heartbeat from core client for 30 sec - exiting 07:18:28 (4200): No heartbeat from core client for 30 sec - exiting 07:18:29 (4200): No heartbeat from core client for 30 sec - exiting 07:18:30 (4200): No heartbeat from core client for 30 sec - exiting 07:18:31 (4200): No heartbeat from core client for 30 sec - exiting 07:18:32 (4200): No heartbeat from core client for 30 sec - exiting 07:18:33 (4200): No heartbeat from core client for 30 sec - exiting 07:18:35 (4200): No heartbeat from core client for 30 sec - exiting 07:18:36 (4200): No heartbeat from core client for 30 sec - exiting 07:18:38 (4200): No heartbeat from core client for 30 sec - exiting 07:18:39 (4200): No heartbeat from core client for 30 sec - exiting 07:18:40 (4200): No heartbeat from core client for 30 sec - exiting 07:18:41 (4200): No heartbeat from core client for 30 sec - exiting 07:18:43 (4200): No heartbeat from core client for 30 sec - exiting 07:18:44 (4200): No heartbeat from core client for 30 sec - exiting 07:18:46 (4200): No heartbeat from core client for 30 sec - exiting 07:18:47 (4200): No heartbeat from core client for 30 sec - exiting 07:18:48 (4200): No heartbeat from core client for 30 sec - exiting 07:18:49 (4200): No heartbeat from core client for 30 sec - exiting 07:18:50 (4200): No heartbeat from core client for 30 sec - exiting 07:18:51 (4200): No heartbeat from core client for 30 sec - exiting 07:18:52 (4200): No heartbeat from core client for 30 sec - exiting 07:18:53 (4200): No heartbeat from core client for 30 sec - exiting 07:18:54 (4200): No heartbeat from core client for 30 sec - exiting 07:18:55 (4200): No heartbeat from core client for 30 sec - exiting 07:18:57 (4200): No heartbeat from core client for 30 sec - exiting 07:18:58 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:05 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... 13:46:23 (5164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:24 (5164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1336, iMonCtr=1 Model crash detected, will try to restart... 15:30:04 (4680): No heartbeat from core client for 30 sec - exiting 15:30:05 (4680): No heartbeat from core client for 30 sec - exiting 15:30:06 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:09:23 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:41:36 (6072): No heartbeat from core client for 30 sec - exiting 11:41:37 (6072): No heartbeat from core client for 30 sec - exiting 11:41:38 (6072): No heartbeat from core client for 30 sec - exiting 11:41:39 (6072): No heartbeat from core client for 30 sec - exiting 11:41:41 (6072): No heartbeat from core client for 30 sec - exiting 11:41:42 (6072): No heartbeat from core client for 30 sec - exiting 11:41:43 (6072): No heartbeat from core client for 30 sec - exiting 11:41:44 (6072): No heartbeat from core client for 30 sec - exiting 11:41:45 (6072): No heartbeat from core client for 30 sec - exiting 11:41:46 (6072): No heartbeat from core client for 30 sec - exiting 11:41:47 (6072): No heartbeat from core client for 30 sec - exiting 11:41:48 (6072): No heartbeat from core client for 30 sec - exiting 11:41:49 (6072): No heartbeat from core client for 30 sec - exiting 11:41:50 (6072): No heartbeat from core client for 30 sec - exiting 11:41:51 (6072): No heartbeat from core client for 30 sec - exiting 11:41:52 (6072): No heartbeat from core client for 30 sec - exiting 11:41:53 (6072): No heartbeat from core client for 30 sec - exiting 11:41:54 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:09:47 (5480): No heartbeat from core client for 30 sec - exiting 14:09:48 (5480): No heartbeat from core client for 30 sec - exiting 14:09:49 (5480): No heartbeat from core client for 30 sec - exiting 14:09:50 (5480): No heartbeat from core client for 30 sec - exiting 14:09:51 (5480): No heartbeat from core client for 30 sec - exiting 14:09:52 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:20:36 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:37 (4476): No heartbeat from core client for 30 sec - exiting 15:20:38 (4476): No heartbeat from core client for 30 sec - exiting 15:20:39 (4476): No heartbeat from core client for 30 sec - exiting 15:20:40 (4476): No heartbeat from core client for 30 sec - exiting 15:20:41 (4476): No heartbeat from core client for 30 sec - exiting 15:20:42 (4476): No heartbeat from core client for 30 sec - exiting 15:20:43 (4476): No heartbeat from core client for 30 sec - exiting 15:20:44 (4476): No heartbeat from core client for 30 sec - exiting 15:20:45 (4476): No heartbeat from core client for 30 sec - exiting 15:20:46 (4476): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2588, iMonCtr=1 Model crash detected, will try to restart... 12:39:21 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:22 (2924): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5168, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76EB6E5F read attempt to address 0x40C6D876 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C76E5F read attempt to address 0x40C6D876 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_006o_1980_40_007999645/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2012 14:00:10	871942	14772449	hadcm3n_006o_1980_40_007999645_2	259,200	931,707	3.5945
03 Jul 2012 16:14:47	871942	14772449	hadcm3n_006o_1980_40_007999645_2	233,280	833,433	3.5727
03 Jul 2012 10:43:24	871942	14772449	hadcm3n_006o_1980_40_007999645_2	207,360	746,277	3.5989
27 Jun 2012 10:55:00	871942	14772449	hadcm3n_006o_1980_40_007999645_2	181,440	655,055	3.6103
22 Jun 2012 19:16:16	871942	14772449	hadcm3n_006o_1980_40_007999645_2	155,520	562,991	3.6201
20 Jun 2012 13:59:30	871942	14772449	hadcm3n_006o_1980_40_007999645_2	129,600	469,390	3.6218
17 Jun 2012 18:36:28	871942	14772449	hadcm3n_006o_1980_40_007999645_2	103,680	377,762	3.6435
14 Jun 2012 16:50:39	871942	14772449	hadcm3n_006o_1980_40_007999645_2	77,760	283,408	3.6447
12 Jun 2012 05:13:27	871942	14772449	hadcm3n_006o_1980_40_007999645_2	51,840	188,687	3.6398
08 Jun 2012 18:25:49	871942	14772449	hadcm3n_006o_1980_40_007999645_2	25,920	94,709	3.6539