Task 13656405

Name	hadcm3n_yi0h_1900_40_007515718_3
Workunit	7713193
Created	23 Nov 2011, 14:53:46 UTC
Sent	23 Nov 2011, 14:59:58 UTC
Report deadline	22 Feb 2012, 22:27:09 UTC
Received	14 Jan 2012, 11:14:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	874636
Run time	23 days 1 hours 52 min 50 sec
CPU time	16 days 3 hours 10 min 50 sec
Validate state	Invalid
Credit	7,464.96
Device peak FLOPS	2.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 05:19:43 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:30 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:31 (5684): No heartbeat from core client for 30 sec - exiting 05:25:29 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:30 (4172): No heartbeat from core client for 30 sec - exiting 05:26:34 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:17 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:35:20 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:14 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:15 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:30 (4888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:40:12 (7084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:45:34 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:45:35 (6052): No heartbeat from core client for 30 sec - exiting 01:45:36 (6052): No heartbeat from core client for 30 sec - exiting 03:47:54 (1940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:26 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:02:44 (6032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:40:57 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:31 (1256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:32 (1256): No heartbeat from core client for 30 sec - exiting 13:42:38 (5352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:04:50 (1448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:14 (1344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:44 (996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:38 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:36 (4176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:14:55 (5072): No heartbeat from core client for 30 sec - exiting 18:14:56 (5072): No heartbeat from core client for 30 sec - exiting 18:14:57 (5072): No heartbeat from core client for 30 sec - exiting 18:14:58 (5072): No heartbeat from core client for 30 sec - exiting 18:14:59 (5072): No heartbeat from core client for 30 sec - exiting 18:15:00 (5072): No heartbeat from core client for 30 sec - exiting 18:15:01 (5072): No heartbeat from core client for 30 sec - exiting 18:15:02 (5072): No heartbeat from core client for 30 sec - exiting 18:15:03 (5072): No heartbeat from core client for 30 sec - exiting 18:15:05 (5072): No heartbeat from core client for 30 sec - exiting 18:15:06 (5072): No heartbeat from core client for 30 sec - exiting 18:15:07 (5072): No heartbeat from core client for 30 sec - exiting 18:15:08 (5072): No heartbeat from core client for 30 sec - exiting 18:15:09 (5072): No heartbeat from core client for 30 sec - exiting 18:15:10 (5072): No heartbeat from core client for 30 sec - exiting 18:15:11 (5072): No heartbeat from core client for 30 sec - exiting 18:15:12 (5072): No heartbeat from core client for 30 sec - exiting 18:15:13 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:14 (5072): No heartbeat from core client for 30 sec - exiting 18:15:16 (5072): No heartbeat from core client for 30 sec - exiting 18:15:17 (5072): No heartbeat from core client for 30 sec - exiting 18:16:27 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:47 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:32:53 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:39:07 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yi0hko.pjb1c10 Error converting file to netcdf: dataout/yi0hko.pib1c10 Error converting file to netcdf: dataout/yi0hko.pfb1c10 Error converting file to netcdf: dataout/yi0hka.phb1c10 Error converting file to netcdf: dataout/yi0hka.pgb1c10 Error converting file to netcdf: dataout/yi0hka.peb1c10 Error converting file to netcdf: dataout/yi0hka.pdb1c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:15:55 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:15:57 (4680): No heartbeat from core client for 30 sec - exiting 23:40:30 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:01:35 (5664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:22 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:15:50 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:14:59 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:39 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:40 (3752): No heartbeat from core client for 30 sec - exiting 03:15:41 (3752): No heartbeat from core client for 30 sec - exiting 03:15:42 (3752): No heartbeat from core client for 30 sec - exiting 03:15:43 (3752): No heartbeat from core client for 30 sec - exiting 03:15:44 (3752): No heartbeat from core client for 30 sec - exiting 03:15:45 (3752): No heartbeat from core client for 30 sec - exiting 03:15:46 (3752): No heartbeat from core client for 30 sec - exiting 03:15:47 (3752): No heartbeat from core client for 30 sec - exiting 03:15:48 (3752): No heartbeat from core client for 30 sec - exiting 03:15:49 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 06:17:22 (2080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:18:09 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:39:08 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:42:42 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:30:04 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:30:06 (4292): No heartbeat from core client for 30 sec - exiting 13:30:07 (4292): No heartbeat from core client for 30 sec - exiting 13:33:47 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:49 (5340): No heartbeat from core client for 30 sec - exiting 13:33:50 (5340): No heartbeat from core client for 30 sec - exiting 13:33:51 (5340): No heartbeat from core client for 30 sec - exiting 13:33:52 (5340): No heartbeat from core client for 30 sec - exiting 13:33:53 (5340): No heartbeat from core client for 30 sec - exiting 13:33:54 (5340): No heartbeat from core client for 30 sec - exiting 13:33:55 (5340): No heartbeat from core client for 30 sec - exiting 13:33:56 (5340): No heartbeat from core client for 30 sec - exiting 13:33:57 (5340): No heartbeat from core client for 30 sec - exiting 13:33:58 (5340): No heartbeat from core client for 30 sec - exiting 13:33:59 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:30:20 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:02:55 (8048): No heartbeat from core client for 30 sec - exiting 22:02:56 (8048): No heartbeat from core client for 30 sec - exiting 22:02:57 (8048): No heartbeat from core client for 30 sec - exiting 22:02:58 (8048): No heartbeat from core client for 30 sec - exiting 22:02:59 (8048): No heartbeat from core client for 30 sec - exiting 22:03:00 (8048): No heartbeat from core client for 30 sec - exiting 22:03:01 (8048): No heartbeat from core client for 30 sec - exiting 22:03:02 (8048): No heartbeat from core client for 30 sec - exiting 22:03:03 (8048): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4584, selfPID=4584, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yi0hko.pjb9c10 Error converting file to netcdf: dataout/yi0hko.pib9c10 Error converting file to netcdf: dataout/yi0hko.pfb9c10 Error converting file to netcdf: dataout/yi0hka.phb9c10 Error converting file to netcdf: dataout/yi0hka.pgb9c10 Error converting file to netcdf: dataout/yi0hka.peb9c10 CPDN Monitor - Quit request from BOINC... 02:08:55 (6648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:58:50 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:23:43 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:14 (6504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:20:28 (1524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:59:37 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:23:16 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:27:39 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:58:59 (6744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 03:23:38 (4360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:33:13 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:34:01 (7908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7584, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7584, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7584, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7584, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7584, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7584, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:04:57 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:12 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:03 (2536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:34 (2624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:21 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:29 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:26 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:14 (5960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:00 (3860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:01 (3860): No heartbeat from core client for 30 sec - exiting 15:55:03 (3860): No heartbeat from core client for 30 sec - exiting 15:55:04 (3860): No heartbeat from core client for 30 sec - exiting 03:00:04 (5688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:04 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:54 (5328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:56 (5328): No heartbeat from core client for 30 sec - exiting 05:35:11 (272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:58:14 (560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:58:16 (560): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 08:22:24 (3732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:45:42 (5328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:46:26 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:54 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:06 (4952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:45 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:31:38 (1776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:47:13 (908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:20 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:58 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:34:35 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:01:57 (1544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:43:10 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:08:51 (1776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:10:48 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:45 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:47:35 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:48:26 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:56:29 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:56:31 (6012): No heartbeat from core client for 30 sec - exiting 23:58:19 (2516): No heartbeat from core client for 30 sec - exiting 23:58:20 (2516): No heartbeat from core client for 30 sec - exiting 23:58:21 (2516): No heartbeat from core client for 30 sec - exiting 23:58:22 (2516): No heartbeat from core client for 30 sec - exiting 23:58:23 (2516): No heartbeat from core client for 30 sec - exiting 23:58:24 (2516): No heartbeat from core client for 30 sec - exiting 23:58:25 (2516): No heartbeat from core client for 30 sec - exiting 23:58:26 (2516): No heartbeat from core client for 30 sec - exiting 23:58:27 (2516): No heartbeat from core client for 30 sec - exiting 23:58:28 (2516): No heartbeat from core client for 30 sec - exiting 23:58:29 (2516): No heartbeat from core client for 30 sec - exiting 23:58:30 (2516): No heartbeat from core client for 30 sec - exiting 23:58:31 (2516): No heartbeat from core client for 30 sec - exiting 23:58:32 (2516): No heartbeat from core client for 30 sec - exiting 23:58:33 (2516): No heartbeat from core client for 30 sec - exiting 23:58:34 (2516): No heartbeat from core client for 30 sec - exiting 23:58:35 (2516): No heartbeat from core client for 30 sec - exiting 23:58:36 (2516): No heartbeat from core client for 30 sec - exiting 23:58:37 (2516): No heartbeat from core client for 30 sec - exiting 23:58:38 (2516): No heartbeat from core client for 30 sec - exiting 23:58:39 (2516): No heartbeat from core client for 30 sec - exiting 23:58:40 (2516): No heartbeat from core client for 30 sec - exiting 23:58:41 (2516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:42 (2516): No heartbeat from core client for 30 sec - exiting 23:58:43 (2516): No heartbeat from core client for 30 sec - exiting 23:58:44 (2516): No heartbeat from core client for 30 sec - exiting 23:58:45 (2516): No heartbeat from core client for 30 sec - exiting 23:58:46 (2516): No heartbeat from core client for 30 sec - exiting 23:58:47 (2516): No heartbeat from core client for 30 sec - exiting 23:58:48 (2516): No heartbeat from core client for 30 sec - exiting 23:58:49 (2516): No heartbeat from core client for 30 sec - exiting 23:58:50 (2516): No heartbeat from core client for 30 sec - exiting 23:58:51 (2516): No heartbeat from core client for 30 sec - exiting 00:03:13 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:04:27 (2192): No heartbeat from core client for 30 sec - exiting 00:04:28 (2192): No heartbeat from core client for 30 sec - exiting 00:04:29 (2192): No heartbeat from core client for 30 sec - exiting 00:04:30 (2192): No heartbeat from core client for 30 sec - exiting 00:04:31 (2192): No heartbeat from core client for 30 sec - exiting 00:04:32 (2192): No heartbeat from core client for 30 sec - exiting 00:04:33 (2192): No heartbeat from core client for 30 sec - exiting 00:04:34 (2192): No heartbeat from core client for 30 sec - exiting 00:04:35 (2192): No heartbeat from core client for 30 sec - exiting 00:04:36 (2192): No heartbeat from core client for 30 sec - exiting 00:04:37 (2192): No heartbeat from core client for 30 sec - exiting 00:04:38 (2192): No heartbeat from core client for 30 sec - exiting 00:04:39 (2192): No heartbeat from core client for 30 sec - exiting 00:04:40 (2192): No heartbeat from core client for 30 sec - exiting 00:04:41 (2192): No heartbeat from core client for 30 sec - exiting 00:04:42 (2192): No heartbeat from core client for 30 sec - exiting 00:04:43 (2192): No heartbeat from core client for 30 sec - exiting 00:04:44 (2192): No heartbeat from core client for 30 sec - exiting 00:04:45 (2192): No heartbeat from core client for 30 sec - exiting 00:04:46 (2192): No heartbeat from core client for 30 sec - exiting 00:04:47 (2192): No heartbeat from core client for 30 sec - exiting 00:04:48 (2192): No heartbeat from core client for 30 sec - exiting 00:04:49 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:04:50 (2192): No heartbeat from core client for 30 sec - exiting 00:04:51 (2192): No heartbeat from core client for 30 sec - exiting 00:04:52 (2192): No heartbeat from core client for 30 sec - exiting 00:04:53 (2192): No heartbeat from core client for 30 sec - exiting 00:04:54 (2192): No heartbeat from core client for 30 sec - exiting 00:04:55 (2192): No heartbeat from core client for 30 sec - exiting 00:04:56 (2192): No heartbeat from core client for 30 sec - exiting 00:04:57 (2192): No heartbeat from core client for 30 sec - exiting 00:04:58 (2192): No heartbeat from core client for 30 sec - exiting 00:04:59 (2192): No heartbeat from core client for 30 sec - exiting 00:17:03 (2672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:35:31 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:35:32 (5180): No heartbeat from core client for 30 sec - exiting 10:11:54 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:54:18 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:13:48 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:16:14 (1964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:17:02 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:43:11 (3212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:44:07 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:07 (2468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:22 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:43 (1108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:57 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:11 (572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:43:27 (3404): No heartbeat from core client for 30 sec - exiting 14:43:28 (3404): No heartbeat from core client for 30 sec - exiting 14:43:29 (3404): No heartbeat from core client for 30 sec - exiting 14:43:30 (3404): No heartbeat from core client for 30 sec - exiting 14:43:31 (3404): No heartbeat from core client for 30 sec - exiting 14:43:32 (3404): No heartbeat from core client for 30 sec - exiting 14:43:33 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:16 (476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:18 (476): No heartbeat from core client for 30 sec - exiting 20:00:19 (476): No heartbeat from core client for 30 sec - exiting 20:00:20 (476): No heartbeat from core client for 30 sec - exiting 20:00:21 (476): No heartbeat from core client for 30 sec - exiting 20:26:31 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:17 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:18 (2804): No heartbeat from core client for 30 sec - exiting 20:43:41 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:20 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:18 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C921780 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5760, selfPID=5760, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Dec 2011 16:52:56	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	622,080	960,012	1.5432
19 Dec 2011 22:55:22	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	596,160	919,091	1.5417
19 Dec 2011 18:01:32	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	570,240	879,364	1.5421
18 Dec 2011 13:33:28	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	544,320	840,088	1.5434
17 Dec 2011 13:34:55	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	518,400	800,735	1.5446
17 Dec 2011 02:27:19	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	492,480	761,216	1.5457
15 Dec 2011 09:54:50	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	466,560	722,048	1.5476
15 Dec 2011 09:54:50	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	440,640	679,619	1.5423
15 Dec 2011 09:54:50	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	414,720	642,041	1.5481
15 Dec 2011 09:54:50	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	388,800	601,471	1.5470
12 Dec 2011 11:29:23	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	362,880	560,602	1.5449
11 Dec 2011 14:58:21	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	336,960	519,411	1.5415
10 Dec 2011 14:42:24	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	311,040	479,168	1.5405
07 Dec 2011 17:29:57	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	285,120	440,310	1.5443
07 Dec 2011 17:29:57	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	259,200	403,239	1.5557
07 Dec 2011 17:29:57	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	233,280	366,186	1.5697
07 Dec 2011 17:29:57	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	207,360	329,138	1.5873
07 Dec 2011 17:29:57	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	181,440	289,677	1.5965
03 Dec 2011 01:04:15	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	155,520	247,291	1.5901
02 Dec 2011 18:50:50	874636	13656405	hadcm3n_yi0h_1900_40_007515718_3	129,600	207,176	1.5986