Task 13403031

Name	hadcm3n_o3lm_1940_40_007457074_0
Workunit	7654577
Created	20 Sep 2011, 21:04:17 UTC
Sent	20 Sep 2011, 21:12:21 UTC
Report deadline	21 Dec 2011, 4:39:32 UTC
Received	6 Jan 2012, 20:14:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1044708
Run time	34 days 21 hours 4 min 14 sec
CPU time	32 days 8 hours 41 min 55 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:17 (1508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:23:21 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19568, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 12:44:08 (94572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:09 (94572): No heartbeat from core client for 30 sec - exiting 12:44:10 (94572): No heartbeat from core client for 30 sec - exiting 17:42:51 (145604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:08 (150004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:09 (150004): No heartbeat from core client for 30 sec - exiting 20:39:57 (162312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:45 (160092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:34 (175684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:33 (179624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:35:27 (183660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:23 (185164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:33:17 (187960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:32:12 (192344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:05 (195888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:56 (195068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:28:46 (201644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:38 (204764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:36 (201932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:26 (210360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:19 (213944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:11 (213316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:22:01 (218424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:22:02 (218424): No heartbeat from core client for 30 sec - exiting 19:20:58 (223584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:19:51 (228668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:33 (228688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:00:26 (640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:59:23 (8120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:58:17 (10900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:57:05 (13552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:55:55 (17320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:40 (21528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:39 (26416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:37 (28940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:51:34 (29684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35400, iMonCtr=1 Model crash detected, will try to restart... 04:50:33 (35400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:54:51 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:34 (6384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:52:29 (13412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:51 (752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:46 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:37:43 (10164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:40 (13344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:40 (16744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:28 (22388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:33:27 (23088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:32:21 (30300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:12 (28272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:02 (35952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:28:47 (34704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:36 (39860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:26:24 (43964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:13 (50308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:24:02 (54636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:22:50 (57212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:32:57 (212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:14:40 (680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:37 (6744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:35:54 (11884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:42 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:23:33 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:22:30 (10652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:19 (13352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:20:07 (26544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:53 (24468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:42 (31416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:31 (37468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:21 (41564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:14:09 (46996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:56 (47216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:53 (54180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:40 (54012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:09:27 (61280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:14 (65504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:07:03 (72372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:49 (74864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:04:39 (77872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:29 (78876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:02:15 (87168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:06 (90208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:55 (97904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:44 (99260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:46 (104576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:42 (118020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:55:40 (120448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:54:33 (119372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:13:14 (119460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:04:30 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:06:17 (1876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:08:39 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:11:01 (856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:14:05 (184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:16:51 (3136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:19:47 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:24:47 (2108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:27:08 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:29:24 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:32:08 (2248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:34:51 (584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:37:31 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:40:18 (2624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:42:48 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:45:32 (1472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:48:17 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:50:47 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:53:05 (516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:55:19 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 13:58:17 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 14:00:48 (532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3lmko.pjf8c10 Error converting file to netcdf: dataout/o3lmko.pif8c10 Error converting file to netcdf: dataout/o3lmko.pff8c10 Error converting file to netcdf: dataout/o3lmka.phf8c10 Error converting file to netcdf: dataout/o3lmka.pgf8c10 Error converting file to netcdf: dataout/o3lmka.pef8c10 Error converting file to netcdf: dataout/o3lmka.pdf8c10 16:48:15 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:47:02 (2152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:45:49 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:56 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:44:01 (536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:42:58 (1504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:34:00 (3944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:32:59 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:58 (2564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:58 (2568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:56 (2544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:51 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:49 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:49 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:02:00 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C9192F9 read attempt to address 0x0122DAE0 Engaging BOINC Windows Runtime Debugger... 03:00:59 (2204): No heartbeat from core client for 30 sec - exiting 03:01:00 (2204): No heartbeat from core client for 30 sec - exiting 03:01:01 (2204): No heartbeat from core client for 30 sec - exiting 03:01:02 (2204): No heartbeat from core client for 30 sec - exiting 03:01:03 (2204): No heartbeat from core client for 30 sec - exiting 03:01:04 (2204): No heartbeat from core client for 30 sec - exiting 03:01:05 (2204): No heartbeat from core client for 30 sec - exiting 03:01:06 (2204): No heartbeat from core client for 30 sec - exiting 03:01:07 (2204): No heartbeat from core client for 30 sec - exiting 03:01:09 (2204): No heartbeat from core client for 30 sec - exiting 03:01:10 (2204): No heartbeat from core client for 30 sec - exiting 03:01:11 (2204): No heartbeat from core client for 30 sec - exiting 03:01:12 (2204): No heartbeat from core client for 30 sec - exiting 03:01:13 (2204): No heartbeat from core client for 30 sec - exiting 03:01:14 (2204): No heartbeat from core client for 30 sec - exiting 03:01:15 (2204): No heartbeat from core client for 30 sec - exiting 03:01:16 (2204): No heartbeat from core client for 30 sec - exiting 03:01:17 (2204): No heartbeat from core client for 30 sec - exiting 03:01:18 (2204): No heartbeat from core client for 30 sec - exiting 03:01:19 (2204): No heartbeat from core client for 30 sec - exiting 03:01:21 (2204): No heartbeat from core client for 30 sec - exiting 03:01:22 (2204): No heartbeat from core client for 30 sec - exiting 03:01:23 (2204): No heartbeat from core client for 30 sec - exiting 03:01:24 (2204): No heartbeat from core client for 30 sec - exiting 03:01:25 (2204): No heartbeat from core client for 30 sec - exiting 03:01:26 (2204): No heartbeat from core client for 30 sec - exiting 03:01:27 (2204): No heartbeat from core client for 30 sec - exiting 03:21:43 (2204): No heartbeat from core client for 30 sec - exiting 03:21:44 (2204): No heartbeat from core client for 30 sec - exiting 03:21:45 (2204): No heartbeat from core client for 30 sec - exiting 03:21:46 (2204): No heartbeat from core client for 30 sec - exiting 03:21:47 (2204): No heartbeat from core client for 30 sec - exiting 03:21:48 (2204): No heartbeat from core client for 30 sec - exiting 03:21:50 (2204): No heartbeat from core client for 30 sec - exiting 03:21:51 (2204): No heartbeat from core client for 30 sec - exiting 03:21:52 (2204): No heartbeat from core client for 30 sec - exiting 03:21:53 (2204): No heartbeat from core client for 30 sec - exiting 03:21:54 (2204): No heartbeat from core client for 30 sec - exiting 03:21:55 (2204): No heartbeat from core client for 30 sec - exiting 03:21:56 (2204): No heartbeat from core client for 30 sec - exiting 03:21:57 (2204): No heartbeat from core client for 30 sec - exiting 03:21:58 (2204): No heartbeat from core client for 30 sec - exiting 03:21:59 (2204): No heartbeat from core client for 30 sec - exiting 03:22:01 (2204): No heartbeat from core client for 30 sec - exiting 03:22:02 (2204): No heartbeat from core client for 30 sec - exiting 03:22:03 (2204): No heartbeat from core client for 30 sec - exiting 03:22:04 (2204): No heartbeat from core client for 30 sec - exiting 03:22:05 (2204): No heartbeat from core client for 30 sec - exiting 03:22:06 (2204): No heartbeat from core client for 30 sec - exiting 03:22:07 (2204): No heartbeat from core client for 30 sec - exiting 03:22:08 (2204): No heartbeat from core client for 30 sec - exiting 03:22:09 (2204): No heartbeat from core client for 30 sec - exiting 03:22:10 (2204): No heartbeat from core client for 30 sec - exiting 03:22:11 (2204): No heartbeat from core client for 30 sec - exiting 03:22:13 (2204): No heartbeat from core client for 30 sec - exiting 03:22:14 (2204): No heartbeat from core client for 30 sec - exiting 03:22:15 (2204): No heartbeat from core client for 30 sec - exiting 03:22:16 (2204): No heartbeat from core client for 30 sec - exiting 03:22:17 (2204): No heartbeat from core client for 30 sec - exiting 03:22:18 (2204): No heartbeat from core client for 30 sec - exiting 03:22:19 (2204): No heartbeat from core client for 30 sec - exiting 03:22:20 (2204): No heartbeat from core client for 30 sec - exiting 03:22:21 (2204): No heartbeat from core client for 30 sec - exiting 03:22:22 (2204): No heartbeat from core client for 30 sec - exiting 03:22:23 (2204): No heartbeat from core client for 30 sec - exiting 03:22:25 (2204): No heartbeat from core client for 30 sec - exiting 03:22:26 (2204): No heartbeat from core client for 30 sec - exiting 03:22:27 (2204): No heartbeat from core client for 30 sec - exiting 03:22:28 (2204): No heartbeat from core client for 30 sec - exiting 03:22:29 (2204): No heartbeat from core client for 30 sec - exiting 03:22:30 (2204): No heartbeat from core client for 30 sec - exiting 03:22:31 (2204): No heartbeat from core client for 30 sec - exiting 03:22:32 (2204): No heartbeat from core client for 30 sec - exiting 03:22:33 (2204): No heartbeat from core client for 30 sec - exiting 03:22:34 (2204): No heartbeat from core client for 30 sec - exiting 03:22:36 (2204): No heartbeat from core client for 30 sec - exiting 03:22:37 (2204): No heartbeat from core client for 30 sec - exiting 03:22:38 (2204): No heartbeat from core client for 30 sec - exiting 03:22:39 (2204): No heartbeat from core client for 30 sec - exiting 03:22:40 (2204): No heartbeat from core client for 30 sec - exiting 03:22:41 (2204): No heartbeat from core client for 30 sec - exiting 03:22:42 (2204): No heartbeat from core client for 30 sec - exiting 03:22:43 (2204): No heartbeat from core client for 30 sec - exiting 03:22:44 (2204): No heartbeat from core client for 30 sec - exiting 03:22:45 (2204): No heartbeat from core client for 30 sec - exiting 03:22:46 (2204): No heartbeat from core client for 30 sec - exiting 03:22:48 (2204): No heartbeat from core client for 30 sec - exiting 03:22:49 (2204): No heartbeat from core client for 30 sec - exiting 03:22:50 (2204): No heartbeat from core client for 30 sec - exiting 03:22:51 (2204): No heartbeat from core client for 30 sec - exiting 03:22:52 (2204): No heartbeat from core client for 30 sec - exiting 03:22:53 (2204): No heartbeat from core client for 30 sec - exiting 03:22:54 (2204): No heartbeat from core client for 30 sec - exiting 03:22:55 (2204): No heartbeat from core client for 30 sec - exiting 03:22:56 (2204): No heartbeat from core client for 30 sec - exiting 03:22:57 (2204): No heartbeat from core client for 30 sec - exiting 03:22:59 (2204): No heartbeat from core client for 30 sec - exiting 03:23:00 (2204): No heartbeat from core client for 30 sec - exiting 03:23:01 (2204): No heartbeat from core client for 30 sec - exiting 03:23:02 (2204): No heartbeat from core client for 30 sec - exiting 03:23:03 (2204): No heartbeat from core client for 30 sec - exiting 03:23:04 (2204): No heartbeat from core client for 30 sec - exiting 03:23:05 (2204): No heartbeat from core client for 30 sec - exiting 03:23:06 (2204): No heartbeat from core client for 30 sec - exiting 03:23:07 (2204): No heartbeat from core client for 30 sec - exiting 03:23:08 (2204): No heartbeat from core client for 30 sec - exiting 03:23:09 (2204): No heartbeat from core client for 30 sec - exiting 03:23:11 (2204): No heartbeat from core client for 30 sec - exiting 03:23:12 (2204): No heartbeat from core client for 30 sec - exiting 03:23:13 (2204): No heartbeat from core client for 30 sec - exiting 03:23:14 (2204): No heartbeat from core client for 30 sec - exiting 03:23:15 (2204): No heartbeat from core client for 30 sec - exiting 03:23:16 (2204): No heartbeat from core client for 30 sec - exiting 03:23:17 (2204): No heartbeat from core client for 30 sec - exiting 03:23:18 (2204): No heartbeat from core client for 30 sec - exiting 03:23:19 (2204): No heartbeat from core client for 30 sec - exiting 03:23:20 (2204): No heartbeat from core client for 30 sec - exiting 03:23:21 (2204): No heartbeat from core client for 30 sec - exiting 03:23:23 (2204): No heartbeat from core client for 30 sec - exiting 03:23:24 (2204): No heartbeat from core client for 30 sec - exiting 03:23:25 (2204): No heartbeat from core client for 30 sec - exiting 03:23:26 (2204): No heartbeat from core client for 30 sec - exiting 03:23:27 (2204): No heartbeat from core client for 30 sec - exiting 03:23:28 (2204): No heartbeat from core client for 30 sec - exiting 03:23:29 (2204): No heartbeat from core client for 30 sec - exiting 03:23:30 (2204): No heartbeat from core client for 30 sec - exiting 03:23:31 (2204): No heartbeat from core client for 30 sec - exiting 03:23:32 (2204): No heartbeat from core client for 30 sec - exiting 03:23:34 (2204): No heartbeat from core client for 30 sec - exiting 03:23:35 (2204): No heartbeat from core client for 30 sec - exiting 03:23:36 (2204): No heartbeat from core client for 30 sec - exiting 03:23:37 (2204): No heartbeat from core client for 30 sec - exiting 03:23:38 (2204): No heartbeat from core client for 30 sec - exiting 03:23:39 (2204): No heartbeat from core client for 30 sec - exiting 03:23:40 (2204): No heartbeat from core client for 30 sec - exiting 03:23:41 (2204): No heartbeat from core client for 30 sec - exiting 03:23:42 (2204): No heartbeat from core client for 30 sec - exiting 03:23:43 (2204): No heartbeat from core client for 30 sec - exiting 03:23:44 (2204): No heartbeat from core client for 30 sec - exiting 03:23:46 (2204): No heartbeat from core client for 30 sec - exiting 03:23:47 (2204): No heartbeat from core client for 30 sec - exiting 03:23:48 (2204): No heartbeat from core client for 30 sec - exiting 03:23:49 (2204): No heartbeat from core client for 30 sec - exiting 03:23:50 (2204): No heartbeat from core client for 30 sec - exiting 03:23:51 (2204): No heartbeat from core client for 30 sec - exiting 03:23:52 (2204): No heartbeat from core client for 30 sec - exiting 03:23:53 (2204): No heartbeat from core client for 30 sec - exiting 03:23:54 (2204): No heartbeat from core client for 30 sec - exiting 03:23:55 (2204): No heartbeat from core client for 30 sec - exiting 03:23:56 (2204): No heartbeat from core client for 30 sec - exiting 03:23:58 (2204): No heartbeat from core client for 30 sec - exiting 03:23:59 (2204): No heartbeat from core client for 30 sec - exiting 03:24:00 (2204): No heartbeat from core client for 30 sec - exiting 03:24:01 (2204): No heartbeat from core client for 30 sec - exiting 03:24:02 (2204): No heartbeat from core client for 30 sec - exiting 03:24:03 (2204): No heartbeat from core client for 30 sec - exiting 03:24:04 (2204): No heartbeat from core client for 30 sec - exiting 03:24:05 (2204): No heartbeat from core client for 30 sec - exiting 03:24:06 (2204): No heartbeat from core client for 30 sec - exiting 03:24:07 (2204): No heartbeat from core client for 30 sec - exiting 03:24:09 (2204): No heartbeat from core client for 30 sec - exiting 03:24:10 (2204): No heartbeat from core client for 30 sec - exiting 03:24:11 (2204): No heartbeat from core client for 30 sec - exiting 03:24:12 (2204): No heartbeat from core client for 30 sec - exiting 03:24:13 (2204): No heartbeat from core client for 30 sec - exiting 03:24:14 (2204): No heartbeat from core client for 30 sec - exiting 03:24:15 (2204): No heartbeat from core client for 30 sec - exiting 03:24:16 (2204): No heartbeat from core client for 30 sec - exiting 03:24:17 (2204): No heartbeat from core client for 30 sec - exiting 03:24:18 (2204): No heartbeat from core client for 30 sec - exiting 03:24:19 (2204): No heartbeat from core client for 30 sec - exiting 03:24:21 (2204): No heartbeat from core client for 30 sec - exiting 03:24:22 (2204): No heartbeat from core client for 30 sec - exiting 03:24:23 (2204): No heartbeat from core client for 30 sec - exiting 03:24:24 (2204): No heartbeat from core client for 30 sec - exiting 03:24:25 (2204): No heartbeat from core client for 30 sec - exiting 03:24:26 (2204): No heartbeat from core client for 30 sec - exiting 03:24:27 (2204): No heartbeat from core client for 30 sec - exiting 03:24:28 (2204): No heartbeat from core client for 30 sec - exiting 03:24:29 (2204): No heartbeat from core client for 30 sec - exiting 03:24:30 (2204): No heartbeat from core client for 30 sec - exiting 03:24:32 (2204): No heartbeat from core client for 30 sec - exiting 03:24:33 (2204): No heartbeat from core client for 30 sec - exiting 03:24:34 (2204): No heartbeat from core client for 30 sec - exiting 03:24:35 (2204): No heartbeat from core client for 30 sec - exiting 03:24:36 (2204): No heartbeat from core client for 30 sec - exiting 03:24:37 (2204): No heartbeat from core client for 30 sec - exiting 03:24:38 (2204): No heartbeat from core client for 30 sec - exiting 03:24:39 (2204): No heartbeat from core client for 30 sec - exiting 03:24:40 (2204): No heartbeat from core client for 30 sec - exiting 03:24:41 (2204): No heartbeat from core client for 30 sec - exiting 03:24:42 (2204): No heartbeat from core client for 30 sec - exiting 03:24:44 (2204): No heartbeat from core client for 30 sec - exiting 03:24:45 (2204): No heartbeat from core client for 30 sec - exiting 03:24:46 (2204): No heartbeat from core client for 30 sec - exiting 03:24:47 (2204): No heartbeat from core client for 30 sec - exiting 03:24:48 (2204): No heartbeat from core client for 30 sec - exiting 03:24:49 (2204): No heartbeat from core client for 30 sec - exiting 03:24:50 (2204): No heartbeat from core client for 30 sec - exiting 03:24:51 (2204): No heartbeat from core client for 30 sec - exiting 03:24:52 (2204): No heartbeat from core client for 30 sec - exiting 03:24:53 (2204): No heartbeat from core client for 30 sec - exiting 03:24:54 (2204): No heartbeat from core client for 30 sec - exiting 03:24:56 (2204): No heartbeat from core client for 30 sec - exiting 03:24:57 (2204): No heartbeat from core client for 30 sec - exiting 03:24:58 (2204): No heartbeat from core client for 30 sec - exiting 03:24:59 (2204): No heartbeat from core client for 30 sec - exiting 03:25:00 (2204): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Dec 2011 08:53:25	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	518,400	2,772,266	5.3477
06 Dec 2011 12:41:01	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	492,480	2,639,531	5.3597
04 Dec 2011 20:07:09	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	466,560	2,505,599	5.3704
02 Dec 2011 23:18:47	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	440,640	2,366,832	5.3714
01 Dec 2011 07:40:25	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	414,720	2,231,074	5.3797
29 Nov 2011 15:02:29	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	388,800	2,095,401	5.3894
27 Nov 2011 19:20:21	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	362,880	1,957,556	5.3945
22 Nov 2011 17:06:01	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	336,960	1,817,941	5.3951
20 Nov 2011 22:05:43	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	311,040	1,678,500	5.3964
05 Nov 2011 17:42:35	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	285,120	1,536,056	5.3874
31 Oct 2011 20:04:02	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	259,200	1,394,824	5.3813
31 Oct 2011 18:46:54	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	233,280	1,252,813	5.3704
31 Oct 2011 17:23:17	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	207,360	1,113,587	5.3703
31 Oct 2011 15:38:45	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	181,440	975,807	5.3781
31 Oct 2011 13:46:45	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	155,520	834,957	5.3688
31 Oct 2011 13:46:45	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	129,600	696,555	5.3747
31 Oct 2011 13:46:45	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	103,680	555,579	5.3586
14 Oct 2011 15:51:13	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	77,760	415,387	5.3419
01 Oct 2011 10:55:20	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	51,840	277,637	5.3557
22 Sep 2011 14:48:42	1044708	13403031	hadcm3n_o3lm_1940_40_007457074_0	25,920	138,980	5.3619