Task 12991434

Name	hadcm3n_s5xj_1940_40_007300354_1
Workunit	7497778
Created	20 Jun 2011, 23:02:43 UTC
Sent	20 Jun 2011, 23:02:45 UTC
Report deadline	20 Sep 2011, 6:29:56 UTC
Received	24 Jul 2011, 7:14:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1101782
Run time	4 days 18 hours 3 min 44 sec
CPU time	4 days 5 hours 27 min 50 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.82 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:34:01 (5140): No heartbeat from core client for 30 sec - exiting 20:34:02 (5140): No heartbeat from core client for 30 sec - exiting 20:34:03 (5140): No heartbeat from core client for 30 sec - exiting 20:34:04 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:06:32 (6672): No heartbeat from core client for 30 sec - exiting 19:06:33 (6672): No heartbeat from core client for 30 sec - exiting 19:06:34 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:06:35 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:06:33 (11220): Can't acquire lockfile (32) - waiting 35s 00:07:53 (11244): Can't acquire lockfile (32) - waiting 35s 00:08:24 (10444): Can't acquire lockfile (32) - waiting 35s 00:11:24 (5728): Can't acquire lockfile (32) - waiting 35s 00:11:45 (11948): Can't acquire lockfile (32) - waiting 35s 00:12:05 (12376): Can't acquire lockfile (32) - waiting 35s 00:12:25 (12716): Can't acquire lockfile (32) - waiting 35s 00:13:56 (13892): Can't acquire lockfile (32) - waiting 35s 00:22:36 (13452): Can't acquire lockfile (32) - waiting 35s 00:22:56 (13760): Can't acquire lockfile (32) - waiting 35s 00:23:16 (14476): Can't acquire lockfile (32) - waiting 35s 00:23:38 (14652): Can't acquire lockfile (32) - waiting 35s 00:23:57 (14828): Can't acquire lockfile (32) - waiting 35s 00:24:18 (15056): Can't acquire lockfile (32) - waiting 35s 00:24:38 (15232): Can't acquire lockfile (32) - waiting 35s 00:24:58 (13400): Can't acquire lockfile (32) - waiting 35s 00:25:19 (13956): Can't acquire lockfile (32) - waiting 35s 00:25:39 (15500): Can't acquire lockfile (32) - waiting 35s 00:25:59 (15688): Can't acquire lockfile (32) - waiting 35s 00:26:19 (15912): Can't acquire lockfile (32) - waiting 35s 00:26:40 (16092): Can't acquire lockfile (32) - waiting 35s 00:27:00 (16252): Can't acquire lockfile (32) - waiting 35s 00:27:20 (15684): Can't acquire lockfile (32) - waiting 35s 00:27:40 (13476): Can't acquire lockfile (32) - waiting 35s 00:28:01 (16576): Can't acquire lockfile (32) - waiting 35s 00:28:21 (16756): Can't acquire lockfile (32) - waiting 35s 00:28:42 (16952): Can't acquire lockfile (32) - waiting 35s 00:29:03 (17224): Can't acquire lockfile (32) - waiting 35s 00:29:24 (13636): Can't acquire lockfile (32) - waiting 35s 00:29:44 (16896): Can't acquire lockfile (32) - waiting 35s 00:30:05 (16940): Can't acquire lockfile (32) - waiting 35s 00:30:26 (17568): Can't acquire lockfile (32) - waiting 35s 00:30:49 (17772): Can't acquire lockfile (32) - waiting 35s 00:31:07 (17960): Can't acquire lockfile (32) - waiting 35s 00:31:27 (18160): Can't acquire lockfile (32) - waiting 35s 00:31:48 (18360): Can't acquire lockfile (32) - waiting 35s 00:32:08 (7564): Can't acquire lockfile (32) - waiting 35s 00:32:31 (17460): Can't acquire lockfile (32) - waiting 35s 00:32:51 (17396): Can't acquire lockfile (32) - waiting 35s 00:33:11 (18608): Can't acquire lockfile (32) - waiting 35s 00:33:33 (18808): Can't acquire lockfile (32) - waiting 35s 00:33:54 (19024): Can't acquire lockfile (32) - waiting 35s 00:34:11 (19188): Can't acquire lockfile (32) - waiting 35s 00:34:32 (19384): Can't acquire lockfile (32) - waiting 35s 00:34:55 (17740): Can't acquire lockfile (32) - waiting 35s 00:35:13 (19508): Can't acquire lockfile (32) - waiting 35s 00:35:36 (19752): Can't acquire lockfile (32) - waiting 35s 00:35:57 (19920): Can't acquire lockfile (32) - waiting 35s 00:36:17 (20108): Can't acquire lockfile (32) - waiting 35s 00:36:38 (20312): Can't acquire lockfile (32) - waiting 35s 00:36:58 (18576): Can't acquire lockfile (32) - waiting 35s 00:38:09 (18308): Can't acquire lockfile (32) - waiting 35s 00:38:29 (20672): Can't acquire lockfile (32) - waiting 35s 00:38:49 (20856): Can't acquire lockfile (32) - waiting 35s 00:39:12 (21100): Can't acquire lockfile (32) - waiting 35s 00:39:29 (21284): Can't acquire lockfile (32) - waiting 35s 00:39:52 (20592): Can't acquire lockfile (32) - waiting 35s 00:40:12 (20280): Can't acquire lockfile (32) - waiting 35s 00:40:33 (19696): Can't acquire lockfile (32) - waiting 35s 00:40:52 (21600): Can't acquire lockfile (32) - waiting 35s 00:41:14 (21820): Can't acquire lockfile (32) - waiting 35s 00:41:36 (22040): Can't acquire lockfile (32) - waiting 35s 00:41:55 (22208): Can't acquire lockfile (32) - waiting 35s 00:42:14 (22376): Can't acquire lockfile (32) - waiting 35s 00:42:37 (21444): Can't acquire lockfile (32) - waiting 35s 00:42:56 (13128): Can't acquire lockfile (32) - waiting 35s 00:43:18 (22536): Can't acquire lockfile (32) - waiting 35s 00:43:38 (22716): Can't acquire lockfile (32) - waiting 35s 00:43:59 (22928): Can't acquire lockfile (32) - waiting 35s 00:44:19 (23108): Can't acquire lockfile (32) - waiting 35s 00:44:50 (23344): Can't acquire lockfile (32) - waiting 35s 00:45:10 (21532): Can't acquire lockfile (32) - waiting 35s 00:45:37 (23340): Can't acquire lockfile (32) - waiting 35s 00:45:51 (23688): Can't acquire lockfile (32) - waiting 35s 00:46:10 (23892): Can't acquire lockfile (32) - waiting 35s 00:46:30 (24128): Can't acquire lockfile (32) - waiting 35s 00:46:52 (24316): Can't acquire lockfile (32) - waiting 35s 00:47:12 (24496): Can't acquire lockfile (32) - waiting 35s 00:47:33 (23508): Can't acquire lockfile (32) - waiting 35s 00:47:53 (24064): Can't acquire lockfile (32) - waiting 35s 00:48:14 (24604): Can't acquire lockfile (32) - waiting 35s 00:48:35 (24780): Can't acquire lockfile (32) - waiting 35s 00:48:56 (24984): Can't acquire lockfile (32) - waiting 35s 00:49:20 (25176): Can't acquire lockfile (32) - waiting 35s 00:49:42 (25360): Can't acquire lockfile (32) - waiting 35s 00:50:01 (25576): Can't acquire lockfile (32) - waiting 35s 00:50:22 (22012): Can't acquire lockfile (32) - waiting 35s 00:50:42 (25608): Can't acquire lockfile (32) - waiting 35s 00:51:02 (25856): Can't acquire lockfile (32) - waiting 35s 00:51:23 (26056): Can't acquire lockfile (32) - waiting 35s 00:51:40 (26248): Can't acquire lockfile (32) - waiting 35s 00:52:04 (26536): Can't acquire lockfile (32) - waiting 35s 00:52:25 (24928): Can't acquire lockfile (32) - waiting 35s 00:52:45 (17924): Can't acquire lockfile (32) - waiting 35s 00:53:06 (26728): Can't acquire lockfile (32) - waiting 35s 00:54:45 (27156): Can't acquire lockfile (32) - waiting 35s 00:55:03 (27356): Can't acquire lockfile (32) - waiting 35s 00:55:29 (27624): Can't acquire lockfile (32) - waiting 35s 00:55:44 (26872): Can't acquire lockfile (32) - waiting 35s 00:56:07 (27012): Can't acquire lockfile (32) - waiting 35s 00:56:28 (27036): Can't acquire lockfile (32) - waiting 35s 00:56:48 (27780): Can't acquire lockfile (32) - waiting 35s 00:57:09 (27956): Can't acquire lockfile (32) - waiting 35s 00:57:30 (28156): Can't acquire lockfile (32) - waiting 35s 00:57:50 (28424): Can't acquire lockfile (32) - waiting 35s 00:58:10 (28668): Can't acquire lockfile (32) - waiting 35s 00:58:31 (24396): Can't acquire lockfile (32) - waiting 35s 00:58:49 (28732): Can't acquire lockfile (32) - waiting 35s 00:59:10 (28932): Can't acquire lockfile (32) - waiting 35s 00:59:40 (29128): Can't acquire lockfile (32) - waiting 35s 00:59:56 (29312): Can't acquire lockfile (32) - waiting 35s 01:00:37 (29604): Can't acquire lockfile (32) - waiting 35s 01:00:44 (27752): Can't acquire lockfile (32) - waiting 35s 01:01:15 (29024): Can't acquire lockfile (32) - waiting 35s 01:01:50 (29024): Can't acquire lockfile (32) - exiting 01:01:50 (29024): Error: The process cannot access the file because it is being used by another process. (0x20) 01:02:48 (30204): Can't acquire lockfile (32) - waiting 35s 01:03:16 (30496): Can't acquire lockfile (32) - waiting 35s 01:03:30 (30708): Can't acquire lockfile (32) - waiting 35s 01:03:49 (29432): Can't acquire lockfile (32) - waiting 35s 01:04:24 (29432): Can't acquire lockfile (32) - exiting 01:04:24 (29432): Error: The process cannot access the file because it is being used by another process. (0x20) 01:05:25 (28912): Can't acquire lockfile (32) - waiting 35s 01:06:00 (28912): Can't acquire lockfile (32) - exiting 01:06:00 (28912): Error: The process cannot access the file because it is being used by another process. (0x20) CPDN Monitor - Quit request from BOINC... 22:03:17 (8160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2788, selfPID=2788, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 12:36:07 (7748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:09 (7748): No heartbeat from core client for 30 sec - exiting 12:36:10 (7748): No heartbeat from core client for 30 sec - exiting 12:36:11 (7748): No heartbeat from core client for 30 sec - exiting 12:36:12 (7748): No heartbeat from core client for 30 sec - exiting 12:36:13 (7748): No heartbeat from core client for 30 sec - exiting 12:36:14 (7748): No heartbeat from core client for 30 sec - exiting 12:36:15 (7748): No heartbeat from core client for 30 sec - exiting 12:36:16 (7748): No heartbeat from core client for 30 sec - exiting 12:36:17 (7748): No heartbeat from core client for 30 sec - exiting 12:36:18 (7748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:06:29 (1476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=716, selfPID=716, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/s5xjko.pje6c10 Error converting file to netcdf: dataout/s5xjko.pie6c10 Error converting file to netcdf: dataout/s5xjko.pfe6c10 Error converting file to netcdf: dataout/s5xjka.phe6c10 Error converting file to netcdf: dataout/s5xjka.pge6c10 Error converting file to netcdf: dataout/s5xjka.pee6c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 21:54:19	1101782	12991434	hadcm3n_s5xj_1940_40_007300354_1	233,280	376,872	1.6155
25 Jul 2011 21:04:45	1101782	12991434	hadcm3n_s5xj_1940_40_007300354_1	207,360	343,354	1.6558
25 Jul 2011 20:59:12	1101782	12991434	hadcm3n_s5xj_1940_40_007300354_1	181,440	307,871	1.6968
25 Jul 2011 20:59:12	1101782	12991434	hadcm3n_s5xj_1940_40_007300354_1	155,520	267,371	1.7192
25 Jul 2011 18:21:07	1101782	12991434	hadcm3n_s5xj_1940_40_007300354_1	129,600	224,236	1.7302
25 Jul 2011 15:54:03	1101782	12991434	hadcm3n_s5xj_1940_40_007300354_1	103,680	180,320	1.7392
09 Jul 2011 22:12:34	1101782	12991434	hadcm3n_s5xj_1940_40_007300354_1	77,760	132,587	1.7051
09 Jul 2011 03:32:34	1101782	12991434	hadcm3n_s5xj_1940_40_007300354_1	51,840	85,399	1.6474
27 Jun 2011 13:25:19	1101782	12991434	hadcm3n_s5xj_1940_40_007300354_1	25,920	36,846	1.4215