Task 16153872

Name	hadcm3n_o5u8_1940_40_008411080_4
Workunit	8561936
Created	23 Dec 2013, 10:59:28 UTC
Sent	23 Dec 2013, 10:59:36 UTC
Report deadline	24 Mar 2014, 18:26:47 UTC
Received	22 Jan 2014, 17:09:30 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	22 (0x00000016) Unknown error code
Computer ID	867786
Run time	6 days 21 hours 23 min 53 sec
CPU time	6 days 21 hours 23 min 53 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	2.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.10.30</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:18:18 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:28:38 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:51:22 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:00:16 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:03 (896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:02:54 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:57:49 (4240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:05:03 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:13:53 (1704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:12:59 (1248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:34 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:11:03 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:47:34 (6132): No heartbeat from core client for 30 sec - exiting 19:47:35 (6132): No heartbeat from core client for 30 sec - exiting 19:47:37 (6132): No heartbeat from core client for 30 sec - exiting 19:47:38 (6132): No heartbeat from core client for 30 sec - exiting 19:47:39 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o5u8ko.pje7c10 Error converting file to netcdf: dataout/o5u8ko.pie7c10 Error converting file to netcdf: dataout/o5u8ko.pfe7c10 Error converting file to netcdf: dataout/o5u8ka.phe7c10 Error converting file to netcdf: dataout/o5u8ka.pge7c10 Error converting file to netcdf: dataout/o5u8ka.pee7c10 Error converting file to netcdf: dataout/o5u8ka.pde7c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:12:11 (1376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:20:33 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:58 (4928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:52 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:37:11 (280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:49:45 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:11:56 (1360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:51:33 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:33 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:26:51 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:31 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:15:10 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:56:46 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:01 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:10:10 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:31:07 (1268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:59 (3448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:41:37 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:59:57 (2904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:02:37 (7756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:02:06 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:55:57 (8136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:15:56 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:43:20 (7960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:15:01 (3412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:07:03 (8088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:37:58 (3784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:36 (7704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:53:58 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:47:11 (7912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:21 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:15 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:44 (6176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:38:40 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:33:47 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:02:39 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:33 (644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:58:53 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:40:24 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:58:07 (516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:24 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:43:49 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:55 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:08:58 (6208): No heartbeat from core client for 30 sec - exiting 21:09:00 (6208): No heartbeat from core client for 30 sec - exiting 21:09:02 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:04 (6208): No heartbeat from core client for 30 sec - exiting 21:09:08 (6208): No heartbeat from core client for 30 sec - exiting 00:27:01 (7824): No heartbeat from core client for 30 sec - exiting 00:27:02 (7824): No heartbeat from core client for 30 sec - exiting 00:27:03 (7824): No heartbeat from core client for 30 sec - exiting 00:27:04 (7824): No heartbeat from core client for 30 sec - exiting 00:27:05 (7824): No heartbeat from core client for 30 sec - exiting 00:27:06 (7824): No heartbeat from core client for 30 sec - exiting 00:27:07 (7824): No heartbeat from core client for 30 sec - exiting 00:27:08 (7824): No heartbeat from core client for 30 sec - exiting 00:27:09 (7824): No heartbeat from core client for 30 sec - exiting 00:27:10 (7824): No heartbeat from core client for 30 sec - exiting 00:27:11 (7824): No heartbeat from core client for 30 sec - exiting 00:27:12 (7824): No heartbeat from core client for 30 sec - exiting 00:27:13 (7824): No heartbeat from core client for 30 sec - exiting 00:27:14 (7824): No heartbeat from core client for 30 sec - exiting 00:27:15 (7824): No heartbeat from core client for 30 sec - exiting 00:27:16 (7824): No heartbeat from core client for 30 sec - exiting 00:27:17 (7824): No heartbeat from core client for 30 sec - exiting 00:27:18 (7824): No heartbeat from core client for 30 sec - exiting 00:27:19 (7824): No heartbeat from core client for 30 sec - exiting 00:27:20 (7824): No heartbeat from core client for 30 sec - exiting 00:27:21 (7824): No heartbeat from core client for 30 sec - exiting 00:27:22 (7824): No heartbeat from core client for 30 sec - exiting 00:27:23 (7824): No heartbeat from core client for 30 sec - exiting 00:27:24 (7824): No heartbeat from core client for 30 sec - exiting 00:27:25 (7824): No heartbeat from core client for 30 sec - exiting 00:27:26 (7824): No heartbeat from core client for 30 sec - exiting 00:27:27 (7824): No heartbeat from core client for 30 sec - exiting 00:27:28 (7824): No heartbeat from core client for 30 sec - exiting 00:27:29 (7824): No heartbeat from core client for 30 sec - exiting 00:27:30 (7824): No heartbeat from core client for 30 sec - exiting 00:27:31 (7824): No heartbeat from core client for 30 sec - exiting 00:27:32 (7824): No heartbeat from core client for 30 sec - exiting 00:27:33 (7824): No heartbeat from core client for 30 sec - exiting 00:27:34 (7824): No heartbeat from core client for 30 sec - exiting 00:27:35 (7824): No heartbeat from core client for 30 sec - exiting 00:27:36 (7824): No heartbeat from core client for 30 sec - exiting 00:27:37 (7824): No heartbeat from core client for 30 sec - exiting 00:27:38 (7824): No heartbeat from core client for 30 sec - exiting 00:27:39 (7824): No heartbeat from core client for 30 sec - exiting 00:27:40 (7824): No heartbeat from core client for 30 sec - exiting 00:27:41 (7824): No heartbeat from core client for 30 sec - exiting 00:27:42 (7824): No heartbeat from core client for 30 sec - exiting 00:27:43 (7824): No heartbeat from core client for 30 sec - exiting 00:27:44 (7824): No heartbeat from core client for 30 sec - exiting 00:27:45 (7824): No heartbeat from core client for 30 sec - exiting 00:27:46 (7824): No heartbeat from core client for 30 sec - exiting 00:27:47 (7824): No heartbeat from core client for 30 sec - exiting 00:27:48 (7824): No heartbeat from core client for 30 sec - exiting 00:27:49 (7824): No heartbeat from core client for 30 sec - exiting 00:27:50 (7824): No heartbeat from core client for 30 sec - exiting 00:27:51 (7824): No heartbeat from core client for 30 sec - exiting 00:27:52 (7824): No heartbeat from core client for 30 sec - exiting 00:27:53 (7824): No heartbeat from core client for 30 sec - exiting 00:27:54 (7824): No heartbeat from core client for 30 sec - exiting 00:27:55 (7824): No heartbeat from core client for 30 sec - exiting 00:27:56 (7824): No heartbeat from core client for 30 sec - exiting 00:27:57 (7824): No heartbeat from core client for 30 sec - exiting 00:27:58 (7824): No heartbeat from core client for 30 sec - exiting 00:27:59 (7824): No heartbeat from core client for 30 sec - exiting 00:28:00 (7824): No heartbeat from core client for 30 sec - exiting 00:28:01 (7824): No heartbeat from core client for 30 sec - exiting 00:28:02 (7824): No heartbeat from core client for 30 sec - exiting 00:28:03 (7824): No heartbeat from core client for 30 sec - exiting 00:28:04 (7824): No heartbeat from core client for 30 sec - exiting 00:28:05 (7824): No heartbeat from core client for 30 sec - exiting 00:28:06 (7824): No heartbeat from core client for 30 sec - exiting 00:28:07 (7824): No heartbeat from core client for 30 sec - exiting 00:28:08 (7824): No heartbeat from core client for 30 sec - exiting 00:28:09 (7824): No heartbeat from core client for 30 sec - exiting 00:28:10 (7824): No heartbeat from core client for 30 sec - exiting 00:28:11 (7824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:12 (7824): No heartbeat from core client for 30 sec - exiting 00:28:13 (7824): No heartbeat from core client for 30 sec - exiting 00:28:14 (7824): No heartbeat from core client for 30 sec - exiting 00:28:15 (7824): No heartbeat from core client for 30 sec - exiting 00:28:16 (7824): No heartbeat from core client for 30 sec - exiting 00:28:17 (7824): No heartbeat from core client for 30 sec - exiting 00:28:18 (7824): No heartbeat from core client for 30 sec - exiting 00:28:19 (7824): No heartbeat from core client for 30 sec - exiting 00:28:20 (7824): No heartbeat from core client for 30 sec - exiting 00:28:21 (7824): No heartbeat from core client for 30 sec - exiting 00:30:33 (6496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:23:16 (8116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:43 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:44 (6196): No heartbeat from core client for 30 sec - exiting 07:23:45 (6196): No heartbeat from core client for 30 sec - exiting 07:23:46 (6196): No heartbeat from core client for 30 sec - exiting 07:23:47 (6196): No heartbeat from core client for 30 sec - exiting 07:23:48 (6196): No heartbeat from core client for 30 sec - exiting 07:23:49 (6196): No heartbeat from core client for 30 sec - exiting 07:23:51 (6196): No heartbeat from core client for 30 sec - exiting 07:23:52 (6196): No heartbeat from core client for 30 sec - exiting 07:23:53 (6196): No heartbeat from core client for 30 sec - exiting 07:23:54 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:24:01 (704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:02 (704): No heartbeat from core client for 30 sec - exiting 11:24:03 (704): No heartbeat from core client for 30 sec - exiting 11:24:04 (704): No heartbeat from core client for 30 sec - exiting 11:24:05 (704): No heartbeat from core client for 30 sec - exiting 11:24:06 (704): No heartbeat from core client for 30 sec - exiting 11:24:07 (704): No heartbeat from core client for 30 sec - exiting 11:24:08 (704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 14:29:00 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:29:01 (2752): No heartbeat from core client for 30 sec - exiting 14:29:02 (2752): No heartbeat from core client for 30 sec - exiting 14:29:03 (2752): No heartbeat from core client for 30 sec - exiting 14:29:04 (2752): No heartbeat from core client for 30 sec - exiting 14:29:05 (2752): No heartbeat from core client for 30 sec - exiting 14:29:06 (2752): No heartbeat from core client for 30 sec - exiting 14:29:07 (2752): No heartbeat from core client for 30 sec - exiting 14:29:08 (2752): No heartbeat from core client for 30 sec - exiting 14:29:09 (2752): No heartbeat from core client for 30 sec - exiting 14:29:10 (2752): No heartbeat from core client for 30 sec - exiting 14:29:11 (2752): No heartbeat from core client for 30 sec - exiting 14:29:12 (2752): No heartbeat from core client for 30 sec - exiting 14:31:28 (3548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:56 (7296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Jan 2014 02:38:44	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	440,640	565,018	1.2823
20 Jan 2014 07:35:04	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	414,720	532,113	1.2831
19 Jan 2014 17:36:25	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	388,800	499,747	1.2854
18 Jan 2014 20:37:17	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	362,880	466,656	1.2860
18 Jan 2014 00:50:15	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	336,960	433,614	1.2868
17 Jan 2014 09:32:21	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	311,040	400,589	1.2879
16 Jan 2014 13:29:31	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	285,120	367,517	1.2890
15 Jan 2014 16:17:34	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	259,200	334,479	1.2904
15 Jan 2014 01:12:03	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	233,280	301,723	1.2934
14 Jan 2014 12:59:21	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	207,360	269,257	1.2985
12 Jan 2014 00:11:23	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	181,440	236,319	1.3025
07 Jan 2014 06:37:26	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	155,520	202,578	1.3026
04 Jan 2014 22:42:39	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	129,600	168,834	1.3027
02 Jan 2014 05:14:38	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	103,680	135,057	1.3026
30 Dec 2013 08:51:58	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	77,760	101,297	1.3027
28 Dec 2013 03:34:19	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	51,840	67,618	1.3044
26 Dec 2013 01:52:06	867786	16153872	hadcm3n_o5u8_1940_40_008411080_4	25,920	33,883	1.3072