Task 16296260

Name	hadcm3n_87bz_1980_40_008516006_0
Workunit	8663518
Created	26 Feb 2014, 16:17:13 UTC
Sent	26 Feb 2014, 16:32:56 UTC
Report deadline	29 May 2014, 0:00:07 UTC
Received	1 Jul 2014, 9:47:36 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	22 (0x00000016) Unknown error code
Computer ID	1181244
Run time	24 days 6 hours 7 min 12 sec
CPU time	24 days 6 hours 7 min 12 sec
Validate state	Invalid
Credit	7,153.92
Device peak FLOPS	1.45 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.3.19</core_client_version> <message>The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:26:28 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 09:07:01 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:07:03 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:30:46 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:08:43 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:08:45 (6116): No heartbeat from core client for 30 sec - exiting 10:08:46 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on 87bzko.daj0c20 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:34:57 (5244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:59 (5244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:31:50 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 17:41:58 (6732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 17:53:10 (6368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 18:13:17 (6040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 18:24:30 (6792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 18:44:37 (7140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 18:55:50 (612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 19:15:57 (6648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 19:27:09 (7060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 19:47:17 (10012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 19:58:40 (8284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 20:18:47 (3528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/87bzko.pjj2c10 Error converting file to netcdf: dataout/87bzko.pij2c10 Error converting file to netcdf: dataout/87bzko.pfj2c10 Error converting file to netcdf: dataout/87bzka.phj2c10 Error converting file to netcdf: dataout/87bzka.pgj2c10 Error converting file to netcdf: dataout/87bzka.pej2c10 Error converting file to netcdf: dataout/87bzka.pdj2c10 20:33:26 (9824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 20:53:32 (6324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 21:14:31 (7148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:42 (10216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:51 (9692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:15:56 (7908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:02 (8688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:11 (10120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:10:30 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:00:05 (5600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:06 (5600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 16:45:20 (2408): No heartbeat from core client for 30 sec - exiting 16:45:21 (2408): No heartbeat from core client for 30 sec - exiting 16:45:22 (2408): No heartbeat from core client for 30 sec - exiting 16:45:23 (2408): No heartbeat from core client for 30 sec - exiting 16:45:25 (2408): No heartbeat from core client for 30 sec - exiting 16:45:28 (2408): No heartbeat from core client for 30 sec - exiting 16:45:29 (2408): No heartbeat from core client for 30 sec - exiting 16:45:30 (2408): No heartbeat from core client for 30 sec - exiting 16:45:31 (2408): No heartbeat from core client for 30 sec - exiting 16:45:32 (2408): No heartbeat from core client for 30 sec - exiting 16:45:33 (2408): No heartbeat from core client for 30 sec - exiting 16:45:34 (2408): No heartbeat from core client for 30 sec - exiting 16:45:35 (2408): No heartbeat from core client for 30 sec - exiting 16:45:36 (2408): No heartbeat from core client for 30 sec - exiting 16:45:37 (2408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on 87bzko.daj56p0 20:57:20 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:21 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:57:30 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:00:58 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:00 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:14:33 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Jun 2014 18:07:42	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	596,160	2,032,041	3.4085
11 Jun 2014 10:57:11	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	570,240	1,945,223	3.4112
03 Jun 2014 14:42:47	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	544,320	1,857,125	3.4118
30 May 2014 18:38:10	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	518,400	1,770,107	3.4146
27 May 2014 17:32:49	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	492,480	1,683,267	3.4179
24 May 2014 19:48:56	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	466,560	1,591,377	3.4109
16 May 2014 20:04:21	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	440,640	1,501,876	3.4084
13 May 2014 11:14:43	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	414,720	1,413,596	3.4086
07 May 2014 14:24:47	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	388,800	1,326,666	3.4122
01 May 2014 13:59:35	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	362,880	1,238,971	3.4143
28 Apr 2014 14:13:15	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	336,960	1,151,071	3.4160
23 Apr 2014 09:10:50	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	311,040	1,062,842	3.4171
15 Apr 2014 18:17:38	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	285,120	975,439	3.4212
11 Apr 2014 14:05:15	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	259,200	885,955	3.4180
08 Apr 2014 13:07:38	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	233,280	797,101	3.4169
03 Apr 2014 10:41:23	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	207,360	708,782	3.4181
01 Apr 2014 01:13:20	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	181,440	618,096	3.4066
25 Mar 2014 23:23:33	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	155,520	530,718	3.4125
21 Mar 2014 12:41:14	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	129,600	444,062	3.4264
17 Mar 2014 09:25:29	1181244	16296260	hadcm3n_87bz_1980_40_008516006_0	103,680	351,455	3.3898