Task 13006812

Name	hadcm3n_o3ou_1940_40_007308712_2
Workunit	7506136
Created	27 Jun 2011, 1:25:09 UTC
Sent	27 Jun 2011, 1:25:14 UTC
Report deadline	26 Sep 2011, 8:52:25 UTC
Received	7 Sep 2011, 13:11:43 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1101171
Run time	34 days 23 hours 23 min 18 sec
CPU time	33 days 7 hours 7 min 16 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:18:56 (6776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:44:39 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:35:19 (2884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 15:05:44 (580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 15:12:59 (7304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 17:21:09 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 08:07:24 (7164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 08:11:50 (8072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 16:32:55 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 16:36:02 (7624): No heartbeat from core client for 30 sec - exiting 16:36:03 (7624): No heartbeat from core client for 30 sec - exiting 16:36:04 (7624): No heartbeat from core client for 30 sec - exiting 16:36:05 (7624): No heartbeat from core client for 30 sec - exiting 16:36:06 (7624): No heartbeat from core client for 30 sec - exiting 16:36:07 (7624): No heartbeat from core client for 30 sec - exiting 16:36:08 (7624): No heartbeat from core client for 30 sec - exiting 16:36:09 (7624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 16:53:03 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 16:54:08 (2704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 16:57:54 (8180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 16:58:29 (9036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 17:05:39 (7272): No heartbeat from core client for 30 sec - exiting 17:05:40 (7272): No heartbeat from core client for 30 sec - exiting 17:05:41 (7272): No heartbeat from core client for 30 sec - exiting 17:05:42 (7272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 17:07:40 (7344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 14:33:55 (7732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 15:30:20 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 17:12:46 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 17:33:13 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjf6c10 Error converting file to netcdf: dataout/o3ouko.pif6c10 Error converting file to netcdf: dataout/o3ouko.pff6c10 Error converting file to netcdf: dataout/o3ouka.phf6c10 Error converting file to netcdf: dataout/o3ouka.pgf6c10 Error converting file to netcdf: dataout/o3ouka.pef6c10 Error converting file to netcdf: dataout/o3ouka.pdf6c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5788, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:54:39 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3ouko.pjh8c10 Error converting file to netcdf: dataout/o3ouko.pih8c10 Error converting file to netcdf: dataout/o3ouko.pfh8c10 Error converting file to netcdf: dataout/o3ouka.phh8c10 Error converting file to netcdf: dataout/o3ouka.pgh8c10 Error converting file to netcdf: dataout/o3ouka.peh8c10 Error converting file to netcdf: dataout/o3ouka.pdh8c10 13:32:31 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:31 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Sep 2011 03:04:02	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	1,036,800	2,875,724	2.7737
06 Sep 2011 05:14:43	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	1,010,880	2,802,870	2.7727
05 Sep 2011 20:14:34	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	984,960	2,732,566	2.7743
31 Aug 2011 21:49:58	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	959,040	2,660,835	2.7745
31 Aug 2011 00:08:58	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	933,120	2,589,207	2.7748
30 Aug 2011 09:12:25	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	907,200	2,519,766	2.7775
29 Aug 2011 04:34:20	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	881,280	2,450,441	2.7805
28 Aug 2011 08:01:01	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	855,360	2,380,940	2.7836
27 Aug 2011 10:31:15	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	829,440	2,307,224	2.7817
26 Aug 2011 12:35:41	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	803,520	2,231,916	2.7777
25 Aug 2011 14:48:23	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	777,600	2,154,704	2.7710
24 Aug 2011 15:15:35	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	751,680	2,077,513	2.7638
23 Aug 2011 16:31:06	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	725,760	2,000,438	2.7563
22 Aug 2011 17:38:44	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	699,840	1,923,184	2.7480
21 Aug 2011 19:16:05	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	673,920	1,845,848	2.7390
20 Aug 2011 21:19:03	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	648,000	1,768,245	2.7288
20 Aug 2011 00:58:18	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	622,080	1,696,321	2.7269
19 Aug 2011 05:02:42	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	596,160	1,625,482	2.7266
18 Aug 2011 08:27:28	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	570,240	1,550,714	2.7194
17 Aug 2011 12:03:20	1101171	13006812	hadcm3n_o3ou_1940_40_007308712_2	544,320	1,481,126	2.7211