Task 13886673

Name	hadcm3n_ylh9_1940_40_007619026_4
Workunit	7797251
Created	7 Jan 2012, 21:02:39 UTC
Sent	7 Jan 2012, 21:02:45 UTC
Report deadline	8 Apr 2012, 4:29:56 UTC
Received	8 Mar 2012, 4:59:36 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	948809
Run time	30 days 10 hours 46 min 10 sec
CPU time	30 days 10 hours 46 min 10 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.17 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.4.5</core_client_version> <![CDATA[ <stderr_txt> 07:15:27 (7932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:26:21 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:23 (3852): No heartbeat from core client for 30 sec - exiting 13:48:37 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:38 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5012, selfPID=5012, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ylh9ko.pje9c10 Error converting file to netcdf: dataout/ylh9ko.pie9c10 Error converting file to netcdf: dataout/ylh9ko.pfe9c10 Error converting file to netcdf: dataout/ylh9ka.phe9c10 Error converting file to netcdf: dataout/ylh9ka.pge9c10 Error converting file to netcdf: dataout/ylh9ka.pee9c10 Error converting file to netcdf: dataout/ylh9ka.pde9c10 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1456, selfPID=1456, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ylh9ko.pje9c10 Error converting file to netcdf: dataout/ylh9ko.pie9c10 Error converting file to netcdf: dataout/ylh9ko.pfe9c10 Error converting file to netcdf: dataout/ylh9ka.phe9c10 Error converting file to netcdf: dataout/ylh9ka.pge9c10 Error converting file to netcdf: dataout/ylh9ka.pee9c10 Error converting file to netcdf: dataout/ylh9ka.pde9c10 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1912, selfPID=1912, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ylh9ko.pje9c10 Error converting file to netcdf: dataout/ylh9ko.pie9c10 Error converting file to netcdf: dataout/ylh9ko.pfe9c10 Error converting file to netcdf: dataout/ylh9ka.phe9c10 Error converting file to netcdf: dataout/ylh9ka.pge9c10 Error converting file to netcdf: dataout/ylh9ka.pee9c10 Error converting file to netcdf: dataout/ylh9ka.pde9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:05:43 (1544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:28:29 (8248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29364, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ylh9ko.pjf7c10 Error converting file to netcdf: dataout/ylh9ko.pif7c10 Error converting file to netcdf: dataout/ylh9ko.pff7c10 Error converting file to netcdf: dataout/ylh9ka.phf7c10 Error converting file to netcdf: dataout/ylh9ka.pgf7c10 Error converting file to netcdf: dataout/ylh9ka.pef7c10 Error converting file to netcdf: dataout/ylh9ka.pdf7c10 CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ylh9ko.daf8960 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:49:46 (27704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9516, iMonCtr=1 Model crash detected, will try to restart... 01:41:10 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:41:11 (4552): No heartbeat from core client for 30 sec - exiting 01:41:12 (4552): No heartbeat from core client for 30 sec - exiting 01:41:13 (4552): No heartbeat from core client for 30 sec - exiting 01:41:14 (4552): No heartbeat from core client for 30 sec - exiting 01:41:15 (4552): No heartbeat from core client for 30 sec - exiting 01:41:16 (4552): No heartbeat from core client for 30 sec - exiting 01:41:17 (4552): No heartbeat from core client for 30 sec - exiting 01:41:18 (4552): No heartbeat from core client for 30 sec - exiting 01:41:19 (4552): No heartbeat from core client for 30 sec - exiting 01:41:20 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:30:34 (7216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:24 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:08:33 (7320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:34 (7320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:59:56 (9880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:06:14 (9848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:06:15 (9848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:49:24 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:25 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Mar 2012 04:42:39	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	1,036,800	2,629,622	2.5363
02 Mar 2012 07:19:55	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	1,010,880	2,559,527	2.5320
01 Mar 2012 11:03:31	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	984,960	2,498,129	2.5363
29 Feb 2012 15:09:43	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	959,040	2,436,191	2.5402
28 Feb 2012 19:12:04	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	933,120	2,373,234	2.5433
27 Feb 2012 22:58:45	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	907,200	2,310,391	2.5467
27 Feb 2012 00:27:38	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	881,280	2,247,932	2.5508
25 Feb 2012 22:36:09	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	855,360	2,186,675	2.5564
25 Feb 2012 01:58:12	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	829,440	2,124,376	2.5612
24 Feb 2012 01:30:11	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	803,520	2,061,668	2.5658
23 Feb 2012 05:31:21	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	777,600	1,998,025	2.5695
18 Feb 2012 20:05:28	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	751,680	1,936,110	2.5757
17 Feb 2012 23:51:40	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	725,760	1,873,931	2.5820
17 Feb 2012 03:09:27	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	699,840	1,811,195	2.5880
16 Feb 2012 04:43:57	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	673,920	1,749,179	2.5955
15 Feb 2012 03:40:13	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	648,000	1,686,916	2.6033
14 Feb 2012 07:33:52	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	622,080	1,625,123	2.6124
04 Feb 2012 08:20:35	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	596,160	1,545,959	2.5932
02 Feb 2012 18:08:22	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	570,240	1,478,042	2.5920
01 Feb 2012 09:45:58	948809	13886673	hadcm3n_ylh9_1940_40_007619026_4	544,320	1,410,420	2.5912