Task 14765685

Name	hadcm3n_o2r0_2060_40_007998658_2
Workunit	8153772
Created	1 Jun 2012, 23:04:28 UTC
Sent	1 Jun 2012, 23:05:18 UTC
Report deadline	1 Sep 2012, 6:32:29 UTC
Received	11 Jul 2012, 15:30:13 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	775427
Run time	25 days 4 hours 6 min 41 sec
CPU time	23 days 15 hours 2 min 59 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> 21:33:17 (29168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:19 (29168): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:35:27 (30300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:10 (32556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:12 (55888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:26:37 (67500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:18 (4752): No heartbeat from core client for 30 sec - exiting 15:11:19 (4752): No heartbeat from core client for 30 sec - exiting 15:11:20 (4752): No heartbeat from core client for 30 sec - exiting 15:11:21 (4752): No heartbeat from core client for 30 sec - exiting 15:11:22 (4752): No heartbeat from core client for 30 sec - exiting 15:11:23 (4752): No heartbeat from core client for 30 sec - exiting 15:11:24 (4752): No heartbeat from core client for 30 sec - exiting 15:11:25 (4752): No heartbeat from core client for 30 sec - exiting 15:11:26 (4752): No heartbeat from core client for 30 sec - exiting 15:11:27 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:26:29 (15260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:30 (15260): No heartbeat from core client for 30 sec - exiting 16:07:34 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:59 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:52 (58096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:57:44 (64376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=96540, iMonCtr=1 Model crash detected, will try to restart... 20:31:11 (1112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:52:36 (34036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6100, iMonCtr=1 Model crash detected, will try to restart... 22:16:48 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:44 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:40:43 (22848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:19:46 (41008): No heartbeat from core client for 30 sec - exiting 14:19:47 (41008): No heartbeat from core client for 30 sec - exiting 14:19:48 (41008): No heartbeat from core client for 30 sec - exiting 14:19:49 (41008): No heartbeat from core client for 30 sec - exiting 14:19:50 (41008): No heartbeat from core client for 30 sec - exiting 14:19:51 (41008): No heartbeat from core client for 30 sec - exiting 14:19:52 (41008): No heartbeat from core client for 30 sec - exiting 14:19:53 (41008): No heartbeat from core client for 30 sec - exiting 14:19:54 (41008): No heartbeat from core client for 30 sec - exiting 14:19:55 (41008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:54:23 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:51:28 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:33:41 (4800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3388, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3712, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5604, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 15:45:21 (4540): No heartbeat from core client for 30 sec - exiting 15:45:22 (4540): No heartbeat from core client for 30 sec - exiting 15:45:23 (4540): No heartbeat from core client for 30 sec - exiting 15:45:24 (4540): No heartbeat from core client for 30 sec - exiting 15:45:25 (4540): No heartbeat from core client for 30 sec - exiting 15:45:26 (4540): No heartbeat from core client for 30 sec - exiting 15:45:27 (4540): No heartbeat from core client for 30 sec - exiting 15:45:28 (4540): No heartbeat from core client for 30 sec - exiting 15:45:29 (4540): No heartbeat from core client for 30 sec - exiting 15:45:30 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3432, iMonCtr=1 Model crash detected, will try to restart... 01:34:19 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:20:04 (10508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:12 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7268, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3588, iMonCtr=1 Model crash detected, will try to restart... 18:06:56 (1680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:31:07 (2432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11896, iMonCtr=1 Model crash detected, will try to restart... 17:41:32 (1816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:43:04 (6304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8308, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 10:52:54 (3176): No heartbeat from core client for 30 sec - exiting 10:52:56 (3176): No heartbeat from core client for 30 sec - exiting 10:52:57 (3176): No heartbeat from core client for 30 sec - exiting 10:52:58 (3176): No heartbeat from core client for 30 sec - exiting 10:52:59 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) 09:38:31 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:43:53 (4088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=1 Model crash detected, will try to restart... 07:26:51 (2628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:46 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:48 (8016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8048, iMonCtr=1 Model crash detected, will try to restart... 16:35:06 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7216, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1 Model crash detected, will try to restart... 11:25:15 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:28:58 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o2r0ko.pjt9c10 Error converting file to netcdf: dataout/o2r0ko.pit9c10 Error converting file to netcdf: dataout/o2r0ko.pft9c10 Error converting file to netcdf: dataout/o2r0ka.pht9c10 Error converting file to netcdf: dataout/o2r0ka.pgt9c10 Error converting file to netcdf: dataout/o2r0ka.pet9c10 Error converting file to netcdf: dataout/o2r0ka.pdt9c10 07:36:36 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:57:00 (6356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:58:25 (9044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Jul 2012 15:30:14	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	1,036,800	2,040,622	1.9682
10 Jul 2012 13:41:23	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	1,010,880	1,991,278	1.9698
09 Jul 2012 02:08:40	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	984,960	1,940,189	1.9698
08 Jul 2012 01:13:39	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	959,040	1,891,991	1.9728
07 Jul 2012 00:38:48	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	933,120	1,839,397	1.9712
06 Jul 2012 01:32:55	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	907,200	1,789,214	1.9722
04 Jul 2012 19:39:36	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	881,280	1,740,392	1.9748
03 Jul 2012 18:47:20	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	855,360	1,689,923	1.9757
02 Jul 2012 20:55:44	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	829,440	1,639,783	1.9770
02 Jul 2012 20:55:44	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	803,520	1,589,655	1.9784
02 Jul 2012 20:55:44	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	777,600	1,539,224	1.9795
30 Jun 2012 01:20:48	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	751,680	1,488,905	1.9808
29 Jun 2012 01:57:10	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	725,760	1,436,924	1.9799
28 Jun 2012 01:11:17	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	699,840	1,384,225	1.9779
27 Jun 2012 09:38:49	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	673,920	1,331,720	1.9761
26 Jun 2012 16:23:24	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	648,000	1,279,358	1.9743
25 Jun 2012 04:24:23	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	622,080	1,226,847	1.9722
24 Jun 2012 13:19:34	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	596,160	1,174,677	1.9704
23 Jun 2012 22:23:41	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	570,240	1,123,201	1.9697
23 Jun 2012 07:57:22	775427	14765685	hadcm3n_o2r0_2060_40_007998658_2	544,320	1,073,292	1.9718