Task 12757818

Name	hadcm3n_o3up_1900_40_007200324_2
Workunit	7398604
Created	30 Mar 2011, 23:07:34 UTC
Sent	31 Mar 2011, 23:07:34 UTC
Report deadline	1 Jul 2011, 6:34:45 UTC
Received	27 Apr 2011, 12:29:24 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1105487
Run time	21 days 11 hours 48 min 41 sec
CPU time	21 days 5 hours 33 min 12 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.17 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 09:34:08 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:34:55 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:54:39 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:40 (5524): No heartbeat from core client for 30 sec - exiting 08:54:41 (5524): No heartbeat from core client for 30 sec - exiting 08:54:42 (5524): No heartbeat from core client for 30 sec - exiting 16:12:12 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:14:54 (2732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:14:55 (2732): No heartbeat from core client for 30 sec - exiting 15:14:57 (2732): No heartbeat from core client for 30 sec - exiting 15:14:58 (2732): No heartbeat from core client for 30 sec - exiting 15:14:59 (2732): No heartbeat from core client for 30 sec - exiting 17:28:34 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:28:35 (3852): No heartbeat from core client for 30 sec - exiting 17:28:36 (3852): No heartbeat from core client for 30 sec - exiting 17:28:37 (3852): No heartbeat from core client for 30 sec - exiting 17:28:38 (3852): No heartbeat from core client for 30 sec - exiting 17:28:39 (3852): No heartbeat from core client for 30 sec - exiting 17:28:40 (3852): No heartbeat from core client for 30 sec - exiting 17:28:41 (3852): No heartbeat from core client for 30 sec - exiting 17:28:42 (3852): No heartbeat from core client for 30 sec - exiting 17:28:43 (3852): No heartbeat from core client for 30 sec - exiting 17:28:45 (3852): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:08:51 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:52 (4408): No heartbeat from core client for 30 sec - exiting 01:08:53 (4408): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:55:04 (6084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:05 (6084): No heartbeat from core client for 30 sec - exiting 20:55:06 (6084): No heartbeat from core client for 30 sec - exiting 20:55:07 (6084): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4040, iMonCtr=1 Model crash detected, will try to restart... 05:11:48 (3716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:11:49 (3716): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 07:27:42 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:43 (4368): No heartbeat from core client for 30 sec - exiting 07:27:44 (4368): No heartbeat from core client for 30 sec - exiting 07:27:45 (4368): No heartbeat from core client for 30 sec - exiting 07:27:46 (4368): No heartbeat from core client for 30 sec - exiting 07:27:47 (4368): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:47:04 (1104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:47:05 (1104): No heartbeat from core client for 30 sec - exiting 22:47:06 (1104): No heartbeat from core client for 30 sec - exiting 22:47:07 (1104): No heartbeat from core client for 30 sec - exiting 22:47:08 (1104): No heartbeat from core client for 30 sec - exiting 14:44:46 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:47 (3256): No heartbeat from core client for 30 sec - exiting 14:44:48 (3256): No heartbeat from core client for 30 sec - exiting 22:31:12 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:40 (4360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:41 (4360): No heartbeat from core client for 30 sec - exiting 14:56:42 (4360): No heartbeat from core client for 30 sec - exiting 14:56:43 (4360): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:13:00 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:57:03 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:34 (6040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:35 (6040): No heartbeat from core client for 30 sec - exiting 03:07:36 (6040): No heartbeat from core client for 30 sec - exiting 03:07:37 (6040): No heartbeat from core client for 30 sec - exiting 03:07:38 (6040): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 04:45:55 (2884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:41 (3384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:03 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2808, iMonCtr=1 Model crash detected, will try to restart... 22:46:56 (2808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:32:37 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:21:06 (6832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:05:57 (3284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3upko.pjd2c10 Error converting file to netcdf: dataout/o3upko.pid2c10 Error converting file to netcdf: dataout/o3upko.pfd2c10 Error converting file to netcdf: dataout/o3upka.phd2c10 Error converting file to netcdf: dataout/o3upka.pgd2c10 Error converting file to netcdf: dataout/o3upka.ped2c10 Error converting file to netcdf: dataout/o3upka.pdd2c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 19:24:42 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 18:59:18 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:19 (4276): No heartbeat from core client for 30 sec - exiting 18:59:21 (4276): No heartbeat from core client for 30 sec - exiting 18:59:22 (4276): No heartbeat from core client for 30 sec - exiting 18:59:23 (4276): No heartbeat from core client for 30 sec - exiting 18:59:24 (4276): No heartbeat from core client for 30 sec - exiting 18:59:25 (4276): No heartbeat from core client for 30 sec - exiting 18:59:26 (4276): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 12:48:15 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 19:16:23 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Apr 2011 09:49:41	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	1,036,800	1,833,692	1.7686
26 Apr 2011 20:36:05	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	1,010,880	1,786,469	1.7672
25 Apr 2011 18:11:35	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	984,960	1,739,541	1.7661
24 Apr 2011 15:27:15	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	959,040	1,692,821	1.7651
23 Apr 2011 14:37:23	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	933,120	1,648,397	1.7665
22 Apr 2011 15:09:57	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	907,200	1,602,421	1.7663
21 Apr 2011 14:57:37	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	881,280	1,556,204	1.7658
20 Apr 2011 18:26:16	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	855,360	1,510,140	1.7655
20 Apr 2011 18:26:16	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	829,440	1,464,254	1.7654
20 Apr 2011 18:26:16	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	803,520	1,418,329	1.7651
20 Apr 2011 18:26:16	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	777,600	1,372,466	1.7650
20 Apr 2011 18:26:16	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	751,680	1,326,612	1.7649
20 Apr 2011 18:26:16	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	725,760	1,280,750	1.7647
20 Apr 2011 18:26:16	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	699,840	1,234,652	1.7642
20 Apr 2011 18:26:16	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	673,920	1,188,558	1.7636
20 Apr 2011 18:26:16	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	648,000	1,142,463	1.7631
20 Apr 2011 18:26:15	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	622,080	1,096,347	1.7624
13 Apr 2011 08:06:26	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	596,160	1,050,335	1.7618
12 Apr 2011 20:09:50	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	570,240	1,004,302	1.7612
12 Apr 2011 09:08:19	1105487	12757818	hadcm3n_o3up_1900_40_007200324_2	544,320	958,583	1.7611