Task 13340976

Name	hadcm3n_o1by_1900_40_007438971_3
Workunit	7636474
Created	6 Sep 2011, 17:59:52 UTC
Sent	6 Sep 2011, 18:12:14 UTC
Report deadline	7 Dec 2011, 1:39:25 UTC
Received	29 Nov 2011, 17:06:41 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1167974
Run time	9 days 17 hours 30 min 44 sec
CPU time	8 days 17 hours 50 min 28 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.71 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7008, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 20:45:11 (5976): No heartbeat from core client for 30 sec - exiting 20:45:12 (5976): No heartbeat from core client for 30 sec - exiting 20:45:13 (5976): No heartbeat from core client for 30 sec - exiting 20:45:14 (5976): No heartbeat from core client for 30 sec - exiting 20:45:16 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:17 (5976): No heartbeat from core client for 30 sec - exiting 20:45:18 (5976): No heartbeat from core client for 30 sec - exiting 20:45:19 (5976): No heartbeat from core client for 30 sec - exiting 20:45:20 (5976): No heartbeat from core client for 30 sec - exiting 20:45:21 (5976): No heartbeat from core client for 30 sec - exiting 20:45:22 (5976): No heartbeat from core client for 30 sec - exiting 20:45:23 (5976): No heartbeat from core client for 30 sec - exiting CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:59:23 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:53:31 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:02 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:40:37 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:00:26 (4840): No heartbeat from core client for 30 sec - exiting 00:00:27 (4840): No heartbeat from core client for 30 sec - exiting 00:00:28 (4840): No heartbeat from core client for 30 sec - exiting 00:00:29 (4840): No heartbeat from core client for 30 sec - exiting 00:00:30 (4840): No heartbeat from core client for 30 sec - exiting 00:00:32 (4840): No heartbeat from core client for 30 sec - exiting 00:00:33 (4840): No heartbeat from core client for 30 sec - exiting 00:00:34 (4840): No heartbeat from core client for 30 sec - exiting 00:00:35 (4840): No heartbeat from core client for 30 sec - exiting 00:00:36 (4840): No heartbeat from core client for 30 sec - exiting 00:00:37 (4840): No heartbeat from core client for 30 sec - exiting 00:00:38 (4840): No heartbeat from core client for 30 sec - exiting 00:00:39 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:11:30 (1220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:02 (5152): No heartbeat from core client for 30 sec - exiting 18:48:03 (5152): No heartbeat from core client for 30 sec - exiting 18:48:05 (5152): No heartbeat from core client for 30 sec - exiting 18:48:06 (5152): No heartbeat from core client for 30 sec - exiting 18:48:07 (5152): No heartbeat from core client for 30 sec - exiting 18:48:08 (5152): No heartbeat from core client for 30 sec - exiting 18:48:09 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:11:27 (4120): No heartbeat from core client for 30 sec - exiting 18:11:28 (4120): No heartbeat from core client for 30 sec - exiting 18:11:29 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:15:04 (3760): No heartbeat from core client for 30 sec - exiting 00:15:06 (3760): No heartbeat from core client for 30 sec - exiting 00:15:07 (3760): No heartbeat from core client for 30 sec - exiting 00:15:08 (3760): No heartbeat from core client for 30 sec - exiting 00:15:09 (3760): No heartbeat from core client for 30 sec - exiting 00:15:10 (3760): No heartbeat from core client for 30 sec - exiting 00:15:11 (3760): No heartbeat from core client for 30 sec - exiting 00:15:12 (3760): No heartbeat from core client for 30 sec - exiting 00:15:13 (3760): No heartbeat from core client for 30 sec - exiting 00:15:14 (3760): No heartbeat from core client for 30 sec - exiting 00:15:15 (3760): No heartbeat from core client for 30 sec - exiting 00:15:16 (3760): No heartbeat from core client for 30 sec - exiting 00:15:17 (3760): No heartbeat from core client for 30 sec - exiting 00:15:18 (3760): No heartbeat from core client for 30 sec - exiting 00:15:19 (3760): No heartbeat from core client for 30 sec - exiting 00:15:20 (3760): No heartbeat from core client for 30 sec - exiting 00:15:21 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:36 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:20:37 (2608): No heartbeat from core client for 30 sec - exiting 00:20:38 (2608): No heartbeat from core client for 30 sec - exiting 00:20:39 (2608): No heartbeat from core client for 30 sec - exiting 00:20:40 (2608): No heartbeat from core client for 30 sec - exiting 00:20:41 (2608): No heartbeat from core client for 30 sec - exiting 00:20:42 (2608): No heartbeat from core client for 30 sec - exiting 00:20:43 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:09:45 (5524): Can't acquire lockfile (32) - waiting 35s No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5612, selfPID=5612, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o1byko.pjc7c10 Error converting file to netcdf: dataout/o1byko.pic7c10 Error converting file to netcdf: dataout/o1byko.pfc7c10 Error converting file to netcdf: dataout/o1byka.phc7c10 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3292, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:36:00 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:54:32 (3428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:42:46 (5112): No heartbeat from core client for 30 sec - exiting 17:42:47 (5112): No heartbeat from core client for 30 sec - exiting 17:42:48 (5112): No heartbeat from core client for 30 sec - exiting 17:42:49 (5112): No heartbeat from core client for 30 sec - exiting 17:42:50 (5112): No heartbeat from core client for 30 sec - exiting 17:42:51 (5112): No heartbeat from core client for 30 sec - exiting 17:42:52 (5112): No heartbeat from core client for 30 sec - exiting 17:42:53 (5112): No heartbeat from core client for 30 sec - exiting 17:42:54 (5112): No heartbeat from core client for 30 sec - exiting 17:42:56 (5112): No heartbeat from core client for 30 sec - exiting 17:42:57 (5112): No heartbeat from core client for 30 sec - exiting 17:42:58 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:06:20 (2512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3560, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:37:14 (4476): No heartbeat from core client for 30 sec - exiting 09:37:16 (4476): No heartbeat from core client for 30 sec - exiting 09:37:17 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:31:47 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:06:49 (4416): No heartbeat from core client for 30 sec - exiting 15:06:51 (4416): No heartbeat from core client for 30 sec - exiting 15:06:52 (4416): No heartbeat from core client for 30 sec - exiting 15:06:53 (4416): No heartbeat from core client for 30 sec - exiting 15:06:54 (4416): No heartbeat from core client for 30 sec - exiting 15:06:55 (4416): No heartbeat from core client for 30 sec - exiting 15:06:56 (4416): No heartbeat from core client for 30 sec - exiting 15:06:57 (4416): No heartbeat from core client for 30 sec - exiting 15:06:58 (4416): No heartbeat from core client for 30 sec - exiting 15:06:59 (4416): No heartbeat from core client for 30 sec - exiting 15:07:00 (4416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Nov 2011 15:57:55	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	1,036,800	755,171	0.7284
27 Nov 2011 17:58:22	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	1,010,880	736,598	0.7287
27 Nov 2011 12:01:34	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	984,960	718,247	0.7292
24 Nov 2011 21:07:03	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	959,040	699,587	0.7295
22 Nov 2011 23:00:02	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	933,120	680,978	0.7298
20 Nov 2011 21:35:32	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	907,200	662,283	0.7300
16 Nov 2011 18:47:55	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	881,280	643,450	0.7301
15 Nov 2011 19:41:09	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	855,360	624,650	0.7303
15 Nov 2011 19:41:09	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	829,440	606,126	0.7308
15 Nov 2011 19:41:09	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	803,520	587,558	0.7312
09 Nov 2011 22:37:21	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	777,600	568,843	0.7315
08 Nov 2011 19:15:22	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	751,680	550,023	0.7317
06 Nov 2011 15:19:26	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	725,760	531,351	0.7321
04 Nov 2011 20:59:14	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	699,840	512,517	0.7323
31 Oct 2011 18:42:36	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	673,920	493,498	0.7323
31 Oct 2011 17:21:12	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	648,000	474,427	0.7321
31 Oct 2011 16:40:42	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	622,080	455,376	0.7320
31 Oct 2011 14:53:01	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	596,160	436,469	0.7321
31 Oct 2011 14:53:01	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	570,240	417,451	0.7321
16 Oct 2011 13:20:26	1167974	13340976	hadcm3n_o1by_1900_40_007438971_3	544,320	398,884	0.7328