Task 15628843

Name	hadcm3n_zgfj_1920_40_008315818_0
Workunit	8466953
Created	23 Feb 2013, 17:20:25 UTC
Sent	23 Feb 2013, 17:20:32 UTC
Report deadline	26 May 2013, 0:47:43 UTC
Received	7 Feb 2014, 8:27:19 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1103784
Run time	16 days 17 hours 49 min 38 sec
CPU time	15 days 5 hours 50 min 48 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.96 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/zgfjko.pjc2c10 Error converting file to netcdf: dataout/zgfjko.pic2c10 Error converting file to netcdf: dataout/zgfjko.pfc2c10 Error converting file to netcdf: dataout/zgfjka.phc2c10 Error converting file to netcdf: dataout/zgfjka.pgc2c10 Error converting file to netcdf: dataout/zgfjka.pec2c10 Error converting file to netcdf: dataout/zgfjka.pdc2c10 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:49:25 (1260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:19:18 (4256): No heartbeat from core client for 30 sec - exiting 08:19:19 (4256): No heartbeat from core client for 30 sec - exiting 08:19:20 (4256): No heartbeat from core client for 30 sec - exiting 08:19:21 (4256): No heartbeat from core client for 30 sec - exiting 08:19:22 (4256): No heartbeat from core client for 30 sec - exiting 08:19:23 (4256): No heartbeat from core client for 30 sec - exiting 08:19:24 (4256): No heartbeat from core client for 30 sec - exiting 08:19:25 (4256): No heartbeat from core client for 30 sec - exiting 08:19:26 (4256): No heartbeat from core client for 30 sec - exiting 08:19:27 (4256): No heartbeat from core client for 30 sec - exiting 08:19:28 (4256): No heartbeat from core client for 30 sec - exiting 08:19:29 (4256): No heartbeat from core client for 30 sec - exiting 08:19:30 (4256): No heartbeat from core client for 30 sec - exiting 08:19:31 (4256): No heartbeat from core client for 30 sec - exiting 08:19:32 (4256): No heartbeat from core client for 30 sec - exiting 08:19:33 (4256): No heartbeat from core client for 30 sec - exiting 08:19:34 (4256): No heartbeat from core client for 30 sec - exiting 08:19:35 (4256): No heartbeat from core client for 30 sec - exiting 08:19:36 (4256): No heartbeat from core client for 30 sec - exiting 08:19:37 (4256): No heartbeat from core client for 30 sec - exiting 08:19:38 (4256): No heartbeat from core client for 30 sec - exiting 08:19:39 (4256): No heartbeat from core client for 30 sec - exiting 08:19:40 (4256): No heartbeat from core client for 30 sec - exiting 08:19:41 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:46:52 (3596): No heartbeat from core client for 30 sec - exiting 19:46:53 (3596): No heartbeat from core client for 30 sec - exiting 19:46:54 (3596): No heartbeat from core client for 30 sec - exiting 19:46:55 (3596): No heartbeat from core client for 30 sec - exiting 19:46:56 (3596): No heartbeat from core client for 30 sec - exiting 19:46:57 (3596): No heartbeat from core client for 30 sec - exiting 19:46:58 (3596): No heartbeat from core client for 30 sec - exiting 19:46:59 (3596): No heartbeat from core client for 30 sec - exiting 19:47:00 (3596): No heartbeat from core client for 30 sec - exiting 19:47:01 (3596): No heartbeat from core client for 30 sec - exiting 19:47:02 (3596): No heartbeat from core client for 30 sec - exiting 19:47:03 (3596): No heartbeat from core client for 30 sec - exiting 19:47:04 (3596): No heartbeat from core client for 30 sec - exiting 19:47:05 (3596): No heartbeat from core client for 30 sec - exiting 19:47:06 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:05:56 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:57 (4924): No heartbeat from core client for 30 sec - exiting 21:05:58 (4924): No heartbeat from core client for 30 sec - exiting 21:05:59 (4924): No heartbeat from core client for 30 sec - exiting 21:06:00 (4924): No heartbeat from core client for 30 sec - exiting 21:06:01 (4924): No heartbeat from core client for 30 sec - exiting 21:06:02 (4924): No heartbeat from core client for 30 sec - exiting 21:06:03 (4924): No heartbeat from core client for 30 sec - exiting 21:06:04 (4924): No heartbeat from core client for 30 sec - exiting 21:06:05 (4924): No heartbeat from core client for 30 sec - exiting 21:06:06 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4564, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4564, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4564, iMonCtr=1 Model crash detected, will try to restart... 20:06:46 (1220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:14 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:41:31 (3840): No heartbeat from core client for 30 sec - exiting 18:41:32 (3840): No heartbeat from core client for 30 sec - exiting 18:41:33 (3840): No heartbeat from core client for 30 sec - exiting 18:41:34 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:56:46 (3784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:19:44 (5544): No heartbeat from core client for 30 sec - exiting 18:19:46 (5544): No heartbeat from core client for 30 sec - exiting 18:19:47 (5544): No heartbeat from core client for 30 sec - exiting 18:19:48 (5544): No heartbeat from core client for 30 sec - exiting 18:19:49 (5544): No heartbeat from core client for 30 sec - exiting 18:19:50 (5544): No heartbeat from core client for 30 sec - exiting 18:19:51 (5544): No heartbeat from core client for 30 sec - exiting 18:19:52 (5544): No heartbeat from core client for 30 sec - exiting 18:19:53 (5544): No heartbeat from core client for 30 sec - exiting 18:19:54 (5544): No heartbeat from core client for 30 sec - exiting 18:19:55 (5544): No heartbeat from core client for 30 sec - exiting 18:19:56 (5544): No heartbeat from core client for 30 sec - exiting 18:19:57 (5544): No heartbeat from core client for 30 sec - exiting 18:19:58 (5544): No heartbeat from core client for 30 sec - exiting 18:19:58 (5544): No heartbeat from core client for 30 sec - exiting 18:19:59 (5544): No heartbeat from core client for 30 sec - exiting 18:20:00 (5544): No heartbeat from core client for 30 sec - exiting 18:20:01 (5544): No heartbeat from core client for 30 sec - exiting 18:20:02 (5544): No heartbeat from core client for 30 sec - exiting 18:20:03 (5544): No heartbeat from core client for 30 sec - exiting 18:20:04 (5544): No heartbeat from core client for 30 sec - exiting 18:20:05 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:15 (4564): No heartbeat from core client for 30 sec - exiting 22:35:16 (4564): No heartbeat from core client for 30 sec - exiting 22:35:17 (4564): No heartbeat from core client for 30 sec - exiting 22:35:18 (4564): No heartbeat from core client for 30 sec - exiting 22:35:19 (4564): No heartbeat from core client for 30 sec - exiting 22:35:20 (4564): No heartbeat from core client for 30 sec - exiting 22:35:21 (4564): No heartbeat from core client for 30 sec - exiting 22:35:22 (4564): No heartbeat from core client for 30 sec - exiting 22:35:23 (4564): No heartbeat from core client for 30 sec - exiting 22:35:24 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:12 (4612): No heartbeat from core client for 30 sec - exiting 05:13:13 (4612): No heartbeat from core client for 30 sec - exiting 05:13:14 (4612): No heartbeat from core client for 30 sec - exiting 05:13:15 (4612): No heartbeat from core client for 30 sec - exiting 05:13:16 (4612): No heartbeat from core client for 30 sec - exiting 05:13:17 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:59:26 (4932): No heartbeat from core client for 30 sec - exiting 16:59:27 (4932): No heartbeat from core client for 30 sec - exiting 16:59:28 (4932): No heartbeat from core client for 30 sec - exiting 16:59:29 (4932): No heartbeat from core client for 30 sec - exiting 16:59:30 (4932): No heartbeat from core client for 30 sec - exiting 16:59:31 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:39 (4112): No heartbeat from core client for 30 sec - exiting 17:15:40 (4112): No heartbeat from core client for 30 sec - exiting 17:15:41 (4112): No heartbeat from core client for 30 sec - exiting 17:15:42 (4112): No heartbeat from core client for 30 sec - exiting 17:15:43 (4112): No heartbeat from core client for 30 sec - exiting 17:15:44 (4112): No heartbeat from core client for 30 sec - exiting 17:15:45 (4112): No heartbeat from core client for 30 sec - exiting 17:15:46 (4112): No heartbeat from core client for 30 sec - exiting 17:15:47 (4112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:35 (4520): No heartbeat from core client for 30 sec - exiting 18:25:36 (4520): No heartbeat from core client for 30 sec - exiting 18:25:36 (4520): No heartbeat from core client for 30 sec - exiting 18:25:37 (4520): No heartbeat from core client for 30 sec - exiting 18:25:38 (4520): No heartbeat from core client for 30 sec - exiting 18:25:39 (4520): No heartbeat from core client for 30 sec - exiting 18:25:40 (4520): No heartbeat from core client for 30 sec - exiting 18:25:41 (4520): No heartbeat from core client for 30 sec - exiting 18:25:42 (4520): No heartbeat from core client for 30 sec - exiting 18:25:43 (4520): No heartbeat from core client for 30 sec - exiting 18:25:44 (4520): No heartbeat from core client for 30 sec - exiting 18:25:45 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:32:31 (3992): No heartbeat from core client for 30 sec - exiting 17:32:32 (3992): No heartbeat from core client for 30 sec - exiting 17:32:33 (3992): No heartbeat from core client for 30 sec - exiting 17:32:34 (3992): No heartbeat from core client for 30 sec - exiting 17:32:34 (3992): No heartbeat from core client for 30 sec - exiting 17:32:35 (3992): No heartbeat from core client for 30 sec - exiting 17:32:36 (3992): No heartbeat from core client for 30 sec - exiting 17:32:37 (3992): No heartbeat from core client for 30 sec - exiting 17:32:38 (3992): No heartbeat from core client for 30 sec - exiting 17:32:39 (3992): No heartbeat from core client for 30 sec - exiting 17:32:40 (3992): No heartbeat from core client for 30 sec - exiting 17:32:41 (3992): No heartbeat from core client for 30 sec - exiting 17:32:42 (3992): No heartbeat from core client for 30 sec - exiting 17:32:43 (3992): No heartbeat from core client for 30 sec - exiting 17:32:44 (3992): No heartbeat from core client for 30 sec - exiting 17:32:45 (3992): No heartbeat from core client for 30 sec - exiting 17:32:46 (3992): No heartbeat from core client for 30 sec - exiting 17:32:47 (3992): No heartbeat from core client for 30 sec - exiting 17:32:48 (3992): No heartbeat from core client for 30 sec - exiting 17:32:49 (3992): No heartbeat from core client for 30 sec - exiting 17:32:50 (3992): No heartbeat from core client for 30 sec - exiting 17:32:51 (3992): No heartbeat from core client for 30 sec - exiting 17:32:52 (3992): No heartbeat from core client for 30 sec - exiting 17:32:53 (3992): No heartbeat from core client for 30 sec - exiting 17:32:54 (3992): No heartbeat from core client for 30 sec - exiting 17:32:55 (3992): No heartbeat from core client for 30 sec - exiting 17:32:56 (3992): No heartbeat from core client for 30 sec - exiting 17:32:57 (3992): No heartbeat from core client for 30 sec - exiting 17:32:58 (3992): No heartbeat from core client for 30 sec - exiting 17:32:59 (3992): No heartbeat from core client for 30 sec - exiting 17:33:00 (3992): No heartbeat from core client for 30 sec - exiting 17:33:01 (3992): No heartbeat from core client for 30 sec - exiting 17:33:02 (3992): No heartbeat from core client for 30 sec - exiting 17:33:03 (3992): No heartbeat from core client for 30 sec - exiting 17:33:04 (3992): No heartbeat from core client for 30 sec - exiting 17:33:05 (3992): No heartbeat from core client for 30 sec - exiting 17:33:06 (3992): No heartbeat from core client for 30 sec - exiting 17:33:07 (3992): No heartbeat from core client for 30 sec - exiting 17:33:08 (3992): No heartbeat from core client for 30 sec - exiting 17:33:09 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:10 (3992): No heartbeat from core client for 30 sec - exiting 17:33:11 (3992): No heartbeat from core client for 30 sec - exiting 17:33:12 (3992): No heartbeat from core client for 30 sec - exiting 17:33:13 (3992): No heartbeat from core client for 30 sec - exiting 17:33:14 (3992): No heartbeat from core client for 30 sec - exiting BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 17:37:44 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: C I/17:41:36 (1840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:41:37 (1840): No heartbeat from core client for 30 sec - exiting 17:41:38 (1840): No heartbeat from core client for 30 sec - exiting 17:41:39 (1840): No heartbeat from core client for 30 sec - exiting 17:41:40 (1840): No heartbeat from core client for 30 sec - exiting 17:41:41 (1840): No heartbeat from core client for 30 sec - exiting 17:41:42 (1840): No heartbeat from core client for 30 sec - exiting 17:41:43 (1840): No heartbeat from core client for 30 sec - exiting 17:41:44 (1840): No heartbeat from core client for 30 sec - exiting 17:41:45 (1840): No heartbeat from core client for 30 sec - exiting 17:41:46 (1840): No heartbeat from core client for 30 sec - exiting 22:08:13 (5024): No heartbeat from core client for 30 sec - exiting 22:08:14 (5024): No heartbeat from core client for 30 sec - exiting 22:08:15 (5024): No heartbeat from core client for 30 sec - exiting 22:08:16 (5024): No heartbeat from core client for 30 sec - exiting 22:08:17 (5024): No heartbeat from core client for 30 sec - exiting 22:08:18 (5024): No heartbeat from core client for 30 sec - exiting 22:08:19 (5024): No heartbeat from core client for 30 sec - exiting 22:08:20 (5024): No heartbeat from core client for 30 sec - exiting 22:08:21 (5024): No heartbeat from core client for 30 sec - exiting 22:08:22 (5024): No heartbeat from core client for 30 sec - exiting 22:08:23 (5024): No heartbeat from core client for 30 sec - exiting 22:08:24 (5024): No heartbeat from core client for 30 sec - exiting 22:08:25 (5024): No heartbeat from core client for 30 sec - exiting 22:08:26 (5024): No heartbeat from core client for 30 sec - exiting 22:08:27 (5024): No heartbeat from core client for 30 sec - exiting 22:08:28 (5024): No heartbeat from core client for 30 sec - exiting 22:08:29 (5024): No heartbeat from core client for 30 sec - exiting 22:08:30 (5024): No heartbeat from core client for 30 sec - exiting 22:08:31 (5024): No heartbeat from core client for 30 sec - exiting 22:08:32 (5024): No heartbeat from core client for 30 sec - exiting 22:08:33 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:34 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5724, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Feb 2014 07:30:00	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	1,036,800	1,316,578	1.2698
06 Feb 2014 17:41:56	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	1,010,880	1,284,938	1.2711
06 Feb 2014 08:50:29	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	984,960	1,253,308	1.2724
10 Nov 2013 16:26:04	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	959,040	1,222,384	1.2746
09 Nov 2013 20:25:00	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	933,120	1,191,936	1.2774
07 Sep 2013 03:32:47	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	907,200	1,161,699	1.2805
06 Sep 2013 18:25:26	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	881,280	1,130,168	1.2824
23 Jul 2013 19:57:54	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	855,360	1,097,724	1.2833
04 Jul 2013 17:27:50	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	829,440	1,064,943	1.2839
02 Jul 2013 14:35:24	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	803,520	1,035,484	1.2887
26 Jun 2013 20:21:50	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	777,600	1,005,744	1.2934
24 May 2013 02:25:46	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	751,680	972,234	1.2934
17 May 2013 18:10:45	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	725,760	938,888	1.2937
17 May 2013 07:24:47	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	699,840	905,207	1.2934
16 May 2013 20:18:13	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	673,920	871,621	1.2934
30 Apr 2013 08:20:20	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	648,000	837,879	1.2930
17 Apr 2013 23:21:22	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	622,080	804,614	1.2934
16 Apr 2013 02:57:45	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	596,160	770,663	1.2927
12 Apr 2013 12:20:35	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	570,240	736,977	1.2924
11 Apr 2013 15:05:29	1103784	15628843	hadcm3n_zgfj_1920_40_008315818_0	544,320	703,709	1.2928