Task 16014376

Name	hadcm3n_83xn_1980_40_008463038_1
Workunit	8613894
Created	13 Sep 2013, 5:47:42 UTC
Sent	13 Sep 2013, 6:32:09 UTC
Report deadline	13 Dec 2013, 13:59:20 UTC
Received	29 Oct 2013, 1:27:46 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1242385
Run time	25 days 15 hours 13 min 7 sec
CPU time	24 days 23 hours 28 min 56 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.09 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> 08:31:39 (7020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6240, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:01:52 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8856, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:30:52 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model craSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:28:35 (2648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:35:50 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:51 (3776): No heartbeat from core client for 30 sec - exiting 10:35:52 (3776): No heartbeat from core client for 30 sec - exiting 10:35:53 (3776): No heartbeat from core client for 30 sec - exiting 10:35:54 (3776): No heartbeat from core client for 30 sec - exiting 10:35:55 (3776): No heartbeat from core client for 30 sec - exiting 10:35:56 (3776): No heartbeat from core client for 30 sec - exiting 10:35:57 (3776): No heartbeat from core client for 30 sec - exiting 10:35:58 (3776): No heartbeat from core client for 30 sec - exiting 10:35:59 (3776): No heartbeat from core client for 30 sec - exiting 10:36:00 (3776): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6808, iMonCtr=1 Model crash detected, will try to restart... 13:02:01 (6220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6968, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6388, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:33:08 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5720, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=876, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=876, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6120, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5660, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5660, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... C08:30:40 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:22 (6948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=1 Model crash detected, will try to restart... 14:05:12 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:29:36 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/83xnko.pjk8c10 Error converting file to netcdf: dataout/83xnko.pik8c10 Error converting file to netcdf: dataout/83xnko.pfk8c10 Error converting file to netcdf: dataout/83xnka.phk8c10 Error converting file to netcdf: dataout/83xnka.pgk8c10 Error converting file to netcdf: dataout/83xnka.pek8c10 Error converting file to netcdf: dataout/83xnka.pdk8c10 Suspended CPDN Monitor - Suspend request from BOINC... 09:31:54 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:06:56 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:06:57 (6768): No heartbeat from core client for 30 sec - exiting 14:06:58 (6768): No heartbeat from core client for 30 sec - exiting 14:06:59 (6768): No heartbeat from core client for 30 sec - exiting 14:07:00 (6768): No heartbeat from core client for 30 sec - exiting 14:07:01 (6768): No heartbeat from core client for 30 sec - exiting 14:07:02 (6768): No heartbeat from core client for 30 sec - exiting 14:07:03 (6768): No heartbeat from core client for 30 sec - exiting 14:07:04 (6768): No heartbeat from core client for 30 sec - exiting 14:07:05 (6768): No heartbeat from core client for 30 sec - exiting 14:07:06 (6768): No heartbeat from core client for 30 sec - exiting 08:27:40 (6432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:39:08 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:09 (5052): No heartbeat from core client for 30 sec - exiting 09:39:10 (5052): No heartbeat from core client for 30 sec - exiting 09:39:11 (5052): No heartbeat from core client for 30 sec - exiting 09:39:12 (5052): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:04:23 (3280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:24 (3280): No heartbeat from core client for 30 sec - exiting 14:04:25 (3280): No heartbeat from core client for 30 sec - exiting 14:04:26 (3280): No heartbeat from core client for 30 sec - exiting 14:04:27 (3280): No heartbeat from core client for 30 sec - exiting 14:04:28 (3280): No heartbeat from core client for 30 sec - exiting 14:04:29 (3280): No heartbeat from core client for 30 sec - exiting 14:04:30 (3280): No heartbeat from core client for 30 sec - exiting 14:04:31 (3280): No heartbeat from core client for 30 sec - exiting 14:04:32 (3280): No heartbeat from core client for 30 sec - exiting 14:04:33 (3280): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1536, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:29:47 (8132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:48 (8132): No heartbeat from core client for 30 sec - exiting 13:29:49 (8132): No heartbeat from core client for 30 sec - exiting 13:29:50 (8132): No heartbeat from core client for 30 sec - exiting 13:29:51 (8132): No heartbeat from core client for 30 sec - exiting 13:29:52 (8132): No heartbeat from core client for 30 sec - exiting 13:29:53 (8132): No heartbeat from core client for 30 sec - exiting 13:29:54 (8132): No heartbeat from core client for 30 sec - exiting 13:29:55 (8132): No heartbeat from core client for 30 sec - exiting 13:29:56 (8132): No heartbeat from core client for 30 sec - exiting 13:29:57 (8132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:09:26 (7360): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:28:59 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:33:13 (6644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:33:14 (6644): No heartbeat from core client for 30 sec - exiting 09:33:15 (6644): No heartbeat from core client for 30 sec - exiting 09:33:16 (6644): No heartbeat from core client for 30 sec - exiting 09:33:17 (6644): No heartbeat from core client for 30 sec - exiting 09:33:18 (6644): No heartbeat from core client for 30 sec - exiting 09:33:19 (6644): No heartbeat from core client for 30 sec - exiting 09:33:20 (6644): No heartbeat from core client for 30 sec - exiting 09:33:21 (6644): No heartbeat from core client for 30 sec - exiting 09:33:22 (6644): No heartbeat from core client for 30 sec - exiting 09:33:23 (6644): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 13:02:18 (6524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:24 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Oct 2013 13:24:26	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	1,036,800	2,157,000	2.0804
27 Oct 2013 22:09:15	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	1,010,880	2,105,483	2.0828
27 Oct 2013 08:28:13	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	984,960	2,057,031	2.0884
26 Oct 2013 18:12:12	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	959,040	2,006,466	2.0922
26 Oct 2013 04:09:54	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	933,120	1,956,995	2.0973
25 Oct 2013 11:09:39	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	907,200	1,903,931	2.0987
24 Oct 2013 17:19:24	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	881,280	1,850,505	2.0998
24 Oct 2013 02:10:54	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	855,360	1,800,652	2.1051
23 Oct 2013 10:37:24	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	829,440	1,747,192	2.1065
22 Oct 2013 09:58:26	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	803,520	1,699,398	2.1149
19 Oct 2013 04:44:22	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	777,600	1,649,154	2.1208
18 Oct 2013 08:40:20	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	751,680	1,593,968	2.1205
17 Oct 2013 13:37:10	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	725,760	1,537,486	2.1184
16 Oct 2013 22:13:00	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	699,840	1,486,115	2.1235
16 Oct 2013 06:38:56	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	673,920	1,437,027	2.1323
15 Oct 2013 13:55:14	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	648,000	1,383,794	2.1355
14 Oct 2013 22:04:31	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	622,080	1,331,464	2.1403
05 Oct 2013 16:45:52	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	596,160	1,271,529	2.1329
04 Oct 2013 23:29:47	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	570,240	1,211,019	2.1237
03 Oct 2013 03:38:53	1242385	16014376	hadcm3n_83xn_1980_40_008463038_1	544,320	1,159,873	2.1309