Task 15445806

Name	hadcm3n_z98s_1880_40_008247938_1
Workunit	8403062
Created	21 Nov 2012, 10:49:19 UTC
Sent	21 Nov 2012, 10:49:25 UTC
Report deadline	20 Feb 2013, 18:16:36 UTC
Received	20 Jan 2013, 2:51:05 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1103902
Run time	40 days 3 hours 30 min 30 sec
CPU time	36 days 22 hours 40 min 48 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	0.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1504, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 04:39:45 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:39:46 (3808): No heartbeat from core client for 30 sec - exiting 04:39:47 (3808): No heartbeat from core client for 30 sec - exiting 22:28:31 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:04 (2460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:36 (2532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:37 (2532): No heartbeat from core client for 30 sec - exiting 14:22:38 (2532): No heartbeat from core client for 30 sec - exiting 14:22:39 (2532): No heartbeat from core client for 30 sec - exiting 22:17:46 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:55 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:49 (2600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:35:10 (1620): No heartbeat from core client for 30 sec - exiting 21:35:12 (1620): No heartbeat from core client for 30 sec - exiting 21:35:13 (1620): No heartbeat from core client for 30 sec - exiting 21:35:14 (1620): No heartbeat from core client for 30 sec - exiting 21:35:15 (1620): No heartbeat from core client for 30 sec - exiting 21:35:16 (1620): No heartbeat from core client for 30 sec - exiting 21:35:17 (1620): No heartbeat from core client for 30 sec - exiting 21:35:18 (1620): No heartbeat from core client for 30 sec - exiting 21:35:19 (1620): No heartbeat from core client for 30 sec - exiting 21:35:20 (1620): No heartbeat from core client for 30 sec - exiting 21:35:21 (1620): No heartbeat from core client for 30 sec - exiting 21:35:22 (1620): No heartbeat from core client for 30 sec - exiting 21:35:24 (1620): No heartbeat from core client for 30 sec - exiting 21:35:25 (1620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:35:26 (1620): No heartbeat from core client for 30 sec - exiting 00:05:35 (3944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:37 (3944): No heartbeat from core client for 30 sec - exiting 00:05:38 (3944): No heartbeat from core client for 30 sec - exiting 22:50:43 (1376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:16 (3372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:42 (2576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:07 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:08 (3864): No heartbeat from core client for 30 sec - exiting 22:06:07 (1268): No heartbeat from core client for 30 sec - exiting 22:06:08 (1268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:15:30 (2440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:15:33 (2440): No heartbeat from core client for 30 sec - exiting 00:03:31 (2376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:45 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:53:19 (2964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:20 (2964): No heartbeat from core client for 30 sec - exiting 10:53:21 (2964): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4504, iMonCtr=1 Model crash detected, will try to restart... 03:44:25 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:02 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4536, iMonCtr=1 Model crash detected, will try to restart... 07:45:36 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:32 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:33 (4752): No heartbeat from core client for 30 sec - exiting 01:00:47 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:48 (5192): No heartbeat from core client for 30 sec - exiting 01:00:49 (5192): No heartbeat from core client for 30 sec - exiting 01:00:50 (5192): No heartbeat from core client for 30 sec - exiting 01:00:51 (5192): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on z98sko.da897s0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4648, iMonCtr=1 Model crash detected, will try to restart... 23:54:54 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:16 (4660): No heartbeat from core client for 30 sec - exiting 07:27:17 (4660): No heartbeat from core client for 30 sec - exiting 07:27:18 (4660): No heartbeat from core client for 30 sec - exiting 07:27:19 (4660): No heartbeat from core client for 30 sec - exiting 07:27:20 (4660): No heartbeat from core client for 30 sec - exiting 07:27:21 (4660): No heartbeat from core client for 30 sec - exiting 07:27:22 (4660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:15:11 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:12 (4156): No heartbeat from core client for 30 sec - exiting 11:15:13 (4156): No heartbeat from core client for 30 sec - exiting 11:15:14 (4156): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:48:19 (4184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:20 (4184): No heartbeat from core client for 30 sec - exiting 00:48:21 (4184): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 19:50:16 (5884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:17 (5884): No heartbeat from core client for 30 sec - exiting 06:25:23 (5440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:13 (4508): No heartbeat from core client for 30 sec - exiting 04:10:14 (4508): No heartbeat from core client for 30 sec - exiting 04:10:15 (4508): No heartbeat from core client for 30 sec - exiting 04:10:16 (4508): No heartbeat from core client for 30 sec - exiting 04:10:17 (4508): No heartbeat from core client for 30 sec - exiting 04:10:18 (4508): No heartbeat from core client for 30 sec - exiting 04:10:19 (4508): No heartbeat from core client for 30 sec - exiting 04:10:20 (4508): No heartbeat from core client for 30 sec - exiting 04:10:21 (4508): No heartbeat from core client for 30 sec - exiting 04:10:22 (4508): No heartbeat from core client for 30 sec - exiting 04:10:23 (4508): No heartbeat from core client for 30 sec - exiting 04:10:24 (4508): No heartbeat from core client for 30 sec - exiting 04:10:25 (4508): No heartbeat from core client for 30 sec - exiting 04:10:26 (4508): No heartbeat from core client for 30 sec - exiting 04:10:27 (4508): No heartbeat from core client for 30 sec - exiting 04:10:28 (4508): No heartbeat from core client for 30 sec - exiting 04:10:29 (4508): No heartbeat from core client for 30 sec - exiting 04:10:30 (4508): No heartbeat from core client for 30 sec - exiting 04:10:31 (4508): No heartbeat from core client for 30 sec - exiting 04:10:32 (4508): No heartbeat from core client for 30 sec - exiting 04:10:33 (4508): No heartbeat from core client for 30 sec - exiting 04:10:34 (4508): No heartbeat from core client for 30 sec - exiting 04:10:35 (4508): No heartbeat from core client for 30 sec - exiting 04:10:36 (4508): No heartbeat from core client for 30 sec - exiting 04:10:37 (4508): No heartbeat from core client for 30 sec - exiting 04:10:38 (4508): No heartbeat from core client for 30 sec - exiting 04:10:40 (4508): No heartbeat from core client for 30 sec - exiting 04:10:41 (4508): No heartbeat from core client for 30 sec - exiting 04:10:42 (4508): No heartbeat from core client for 30 sec - exiting 04:10:43 (4508): No heartbeat from core client for 30 sec - exiting 04:10:44 (4508): No heartbeat from core client for 30 sec - exiting 04:10:45 (4508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) 10:54:56 (3128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:58 (3128): No heartbeat from core client for 30 sec - exiting 22:42:07 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:42:08 (4940): No heartbeat from core client for 30 sec - exiting 22:42:09 (4940): No heartbeat from core client for 30 sec - exiting 22:42:10 (4940): No heartbeat from core client for 30 sec - exiting 22:42:11 (4940): No heartbeat from core client for 30 sec - exiting 22:42:12 (4940): No heartbeat from core client for 30 sec - exiting 22:42:13 (4940): No heartbeat from core client for 30 sec - exiting 22:42:14 (4940): No heartbeat from core client for 30 sec - exiting 22:42:15 (4940): No heartbeat from core client for 30 sec - exiting 22:42:16 (4940): No heartbeat from core client for 30 sec - exiting 22:42:17 (4940): No heartbeat from core client for 30 sec - exiting 22:49:21 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:22 (3832): No heartbeat from core client for 30 sec - exiting 23:23:46 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:23:47 (5524): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5724, iMonCtr=1 Model crash detected, will try to restart... 00:31:56 (4236): No heartbeat from core client for 30 sec - exiting 00:31:57 (4236): No heartbeat from core client for 30 sec - exiting 00:31:58 (4236): No heartbeat from core client for 30 sec - exiting 00:31:59 (4236): No heartbeat from core client for 30 sec - exiting 00:32:00 (4236): No heartbeat from core client for 30 sec - exiting 00:32:01 (4236): No heartbeat from core client for 30 sec - exiting 00:32:02 (4236): No heartbeat from core client for 30 sec - exiting 00:32:03 (4236): No heartbeat from core client for 30 sec - exiting 00:32:05 (4236): No heartbeat from core client for 30 sec - exiting 00:32:06 (4236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2960, iMonCtr=1 Model crash detected, will try to restart... 20:12:32 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:33 (4944): No heartbeat from core client for 30 sec - exiting 20:12:34 (4944): No heartbeat from core client for 30 sec - exiting 20:12:35 (4944): No heartbeat from core client for 30 sec - exiting Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Jan 2013 01:53:20	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	1,036,800	3,191,037	3.0778
19 Jan 2013 02:33:50	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	1,010,880	3,112,759	3.0793
18 Jan 2013 01:53:11	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	984,960	3,031,941	3.0782
17 Jan 2013 00:47:53	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	959,040	2,950,388	3.0764
16 Jan 2013 00:35:30	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	933,120	2,869,768	3.0755
15 Jan 2013 00:21:41	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	907,200	2,789,424	3.0748
13 Jan 2013 18:31:14	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	881,280	2,716,976	3.0830
12 Jan 2013 21:11:37	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	855,360	2,645,532	3.0929
11 Jan 2013 23:22:18	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	829,440	2,574,396	3.1038
11 Jan 2013 01:33:04	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	803,520	2,503,606	3.1158
10 Jan 2013 04:12:53	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	777,600	2,432,955	3.1288
09 Jan 2013 06:29:42	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	751,680	2,362,387	3.1428
08 Jan 2013 08:37:01	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	725,760	2,290,642	3.1562
07 Jan 2013 10:56:29	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	699,840	2,218,861	3.1705
06 Jan 2013 13:27:04	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	673,920	2,147,208	3.1861
05 Jan 2013 15:50:54	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	648,000	2,075,307	3.2026
04 Jan 2013 18:15:02	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	622,080	2,004,112	3.2216
03 Jan 2013 21:06:45	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	596,160	1,932,851	3.2422
02 Jan 2013 23:58:59	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	570,240	1,862,154	3.2656
02 Jan 2013 02:43:50	1103902	15445806	hadcm3n_z98s_1880_40_008247938_1	544,320	1,791,104	3.2905