Task 15483050

Name	hadcm3n_zj0x_1880_40_008251784_2
Workunit	8406908
Created	17 Dec 2012, 23:23:05 UTC
Sent	17 Dec 2012, 23:23:18 UTC
Report deadline	19 Mar 2013, 6:50:29 UTC
Received	23 Jan 2013, 6:55:14 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1103902
Run time	35 days 20 hours 21 min 43 sec
CPU time	31 days 19 hours 58 min
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	1.57 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Ocean Restart file copy failed on zj0xko.da828b0 10:53:19 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:20 (5936): No heartbeat from core client for 30 sec - exiting 10:53:21 (5936): No heartbeat from core client for 30 sec - exiting 10:53:22 (5936): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5848, iMonCtr=1 Model crash detected, will try to restart... 03:44:24 (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:01 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2444, iMonCtr=1 Model crash detected, will try to restart... 07:45:35 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:32 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:33 (4760): No heartbeat from core client for 30 sec - exiting 01:00:47 (4532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:48 (4532): No heartbeat from core client for 30 sec - exiting 01:00:49 (4532): No heartbeat from core client for 30 sec - exiting 01:00:50 (4532): No heartbeat from core client for 30 sec - exiting 01:00:51 (4532): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5508, iMonCtr=1 Model crash detected, will try to restart... 23:54:53 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:54 (4228): No heartbeat from core client for 30 sec - exiting 07:27:16 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:17 (4668): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:15:11 (3876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:12 (3876): No heartbeat from core client for 30 sec - exiting 11:15:13 (3876): No heartbeat from core client for 30 sec - exiting 11:15:14 (3876): No heartbeat from core client for 30 sec - exiting 11:15:15 (3876): No heartbeat from core client for 30 sec - exiting 11:15:16 (3876): No heartbeat from core client for 30 sec - exiting 11:15:17 (3876): No heartbeat from core client for 30 sec - exiting 11:15:18 (3876): No heartbeat from core client for 30 sec - exiting 11:15:19 (3876): No heartbeat from core client for 30 sec - exiting 11:15:20 (3876): No heartbeat from core client for 30 sec - exiting 11:15:21 (3876): No heartbeat from core client for 30 sec - exiting 11:15:22 (3876): No heartbeat from core client for 30 sec - exiting 11:15:23 (3876): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 00:48:19 (5132): No heartbeat from core client for 30 sec - exiting 00:48:21 (5132): No heartbeat from core client for 30 sec - exiting 00:48:22 (5132): No heartbeat from core client for 30 sec - exiting 00:48:23 (5132): No heartbeat from core client for 30 sec - exiting 00:48:24 (5132): No heartbeat from core client for 30 sec - exiting 00:48:25 (5132): No heartbeat from core client for 30 sec - exiting 00:48:26 (5132): No heartbeat from core client for 30 sec - exiting 00:48:27 (5132): No heartbeat from core client for 30 sec - exiting 00:48:28 (5132): No heartbeat from core client for 30 sec - exiting 00:48:29 (5132): No heartbeat from core client for 30 sec - exiting 00:48:30 (5132): No heartbeat from core client for 30 sec - exiting 00:48:31 (5132): No heartbeat from core client for 30 sec - exiting 00:48:32 (5132): No heartbeat from core client for 30 sec - exiting 00:48:33 (5132): No heartbeat from core client for 30 sec - exiting 00:48:34 (5132): No heartbeat from core client for 30 sec - exiting 00:48:35 (5132): No heartbeat from core client for 30 sec - exiting 00:48:36 (5132): No heartbeat from core client for 30 sec - exiting 00:48:37 (5132): No heartbeat from core client for 30 sec - exiting 00:49:25 (5132): No heartbeat from core client for 30 sec - exiting 00:49:26 (5132): No heartbeat from core client for 30 sec - exiting 00:49:27 (5132): No heartbeat from core client for 30 sec - exiting 00:49:28 (5132): No heartbeat from core client for 30 sec - exiting 00:49:29 (5132): No heartbeat from core client for 30 sec - exiting 00:49:30 (5132): No heartbeat from core client for 30 sec - exiting 00:49:31 (5132): No heartbeat from core client for 30 sec - exiting 00:49:32 (5132): No heartbeat from core client for 30 sec - exiting 00:49:33 (5132): No heartbeat from core client for 30 sec - exiting 00:49:34 (5132): No heartbeat from core client for 30 sec - exiting 00:49:35 (5132): No heartbeat from core client for 30 sec - exiting 00:49:36 (5132): No heartbeat from core client for 30 sec - exiting 00:49:37 (5132): No heartbeat from core client for 30 sec - exiting 00:49:38 (5132): No heartbeat from core client for 30 sec - exiting 00:49:39 (5132): No heartbeat from core client for 30 sec - exiting 00:49:40 (5132): No heartbeat from core client for 30 sec - exiting 00:49:41 (5132): No heartbeat from core client for 30 sec - exiting 00:49:42 (5132): No heartbeat from core client for 30 sec - exiting 00:49:43 (5132): No heartbeat from core client for 30 sec - exiting 00:49:44 (5132): No heartbeat from core client for 30 sec - exiting 00:49:45 (5132): No heartbeat from core client for 30 sec - exiting 00:49:46 (5132): No heartbeat from core client for 30 sec - exiting 00:49:47 (5132): No heartbeat from core client for 30 sec - exiting 00:49:48 (5132): No heartbeat from core client for 30 sec - exiting 00:49:49 (5132): No heartbeat from core client for 30 sec - exiting 00:49:50 (5132): No heartbeat from core client for 30 sec - exiting 00:49:51 (5132): No heartbeat from core client for 30 sec - exiting 00:49:52 (5132): No heartbeat from core client for 30 sec - exiting 00:49:53 (5132): No heartbeat from core client for 30 sec - exiting 00:49:54 (5132): No heartbeat from core client for 30 sec - exiting 00:49:55 (5132): No heartbeat from core client for 30 sec - exiting 00:49:56 (5132): No heartbeat from core client for 30 sec - exiting 00:49:57 (5132): No heartbeat from core client for 30 sec - exiting 00:49:58 (5132): No heartbeat from core client for 30 sec - exiting 00:49:59 (5132): No heartbeat from core client for 30 sec - exiting 00:50:00 (5132): No heartbeat from core client for 30 sec - exiting 00:50:01 (5132): No heartbeat from core client for 30 sec - exiting 00:50:02 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... 19:50:16 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:17 (4172): No heartbeat from core client for 30 sec - exiting 19:50:18 (4172):06:25:22 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:24 (5792): No heartbeat from core client for 30 sec - exiting 04:10:12 (1964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:13 (1964): No heartbeat from core client for 30 sec - exiting 04:10:14 (1964): No heartbeat from core client for 30 sec - exiting 10:54:57 (1792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 22:42:07 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:42:08 (1824): No heartbeat from core client for 30 sec - exiting 22:42:09 (1824): No heartbeat from core client for 30 sec - exiting 22:42:10 (1824): No heartbeat from core client for 30 sec - exiting 22:42:11 (1824): No heartbeat from core client for 30 sec - exiting 22:42:12 (1824): No heartbeat from core client for 30 sec - exiting 22:49:22 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:27 (6024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:23:46 (3112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:23:47 (3112): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4424, iMonCtr=1 Model crash detected, will try to restart... 00:31:55 (4244): No heartbeat from core client for 30 sec - exiting 00:31:56 (4244): No heartbeat from core client for 30 sec - exiting 00:31:57 (4244): No heartbeat from core client for 30 sec - exiting 00:31:58 (4244): No heartbeat from core client for 30 sec - exiting 00:31:59 (4244): No heartbeat from core client for 30 sec - exiting 00:32:01 (4244): No heartbeat from core client for 30 sec - exiting 00:32:02 (4244): No heartbeat from core client for 30 sec - exiting 00:32:03 (4244): No heartbeat from core client for 30 sec - exiting 00:32:04 (4244): No heartbeat from core client for 30 sec - exiting 00:32:05 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:32:06 (4244): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=376, iMonCtr=1 Model crash detected, will try to restart... 20:12:32 (4952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:33 (4952): No heartbeat from core client for 30 sec - exiting 20:12:34 (4952): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jan 2013 06:57:54	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	1,036,800	2,749,359	2.6518
22 Jan 2013 12:15:05	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	1,010,880	2,687,178	2.6583
21 Jan 2013 18:36:37	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	984,960	2,625,144	2.6652
21 Jan 2013 01:54:52	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	959,040	2,563,243	2.6727
20 Jan 2013 07:54:30	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	933,120	2,501,262	2.6805
19 Jan 2013 09:10:16	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	907,200	2,427,346	2.6756
18 Jan 2013 09:10:13	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	881,280	2,347,611	2.6639
17 Jan 2013 08:04:27	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	855,360	2,265,520	2.6486
16 Jan 2013 07:37:19	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	829,440	2,184,563	2.6338
15 Jan 2013 07:33:13	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	803,520	2,104,090	2.6186
14 Jan 2013 01:16:55	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	777,600	2,029,665	2.6102
13 Jan 2013 04:18:46	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	751,680	1,958,770	2.6059
12 Jan 2013 07:24:02	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	725,760	1,887,706	2.6010
11 Jan 2013 08:34:15	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	699,840	1,816,721	2.5959
10 Jan 2013 10:59:02	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	673,920	1,746,318	2.5913
09 Jan 2013 13:15:13	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	648,000	1,675,367	2.5854
08 Jan 2013 15:15:42	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	622,080	1,603,710	2.5780
07 Jan 2013 17:32:30	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	596,160	1,531,766	2.5694
06 Jan 2013 20:01:15	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	570,240	1,459,921	2.5602
05 Jan 2013 22:33:45	1103902	15483050	hadcm3n_zj0x_1880_40_008251784_2	544,320	1,388,240	2.5504