Task 14908503

Name	hadcm3n_o3hg_1980_40_008049267_1
Workunit	8204381
Created	12 Jul 2012, 21:42:35 UTC
Sent	12 Jul 2012, 21:43:08 UTC
Report deadline	12 Oct 2012, 5:10:19 UTC
Received	21 Aug 2012, 19:34:44 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1105487
Run time	22 days 11 hours 39 min 57 sec
CPU time	21 days 20 hours 19 min 8 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 22:13:23 (4508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:13:25 (4508): No heartbeat from core client for 30 sec - exiting 22:13:26 (4508): No heartbeat from core client for 30 sec - exiting 22:13:27 (4508): No heartbeat from core client for 30 sec - exiting 22:13:28 (4508): No heartbeat from core client for 30 sec - exiting 22:13:29 (4508): No heartbeat from core client for 30 sec - exiting 22:13:30 (4508): No heartbeat from core client for 30 sec - exiting 22:13:31 (4508): No heartbeat from core client for 30 sec - exiting 22:13:32 (4508): No heartbeat from core client for 30 sec - exiting 22:13:34 (4508): No heartbeat from core client for 30 sec - exiting 22:13:35 (4508): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 17:56:26 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 14:13:40 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:07:50 (4784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:07:51 (4784): No heartbeat from core client for 30 sec - exiting 15:07:52 (4784): No heartbeat from core client for 30 sec - exiting 15:07:53 (4784): No heartbeat from core client for 30 sec - exiting 15:07:54 (4784): No heartbeat from core client for 30 sec - exiting 20:10:23 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:24 (5988): No heartbeat from core client for 30 sec - exiting 20:10:25 (5988): No heartbeat from core client for 30 sec - exiting 20:10:26 (5988): No heartbeat from core client for 30 sec - exiting 20:10:27 (5988): No heartbeat from core client for 30 sec - exiting 20:10:28 (5988): No heartbeat from core client for 30 sec - exiting 20:10:29 (5988): No heartbeat from core client for 30 sec - exiting 20:10:30 (5988): No heartbeat from core client for 30 sec - exiting 20:10:31 (5988): No heartbeat from core client for 30 sec - exiting 20:10:32 (5988): No heartbeat from core client for 30 sec - exiting 20:10:33 (5988): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 11:25:47 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:49 (4720): No heartbeat from core client for 30 sec - exiting 11:25:50 (4720): No heartbeat from core client for 30 sec - exiting 11:25:51 (4720): No heartbeat from core client for 30 sec - exiting 11:25:52 (4720): No heartbeat from core client for 30 sec - exiting 11:25:53 (4720): No heartbeat from core client for 30 sec - exiting 11:25:54 (4720): No heartbeat from core client for 30 sec - exiting 12:45:05 (6356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:06 (6356): No heartbeat from core client for 30 sec - exiting 12:45:07 (6356): No heartbeat from core client for 30 sec - exiting 12:45:08 (6356): No heartbeat from core client for 30 sec - exiting 12:45:09 (6356): No heartbeat from core client for 30 sec - exiting 12:45:10 (6356): No heartbeat from core client for 30 sec - exiting 12:45:11 (6356): No heartbeat from core client for 30 sec - exiting 12:45:12 (6356): No heartbeat from core client for 30 sec - exiting 12:45:13 (6356): No heartbeat from core client for 30 sec - exiting 12:45:15 (6356): No heartbeat from core client for 30 sec - exiting 12:45:16 (6356): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 15:49:08 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:10 (4756): No heartbeat from core client for 30 sec - exiting 15:49:11 (4756): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 12:59:56 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:59:57 (4644): No heartbeat from core client for 30 sec - exiting 12:59:58 (4644): No heartbeat from core client for 30 sec - exiting 12:59:59 (4644): No heartbeat from core client for 30 sec - exiting 13:00:00 (4644): No heartbeat from core client for 30 sec - exiting 13:00:01 (4644): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 22:01:03 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 18:59:43 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:44 (4008): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 23:30:11 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:13 (4540): No heartbeat from core client for 30 sec - exiting 23:30:14 (4540): No heartbeat from core client for 30 sec - exiting 23:30:15 (4540): No heartbeat from core client for 30 sec - exiting 23:30:16 (4540): No heartbeat from core client for 30 sec - exiting 23:30:17 (4540): No heartbeat from core client for 30 sec - exiting 23:30:18 (4540): No heartbeat from core client for 30 sec - exiting 23:30:19 (4540): No heartbeat from core client for 30 sec - exiting 23:30:20 (4540): No heartbeat from core client for 30 sec - exiting 23:30:21 (4540): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:37:49 (4956): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:16:13 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:03:52 (4212): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:12:51 (968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:52 (968): No heartbeat from core client for 30 sec - exiting 21:12:53 (968): No heartbeat from core client for 30 sec - exiting 21:12:54 (968): No heartbeat from core client for 30 sec - exiting 21:12:55 (968): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:37:50 (1736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:37:52 (1736): No heartbeat from core client for 30 sec - exiting 15:37:53 (1736): No heartbeat from core client for 30 sec - exiting 15:37:54 (1736): No heartbeat from core client for 30 sec - exiting 15:37:55 (1736): No heartbeat from core client for 30 sec - exiting 15:37:56 (1736): No heartbeat from core client for 30 sec - exiting 15:37:57 (1736): No heartbeat from core client for 30 sec - exiting 15:37:58 (1736): No heartbeat from core client for 30 sec - exiting 15:37:59 (1736): No heartbeat from core client for 30 sec - exiting 15:38:00 (1736): No heartbeat from core client for 30 sec - exiting 16:52:28 (2860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 11:19:09 (1736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:10 (1736): No heartbeat from core client for 30 sec - exiting 18:17:22 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:40:10 (1288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 15:30:45 (2440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:30:47 (2440): No heartbeat from core client for 30 sec - exiting 15:30:48 (2440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 11:53:21 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 09:54:57 (3896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:54:58 (3896): No heartbeat from core client for 30 sec - exiting 09:54:59 (3896): No heartbeat from core client for 30 sec - exiting 09:55:00 (3896): No heartbeat from core client for 30 sec - exiting 09:55:01 (3896): No heartbeat from core client for 30 sec - exiting 09:55:02 (3896): No heartbeat from core client for 30 sec - exiting 09:55:03 (3896): No heartbeat from core client for 30 sec - exiting 09:55:04 (3896): No heartbeat from core client for 30 sec - exiting 09:55:06 (3896): No heartbeat from core client for 30 sec - exiting 09:55:07 (3896): No heartbeat from core client for 30 sec - exiting 09:55:08 (3896): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 21:08:43 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:45 (3888): No heartbeat from core client for 30 sec - exiting 21:08:46 (3888): No heartbeat from core client for 30 sec - exiting 21:08:47 (3888): No heartbeat from core client for 30 sec - exiting 21:08:48 (3888): No heartbeat from core client for 30 sec - exiting 21:08:49 (3888): No heartbeat from core client for 30 sec - exiting 21:08:51 (3888): No heartbeat from core client for 30 sec - exiting 21:08:52 (3888): No heartbeat from core client for 30 sec - exiting 21:08:53 (3888): No heartbeat from core client for 30 sec - exiting 21:08:54 (3888): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:39:38 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 12:39:54 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 18:37:16 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:17 (3976): No heartbeat from core client for 30 sec - exiting 18:37:18 (3976): No heartbeat from core client for 30 sec - exiting 18:37:19 (3976): No heartbeat from core client for 30 sec - exiting 18:37:20 (3976): No heartbeat from core client for 30 sec - exiting 18:37:21 (3976): No heartbeat from core client for 30 sec - exiting 18:37:22 (3976): No heartbeat from core client for 30 sec - exiting 18:37:23 (3976): No heartbeat from core client for 30 sec - exiting 18:37:24 (3976): No heartbeat from core client for 30 sec - exiting 18:37:25 (3976): No heartbeat from core client for 30 sec - exiting 18:37:26 (3976): No heartbeat from core client for 30 sec - exiting Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Aug 2012 19:36:46	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	1,036,800	1,886,868	1.8199
20 Aug 2012 23:17:34	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	1,010,880	1,840,371	1.8206
20 Aug 2012 09:29:36	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	984,960	1,793,627	1.8210
19 Aug 2012 12:10:00	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	959,040	1,747,444	1.8221
18 Aug 2012 13:39:58	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	933,120	1,700,993	1.8229
17 Aug 2012 14:31:06	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	907,200	1,654,288	1.8235
16 Aug 2012 17:05:42	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	881,280	1,607,750	1.8243
15 Aug 2012 21:02:55	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	855,360	1,561,482	1.8255
14 Aug 2012 23:02:57	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	829,440	1,515,110	1.8267
14 Aug 2012 09:51:42	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	803,520	1,468,770	1.8279
13 Aug 2012 13:55:28	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	777,600	1,422,371	1.8292
12 Aug 2012 18:04:51	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	751,680	1,376,168	1.8308
11 Aug 2012 19:31:11	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	725,760	1,331,775	1.8350
10 Aug 2012 16:48:49	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	699,840	1,287,049	1.8391
09 Aug 2012 10:11:44	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	673,920	1,242,222	1.8433
08 Aug 2012 08:11:26	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	648,000	1,197,081	1.8473
07 Aug 2012 11:34:45	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	622,080	1,150,665	1.8497
06 Aug 2012 13:49:36	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	596,160	1,104,312	1.8524
05 Aug 2012 16:58:39	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	570,240	1,057,927	1.8552
04 Aug 2012 17:42:57	1105487	14908503	hadcm3n_o3hg_1980_40_008049267_1	544,320	1,011,446	1.8582