Task 15553060

Name	hadcm3n_zhxv_1880_40_008246733_4
Workunit	8401857
Created	20 Jan 2013, 17:53:27 UTC
Sent	20 Jan 2013, 17:53:36 UTC
Report deadline	22 Apr 2013, 1:20:47 UTC
Received	10 Feb 2013, 16:13:44 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1230144
Run time	20 days 13 hours 14 min 42 sec
CPU time	19 days 13 hours 46 min 58 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.21 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> 05:25:01 (4108): No heartbeat from core client for 30 sec - exiting 05:25:02 (4108): No heartbeat from core client for 30 sec - exiting 05:25:03 (4108): No heartbeat from core client for 30 sec - exiting 05:25:04 (4108): No heartbeat from core client for 30 sec - exiting 05:25:05 (4108): No heartbeat from core client for 30 sec - exiting 05:25:06 (4108): No heartbeat from core client for 30 sec - exiting 05:25:07 (4108): No heartbeat from core client for 30 sec - exiting 05:25:09 (4108): No heartbeat from core client for 30 sec - exiting 05:25:10 (4108): No heartbeat from core client for 30 sec - exiting 05:25:11 (4108): No heartbeat from core client for 30 sec - exiting 05:25:12 (4108): No heartbeat from core client for 30 sec - exiting 05:25:13 (4108): No heartbeat from core client for 30 sec - exiting 05:25:14 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:26:05 (136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:26:41 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:15:33 (5024): No heartbeat from core client for 30 sec - exiting 05:15:34 (5024): No heartbeat from core client for 30 sec - exiting 05:15:35 (5024): No heartbeat from core client for 30 sec - exiting 05:15:37 (5024): No heartbeat from core client for 30 sec - exiting 05:15:38 (5024): No heartbeat from core client for 30 sec - exiting 05:15:39 (5024): No heartbeat from core client for 30 sec - exiting 05:15:40 (5024): No heartbeat from core client for 30 sec - exiting 05:15:41 (5024): No heartbeat from core client for 30 sec - exiting 05:15:42 (5024): No heartbeat from core client for 30 sec - exiting 05:15:43 (5024): No heartbeat from core client for 30 sec - exiting 05:15:44 (5024): No heartbeat from core client for 30 sec - exiting 05:15:45 (5024): No heartbeat from core client for 30 sec - exiting 05:15:46 (5024): No heartbeat from core client for 30 sec - exiting 05:15:48 (5024): No heartbeat from core client for 30 sec - exiting 05:15:49 (5024): No heartbeat from core client for 30 sec - exiting 05:15:50 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:51 (5024): No heartbeat from core client for 30 sec - exiting 05:16:42 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:28:55 (4216): No heartbeat from core client for 30 sec - exiting 05:28:56 (4216): No heartbeat from core client for 30 sec - exiting 05:28:57 (4216): No heartbeat from core client for 30 sec - exiting 05:28:58 (4216): No heartbeat from core client for 30 sec - exiting 05:28:59 (4216): No heartbeat from core client for 30 sec - exiting 05:29:00 (4216): No heartbeat from core client for 30 sec - exiting 05:29:01 (4216): No heartbeat from core client for 30 sec - exiting 05:29:02 (4216): No heartbeat from core client for 30 sec - exiting 05:29:03 (4216): No heartbeat from core client for 30 sec - exiting 05:29:05 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:58 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:58 (4872): No heartbeat from core client for 30 sec - exiting 05:21:59 (4872): No heartbeat from core client for 30 sec - exiting 05:22:00 (4872): No heartbeat from core client for 30 sec - exiting 05:22:01 (4872): No heartbeat from core client for 30 sec - exiting 05:22:02 (4872): No heartbeat from core client for 30 sec - exiting 05:22:03 (4872): No heartbeat from core client for 30 sec - exiting 05:22:04 (4872): No heartbeat from core client for 30 sec - exiting 05:22:05 (4872): No heartbeat from core client for 30 sec - exiting 05:22:07 (4872): No heartbeat from core client for 30 sec - exiting 05:22:08 (4872): No heartbeat from core client for 30 sec - exiting 05:22:09 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:21 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:34 (1988): No heartbeat from core client for 30 sec - exiting 05:19:35 (1988): No heartbeat from core client for 30 sec - exiting 05:19:36 (1988): No heartbeat from core client for 30 sec - exiting 05:19:37 (1988): No heartbeat from core client for 30 sec - exiting 05:19:38 (1988): No heartbeat from core client for 30 sec - exiting 05:19:39 (1988): No heartbeat from core client for 30 sec - exiting 05:19:40 (1988): No heartbeat from core client for 30 sec - exiting 05:19:42 (1988): No heartbeat from core client for 30 sec - exiting 05:19:43 (1988): No heartbeat from core client for 30 sec - exiting 05:19:44 (1988): No heartbeat from core client for 30 sec - exiting 05:19:45 (1988): No heartbeat from core client for 30 sec - exiting 05:19:46 (1988): No heartbeat from core client for 30 sec - exiting 05:19:47 (1988): No heartbeat from core client for 30 sec - exiting 05:19:48 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:45 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:31 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:01:49 (4204): No heartbeat from core client for 30 sec - exiting 18:01:50 (4204): No heartbeat from core client for 30 sec - exiting 18:01:51 (4204): No heartbeat from core client for 30 sec - exiting 18:01:52 (4204): No heartbeat from core client for 30 sec - exiting 18:01:53 (4204): No heartbeat from core client for 30 sec - exiting 18:01:55 (4204): No heartbeat from core client for 30 sec - exiting 18:01:56 (4204): No heartbeat from core client for 30 sec - exiting 18:01:57 (4204): No heartbeat from core client for 30 sec - exiting 18:01:58 (4204): No heartbeat from core client for 30 sec - exiting 18:01:59 (4204): No heartbeat from core client for 30 sec - exiting 18:02:00 (4204): No heartbeat from core client for 30 sec - exiting 18:02:01 (4204): No heartbeat from core client for 30 sec - exiting 18:02:02 (4204): No heartbeat from core client for 30 sec - exiting 18:02:03 (4204): No heartbeat from core client for 30 sec - exiting 18:02:04 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:20 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:47 (4520): No heartbeat from core client for 30 sec - exiting 07:21:49 (4520): No heartbeat from core client for 30 sec - exiting 07:21:50 (4520): No heartbeat from core client for 30 sec - exiting 07:21:51 (4520): No heartbeat from core client for 30 sec - exiting 07:21:52 (4520): No heartbeat from core client for 30 sec - exiting 07:21:53 (4520): No heartbeat from core client for 30 sec - exiting 07:21:54 (4520): No heartbeat from core client for 30 sec - exiting 07:21:55 (4520): No heartbeat from core client for 30 sec - exiting 07:21:56 (4520): No heartbeat from core client for 30 sec - exiting 07:21:58 (4520): No heartbeat from core client for 30 sec - exiting 07:21:59 (4520): No heartbeat from core client for 30 sec - exiting 07:22:00 (4520): No heartbeat from core client for 30 sec - exiting 07:22:01 (4520): No heartbeat from core client for 30 sec - exiting 07:22:02 (4520): No heartbeat from core client for 30 sec - exiting 07:22:03 (4520): No heartbeat from core client for 30 sec - exiting 07:22:04 (4520): No heartbeat from core client for 30 sec - exiting 07:22:05 (4520): No heartbeat from core client for 30 sec - exiting 07:22:06 (4520): No heartbeat from core client for 30 sec - exiting 07:22:07 (4520): No heartbeat from core client for 30 sec - exiting 07:22:08 (4520): No heartbeat from core client for 30 sec - exiting 07:22:10 (4520): No heartbeat from core client for 30 sec - exiting 07:22:11 (4520): No heartbeat from core client for 30 sec - exiting 07:22:12 (4520): No heartbeat from core client for 30 sec - exiting 07:22:13 (4520): No heartbeat from core client for 30 sec - exiting 07:22:14 (4520): No heartbeat from core client for 30 sec - exiting 07:22:15 (4520): No heartbeat from core client for 30 sec - exiting 07:22:16 (4520): No heartbeat from core client for 30 sec - exiting 07:22:17 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:34 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:34:07 (4560): No heartbeat from core client for 30 sec - exiting 15:34:08 (4560): No heartbeat from core client for 30 sec - exiting 15:34:09 (4560): No heartbeat from core client for 30 sec - exiting 15:34:10 (4560): No heartbeat from core client for 30 sec - exiting 15:34:11 (4560): No heartbeat from core client for 30 sec - exiting 15:34:12 (4560): No heartbeat from core client for 30 sec - exiting 15:34:13 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:15:21 (1980): No heartbeat from core client for 30 sec - exiting 05:15:22 (1980): No heartbeat from core client for 30 sec - exiting 05:15:23 (1980): No heartbeat from core client for 30 sec - exiting 05:15:24 (1980): No heartbeat from core client for 30 sec - exiting 05:15:25 (1980): No heartbeat from core client for 30 sec - exiting 05:15:26 (1980): No heartbeat from core client for 30 sec - exiting 05:15:27 (1980): No heartbeat from core client for 30 sec - exiting 05:15:28 (1980): No heartbeat from core client for 30 sec - exiting 05:15:29 (1980): No heartbeat from core client for 30 sec - exiting 05:15:31 (1980): No heartbeat from core client for 30 sec - exiting 05:15:32 (1980): No heartbeat from core client for 30 sec - exiting 05:15:33 (1980): No heartbeat from core client for 30 sec - exiting 05:15:34 (1980): No heartbeat from core client for 30 sec - exiting 05:15:35 (1980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:36 (1980): No heartbeat from core client for 30 sec - exiting 23:21:37 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:38 (3344): No heartbeat from core client for 30 sec - exiting 23:22:52 (3444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:19 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:20 (5348): No heartbeat from core client for 30 sec - exiting 23:55:12 (988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:48 (3136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4888, iMonCtr=1 Model crash detected, will try to restart... 05:16:02 (3524): No heartbeat from core client for 30 sec - exiting 05:16:04 (3524): No heartbeat from core client for 30 sec - exiting 05:16:05 (3524): No heartbeat from core client for 30 sec - exiting 05:16:06 (3524): No heartbeat from core client for 30 sec - exiting 05:16:07 (3524): No heartbeat from core client for 30 sec - exiting 05:16:08 (3524): No heartbeat from core client for 30 sec - exiting 05:16:09 (3524): No heartbeat from core client for 30 sec - exiting 05:16:10 (3524): No heartbeat from core client for 30 sec - exiting 05:16:12 (3524): No heartbeat from core client for 30 sec - exiting 05:16:13 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:11:58 (1116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:12:43 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:48:00 (1884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:49:01 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:49:42 (852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:50 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:16:29 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:20:21 (912): No heartbeat from core client for 30 sec - exiting 05:20:22 (912): No heartbeat from core client for 30 sec - exiting 05:20:23 (912): No heartbeat from core client for 30 sec - exiting 05:20:24 (912): No heartbeat from core client for 30 sec - exiting 05:20:25 (912): No heartbeat from core client for 30 sec - exiting 05:20:26 (912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:41 (1104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:38 (3860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:20:52 (2680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:22:08 (2164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:21:40 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:22:25 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1520, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 13:34:26 (4580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:27 (4580): No heartbeat from core client for 30 sec - exiting 13:34:28 (4580): No heartbeat from core client for 30 sec - exiting 13:34:29 (4580): No heartbeat from core client for 30 sec - exiting 13:34:30 (4580): No heartbeat from core client for 30 sec - exiting 13:34:31 (4580): No heartbeat from core client for 30 sec - exiting 13:34:32 (4580): No heartbeat from core client for 30 sec - exiting 13:34:33 (4580): No heartbeat from core client for 30 sec - exiting 13:34:34 (4580): No heartbeat from core client for 30 sec - exiting 13:34:35 (4580): No heartbeat from core client for 30 sec - exiting 13:34:37 (4580): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 05:04:13 (2868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:52 (1776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:49 (5096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:16:30 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:17 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:57 (1896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:21:40 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:22:38 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:57 (1392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:27:22 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:28:08 (1108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:17:56 (5240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:05 (4044): No heartbeat from core client for 30 sec - exiting 05:55:06 (4044): No heartbeat from core client for 30 sec - exiting 05:55:07 (4044): No heartbeat from core client for 30 sec - exiting 05:55:08 (4044): No heartbeat from core client for 30 sec - exiting 05:55:09 (4044): No heartbeat from core client for 30 sec - exiting 05:55:11 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:38 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:18 (3168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2013 16:16:00	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	1,036,800	1,690,609	1.6306
10 Feb 2013 03:25:42	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	1,010,880	1,648,441	1.6307
09 Feb 2013 15:20:38	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	984,960	1,606,714	1.6312
09 Feb 2013 02:55:25	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	959,040	1,564,921	1.6318
08 Feb 2013 14:40:35	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	933,120	1,522,820	1.6320
08 Feb 2013 02:09:29	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	907,200	1,480,415	1.6319
07 Feb 2013 14:05:56	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	881,280	1,438,546	1.6323
07 Feb 2013 01:20:29	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	855,360	1,396,368	1.6325
06 Feb 2013 13:20:16	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	829,440	1,354,611	1.6332
05 Feb 2013 22:40:44	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	803,520	1,311,880	1.6327
05 Feb 2013 11:02:21	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	777,600	1,270,159	1.6334
04 Feb 2013 21:54:07	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	751,680	1,228,244	1.6340
04 Feb 2013 09:27:57	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	725,760	1,186,194	1.6344
03 Feb 2013 19:52:10	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	699,840	1,143,814	1.6344
03 Feb 2013 07:27:21	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	673,920	1,102,099	1.6354
02 Feb 2013 19:46:20	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	648,000	1,060,438	1.6365
02 Feb 2013 07:15:18	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	622,080	1,018,358	1.6370
01 Feb 2013 19:07:18	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	596,160	976,595	1.6381
01 Feb 2013 07:06:30	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	570,240	934,454	1.6387
31 Jan 2013 18:41:42	1230144	15553060	hadcm3n_zhxv_1880_40_008246733_4	544,320	893,007	1.6406