Task 12820156

Name	hadcm3n_p1yd_1900_40_007220117_0
Workunit	7418357
Created	26 Apr 2011, 15:19:24 UTC
Sent	3 May 2011, 5:20:58 UTC
Report deadline	2 Aug 2011, 12:48:09 UTC
Received	23 Jul 2011, 4:23:24 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1119216
Run time	49 days 8 hours 1 min 16 sec
CPU time	44 days 2 hours 27 min 47 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.17 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:01:19 (4648): Can't acquire lockfile (32) - waiting 35s 19:01:39 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:10:55 (6232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:10:56 (6232): No heartbeat from core client for 30 sec - exiting 22:10:57 (6232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4392, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4288, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:13:04 (3772): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:13:05 (3772): No heartbeat from core client for 30 sec - exiting 21:13:06 (3772): No heartbeat from core client for 30 sec - exiting 21:13:08 (3772): No heartbeat from core client for 30 sec - exiting 21:13:09 (3772): No heartbeat from core client for 30 sec - exiting 21:13:10 (3772): No heartbeat from core client for 30 sec - exiting 21:13:11 (3772): No heartbeat from core client for 30 sec - exiting 21:13:12 (3772): No heartbeat from core client for 30 sec - exiting 21:13:13 (3772): No heartbeat from core client for 30 sec - exiting 21:13:14 (3772): No heartbeat from core client for 30 sec - exiting 21:13:15 (3772): No heartbeat from core client for 30 sec - exiting 21:13:16 (3772): No heartbeat from core client for 30 sec - exiting 21:13:17 (3772): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:26:34 (10692): Can't acquire lockfile (32) - waiting 35s 16:26:52 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7840, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6376, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:06:27 (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:06:29 (3544): No heartbeat from core client for 30 sec - exiting 17:06:30 (3544): No heartbeat from core client for 30 sec - exiting 17:06:31 (3544): No heartbeat from core client for 30 sec - exiting 17:06:32 (3544): No heartbeat from core client for 30 sec - exiting 17:06:33 (3544): No heartbeat from core client for 30 sec - exiting 17:06:34 (3544): No heartbeat from core client for 30 sec - exiting 17:06:35 (3544): No heartbeat from core client for 30 sec - exiting 17:06:36 (3544): No heartbeat from core client for 30 sec - exiting 17:06:37 (3544): No heartbeat from core client for 30 sec - exiting 17:06:38 (3544): No heartbeat from core client for 30 sec - exiting 17:06:39 (3544): No heartbeat from core client for 30 sec - exiting 17:06:40 (3544): No heartbeat from core client for 30 sec - exiting 17:06:41 (3544): No heartbeat from core client for 30 sec - exiting 17:06:42 (3544): No heartbeat from core client for 30 sec - exiting 17:06:43 (3544): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:59:57 (868): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6268, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2128, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:10:53 (1292): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:03:08 (6156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:09 (6156): No heartbeat from core client for 30 sec - exiting 09:03:10 (6156): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6036, iMonCtr=1 Model crash detected, will try to restart... 05:55:23 (1856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:01 (2100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:39 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:55 (7628): Can't acquire lockfile (32) - waiting 35s 13:40:11 (5288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 20:28:05	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	1,036,800	3,809,131	3.6739
25 Jul 2011 19:08:12	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	1,010,880	3,709,390	3.6695
25 Jul 2011 18:52:42	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	984,960	3,610,275	3.6654
25 Jul 2011 17:47:37	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	959,040	3,511,384	3.6614
25 Jul 2011 16:31:41	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	933,120	3,413,802	3.6585
25 Jul 2011 15:37:53	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	907,200	3,316,447	3.6557
25 Jul 2011 13:38:01	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	881,280	3,220,135	3.6539
25 Jul 2011 13:38:01	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	855,360	3,130,636	3.6600
25 Jul 2011 13:38:01	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	829,440	3,047,882	3.6746
25 Jul 2011 13:38:01	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	803,520	2,951,470	3.6732
25 Jul 2011 13:38:01	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	777,600	2,854,863	3.6714
25 Jul 2011 13:38:01	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	751,680	2,760,706	3.6727
04 Jul 2011 22:38:12	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	725,760	2,673,262	3.6834
03 Jul 2011 01:01:44	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	699,840	2,577,492	3.6830
01 Jul 2011 08:58:55	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	673,920	2,482,881	3.6842
30 Jun 2011 00:46:29	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	648,000	2,391,685	3.6909
30 Jun 2011 00:46:29	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	622,080	2,302,016	3.7005
30 Jun 2011 00:46:29	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	596,160	2,199,588	3.6896
24 Jun 2011 13:18:47	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	570,240	2,098,764	3.6805
22 Jun 2011 08:47:10	1119216	12820156	hadcm3n_p1yd_1900_40_007220117_0	544,320	2,003,730	3.6812