Task 14109261

Name	hadcm3n_u5ct_1980_40_007752885_2
Workunit	7907994
Created	18 Feb 2012, 19:01:44 UTC
Sent	18 Feb 2012, 19:01:47 UTC
Report deadline	20 May 2012, 2:28:58 UTC
Received	1 Jun 2012, 13:27:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1159517
Run time	16 days 5 hours 10 min 53 sec
CPU time	15 days 23 hours 37 min 21 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:28:20 (9800): No heartbeat from core client for 30 sec - exiting 22:28:21 (9800): No heartbeat from core client for 30 sec - exiting 22:28:22 (9800): No heartbeat from core client for 30 sec - exiting 22:28:23 (9800): No heartbeat from core client for 30 sec - exiting 22:28:24 (9800): No heartbeat from core client for 30 sec - exiting 22:28:25 (9800): No heartbeat from core client for 30 sec - exiting 22:28:26 (9800): No heartbeat from core client for 30 sec - exiting 22:28:27 (9800): No heartbeat from core client for 30 sec - exiting 22:28:28 (9800): No heartbeat from core client for 30 sec - exiting 22:28:29 (9800): No heartbeat from core client for 30 sec - exiting 22:28:30 (9800): No heartbeat from core client for 30 sec - exiting 22:28:31 (9800): No heartbeat from core client for 30 sec - exiting 22:28:32 (9800): No heartbeat from core client for 30 sec - exiting 22:28:33 (9800): No heartbeat from core client for 30 sec - exiting 22:28:34 (9800): No heartbeat from core client for 30 sec - exiting 22:28:35 (9800): No heartbeat from core client for 30 sec - exiting 22:28:36 (9800): No heartbeat from core client for 30 sec - exiting 22:28:37 (9800): No heartbeat from core client for 30 sec - exiting 22:28:38 (9800): No heartbeat from core client for 30 sec - exiting 22:28:39 (9800): No heartbeat from core client for 30 sec - exiting 22:28:40 (9800): No heartbeat from core client for 30 sec - exiting 22:28:41 (9800): No heartbeat from core client for 30 sec - exiting 22:28:42 (9800): No heartbeat from core client for 30 sec - exiting 22:28:43 (9800): No heartbeat from core client for 30 sec - exiting 22:28:44 (9800): No heartbeat from core client for 30 sec - exiting 22:28:45 (9800): No heartbeat from core client for 30 sec - exiting 22:28:46 (9800): No heartbeat from core client for 30 sec - exiting 22:28:47 (9800): No heartbeat from core client for 30 sec - exiting 22:28:48 (9800): No heartbeat from core client for 30 sec - exiting 22:28:49 (9800): No heartbeat from core client for 30 sec - exiting 22:28:50 (9800): No heartbeat from core client for 30 sec - exiting 22:28:51 (9800): No heartbeat from core client for 30 sec - exiting 22:28:52 (9800): No heartbeat from core client for 30 sec - exiting 22:28:53 (9800): No heartbeat from core client for 30 sec - exiting 22:28:54 (9800): No heartbeat from core client for 30 sec - exiting 22:28:55 (9800): No heartbeat from core client for 30 sec - exiting 22:28:56 (9800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:09:50 (6056): No heartbeat from core client for 30 sec - exiting 20:09:51 (6056): No heartbeat from core client for 30 sec - exiting 20:09:52 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:03:43 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:24:46 (3776): No heartbeat from core client for 30 sec - exiting 18:24:47 (3776): No heartbeat from core client for 30 sec - exiting 18:24:48 (3776): No heartbeat from core client for 30 sec - exiting 18:24:49 (3776): No heartbeat from core client for 30 sec - exiting 18:24:50 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:00:17 (2752): No heartbeat from core client for 30 sec - exiting 15:00:18 (2752): No heartbeat from core client for 30 sec - exiting 15:00:19 (2752): No heartbeat from core client for 30 sec - exiting 15:00:20 (2752): No heartbeat from core client for 30 sec - exiting 15:00:21 (2752): No heartbeat from core client for 30 sec - exiting 15:00:22 (2752): No heartbeat from core client for 30 sec - exiting 15:00:23 (2752): No heartbeat from core client for 30 sec - exiting 15:00:24 (2752): No heartbeat from core client for 30 sec - exiting 15:00:25 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:14:35 (3536): No heartbeat from core client for 30 sec - exiting 16:14:37 (3536): No heartbeat from core client for 30 sec - exiting 16:14:38 (3536): No heartbeat from core client for 30 sec - exiting 16:14:39 (3536): No heartbeat from core client for 30 sec - exiting 16:15:10 (3536): No heartbeat from core client for 30 sec - exiting 16:15:11 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:15:12 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 10:12:46 (5952): No heartbeat from core client for 30 sec - exiting 10:12:47 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:48 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:32:01 (736): No heartbeat from core client for 30 sec - exiting 23:32:02 (736): No heartbeat from core client for 30 sec - exiting 23:32:03 (736): No heartbeat from core client for 30 sec - exiting 23:32:04 (736): No heartbeat from core client for 30 sec - exiting 23:32:05 (736): No heartbeat from core client for 30 sec - exiting 23:32:06 (736): No heartbeat from core client for 30 sec - exiting 23:32:07 (736): No heartbeat from core client for 30 sec - exiting 23:32:08 (736): No heartbeat from core client for 30 sec - exiting 23:32:09 (736): No heartbeat from core client for 30 sec - exiting 23:32:10 (736): No heartbeat from core client for 30 sec - exiting 23:32:11 (736): No heartbeat from core client for 30 sec - exiting 23:32:12 (736): No heartbeat from core client for 30 sec - exiting 23:32:13 (736): No heartbeat from core client for 30 sec - exiting 23:32:14 (736): No heartbeat from core client for 30 sec - exiting 23:32:15 (736): No heartbeat from core client for 30 sec - exiting 23:32:16 (736): No heartbeat from core client for 30 sec - exiting 23:32:17 (736): No heartbeat from core client for 30 sec - exiting 23:32:18 (736): No heartbeat from core client for 30 sec - exiting 23:32:19 (736): No heartbeat from core client for 30 sec - exiting 23:32:20 (736): No heartbeat from core client for 30 sec - exiting 23:32:21 (736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:32:53 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:47:46 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:06:29 (4872): No heartbeat from core client for 30 sec - exiting 09:06:30 (4872): No heartbeat from core client for 30 sec - exiting 09:06:31 (4872): No heartbeat from core client for 30 sec - exiting 09:06:32 (4872): No heartbeat from core client for 30 sec - exiting 09:06:33 (4872): No heartbeat from core client for 30 sec - exiting 09:06:34 (4872): No heartbeat from core client for 30 sec - exiting 09:06:35 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:41:57 (5912): No heartbeat from core client for 30 sec - exiting 11:41:59 (5912): No heartbeat from core client for 30 sec - exiting 11:42:00 (5912): No heartbeat from core client for 30 sec - exiting 11:42:01 (5912): No heartbeat from core client for 30 sec - exiting 11:42:02 (5912): No heartbeat from core client for 30 sec - exiting 11:42:03 (5912): No heartbeat from core client for 30 sec - exiting 11:42:04 (5912): No heartbeat from core client for 30 sec - exiting 11:42:05 (5912): No heartbeat from core client for 30 sec - exiting 11:42:06 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:56:10 (4004): No heartbeat from core client for 30 sec - exiting 12:56:11 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:12 (4004): No heartbeat from core client for 30 sec - exiting 12:56:13 (4004): No heartbeat from core client for 30 sec - exiting 12:56:14 (4004): No heartbeat from core client for 30 sec - exiting 12:56:15 (4004): No heartbeat from core client for 30 sec - exiting 12:56:16 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5548, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:50:18 (2952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:33:14 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:53:37 (17744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7256, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7256, iMonCtr=1 Model crash detected, will try to restart... 10:57:20 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:31:04 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:54:36 (2384000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:38:16 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13544, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Jun 2012 13:29:32	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	1,036,800	1,381,040	1.3320
30 May 2012 18:40:41	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	1,010,880	1,347,755	1.3332
29 May 2012 20:42:19	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	984,960	1,314,438	1.3345
27 May 2012 21:55:23	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	959,040	1,282,300	1.3371
26 May 2012 21:53:35	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	933,120	1,248,490	1.3380
23 May 2012 21:28:44	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	907,200	1,214,732	1.3390
23 May 2012 12:00:57	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	881,280	1,180,815	1.3399
20 May 2012 13:48:24	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	855,360	1,147,707	1.3418
17 May 2012 15:39:48	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	829,440	1,113,938	1.3430
14 May 2012 18:16:02	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	803,520	1,080,426	1.3446
13 May 2012 07:51:49	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	777,600	1,047,356	1.3469
10 May 2012 14:56:53	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	751,680	1,013,446	1.3482
09 May 2012 16:19:42	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	725,760	980,058	1.3504
08 May 2012 22:32:18	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	699,840	947,009	1.3532
08 May 2012 13:18:51	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	673,920	913,826	1.3560
07 May 2012 15:10:50	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	648,000	881,047	1.3596
06 May 2012 15:26:41	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	622,080	847,817	1.3629
04 May 2012 16:24:35	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	596,160	814,647	1.3665
01 May 2012 14:34:03	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	570,240	782,399	1.3721
28 Apr 2012 17:14:22	1159517	14109261	hadcm3n_u5ct_1980_40_007752885_2	544,320	749,543	1.3770