Task 13343555

Name	hadcm3n_yjv7_1980_40_007441769_0
Workunit	7639272
Created	7 Sep 2011, 2:45:20 UTC
Sent	7 Sep 2011, 2:47:08 UTC
Report deadline	7 Dec 2011, 10:14:19 UTC
Received	2 Oct 2011, 6:25:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1090356
Run time	10 days 6 hours 0 min 31 sec
CPU time	9 days 17 hours 59 min 19 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:34:23 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:43:36 (2100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:08 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:10 (2892): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:21:20 (5056): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:21:21 (5056): No heartbeat from core client for 30 sec - exiting 14:21:22 (5056): No heartbeat from core client for 30 sec - exiting 14:21:23 (5056): No heartbeat from core client for 30 sec - exiting 14:21:24 (5056): No heartbeat from core client for 30 sec - exiting 14:21:26 (5056): No heartbeat from core client for 30 sec - exiting 14:21:27 (5056): No heartbeat from core client for 30 sec - exiting 14:21:28 (5056): No heartbeat from core client for 30 sec - exiting 14:21:29 (5056): No heartbeat from core client for 30 sec - exiting 14:21:30 (5056): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:27:26 (3052): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:27:27 (3052): No heartbeat from core client for 30 sec - exiting 14:27:28 (3052): No heartbeat from core client for 30 sec - exiting 14:27:29 (3052): No heartbeat from core client for 30 sec - exiting 14:27:30 (3052): No heartbeat from core client for 30 sec - exiting 14:27:31 (3052): No heartbeat from core client for 30 sec - exiting 14:27:32 (3052): No heartbeat from core client for 30 sec - exiting 14:27:33 (3052): No heartbeat from core client for 30 sec - exiting 14:27:34 (3052): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:48:56 (4512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:34:38 (5884): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:34:39 (5884): No heartbeat from core client for 30 sec - exiting 15:34:40 (5884): No heartbeat from core client for 30 sec - exiting 15:34:41 (5884): No heartbeat from core client for 30 sec - exiting 15:34:42 (5884): No heartbeat from core client for 30 sec - exiting 15:34:43 (5884): No heartbeat from core client for 30 sec - exiting 15:34:44 (5884): No heartbeat from core client for 30 sec - exiting 15:34:45 (5884): No heartbeat from core client for 30 sec - exiting 15:34:46 (5884): No heartbeat from core client for 30 sec - exiting 15:34:48 (5884): No heartbeat from core client for 30 sec - exiting 15:34:49 (5884): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:43:46 (5012): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:43:47 (5012): No heartbeat from core client for 30 sec - exiting 15:43:48 (5012): No heartbeat from core client for 30 sec - exiting 15:43:49 (5012): No heartbeat from core client for 30 sec - exiting 15:43:50 (5012): No heartbeat from core client for 30 sec - exiting 15:43:51 (5012): No heartbeat from core client for 30 sec - exiting 15:43:52 (5012): No heartbeat from core client for 30 sec - exiting 15:43:53 (5012): No heartbeat from core client for 30 sec - exiting 15:43:54 (5012): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:12:15 (5092): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:24:34 (5104): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:24:35 (5104): No heartbeat from core client for 30 sec - exiting 17:24:36 (5104): No heartbeat from core client for 30 sec - exiting 17:24:37 (5104): No heartbeat from core client for 30 sec - exiting 17:24:38 (5104): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:24:16 (3180): No heartbeat from core client for 30 sec - exiting 03:24:17 (3180): No heartbeat from core client for 30 sec - exiting 03:24:18 (3180): No heartbeat from core client for 30 sec - exiting 03:24:19 (3180): No heartbeat from core client for 30 sec - exiting 03:24:20 (3180): No heartbeat from core client for 30 sec - exiting 03:24:21 (3180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3920, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:59:31 (4440): No heartbeat from core client for 30 sec - exiting 06:59:32 (4440): No heartbeat from core client for 30 sec - exiting 06:59:33 (4440): No heartbeat from core client for 30 sec - exiting 06:59:34 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:01 (4160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:25:31 (3500): No heartbeat from core client for 30 sec - exiting 10:25:32 (3500): No heartbeat from core client for 30 sec - exiting 10:25:33 (3500): No heartbeat from core client for 30 sec - exiting 10:25:34 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:54:25 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:40:52 (3412): No heartbeat from core client for 30 sec - exiting 04:40:53 (3412): No heartbeat from core client for 30 sec - exiting 04:40:54 (3412): No heartbeat from core client for 30 sec - exiting 04:40:55 (3412): No heartbeat from core client for 30 sec - exiting 04:40:56 (3412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:40:57 (3412): No heartbeat from core client for 30 sec - exiting 04:40:58 (3412): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:24:28 (3724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3096, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3204, iMonCtr=1 Model crash detected, will try to restart... 07:35:26 (4164): No heartbeat from core client for 30 sec - exiting 07:35:27 (4164): No heartbeat from core client for 30 sec - exiting 07:35:28 (4164): No heartbeat from core client for 30 sec - exiting 07:35:29 (4164): No heartbeat from core client for 30 sec - exiting 07:35:30 (4164): No heartbeat from core client for 30 sec - exiting 07:35:31 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Oct 2011 06:23:51	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	777,600	842,356	1.0833
01 Oct 2011 12:42:13	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	751,680	814,404	1.0834
30 Sep 2011 04:37:14	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	725,760	787,008	1.0844
29 Sep 2011 20:39:39	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	699,840	760,719	1.0870
28 Sep 2011 19:21:12	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	673,920	732,775	1.0873
28 Sep 2011 03:30:23	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	648,000	704,221	1.0868
27 Sep 2011 14:55:53	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	622,080	676,382	1.0873
27 Sep 2011 07:01:57	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	596,160	649,330	1.0892
26 Sep 2011 10:51:02	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	570,240	621,612	1.0901
26 Sep 2011 02:50:53	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	544,320	593,712	1.0907
25 Sep 2011 18:49:25	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	518,400	565,331	1.0905
24 Sep 2011 17:57:50	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	492,480	535,870	1.0881
24 Sep 2011 09:52:11	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	466,560	508,078	1.0890
24 Sep 2011 02:27:29	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	440,640	479,324	1.0878
23 Sep 2011 05:19:00	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	414,720	450,543	1.0864
22 Sep 2011 07:47:10	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	388,800	422,881	1.0877
19 Sep 2011 13:00:59	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	362,880	394,615	1.0875
18 Sep 2011 07:35:35	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	336,960	365,956	1.0861
17 Sep 2011 07:49:50	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	311,040	337,995	1.0867
16 Sep 2011 23:10:26	1090356	13343555	hadcm3n_yjv7_1980_40_007441769_0	285,120	309,417	1.0852