Task 13100530

Name	hadcm3n_ybxu_1900_40_007348332_0
Workunit	7545762
Created	6 Jul 2011, 13:49:56 UTC
Sent	18 Jul 2011, 9:24:45 UTC
Report deadline	17 Oct 2011, 16:51:56 UTC
Received	20 Sep 2011, 17:56:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1144915
Run time	12 days 20 hours 6 min 20 sec
CPU time	12 days 7 hours 37 min 49 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:00:32 (5012): No heartbeat from core client for 30 sec - exiting 16:00:33 (5012): No heartbeat from core client for 30 sec - exiting 16:00:34 (5012): No heartbeat from core client for 30 sec - exiting 16:00:35 (5012): No heartbeat from core client for 30 sec - exiting 16:00:36 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:58:23 (8912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:25 (8912): No heartbeat from core client for 30 sec - exiting 05:58:26 (8912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:29:01 (5244): No heartbeat from core client for 30 sec - exiting 13:29:02 (5244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:17:55 (9668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:28:52 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:02:45 (10044): No heartbeat from core client for 30 sec - exiting 13:02:47 (10044): No heartbeat from core client for 30 sec - exiting 13:02:48 (10044): No heartbeat from core client for 30 sec - exiting 13:02:49 (10044): No heartbeat from core client for 30 sec - exiting 13:02:50 (10044): No heartbeat from core client for 30 sec - exiting 13:02:51 (10044): No heartbeat from core client for 30 sec - exiting 13:02:52 (10044): No heartbeat from core client for 30 sec - exiting 13:02:53 (10044): No heartbeat from core client for 30 sec - exiting 13:02:54 (10044): No heartbeat from core client for 30 sec - exiting 13:02:55 (10044): No heartbeat from core client for 30 sec - exiting 13:02:56 (10044): No heartbeat from core client for 30 sec - exiting 13:02:57 (10044): No heartbeat from core client for 30 sec - exiting 13:02:58 (10044): No heartbeat from core client for 30 sec - exiting 13:02:59 (10044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:48 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:58:43 (5972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:37:23 (5956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:31:24 (4800): No heartbeat from core client for 30 sec - exiting 12:31:25 (4800): No heartbeat from core client for 30 sec - exiting 12:31:26 (4800): No heartbeat from core client for 30 sec - exiting 12:31:27 (4800): No heartbeat from core client for 30 sec - exiting 12:31:28 (4800): No heartbeat from core client for 30 sec - exiting 12:31:29 (4800): No heartbeat from core client for 30 sec - exiting 12:31:30 (4800): No heartbeat from core client for 30 sec - exiting 12:31:31 (4800): No heartbeat from core client for 30 sec - exiting 12:31:32 (4800): No heartbeat from core client for 30 sec - exiting 12:31:33 (4800): No heartbeat from core client for 30 sec - exiting 12:31:34 (4800): No heartbeat from core client for 30 sec - exiting 12:31:35 (4800): No heartbeat from core client for 30 sec - exiting 12:31:36 (4800): No heartbeat from core client for 30 sec - exiting 12:31:37 (4800): No heartbeat from core client for 30 sec - exiting 12:31:38 (4800): No heartbeat from core client for 30 sec - exiting 12:31:39 (4800): No heartbeat from core client for 30 sec - exiting 12:31:40 (4800): No heartbeat from core client for 30 sec - exiting 12:31:41 (4800): No heartbeat from core client for 30 sec - exiting 12:31:42 (4800): No heartbeat from core client for 30 sec - exiting 12:31:43 (4800): No heartbeat from core client for 30 sec - exiting 12:31:44 (4800): No heartbeat from core client for 30 sec - exiting 12:31:45 (4800): No heartbeat from core client for 30 sec - exiting 12:31:46 (4800): No heartbeat from core client for 30 sec - exiting 12:31:47 (4800): No heartbeat from core client for 30 sec - exiting 12:31:48 (4800): No heartbeat from core client for 30 sec - exiting 12:31:49 (4800): No heartbeat from core client for 30 sec - exiting 12:31:50 (4800): No heartbeat from core client for 30 sec - exiting 12:31:51 (4800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:43:38 (5152): No heartbeat from core client for 30 sec - exiting 16:43:39 (5152): No heartbeat from core client for 30 sec - exiting 16:43:41 (5152): No heartbeat from core client for 30 sec - exiting 16:43:42 (5152): No heartbeat from core client for 30 sec - exiting 16:43:43 (5152): No heartbeat from core client for 30 sec - exiting 16:43:44 (5152): No heartbeat from core client for 30 sec - exiting 16:43:45 (5152): No heartbeat from core client for 30 sec - exiting 16:43:46 (5152): No heartbeat from core client for 30 sec - exiting 16:43:47 (5152): No heartbeat from core client for 30 sec - exiting 16:43:48 (5152): No heartbeat from core client for 30 sec - exiting 16:43:49 (5152): No heartbeat from core client for 30 sec - exiting 16:43:50 (5152): No heartbeat from core client for 30 sec - exiting 16:43:52 (5152): No heartbeat from core client for 30 sec - exiting 16:43:53 (5152): No heartbeat from core client for 30 sec - exiting 16:43:54 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:44:00 (3136): Can't acquire lockfile (32) - waiting 35s 16:44:35 (3136): Can't set up shared mem: -1. Will run in standalone mode. 16:44:35 (7532): Can't set up shared mem: -1. Will run in standalone mode. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1252, iMonCtr=1 Model crash detected, will try to restart... 08:07:58 (4600): No heartbeat from core client for 30 sec - exiting 08:07:59 (4600): No heartbeat from core client for 30 sec - exiting 08:08:00 (4600): No heartbeat from core client for 30 sec - exiting 08:08:01 (4600): No heartbeat from core client for 30 sec - exiting 08:08:02 (4600): No heartbeat from core client for 30 sec - exiting 08:08:03 (4600): No heartbeat from core client for 30 sec - exiting 08:08:04 (4600): No heartbeat from core client for 30 sec - exiting 08:08:05 (4600): No heartbeat from core client for 30 sec - exiting 08:08:06 (4600): No heartbeat from core client for 30 sec - exiting 08:08:07 (4600): No heartbeat from core client for 30 sec - exiting 08:08:08 (4600): No heartbeat from core client for 30 sec - exiting 08:08:09 (4600): No heartbeat from core client for 30 sec - exiting 08:08:10 (4600): No heartbeat from core client for 30 sec - exiting 08:08:11 (4600): No heartbeat from core client for 30 sec - exiting 08:08:12 (4600): No heartbeat from core client for 30 sec - exiting 08:08:13 (4600): No heartbeat from core client for 30 sec - exiting 08:08:14 (4600): No heartbeat from core client for 30 sec - exiting 08:08:15 (4600): No heartbeat from core client for 30 sec - exiting 08:08:16 (4600): No heartbeat from core client for 30 sec - exiting 08:08:17 (4600): No heartbeat from core client for 30 sec - exiting 08:08:18 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5684, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5104, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:00:19 (6552): No heartbeat from core client for 30 sec - exiting 16:00:21 (6552): No heartbeat from core client for 30 sec - exiting 16:00:22 (6552): No heartbeat from core client for 30 sec - exiting 16:00:23 (6552): No heartbeat from core client for 30 sec - exiting 16:00:24 (6552): No heartbeat from core client for 30 sec - exiting 16:00:25 (6552): No heartbeat from core client for 30 sec - exiting 16:00:26 (6552): No heartbeat from core client for 30 sec - exiting 16:00:27 (6552): No heartbeat from core client for 30 sec - exiting 16:00:28 (6552): No heartbeat from core client for 30 sec - exiting 16:00:29 (6552): No heartbeat from core client for 30 sec - exiting 16:00:30 (6552): No heartbeat from core client for 30 sec - exiting 16:00:31 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:04:37 (10252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:17:36 (7932): No heartbeat from core client for 30 sec - exiting 09:17:38 (7932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:34 (4672): No heartbeat from core client for 30 sec - exiting 12:22:36 (4672): No heartbeat from core client for 30 sec - exiting 12:22:37 (4672): No heartbeat from core client for 30 sec - exiting 12:22:38 (4672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:05:40 (5764): No heartbeat from core client for 30 sec - exiting 09:05:41 (5764): No heartbeat from core client for 30 sec - exiting 09:05:42 (5764): No heartbeat from core client for 30 sec - exiting 09:05:43 (5764): No heartbeat from core client for 30 sec - exiting 09:05:44 (5764): No heartbeat from core client for 30 sec - exiting 09:05:45 (5764): No heartbeat from core client for 30 sec - exiting 09:05:46 (5764): No heartbeat from core client for 30 sec - exiting 09:05:47 (5764): No heartbeat from core client for 30 sec - exiting 09:05:48 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:18 (5508): No heartbeat from core client for 30 sec - exiting 13:16:19 (5508): No heartbeat from core client for 30 sec - exiting 13:16:20 (5508): No heartbeat from core client for 30 sec - exiting 13:16:21 (5508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6096, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 16:00:33 (4600): No heartbeat from core client for 30 sec - exiting 16:00:34 (4600): No heartbeat from core client for 30 sec - exiting 16:00:35 (4600): No heartbeat from core client for 30 sec - exiting 16:00:36 (4600): No heartbeat from core client for 30 sec - exiting 16:00:37 (4600): No heartbeat from core client for 30 sec - exiting 16:00:38 (4600): No heartbeat from core client for 30 sec - exiting 16:00:39 (4600): No heartbeat from core client for 30 sec - exiting 16:00:40 (4600): No heartbeat from core client for 30 sec - exiting 16:00:41 (4600): No heartbeat from core client for 30 sec - exiting 16:00:42 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4572, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:52:43 (5344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Sep 2011 14:31:54	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	518,400	1,064,256	2.0530
05 Sep 2011 23:50:56	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	492,480	1,010,676	2.0522
03 Sep 2011 07:11:09	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	466,560	953,972	2.0447
30 Aug 2011 20:28:19	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	440,640	898,320	2.0387
30 Aug 2011 07:24:59	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	414,720	841,871	2.0300
27 Aug 2011 09:13:18	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	388,800	788,956	2.0292
24 Aug 2011 18:02:50	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	362,880	737,066	2.0312
23 Aug 2011 19:35:41	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	336,960	685,693	2.0349
22 Aug 2011 21:08:01	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	311,040	635,080	2.0418
22 Aug 2011 06:15:48	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	285,120	580,544	2.0361
17 Aug 2011 22:42:59	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	259,200	527,420	2.0348
17 Aug 2011 00:02:04	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	233,280	475,846	2.0398
15 Aug 2011 18:06:58	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	207,360	421,290	2.0317
10 Aug 2011 23:47:17	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	181,440	375,286	2.0684
09 Aug 2011 02:24:02	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	155,520	320,688	2.0620
06 Aug 2011 08:40:19	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	129,600	265,386	2.0477
03 Aug 2011 21:15:13	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	103,680	213,502	2.0592
02 Aug 2011 22:27:51	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	77,760	158,605	2.0397
30 Jul 2011 15:09:41	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	51,840	107,034	2.0647
27 Jul 2011 15:39:09	1144915	13100530	hadcm3n_ybxu_1900_40_007348332_0	25,920	54,335	2.0963