Task 16230415

Name	hadcm3n_7k3t_1980_40_008437340_1
Workunit	8588196
Created	14 Jan 2014, 6:32:19 UTC
Sent	14 Jan 2014, 6:35:54 UTC
Report deadline	15 Apr 2014, 14:03:05 UTC
Received	26 Jan 2014, 11:27:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1309653
Run time	5 days 9 hours 51 min 37 sec
CPU time	4 days 21 hours 24 min 28 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.08 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:38:24 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:39:57 (3684): No heartbeat from core client for 30 sec - exiting 06:39:59 (3684): No heartbeat from core client for 30 sec - exiting 06:40:00 (3684): No heartbeat from core client for 30 sec - exiting 06:40:01 (3684): No heartbeat from core client for 30 sec - exiting 06:40:02 (3684): No heartbeat from core client for 30 sec - exiting 06:40:03 (3684): No heartbeat from core client for 30 sec - exiting 06:40:04 (3684): No heartbeat from core client for 30 sec - exiting 06:40:05 (3684): No heartbeat from core client for 30 sec - exiting 06:40:06 (3684): No heartbeat from core client for 30 sec - exiting 06:40:07 (3684): No heartbeat from core client for 30 sec - exiting 06:40:08 (3684): No heartbeat from core client for 30 sec - exiting 06:40:09 (3684): No heartbeat from core client for 30 sec - exiting 06:40:11 (3684): No heartbeat from core client for 30 sec - exiting 06:40:12 (3684): No heartbeat from core client for 30 sec - exiting 06:40:13 (3684): No heartbeat from core client for 30 sec - exiting 06:40:14 (3684): No heartbeat from core client for 30 sec - exiting 06:40:15 (3684): No heartbeat from core client for 30 sec - exiting 06:40:16 (3684): No heartbeat from core client for 30 sec - exiting 06:40:17 (3684): No heartbeat from core client for 30 sec - exiting 06:40:18 (3684): No heartbeat from core client for 30 sec - exiting 06:40:19 (3684): No heartbeat from core client for 30 sec - exiting 06:40:20 (3684): No heartbeat from core client for 30 sec - exiting 06:40:22 (3684): No heartbeat from core client for 30 sec - exiting 06:40:23 (3684): No heartbeat from core client for 30 sec - exiting 06:40:24 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:53:24 (7352): No heartbeat from core client for 30 sec - exiting 12:53:25 (7352): No heartbeat from core client for 30 sec - exiting 12:53:26 (7352): No heartbeat from core client for 30 sec - exiting 12:53:27 (7352): No heartbeat from core client for 30 sec - exiting 12:53:29 (7352): No heartbeat from core client for 30 sec - exiting 12:53:30 (7352): No heartbeat from core client for 30 sec - exiting 12:53:31 (7352): No heartbeat from core client for 30 sec - exiting 12:53:32 (7352): No heartbeat from core client for 30 sec - exiting 12:53:33 (7352): No heartbeat from core client for 30 sec - exiting 12:53:34 (7352): No heartbeat from core client for 30 sec - exiting 12:53:35 (7352): No heartbeat from core client for 30 sec - exiting 12:53:36 (7352): No heartbeat from core client for 30 sec - exiting 12:53:37 (7352): No heartbeat from core client for 30 sec - exiting 12:53:38 (7352): No heartbeat from core client for 30 sec - exiting 12:53:39 (7352): No heartbeat from core client for 30 sec - exiting 12:53:41 (7352): No heartbeat from core client for 30 sec - exiting 12:53:42 (7352): No heartbeat from core client for 30 sec - exiting 12:53:43 (7352): No heartbeat from core client for 30 sec - exiting 12:53:44 (7352): No heartbeat from core client for 30 sec - exiting 12:53:45 (7352): No heartbeat from core client for 30 sec - exiting 12:53:46 (7352): No heartbeat from core client for 30 sec - exiting 12:53:47 (7352): No heartbeat from core client for 30 sec - exiting 12:53:48 (7352): No heartbeat from core client for 30 sec - exiting 12:53:49 (7352): No heartbeat from core client for 30 sec - exiting 12:53:50 (7352): No heartbeat from core client for 30 sec - exiting 12:53:51 (7352): No heartbeat from core client for 30 sec - exiting 12:53:53 (7352): No heartbeat from core client for 30 sec - exiting 12:53:54 (7352): No heartbeat from core client for 30 sec - exiting 12:53:55 (7352): No heartbeat from core client for 30 sec - exiting 12:53:56 (7352): No heartbeat from core client for 30 sec - exiting 12:53:57 (7352): No heartbeat from core client for 30 sec - exiting 12:53:58 (7352): No heartbeat from core client for 30 sec - exiting 12:53:59 (7352): No heartbeat from core client for 30 sec - exiting 12:54:00 (7352): No heartbeat from core client for 30 sec - exiting 12:54:01 (7352): No heartbeat from core client for 30 sec - exiting 12:54:02 (7352): No heartbeat from core client for 30 sec - exiting 12:54:03 (7352): No heartbeat from core client for 30 sec - exiting 12:54:05 (7352): No heartbeat from core client for 30 sec - exiting 12:54:06 (7352): No heartbeat from core client for 30 sec - exiting 12:54:07 (7352): No heartbeat from core client for 30 sec - exiting 12:54:08 (7352): No heartbeat from core client for 30 sec - exiting 12:54:09 (7352): No heartbeat from core client for 30 sec - exiting 12:54:10 (7352): No heartbeat from core client for 30 sec - exiting 12:54:11 (7352): No heartbeat from core client for 30 sec - exiting 12:54:12 (7352): No heartbeat from core client for 30 sec - exiting 12:54:13 (7352): No heartbeat from core client for 30 sec - exiting 12:54:14 (7352): No heartbeat from core client for 30 sec - exiting 12:54:15 (7352): No heartbeat from core client for 30 sec - exiting 12:54:17 (7352): No heartbeat from core client for 30 sec - exiting 12:54:18 (7352): No heartbeat from core client for 30 sec - exiting 12:54:19 (7352): No heartbeat from core client for 30 sec - exiting 12:54:20 (7352): No heartbeat from core client for 30 sec - exiting 12:54:21 (7352): No heartbeat from core client for 30 sec - exiting 12:54:22 (7352): No heartbeat from core client for 30 sec - exiting 12:54:23 (7352): No heartbeat from core client for 30 sec - exiting 12:54:24 (7352): No heartbeat from core client for 30 sec - exiting 12:54:25 (7352): No heartbeat from core client for 30 sec - exiting 12:54:26 (7352): No heartbeat from core client for 30 sec - exiting 12:54:28 (7352): No heartbeat from core client for 30 sec - exiting 12:54:29 (7352): No heartbeat from core client for 30 sec - exiting 12:54:30 (7352): No heartbeat from core client for 30 sec - exiting 12:54:31 (7352): No heartbeat from core client for 30 sec - exiting 12:54:32 (7352): No heartbeat from core client for 30 sec - exiting 12:54:33 (7352): No heartbeat from core client for 30 sec - exiting 12:54:34 (7352): No heartbeat from core client for 30 sec - exiting 12:54:35 (7352): No heartbeat from core client for 30 sec - exiting 12:54:36 (7352): No heartbeat from core client for 30 sec - exiting 12:54:37 (7352): No heartbeat from core client for 30 sec - exiting 12:54:38 (7352): No heartbeat from core client for 30 sec - exiting 12:54:40 (7352): No heartbeat from core client for 30 sec - exiting 12:54:41 (7352): No heartbeat from core client for 30 sec - exiting 12:54:42 (7352): No heartbeat from core client for 30 sec - exiting 12:54:43 (7352): No heartbeat from core client for 30 sec - exiting 12:54:44 (7352): No heartbeat from core client for 30 sec - exiting 12:54:45 (7352): No heartbeat from core client for 30 sec - exiting 12:54:46 (7352): No heartbeat from core client for 30 sec - exiting 12:54:47 (7352): No heartbeat from core client for 30 sec - exiting 12:54:48 (7352): No heartbeat from core client for 30 sec - exiting 12:54:49 (7352): No heartbeat from core client for 30 sec - exiting 12:54:50 (7352): No heartbeat from core client for 30 sec - exiting 12:54:52 (7352): No heartbeat from core client for 30 sec - exiting 12:54:53 (7352): No heartbeat from core client for 30 sec - exiting 12:54:54 (7352): No heartbeat from core client for 30 sec - exiting 12:54:55 (7352): No heartbeat from core client for 30 sec - exiting 12:54:56 (7352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:57 (7352): No heartbeat from core client for 30 sec - exiting 12:54:58 (7352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:36:45 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:58:56 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4324, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4324, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4324, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jan 2014 11:27:28	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	259,200	422,664	1.6306
25 Jan 2014 09:32:19	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	233,280	379,024	1.6248
24 Jan 2014 11:56:57	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	207,360	336,434	1.6225
22 Jan 2014 17:41:24	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	181,440	292,931	1.6145
21 Jan 2014 14:26:20	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	155,520	250,653	1.6117
19 Jan 2014 20:57:44	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	129,600	207,961	1.6046
18 Jan 2014 19:01:50	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	103,680	165,580	1.5970
17 Jan 2014 14:23:32	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	77,760	123,671	1.5904
16 Jan 2014 08:43:27	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	51,840	81,720	1.5764
15 Jan 2014 11:09:37	1309653	16230415	hadcm3n_7k3t_1980_40_008437340_1	25,920	42,583	1.6429