Task 16162742

Name	hadcm3n_oezf_1900_40_008474542_1
Workunit	8625381
Created	28 Dec 2013, 8:53:34 UTC
Sent	28 Dec 2013, 8:53:42 UTC
Report deadline	29 Mar 2014, 16:20:53 UTC
Received	9 Feb 2014, 19:23:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1300565
Run time	4 days 3 hours 53 min 43 sec
CPU time	3 days 22 hours 19 min 57 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:09:13 (16264): No heartbeat from core client for 30 sec - exiting 15:09:14 (16264): No heartbeat from core client for 30 sec - exiting 15:09:15 (16264): No heartbeat from core client for 30 sec - exiting 15:09:16 (16264): No heartbeat from core client for 30 sec - exiting 15:09:17 (16264): No heartbeat from core client for 30 sec - exiting 15:09:18 (16264): No heartbeat from core client for 30 sec - exiting 15:09:19 (16264): No heartbeat from core client for 30 sec - exiting 15:09:20 (16264): No heartbeat from core client for 30 sec - exiting 15:09:21 (16264): No heartbeat from core client for 30 sec - exiting 15:09:22 (16264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:19:29 (13736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:06:05 (14656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:50 (10156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:50 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:24:30 (11288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:19 (10556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:01 (336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:37:05 (18112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:04:22 (4952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:25 (17828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:07:38 (18124): No heartbeat from core client for 30 sec - exiting 10:07:39 (18124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17944, iMonCtr=1 Model crash detected, will try to restart... 10:52:57 (17944): No heartbeat from core client for 30 sec - exiting 10:52:58 (17944): No heartbeat from core client for 30 sec - exiting 10:53:00 (17944): No heartbeat from core client for 30 sec - exiting 10:53:01 (17944): No heartbeat from core client for 30 sec - exiting 10:53:02 (17944): No heartbeat from core client for 30 sec - exiting 10:53:03 (17944): No heartbeat from core client for 30 sec - exiting 10:53:04 (17944): No heartbeat from core client for 30 sec - exiting 10:53:05 (17944): No heartbeat from core client for 30 sec - exiting 10:53:06 (17944): No heartbeat from core client for 30 sec - exiting 10:53:07 (17944): No heartbeat from core client for 30 sec - exiting 10:53:08 (17944): No heartbeat from core client for 30 sec - exiting 10:53:09 (17944): No heartbeat from core client for 30 sec - exiting 10:53:10 (17944): No heartbeat from core client for 30 sec - exiting 10:53:11 (17944): No heartbeat from core client for 30 sec - exiting 10:53:12 (17944): No heartbeat from core client for 30 sec - exiting 10:53:13 (17944): No heartbeat from core client for 30 sec - exiting 10:53:14 (17944): No heartbeat from core client for 30 sec - exiting 10:53:15 (17944): No heartbeat from core client for 30 sec - exiting 10:53:16 (17944): No heartbeat from core client for 30 sec - exiting 10:53:17 (17944): No heartbeat from core client for 30 sec - exiting 10:53:18 (17944): No heartbeat from core client for 30 sec - exiting 10:53:19 (17944): No heartbeat from core client for 30 sec - exiting 10:53:20 (17944): No heartbeat from core client for 30 sec - exiting 10:53:21 (17944): No heartbeat from core client for 30 sec - exiting 10:53:22 (17944): No heartbeat from core client for 30 sec - exiting 10:53:23 (17944): No heartbeat from core client for 30 sec - exiting 10:53:24 (17944): No heartbeat from core client for 30 sec - exiting 10:53:25 (17944): No heartbeat from core client for 30 sec - exiting 10:53:26 (17944): No heartbeat from core client for 30 sec - exiting 10:53:27 (17944): No heartbeat from core client for 30 sec - exiting 10:53:28 (17944): No heartbeat from core client for 30 sec - exiting 10:53:29 (17944): No heartbeat from core client for 30 sec - exiting 10:53:30 (17944): No heartbeat from core client for 30 sec - exiting 10:53:31 (17944): No heartbeat from core client for 30 sec - exiting 10:53:32 (17944): No heartbeat from core client for 30 sec - exiting 10:53:33 (17944): No heartbeat from core client for 30 sec - exiting 10:53:34 (17944): No heartbeat from core client for 30 sec - exiting 10:53:35 (17944): No heartbeat from core client for 30 sec - exiting 10:53:36 (17944): No heartbeat from core client for 30 sec - exiting 10:53:37 (17944): No heartbeat from core client for 30 sec - exiting 10:53:38 (17944): No heartbeat from core client for 30 sec - exiting 10:53:39 (17944): No heartbeat from core client for 30 sec - exiting 10:53:40 (17944): No heartbeat from core client for 30 sec - exiting 10:53:41 (17944): No heartbeat from core client for 30 sec - exiting 10:53:42 (17944): No heartbeat from core client for 30 sec - exiting 10:53:43 (17944): No heartbeat from core client for 30 sec - exiting 10:53:44 (17944): No heartbeat from core client for 30 sec - exiting 10:53:45 (17944): No heartbeat from core client for 30 sec - exiting 10:53:46 (17944): No heartbeat from core client for 30 sec - exiting 10:53:47 (17944): No heartbeat from core client for 30 sec - exiting 10:53:48 (17944): No heartbeat from core client for 30 sec - exiting 10:53:49 (17944): No heartbeat from core client for 30 sec - exiting 10:53:50 (17944): No heartbeat from core client for 30 sec - exiting 10:53:51 (17944): No heartbeat from core client for 30 sec - exiting 10:53:52 (17944): No heartbeat from core client for 30 sec - exiting 10:53:53 (17944): No heartbeat from core client for 30 sec - exiting 10:53:54 (17944): No heartbeat from core client for 30 sec - exiting 10:53:55 (17944): No heartbeat from core client for 30 sec - exiting 10:53:56 (17944): No heartbeat from core client for 30 sec - exiting 10:53:57 (17944): No heartbeat from core client for 30 sec - exiting 10:53:58 (17944): No heartbeat from core client for 30 sec - exiting 10:53:59 (17944): No heartbeat from core client for 30 sec - exiting 10:54:00 (17944): No heartbeat from core client for 30 sec - exiting 10:54:01 (17944): No heartbeat from core client for 30 sec - exiting 10:54:02 (17944): No heartbeat from core client for 30 sec - exiting 10:54:03 (17944): No heartbeat from core client for 30 sec - exiting 10:54:04 (17944): No heartbeat from core client for 30 sec - exiting 10:54:05 (17944): No heartbeat from core client for 30 sec - exiting 10:54:06 (17944): No heartbeat from core client for 30 sec - exiting 10:54:07 (17944): No heartbeat from core client for 30 sec - exiting 10:54:08 (17944): No heartbeat from core client for 30 sec - exiting 10:54:09 (17944): No heartbeat from core client for 30 sec - exiting 10:54:10 (17944): No heartbeat from core client for 30 sec - exiting 10:54:11 (17944): No heartbeat from core client for 30 sec - exiting 10:54:12 (17944): No heartbeat from core client for 30 sec - exiting 10:54:13 (17944): No heartbeat from core client for 30 sec - exiting 10:54:14 (17944): No heartbeat from core client for 30 sec - exiting 10:54:15 (17944): No heartbeat from core client for 30 sec - exiting 10:54:16 (17944): No heartbeat from core client for 30 sec - exiting 13:32:45 (14520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:35:34 (3452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7528, selfPID=7528, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:41:07 (15212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:08 (10348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:52 (12756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:46 (11564): No heartbeat from core client for 30 sec - exiting 13:13:47 (11564): No heartbeat from core client for 30 sec - exiting 13:13:49 (11564): No heartbeat from core client for 30 sec - exiting 13:13:50 (11564): No heartbeat from core client for 30 sec - exiting 13:13:52 (11564): No heartbeat from core client for 30 sec - exiting 13:13:53 (11564): No heartbeat from core client for 30 sec - exiting 13:13:54 (11564): No heartbeat from core client for 30 sec - exiting 13:13:55 (11564): No heartbeat from core client for 30 sec - exiting 13:13:56 (11564): No heartbeat from core client for 30 sec - exiting 13:13:57 (11564): No heartbeat from core client for 30 sec - exiting 13:13:59 (11564): No heartbeat from core client for 30 sec - exiting 13:14:00 (11564): No heartbeat from core client for 30 sec - exiting 13:14:01 (11564): No heartbeat from core client for 30 sec - exiting 13:14:03 (11564): No heartbeat from core client for 30 sec - exiting 13:14:04 (11564): No heartbeat from core client for 30 sec - exiting 13:14:05 (11564): No heartbeat from core client for 30 sec - exiting 13:14:06 (11564): No heartbeat from core client for 30 sec - exiting 13:14:07 (11564): No heartbeat from core client for 30 sec - exiting 13:14:08 (11564): No heartbeat from core client for 30 sec - exiting 13:14:09 (11564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:57 (15952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:15 (14556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:23 (16028): No heartbeat from core client for 30 sec - exiting 13:41:24 (16028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:47 (3232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:37 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:19:14 (12316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:26:06 (13016): No heartbeat from core client for 30 sec - exiting 15:26:07 (13016): No heartbeat from core client for 30 sec - exiting 15:26:08 (13016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:34:00 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:44 (14832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:42:20 (15280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:42:21 (15280): No heartbeat from core client for 30 sec - exiting 15:56:51 (12912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:06 (15452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:30 (11892): No heartbeat from core client for 30 sec - exiting 17:44:31 (11892): No heartbeat from core client for 30 sec - exiting 17:44:33 (11892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:27 (8540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:19:09 (13476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:12 (15492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:38:42 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:02 (14100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:31 (16964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:55:45 (17924): No heartbeat from core client for 30 sec - exiting 18:55:46 (17924): No heartbeat from core client for 30 sec - exiting 18:55:47 (17924): No heartbeat from core client for 30 sec - exiting 18:55:48 (17924): No heartbeat from core client for 30 sec - exiting 18:55:49 (17924): No heartbeat from core client for 30 sec - exiting 18:55:51 (17924): No heartbeat from core client for 30 sec - exiting 18:55:52 (17924): No heartbeat from core client for 30 sec - exiting 18:55:53 (17924): No heartbeat from core client for 30 sec - exiting 18:55:55 (17924): No heartbeat from core client for 30 sec - exiting 18:55:56 (17924): No heartbeat from core client for 30 sec - exiting 18:55:57 (17924): No heartbeat from core client for 30 sec - exiting 18:55:58 (17924): No heartbeat from core client for 30 sec - exiting 18:55:59 (17924): No heartbeat from core client for 30 sec - exiting 18:56:00 (17924): No heartbeat from core client for 30 sec - exiting 18:56:02 (17924): No heartbeat from core client for 30 sec - exiting 18:56:03 (17924): No heartbeat from core client for 30 sec - exiting 18:56:04 (17924): No heartbeat from core client for 30 sec - exiting 18:56:05 (17924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:06 (12232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:05 (18036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:45 (11136): No heartbeat from core client for 30 sec - exiting 19:20:46 (11136): No heartbeat from core client for 30 sec - exiting 19:20:47 (11136): No heartbeat from core client for 30 sec - exiting 19:20:48 (11136): No heartbeat from core client for 30 sec - exiting 19:20:49 (11136): No heartbeat from core client for 30 sec - exiting 19:20:50 (11136): No heartbeat from core client for 30 sec - exiting 19:20:51 (11136): No heartbeat from core client for 30 sec - exiting 19:20:52 (11136): No heartbeat from core client for 30 sec - exiting 19:20:53 (11136): No heartbeat from core client for 30 sec - exiting 19:20:54 (11136): No heartbeat from core client for 30 sec - exiting 19:20:55 (11136): No heartbeat from core client for 30 sec - exiting 19:20:57 (11136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:03 (10908): No heartbeat from core client for 30 sec - exiting 19:30:04 (10908): No heartbeat from core client for 30 sec - exiting 19:30:05 (10908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:29 (17544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:51 (17316): No heartbeat from core client for 30 sec - exiting 19:35:52 (17316): No heartbeat from core client for 30 sec - exiting 19:35:54 (17316): No heartbeat from core client for 30 sec - exiting 19:35:55 (17316): No heartbeat from core client for 30 sec - exiting 19:35:56 (17316): No heartbeat from core client for 30 sec - exiting 19:35:57 (17316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:02 (18320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:05 (10008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:46 (9464): No heartbeat from core client for 30 sec - exiting 20:02:47 (9464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:06:58 (13036): No heartbeat from core client for 30 sec - exiting 20:07:00 (13036): No heartbeat from core client for 30 sec - exiting 20:07:01 (13036): No heartbeat from core client for 30 sec - exiting 20:07:02 (13036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:28 (12172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Feb 2014 19:24:26	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	259,200	339,596	1.3102
08 Feb 2014 17:51:57	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	233,280	304,298	1.3044
02 Feb 2014 02:37:25	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	207,360	268,976	1.2971
01 Feb 2014 17:25:22	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	181,440	236,689	1.3045
17 Jan 2014 19:03:44	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	155,520	202,514	1.3022
11 Jan 2014 22:46:03	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	129,600	167,288	1.2908
11 Jan 2014 12:33:35	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	103,680	133,017	1.2830
06 Jan 2014 08:33:38	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	77,760	99,019	1.2734
01 Jan 2014 09:54:35	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	51,840	68,004	1.3118
31 Dec 2013 10:50:14	1300565	16162742	hadcm3n_oezf_1900_40_008474542_1	25,920	33,944	1.3096