Task 15992126

Name	hadcm3n_808m_1980_40_008458249_0
Workunit	8609105
Created	30 Aug 2013, 20:09:04 UTC
Sent	8 Sep 2013, 16:34:40 UTC
Report deadline	9 Dec 2013, 0:01:51 UTC
Received	1 Oct 2013, 8:42:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1243317
Run time	5 days 2 hours 55 min 47 sec
CPU time	4 days 6 hours 18 min 13 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3244, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:34:26 (1460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:13:29 (6440): No heartbeat from core client for 30 sec - exiting 13:13:30 (6440): No heartbeat from core client for 30 sec - exiting 13:13:31 (6440): No heartbeat from core client for 30 sec - exiting 13:13:32 (6440): No heartbeat from core client for 30 sec - exiting 13:13:33 (6440): No heartbeat from core client for 30 sec - exiting 13:13:34 (6440): No heartbeat from core client for 30 sec - exiting 13:13:35 (6440): No heartbeat from core client for 30 sec - exiting 13:13:36 (6440): No heartbeat from core client for 30 sec - exiting 13:13:37 (6440): No heartbeat from core client for 30 sec - exiting 13:13:38 (6440): No heartbeat from core client for 30 sec - exiting 13:13:39 (6440): No heartbeat from core client for 30 sec - exiting 13:13:40 (6440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:40:44 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:01:39 (5528): No heartbeat from core client for 30 sec - exiting 17:01:40 (5528): No heartbeat from core client for 30 sec - exiting 17:01:41 (5528): No heartbeat from core client for 30 sec - exiting 17:01:43 (5528): No heartbeat from core client for 30 sec - exiting 17:01:44 (5528): No heartbeat from core client for 30 sec - exiting 17:01:45 (5528): No heartbeat from core client for 30 sec - exiting 17:01:46 (5528): No heartbeat from core client for 30 sec - exiting 17:01:47 (5528): No heartbeat from core client for 30 sec - exiting 17:01:48 (5528): No heartbeat from core client for 30 sec - exiting 17:01:49 (5528): No heartbeat from core client for 30 sec - exiting 17:01:50 (5528): No heartbeat from core client for 30 sec - exiting 17:01:51 (5528): No heartbeat from core client for 30 sec - exiting 17:01:52 (5528): No heartbeat from core client for 30 sec - exiting 17:01:53 (5528): No heartbeat from core client for 30 sec - exiting 17:01:55 (5528): No heartbeat from core client for 30 sec - exiting 17:01:56 (5528): No heartbeat from core client for 30 sec - exiting 17:01:57 (5528): No heartbeat from core client for 30 sec - exiting 17:01:58 (5528): No heartbeat from core client for 30 sec - exiting 17:01:59 (5528): No heartbeat from core client for 30 sec - exiting 17:02:00 (5528): No heartbeat from core client for 30 sec - exiting 17:02:01 (5528): No heartbeat from core client for 30 sec - exiting 17:02:02 (5528): No heartbeat from core client for 30 sec - exiting 17:02:03 (5528): No heartbeat from core client for 30 sec - exiting 17:02:04 (5528): No heartbeat from core client for 30 sec - exiting 17:02:05 (5528): No heartbeat from core client for 30 sec - exiting 17:02:07 (5528): No heartbeat from core client for 30 sec - exiting 17:02:08 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:40:31 (6048): No heartbeat from core client for 30 sec - exiting 18:40:32 (6048): No heartbeat from core client for 30 sec - exiting 18:40:33 (6048): No heartbeat from core client for 30 sec - exiting 18:40:35 (6048): No heartbeat from core client for 30 sec - exiting 18:40:36 (6048): No heartbeat from core client for 30 sec - exiting 18:40:37 (6048): No heartbeat from core client for 30 sec - exiting 18:40:38 (6048): No heartbeat from core client for 30 sec - exiting 18:40:39 (6048): No heartbeat from core client for 30 sec - exiting 18:40:40 (6048): No heartbeat from core client for 30 sec - exiting 18:40:41 (6048): No heartbeat from core client for 30 sec - exiting 18:40:42 (6048): No heartbeat from core client for 30 sec - exiting 18:40:43 (6048): No heartbeat from core client for 30 sec - exiting 18:40:44 (6048): No heartbeat from core client for 30 sec - exiting 18:40:46 (6048): No heartbeat from core client for 30 sec - exiting 18:40:47 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6300, iMonCtr=1 Model crash detected, will try to restart... 08:03:48 (4648): No heartbeat from core client for 30 sec - exiting 08:03:50 (4648): No heartbeat from core client for 30 sec - exiting 08:03:51 (4648): No heartbeat from core client for 30 sec - exiting 08:03:52 (4648): No heartbeat from core client for 30 sec - exiting 08:03:54 (4648): No heartbeat from core client for 30 sec - exiting 08:03:55 (4648): No heartbeat from core client for 30 sec - exiting 08:03:56 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:15:51 (6168): No heartbeat from core client for 30 sec - exiting 17:15:55 (6168): No heartbeat from core client for 30 sec - exiting 17:15:56 (6168): No heartbeat from core client for 30 sec - exiting 17:15:57 (6168): No heartbeat from core client for 30 sec - exiting 17:15:59 (6168): No heartbeat from core client for 30 sec - exiting 17:16:00 (6168): No heartbeat from core client for 30 sec - exiting 17:16:01 (6168): No heartbeat from core client for 30 sec - exiting 17:16:02 (6168): No heartbeat from core client for 30 sec - exiting 17:16:03 (6168): No heartbeat from core client for 30 sec - exiting 17:16:04 (6168): No heartbeat from core client for 30 sec - exiting 17:16:05 (6168): No heartbeat from core client for 30 sec - exiting 17:16:06 (6168): No heartbeat from core client for 30 sec - exiting 17:16:07 (6168): No heartbeat from core client for 30 sec - exiting 17:16:08 (6168): No heartbeat from core client for 30 sec - exiting 17:16:10 (6168): No heartbeat from core client for 30 sec - exiting 17:16:11 (6168): No heartbeat from core client for 30 sec - exiting 17:16:12 (6168): No heartbeat from core client for 30 sec - exiting 17:16:13 (6168): No heartbeat from core client for 30 sec - exiting 17:16:14 (6168): No heartbeat from core client for 30 sec - exiting 17:16:15 (6168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:55:32 (1416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:19:21 (3356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:15:51 (7656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:48:11 (8336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:56:56 (8768): No heartbeat from core client for 30 sec - exiting 11:56:57 (8768): No heartbeat from core client for 30 sec - exiting 11:56:58 (8768): No heartbeat from core client for 30 sec - exiting 11:56:59 (8768): No heartbeat from core client for 30 sec - exiting 11:57:00 (8768): No heartbeat from core client for 30 sec - exiting 11:57:01 (8768): No heartbeat from core client for 30 sec - exiting 11:57:02 (8768): No heartbeat from core client for 30 sec - exiting 11:57:03 (8768): No heartbeat from core client for 30 sec - exiting 11:57:04 (8768): No heartbeat from core client for 30 sec - exiting 11:57:05 (8768): No heartbeat from core client for 30 sec - exiting 11:57:06 (8768): No heartbeat from core client for 30 sec - exiting 11:57:07 (8768): No heartbeat from core client for 30 sec - exiting 11:57:08 (8768): No heartbeat from core client for 30 sec - exiting 11:57:09 (8768): No heartbeat from core client for 30 sec - exiting 11:57:10 (8768): No heartbeat from core client for 30 sec - exiting 11:57:11 (8768): No heartbeat from core client for 30 sec - exiting 11:57:12 (8768): No heartbeat from core client for 30 sec - exiting 11:57:13 (8768): No heartbeat from core client for 30 sec - exiting 11:57:14 (8768): No heartbeat from core client for 30 sec - exiting 11:57:15 (8768): No heartbeat from core client for 30 sec - exiting 11:57:16 (8768): No heartbeat from core client for 30 sec - exiting 11:57:17 (8768): No heartbeat from core client for 30 sec - exiting 11:57:18 (8768): No heartbeat from core client for 30 sec - exiting 11:57:19 (8768): No heartbeat from core client for 30 sec - exiting 11:57:20 (8768): No heartbeat from core client for 30 sec - exiting 11:57:21 (8768): No heartbeat from core client for 30 sec - exiting 11:57:22 (8768): No heartbeat from core client for 30 sec - exiting 11:57:23 (8768): No heartbeat from core client for 30 sec - exiting 11:57:24 (8768): No heartbeat from core client for 30 sec - exiting 11:57:25 (8768): No heartbeat from core client for 30 sec - exiting 11:57:26 (8768): No heartbeat from core client for 30 sec - exiting 11:57:27 (8768): No heartbeat from core client for 30 sec - exiting 11:57:28 (8768): No heartbeat from core client for 30 sec - exiting 11:57:29 (8768): No heartbeat from core client for 30 sec - exiting 11:57:30 (8768): No heartbeat from core client for 30 sec - exiting 11:57:31 (8768): No heartbeat from core client for 30 sec - exiting 11:57:32 (8768): No heartbeat from core client for 30 sec - exiting 11:57:33 (8768): No heartbeat from core client for 30 sec - exiting 11:57:34 (8768): No heartbeat from core client for 30 sec - exiting 11:57:35 (8768): No heartbeat from core client for 30 sec - exiting 11:57:36 (8768): No heartbeat from core client for 30 sec - exiting 11:57:37 (8768): No heartbeat from core client for 30 sec - exiting 11:57:38 (8768): No heartbeat from core client for 30 sec - exiting 11:57:39 (8768): No heartbeat from core client for 30 sec - exiting 11:57:40 (8768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Sep 2013 19:34:12	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	259,200	366,692	1.4147
27 Sep 2013 19:14:19	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	233,280	330,692	1.4176
27 Sep 2013 05:26:07	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	207,360	294,964	1.4225
26 Sep 2013 17:46:27	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	181,440	258,730	1.4260
26 Sep 2013 04:20:20	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	155,520	220,066	1.4150
25 Sep 2013 13:57:48	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	129,600	177,631	1.3706
23 Sep 2013 15:12:21	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	103,680	142,297	1.3725
19 Sep 2013 17:07:17	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	77,760	106,452	1.3690
13 Sep 2013 18:13:10	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	51,840	70,676	1.3633
11 Sep 2013 17:18:21	1243317	15992126	hadcm3n_808m_1980_40_008458249_0	25,920	35,559	1.3719