Task 15808424

Name	hadcm3n_n2yp_1960_40_008378577_0
Workunit	8529436
Created	30 May 2013, 21:09:58 UTC
Sent	30 May 2013, 22:26:15 UTC
Report deadline	30 Aug 2013, 5:53:26 UTC
Received	6 Jun 2013, 2:00:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1230144
Run time	5 days 12 hours 58 min 46 sec
CPU time	5 days 3 hours 56 min 50 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 18:21:06 (2720): No heartbeat from core client for 30 sec - exiting 18:21:07 (2720): No heartbeat from core client for 30 sec - exiting 18:21:08 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:09 (2720): No heartbeat from core client for 30 sec - exiting 18:28:58 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:01:01 (4600): No heartbeat from core client for 30 sec - exiting 05:01:03 (4600): No heartbeat from core client for 30 sec - exiting 05:01:04 (4600): No heartbeat from core client for 30 sec - exiting 05:01:05 (4600): No heartbeat from core client for 30 sec - exiting 05:01:06 (4600): No heartbeat from core client for 30 sec - exiting 05:01:07 (4600): No heartbeat from core client for 30 sec - exiting 05:01:08 (4600): No heartbeat from core client for 30 sec - exiting 05:01:09 (4600): No heartbeat from core client for 30 sec - exiting 05:01:10 (4600): No heartbeat from core client for 30 sec - exiting 05:01:11 (4600): No heartbeat from core client for 30 sec - exiting 05:01:12 (4600): No heartbeat from core client for 30 sec - exiting 05:01:13 (4600): No heartbeat from core client for 30 sec - exiting 05:01:15 (4600): No heartbeat from core client for 30 sec - exiting 05:01:16 (4600): No heartbeat from core client for 30 sec - exiting 05:01:17 (4600): No heartbeat from core client for 30 sec - exiting 05:01:18 (4600): No heartbeat from core client for 30 sec - exiting 05:01:19 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 19:49:16 (1224): No heartbeat from core client for 30 sec - exiting 19:49:17 (1224): No heartbeat from core client for 30 sec - exiting 19:49:18 (1224): No heartbeat from core client for 30 sec - exiting 19:49:19 (1224): No heartbeat from core client for 30 sec - exiting 19:49:20 (1224): No heartbeat from core client for 30 sec - exiting 19:49:22 (1224): No heartbeat from core client for 30 sec - exiting 19:49:23 (1224): No heartbeat from core client for 30 sec - exiting 19:49:24 (1224): No heartbeat from core client for 30 sec - exiting 19:49:25 (1224): No heartbeat from core client for 30 sec - exiting 19:49:26 (1224): No heartbeat from core client for 30 sec - exiting 19:49:27 (1224): No heartbeat from core client for 30 sec - exiting 19:49:28 (1224): No heartbeat from core client for 30 sec - exiting 19:49:29 (1224): No heartbeat from core client for 30 sec - exiting 19:49:30 (1224): No heartbeat from core client for 30 sec - exiting 19:49:31 (1224): No heartbeat from core client for 30 sec - exiting 19:49:32 (1224): No heartbeat from core client for 30 sec - exiting 19:49:34 (1224): No heartbeat from core client for 30 sec - exiting 19:49:35 (1224): No heartbeat from core client for 30 sec - exiting 19:49:36 (1224): No heartbeat from core client for 30 sec - exiting 19:49:37 (1224): No heartbeat from core client for 30 sec - exiting 19:49:38 (1224): No heartbeat from core client for 30 sec - exiting 19:49:39 (1224): No heartbeat from core client for 30 sec - exiting 19:49:40 (1224): No heartbeat from core client for 30 sec - exiting 19:49:41 (1224): No heartbeat from core client for 30 sec - exiting 19:49:42 (1224): No heartbeat from core client for 30 sec - exiting 19:49:43 (1224): No heartbeat from core client for 30 sec - exiting 19:49:45 (1224): No heartbeat from core client for 30 sec - exiting 19:49:46 (1224): No heartbeat from core client for 30 sec - exiting 19:49:47 (1224): No heartbeat from core client for 30 sec - exiting 19:49:48 (1224): No heartbeat from core client for 30 sec - exiting 19:49:49 (1224): No heartbeat from core client for 30 sec - exiting 19:49:50 (1224): No heartbeat from core client for 30 sec - exiting 19:49:51 (1224): No heartbeat from core client for 30 sec - exiting 19:49:52 (1224): No heartbeat from core client for 30 sec - exiting 19:49:53 (1224): No heartbeat from core client for 30 sec - exiting 19:49:54 (1224): No heartbeat from core client for 30 sec - exiting 19:49:55 (1224): No heartbeat from core client for 30 sec - exiting 19:49:57 (1224): No heartbeat from core client for 30 sec - exiting 19:49:58 (1224): No heartbeat from core client for 30 sec - exiting 19:49:59 (1224): No heartbeat from core client for 30 sec - exiting 19:50:00 (1224): No heartbeat from core client for 30 sec - exiting 19:50:01 (1224): No heartbeat from core client for 30 sec - exiting 19:50:02 (1224): No heartbeat from core client for 30 sec - exiting 19:50:03 (1224): No heartbeat from core client for 30 sec - exiting 19:50:04 (1224): No heartbeat from core client for 30 sec - exiting 19:50:05 (1224): No heartbeat from core client for 30 sec - exiting 19:50:06 (1224): No heartbeat from core client for 30 sec - exiting 19:50:07 (1224): No heartbeat from core client for 30 sec - exiting 19:50:09 (1224): No heartbeat from core client for 30 sec - exiting 19:50:10 (1224): No heartbeat from core client for 30 sec - exiting 19:50:11 (1224): No heartbeat from core client for 30 sec - exiting 19:50:12 (1224): No heartbeat from core client for 30 sec - exiting 19:50:13 (1224): No heartbeat from core client for 30 sec - exiting 19:50:14 (1224): No heartbeat from core client for 30 sec - exiting 19:50:15 (1224): No heartbeat from core client for 30 sec - exiting 19:50:16 (1224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:23 (1876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:01 (3696): No heartbeat from core client for 30 sec - exiting 20:11:02 (3696): No heartbeat from core client for 30 sec - exiting 20:11:03 (3696): No heartbeat from core client for 30 sec - exiting 20:11:05 (3696): No heartbeat from core client for 30 sec - exiting 20:11:06 (3696): No heartbeat from core client for 30 sec - exiting 20:11:07 (3696): No heartbeat from core client for 30 sec - exiting 20:11:08 (3696): No heartbeat from core client for 30 sec - exiting 20:11:09 (3696): No heartbeat from core client for 30 sec - exiting 20:11:10 (3696): No heartbeat from core client for 30 sec - exiting 20:11:11 (3696): No heartbeat from core client for 30 sec - exiting 20:11:12 (3696): No heartbeat from core client for 30 sec - exiting 20:11:13 (3696): No heartbeat from core client for 30 sec - exiting 20:11:14 (3696): No heartbeat from core client for 30 sec - exiting 20:11:15 (3696): No heartbeat from core client for 30 sec - exiting 20:11:16 (3696): No heartbeat from core client for 30 sec - exiting 20:11:17 (3696): No heartbeat from core client for 30 sec - exiting 20:11:19 (3696): No heartbeat from core client for 30 sec - exiting 20:11:20 (3696): No heartbeat from core client for 30 sec - exiting 20:11:21 (3696): No heartbeat from core client for 30 sec - exiting 20:11:22 (3696): No heartbeat from core client for 30 sec - exiting 20:11:23 (3696): No heartbeat from core client for 30 sec - exiting 20:11:24 (3696): No heartbeat from core client for 30 sec - exiting 20:11:25 (3696): No heartbeat from core client for 30 sec - exiting 20:11:26 (3696): No heartbeat from core client for 30 sec - exiting 20:11:27 (3696): No heartbeat from core client for 30 sec - exiting 20:11:28 (3696): No heartbeat from core client for 30 sec - exiting 20:11:30 (3696): No heartbeat from core client for 30 sec - exiting 20:11:31 (3696): No heartbeat from core client for 30 sec - exiting 20:11:32 (3696): No heartbeat from core client for 30 sec - exiting 20:11:33 (3696): No heartbeat from core client for 30 sec - exiting 20:11:34 (3696): No heartbeat from core client for 30 sec - exiting 20:11:35 (3696): No heartbeat from core client for 30 sec - exiting 20:11:36 (3696): No heartbeat from core client for 30 sec - exiting 20:11:37 (3696): No heartbeat from core client for 30 sec - exiting 20:11:38 (3696): No heartbeat from core client for 30 sec - exiting 20:11:39 (3696): No heartbeat from core client for 30 sec - exiting 20:11:40 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:46:31 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:47:11 (6068): No heartbeat from core client for 30 sec - exiting 23:47:12 (6068): No heartbeat from core client for 30 sec - exiting 23:47:13 (6068): No heartbeat from core client for 30 sec - exiting 23:47:14 (6068): No heartbeat from core client for 30 sec - exiting 23:47:15 (6068): No heartbeat from core client for 30 sec - exiting 23:47:16 (6068): No heartbeat from core client for 30 sec - exiting 23:47:17 (6068): No heartbeat from core client for 30 sec - exiting 23:47:18 (6068): No heartbeat from core client for 30 sec - exiting 23:47:19 (6068): No heartbeat from core client for 30 sec - exiting 23:47:20 (6068): No heartbeat from core client for 30 sec - exiting 23:47:21 (6068): No heartbeat from core client for 30 sec - exiting 23:47:23 (6068): No heartbeat from core client for 30 sec - exiting 23:47:24 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:53:00 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:29:42 (5640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:50 (4148): No heartbeat from core client for 30 sec - exiting 05:29:51 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:28:57 (4600): No heartbeat from core client for 30 sec - exiting 06:28:58 (4600): No heartbeat from core client for 30 sec - exiting 06:28:59 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:13 (4380): No heartbeat from core client for 30 sec - exiting 09:17:14 (4380): No heartbeat from core client for 30 sec - exiting 09:17:15 (4380): No heartbeat from core client for 30 sec - exiting 09:17:16 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4768, selfPID=4768, iMonCtr=1 16:15:12 (4428): No heartbeat from core client for 30 sec - exiting 16:15:13 (4428): No heartbeat from core client for 30 sec - exiting 16:15:14 (4428): No heartbeat from core client for 30 sec - exiting 16:15:15 (4428): No heartbeat from core client for 30 sec - exiting 16:15:16 (4428): No heartbeat from core client for 30 sec - exiting 16:15:17 (4428): No heartbeat from core client for 30 sec - exiting 16:15:18 (4428): No heartbeat from core client for 30 sec - exiting 16:15:20 (4428): No heartbeat from core client for 30 sec - exiting 16:15:21 (4428): No heartbeat from core client for 30 sec - exiting 16:15:22 (4428): No heartbeat from core client for 30 sec - exiting 16:15:23 (4428): No heartbeat from core client for 30 sec - exiting 16:15:24 (4428): No heartbeat from core client for 30 sec - exiting 16:15:25 (4428): No heartbeat from core client for 30 sec - exiting 16:15:26 (4428): No heartbeat from core client for 30 sec - exiting 16:15:27 (4428): No heartbeat from core client for 30 sec - exiting 16:15:28 (4428): No heartbeat from core client for 30 sec - exiting 16:15:29 (4428): No heartbeat from core client for 30 sec - exiting 16:15:30 (4428): No heartbeat from core client for 30 sec - exiting 16:15:32 (4428): No heartbeat from core client for 30 sec - exiting 16:15:33 (4428): No heartbeat from core client for 30 sec - exiting 16:15:34 (4428): No heartbeat from core client for 30 sec - exiting 16:15:35 (4428): No heartbeat from core client for 30 sec - exiting 16:15:36 (4428): No heartbeat from core client for 30 sec - exiting 16:15:37 (4428): No heartbeat from core client for 30 sec - exiting 16:15:38 (4428): No heartbeat from core client for 30 sec - exiting 16:15:39 (4428): No heartbeat from core client for 30 sec - exiting 16:15:40 (4428): No heartbeat from core client for 30 sec - exiting 16:15:41 (4428): No heartbeat from core client for 30 sec - exiting 16:15:42 (4428): No heartbeat from core client for 30 sec - exiting 16:15:44 (4428): No heartbeat from core client for 30 sec - exiting 16:15:45 (4428): No heartbeat from core client for 30 sec - exiting 16:15:46 (4428): No heartbeat from core client for 30 sec - exiting 16:15:47 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4868, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 03:03:48 (4988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:03:49 (4988): No heartbeat from core client for 30 sec - exiting 03:03:50 (4988): No heartbeat from core client for 30 sec - exiting 03:03:51 (4988): No heartbeat from core client for 30 sec - exiting 03:03:52 (4988): No heartbeat from core client for 30 sec - exiting 03:03:53 (4988): No heartbeat from core client for 30 sec - exiting 03:03:54 (4988): No heartbeat from core client for 30 sec - exiting 03:03:55 (4988): No heartbeat from core client for 30 sec - exiting 03:03:56 (4988): No heartbeat from core client for 30 sec - exiting 03:03:57 (4988): No heartbeat from core client for 30 sec - exiting 03:03:59 (4988): No heartbeat from core client for 30 sec - exiting 05:15:15 (4108): No heartbeat from core client for 30 sec - exiting 05:15:16 (4108): No heartbeat from core client for 30 sec - exiting 05:15:17 (4108): No heartbeat from core client for 30 sec - exiting 05:15:18 (4108): No heartbeat from core client for 30 sec - exiting 05:15:19 (4108): No heartbeat from core client for 30 sec - exiting 05:15:20 (4108): No heartbeat from core client for 30 sec - exiting 05:15:21 (4108): No heartbeat from core client for 30 sec - exiting 05:15:22 (4108): No heartbeat from core client for 30 sec - exiting 05:15:23 (4108): No heartbeat from core client for 30 sec - exiting 05:15:24 (4108): No heartbeat from core client for 30 sec - exiting 05:15:26 (4108): No heartbeat from core client for 30 sec - exiting 05:15:27 (4108): No heartbeat from core client for 30 sec - exiting 05:15:28 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:57 (5080): No heartbeat from core client for 30 sec - exiting 05:28:59 (5080): No heartbeat from core client for 30 sec - exiting 05:29:00 (5080): No heartbeat from core client for 30 sec - exiting 05:29:01 (5080): No heartbeat from core client for 30 sec - exiting 05:29:02 (5080): No heartbeat from core client for 30 sec - exiting 05:29:03 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jun 2013 00:37:41	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	259,200	446,153	1.7213
05 Jun 2013 10:10:58	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	233,280	400,999	1.7190
04 Jun 2013 20:43:47	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	207,360	355,174	1.7128
04 Jun 2013 06:48:59	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	181,440	309,911	1.7081
03 Jun 2013 17:25:34	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	155,520	264,456	1.7005
03 Jun 2013 03:09:07	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	129,600	219,273	1.6919
02 Jun 2013 08:03:30	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	103,680	174,625	1.6843
01 Jun 2013 19:22:32	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	77,760	131,288	1.6884
01 Jun 2013 05:46:46	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	51,840	87,846	1.6946
31 May 2013 14:53:36	1230144	15808424	hadcm3n_n2yp_1960_40_008378577_0	25,920	44,024	1.6985