Task 13351631

Name	hadcm3n_o4q0_1940_40_007443633_4
Workunit	7641136
Created	9 Sep 2011, 3:16:06 UTC
Sent	9 Sep 2011, 3:23:01 UTC
Report deadline	9 Dec 2011, 10:50:12 UTC
Received	25 Oct 2011, 23:29:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1127888
Run time	17 days 4 hours 9 min 29 sec
CPU time	16 days 4 hours 46 min 56 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 19:44:52 (2668): No heartbeat from core client for 30 sec - exiting 19:44:54 (2668):CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:23:23 (12200): No heartbeat from core client for 30 sec - exiting 19:23:24 (12200): No heartbeat from core client for 30 sec - exiting 19:23:25 (12200): No heartbeat from core client for 30 sec - exiting 19:23:26 (12200): No heartbeat from core client for 30 sec - exiting 19:23:27 (12200): No heartbeat from core client for 30 sec - exiting 19:23:28 (12200): No heartbeat from core client for 30 sec - exiting 19:23:29 (12200): No heartbeat from core client for 30 sec - exiting 19:23:30 (12200): No heartbeat from core client for 30 sec - exiting 19:23:31 (12200): No heartbeat from core client for 30 sec - exiting 19:23:32 (12200): No heartbeat from core client for 30 sec - exiting 19:23:33 (12200): No heartbeat from core client for 30 sec - exiting 19:23:34 (12200): No heartbeat from core client for 30 sec - exiting 19:23:35 (12200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:19:54 (9788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14056, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 09:36:49 (2324): No heartbeat from core client for 30 sec - exiting 09:36:50 (2324): No heartbeat from core client for 30 sec - exiting 09:36:51 (2324): No heartbeat from core client for 30 sec - exiting 09:36:52 (2324): No heartbeat from core client for 30 sec - exiting 09:36:53 (2324): No heartbeat from core client for 30 sec - exiting 09:36:54 (2324): No heartbeat from core client for 30 sec - exiting 09:36:55 (2324): No heartbeat from core client for 30 sec - exiting 09:36:56 (2324): No heartbeat from core client for 30 sec - exiting 09:36:57 (2324): No heartbeat from core client for 30 sec - exiting 09:36:58 (2324): No heartbeat from core client for 30 sec - exiting 09:36:59 (2324): No heartbeat from core client for 30 sec - exiting 09:37:00 (2324): No heartbeat from core client for 30 sec - exiting 09:37:01 (2324): No heartbeat from core client for 30 sec - exiting 09:37:02 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:05:16 (6700): No heartbeat from core client for 30 sec - exiting 21:05:17 (6700): No heartbeat from core client for 30 sec - exiting 21:05:18 (6700): No heartbeat from core client for 30 sec - exiting 21:05:19 (6700): No heartbeat from core client for 30 sec - exiting 21:05:20 (6700): No heartbeat from core client for 30 sec - exiting 21:05:21 (6700): No heartbeat from core client for 30 sec - exiting 21:05:22 (6700): No heartbeat from core client for 30 sec - exiting 21:05:23 (6700): No heartbeat from core client for 30 sec - exiting 21:05:24 (6700): No heartbeat from core client for 30 sec - exiting 21:05:25 (6700): No heartbeat from core client for 30 sec - exiting 21:05:26 (6700): No heartbeat from core client for 30 sec - exiting 21:05:27 (6700): No heartbeat from core client for 30 sec - exiting 21:05:28 (6700): No heartbeat from core client for 30 sec - exiting 21:05:29 (6700): No heartbeat from core client for 30 sec - exiting 21:05:30 (6700): No heartbeat from core client for 30 sec - exiting 21:05:31 (6700): No heartbeat from core client for 30 sec - exiting 21:05:32 (6700): No heartbeat from core client for 30 sec - exiting 21:05:33 (6700): No heartbeat from core client for 30 sec - exiting 21:05:34 (6700): No heartbeat from core client for 30 sec - exiting 21:05:35 (6700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:58:47 (7844): No heartbeat from core client for 30 sec - exiting 20:58:48 (7844): No heartbeat from core client for 30 sec - exiting 20:58:49 (7844): No heartbeat from core client for 30 sec - exiting 20:58:50 (7844): No heartbeat from core client for 30 sec - exiting 20:58:51 (7844): No heartbeat from core client for 30 sec - exiting 20:58:52 (7844): No heartbeat from core client for 30 sec - exiting 20:58:53 (7844): No heartbeat from core client for 30 sec - exiting 20:58:54 (7844): No heartbeat from core client for 30 sec - exiting 20:58:55 (7844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:56 (7844): No heartbeat from core client for 30 sec - exiting 20:58:57 (7844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:26:25 (11708): No heartbeat from core client for 30 sec - exiting 21:26:26 (11708): No heartbeat from core client for 30 sec - exiting 21:26:27 (11708): No heartbeat from core client for 30 sec - exiting 21:26:28 (11708): No heartbeat from core client for 30 sec - exiting 21:26:29 (11708): No heartbeat from core client for 30 sec - exiting 21:26:30 (11708): No heartbeat from core client for 30 sec - exiting 21:26:31 (11708): No heartbeat from core client for 30 sec - exiting 21:26:32 (11708): No heartbeat from core client for 30 sec - exiting 21:26:33 (11708): No heartbeat from core client for 30 sec - exiting 21:26:34 (11708): No heartbeat from core client for 30 sec - exiting 21:26:35 (11708): No heartbeat from core client for 30 sec - exiting 21:26:36 (11708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:13:13 (8248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:02:28 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10592, selfPID=10592, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 07:33:46 (2856): No heartbeat from core client for 30 sec - exiting 07:33:47 (2856): No heartbeat from core client for 30 sec - exiting 07:33:48 (2856): No heartbeat from core client for 30 sec - exiting 07:33:49 (2856): No heartbeat from core client for 30 sec - exiting 07:33:50 (2856): No heartbeat from core client for 30 sec - exiting 07:33:51 (2856): No heartbeat from core client for 30 sec - exiting 07:33:53 (2856): No heartbeat from core client for 30 sec - exiting 07:33:54 (2856): No heartbeat from core client for 30 sec - exiting 07:33:55 (2856): No heartbeat from core client for 30 sec - exiting 07:33:56 (2856): No heartbeat from core client for 30 sec - exiting 07:33:57 (2856): No heartbeat from core client for 30 sec - exiting 07:33:58 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10652, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 11:00:27 (6012): No heartbeat from core client for 30 sec - exiting 11:00:28 (6012): No heartbeat from core client for 30 sec - exiting 11:00:29 (6012): No heartbeat from core client for 30 sec - exiting 11:00:30 (6012): No heartbeat from core client for 30 sec - exiting 11:00:31 (6012): No heartbeat from core client for 30 sec - exiting 11:00:32 (6012): No heartbeat from core client for 30 sec - exiting 11:00:33 (6012): No heartbeat from core client for 30 sec - exiting 11:00:34 (6012): No heartbeat from core client for 30 sec - exiting 11:00:35 (6012): No heartbeat from core client for 30 sec - exiting 11:00:36 (6012): No heartbeat from core client for 30 sec - exiting 11:00:37 (6012): No heartbeat from core client for 30 sec - exiting 11:00:38 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:31:25 (13896): No heartbeat from core client for 30 sec - exiting 19:31:26 (13896): No heartbeat from core client for 30 sec - exiting 19:31:27 (13896): No heartbeat from core client for 30 sec - exiting 19:31:28 (13896): No heartbeat from core client for 30 sec - exiting 19:31:29 (13896): No heartbeat from core client for 30 sec - exiting 19:31:30 (13896): No heartbeat from core client for 30 sec - exiting 19:31:31 (13896): No heartbeat from core client for 30 sec - exiting 19:31:32 (13896): No heartbeat from core client for 30 sec - exiting 19:31:33 (13896): No heartbeat from core client for 30 sec - exiting 19:31:34 (13896): No heartbeat from core client for 30 sec - exiting 19:31:35 (13896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:39:02 (4748): No heartbeat from core client for 30 sec - exiting 18:39:04 (4748): No heartbeat from core client for 30 sec - exiting 18:39:05 (4748): No heartbeat from core client for 30 sec - exiting 18:39:06 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:07 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:34:38 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:28:43 (4156): No heartbeat from core client for 30 sec - exiting 17:28:44 (4156): No heartbeat from core client for 30 sec - exiting 17:28:45 (4156): No heartbeat from core client for 30 sec - exiting 17:28:46 (4156): No heartbeat from core client for 30 sec - exiting 17:28:47 (4156): No heartbeat from core client for 30 sec - exiting 17:28:48 (4156): No heartbeat from core client for 30 sec - exiting 17:28:49 (4156): No heartbeat from core client for 30 sec - exiting 17:28:51 (4156): No heartbeat from core client for 30 sec - exiting 17:28:52 (4156): No heartbeat from core client for 30 sec - exiting 17:28:53 (4156): No heartbeat from core client for 30 sec - exiting 17:28:54 (4156): No heartbeat from core client for 30 sec - exiting 17:28:55 (4156): No heartbeat from core client for 30 sec - exiting 17:28:56 (4156): No heartbeat from core client for 30 sec - exiting 17:28:57 (4156): No heartbeat from core client for 30 sec - exiting 17:28:58 (4156): No heartbeat from core client for 30 sec - exiting 17:28:59 (4156): No heartbeat from core client for 30 sec - exiting 17:29:00 (4156): No heartbeat from core client for 30 sec - exiting 17:29:01 (4156): No heartbeat from core client for 30 sec - exiting 17:29:03 (4156): No heartbeat from core client for 30 sec - exiting 17:29:04 (4156): No heartbeat from core client for 30 sec - exiting 17:29:05 (4156): No heartbeat from core client for 30 sec - exiting 17:29:06 (4156): No heartbeat from core client for 30 sec - exiting 17:29:07 (4156): No heartbeat from core client for 30 sec - exiting 17:29:08 (4156): No heartbeat from core client for 30 sec - exiting 17:29:09 (4156): No heartbeat from core client for 30 sec - exiting 17:29:10 (4156): No heartbeat from core client for 30 sec - exiting 17:29:11 (4156): No heartbeat from core client for 30 sec - exiting 17:29:12 (4156): No heartbeat from core client for 30 sec - exiting 17:29:13 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:15 (4156): No heartbeat from core client for 30 sec - exiting 17:29:16 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:37:01 (9140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:57:56 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:41:59 (4504): No heartbeat from core client for 30 sec - exiting 00:42:00 (4504): No heartbeat from core client for 30 sec - exiting 00:42:02 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:42:03 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:10:35 (5440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:59:32 (11328): No heartbeat from core client for 30 sec - exiting 23:59:33 (11328): No heartbeat from core client for 30 sec - exiting 23:59:34 (11328): No heartbeat from core client for 30 sec - exiting 23:59:35 (11328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 15:26:24	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	777,600	1,399,602	1.7999
31 Oct 2011 15:26:24	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	751,680	1,354,817	1.8024
31 Oct 2011 15:26:24	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	725,760	1,308,894	1.8035
31 Oct 2011 15:26:24	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	699,840	1,262,465	1.8039
31 Oct 2011 15:26:24	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	673,920	1,215,876	1.8042
31 Oct 2011 15:26:24	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	648,000	1,171,098	1.8073
31 Oct 2011 15:26:23	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	622,080	1,125,178	1.8087
31 Oct 2011 15:26:23	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	596,160	1,079,444	1.8107
31 Oct 2011 15:26:23	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	570,240	1,034,500	1.8141
19 Oct 2011 08:05:52	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	544,320	988,757	1.8165
18 Oct 2011 18:40:09	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	518,400	944,031	1.8210
17 Oct 2011 12:04:39	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	492,480	898,835	1.8251
16 Oct 2011 11:03:45	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	466,560	853,915	1.8302
15 Oct 2011 12:25:55	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	440,640	808,639	1.8351
14 Oct 2011 08:38:57	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	414,720	763,724	1.8415
13 Oct 2011 17:59:23	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	388,800	718,024	1.8468
13 Oct 2011 04:24:40	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	362,880	672,818	1.8541
11 Oct 2011 09:22:45	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	336,960	627,221	1.8614
09 Oct 2011 18:54:53	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	311,040	580,882	1.8675
09 Oct 2011 04:27:57	1127888	13351631	hadcm3n_o4q0_1940_40_007443633_4	285,120	532,168	1.8665