Task 13352625

Name	hadcm3n_o6c3_1940_40_007444025_4
Workunit	7641528
Created	9 Sep 2011, 10:17:41 UTC
Sent	9 Sep 2011, 11:00:27 UTC
Report deadline	9 Dec 2011, 18:27:38 UTC
Received	2 Mar 2013, 7:54:45 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1168646
Run time	8 days 10 hours 24 min 34 sec
CPU time	8 days 6 hours 29 min 33 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3700, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 01:14:49 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:52 (4228): No heartbeat from core client for 30 sec - exiting 01:14:53 (4228): No heartbeat from core client for 30 sec - exiting 01:14:54 (4228): No heartbeat from core client for 30 sec - exiting 01:14:55 (4228): No heartbeat from core client for 30 sec - exiting 01:14:56 (4228): No heartbeat from core client for 30 sec - exiting 01:14:58 (4228): No heartbeat from core client for 30 sec - exiting 01:14:59 (4228): No heartbeat from core client for 30 sec - exiting 01:15:00 (4228): No heartbeat from core client for 30 sec - exiting 01:15:01 (4228): No heartbeat from core client for 30 sec - exiting 01:15:02 (4228): No heartbeat from core client for 30 sec - exiting 01:15:03 (4228): No heartbeat from core client for 30 sec - exiting 01:15:05 (4228): No heartbeat from core client for 30 sec - exiting 01:15:07 (4228): No heartbeat from core client for 30 sec - exiting 01:15:08 (4228): No heartbeat from core client for 30 sec - exiting 01:15:09 (4228): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 01:01:39 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:41 (4216): No heartbeat from core client for 30 sec - exiting 01:01:42 (4216): No heartbeat from core client for 30 sec - exiting 01:01:44 (4216): No heartbeat from core client for 30 sec - exiting 01:01:45 (4216): No heartbeat from core client for 30 sec - exiting 01:01:46 (4216): No heartbeat from core client for 30 sec - exiting 01:01:47 (4216): No heartbeat from core client for 30 sec - exiting 01:01:48 (4216): No heartbeat from core client for 30 sec - exiting 01:01:50 (4216): No heartbeat from core client for 30 sec - exiting 01:02:53 (5272): No heartbeat from core client for 30 sec - exiting 01:03:02 (5272): No heartbeat from core client for 30 sec - exiting 01:03:04 (5272): No heartbeat from core client for 30 sec - exiting 01:03:05 (5272): No heartbeat from core client for 30 sec - exiting 01:03:07 (5272): No heartbeat from core client for 30 sec - exiting 01:03:09 (5272): No heartbeat from core client for 30 sec - exiting 01:03:11 (5272): No heartbeat from core client for 30 sec - exiting 01:03:12 (5272): No heartbeat from core client for 30 sec - exiting 01:03:13 (5272): No heartbeat from core client for 30 sec - exiting 01:03:15 (5272): No heartbeat from core client for 30 sec - exiting 01:03:16 (5272): No heartbeat from core client for 30 sec - exiting 01:03:18 (5272): No heartbeat from core client for 30 sec - exiting 01:03:19 (5272): No heartbeat from core client for 30 sec - exiting 01:03:21 (5272): No heartbeat from core client for 30 sec - exiting 01:03:23 (5272): No heartbeat from core client for 30 sec - exiting 01:03:26 (5272): No heartbeat from core client for 30 sec - exiting 01:03:27 (5272): No heartbeat from core client for 30 sec - exiting 01:03:30 (5272): No heartbeat from core client for 30 sec - exiting 01:03:31 (5272): No heartbeat from core client for 30 sec - exiting 01:03:33 (5272): No heartbeat from core client for 30 sec - exiting 01:03:35 (5272): No heartbeat from core client for 30 sec - exiting 01:03:36 (5272): No heartbeat from core client for 30 sec - exiting 01:03:37 (5272): No heartbeat from core client for 30 sec - exiting 01:03:38 (5272): No heartbeat from core client for 30 sec - exiting 01:03:39 (5272): No heartbeat from core client for 30 sec - exiting 01:03:40 (5272): No heartbeat from core client for 30 sec - exiting 01:03:41 (5272): No heartbeat from core client for 30 sec - exiting 01:03:42 (5272): No heartbeat from core client for 30 sec - exiting 01:03:43 (5272): No heartbeat from core client for 30 sec - exiting 01:03:45 (5272): No heartbeat from core client for 30 sec - exiting 01:03:46 (5272): No heartbeat from core client for 30 sec - exiting 01:03:48 (5272): No heartbeat from core client for 30 sec - exiting 01:03:49 (5272): No heartbeat from core client for 30 sec - exiting 01:03:51 (5272): No heartbeat from core client for 30 sec - exiting 01:03:53 (5272): No heartbeat from core client for 30 sec - exiting 01:03:55 (5272): No heartbeat from core client for 30 sec - exiting 01:03:56 (5272): No heartbeat from core client for 30 sec - exiting 01:03:57 (5272): No heartbeat from core client for 30 sec - exiting 01:03:58 (5272): No heartbeat from core client for 30 sec - exiting 01:03:59 (5272): No heartbeat from core client for 30 sec - exiting 01:04:00 (5272): No heartbeat from core client for 30 sec - exiting 01:04:04 (5272): No heartbeat from core client for 30 sec - exiting 01:04:06 (5272): No heartbeat from core client for 30 sec - exiting 01:04:08 (5272): No heartbeat from core client for 30 sec - exiting 01:04:09 (5272): No heartbeat from core client for 30 sec - exiting 01:04:10 (5272): No heartbeat from core client for 30 sec - exiting 01:04:11 (5272): No heartbeat from core client for 30 sec - exiting 01:04:12 (5272): No heartbeat from core client for 30 sec - exiting 01:04:13 (5272): No heartbeat from core client for 30 sec - exiting 01:04:15 (5272): No heartbeat from core client for 30 sec - exiting 01:04:17 (5272): No heartbeat from core client for 30 sec - exiting 01:04:18 (5272): No heartbeat from core client for 30 sec - exiting 01:04:19 (5272): No heartbeat from core client for 30 sec - exiting 01:04:20 (5272): No heartbeat from core client for 30 sec - exiting 01:04:22 (5272): No heartbeat from core client for 30 sec - exiting 01:04:28 (5272): No heartbeat from core client for 30 sec - exiting 01:04:29 (5272): No heartbeat from core client for 30 sec - exiting 01:04:32 (5272): No heartbeat from core client for 30 sec - exiting 01:04:34 (5272): No heartbeat from core client for 30 sec - exiting 01:04:36 (5272): No heartbeat from core client for 30 sec - exiting 01:04:39 (5272): No heartbeat from core client for 30 sec - exiting 01:04:40 (5272): No heartbeat from core client for 30 sec - exiting 01:04:41 (5272): No heartbeat from core client for 30 sec - exiting 01:04:42 (5272): No heartbeat from core client for 30 sec - exiting 01:04:43 (5272): No heartbeat from core client for 30 sec - exiting 01:04:44 (5272): No heartbeat from core client for 30 sec - exiting 01:04:46 (5272): No heartbeat from core client for 30 sec - exiting 01:04:47 (5272): No heartbeat from core client for 30 sec - exiting 01:04:50 (5272): No heartbeat from core client for 30 sec - exiting 01:04:51 (5272): No heartbeat from core client for 30 sec - exiting 01:04:52 (5272): No heartbeat from core client for 30 sec - exiting 01:04:54 (5272): No heartbeat from core client for 30 sec - exiting 01:04:55 (5272): No heartbeat from core client for 30 sec - exiting 01:04:56 (5272): No heartbeat from core client for 30 sec - exiting 01:04:57 (5272): No heartbeat from core client for 30 sec - exiting 01:04:59 (5272): No heartbeat from core client for 30 sec - exiting 01:05:00 (5272): No heartbeat from core client for 30 sec - exiting 01:05:04 (5272): No heartbeat from core client for 30 sec - exiting 01:05:06 (5272): No heartbeat from core client for 30 sec - exiting 01:05:07 (5272): No heartbeat from core client for 30 sec - exiting 01:05:09 (5272): No heartbeat from core client for 30 sec - exiting 01:05:11 (5272): No heartbeat from core client for 30 sec - exiting 01:05:12 (5272): No heartbeat from core client for 30 sec - exiting 01:05:13 (5272): No heartbeat from core client for 30 sec - exiting 01:05:14 (5272): No heartbeat from core client for 30 sec - exiting 01:05:15 (5272): No heartbeat from core client for 30 sec - exiting 01:05:16 (5272): No heartbeat from core client for 30 sec - exiting 01:05:17 (5272): No heartbeat from core client for 30 sec - exiting 01:05:18 (5272): No heartbeat from core client for 30 sec - exiting 01:05:20 (5272): No heartbeat from core client for 30 sec - exiting 01:05:21 (5272): No heartbeat from core client for 30 sec - exiting 01:05:23 (5272): No heartbeat from core client for 30 sec - exiting 01:05:25 (5272): No heartbeat from core client for 30 sec - exiting 01:05:27 (5272): No heartbeat from core client for 30 sec - exiting 01:05:28 (5272): No heartbeat from core client for 30 sec - exiting 01:05:30 (5272): No heartbeat from core client for 30 sec - exiting 01:05:33 (5272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:15 (5272): No heartbeat from core client for 30 sec - exiting 01:06:17 (5272): No heartbeat from core client for 30 sec - exiting 01:10:35 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:39 (2932): No heartbeat from core client for 30 sec - exiting 01:10:44 (2932): No heartbeat from core client for 30 sec - exiting 01:11:44 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:57 (4168): No heartbeat from core client for 30 sec - exiting 01:13:49 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:13:51 (5576): No heartbeat from core client for 30 sec - exiting 01:13:52 (5576): No heartbeat from core client for 30 sec - exiting 01:14:49 (1976): No heartbeat from core client for 30 sec - exiting 01:14:54 (1976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:56 (1976): No heartbeat from core client for 30 sec - exiting 01:14:57 (1976): No heartbeat from core client for 30 sec - exiting 01:14:59 (1976): No heartbeat from core client for 30 sec - exiting 01:15:01 (1976): No heartbeat from core client for 30 sec - exiting 01:15:03 (1976): No heartbeat from core client for 30 sec - exiting 01:15:04 (1976): No heartbeat from core client for 30 sec - exiting 01:15:06 (1976): No heartbeat from core client for 30 sec - exiting 01:16:06 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:16:07 (5524): No heartbeat from core client for 30 sec - exiting 01:16:08 (5524): No heartbeat from core client for 30 sec - exiting 01:16:09 (5524): No heartbeat from core client for 30 sec - exiting 01:16:11 (5524): No heartbeat from core client for 30 sec - exiting 01:16:13 (5524): No heartbeat from core client for 30 sec - exiting 01:16:15 (5524): No heartbeat from core client for 30 sec - exiting 01:16:16 (5524): No heartbeat from core client for 30 sec - exiting 01:16:17 (5524): No heartbeat from core client for 30 sec - exiting 01:16:18 (5524): No heartbeat from core client for 30 sec - exiting 01:18:51 (1528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:22:07 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:23:33 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:04 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:18 (4540): No heartbeat from core client for 30 sec - exiting 01:38:34 (3436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:40:33 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:44:44 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:44:50 (5028): No heartbeat from core client for 30 sec - exiting 01:48:43 (1392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:48:56 (1392): No heartbeat from core client for 30 sec - exiting 01:48:57 (1392): No heartbeat from core client for 30 sec - exiting 01:48:58 (1392): No heartbeat from core client for 30 sec - exiting 01:51:35 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:54:31 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:54:40 (2312): No heartbeat from core client for 30 sec - exiting 01:55:47 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:57:17 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:48 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:56 (5948): No heartbeat from core client for 30 sec - exiting 13:16:49 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Sep 2011 12:34:06	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	388,800	713,278	1.8346
21 Sep 2011 00:00:42	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	362,880	668,182	1.8413
20 Sep 2011 11:24:56	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	336,960	623,072	1.8491
19 Sep 2011 22:55:40	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	311,040	578,191	1.8589
18 Sep 2011 18:46:19	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	285,120	532,386	1.8672
18 Sep 2011 04:52:32	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	259,200	483,372	1.8649
17 Sep 2011 14:38:16	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	233,280	434,491	1.8625
17 Sep 2011 00:56:15	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	207,360	385,637	1.8597
16 Sep 2011 11:07:07	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	181,440	336,621	1.8553
15 Sep 2011 14:40:13	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	155,520	287,430	1.8482
15 Sep 2011 01:06:59	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	129,600	239,097	1.8449
14 Sep 2011 11:38:07	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	103,680	191,198	1.8441
13 Sep 2011 22:15:53	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	77,760	143,620	1.8470
13 Sep 2011 08:54:47	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	51,840	96,036	1.8525
12 Sep 2011 19:33:22	1168646	13352625	hadcm3n_o6c3_1940_40_007444025_4	25,920	48,653	1.8770