Task 13373079

Name	hadcm3n_t6td_1940_40_007452753_2
Workunit	7650256
Created	10 Sep 2011, 15:10:15 UTC
Sent	10 Sep 2011, 18:01:59 UTC
Report deadline	11 Dec 2011, 1:29:10 UTC
Received	13 Dec 2011, 20:29:21 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	-197 (0xFFFFFF3B) ERR_ABORTED_VIA_GUI
Computer ID	1155553
Run time	16 days 19 hours 48 min 17 sec
CPU time	11 days 19 hours 55 min 20 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	1.59 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> 13:06:02 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:44:31 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:53:42 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:27:28 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:19 (1768): No heartbeat from core client for 30 sec - exiting 13:28:20 (1768): No heartbeat from core client for 30 sec - exiting 13:28:21 (1768): No heartbeat from core client for 30 sec - exiting 13:28:54 (1768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5740, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5740, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 22:39:01 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:16:42 (1292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:29 (1020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:42:45 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:25:49 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2716, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1576, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1 Model crash detected, will try to restart... 15:19:19 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:44:08 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:53:19 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:20:30 (6872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:16 (6204): No heartbeat from core client for 30 sec - exiting 21:21:17 (6204): No heartbeat from core client for 30 sec - exiting 21:21:18 (6204): No heartbeat from core client for 30 sec - exiting 21:21:19 (6204): No heartbeat from core client for 30 sec - exiting 21:21:20 (6204): No heartbeat from core client for 30 sec - exiting 21:21:21 (6204): No heartbeat from core client for 30 sec - exiting 21:21:22 (6204): No heartbeat from core client for 30 sec - exiting 21:21:23 (6204): No heartbeat from core client for 30 sec - exiting 21:21:24 (6204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:07 (7008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:39:14 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:52 (1284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:15:04 (5352): No heartbeat from core client for 30 sec - exiting 17:15:05 (5352): No heartbeat from core client for 30 sec - exiting 17:15:06 (5352): No heartbeat from core client for 30 sec - exiting 17:15:07 (5352): No heartbeat from core client for 30 sec - exiting 17:15:08 (5352): No heartbeat from core client for 30 sec - exiting 17:15:09 (5352): No heartbeat from core client for 30 sec - exiting 17:15:10 (5352): No heartbeat from core client for 30 sec - exiting 17:15:11 (5352): No heartbeat from core client for 30 sec - exiting 17:15:12 (5352): No heartbeat from core client for 30 sec - exiting 17:15:13 (5352): No heartbeat from core client for 30 sec - exiting 17:15:14 (5352): No heartbeat from core client for 30 sec - exiting 17:15:15 (5352): No heartbeat from core client for 30 sec - exiting 17:15:16 (5352): No heartbeat from core client for 30 sec - exiting 17:15:17 (5352): No heartbeat from core client for 30 sec - exiting 17:15:18 (5352): No heartbeat from core client for 30 sec - exiting 17:15:19 (5352): No heartbeat from core client for 30 sec - exiting 17:15:20 (5352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:21 (5352): No heartbeat from core client for 30 sec - exiting CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:50:30 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6368, selfPID=6368, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4928, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4904, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4232, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4500, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 22:04:17 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:22:23 (3640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4572, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4804, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Dec 2011 19:39:07	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	466,560	1,003,263	2.1503
05 Dec 2011 19:09:04	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	440,640	940,289	2.1339
03 Dec 2011 20:41:33	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	414,720	902,778	2.1768
03 Dec 2011 10:26:39	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	388,800	870,719	2.2395
03 Dec 2011 00:14:03	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	362,880	838,675	2.3112
02 Dec 2011 05:25:58	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	336,960	787,144	2.3360
30 Nov 2011 16:47:27	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	311,040	733,387	2.3579
27 Nov 2011 18:38:49	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	285,120	680,612	2.3871
24 Nov 2011 19:15:43	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	259,200	628,022	2.4229
22 Nov 2011 16:35:51	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	233,280	582,082	2.4952
20 Nov 2011 18:42:47	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	207,360	510,656	2.4627
17 Nov 2011 05:37:31	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	181,440	434,737	2.3960
15 Nov 2011 23:35:40	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	155,520	360,633	2.3189
31 Oct 2011 21:12:03	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	129,600	288,504	2.2261
06 Oct 2011 19:39:39	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	103,680	218,422	2.1067
29 Sep 2011 22:01:05	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	77,760	160,650	2.0660
29 Sep 2011 22:01:05	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	51,840	107,158	2.0671
22 Sep 2011 09:08:10	1155553	13373079	hadcm3n_t6td_1940_40_007452753_2	25,920	63,947	2.4671