Task 14653482

Name	hadcm3n_o20c_1980_40_007958731_2
Workunit	8113843
Created	10 May 2012, 3:27:48 UTC
Sent	10 May 2012, 3:35:39 UTC
Report deadline	9 Aug 2012, 11:02:50 UTC
Received	29 Jul 2012, 19:55:09 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	-197 (0xFFFFFF3B) ERR_ABORTED_VIA_GUI
Computer ID	1215735
Run time	11 days 11 hours 32 min 15 sec
CPU time	7 days 20 hours 56 min 59 sec
Validate state	Invalid
Credit	2,177.28
Device peak FLOPS	1.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 22:52:05 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:56 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:44 (3304): No heartbeat from core client for 30 sec - exiting 21:12:45 (3304): No heartbeat from core client for 30 sec - exiting 21:12:47 (3304): No heartbeat from core client for 30 sec - exiting 21:12:48 (3304): No heartbeat from core client for 30 sec - exiting 21:12:49 (3304): No heartbeat from core client for 30 sec - exiting 21:12:50 (3304): No heartbeat from core client for 30 sec - exiting 21:12:51 (3304): No heartbeat from core client for 30 sec - exiting 21:12:52 (3304): No heartbeat from core client for 30 sec - exiting 21:12:53 (3304): No heartbeat from core client for 30 sec - exiting 21:12:54 (3304): No heartbeat from core client for 30 sec - exiting 21:12:55 (3304): No heartbeat from core client for 30 sec - exiting 21:12:56 (3304): No heartbeat from core client for 30 sec - exiting 21:12:57 (3304): No heartbeat from core client for 30 sec - exiting 21:12:59 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4260, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4496, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4928, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4812, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5012, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5112, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4676, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4764, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4764, iMonCtr=1 Model crash detected, will try to restart... 07:26:56 (5740): No heartbeat from core client for 30 sec - exiting 07:26:57 (5740): No heartbeat from core client for 30 sec - exiting 07:26:58 (5740): No heartbeat from core client for 30 sec - exiting 07:26:59 (5740): No heartbeat from core client for 30 sec - exiting 07:27:00 (5740): No heartbeat from core client for 30 sec - exiting 07:27:01 (5740): No heartbeat from core client for 30 sec - exiting 07:27:02 (5740): No heartbeat from core client for 30 sec - exiting 07:27:03 (5740): No heartbeat from core client for 30 sec - exiting 07:27:04 (5740): No heartbeat from core client for 30 sec - exiting 07:27:06 (5740): No heartbeat from core client for 30 sec - exiting 07:27:07 (5740): No heartbeat from core client for 30 sec - exiting 07:27:08 (5740): No heartbeat from core client for 30 sec - exiting 07:27:09 (5740): No heartbeat from core client for 30 sec - exiting 07:27:10 (5740): No heartbeat from core client for 30 sec - exiting 07:27:11 (5740): No heartbeat from core client for 30 sec - exiting 07:27:12 (5740): No heartbeat from core client for 30 sec - exiting 07:27:13 (5740): No heartbeat from core client for 30 sec - exiting 07:27:14 (5740): No heartbeat from core client for 30 sec - exiting 07:27:15 (5740): No heartbeat from core client for 30 sec - exiting 07:27:16 (5740): No heartbeat from core client for 30 sec - exiting 07:27:18 (5740): No heartbeat from core client for 30 sec - exiting 07:27:19 (5740): No heartbeat from core client for 30 sec - exiting 07:27:20 (5740): No heartbeat from core client for 30 sec - exiting 07:27:21 (5740): No heartbeat from core client for 30 sec - exiting 07:27:22 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:23 (5740): No heartbeat from core client for 30 sec - exiting 07:27:24 (5740): No heartbeat from core client for 30 sec - exiting 07:27:25 (5740): No heartbeat from core client for 30 sec - exiting 07:27:26 (5740): No heartbeat from core client for 30 sec - exiting 07:27:27 (5740): No heartbeat from core client for 30 sec - exiting 07:27:28 (5740): No heartbeat from core client for 30 sec - exiting 07:27:30 (5740): No heartbeat from core client for 30 sec - exiting 07:27:31 (5740): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1140, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4444, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=820, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:00:03 (5344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3608, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5612, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2296, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1592, iMonCtr=1 Model crash detected, will try to restart... C20:07:24 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:15:54 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:20 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 05:12:35 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:46 (3248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:07 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:14:53 (5968): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:14:54 (5968): No heartbeat from core client for 30 sec - exiting 20:14:55 (5968): No heartbeat from core client for 30 sec - exiting 20:14:56 (5968): No heartbeat from core client for 30 sec - exiting 20:14:57 (5968): No heartbeat from core client for 30 sec - exiting 20:14:59 (5968): No heartbeat from core client for 30 sec - exiting 20:15:00 (5968): No heartbeat from core client for 30 sec - exiting 19:57:19 (6576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:57:07 (6784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:08 (6784): No heartbeat from core client for 30 sec - exiting 20:57:10 (6784): No heartbeat from core client for 30 sec - exiting 20:57:11 (6784): No heartbeat from core client for 30 sec - exiting 20:57:12 (6784): No heartbeat from core client for 30 sec - exiting 20:57:13 (6784): No heartbeat from core client for 30 sec - exiting 20:57:14 (6784): No heartbeat from core client for 30 sec - exiting 20:57:15 (6784): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:54:09 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:24:46 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5916, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jul 2012 18:58:32	1215735	14653482	hadcm3n_o20c_1980_40_007958731_2	181,440	644,915	3.5544
10 Jul 2012 21:00:49	1215735	14653482	hadcm3n_o20c_1980_40_007958731_2	155,520	553,912	3.5617
29 Jun 2012 22:07:55	1215735	14653482	hadcm3n_o20c_1980_40_007958731_2	129,600	456,441	3.5219
21 Jun 2012 20:15:06	1215735	14653482	hadcm3n_o20c_1980_40_007958731_2	103,680	359,291	3.4654
13 Jun 2012 17:00:23	1215735	14653482	hadcm3n_o20c_1980_40_007958731_2	77,760	267,166	3.4358
05 Jun 2012 19:17:16	1215735	14653482	hadcm3n_o20c_1980_40_007958731_2	51,840	177,811	3.4300
23 May 2012 22:56:39	1215735	14653482	hadcm3n_o20c_1980_40_007958731_2	25,920	85,665	3.3050