Task 13633929

Name	hadcm3n_t2gs_1940_40_007442558_3
Workunit	7640061
Created	15 Nov 2011, 17:12:55 UTC
Sent	15 Nov 2011, 17:13:30 UTC
Report deadline	15 Feb 2012, 0:40:41 UTC
Received	4 Jan 2012, 20:20:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1082927
Run time	23 days 18 hours 45 min 52 sec
CPU time	23 days 9 hours 46 min 33 sec
Validate state	Invalid
Credit	10,264.32
Device peak FLOPS	2.05 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:15:46 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9396, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:28:39 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3228, iMonCtr=1 Model crash detected, will try to resCPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7640, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7124, iMonCtr=1 Model crash detected, will try to restart... 12:15:32 (7580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7788, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7312, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7312, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7172, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6832, iMonCtr=1 Model crash detected, will try to restart... 16:45:43 (5056): No heartbeat from core client for 30 sec - exiting 16:45:44 (5056): No heartbeat from core client for 30 sec - exiting 16:45:45 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:46 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 07:32:02 (8996): No heartbeat from core client for 30 sec - exiting 07:32:03 (8996): No heartbeat from core client for 30 sec - exiting 07:32:04 (8996): No heartbeat from core client for 30 sec - exiting 07:32:05 (8996): No heartbeat from core client for 30 sec - exiting 07:32:06 (8996): No heartbeat from core client for 30 sec - exiting 07:32:07 (8996): No heartbeat from core client for 30 sec - exiting 07:32:08 (8996): No heartbeat from core client for 30 sec - exiting 07:32:09 (8996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jan 2012 02:09:34	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	855,360	2,012,113	2.3524
02 Jan 2012 19:09:53	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	829,440	1,949,970	2.3509
01 Jan 2012 19:09:13	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	803,520	1,890,539	2.3528
31 Dec 2011 21:39:43	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	777,600	1,828,794	2.3518
30 Dec 2011 21:27:54	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	751,680	1,768,607	2.3529
29 Dec 2011 21:36:15	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	725,760	1,709,070	2.3549
28 Dec 2011 22:35:44	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	699,840	1,648,078	2.3549
27 Dec 2011 20:06:19	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	673,920	1,581,533	2.3468
26 Dec 2011 19:32:56	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	648,000	1,511,257	2.3322
24 Dec 2011 05:34:23	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	622,080	1,443,738	2.3208
21 Dec 2011 16:54:58	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	596,160	1,381,110	2.3167
19 Dec 2011 23:15:28	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	570,240	1,318,836	2.3128
16 Dec 2011 23:56:34	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	544,320	1,256,762	2.3089
15 Dec 2011 02:47:45	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	518,400	1,195,973	2.3070
13 Dec 2011 00:07:43	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	492,480	1,133,606	2.3018
11 Dec 2011 21:40:07	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	466,560	1,072,714	2.2992
09 Dec 2011 23:08:39	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	440,640	1,010,837	2.2940
08 Dec 2011 05:57:20	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	414,720	949,213	2.2888
07 Dec 2011 05:54:58	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	388,800	890,235	2.2897
06 Dec 2011 01:12:17	1082927	13633929	hadcm3n_t2gs_1940_40_007442558_3	362,880	830,063	2.2874