Task 16177846

Name	hadcm3n_39kn_1980_40_008391935_2
Workunit	8542794
Created	31 Dec 2013, 1:47:44 UTC
Sent	31 Dec 2013, 1:47:57 UTC
Report deadline	1 Apr 2014, 9:15:08 UTC
Received	11 Feb 2014, 9:13:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1308663
Run time	16 days 4 hours 28 min 12 sec
CPU time	15 days 0 hours 26 min 5 sec
Validate state	Invalid
Credit	10,886.40
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:59:16 (15469): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:20:34 (15817): No heartbeat from core client for 30 sec - exiting 08:20:36 (15817): No heartbeat from core client for 30 sec - exiting 08:20:37 (15817): No heartbeat from core client for 30 sec - exiting 08:20:38 (15817): No heartbeat from core client for 30 sec - exiting 08:20:39 (15817): No heartbeat from core client for 30 sec - exiting 08:20:40 (15817): No heartbeat from core client for 30 sec - exiting 08:20:41 (15817): No heartbeat from core client for 30 sec - exiting 08:20:42 (15817): No heartbeat from core client for 30 sec - exiting 08:20:43 (15817): No heartbeat from core client for 30 sec - exiting 08:20:44 (15817): No heartbeat from core client for 30 sec - exiting 08:20:45 (15817): No heartbeat from core client for 30 sec - exiting 08:20:46 (15817): No heartbeat from core client for 30 sec - exiting 08:20:47 (15817): No heartbeat from core client for 30 sec - exiting 08:20:48 (15817): No heartbeat from core client for 30 sec - exiting 08:20:49 (15817): No heartbeat from core client for 30 sec - exiting 08:20:50 (15817): No heartbeat from core client for 30 sec - exiting 08:20:51 (15817): No heartbeat from core client for 30 sec - exiting 08:20:52 (15817): No heartbeat from core client for 30 sec - exiting 08:20:53 (15817): No heartbeat from core client for 30 sec - exiting 08:20:54 (15817): No heartbeat from core client for 30 sec - exiting 08:20:55 (15817): No heartbeat from core client for 30 sec - exiting 08:20:56 (15817): No heartbeat from core client for 30 sec - exiting 08:20:57 (15817): No heartbeat from core client for 30 sec - exiting 08:20:58 (15817): No heartbeat from core client for 30 sec - exiting 08:20:59 (15817): No heartbeat from core client for 30 sec - exiting 08:21:00 (15817): No heartbeat from core client for 30 sec - exiting 08:21:01 (15817): No heartbeat from core client for 30 sec - exiting 08:21:02 (15817): No heartbeat from core client for 30 sec - exiting 08:21:03 (15817): No heartbeat from core client for 30 sec - exiting 08:21:04 (15817): No heartbeat from core client for 30 sec - exiting 08:21:05 (15817): No heartbeat from core client for 30 sec - exiting 08:21:06 (15817): No heartbeat from core client for 30 sec - exiting 08:21:07 (15817): No heartbeat from core client for 30 sec - exiting 08:21:08 (15817): No heartbeat from core client for 30 sec - exiting 08:21:09 (15817): No heartbeat from core client for 30 sec - exiting 08:21:10 (15817): No heartbeat from core client for 30 sec - exiting 08:21:11 (15817): No heartbeat from core client for 30 sec - exiting 08:21:12 (15817): No heartbeat from core client for 30 sec - exiting 08:21:13 (15817): No heartbeat from core client for 30 sec - exiting 08:21:14 (15817): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:10:59 (28210): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135680) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12400, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135680) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12400, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135680) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12400, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135680) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12400, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135680) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12400, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135680) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12400, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Feb 2014 10:24:21	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	907,200	1,296,908	1.4296
24 Jan 2014 12:02:01	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	881,280	1,259,853	1.4296
23 Jan 2014 01:38:54	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	855,360	1,223,041	1.4299
22 Jan 2014 11:23:57	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	829,440	1,185,727	1.4296
21 Jan 2014 06:44:31	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	803,520	1,148,435	1.4293
19 Jan 2014 20:42:39	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	777,600	1,111,362	1.4292
19 Jan 2014 09:50:23	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	751,680	1,074,371	1.4293
18 Jan 2014 22:32:46	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	725,760	1,037,453	1.4295
18 Jan 2014 10:07:18	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	699,840	1,000,193	1.4292
17 Jan 2014 23:24:52	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	673,920	963,296	1.4294
16 Jan 2014 18:12:56	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	648,000	925,598	1.4284
15 Jan 2014 19:50:15	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	622,080	888,369	1.4281
15 Jan 2014 04:02:44	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	596,160	850,979	1.4274
14 Jan 2014 16:18:49	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	570,240	813,703	1.4269
14 Jan 2014 05:32:26	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	544,320	776,831	1.4272
14 Jan 2014 00:40:51	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	518,400	739,848	1.4272
13 Jan 2014 07:37:35	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	492,480	702,847	1.4272
12 Jan 2014 20:55:04	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	466,560	666,112	1.4277
12 Jan 2014 08:28:23	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	440,640	628,783	1.4270
11 Jan 2014 21:25:45	1308663	16177846	hadcm3n_39kn_1980_40_008391935_2	414,720	591,904	1.4272