Task 13661858

Name	hadcm3n_yk7x_1980_40_007536948_4
Workunit	7734180
Created	25 Nov 2011, 19:33:12 UTC
Sent	25 Nov 2011, 19:36:52 UTC
Report deadline	25 Feb 2012, 3:04:03 UTC
Received	13 Jan 2012, 17:14:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1130435
Run time	18 days 7 hours 16 min 26 sec
CPU time	15 days 6 hours 22 min 55 sec
Validate state	Invalid
Credit	11,197.44
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 139280) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14678, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 139280) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14678, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 139280) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14678, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 139280) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14678, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 139280) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14678, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 139280) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14678, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jan 2012 09:13:25	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	933,120	1,300,550	1.3938
09 Jan 2012 20:24:54	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	907,200	1,258,725	1.3875
09 Jan 2012 08:48:21	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	881,280	1,218,357	1.3825
08 Jan 2012 21:25:02	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	855,360	1,178,794	1.3781
08 Jan 2012 07:49:41	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	829,440	1,138,330	1.3724
07 Jan 2012 20:06:44	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	803,520	1,097,742	1.3662
07 Jan 2012 08:32:10	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	777,600	1,057,453	1.3599
06 Jan 2012 19:03:01	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	751,680	1,017,525	1.3537
06 Jan 2012 03:11:54	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	725,760	976,751	1.3458
05 Jan 2012 15:16:16	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	699,840	935,813	1.3372
05 Jan 2012 03:03:06	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	673,920	894,610	1.3275
04 Jan 2012 15:32:45	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	648,000	854,532	1.3187
04 Jan 2012 04:04:58	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	622,080	814,761	1.3097
03 Jan 2012 15:32:52	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	596,160	774,748	1.2996
03 Jan 2012 04:05:10	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	570,240	735,004	1.2889
02 Jan 2012 11:15:23	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	544,320	693,707	1.2744
01 Jan 2012 23:17:33	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	518,400	652,537	1.2588
01 Jan 2012 09:02:20	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	492,480	610,646	1.2399
31 Dec 2011 20:44:21	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	466,560	569,341	1.2203
31 Dec 2011 08:46:27	1130435	13661858	hadcm3n_yk7x_1980_40_007536948_4	440,640	527,715	1.1976