Task 13292590

Name	hadcm3n_p56z_1940_40_007422011_0
Workunit	7619646
Created	25 Aug 2011, 4:15:33 UTC
Sent	25 Aug 2011, 4:24:19 UTC
Report deadline	24 Nov 2011, 11:51:30 UTC
Received	14 Sep 2011, 16:02:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1120510
Run time	15 days 22 hours 57 min 49 sec
CPU time	10 days 4 hours 13 min 9 sec
Validate state	Invalid
Credit	9,953.28
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... 07:33:00 (196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 15:50:39 (212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 132835) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=949, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 132835) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=949, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 132835) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=949, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 132835) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=949, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 132835) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=949, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 132835) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=949, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Sep 2011 10:32:02	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	829,440	867,049	1.0453
13 Sep 2011 23:02:18	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	803,520	828,391	1.0310
13 Sep 2011 10:49:23	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	777,600	825,192	1.0612
12 Sep 2011 23:19:22	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	751,680	786,837	1.0468
12 Sep 2011 10:27:38	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	725,760	753,448	1.0382
11 Sep 2011 23:17:44	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	699,840	715,737	1.0227
11 Sep 2011 12:26:40	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	673,920	734,417	1.0898
11 Sep 2011 01:25:58	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	648,000	697,215	1.0759
10 Sep 2011 14:29:40	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	622,080	726,107	1.1672
10 Sep 2011 03:27:27	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	596,160	717,549	1.2036
09 Sep 2011 14:21:51	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	570,240	679,498	1.1916
09 Sep 2011 02:42:10	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	544,320	640,998	1.1776
08 Sep 2011 13:53:35	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	518,400	633,247	1.2215
08 Sep 2011 01:48:52	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	492,480	593,459	1.2050
07 Sep 2011 12:11:36	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	466,560	572,166	1.2264
07 Sep 2011 00:11:19	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	440,640	585,073	1.3278
06 Sep 2011 10:29:22	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	414,720	545,078	1.3143
05 Sep 2011 22:38:35	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	388,800	506,297	1.3022
05 Sep 2011 10:44:09	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	362,880	466,890	1.2866
04 Sep 2011 22:43:36	1120510	13292590	hadcm3n_p56z_1940_40_007422011_0	336,960	427,575	1.2689