Task 15475221

Name	hadcm3n_zh0o_1880_40_008251656_2
Workunit	8406780
Created	13 Dec 2012, 19:24:41 UTC
Sent	13 Dec 2012, 19:25:05 UTC
Report deadline	15 Mar 2013, 2:52:16 UTC
Received	23 Jan 2013, 13:59:39 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	976228
Run time	22 days 11 hours 40 min 39 sec
CPU time	20 days 20 hours 31 min 33 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.13 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.6.29</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... OPEN: File Creation Failed: Permission denied OPEN: Unable to Open File dataout/zh0oko.dab17b0 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.ihist after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.namelists after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/ocean_restart.day after 11 attempts Could not change to slots dir /Users/guy/Documents/BOINC/slots/0 execl(/Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137070) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=542, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.ihist after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.namelists after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/ocean_restart.day after 11 attempts Could not change to slots dir /Users/guy/Documents/BOINC/slots/0 execl(/Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137070) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=542, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.ihist after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.namelists after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/ocean_restart.day after 11 attempts Could not change to slots dir /Users/guy/Documents/BOINC/slots/0 execl(/Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137070) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=542, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.ihist after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.namelists after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/ocean_restart.day after 11 attempts Could not change to slots dir /Users/guy/Documents/BOINC/slots/0 execl(/Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137070) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=542, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.ihist after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/jobs/xabnk.namelists after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_zh0o_1880_40_008251656/dataout/ocean_restart.day after 11 attempts Could not change to slots dir /Users/guy/Documents/BOINC/slots/0 execl(/Users/guy/Documents/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137070) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=542, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Could not change to slots directory /Users/guy/Documents/BOINC/slots/0 Called boinc_finish SIGSEGV: segmentation violation Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:16:50 (2054): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jan 2013 13:00:11	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	1,036,800	1,801,090	1.7372
22 Jan 2013 20:55:05	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	1,010,880	1,750,370	1.7315
22 Jan 2013 06:15:00	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	984,960	1,698,854	1.7248
21 Jan 2013 14:55:41	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	959,040	1,649,597	1.7201
18 Jan 2013 16:01:44	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	933,120	1,599,699	1.7144
18 Jan 2013 01:58:11	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	907,200	1,550,106	1.7087
17 Jan 2013 11:45:10	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	881,280	1,500,527	1.7027
16 Jan 2013 19:29:03	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	855,360	1,450,795	1.6961
16 Jan 2013 02:41:13	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	829,440	1,401,010	1.6891
15 Jan 2013 13:30:26	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	803,520	1,352,600	1.6833
14 Jan 2013 16:36:12	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	777,600	1,309,574	1.6841
14 Jan 2013 01:57:04	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	751,680	1,266,160	1.6844
13 Jan 2013 13:15:07	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	725,760	1,222,532	1.6845
13 Jan 2013 00:23:06	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	699,840	1,178,795	1.6844
12 Jan 2013 11:24:50	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	673,920	1,134,809	1.6839
11 Jan 2013 19:39:46	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	648,000	1,091,071	1.6838
11 Jan 2013 04:08:31	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	622,080	1,047,903	1.6845
09 Jan 2013 00:23:15	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	596,160	1,004,772	1.6854
08 Jan 2013 10:12:19	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	570,240	961,867	1.6868
07 Jan 2013 18:43:06	976228	15475221	hadcm3n_zh0o_1880_40_008251656_2	544,320	918,784	1.6879