climateprediction.net home page
Task 15449588

Task 15449588

Name hadcm3n_zm0y_1880_40_008249550_0
Workunit 8404674
Created 21 Nov 2012, 23:43:39 UTC
Sent 21 Nov 2012, 23:44:39 UTC
Report deadline 21 Feb 2013, 7:11:50 UTC
Received 16 Dec 2012, 14:36:10 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 968709
Run time 7 days 9 hours 21 min 16 sec
CPU time 5 days 6 hours 22 min 5 sec
Validate state Invalid
Credit 2,488.32
Device peak FLOPS 2.33 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.6.20</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:34:49 (128): No heartbeat from core client for 30 sec - exiting
18:34:51 (128): No heartbeat from core client for 30 sec - exiting
18:34:52 (128): No heartbeat from core client for 30 sec - exiting
18:34:53 (128): No heartbeat from core client for 30 sec - exiting
18:34:54 (128): No heartbeat from core client for 30 sec - exiting
18:34:55 (128): No heartbeat from core client for 30 sec - exiting
18:34:56 (128): No heartbeat from core client for 30 sec - exiting
18:34:57 (128): No heartbeat from core client for 30 sec - exiting
18:34:58 (128): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:10:49 (138): No heartbeat from core client for 30 sec - exiting
16:10:51 (138): No heartbeat from core client for 30 sec - exiting
16:10:52 (138): No heartbeat from core client for 30 sec - exiting
16:10:53 (138): No heartbeat from core client for 30 sec - exiting
16:10:54 (138): No heartbeat from core client for 30 sec - exiting
16:10:55 (138): No heartbeat from core client for 30 sec - exiting
16:10:56 (138): No heartbeat from core client for 30 sec - exiting
16:10:57 (138): No heartbeat from core client for 30 sec - exiting
16:10:58 (138): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:18:07 (149): No heartbeat from core client for 30 sec - exiting
16:18:08 (149): No heartbeat from core client for 30 sec - exiting
16:18:09 (149): No heartbeat from core client for 30 sec - exiting
16:18:10 (149): No heartbeat from core client for 30 sec - exiting
16:18:11 (149): No heartbeat from core client for 30 sec - exiting
16:18:12 (149): No heartbeat from core client for 30 sec - exiting
16:18:13 (149): No heartbeat from core client for 30 sec - exiting
16:18:14 (149): No heartbeat from core client for 30 sec - exiting
16:18:15 (149): No heartbeat from core client for 30 sec - exiting
16:18:16 (149): No heartbeat from core client for 30 sec - exiting
16:18:17 (149): No heartbeat from core client for 30 sec - exiting
16:18:18 (149): No heartbeat from core client for 30 sec - exiting
16:18:19 (149): No heartbeat from core client for 30 sec - exiting
16:18:20 (149): No heartbeat from core client for 30 sec - exiting
16:18:21 (149): No heartbeat from core client for 30 sec - exiting
16:18:22 (149): No heartbeat from core client for 30 sec - exiting
16:18:23 (149): No heartbeat from core client for 30 sec - exiting
16:18:24 (149): No heartbeat from core client for 30 sec - exiting
16:18:25 (149): No heartbeat from core client for 30 sec - exiting
16:18:26 (149): No heartbeat from core client for 30 sec - exiting
16:18:27 (149): No heartbeat from core client for 30 sec - exiting
16:18:28 (149): No heartbeat from core client for 30 sec - exiting
16:18:29 (149): No heartbeat from core client for 30 sec - exiting
16:18:30 (149): No heartbeat from core client for 30 sec - exiting
16:18:31 (149): No heartbeat from core client for 30 sec - exiting
16:18:33 (149): No heartbeat from core client for 30 sec - exiting
16:18:34 (149): No heartbeat from core client for 30 sec - exiting
16:18:35 (149): No heartbeat from core client for 30 sec - exiting
16:18:36 (149): No heartbeat from core client for 30 sec - exiting
16:18:37 (149): No heartbeat from core client for 30 sec - exiting
16:18:38 (149): No heartbeat from core client for 30 sec - exiting
16:18:39 (149): No heartbeat from core client for 30 sec - exiting
16:18:40 (149): No heartbeat from core client for 30 sec - exiting
16:18:41 (149): No heartbeat from core client for 30 sec - exiting
16:18:42 (149): No heartbeat from core client for 30 sec - exiting
16:18:43 (149): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:18:45 (149): No heartbeat from core client for 30 sec - exiting
16:18:46 (149): No heartbeat from core client for 30 sec - exiting
16:18:47 (149): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
23:45:51 (152): No heartbeat from core client for 30 sec - exiting
23:45:53 (152): No heartbeat from core client for 30 sec - exiting
23:45:54 (152): No heartbeat from core client for 30 sec - exiting
23:45:55 (152): No heartbeat from core client for 30 sec - exiting
23:45:56 (152): No heartbeat from core client for 30 sec - exiting
23:45:57 (152): No heartbeat from core client for 30 sec - exiting
23:45:58 (152): No heartbeat from core client for 30 sec - exiting
23:45:59 (152): No heartbeat from core client for 30 sec - exiting
23:46:00 (152): No heartbeat from core client for 30 sec - exiting
23:46:01 (152): No heartbeat from core client for 30 sec - exiting
23:46:02 (152): No heartbeat from core client for 30 sec - exiting
23:46:03 (152): No heartbeat from core client for 30 sec - exiting
23:46:04 (152): No heartbeat from core client for 30 sec - exiting
23:46:05 (152): No heartbeat from core client for 30 sec - exiting
23:46:06 (152): No heartbeat from core client for 30 sec - exiting
23:46:07 (152): No heartbeat from core client for 30 sec - exiting
23:46:08 (152): No heartbeat from core client for 30 sec - exiting
23:46:09 (152): No heartbeat from core client for 30 sec - exiting
23:46:10 (152): No heartbeat from core client for 30 sec - exiting
23:46:11 (152): No heartbeat from core client for 30 sec - exiting
23:46:12 (152): No heartbeat from core client for 30 sec - exiting
23:46:13 (152): No heartbeat from core client for 30 sec - exiting
23:46:14 (152): No heartbeat from core client for 30 sec - exiting
23:46:15 (152): No heartbeat from core client for 30 sec - exiting
23:46:16 (152): No heartbeat from core client for 30 sec - exiting
23:46:17 (152): No heartbeat from core client for 30 sec - exiting
23:46:18 (152): No heartbeat from core client for 30 sec - exiting
23:46:19 (152): No heartbeat from core client for 30 sec - exiting
23:46:20 (152): No heartbeat from core client for 30 sec - exiting
23:46:21 (152): No heartbeat from core client for 30 sec - exiting
23:46:22 (152): No heartbeat from core client for 30 sec - exiting
23:46:23 (152): No heartbeat from core client for 30 sec - exiting
23:46:24 (152): No heartbeat from core client for 30 sec - exiting
23:46:25 (152): No heartbeat from core client for 30 sec - exiting
23:46:26 (152): No heartbeat from core client for 30 sec - exiting
23:46:27 (152): No heartbeat from core client for 30 sec - exiting
23:46:28 (152): No heartbeat from core client for 30 sec - exiting
23:46:29 (152): No heartbeat from core client for 30 sec - exiting
23:46:30 (152): No heartbeat from core client for 30 sec - exiting
23:46:31 (152): No heartbeat from core client for 30 sec - exiting
23:46:32 (152): No heartbeat from core client for 30 sec - exiting
23:46:33 (152): No heartbeat from core client for 30 sec - exiting
23:46:34 (152): No heartbeat from core client for 30 sec - exiting
23:46:35 (152): No heartbeat from core client for 30 sec - exiting
23:46:36 (152): No heartbeat from core client for 30 sec - exiting
23:46:37 (152): No heartbeat from core client for 30 sec - exiting
23:46:38 (152): No heartbeat from core client for 30 sec - exiting
23:46:39 (152): No heartbeat from core client for 30 sec - exiting
23:46:40 (152): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:16:20 (178): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
18:49:45 (158): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:05:59 (148): No heartbeat from core client for 30 sec - exiting
22:06:01 (148): No heartbeat from core client for 30 sec - exiting
22:06:02 (148): No heartbeat from core client for 30 sec - exiting
22:06:03 (148): No heartbeat from core client for 30 sec - exiting
22:06:04 (148): No heartbeat from core client for 30 sec - exiting
22:06:05 (148): No heartbeat from core client for 30 sec - exiting
22:06:06 (148): No heartbeat from core client for 30 sec - exiting
22:06:07 (148): No heartbeat from core client for 30 sec - exiting
22:06:08 (148): No heartbeat from core client for 30 sec - exiting
22:06:09 (148): No heartbeat from core client for 30 sec - exiting
22:06:10 (148): No heartbeat from core client for 30 sec - exiting
22:06:11 (148): No heartbeat from core client for 30 sec - exiting
22:06:12 (148): No heartbeat from core client for 30 sec - exiting
22:06:13 (148): No heartbeat from core client for 30 sec - exiting
22:06:14 (148): No heartbeat from core client for 30 sec - exiting
22:06:15 (148): No heartbeat from core client for 30 sec - exiting
22:06:16 (148): No heartbeat from core client for 30 sec - exiting
22:06:17 (148): No heartbeat from core client for 30 sec - exiting
22:06:18 (148): No heartbeat from core client for 30 sec - exiting
22:06:19 (148): No heartbeat from core client for 30 sec - exiting
22:06:20 (148): No heartbeat from core client for 30 sec - exiting
22:06:21 (148): No heartbeat from core client for 30 sec - exiting
22:06:22 (148): No heartbeat from core client for 30 sec - exiting
22:06:23 (148): No heartbeat from core client for 30 sec - exiting
22:06:24 (148): No heartbeat from core client for 30 sec - exiting
22:06:25 (148): No heartbeat from core client for 30 sec - exiting
22:06:26 (148): No heartbeat from core client for 30 sec - exiting
22:06:27 (148): No heartbeat from core client for 30 sec - exiting
22:06:28 (148): No heartbeat from core client for 30 sec - exiting
22:06:29 (148): No heartbeat from core client for 30 sec - exiting
22:06:30 (148): No heartbeat from core client for 30 sec - exiting
22:06:31 (148): No heartbeat from core client for 30 sec - exiting
22:06:32 (148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:09:49 (151): No heartbeat from core client for 30 sec - exiting
02:09:51 (151): No heartbeat from core client for 30 sec - exiting
02:09:52 (151): No heartbeat from core client for 30 sec - exiting
02:09:53 (151): No heartbeat from core client for 30 sec - exiting
02:09:54 (151): No heartbeat from core client for 30 sec - exiting
02:09:55 (151): No heartbeat from core client for 30 sec - exiting
02:09:56 (151): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:17:46 (143): No heartbeat from core client for 30 sec - exiting
20:17:47 (143): No heartbeat from core client for 30 sec - exiting
20:17:48 (143): No heartbeat from core client for 30 sec - exiting
20:17:49 (143): No heartbeat from core client for 30 sec - exiting
20:17:50 (143): No heartbeat from core client for 30 sec - exiting
20:17:51 (143): No heartbeat from core client for 30 sec - exiting
20:17:52 (143): No heartbeat from core client for 30 sec - exiting
20:17:53 (143): No heartbeat from core client for 30 sec - exiting
20:17:54 (143): No heartbeat from core client for 30 sec - exiting
20:17:55 (143): No heartbeat from core client for 30 sec - exiting
20:17:56 (143): No heartbeat from core client for 30 sec - exiting
20:17:57 (143): No heartbeat from core client for 30 sec - exiting
20:17:58 (143): No heartbeat from core client for 30 sec - exiting
20:17:59 (143): No heartbeat from core client for 30 sec - exiting
20:18:00 (143): No heartbeat from core client for 30 sec - exiting
20:18:01 (143): No heartbeat from core client for 30 sec - exiting
20:18:02 (143): No heartbeat from core client for 30 sec - exiting
20:18:03 (143): No heartbeat from core client for 30 sec - exiting
20:18:04 (143): No heartbeat from core client for 30 sec - exiting
20:18:05 (143): No heartbeat from core client for 30 sec - exiting
20:18:06 (143): No heartbeat from core client for 30 sec - exiting
20:18:07 (143): No heartbeat from core client for 30 sec - exiting
20:18:08 (143): No heartbeat from core client for 30 sec - exiting
20:18:09 (143): No heartbeat from core client for 30 sec - exiting
20:18:10 (143): No heartbeat from core client for 30 sec - exiting
20:18:11 (143): No heartbeat from core client for 30 sec - exiting
20:18:12 (143): No heartbeat from core client for 30 sec - exiting
20:18:13 (143): No heartbeat from core client for 30 sec - exiting
20:18:14 (143): No heartbeat from core client for 30 sec - exiting
20:18:15 (143): No heartbeat from core client for 30 sec - exiting
20:18:16 (143): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:18:17 (143): No heartbeat from core client for 30 sec - exiting

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.namelists after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/ocean_restart.day after 11 attempts
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137755) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=388, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.namelists after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/ocean_restart.day after 11 attempts
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137755) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=388, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.namelists after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/ocean_restart.day after 11 attempts
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137755) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=388, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.namelists after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/ocean_restart.day after 11 attempts
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137755) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=388, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/jobs/xabnk.namelists after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zm0y_1880_40_008249550/dataout/ocean_restart.day after 11 attempts
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 137755) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=388, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Dec 2012 21:31:46 968709 15449588 hadcm3n_zm0y_1880_40_008249550_0 207,360 429,483 2.0712
15 Dec 2012 20:20:56 968709 15449588 hadcm3n_zm0y_1880_40_008249550_0 181,440 373,297 2.0574
15 Dec 2012 20:20:56 968709 15449588 hadcm3n_zm0y_1880_40_008249550_0 155,520 316,468 2.0349
07 Dec 2012 01:15:43 968709 15449588 hadcm3n_zm0y_1880_40_008249550_0 129,600 261,680 2.0191
04 Dec 2012 11:22:47 968709 15449588 hadcm3n_zm0y_1880_40_008249550_0 103,680 206,744 1.9941
03 Dec 2012 19:47:16 968709 15449588 hadcm3n_zm0y_1880_40_008249550_0 77,760 156,933 2.0182
02 Dec 2012 15:39:54 968709 15449588 hadcm3n_zm0y_1880_40_008249550_0 51,840 103,891 2.0041
30 Nov 2012 20:12:20 968709 15449588 hadcm3n_zm0y_1880_40_008249550_0 25,920 52,986 2.0442


©2024 cpdn.org