climateprediction.net home page
Task 14103810

Task 14103810

Name hadcm3n_o63i_1980_40_007753322_2
Workunit 7908431
Created 17 Feb 2012, 1:39:00 UTC
Sent 17 Feb 2012, 1:39:02 UTC
Report deadline 18 May 2012, 9:06:13 UTC
Received 18 Apr 2012, 15:02:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1030261
Run time 9 days 21 hours 1 min 5 sec
CPU time 8 days 19 hours 0 min 20 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 3.07 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(338,0xa08e2540) malloc: *** error for object 0x1002204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(338,0xa08e2540) malloc: *** error for object 0x1002200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(338,0xa08e2540) malloc: *** error for object 0x1002204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(338,0xa08e2540) malloc: *** error for object 0x1002200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(338,0xa08e2540) malloc: *** error for object 0x1002204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=340, selfPID=340, iMonCtr=1
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(388,0xa08e2540) malloc: *** error for object 0x83e800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o63i_1980_40_007753322/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Apr 2012 02:47:37 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 518,400 759,644 1.4654
16 Apr 2012 17:05:51 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 492,480 724,994 1.4721
15 Apr 2012 21:51:09 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 466,560 690,505 1.4800
14 Apr 2012 16:30:54 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 440,640 655,987 1.4887
13 Apr 2012 03:51:49 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 414,720 618,207 1.4907
10 Apr 2012 17:48:35 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 388,800 579,184 1.4897
09 Apr 2012 19:29:55 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 362,880 540,981 1.4908
09 Apr 2012 07:22:50 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 336,960 502,672 1.4918
08 Apr 2012 19:27:23 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 311,040 464,315 1.4928
07 Apr 2012 19:28:06 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 285,120 426,085 1.4944
04 Apr 2012 00:43:36 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 259,200 387,873 1.4964
02 Apr 2012 17:44:03 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 233,280 349,560 1.4985
30 Mar 2012 13:06:14 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 207,360 310,594 1.4978
26 Mar 2012 17:32:59 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 181,440 272,467 1.5017
07 Mar 2012 19:18:03 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 155,520 231,577 1.4890
01 Mar 2012 22:24:57 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 129,600 193,305 1.4916
27 Feb 2012 03:36:06 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 103,680 154,885 1.4939
26 Feb 2012 15:31:00 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 77,760 115,919 1.4907
26 Feb 2012 03:57:18 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 51,840 77,383 1.4927
21 Feb 2012 20:41:56 1030261 14103810 hadcm3n_o63i_1980_40_007753322_2 25,920 38,321 1.4784


©2024 climateprediction.net