climateprediction.net home page
Task 16081583

Task 16081583

Name hadcm3n_o0ui_1980_40_008386688_2
Workunit 8537547
Created 17 Nov 2013, 17:04:27 UTC
Sent 17 Nov 2013, 17:04:42 UTC
Report deadline 17 Feb 2014, 0:31:53 UTC
Received 30 Dec 2013, 12:00:47 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1001397
Run time 15 days 20 hours 4 min 36 sec
CPU time 14 days 22 hours 40 min 48 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.60 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=48198, selfPID=48198, iMonCtr=1
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x2020604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x1056c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x381f604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x825e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(86558,0xa0c87540) malloc: *** error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o0ui_1980_40_008386688/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Dec 2013 14:03:21 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 777,600 1,267,607 1.6302
27 Dec 2013 19:07:16 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 751,680 1,223,549 1.6278
26 Dec 2013 15:05:33 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 725,760 1,179,457 1.6251
25 Dec 2013 12:01:27 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 699,840 1,135,342 1.6223
23 Dec 2013 16:22:52 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 673,920 1,091,325 1.6194
22 Dec 2013 12:40:28 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 648,000 1,047,327 1.6162
20 Dec 2013 18:02:18 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 622,080 1,003,276 1.6128
19 Dec 2013 14:25:05 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 596,160 959,274 1.6091
17 Dec 2013 20:32:47 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 570,240 916,429 1.6071
16 Dec 2013 16:06:40 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 544,320 872,547 1.6030
15 Dec 2013 11:47:06 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 518,400 828,459 1.5981
13 Dec 2013 17:29:55 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 492,480 784,659 1.5933
12 Dec 2013 13:22:44 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 466,560 740,745 1.5877
10 Dec 2013 18:17:42 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 440,640 697,003 1.5818
09 Dec 2013 13:40:15 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 414,720 653,450 1.5756
07 Dec 2013 18:32:49 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 388,800 609,476 1.5676
06 Dec 2013 14:31:32 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 362,880 565,429 1.5582
04 Dec 2013 19:07:45 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 336,960 521,445 1.5475
03 Dec 2013 14:54:42 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 311,040 477,415 1.5349
01 Dec 2013 19:40:42 1001397 16081583 hadcm3n_o0ui_1980_40_008386688_2 285,120 433,483 1.5204


©2024 climateprediction.net