climateprediction.net home page
Task 15607783

Task 15607783

Name hadcm3n_4m3i_1940_40_008304516_1
Workunit 8455651
Created 14 Feb 2013, 2:53:34 UTC
Sent 14 Feb 2013, 2:53:37 UTC
Report deadline 16 May 2013, 10:20:48 UTC
Received 9 Apr 2013, 6:48:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1095706
Run time 13 days 6 hours 7 min 5 sec
CPU time 11 days 8 hours 0 min 23 sec
Validate state Invalid
Credit 7,464.96
Device peak FLOPS 3.13 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:36:11 (173): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:36:13 (173): No heartbeat from core client for 30 sec - exiting
17:36:14 (173): No heartbeat from core client for 30 sec - exiting
17:36:15 (173): No heartbeat from core client for 30 sec - exiting
17:36:16 (173): No heartbeat from core client for 30 sec - exiting
17:36:17 (173): No heartbeat from core client for 30 sec - exiting
17:36:18 (173): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(312,0xa0362540) malloc: *** error for object 0x2011204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(312,0xa0362540) malloc: *** error for object 0x2012004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(312,0xa0362540) malloc: *** error for object 0x2012000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(312,0xa0362540) malloc: *** error for object 0x2012004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(312,0xa0362540) malloc: *** error for object 0x2012000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(312,0xa0362540) malloc: *** error for object 0x2012000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=333, selfPID=333, iMonCtr=1
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(183,0xa0362540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Apr 2013 03:17:33 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 622,080 954,052 1.5336
03 Apr 2013 05:59:22 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 596,160 914,375 1.5338
01 Apr 2013 09:14:33 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 570,240 875,139 1.5347
29 Mar 2013 05:39:31 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 544,320 836,227 1.5363
27 Mar 2013 09:02:26 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 518,400 796,399 1.5363
26 Mar 2013 03:54:15 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 492,480 755,945 1.5350
22 Mar 2013 08:18:48 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 466,560 715,284 1.5331
21 Mar 2013 05:38:26 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 440,640 676,202 1.5346
19 Mar 2013 11:54:49 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 414,720 636,795 1.5355
18 Mar 2013 07:13:16 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 388,800 596,925 1.5353
14 Mar 2013 10:40:22 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 362,880 557,167 1.5354
13 Mar 2013 05:54:12 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 336,960 516,449 1.5327
11 Mar 2013 08:33:02 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 311,040 474,902 1.5268
08 Mar 2013 03:14:45 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 285,120 433,765 1.5213
06 Mar 2013 06:55:23 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 259,200 393,345 1.5175
04 Mar 2013 14:25:18 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 233,280 353,539 1.5155
01 Mar 2013 10:27:52 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 207,360 313,956 1.5141
28 Feb 2013 06:37:12 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 181,440 274,386 1.5123
27 Feb 2013 03:05:31 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 155,520 235,386 1.5135
23 Feb 2013 09:22:14 1095706 15607783 hadcm3n_4m3i_1940_40_008304516_1 129,600 196,168 1.5136


©2024 climateprediction.net