climateprediction.net home page
Task 15893391

Task 15893391

Name hadcm3n_3evj_1980_40_008319720_3
Workunit 8470855
Created 18 Jul 2013, 10:52:02 UTC
Sent 18 Jul 2013, 15:09:03 UTC
Report deadline 17 Oct 2013, 22:36:14 UTC
Received 14 Aug 2013, 16:06:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1197259
Run time 8 days 14 hours 33 min 26 sec
CPU time 5 days 9 hours 47 min 57 sec
Validate state Invalid
Credit 3,732.48
Device peak FLOPS 3.20 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
01:13:31 (18474): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:33 (18474): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:28:02 (24517): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:28:03 (24517): No heartbeat from core client for 30 sec - exiting
00:28:04 (24517): No heartbeat from core client for 30 sec - exiting
00:28:05 (24517): No heartbeat from core client for 30 sec - exiting
00:28:06 (24517): No heartbeat from core client for 30 sec - exiting
00:28:07 (24517): No heartbeat from core client for 30 sec - exiting
00:28:08 (24517): No heartbeat from core client for 30 sec - exiting
00:28:09 (24517): No heartbeat from core client for 30 sec - exiting
00:28:10 (24517): No heartbeat from core client for 30 sec - exiting
00:28:11 (24517): No heartbeat from core client for 30 sec - exiting
02:35:56 (69676): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:35:59 (69676): No heartbeat from core client for 30 sec - exiting
02:36:00 (69676): No heartbeat from core client for 30 sec - exiting
02:36:01 (69676): No heartbeat from core client for 30 sec - exiting
02:36:02 (69676): No heartbeat from core client for 30 sec - exiting
02:36:03 (69676): No heartbeat from core client for 30 sec - exiting
02:36:04 (69676): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
hadcm3n_6.07_i686-apple-darwin(412,0xac96e2c0) malloc: *** error for object 0x33ca204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(412,0xac96e2c0) malloc: *** error for object 0x33ca200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(412,0xac96e2c0) malloc: *** error for object 0x6bdce04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(412,0xac96e2c0) malloc: *** error for object 0x83ca204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(412,0xac96e2c0) malloc: *** error for object 0x83ca200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(412,0xac96e2c0) malloc: *** error for object 0x5bd0404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(412,0xac96e2c0) malloc: *** error for object 0x7bb0e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(412,0xac96e2c0) malloc: *** error for object 0x7bb0e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(412,0xac96e2c0) malloc: *** error for object 0x7bb0e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x1156a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x2952a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x514da04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x1156a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x1156a00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x895f604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x895f600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(61044,0xac96e2c0) malloc: *** error for object 0x814b600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:35:17 (61044): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Aug 2013 16:16:30 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 311,040 460,557 1.4807
14 Aug 2013 16:16:30 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 285,120 424,941 1.4904
14 Aug 2013 16:16:30 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 259,200 388,822 1.5001
14 Aug 2013 16:16:30 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 233,280 352,594 1.5115
14 Aug 2013 16:16:30 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 207,360 316,745 1.5275
14 Aug 2013 16:16:30 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 181,440 280,740 1.5473
14 Aug 2013 16:16:30 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 155,520 244,855 1.5744
14 Aug 2013 16:16:30 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 129,600 208,732 1.6106
14 Aug 2013 16:16:30 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 103,680 170,019 1.6398
30 Jul 2013 09:22:35 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 77,760 128,074 1.6470
30 Jul 2013 09:22:35 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 51,840 88,338 1.7041
30 Jul 2013 09:22:35 1197259 15893391 hadcm3n_3evj_1980_40_008319720_3 25,920 45,023 1.7370


©2024 climateprediction.net