climateprediction.net home page
Task 13023108

Task 13023108

Name hadcm3n_t3dj_1940_40_007315119_0
Workunit 7512549
Created 28 Jun 2011, 19:43:33 UTC
Sent 28 Jun 2011, 19:51:54 UTC
Report deadline 28 Sep 2011, 3:19:05 UTC
Received 10 Sep 2011, 15:44:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1153671
Run time 8 days 22 hours 15 min 26 sec
CPU time 8 days 3 hours 56 min 56 sec
Validate state Invalid
Credit 9,020.16
Device peak FLOPS 3.26 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
1, checkPID=3323, selfPID=3323, iMonCtr=1
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x202de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x202de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1011e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1011e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1011e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1011e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7473,0xa041a540) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
Suspended CPDN Monitor - Suspend request from BOINC...
11:44:48 (7473): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:19:45 (10320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
02:51:18 (12705): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:46:58 (13713): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:56:24 (16241): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:56:19 (17262): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x82ca04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x82ca00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x82ca04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x82ca00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x281fe04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x283b404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x283b400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x283b404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x283b400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x283b404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x283b400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x82ca04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x82ca00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x82ca04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x82ca00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x204a204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x204a200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x101f804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x101f800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(25255,0xa041a540) malloc: *** error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
Signal 3 received, exiting...
Called boinc_finish
hadcm3n_6.07_i686-apple-darwin(31368,0xa041a540) malloc: *** error for object 0x1058604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31368,0xa041a540) malloc: *** error for object 0x281f604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31368,0xa041a540) malloc: *** error for object 0x201f604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31368,0xa041a540) malloc: *** error for object 0x1058604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31368,0xa041a540) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31368,0xa041a540) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31368,0xa041a540) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31368,0xa041a540) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31368,0xa041a540) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(98788,0xa041a540) malloc: *** error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(98788,0xa041a540) malloc: *** error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(98788,0xa041a540) malloc: *** error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(98788,0xa041a540) malloc: *** error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(98788,0xa041a540) malloc: *** error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(98788,0xa041a540) malloc: *** error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(98788,0xa041a540) malloc: *** error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(98788,0xa041a540) malloc: *** error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(98788,0xa041a540) malloc: *** error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
21:11:49 (98788): No heartbeat from core client for 30 sec - exiting
21:11:50 (98788): No heartbeat from core client for 30 sec - exiting
21:11:51 (98788): No heartbeat from core client for 30 sec - exiting
21:11:52 (98788): No heartbeat from core client for 30 sec - exiting
21:11:53 (98788): No heartbeat from core client for 30 sec - exiting
21:11:54 (98788): No heartbeat from core client for 30 sec - exiting
21:11:55 (98788): No heartbeat from core client for 30 sec - exiting
21:11:56 (98788): No heartbeat from core client for 30 sec - exiting
21:11:57 (98788): No heartbeat from core client for 30 sec - exiting
21:11:58 (98788): No heartbeat from core client for 30 sec - exiting
21:11:59 (98788): No heartbeat from core client for 30 sec - exiting
21:12:00 (98788): No heartbeat from core client for 30 sec - exiting
21:12:01 (98788): No heartbeat from core client for 30 sec - exiting
21:12:02 (98788): No heartbeat from core client for 30 sec - exiting
21:12:03 (98788): No heartbeat from core client for 30 sec - exiting
21:12:04 (98788): No heartbeat from core client for 30 sec - exiting
21:12:05 (98788): No heartbeat from core client for 30 sec - exiting
21:12:06 (98788): No heartbeat from core client for 30 sec - exiting
21:12:07 (98788): No heartbeat from core client for 30 sec - exiting
21:12:08 (98788): No heartbeat from core client for 30 sec - exiting
21:12:09 (98788): No heartbeat from core client for 30 sec - exiting
21:12:10 (98788): No heartbeat from core client for 30 sec - exiting
21:12:11 (98788): No heartbeat from core client for 30 sec - exiting
21:12:12 (98788): No heartbeat from core client for 30 sec - exiting
21:12:13 (98788): No heartbeat from core client for 30 sec - exiting
21:12:14 (98788): No heartbeat from core client for 30 sec - exiting
21:12:15 (98788): No heartbeat from core client for 30 sec - exiting
21:12:16 (98788): No heartbeat from core client for 30 sec - exiting
21:12:17 (98788): No heartbeat from core client for 30 sec - exiting
21:12:18 (98788): No heartbeat from core client for 30 sec - exiting
21:14:09 (98788): No heartbeat from core client for 30 sec - exiting
21:14:10 (98788): No heartbeat from core client for 30 sec - exiting
21:14:11 (98788): No heartbeat from core client for 30 sec - exiting
21:14:12 (98788): No heartbeat from core client for 30 sec - exiting
21:14:13 (98788): No heartbeat from core client for 30 sec - exiting
21:14:14 (98788): No heartbeat from core client for 30 sec - exiting
21:14:15 (98788): No heartbeat from core client for 30 sec - exiting
21:14:16 (98788): No heartbeat from core client for 30 sec - exiting
21:14:17 (98788): No heartbeat from core client for 30 sec - exiting
21:14:18 (98788): No heartbeat from core client for 30 sec - exiting
21:14:19 (98788): No heartbeat from core client for 30 sec - exiting
21:14:20 (98788): No heartbeat from core client for 30 sec - exiting
21:14:21 (98788): No heartbeat from core client for 30 sec - exiting
21:14:22 (98788): No heartbeat from core client for 30 sec - exiting
21:14:23 (98788): No heartbeat from core client for 30 sec - exiting
21:14:24 (98788): No heartbeat from core client for 30 sec - exiting
21:14:25 (98788): No heartbeat from core client for 30 sec - exiting
21:14:26 (98788): No heartbeat from core client for 30 sec - exiting
21:14:27 (98788): No heartbeat from core client for 30 sec - exiting
21:14:28 (98788): No heartbeat from core client for 30 sec - exiting
21:14:29 (98788): No heartbeat from core client for 30 sec - exiting
21:14:30 (98788): No heartbeat from core client for 30 sec - exiting
21:14:31 (98788): No heartbeat from core client for 30 sec - exiting
21:14:32 (98788): No heartbeat from core client for 30 sec - exiting
21:14:33 (98788): No heartbeat from core client for 30 sec - exiting
21:14:34 (98788): No heartbeat from core client for 30 sec - exiting
21:14:35 (98788): No heartbeat from core client for 30 sec - exiting
21:14:36 (98788): No heartbeat from core client for 30 sec - exiting
21:14:37 (98788): No heartbeat from core client for 30 sec - exiting
21:14:38 (98788): No heartbeat from core client for 30 sec - exiting
21:17:45 (98788): No heartbeat from core client for 30 sec - exiting
21:17:46 (98788): No heartbeat from core client for 30 sec - exiting
21:17:47 (98788): No heartbeat from core client for 30 sec - exiting
21:17:48 (98788): No heartbeat from core client for 30 sec - exiting
21:17:49 (98788): No heartbeat from core client for 30 sec - exiting
21:17:50 (98788): No heartbeat from core client for 30 sec - exiting
21:17:51 (98788): No heartbeat from core client for 30 sec - exiting
21:17:52 (98788): No heartbeat from core client for 30 sec - exiting
21:17:53 (98788): No heartbeat from core client for 30 sec - exiting
21:17:54 (98788): No heartbeat from core client for 30 sec - exiting
21:17:55 (98788): No heartbeat from core client for 30 sec - exiting
21:17:56 (98788): No heartbeat from core client for 30 sec - exiting
21:17:57 (98788): No heartbeat from core client for 30 sec - exiting
21:17:58 (98788): No heartbeat from core client for 30 sec - exiting
21:17:59 (98788): No heartbeat from core client for 30 sec - exiting
21:18:00 (98788): No heartbeat from core client for 30 sec - exiting
21:18:01 (98788): No heartbeat from core client for 30 sec - exiting
21:18:02 (98788): No heartbeat from core client for 30 sec - exiting
21:18:03 (98788): No heartbeat from core client for 30 sec - exiting
21:18:04 (98788): No heartbeat from core client for 30 sec - exiting
21:18:05 (98788): No heartbeat from core client for 30 sec - exiting
21:18:06 (98788): No heartbeat from core client for 30 sec - exiting
21:18:07 (98788): No heartbeat from core client for 30 sec - exiting
21:18:08 (98788): No heartbeat from core client for 30 sec - exiting
21:18:09 (98788): No heartbeat from core client for 30 sec - exiting
21:18:10 (98788): No heartbeat from core client for 30 sec - exiting
21:18:11 (98788): No heartbeat from core client for 30 sec - exiting
21:18:12 (98788): No heartbeat from core client for 30 sec - exiting
21:18:13 (98788): No heartbeat from core client for 30 sec - exiting
21:18:14 (98788): No heartbeat from core client for 30 sec - exiting
21:20:05 (98788): No heartbeat from core client for 30 sec - exiting
21:20:06 (98788): No heartbeat from core client for 30 sec - exiting
21:20:07 (98788): No heartbeat from core client for 30 sec - exiting
21:20:08 (98788): No heartbeat from core client for 30 sec - exiting
21:20:09 (98788): No heartbeat from core client for 30 sec - exiting
21:20:10 (98788): No heartbeat from core client for 30 sec - exiting
21:20:11 (98788): No heartbeat from core client for 30 sec - exiting
21:20:12 (98788): No heartbeat from core client for 30 sec - exiting
21:20:13 (98788): No heartbeat from core client for 30 sec - exiting
21:20:14 (98788): No heartbeat from core client for 30 sec - exiting
21:20:15 (98788): No heartbeat from core client for 30 sec - exiting
21:20:16 (98788): No heartbeat from core client for 30 sec - exiting
21:20:17 (98788): No heartbeat from core client for 30 sec - exiting
21:20:18 (98788): No heartbeat from core client for 30 sec - exiting
21:20:19 (98788): No heartbeat from core client for 30 sec - exiting
21:20:20 (98788): No heartbeat from core client for 30 sec - exiting
21:20:21 (98788): No heartbeat from core client for 30 sec - exiting
21:20:22 (98788): No heartbeat from core client for 30 sec - exiting
21:20:23 (98788): No heartbeat from core client for 30 sec - exiting
21:20:24 (98788): No heartbeat from core client for 30 sec - exiting
21:20:25 (98788): No heartbeat from core client for 30 sec - exiting
21:20:26 (98788): No heartbeat from core client for 30 sec - exiting
21:20:27 (98788): No heartbeat from core client for 30 sec - exiting
21:20:28 (98788): No heartbeat from core client for 30 sec - exiting
21:20:29 (98788): No heartbeat from core client for 30 sec - exiting
21:20:30 (98788): No heartbeat from core client for 30 sec - exiting
21:20:31 (98788): No heartbeat from core client for 30 sec - exiting
21:20:32 (98788): No heartbeat from core client for 30 sec - exiting
21:20:33 (98788): No heartbeat from core client for 30 sec - exiting
21:20:34 (98788): No heartbeat from core client for 30 sec - exiting
21:23:42 (98788): No heartbeat from core client for 30 sec - exiting
21:23:43 (98788): No heartbeat from core client for 30 sec - exiting
21:23:44 (98788): No heartbeat from core client for 30 sec - exiting
21:23:45 (98788): No heartbeat from core client for 30 sec - exiting
21:23:46 (98788): No heartbeat from core client for 30 sec - exiting
21:23:47 (98788): No heartbeat from core client for 30 sec - exiting
21:23:48 (98788): No heartbeat from core client for 30 sec - exiting
21:23:49 (98788): No heartbeat from core client for 30 sec - exiting
21:23:50 (98788): No heartbeat from core client for 30 sec - exiting
21:23:51 (98788): No heartbeat from core client for 30 sec - exiting
21:23:52 (98788): No heartbeat from core client for 30 sec - exiting
21:23:53 (98788): No heartbeat from core client for 30 sec - exiting
21:23:54 (98788): No heartbeat from core client for 30 sec - exiting
21:23:55 (98788): No heartbeat from core client for 30 sec - exiting
21:23:56 (98788): No heartbeat from core client for 30 sec - exiting
21:23:57 (98788): No heartbeat from core client for 30 sec - exiting
21:23:58 (98788): No heartbeat from core client for 30 sec - exiting
21:23:59 (98788): No heartbeat from core client for 30 sec - exiting
21:24:00 (98788): No heartbeat from core client for 30 sec - exiting
21:24:01 (98788): No heartbeat from core client for 30 sec - exiting
21:24:02 (98788): No heartbeat from core client for 30 sec - exiting
21:24:03 (98788): No heartbeat from core client for 30 sec - exiting
21:24:04 (98788): No heartbeat from core client for 30 sec - exiting
21:24:05 (98788): No heartbeat from core client for 30 sec - exiting
21:24:06 (98788): No heartbeat from core client for 30 sec - exiting
21:24:07 (98788): No heartbeat from core client for 30 sec - exiting
21:24:08 (98788): No heartbeat from core client for 30 sec - exiting
21:24:09 (98788): No heartbeat from core client for 30 sec - exiting
21:24:10 (98788): No heartbeat from core client for 30 sec - exiting
21:24:11 (98788): No heartbeat from core client for 30 sec - exiting
21:26:02 (98788): No heartbeat from core client for 30 sec - exiting
21:26:03 (98788): No heartbeat from core client for 30 sec - exiting
21:26:04 (98788): No heartbeat from core client for 30 sec - exiting
21:26:05 (98788): No heartbeat from core client for 30 sec - exiting
21:26:06 (98788): No heartbeat from core client for 30 sec - exiting
21:26:07 (98788): No heartbeat from core client for 30 sec - exiting
21:26:08 (98788): No heartbeat from core client for 30 sec - exiting
21:26:09 (98788): No heartbeat from core client for 30 sec - exiting
21:26:10 (98788): No heartbeat from core client for 30 sec - exiting
21:26:11 (98788): No heartbeat from core client for 30 sec - exiting
21:26:12 (98788): No heartbeat from core client for 30 sec - exiting
21:26:13 (98788): No heartbeat from core client for 30 sec - exiting
21:26:14 (98788): No heartbeat from core client for 30 sec - exiting
21:26:15 (98788): No heartbeat from core client for 30 sec - exiting
21:26:16 (98788): No heartbeat from core client for 30 sec - exiting
21:26:17 (98788): No heartbeat from core client for 30 sec - exiting
21:26:18 (98788): No heartbeat from core client for 30 sec - exiting
21:26:19 (98788): No heartbeat from core client for 30 sec - exiting
21:26:20 (98788): No heartbeat from core client for 30 sec - exiting
21:26:21 (98788): No heartbeat from core client for 30 sec - exiting
21:26:22 (98788): No heartbeat from core client for 30 sec - exiting
21:26:23 (98788): No heartbeat from core client for 30 sec - exiting
21:26:24 (98788): No heartbeat from core client for 30 sec - exiting
21:26:25 (98788): No heartbeat from core client for 30 sec - exiting
21:26:26 (98788): No heartbeat from core client for 30 sec - exiting
21:26:27 (98788): No heartbeat from core client for 30 sec - exiting
21:26:28 (98788): No heartbeat from core client for 30 sec - exiting
21:26:29 (98788): No heartbeat from core client for 30 sec - exiting
21:26:30 (98788): No heartbeat from core client for 30 sec - exiting
21:26:31 (98788): No heartbeat from core client for 30 sec - exiting
21:29:38 (98788): No heartbeat from core client for 30 sec - exiting
21:29:39 (98788): No heartbeat from core client for 30 sec - exiting
21:29:40 (98788): No heartbeat from core client for 30 sec - exiting
21:29:41 (98788): No heartbeat from core client for 30 sec - exiting
21:29:42 (98788): No heartbeat from core client for 30 sec - exiting
21:29:43 (98788): No heartbeat from core client for 30 sec - exiting
21:29:44 (98788): No heartbeat from core client for 30 sec - exiting
21:29:45 (98788): No heartbeat from core client for 30 sec - exiting
21:29:46 (98788): No heartbeat from core client for 30 sec - exiting
21:29:47 (98788): No heartbeat from core client for 30 sec - exiting
21:29:48 (98788): No heartbeat from core client for 30 sec - exiting
21:29:49 (98788): No heartbeat from core client for 30 sec - exiting
21:29:50 (98788): No heartbeat from core client for 30 sec - exiting
21:29:51 (98788): No heartbeat from core client for 30 sec - exiting
21:29:52 (98788): No heartbeat from core client for 30 sec - exiting
21:29:53 (98788): No heartbeat from core client for 30 sec - exiting
21:29:54 (98788): No heartbeat from core client for 30 sec - exiting
21:29:55 (98788): No heartbeat from core client for 30 sec - exiting
21:29:56 (98788): No heartbeat from core client for 30 sec - exiting
21:29:57 (98788): No heartbeat from core client for 30 sec - exiting
21:29:58 (98788): No heartbeat from core client for 30 sec - exiting
21:29:59 (98788): No heartbeat from core client for 30 sec - exiting
21:30:00 (98788): No heartbeat from core client for 30 sec - exiting
21:30:01 (98788): No heartbeat from core client for 30 sec - exiting
21:30:02 (98788): No heartbeat from core client for 30 sec - exiting
21:30:03 (98788): No heartbeat from core client for 30 sec - exiting
21:30:04 (98788): No heartbeat from core client for 30 sec - exiting
21:30:05 (98788): No heartbeat from core client for 30 sec - exiting
21:30:06 (98788): No heartbeat from core client for 30 sec - exiting
21:30:07 (98788): No heartbeat from core client for 30 sec - exiting
21:31:58 (98788): No heartbeat from core client for 30 sec - exiting
21:31:59 (98788): No heartbeat from core client for 30 sec - exiting
21:32:00 (98788): No heartbeat from core client for 30 sec - exiting
21:32:01 (98788): No heartbeat from core client for 30 sec - exiting
21:32:02 (98788): No heartbeat from core client for 30 sec - exiting
21:32:03 (98788): No heartbeat from core client for 30 sec - exiting
21:32:04 (98788): No heartbeat from core client for 30 sec - exiting
21:32:05 (98788): No heartbeat from core client for 30 sec - exiting
21:32:06 (98788): No heartbeat from core client for 30 sec - exiting
21:32:07 (98788): No heartbeat from core client for 30 sec - exiting
21:32:08 (98788): No heartbeat from core client for 30 sec - exiting
21:32:09 (98788): No heartbeat from core client for 30 sec - exiting
21:32:10 (98788): No heartbeat from core client for 30 sec - exiting
21:32:11 (98788): No heartbeat from core client for 30 sec - exiting
21:32:12 (98788): No heartbeat from core client for 30 sec - exiting
21:32:13 (98788): No heartbeat from core client for 30 sec - exiting
21:32:14 (98788): No heartbeat from core client for 30 sec - exiting
21:32:15 (98788): No heartbeat from core client for 30 sec - exiting
21:32:16 (98788): No heartbeat from core client for 30 sec - exiting
21:32:17 (98788): No heartbeat from core client for 30 sec - exiting
21:32:18 (98788): No heartbeat from core client for 30 sec - exiting
21:32:19 (98788): No heartbeat from core client for 30 sec - exiting
21:32:20 (98788): No heartbeat from core client for 30 sec - exiting
21:32:21 (98788): No heartbeat from core client for 30 sec - exiting
21:32:22 (98788): No heartbeat from core client for 30 sec - exiting
21:32:23 (98788): No heartbeat from core client for 30 sec - exiting
21:32:24 (98788): No heartbeat from core client for 30 sec - exiting
21:32:25 (98788): No heartbeat from core client for 30 sec - exiting
21:32:26 (98788): No heartbeat from core client for 30 sec - exiting
21:32:27 (98788): No heartbeat from core client for 30 sec - exiting
21:35:35 (98788): No heartbeat from core client for 30 sec - exiting
21:35:36 (98788): No heartbeat from core client for 30 sec - exiting
21:35:37 (98788): No heartbeat from core client for 30 sec - exiting
21:35:38 (98788): No heartbeat from core client for 30 sec - exiting
21:35:39 (98788): No heartbeat from core client for 30 sec - exiting
21:35:40 (98788): No heartbeat from core client for 30 sec - exiting
21:35:41 (98788): No heartbeat from core client for 30 sec - exiting
21:35:42 (98788): No heartbeat from core client for 30 sec - exiting
21:35:43 (98788): No heartbeat from core client for 30 sec - exiting
21:35:44 (98788): No heartbeat from core client for 30 sec - exiting
21:35:45 (98788): No heartbeat from core client for 30 sec - exiting
21:35:46 (98788): No heartbeat from core client for 30 sec - exiting
21:35:47 (98788): No heartbeat from core client for 30 sec - exiting
21:35:48 (98788): No heartbeat from core client for 30 sec - exiting
21:35:49 (98788): No heartbeat from core client for 30 sec - exiting
21:35:50 (98788): No heartbeat from core client for 30 sec - exiting
21:35:51 (98788): No heartbeat from core client for 30 sec - exiting
21:35:52 (98788): No heartbeat from core client for 30 sec - exiting
21:35:53 (98788): No heartbeat from core client for 30 sec - exiting
21:35:54 (98788): No heartbeat from core client for 30 sec - exiting
21:35:55 (98788): No heartbeat from core client for 30 sec - exiting
21:35:56 (98788): No heartbeat from core client for 30 sec - exiting
21:35:57 (98788): No heartbeat from core client for 30 sec - exiting
21:35:58 (98788): No heartbeat from core client for 30 sec - exiting
21:35:59 (98788): No heartbeat from core client for 30 sec - exiting
21:36:00 (98788): No heartbeat from core client for 30 sec - exiting
21:36:01 (98788): No heartbeat from core client for 30 sec - exiting
21:36:02 (98788): No heartbeat from core client for 30 sec - exiting
21:36:03 (98788): No heartbeat from core client for 30 sec - exiting
21:36:04 (98788): No heartbeat from core client for 30 sec - exiting
21:37:55 (98788): No heartbeat from core client for 30 sec - exiting
21:37:56 (98788): No heartbeat from core client for 30 sec - exiting
21:37:57 (98788): No heartbeat from core client for 30 sec - exiting
21:37:58 (98788): No heartbeat from core client for 30 sec - exiting
21:37:59 (98788): No heartbeat from core client for 30 sec - exiting
21:38:00 (98788): No heartbeat from core client for 30 sec - exiting
21:38:01 (98788): No heartbeat from core client for 30 sec - exiting
21:38:02 (98788): No heartbeat from core client for 30 sec - exiting
21:38:03 (98788): No heartbeat from core client for 30 sec - exiting
21:38:04 (98788): No heartbeat from core client for 30 sec - exiting
21:38:05 (98788): No heartbeat from core client for 30 sec - exiting
21:38:06 (98788): No heartbeat from core client for 30 sec - exiting
21:38:07 (98788): No heartbeat from core client for 30 sec - exiting
21:38:08 (98788): No heartbeat from core client for 30 sec - exiting
21:38:09 (98788): No heartbeat from core client for 30 sec - exiting
21:38:10 (98788): No heartbeat from core client for 30 sec - exiting
21:38:11 (98788): No heartbeat from core client for 30 sec - exiting
21:38:12 (98788): No heartbeat from core client for 30 sec - exiting
21:38:13 (98788): No heartbeat from core client for 30 sec - exiting
21:38:14 (98788): No heartbeat from core client for 30 sec - exiting
21:38:15 (98788): No heartbeat from core client for 30 sec - exiting
21:38:16 (98788): No heartbeat from core client for 30 sec - exiting
21:38:17 (98788): No heartbeat from core client for 30 sec - exiting
21:38:18 (98788): No heartbeat from core client for 30 sec - exiting
21:38:19 (98788): No heartbeat from core client for 30 sec - exiting
21:38:20 (98788): No heartbeat from core client for 30 sec - exiting
21:38:21 (98788): No heartbeat from core client for 30 sec - exiting
21:38:22 (98788): No heartbeat from core client for 30 sec - exiting
21:38:23 (98788): No heartbeat from core client for 30 sec - exiting
21:38:24 (98788): No heartbeat from core client for 30 sec - exiting
21:41:31 (98788): No heartbeat from core client for 30 sec - exiting
21:41:32 (98788): No heartbeat from core client for 30 sec - exiting
21:41:33 (98788): No heartbeat from core client for 30 sec - exiting
21:41:34 (98788): No heartbeat from core client for 30 sec - exiting
21:41:35 (98788): No heartbeat from core client for 30 sec - exiting
21:41:36 (98788): No heartbeat from core client for 30 sec - exiting
21:41:37 (98788): No heartbeat from core client for 30 sec - exiting
21:41:38 (98788): No heartbeat from core client for 30 sec - exiting
21:41:39 (98788): No heartbeat from core client for 30 sec - exiting
21:41:40 (98788): No heartbeat from core client for 30 sec - exiting
21:41:41 (98788): No heartbeat from core client for 30 sec - exiting
21:41:42 (98788): No heartbeat from core client for 30 sec - exiting
21:41:43 (98788): No heartbeat from core client for 30 sec - exiting
21:41:44 (98788): No heartbeat from core client for 30 sec - exiting
21:41:45 (98788): No heartbeat from core client for 30 sec - exiting
21:41:46 (98788): No heartbeat from core client for 30 sec - exiting
21:41:47 (98788): No heartbeat from core client for 30 sec - exiting
21:41:48 (98788): No heartbeat from core client for 30 sec - exiting
21:41:49 (98788): No heartbeat from core client for 30 sec - exiting
21:41:50 (98788): No heartbeat from core client for 30 sec - exiting
21:41:51 (98788): No heartbeat from core client for 30 sec - exiting
21:41:52 (98788): No heartbeat from core client for 30 sec - exiting
21:41:53 (98788): No heartbeat from core client for 30 sec - exiting
21:41:54 (98788): No heartbeat from core client for 30 sec - exiting
21:41:55 (98788): No heartbeat from core client for 30 sec - exiting
21:41:56 (98788): No heartbeat from core client for 30 sec - exiting
21:41:57 (98788): No heartbeat from core client for 30 sec - exiting
21:41:58 (98788): No heartbeat from core client for 30 sec - exiting
21:41:59 (98788): No heartbeat from core client for 30 sec - exiting
21:42:00 (98788): No heartbeat from core client for 30 sec - exiting
21:43:51 (98788): No heartbeat from core client for 30 sec - exiting
21:43:52 (98788): No heartbeat from core client for 30 sec - exiting
21:43:53 (98788): No heartbeat from core client for 30 sec - exiting
21:43:54 (98788): No heartbeat from core client for 30 sec - exiting
21:43:55 (98788): No heartbeat from core client for 30 sec - exiting
21:43:56 (98788): No heartbeat from core client for 30 sec - exiting
21:43:57 (98788): No heartbeat from core client for 30 sec - exiting
21:43:58 (98788): No heartbeat from core client for 30 sec - exiting
21:43:59 (98788): No heartbeat from core client for 30 sec - exiting
21:44:00 (98788): No heartbeat from core client for 30 sec - exiting
21:44:01 (98788): No heartbeat from core client for 30 sec - exiting
21:44:02 (98788): No heartbeat from core client for 30 sec - exiting
21:44:03 (98788): No heartbeat from core client for 30 sec - exiting
21:44:04 (98788): No heartbeat from core client for 30 sec - exiting
21:44:05 (98788): No heartbeat from core client for 30 sec - exiting
21:44:06 (98788): No heartbeat from core client for 30 sec - exiting
21:44:07 (98788): No heartbeat from core client for 30 sec - exiting
21:44:08 (98788): No heartbeat from core client for 30 sec - exiting
21:44:09 (98788): No heartbeat from core client for 30 sec - exiting
21:44:10 (98788): No heartbeat from core client for 30 sec - exiting
21:44:11 (98788): No heartbeat from core client for 30 sec - exiting
21:44:12 (98788): No heartbeat from core client for 30 sec - exiting
21:44:13 (98788): No heartbeat from core client for 30 sec - exiting
21:44:14 (98788): No heartbeat from core client for 30 sec - exiting
21:44:15 (98788): No heartbeat from core client for 30 sec - exiting
21:44:16 (98788): No heartbeat from core client for 30 sec - exiting
21:44:17 (98788): No heartbeat from core client for 30 sec - exiting
21:44:18 (98788): No heartbeat from core client for 30 sec - exiting
21:44:19 (98788): No heartbeat from core client for 30 sec - exiting
21:44:20 (98788): No heartbeat from core client for 30 sec - exiting
21:47:28 (98788): No heartbeat from core client for 30 sec - exiting
21:47:29 (98788): No heartbeat from core client for 30 sec - exiting
21:47:30 (98788): No heartbeat from core client for 30 sec - exiting
21:47:31 (98788): No heartbeat from core client for 30 sec - exiting
21:47:32 (98788): No heartbeat from core client for 30 sec - exiting
21:47:33 (98788): No heartbeat from core client for 30 sec - exiting
21:47:34 (98788): No heartbeat from core client for 30 sec - exiting
21:47:35 (98788): No heartbeat from core client for 30 sec - exiting
21:47:36 (98788): No heartbeat from core client for 30 sec - exiting
21:47:37 (98788): No heartbeat from core client for 30 sec - exiting
21:47:38 (98788): No heartbeat from core client for 30 sec - exiting
21:47:39 (98788): No heartbeat from core client for 30 sec - exiting
21:47:40 (98788): No heartbeat from core client for 30 sec - exiting
21:47:41 (98788): No heartbeat from core client for 30 sec - exiting
21:47:42 (98788): No heartbeat from core client for 30 sec - exiting
21:47:43 (98788): No heartbeat from core client for 30 sec - exiting
21:47:44 (98788): No heartbeat from core client for 30 sec - exiting
21:47:45 (98788): No heartbeat from core client for 30 sec - exiting
21:47:46 (98788): No heartbeat from core client for 30 sec - exiting
21:47:47 (98788): No heartbeat from core client for 30 sec - exiting
21:47:48 (98788): No heartbeat from core client for 30 sec - exiting
21:47:49 (98788): No heartbeat from core client for 30 sec - exiting
21:47:50 (98788): No heartbeat from core client for 30 sec - exiting
21:47:51 (98788): No heartbeat from core client for 30 sec - exiting
21:47:52 (98788): No heartbeat from core client for 30 sec - exiting
21:47:53 (98788): No heartbeat from core client for 30 sec - exiting
21:47:54 (98788): No heartbeat from core client for 30 sec - exiting
21:47:55 (98788): No heartbeat from core client for 30 sec - exiting
21:47:56 (98788): No heartbeat from core client for 30 sec - exiting
21:47:57 (98788): No heartbeat from core client for 30 sec - exiting
21:49:48 (98788): No heartbeat from core client for 30 sec - exiting
21:49:49 (98788): No heartbeat from core client for 30 sec - exiting
21:49:50 (98788): No heartbeat from core client for 30 sec - exiting
21:49:51 (98788): No heartbeat from core client for 30 sec - exiting
21:49:52 (98788): No heartbeat from core client for 30 sec - exiting
21:49:53 (98788): No heartbeat from core client for 30 sec - exiting
21:49:54 (98788): No heartbeat from core client for 30 sec - exiting
21:49:55 (98788): No heartbeat from core client for 30 sec - exiting
21:49:56 (98788): No heartbeat from core client for 30 sec - exiting
21:49:57 (98788): No heartbeat from core client for 30 sec - exiting
21:49:58 (98788): No heartbeat from core client for 30 sec - exiting
21:49:59 (98788): No heartbeat from core client for 30 sec - exiting
21:50:00 (98788): No heartbeat from core client for 30 sec - exiting
21:50:01 (98788): No heartbeat from core client for 30 sec - exiting
21:50:02 (98788): No heartbeat from core client for 30 sec - exiting
21:50:03 (98788): No heartbeat from core client for 30 sec - exiting
21:50:04 (98788): No heartbeat from core client for 30 sec - exiting
21:50:05 (98788): No heartbeat from core client for 30 sec - exiting
21:50:06 (98788): No heartbeat from core client for 30 sec - exiting
21:50:07 (98788): No heartbeat from core client for 30 sec - exiting
21:50:08 (98788): No heartbeat from core client for 30 sec - exiting
21:50:09 (98788): No heartbeat from core client for 30 sec - exiting
21:50:10 (98788): No heartbeat from core client for 30 sec - exiting
21:50:11 (98788): No heartbeat from core client for 30 sec - exiting
21:50:12 (98788): No heartbeat from core client for 30 sec - exiting
21:50:13 (98788): No heartbeat from core client for 30 sec - exiting
21:50:14 (98788): No heartbeat from core client for 30 sec - exiting
21:50:15 (98788): No heartbeat from core client for 30 sec - exiting
21:50:16 (98788): No heartbeat from core client for 30 sec - exiting
21:50:17 (98788): No heartbeat from core client for 30 sec - exiting
21:53:24 (98788): No heartbeat from core client for 30 sec - exiting
21:53:25 (98788): No heartbeat from core client for 30 sec - exiting
21:53:26 (98788): No heartbeat from core client for 30 sec - exiting
21:53:27 (98788): No heartbeat from core client for 30 sec - exiting
21:53:28 (98788): No heartbeat from core client for 30 sec - exiting
21:53:29 (98788): No heartbeat from core client for 30 sec - exiting
21:53:30 (98788): No heartbeat from core client for 30 sec - exiting
21:53:31 (98788): No heartbeat from core client for 30 sec - exiting
21:53:32 (98788): No heartbeat from core client for 30 sec - exiting
21:53:33 (98788): No heartbeat from core client for 30 sec - exiting
21:53:34 (98788): No heartbeat from core client for 30 sec - exiting
21:53:35 (98788): No heartbeat from core client for 30 sec - exiting
21:53:36 (98788): No heartbeat from core client for 30 sec - exiting
21:53:37 (98788): No heartbeat from core client for 30 sec - exiting
21:53:38 (98788): No heartbeat from core client for 30 sec - exiting
21:53:39 (98788): No heartbeat from core client for 30 sec - exiting
21:53:40 (98788): No heartbeat from core client for 30 sec - exiting
21:53:41 (98788): No heartbeat from core client for 30 sec - exiting
21:53:42 (98788): No heartbeat from core client for 30 sec - exiting
21:53:43 (98788): No heartbeat from core client for 30 sec - exiting
21:53:44 (98788): No heartbeat from core client for 30 sec - exiting
21:53:45 (98788): No heartbeat from core client for 30 sec - exiting
21:53:46 (98788): No heartbeat from core client for 30 sec - exiting
21:53:47 (98788): No heartbeat from core client for 30 sec - exiting
21:53:48 (98788): No heartbeat from core client for 30 sec - exiting
21:53:49 (98788): No heartbeat from core client for 30 sec - exiting
21:53:50 (98788): No heartbeat from core client for 30 sec - exiting
21:53:51 (98788): No heartbeat from core client for 30 sec - exiting
21:53:52 (98788): No heartbeat from core client for 30 sec - exiting
21:53:53 (98788): No heartbeat from core client for 30 sec - exiting
21:55:46 (98788): No heartbeat from core client for 30 sec - exiting
21:55:47 (98788): No heartbeat from core client for 30 sec - exiting
21:55:48 (98788): No heartbeat from core client for 30 sec - exiting
21:55:49 (98788): No heartbeat from core client for 30 sec - exiting
21:55:50 (98788): No heartbeat from core client for 30 sec - exiting
21:55:51 (98788): No heartbeat from core client for 30 sec - exiting
21:55:52 (98788): No heartbeat from core client for 30 sec - exiting
21:55:53 (98788): No heartbeat from core client for 30 sec - exiting
21:55:54 (98788): No heartbeat from core client for 30 sec - exiting
21:55:55 (98788): No heartbeat from core client for 30 sec - exiting
21:55:56 (98788): No heartbeat from core client for 30 sec - exiting
21:55:57 (98788): No heartbeat from core client for 30 sec - exiting
21:55:58 (98788): No heartbeat from core client for 30 sec - exiting
21:55:59 (98788): No heartbeat from core client for 30 sec - exiting
21:56:00 (98788): No heartbeat from core client for 30 sec - exiting
21:56:01 (98788): No heartbeat from core client for 30 sec - exiting
21:56:02 (98788): No heartbeat from core client for 30 sec - exiting
21:56:03 (98788): No heartbeat from core client for 30 sec - exiting
21:56:04 (98788): No heartbeat from core client for 30 sec - exiting
21:56:05 (98788): No heartbeat from core client for 30 sec - exiting
21:56:06 (98788): No heartbeat from core client for 30 sec - exiting
21:56:07 (98788): No heartbeat from core client for 30 sec - exiting
21:56:08 (98788): No heartbeat from core client for 30 sec - exiting
21:56:09 (98788): No heartbeat from core client for 30 sec - exiting
21:56:10 (98788): No heartbeat from core client for 30 sec - exiting
21:56:11 (98788): No heartbeat from core client for 30 sec - exiting
21:56:12 (98788): No heartbeat from core client for 30 sec - exiting
21:56:13 (98788): No heartbeat from core client for 30 sec - exiting
21:56:14 (98788): No heartbeat from core client for 30 sec - exiting
21:59:22 (98788): No heartbeat from core client for 30 sec - exiting
21:59:23 (98788): No heartbeat from core client for 30 sec - exiting
21:59:24 (98788): No heartbeat from core client for 30 sec - exiting
21:59:25 (98788): No heartbeat from core client for 30 sec - exiting
21:59:26 (98788): No heartbeat from core client for 30 sec - exiting
21:59:27 (98788): No heartbeat from core client for 30 sec - exiting
21:59:28 (98788): No heartbeat from core client for 30 sec - exiting
21:59:29 (98788): No heartbeat from core client for 30 sec - exiting
21:59:30 (98788): No heartbeat from core client for 30 sec - exiting
21:59:31 (98788): No heartbeat from core client for 30 sec - exiting
21:59:32 (98788): No heartbeat from core client for 30 sec - exiting
21:59:33 (98788): No heartbeat from core client for 30 sec - exiting
21:59:34 (98788): No heartbeat from core client for 30 sec - exiting
21:59:35 (98788): No heartbeat from core client for 30 sec - exiting
21:59:36 (98788): No heartbeat from core client for 30 sec - exiting
21:59:37 (98788): No heartbeat from core client for 30 sec - exiting
21:59:38 (98788): No heartbeat from core client for 30 sec - exiting
21:59:39 (98788): No heartbeat from core client for 30 sec - exiting
21:59:40 (98788): No heartbeat from core client for 30 sec - exiting
21:59:41 (98788): No heartbeat from core client for 30 sec - exiting
21:59:42 (98788): No heartbeat from core client for 30 sec - exiting
21:59:43 (98788): No heartbeat from core client for 30 sec - exiting
21:59:44 (98788): No heartbeat from core client for 30 sec - exiting
21:59:45 (98788): No heartbeat from core client for 30 sec - exiting
21:59:46 (98788): No heartbeat from core client for 30 sec - exiting
21:59:47 (98788): No heartbeat from core client for 30 sec - exiting
21:59:48 (98788): No heartbeat from core client for 30 sec - exiting
21:59:49 (98788): No heartbeat from core client for 30 sec - exiting
21:59:50 (98788): No heartbeat from core client for 30 sec - exiting
21:59:51 (98788): No heartbeat from core client for 30 sec - exiting
22:01:42 (98788): No heartbeat from core client for 30 sec - exiting
22:01:43 (98788): No heartbeat from core client for 30 sec - exiting
22:01:44 (98788): No heartbeat from core client for 30 sec - exiting
22:01:45 (98788): No heartbeat from core client for 30 sec - exiting
22:01:46 (98788): No heartbeat from core client for 30 sec - exiting
22:01:47 (98788): No heartbeat from core client for 30 sec - exiting
22:01:48 (98788): No heartbeat from core client for 30 sec - exiting
22:01:49 (98788): No heartbeat from core client for 30 sec - exiting
22:01:50 (98788): No heartbeat from core client for 30 sec - exiting
22:01:51 (98788): No heartbeat from core client for 30 sec - exiting
22:01:52 (98788): No heartbeat from core client for 30 sec - exiting
22:01:53 (98788): No heartbeat from core client for 30 sec - exiting
22:01:54 (98788): No heartbeat from core client for 30 sec - exiting
22:01:55 (98788): No heartbeat from core client for 30 sec - exiting
22:01:56 (98788): No heartbeat from core client for 30 sec - exiting
22:01:57 (98788): No heartbeat from core client for 30 sec - exiting
22:01:58 (98788): No heartbeat from core client for 30 sec - exiting
22:01:59 (98788): No heartbeat from core client for 30 sec - exiting
22:02:00 (98788): No heartbeat from core client for 30 sec - exiting
22:02:01 (98788): No heartbeat from core client for 30 sec - exiting
22:02:02 (98788): No heartbeat from core client for 30 sec - exiting
22:02:03 (98788): No heartbeat from core client for 30 sec - exiting
22:02:04 (98788): No heartbeat from core client for 30 sec - exiting
22:02:05 (98788): No heartbeat from core client for 30 sec - exiting
22:02:06 (98788): No heartbeat from core client for 30 sec - exiting
22:02:07 (98788): No heartbeat from core client for 30 sec - exiting
22:02:08 (98788): No heartbeat from core client for 30 sec - exiting
22:02:09 (98788): No heartbeat from core client for 30 sec - exiting
22:02:10 (98788): No heartbeat from core client for 30 sec - exiting
22:02:11 (98788): No heartbeat from core client for 30 sec - exiting
22:05:18 (98788): No heartbeat from core client for 30 sec - exiting
22:05:19 (98788): No heartbeat from core client for 30 sec - exiting
22:05:20 (98788): No heartbeat from core client for 30 sec - exiting
22:05:21 (98788): No heartbeat from core client for 30 sec - exiting
22:05:22 (98788): No heartbeat from core client for 30 sec - exiting
22:05:23 (98788): No heartbeat from core client for 30 sec - exiting
22:05:24 (98788): No heartbeat from core client for 30 sec - exiting
22:05:25 (98788): No heartbeat from core client for 30 sec - exiting
22:05:26 (98788): No heartbeat from core client for 30 sec - exiting
22:05:27 (98788): No heartbeat from core client for 30 sec - exiting
22:05:28 (98788): No heartbeat from core client for 30 sec - exiting
22:05:29 (98788): No heartbeat from core client for 30 sec - exiting
22:05:30 (98788): No heartbeat from core client for 30 sec - exiting
22:05:31 (98788): No heartbeat from core client for 30 sec - exiting
22:05:32 (98788): No heartbeat from core client for 30 sec - exiting
22:05:33 (98788): No heartbeat from core client for 30 sec - exiting
22:05:34 (98788): No heartbeat from core client for 30 sec - exiting
22:05:35 (98788): No heartbeat from core client for 30 sec - exiting
22:05:36 (98788): No heartbeat from core client for 30 sec - exiting
22:05:37 (98788): No heartbeat from core client for 30 sec - exiting
22:05:38 (98788): No heartbeat from core client for 30 sec - exiting
22:05:39 (98788): No heartbeat from core client for 30 sec - exiting
22:05:40 (98788): No heartbeat from core client for 30 sec - exiting
22:05:41 (98788): No heartbeat from core client for 30 sec - exiting
22:05:42 (98788): No heartbeat from core client for 30 sec - exiting
22:05:43 (98788): No heartbeat from core client for 30 sec - exiting
22:05:44 (98788): No heartbeat from core client for 30 sec - exiting
22:05:45 (98788): No heartbeat from core client for 30 sec - exiting
22:05:46 (98788): No heartbeat from core client for 30 sec - exiting
22:05:47 (98788): No heartbeat from core client for 30 sec - exiting
22:07:39 (98788): No heartbeat from core client for 30 sec - exiting
22:07:40 (98788): No heartbeat from core client for 30 sec - exiting
22:07:41 (98788): No heartbeat from core client for 30 sec - exiting
22:07:42 (98788): No heartbeat from core client for 30 sec - exiting
22:07:43 (98788): No heartbeat from core client for 30 sec - exiting
22:07:44 (98788): No heartbeat from core client for 30 sec - exiting
22:07:45 (98788): No heartbeat from core client for 30 sec - exiting
22:07:46 (98788): No heartbeat from core client for 30 sec - exiting
22:07:47 (98788): No heartbeat from core client for 30 sec - exiting
22:07:48 (98788): No heartbeat from core client for 30 sec - exiting
22:07:49 (98788): No heartbeat from core client for 30 sec - exiting
22:07:50 (98788): No heartbeat from core client for 30 sec - exiting
22:07:51 (98788): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(99426,0xa041a540) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99426,0xa041a540) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99426,0xa041a540) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99426,0xa041a540) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99426,0xa041a540) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99426,0xa041a540) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99426,0xa041a540) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99426,0xa041a540) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99426,0xa041a540) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(2291,0xa041a540) malloc: *** error for object 0x1838604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2291,0xa041a540) malloc: *** error for object 0x1028604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(3097,0xa041a540) malloc: *** error for object 0x850604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3097,0xa041a540) malloc: *** error for object 0x2820604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x844604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18328,0xa041a540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135765) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=1
Model crash detected, will try to restart...
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135765) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=1
Model crash detected, will try to restart...
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135765) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=1
Model crash detected, will try to restart...
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135765) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=1
Model crash detected, will try to restart...
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135765) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=1
Model crash detected, will try to restart...
execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 135765) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Jul 2011 19:52:00 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 751,680 704,905 0.9378
25 Jul 2011 19:21:48 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 725,760 680,922 0.9382
25 Jul 2011 19:21:46 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 699,840 657,043 0.9388
25 Jul 2011 19:05:01 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 673,920 632,955 0.9392
25 Jul 2011 18:59:24 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 648,000 608,967 0.9398
25 Jul 2011 18:21:07 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 622,080 584,892 0.9402
25 Jul 2011 18:00:24 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 596,160 560,800 0.9407
25 Jul 2011 17:36:22 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 570,240 536,798 0.9414
25 Jul 2011 16:48:14 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 544,320 512,685 0.9419
08 Jul 2011 14:40:04 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 518,400 488,299 0.9419
08 Jul 2011 03:06:43 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 492,480 463,799 0.9418
07 Jul 2011 19:07:51 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 466,560 439,911 0.9429
07 Jul 2011 17:49:07 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 440,640 415,595 0.9432
07 Jul 2011 17:49:07 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 414,720 391,127 0.9431
07 Jul 2011 17:49:06 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 388,800 366,739 0.9433
07 Jul 2011 17:49:05 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 362,880 342,367 0.9435
07 Jul 2011 17:49:04 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 336,960 317,789 0.9431
04 Jul 2011 20:16:59 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 311,040 293,283 0.9429
04 Jul 2011 12:46:35 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 285,120 268,799 0.9428
04 Jul 2011 05:11:11 1153671 13023108 hadcm3n_t3dj_1940_40_007315119_0 259,200 244,269 0.9424


©2024 cpdn.org