climateprediction.net home page
Task 14648703

Task 14648703

Name hadcm3n_102s_1980_40_007957233_2
Workunit 8112345
Created 9 May 2012, 13:23:31 UTC
Sent 9 May 2012, 18:50:29 UTC
Report deadline 9 Aug 2012, 2:17:40 UTC
Received 15 May 2012, 12:57:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1212789
Run time 5 days 5 hours 4 min 27 sec
CPU time 5 days 0 hours 18 min 17 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.36 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.0.25</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
ore client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:33:03 (54795): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:36:33 (54839): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:39:51 (54877): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:42:53 (54900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:46:29 (54941): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:50:18 (54966): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:53:38 (55006): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:56:48 (55035): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:00:41 (55064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:04:26 (55105): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:08:11 (55136): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:11:41 (55174): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:15:45 (55207): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:18:47 (55241): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:22:43 (55281): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:26:03 (55312): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:29:50 (55348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:33:09 (55382): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:36:20 (55411): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:39:55 (55440): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:43:06 (55479): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:47:05 (55516): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:50:59 (55543): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:54:53 (55584): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:58:42 (55630): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:02:34 (55656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:05:59 (55698): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:09:10 (55734): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:12:38 (55757): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:16:07 (55795): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:19:30 (55822): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:23:08 (55859): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:26:37 (55888): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:30:06 (55924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:33:27 (55954): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:37:15 (55990): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:41:16 (56031): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:44:34 (56061): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:47:52 (56096): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:51:32 (56124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:55:36 (56163): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:59:27 (56205): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:03:06 (56232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:06:54 (56271): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:10:38 (56314): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:14:30 (56340): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:18:17 (56381): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:21:55 (56422): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:25:50 (56449): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:29:12 (56493): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:33:03 (56519): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:36:54 (56559): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:40:45 (56601): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:43:49 (56630): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:47:16 (56669): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:51:12 (56693): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:54:34 (56734): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x86fc04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x86fc00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1026a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(56770,0xa02bb540) malloc: *** error for object 0x1042000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
13:58:00 (56770): No heartbeat from core client for 30 sec - exiting
13:58:01 (56770): No heartbeat from core client for 30 sec - exiting
13:58:02 (56770): No heartbeat from core client for 30 sec - exiting
13:58:03 (56770): No heartbeat from core client for 30 sec - exiting
13:58:04 (56770): No heartbeat from core client for 30 sec - exiting
13:58:05 (56770): No heartbeat from core client for 30 sec - exiting
13:58:06 (56770): No heartbeat from core client for 30 sec - exiting
13:58:07 (56770): No heartbeat from core client for 30 sec - exiting
13:58:08 (56770): No heartbeat from core client for 30 sec - exiting
13:58:09 (56770): No heartbeat from core client for 30 sec - exiting
13:58:10 (56770): No heartbeat from core client for 30 sec - exiting
13:58:11 (56770): No heartbeat from core client for 30 sec - exiting
13:58:12 (56770): No heartbeat from core client for 30 sec - exiting
13:58:13 (56770): No heartbeat from core client for 30 sec - exiting
13:58:14 (56770): No heartbeat from core client for 30 sec - exiting
13:58:15 (56770): No heartbeat from core client for 30 sec - exiting
13:58:16 (56770): No heartbeat from core client for 30 sec - exiting
13:58:17 (56770): No heartbeat from core client for 30 sec - exiting
13:58:18 (56770): No heartbeat from core client for 30 sec - exiting
13:58:19 (56770): No heartbeat from core client for 30 sec - exiting
13:58:20 (56770): No heartbeat from core client for 30 sec - exiting
13:58:21 (56770): No heartbeat from core client for 30 sec - exiting
13:58:22 (56770): No heartbeat from core client for 30 sec - exiting
13:58:23 (56770): No heartbeat from core client for 30 sec - exiting
13:58:24 (56770): No heartbeat from core client for 30 sec - exiting
13:58:25 (56770): No heartbeat from core client for 30 sec - exiting
13:58:26 (56770): No heartbeat from core client for 30 sec - exiting
13:58:27 (56770): No heartbeat from core client for 30 sec - exiting
13:58:28 (56770): No heartbeat from core client for 30 sec - exiting
13:58:29 (56770): No heartbeat from core client for 30 sec - exiting
14:01:23 (56770): No heartbeat from core client for 30 sec - exiting
14:01:24 (56770): No heartbeat from core client for 30 sec - exiting
14:01:25 (56770): No heartbeat from core client for 30 sec - exiting
14:01:26 (56770): No heartbeat from core client for 30 sec - exiting
14:01:27 (56770): No heartbeat from core client for 30 sec - exiting
14:01:28 (56770): No heartbeat from core client for 30 sec - exiting
14:01:29 (56770): No heartbeat from core client for 30 sec - exiting
14:01:30 (56770): No heartbeat from core client for 30 sec - exiting
14:01:31 (56770): No heartbeat from core client for 30 sec - exiting
14:01:32 (56770): No heartbeat from core client for 30 sec - exiting
14:01:33 (56770): No heartbeat from core client for 30 sec - exiting
14:01:34 (56770): No heartbeat from core client for 30 sec - exiting
14:01:35 (56770): No heartbeat from core client for 30 sec - exiting
14:01:36 (56770): No heartbeat from core client for 30 sec - exiting
14:01:37 (56770): No heartbeat from core client for 30 sec - exiting
14:01:38 (56770): No heartbeat from core client for 30 sec - exiting
14:01:39 (56770): No heartbeat from core client for 30 sec - exiting
14:01:40 (56770): No heartbeat from core client for 30 sec - exiting
14:01:41 (56770): No heartbeat from core client for 30 sec - exiting
14:01:42 (56770): No heartbeat from core client for 30 sec - exiting
14:01:44 (56770): No heartbeat from core client for 30 sec - exiting
14:01:45 (56770): No heartbeat from core client for 30 sec - exiting
14:01:46 (56770): No heartbeat from core client for 30 sec - exiting
14:01:47 (56770): No heartbeat from core client for 30 sec - exiting
14:01:48 (56770): No heartbeat from core client for 30 sec - exiting
14:01:49 (56770): No heartbeat from core client for 30 sec - exiting
14:01:50 (56770): No heartbeat from core client for 30 sec - exiting
14:01:51 (56770): No heartbeat from core client for 30 sec - exiting
14:01:52 (56770): No heartbeat from core client for 30 sec - exiting
14:01:53 (56770): No heartbeat from core client for 30 sec - exiting
14:04:37 (56770): No heartbeat from core client for 30 sec - exiting
14:04:38 (56770): No heartbeat from core client for 30 sec - exiting
14:04:39 (56770): No heartbeat from core client for 30 sec - exiting
14:04:40 (56770): No heartbeat from core client for 30 sec - exiting
14:04:41 (56770): No heartbeat from core client for 30 sec - exiting
14:04:42 (56770): No heartbeat from core client for 30 sec - exiting
14:04:43 (56770): No heartbeat from core client for 30 sec - exiting
14:04:44 (56770): No heartbeat from core client for 30 sec - exiting
14:04:45 (56770): No heartbeat from core client for 30 sec - exiting
14:04:46 (56770): No heartbeat from core client for 30 sec - exiting
14:04:47 (56770): No heartbeat from core client for 30 sec - exiting
14:04:48 (56770): No heartbeat from core client for 30 sec - exiting
14:04:49 (56770): No heartbeat from core client for 30 sec - exiting
14:04:50 (56770): No heartbeat from core client for 30 sec - exiting
14:04:51 (56770): No heartbeat from core client for 30 sec - exiting
14:04:52 (56770): No heartbeat from core client for 30 sec - exiting
14:04:53 (56770): No heartbeat from core client for 30 sec - exiting
14:04:54 (56770): No heartbeat from core client for 30 sec - exiting
14:04:55 (56770): No heartbeat from core client for 30 sec - exiting
14:04:56 (56770): No heartbeat from core client for 30 sec - exiting
14:04:57 (56770): No heartbeat from core client for 30 sec - exiting
14:04:58 (56770): No heartbeat from core client for 30 sec - exiting
14:04:59 (56770): No heartbeat from core client for 30 sec - exiting
14:05:00 (56770): No heartbeat from core client for 30 sec - exiting
14:05:01 (56770): No heartbeat from core client for 30 sec - exiting
14:05:02 (56770): No heartbeat from core client for 30 sec - exiting
14:05:03 (56770): No heartbeat from core client for 30 sec - exiting
14:05:04 (56770): No heartbeat from core client for 30 sec - exiting
14:05:05 (56770): No heartbeat from core client for 30 sec - exiting
14:05:06 (56770): No heartbeat from core client for 30 sec - exiting
14:08:37 (56770): No heartbeat from core client for 30 sec - exiting
14:08:38 (56770): No heartbeat from core client for 30 sec - exiting
14:08:39 (56770): No heartbeat from core client for 30 sec - exiting
14:08:40 (56770): No heartbeat from core client for 30 sec - exiting
14:08:41 (56770): No heartbeat from core client for 30 sec - exiting
14:08:42 (56770): No heartbeat from core client for 30 sec - exiting
14:08:43 (56770): No heartbeat from core client for 30 sec - exiting
14:08:44 (56770): No heartbeat from core client for 30 sec - exiting
14:08:45 (56770): No heartbeat from core client for 30 sec - exiting
14:08:46 (56770): No heartbeat from core client for 30 sec - exiting
14:08:47 (56770): No heartbeat from core client for 30 sec - exiting
14:08:48 (56770): No heartbeat from core client for 30 sec - exiting
14:08:49 (56770): No heartbeat from core client for 30 sec - exiting
14:08:50 (56770): No heartbeat from core client for 30 sec - exiting
14:08:51 (56770): No heartbeat from core client for 30 sec - exiting
14:08:52 (56770): No heartbeat from core client for 30 sec - exiting
14:08:53 (56770): No heartbeat from core client for 30 sec - exiting
14:08:54 (56770): No heartbeat from core client for 30 sec - exiting
14:08:55 (56770): No heartbeat from core client for 30 sec - exiting
14:08:56 (56770): No heartbeat from core client for 30 sec - exiting
14:08:57 (56770): No heartbeat from core client for 30 sec - exiting
14:08:58 (56770): No heartbeat from core client for 30 sec - exiting
14:08:59 (56770): No heartbeat from core client for 30 sec - exiting
14:09:00 (56770): No heartbeat from core client for 30 sec - exiting
14:09:01 (56770): No heartbeat from core client for 30 sec - exiting
14:09:02 (56770): No heartbeat from core client for 30 sec - exiting
14:09:03 (56770): No heartbeat from core client for 30 sec - exiting
14:09:04 (56770): No heartbeat from core client for 30 sec - exiting
14:09:05 (56770): No heartbeat from core client for 30 sec - exiting
14:09:06 (56770): No heartbeat from core client for 30 sec - exiting
14:12:32 (56770): No heartbeat from core client for 30 sec - exiting
14:12:33 (56770): No heartbeat from core client for 30 sec - exiting
14:12:34 (56770): No heartbeat from core client for 30 sec - exiting
14:12:35 (56770): No heartbeat from core client for 30 sec - exiting
14:12:36 (56770): No heartbeat from core client for 30 sec - exiting
14:12:37 (56770): No heartbeat from core client for 30 sec - exiting
14:12:38 (56770): No heartbeat from core client for 30 sec - exiting
14:12:39 (56770): No heartbeat from core client for 30 sec - exiting
14:12:40 (56770): No heartbeat from core client for 30 sec - exiting
14:12:41 (56770): No heartbeat from core client for 30 sec - exiting
14:12:42 (56770): No heartbeat from core client for 30 sec - exiting
14:12:43 (56770): No heartbeat from core client for 30 sec - exiting
14:12:44 (56770): No heartbeat from core client for 30 sec - exiting
14:12:45 (56770): No heartbeat from core client for 30 sec - exiting
14:12:46 (56770): No heartbeat from core client for 30 sec - exiting
14:12:47 (56770): No heartbeat from core client for 30 sec - exiting
14:12:48 (56770): No heartbeat from core client for 30 sec - exiting
14:12:49 (56770): No heartbeat from core client for 30 sec - exiting
14:12:50 (56770): No heartbeat from core client for 30 sec - exiting
14:12:51 (56770): No heartbeat from core client for 30 sec - exiting
14:12:52 (56770): No heartbeat from core client for 30 sec - exiting
14:12:53 (56770): No heartbeat from core client for 30 sec - exiting
14:12:54 (56770): No heartbeat from core client for 30 sec - exiting
14:12:55 (56770): No heartbeat from core client for 30 sec - exiting
14:12:56 (56770): No heartbeat from core client for 30 sec - exiting
14:12:57 (56770): No heartbeat from core client for 30 sec - exiting
14:12:58 (56770): No heartbeat from core client for 30 sec - exiting
14:12:59 (56770): No heartbeat from core client for 30 sec - exiting
14:13:00 (56770): No heartbeat from core client for 30 sec - exiting
14:15:39 (56770): No heartbeat from core client for 30 sec - exiting
14:15:40 (56770): No heartbeat from core client for 30 sec - exiting
14:15:41 (56770): No heartbeat from core client for 30 sec - exiting
14:15:42 (56770): No heartbeat from core client for 30 sec - exiting
14:15:43 (56770): No heartbeat from core client for 30 sec - exiting
14:15:44 (56770): No heartbeat from core client for 30 sec - exiting
14:15:45 (56770): No heartbeat from core client for 30 sec - exiting
14:15:46 (56770): No heartbeat from core client for 30 sec - exiting
14:15:47 (56770): No heartbeat from core client for 30 sec - exiting
14:15:48 (56770): No heartbeat from core client for 30 sec - exiting
14:15:49 (56770): No heartbeat from core client for 30 sec - exiting
14:15:50 (56770): No heartbeat from core client for 30 sec - exiting
14:15:51 (56770): No heartbeat from core client for 30 sec - exiting
14:15:52 (56770): No heartbeat from core client for 30 sec - exiting
14:15:53 (56770): No heartbeat from core client for 30 sec - exiting
14:15:54 (56770): No heartbeat from core client for 30 sec - exiting
14:15:55 (56770): No heartbeat from core client for 30 sec - exiting
14:15:56 (56770): No heartbeat from core client for 30 sec - exiting
14:15:57 (56770): No heartbeat from core client for 30 sec - exiting
14:15:58 (56770): No heartbeat from core client for 30 sec - exiting
14:15:59 (56770): No heartbeat from core client for 30 sec - exiting
14:16:00 (56770): No heartbeat from core client for 30 sec - exiting
14:16:01 (56770): No heartbeat from core client for 30 sec - exiting
14:16:02 (56770): No heartbeat from core client for 30 sec - exiting
14:16:03 (56770): No heartbeat from core client for 30 sec - exiting
14:16:04 (56770): No heartbeat from core client for 30 sec - exiting
14:16:05 (56770): No heartbeat from core client for 30 sec - exiting
14:16:06 (56770): No heartbeat from core client for 30 sec - exiting
14:16:07 (56770): No heartbeat from core client for 30 sec - exiting
14:19:36 (56770): No heartbeat from core client for 30 sec - exiting
14:19:37 (56770): No heartbeat from core client for 30 sec - exiting
14:19:38 (56770): No heartbeat from core client for 30 sec - exiting
14:19:39 (56770): No heartbeat from core client for 30 sec - exiting
14:19:40 (56770): No heartbeat from core client for 30 sec - exiting
14:19:41 (56770): No heartbeat from core client for 30 sec - exiting
14:19:42 (56770): No heartbeat from core client for 30 sec - exiting
14:19:43 (56770): No heartbeat from core client for 30 sec - exiting
14:19:44 (56770): No heartbeat from core client for 30 sec - exiting
14:19:45 (56770): No heartbeat from core client for 30 sec - exiting
14:19:46 (56770): No heartbeat from core client for 30 sec - exiting
14:19:47 (56770): No heartbeat from core client for 30 sec - exiting
14:19:48 (56770): No heartbeat from core client for 30 sec - exiting
14:19:49 (56770): No heartbeat from core client for 30 sec - exiting
14:19:50 (56770): No heartbeat from core client for 30 sec - exiting
14:19:51 (56770): No heartbeat from core client for 30 sec - exiting
14:19:52 (56770): No heartbeat from core client for 30 sec - exiting
14:19:53 (56770): No heartbeat from core client for 30 sec - exiting
14:19:54 (56770): No heartbeat from core client for 30 sec - exiting
14:19:55 (56770): No heartbeat from core client for 30 sec - exiting
14:19:56 (56770): No heartbeat from core client for 30 sec - exiting
14:19:57 (56770): No heartbeat from core client for 30 sec - exiting
14:19:58 (56770): No heartbeat from core client for 30 sec - exiting
14:19:59 (56770): No heartbeat from core client for 30 sec - exiting
14:20:00 (56770): No heartbeat from core client for 30 sec - exiting
14:20:01 (56770): No heartbeat from core client for 30 sec - exiting
14:20:02 (56770): No heartbeat from core client for 30 sec - exiting
14:20:03 (56770): No heartbeat from core client for 30 sec - exiting
14:20:04 (56770): No heartbeat from core client for 30 sec - exiting
14:20:05 (56770): No heartbeat from core client for 30 sec - exiting
14:23:09 (56770): No heartbeat from core client for 30 sec - exiting
14:23:10 (56770): No heartbeat from core client for 30 sec - exiting
14:23:11 (56770): No heartbeat from core client for 30 sec - exiting
14:23:12 (56770): No heartbeat from core client for 30 sec - exiting
14:23:13 (56770): No heartbeat from core client for 30 sec - exiting
14:23:14 (56770): No heartbeat from core client for 30 sec - exiting
14:23:15 (56770): No heartbeat from core client for 30 sec - exiting
14:23:16 (56770): No heartbeat from core client for 30 sec - exiting
14:23:17 (56770): No heartbeat from core client for 30 sec - exiting
14:23:18 (56770): No heartbeat from core client for 30 sec - exiting
14:23:19 (56770): No heartbeat from core client for 30 sec - exiting
14:23:20 (56770): No heartbeat from core client for 30 sec - exiting
14:23:21 (56770): No heartbeat from core client for 30 sec - exiting
14:23:22 (56770): No heartbeat from core client for 30 sec - exiting
14:23:23 (56770): No heartbeat from core client for 30 sec - exiting
14:23:24 (56770): No heartbeat from core client for 30 sec - exiting
14:23:25 (56770): No heartbeat from core client for 30 sec - exiting
14:23:26 (56770): No heartbeat from core client for 30 sec - exiting
14:23:27 (56770): No heartbeat from core client for 30 sec - exiting
14:23:28 (56770): No heartbeat from core client for 30 sec - exiting
14:23:29 (56770): No heartbeat from core client for 30 sec - exiting
14:23:30 (56770): No heartbeat from core client for 30 sec - exiting
14:23:31 (56770): No heartbeat from core client for 30 sec - exiting
14:23:32 (56770): No heartbeat from core client for 30 sec - exiting
14:23:33 (56770): No heartbeat from core client for 30 sec - exiting
14:23:34 (56770): No heartbeat from core client for 30 sec - exiting
14:23:35 (56770): No heartbeat from core client for 30 sec - exiting
14:23:36 (56770): No heartbeat from core client for 30 sec - exiting
14:23:37 (56770): No heartbeat from core client for 30 sec - exiting
14:23:38 (56770): No heartbeat from core client for 30 sec - exiting
14:26:48 (56770): No heartbeat from core client for 30 sec - exiting
14:26:49 (56770): No heartbeat from core client for 30 sec - exiting
14:26:50 (56770): No heartbeat from core client for 30 sec - exiting
14:26:51 (56770): No heartbeat from core client for 30 sec - exiting
14:26:52 (56770): No heartbeat from core client for 30 sec - exiting
14:26:53 (56770): No heartbeat from core client for 30 sec - exiting
14:26:54 (56770): No heartbeat from core client for 30 sec - exiting
14:26:55 (56770): No heartbeat from core client for 30 sec - exiting
14:26:56 (56770): No heartbeat from core client for 30 sec - exiting
14:26:57 (56770): No heartbeat from core client for 30 sec - exiting
14:26:58 (56770): No heartbeat from core client for 30 sec - exiting
14:26:59 (56770): No heartbeat from core client for 30 sec - exiting
14:27:00 (56770): No heartbeat from core client for 30 sec - exiting
14:27:01 (56770): No heartbeat from core client for 30 sec - exiting
14:27:02 (56770): No heartbeat from core client for 30 sec - exiting
14:27:03 (56770): No heartbeat from core client for 30 sec - exiting
14:27:04 (56770): No heartbeat from core client for 30 sec - exiting
14:27:05 (56770): No heartbeat from core client for 30 sec - exiting
14:27:06 (56770): No heartbeat from core client for 30 sec - exiting
14:27:07 (56770): No heartbeat from core client for 30 sec - exiting
14:27:08 (56770): No heartbeat from core client for 30 sec - exiting
14:27:09 (56770): No heartbeat from core client for 30 sec - exiting
14:27:10 (56770): No heartbeat from core client for 30 sec - exiting
14:27:11 (56770): No heartbeat from core client for 30 sec - exiting
14:27:12 (56770): No heartbeat from core client for 30 sec - exiting
14:27:13 (56770): No heartbeat from core client for 30 sec - exiting
14:27:14 (56770): No heartbeat from core client for 30 sec - exiting
14:27:15 (56770): No heartbeat from core client for 30 sec - exiting
14:27:16 (56770): No heartbeat from core client for 30 sec - exiting
14:27:17 (56770): No heartbeat from core client for 30 sec - exiting
14:30:23 (56770): No heartbeat from core client for 30 sec - exiting
14:30:24 (56770): No heartbeat from core client for 30 sec - exiting
14:30:25 (56770): No heartbeat from core client for 30 sec - exiting
14:30:26 (56770): No heartbeat from core client for 30 sec - exiting
14:30:27 (56770): No heartbeat from core client for 30 sec - exiting
14:30:28 (56770): No heartbeat from core client for 30 sec - exiting
14:30:29 (56770): No heartbeat from core client for 30 sec - exiting
14:30:30 (56770): No heartbeat from core client for 30 sec - exiting
14:30:31 (56770): No heartbeat from core client for 30 sec - exiting
14:30:32 (56770): No heartbeat from core client for 30 sec - exiting
14:30:33 (56770): No heartbeat from core client for 30 sec - exiting
14:30:34 (56770): No heartbeat from core client for 30 sec - exiting
14:30:35 (56770): No heartbeat from core client for 30 sec - exiting
14:30:36 (56770): No heartbeat from core client for 30 sec - exiting
14:30:37 (56770): No heartbeat from core client for 30 sec - exiting
14:30:38 (56770): No heartbeat from core client for 30 sec - exiting
14:30:39 (56770): No heartbeat from core client for 30 sec - exiting
14:30:40 (56770): No heartbeat from core client for 30 sec - exiting
14:30:41 (56770): No heartbeat from core client for 30 sec - exiting
14:30:42 (56770): No heartbeat from core client for 30 sec - exiting
14:30:43 (56770): No heartbeat from core client for 30 sec - exiting
14:30:44 (56770): No heartbeat from core client for 30 sec - exiting
14:30:45 (56770): No heartbeat from core client for 30 sec - exiting
14:30:46 (56770): No heartbeat from core client for 30 sec - exiting
14:30:47 (56770): No heartbeat from core client for 30 sec - exiting
14:30:48 (56770): No heartbeat from core client for 30 sec - exiting
14:30:49 (56770): No heartbeat from core client for 30 sec - exiting
14:30:50 (56770): No heartbeat from core client for 30 sec - exiting
14:30:51 (56770): No heartbeat from core client for 30 sec - exiting
14:30:52 (56770): No heartbeat from core client for 30 sec - exiting
14:34:27 (56770): No heartbeat from core client for 30 sec - exiting
14:34:28 (56770): No heartbeat from core client for 30 sec - exiting
14:34:29 (56770): No heartbeat from core client for 30 sec - exiting
14:34:30 (56770): No heartbeat from core client for 30 sec - exiting
14:34:31 (56770): No heartbeat from core client for 30 sec - exiting
14:34:32 (56770): No heartbeat from core client for 30 sec - exiting
14:34:33 (56770): No heartbeat from core client for 30 sec - exiting
14:34:34 (56770): No heartbeat from core client for 30 sec - exiting
14:34:35 (56770): No heartbeat from core client for 30 sec - exiting
14:34:36 (56770): No heartbeat from core client for 30 sec - exiting
14:34:37 (56770): No heartbeat from core client for 30 sec - exiting
14:34:38 (56770): No heartbeat from core client for 30 sec - exiting
14:34:39 (56770): No heartbeat from core client for 30 sec - exiting
14:34:40 (56770): No heartbeat from core client for 30 sec - exiting
14:34:41 (56770): No heartbeat from core client for 30 sec - exiting
14:34:42 (56770): No heartbeat from core client for 30 sec - exiting
14:34:43 (56770): No heartbeat from core client for 30 sec - exiting
14:34:44 (56770): No heartbeat from core client for 30 sec - exiting
14:34:45 (56770): No heartbeat from core client for 30 sec - exiting
14:34:46 (56770): No heartbeat from core client for 30 sec - exiting
14:34:47 (56770): No heartbeat from core client for 30 sec - exiting
14:34:48 (56770): No heartbeat from core client for 30 sec - exiting
14:34:49 (56770): No heartbeat from core client for 30 sec - exiting
14:34:50 (56770): No heartbeat from core client for 30 sec - exiting
14:34:51 (56770): No heartbeat from core client for 30 sec - exiting
14:34:52 (56770): No heartbeat from core client for 30 sec - exiting
14:34:53 (56770): No heartbeat from core client for 30 sec - exiting
14:34:54 (56770): No heartbeat from core client for 30 sec - exiting
14:34:55 (56770): No heartbeat from core client for 30 sec - exiting
14:34:56 (56770): No heartbeat from core client for 30 sec - exiting
14:37:35 (56770): No heartbeat from core client for 30 sec - exiting
14:37:36 (56770): No heartbeat from core client for 30 sec - exiting
14:37:37 (56770): No heartbeat from core client for 30 sec - exiting
14:37:38 (56770): No heartbeat from core client for 30 sec - exiting
14:37:39 (56770): No heartbeat from core client for 30 sec - exiting
14:37:40 (56770): No heartbeat from core client for 30 sec - exiting
14:37:41 (56770): No heartbeat from core client for 30 sec - exiting
14:37:42 (56770): No heartbeat from core client for 30 sec - exiting
14:37:43 (56770): No heartbeat from core client for 30 sec - exiting
14:37:44 (56770): No heartbeat from core client for 30 sec - exiting
14:37:45 (56770): No heartbeat from core client for 30 sec - exiting
14:37:46 (56770): No heartbeat from core client for 30 sec - exiting
14:37:47 (56770): No heartbeat from core client for 30 sec - exiting
14:37:48 (56770): No heartbeat from core client for 30 sec - exiting
14:37:49 (56770): No heartbeat from core client for 30 sec - exiting
14:37:50 (56770): No heartbeat from core client for 30 sec - exiting
14:37:51 (56770): No heartbeat from core client for 30 sec - exiting
14:37:52 (56770): No heartbeat from core client for 30 sec - exiting
14:37:53 (56770): No heartbeat from core client for 30 sec - exiting
14:37:54 (56770): No heartbeat from core client for 30 sec - exiting
14:37:55 (56770): No heartbeat from core client for 30 sec - exiting
14:37:56 (56770): No heartbeat from core client for 30 sec - exiting
14:37:57 (56770): No heartbeat from core client for 30 sec - exiting
14:37:58 (56770): No heartbeat from core client for 30 sec - exiting
14:37:59 (56770): No heartbeat from core client for 30 sec - exiting
14:38:00 (56770): No heartbeat from core client for 30 sec - exiting
14:38:01 (56770): No heartbeat from core client for 30 sec - exiting
14:38:02 (56770): No heartbeat from core client for 30 sec - exiting
14:38:03 (56770): No heartbeat from core client for 30 sec - exiting
14:38:04 (56770): No heartbeat from core client for 30 sec - exiting
14:41:08 (56770): No heartbeat from core client for 30 sec - exiting
14:41:09 (56770): No heartbeat from core client for 30 sec - exiting
14:41:10 (56770): No heartbeat from core client for 30 sec - exiting
14:41:11 (56770): No heartbeat from core client for 30 sec - exiting
14:41:12 (56770): No heartbeat from core client for 30 sec - exiting
14:41:13 (56770): No heartbeat from core client for 30 sec - exiting
14:41:14 (56770): No heartbeat from core client for 30 sec - exiting
14:41:15 (56770): No heartbeat from core client for 30 sec - exiting
14:41:16 (56770): No heartbeat from core client for 30 sec - exiting
14:41:17 (56770): No heartbeat from core client for 30 sec - exiting
14:41:18 (56770): No heartbeat from core client for 30 sec - exiting
14:41:19 (56770): No heartbeat from core client for 30 sec - exiting
14:41:20 (56770): No heartbeat from core client for 30 sec - exiting
14:41:21 (56770): No heartbeat from core client for 30 sec - exiting
14:41:22 (56770): No heartbeat from core client for 30 sec - exiting
14:41:23 (56770): No heartbeat from core client for 30 sec - exiting
14:41:24 (56770): No heartbeat from core client for 30 sec - exiting
14:41:25 (56770): No heartbeat from core client for 30 sec - exiting
14:41:26 (56770): No heartbeat from core client for 30 sec - exiting
14:41:27 (56770): No heartbeat from core client for 30 sec - exiting
14:41:28 (56770): No heartbeat from core client for 30 sec - exiting
14:41:29 (56770): No heartbeat from core client for 30 sec - exiting
14:41:30 (56770): No heartbeat from core client for 30 sec - exiting
14:41:31 (56770): No heartbeat from core client for 30 sec - exiting
14:41:32 (56770): No heartbeat from core client for 30 sec - exiting
14:41:33 (56770): No heartbeat from core client for 30 sec - exiting
14:41:34 (56770): No heartbeat from core client for 30 sec - exiting
14:41:35 (56770): No heartbeat from core client for 30 sec - exiting
14:41:36 (56770): No heartbeat from core client for 30 sec - exiting
14:41:37 (56770): No heartbeat from core client for 30 sec - exiting
14:44:32 (56770): No heartbeat from core client for 30 sec - exiting
14:44:33 (56770): No heartbeat from core client for 30 sec - exiting
14:44:34 (56770): No heartbeat from core client for 30 sec - exiting
14:44:35 (56770): No heartbeat from core client for 30 sec - exiting
14:44:36 (56770): No heartbeat from core client for 30 sec - exiting
14:44:37 (56770): No heartbeat from core client for 30 sec - exiting
14:44:38 (56770): No heartbeat from core client for 30 sec - exiting
14:44:39 (56770): No heartbeat from core client for 30 sec - exiting
14:44:40 (56770): No heartbeat from core client for 30 sec - exiting
14:44:41 (56770): No heartbeat from core client for 30 sec - exiting
14:44:42 (56770): No heartbeat from core client for 30 sec - exiting
14:44:43 (56770): No heartbeat from core client for 30 sec - exiting
14:44:44 (56770): No heartbeat from core client for 30 sec - exiting
14:44:45 (56770): No heartbeat from core client for 30 sec - exiting
14:44:46 (56770): No heartbeat from core client for 30 sec - exiting
14:44:47 (56770): No heartbeat from core client for 30 sec - exiting
14:44:48 (56770): No heartbeat from core client for 30 sec - exiting
14:44:49 (56770): No heartbeat from core client for 30 sec - exiting
14:44:50 (56770): No heartbeat from core client for 30 sec - exiting
14:44:51 (56770): No heartbeat from core client for 30 sec - exiting
14:44:52 (56770): No heartbeat from core client for 30 sec - exiting
14:44:53 (56770): No heartbeat from core client for 30 sec - exiting
14:44:54 (56770): No heartbeat from core client for 30 sec - exiting
14:44:55 (56770): No heartbeat from core client for 30 sec - exiting
14:44:56 (56770): No heartbeat from core client for 30 sec - exiting
14:44:57 (56770): No heartbeat from core client for 30 sec - exiting
14:44:58 (56770): No heartbeat from core client for 30 sec - exiting
14:44:59 (56770): No heartbeat from core client for 30 sec - exiting
14:45:00 (56770): No heartbeat from core client for 30 sec - exiting
14:45:01 (56770): No heartbeat from core client for 30 sec - exiting
14:48:06 (56770): No heartbeat from core client for 30 sec - exiting
14:48:07 (56770): No heartbeat from core client for 30 sec - exiting
14:48:08 (56770): No heartbeat from core client for 30 sec - exiting
14:48:09 (56770): No heartbeat from core client for 30 sec - exiting
14:48:10 (56770): No heartbeat from core client for 30 sec - exiting
14:48:11 (56770): No heartbeat from core client for 30 sec - exiting
14:48:12 (56770): No heartbeat from core client for 30 sec - exiting
14:48:13 (56770): No heartbeat from core client for 30 sec - exiting
14:48:14 (56770): No heartbeat from core client for 30 sec - exiting
14:48:15 (56770): No heartbeat from core client for 30 sec - exiting
14:48:16 (56770): No heartbeat from core client for 30 sec - exiting
14:48:17 (56770): No heartbeat from core client for 30 sec - exiting
14:48:18 (56770): No heartbeat from core client for 30 sec - exiting
14:48:19 (56770): No heartbeat from core client for 30 sec - exiting
14:48:20 (56770): No heartbeat from core client for 30 sec - exiting
14:48:21 (56770): No heartbeat from core client for 30 sec - exiting
14:48:22 (56770): No heartbeat from core client for 30 sec - exiting
14:48:23 (56770): No heartbeat from core client for 30 sec - exiting
14:48:24 (56770): No heartbeat from core client for 30 sec - exiting
14:48:25 (56770): No heartbeat from core client for 30 sec - exiting
14:48:26 (56770): No heartbeat from core client for 30 sec - exiting
14:48:27 (56770): No heartbeat from core client for 30 sec - exiting
14:48:28 (56770): No heartbeat from core client for 30 sec - exiting
14:48:29 (56770): No heartbeat from core client for 30 sec - exiting
14:48:30 (56770): No heartbeat from core client for 30 sec - exiting
14:48:31 (56770): No heartbeat from core client for 30 sec - exiting
14:48:32 (56770): No heartbeat from core client for 30 sec - exiting
14:48:33 (56770): No heartbeat from core client for 30 sec - exiting
14:48:34 (56770): No heartbeat from core client for 30 sec - exiting
14:48:35 (56770): No heartbeat from core client for 30 sec - exiting
14:51:28 (56770): No heartbeat from core client for 30 sec - exiting
14:51:29 (56770): No heartbeat from core client for 30 sec - exiting
14:51:30 (56770): No heartbeat from core client for 30 sec - exiting
14:51:31 (56770): No heartbeat from core client for 30 sec - exiting
14:51:32 (56770): No heartbeat from core client for 30 sec - exiting
14:51:33 (56770): No heartbeat from core client for 30 sec - exiting
14:51:34 (56770): No heartbeat from core client for 30 sec - exiting
14:51:35 (56770): No heartbeat from core client for 30 sec - exiting
14:51:36 (56770): No heartbeat from core client for 30 sec - exiting
14:51:37 (56770): No heartbeat from core client for 30 sec - exiting
14:51:38 (56770): No heartbeat from core client for 30 sec - exiting
14:51:39 (56770): No heartbeat from core client for 30 sec - exiting
14:51:40 (56770): No heartbeat from core client for 30 sec - exiting
14:51:41 (56770): No heartbeat from core client for 30 sec - exiting
14:51:42 (56770): No heartbeat from core client for 30 sec - exiting
14:51:43 (56770): No heartbeat from core client for 30 sec - exiting
14:51:44 (56770): No heartbeat from core client for 30 sec - exiting
14:51:45 (56770): No heartbeat from core client for 30 sec - exiting
14:51:46 (56770): No heartbeat from core client for 30 sec - exiting
14:51:47 (56770): No heartbeat from core client for 30 sec - exiting
14:51:48 (56770): No heartbeat from core client for 30 sec - exiting
14:51:49 (56770): No heartbeat from core client for 30 sec - exiting
14:51:50 (56770): No heartbeat from core client for 30 sec - exiting
14:51:51 (56770): No heartbeat from core client for 30 sec - exiting
14:51:52 (56770): No heartbeat from core client for 30 sec - exiting
14:51:53 (56770): No heartbeat from core client for 30 sec - exiting
14:51:54 (56770): No heartbeat from core client for 30 sec - exiting
14:51:55 (56770): No heartbeat from core client for 30 sec - exiting
14:51:56 (56770): No heartbeat from core client for 30 sec - exiting
14:51:57 (56770): No heartbeat from core client for 30 sec - exiting
14:54:58 (56770): No heartbeat from core client for 30 sec - exiting
14:54:59 (56770): No heartbeat from core client for 30 sec - exiting
14:55:01 (56770): No heartbeat from core client for 30 sec - exiting
14:55:02 (56770): No heartbeat from core client for 30 sec - exiting
14:55:03 (56770): No heartbeat from core client for 30 sec - exiting
14:55:04 (56770): No heartbeat from core client for 30 sec - exiting
14:55:05 (56770): No heartbeat from core client for 30 sec - exiting
14:55:06 (56770): No heartbeat from core client for 30 sec - exiting
14:55:07 (56770): No heartbeat from core client for 30 sec - exiting
14:55:08 (56770): No heartbeat from core client for 30 sec - exiting
14:55:09 (56770): No heartbeat from core client for 30 sec - exiting
14:55:10 (56770): No heartbeat from core client for 30 sec - exiting
14:55:11 (56770): No heartbeat from core client for 30 sec - exiting
14:55:12 (56770): No heartbeat from core client for 30 sec - exiting
14:55:13 (56770): No heartbeat from core client for 30 sec - exiting
14:55:14 (56770): No heartbeat from core client for 30 sec - exiting
14:55:15 (56770): No heartbeat from core client for 30 sec - exiting
14:55:16 (56770): No heartbeat from core client for 30 sec - exiting
14:55:17 (56770): No heartbeat from core client for 30 sec - exiting
14:55:18 (56770): No heartbeat from core client for 30 sec - exiting
14:55:19 (56770): No heartbeat from core client for 30 sec - exiting
14:55:20 (56770): No heartbeat from core client for 30 sec - exiting
14:55:21 (56770): No heartbeat from core client for 30 sec - exiting
14:55:22 (56770): No heartbeat from core client for 30 sec - exiting
14:55:23 (56770): No heartbeat from core client for 30 sec - exiting
14:55:24 (56770): No heartbeat from core client for 30 sec - exiting
14:55:25 (56770): No heartbeat from core client for 30 sec - exiting
14:55:26 (56770): No heartbeat from core client for 30 sec - exiting
14:55:27 (56770): No heartbeat from core client for 30 sec - exiting
14:55:28 (56770): No heartbeat from core client for 30 sec - exiting
14:58:10 (56770): No heartbeat from core client for 30 sec - exiting
14:58:11 (56770): No heartbeat from core client for 30 sec - exiting
14:58:12 (56770): No heartbeat from core client for 30 sec - exiting
14:58:13 (56770): No heartbeat from core client for 30 sec - exiting
14:58:14 (56770): No heartbeat from core client for 30 sec - exiting
14:58:15 (56770): No heartbeat from core client for 30 sec - exiting
14:58:16 (56770): No heartbeat from core client for 30 sec - exiting
14:58:17 (56770): No heartbeat from core client for 30 sec - exiting
14:58:18 (56770): No heartbeat from core client for 30 sec - exiting
14:58:19 (56770): No heartbeat from core client for 30 sec - exiting
14:58:20 (56770): No heartbeat from core client for 30 sec - exiting
14:58:21 (56770): No heartbeat from core client for 30 sec - exiting
14:58:22 (56770): No heartbeat from core client for 30 sec - exiting
14:58:23 (56770): No heartbeat from core client for 30 sec - exiting
14:58:24 (56770): No heartbeat from core client for 30 sec - exiting
14:58:25 (56770): No heartbeat from core client for 30 sec - exiting
14:58:26 (56770): No heartbeat from core client for 30 sec - exiting
14:58:27 (56770): No heartbeat from core client for 30 sec - exiting
14:58:28 (56770): No heartbeat from core client for 30 sec - exiting
14:58:29 (56770): No heartbeat from core client for 30 sec - exiting
14:58:30 (56770): No heartbeat from core client for 30 sec - exiting
14:58:31 (56770): No heartbeat from core client for 30 sec - exiting
14:58:32 (56770): No heartbeat from core client for 30 sec - exiting
14:58:33 (56770): No heartbeat from core client for 30 sec - exiting
14:58:34 (56770): No heartbeat from core client for 30 sec - exiting
14:58:35 (56770): No heartbeat from core client for 30 sec - exiting
14:58:36 (56770): No heartbeat from core client for 30 sec - exiting
14:58:37 (56770): No heartbeat from core client for 30 sec - exiting
14:58:38 (56770): No heartbeat from core client for 30 sec - exiting
14:58:39 (56770): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(57369,0xa02bb540) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57369,0xa02bb540) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57369,0xa02bb540) malloc: *** error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
15:04:19 (57369): No heartbeat from core client for 30 sec - exiting
15:04:20 (57369): No heartbeat from core client for 30 sec - exiting
15:04:21 (57369): No heartbeat from core client for 30 sec - exiting
15:04:22 (57369): No heartbeat from core client for 30 sec - exiting
15:04:23 (57369): No heartbeat from core client for 30 sec - exiting
15:04:24 (57369): No heartbeat from core client for 30 sec - exiting
15:04:25 (57369): No heartbeat from core client for 30 sec - exiting
15:04:26 (57369): No heartbeat from core client for 30 sec - exiting
15:04:27 (57369): No heartbeat from core client for 30 sec - exiting
15:04:28 (57369): No heartbeat from core client for 30 sec - exiting
15:04:29 (57369): No heartbeat from core client for 30 sec - exiting
15:04:30 (57369): No heartbeat from core client for 30 sec - exiting
15:04:31 (57369): No heartbeat from core client for 30 sec - exiting
15:04:32 (57369): No heartbeat from core client for 30 sec - exiting
15:04:33 (57369): No heartbeat from core client for 30 sec - exiting
15:04:34 (57369): No heartbeat from core client for 30 sec - exiting
15:04:35 (57369): No heartbeat from core client for 30 sec - exiting
15:04:36 (57369): No heartbeat from core client for 30 sec - exiting
15:04:37 (57369): No heartbeat from core client for 30 sec - exiting
15:04:38 (57369): No heartbeat from core client for 30 sec - exiting
15:04:39 (57369): No heartbeat from core client for 30 sec - exiting
15:04:40 (57369): No heartbeat from core client for 30 sec - exiting
15:04:41 (57369): No heartbeat from core client for 30 sec - exiting
15:04:42 (57369): No heartbeat from core client for 30 sec - exiting
15:04:43 (57369): No heartbeat from core client for 30 sec - exiting
15:04:44 (57369): No heartbeat from core client for 30 sec - exiting
15:04:45 (57369): No heartbeat from core client for 30 sec - exiting
15:04:46 (57369): No heartbeat from core client for 30 sec - exiting
15:04:47 (57369): No heartbeat from core client for 30 sec - exiting
15:04:48 (57369): No heartbeat from core client for 30 sec - exiting
15:08:10 (57369): No heartbeat from core client for 30 sec - exiting
15:08:11 (57369): No heartbeat from core client for 30 sec - exiting
15:08:12 (57369): No heartbeat from core client for 30 sec - exiting
15:08:13 (57369): No heartbeat from core client for 30 sec - exiting
15:08:14 (57369): No heartbeat from core client for 30 sec - exiting
15:08:15 (57369): No heartbeat from core client for 30 sec - exiting
15:08:16 (57369): No heartbeat from core client for 30 sec - exiting
15:08:17 (57369): No heartbeat from core client for 30 sec - exiting
15:08:18 (57369): No heartbeat from core client for 30 sec - exiting
15:08:19 (57369): No heartbeat from core client for 30 sec - exiting
15:08:20 (57369): No heartbeat from core client for 30 sec - exiting
15:08:21 (57369): No heartbeat from core client for 30 sec - exiting
15:08:22 (57369): No heartbeat from core client for 30 sec - exiting
15:08:23 (57369): No heartbeat from core client for 30 sec - exiting
15:08:24 (57369): No heartbeat from core client for 30 sec - exiting
15:08:25 (57369): No heartbeat from core client for 30 sec - exiting
15:08:26 (57369): No heartbeat from core client for 30 sec - exiting
15:08:27 (57369): No heartbeat from core client for 30 sec - exiting
15:08:28 (57369): No heartbeat from core client for 30 sec - exiting
15:08:29 (57369): No heartbeat from core client for 30 sec - exiting
15:08:30 (57369): No heartbeat from core client for 30 sec - exiting
15:08:31 (57369): No heartbeat from core client for 30 sec - exiting
15:08:32 (57369): No heartbeat from core client for 30 sec - exiting
15:08:33 (57369): No heartbeat from core client for 30 sec - exiting
15:08:34 (57369): No heartbeat from core client for 30 sec - exiting
15:08:35 (57369): No heartbeat from core client for 30 sec - exiting
15:08:36 (57369): No heartbeat from core client for 30 sec - exiting
15:08:37 (57369): No heartbeat from core client for 30 sec - exiting
15:08:38 (57369): No heartbeat from core client for 30 sec - exiting
15:08:39 (57369): No heartbeat from core client for 30 sec - exiting
15:11:47 (57369): No heartbeat from core client for 30 sec - exiting
15:11:48 (57369): No heartbeat from core client for 30 sec - exiting
15:11:49 (57369): No heartbeat from core client for 30 sec - exiting
15:11:50 (57369): No heartbeat from core client for 30 sec - exiting
15:11:51 (57369): No heartbeat from core client for 30 sec - exiting
15:11:52 (57369): No heartbeat from core client for 30 sec - exiting
15:11:53 (57369): No heartbeat from core client for 30 sec - exiting
15:11:54 (57369): No heartbeat from core client for 30 sec - exiting
15:11:55 (57369): No heartbeat from core client for 30 sec - exiting
15:11:56 (57369): No heartbeat from core client for 30 sec - exiting
15:11:57 (57369): No heartbeat from core client for 30 sec - exiting
15:11:58 (57369): No heartbeat from core client for 30 sec - exiting
15:11:59 (57369): No heartbeat from core client for 30 sec - exiting
15:12:00 (57369): No heartbeat from core client for 30 sec - exiting
15:12:01 (57369): No heartbeat from core client for 30 sec - exiting
15:12:02 (57369): No heartbeat from core client for 30 sec - exiting
15:12:03 (57369): No heartbeat from core client for 30 sec - exiting
15:12:04 (57369): No heartbeat from core client for 30 sec - exiting
15:12:05 (57369): No heartbeat from core client for 30 sec - exiting
15:12:06 (57369): No heartbeat from core client for 30 sec - exiting
15:12:07 (57369): No heartbeat from core client for 30 sec - exiting
15:12:08 (57369): No heartbeat from core client for 30 sec - exiting
15:12:09 (57369): No heartbeat from core client for 30 sec - exiting
15:12:10 (57369): No heartbeat from core client for 30 sec - exiting
15:12:11 (57369): No heartbeat from core client for 30 sec - exiting
15:12:12 (57369): No heartbeat from core client for 30 sec - exiting
15:12:13 (57369): No heartbeat from core client for 30 sec - exiting
15:12:14 (57369): No heartbeat from core client for 30 sec - exiting
15:12:15 (57369): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(57496,0xa02bb540) malloc: *** error for object 0x101de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58158,0xa02bb540) malloc: *** error for object 0x810400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58207,0xa02bb540) malloc: *** error for object 0x1815c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58207,0xa02bb540) malloc: *** error for object 0x1815c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58207,0xa02bb540) malloc: *** error for object 0x825e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58545,0xa02bb540) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_102s_1980_40_007957233/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 May 2012 12:58:06 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 259,200 429,542 1.6572
15 May 2012 12:58:06 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 233,280 388,711 1.6663
15 May 2012 12:58:06 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 207,360 345,530 1.6663
15 May 2012 12:58:06 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 181,440 302,334 1.6663
13 May 2012 02:40:38 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 155,520 259,151 1.6664
12 May 2012 13:57:50 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 129,600 215,972 1.6665
12 May 2012 01:32:15 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 103,680 172,865 1.6673
11 May 2012 12:31:54 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 77,760 129,699 1.6679
10 May 2012 22:23:28 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 51,840 86,467 1.6680
10 May 2012 09:51:04 1212789 14648703 hadcm3n_102s_1980_40_007957233_2 25,920 43,280 1.6698


©2024 climateprediction.net