climateprediction.net home page
Task 13583327

Task 13583327

Name hadcm3n_yjto_1900_40_007524764_2
Workunit 7722239
Created 1 Nov 2011, 23:24:40 UTC
Sent 1 Nov 2011, 23:30:25 UTC
Report deadline 1 Feb 2012, 6:57:36 UTC
Received 19 Jan 2012, 3:29:23 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 6011
Run time 28 days 10 hours 48 min 58 sec
CPU time 19 days 17 hours 14 min 44 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 2.91 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>6.12.35</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
OINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:48:03 (5764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:12:21 (64722): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:13:49 (67075): No heartbeat from core client for 30 sec - exiting
18:13:50 (67075): No heartbeat from core client for 30 sec - exiting
18:13:51 (67075): No heartbeat from core client for 30 sec - exiting
18:13:52 (67075): No heartbeat from core client for 30 sec - exiting
18:13:53 (67075): No heartbeat from core client for 30 sec - exiting
18:13:54 (67075): No heartbeat from core client for 30 sec - exiting
18:13:55 (67075): No heartbeat from core client for 30 sec - exiting
18:13:56 (67075): No heartbeat from core client for 30 sec - exiting
18:13:57 (67075): No heartbeat from core client for 30 sec - exiting
18:13:58 (67075): No heartbeat from core client for 30 sec - exiting
18:13:59 (67075): No heartbeat from core client for 30 sec - exiting
18:14:00 (67075): No heartbeat from core client for 30 sec - exiting
18:14:01 (67075): No heartbeat from core client for 30 sec - exiting
18:14:02 (67075): No heartbeat from core client for 30 sec - exiting
18:14:03 (67075): No heartbeat from core client for 30 sec - exiting
18:14:04 (67075): No heartbeat from core client for 30 sec - exiting
18:14:05 (67075): No heartbeat from core client for 30 sec - exiting
18:14:06 (67075): No heartbeat from core client for 30 sec - exiting
18:14:07 (67075): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:22:45 (67092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:22:47 (67092): No heartbeat from core client for 30 sec - exiting
18:22:48 (67092): No heartbeat from core client for 30 sec - exiting
18:22:49 (67092): No heartbeat from core client for 30 sec - exiting
18:22:50 (67092): No heartbeat from core client for 30 sec - exiting
18:22:51 (67092): No heartbeat from core client for 30 sec - exiting
18:22:52 (67092): No heartbeat from core client for 30 sec - exiting
18:22:53 (67092): No heartbeat from core client for 30 sec - exiting
18:22:54 (67092): No heartbeat from core client for 30 sec - exiting
18:22:55 (67092): No heartbeat from core client for 30 sec - exiting
18:22:56 (67092): No heartbeat from core client for 30 sec - exiting
18:22:57 (67092): No heartbeat from core client for 30 sec - exiting
18:22:58 (67092): No heartbeat from core client for 30 sec - exiting
18:22:59 (67092): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:31:28 (59764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:48:44 (81515): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:48:46 (81515): No heartbeat from core client for 30 sec - exiting
13:48:47 (81515): No heartbeat from core client for 30 sec - exiting
13:48:48 (81515): No heartbeat from core client for 30 sec - exiting
13:48:49 (81515): No heartbeat from core client for 30 sec - exiting
13:48:50 (81515): No heartbeat from core client for 30 sec - exiting
13:48:51 (81515): No heartbeat from core client for 30 sec - exiting
13:48:52 (81515): No heartbeat from core client for 30 sec - exiting
13:48:53 (81515): No heartbeat from core client for 30 sec - exiting
13:48:54 (81515): No heartbeat from core client for 30 sec - exiting
13:48:55 (81515): No heartbeat from core client for 30 sec - exiting
13:48:56 (81515): No heartbeat from core client for 30 sec - exiting
13:48:57 (81515): No heartbeat from core client for 30 sec - exiting
13:48:58 (81515): No heartbeat from core client for 30 sec - exiting
13:48:59 (81515): No heartbeat from core client for 30 sec - exiting
13:49:00 (81515): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:38:13 (84060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:40:34 (88322): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:43:53 (88361): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:44:54 (88361): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
15:46:31 (88455): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:36:22 (88474): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:36:24 (88474): No heartbeat from core client for 30 sec - exiting
22:36:25 (88474): No heartbeat from core client for 30 sec - exiting
22:53:33 (21883): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:53:35 (21883): No heartbeat from core client for 30 sec - exiting
22:53:36 (21883): No heartbeat from core client for 30 sec - exiting
22:53:37 (21883): No heartbeat from core client for 30 sec - exiting
22:53:38 (21883): No heartbeat from core client for 30 sec - exiting
22:53:39 (21883): No heartbeat from core client for 30 sec - exiting
22:53:40 (21883): No heartbeat from core client for 30 sec - exiting
22:53:41 (21883): No heartbeat from core client for 30 sec - exiting
22:53:42 (21883): No heartbeat from core client for 30 sec - exiting
22:53:43 (21883): No heartbeat from core client for 30 sec - exiting
22:53:44 (21883): No heartbeat from core client for 30 sec - exiting
22:53:45 (21883): No heartbeat from core client for 30 sec - exiting
22:53:46 (21883): No heartbeat from core client for 30 sec - exiting
22:53:47 (21883): No heartbeat from core client for 30 sec - exiting
22:53:48 (21883): No heartbeat from core client for 30 sec - exiting
22:53:49 (21883): No heartbeat from core client for 30 sec - exiting
22:53:50 (21883): No heartbeat from core client for 30 sec - exiting
22:53:51 (21883): No heartbeat from core client for 30 sec - exiting
22:53:52 (21883): No heartbeat from core client for 30 sec - exiting
22:53:53 (21883): No heartbeat from core client for 30 sec - exiting
22:53:54 (21883): No heartbeat from core client for 30 sec - exiting
22:53:55 (21883): No heartbeat from core client for 30 sec - exiting
22:53:56 (21883): No heartbeat from core client for 30 sec - exiting
22:53:57 (21883): No heartbeat from core client for 30 sec - exiting
22:53:58 (21883): No heartbeat from core client for 30 sec - exiting
22:53:59 (21883): No heartbeat from core client for 30 sec - exiting
22:54:00 (21883): No heartbeat from core client for 30 sec - exiting
22:54:48 (23744): No heartbeat from core client for 30 sec - exiting
22:54:49 (23744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:55:24 (23801): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:57:10 (24119): No heartbeat from core client for 30 sec - exiting
22:57:11 (24119): No heartbeat from core client for 30 sec - exiting
22:57:12 (24119): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:01:26 (24877): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:06:43 (25570): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:06:45 (25570): No heartbeat from core client for 30 sec - exiting
23:06:46 (25570): No heartbeat from core client for 30 sec - exiting
23:06:47 (25570): No heartbeat from core client for 30 sec - exiting
23:06:48 (25570): No heartbeat from core client for 30 sec - exiting
23:06:49 (25570): No heartbeat from core client for 30 sec - exiting
23:06:50 (25570): No heartbeat from core client for 30 sec - exiting
23:06:51 (25570): No heartbeat from core client for 30 sec - exiting
23:06:52 (25570): No heartbeat from core client for 30 sec - exiting
23:06:53 (25570): No heartbeat from core client for 30 sec - exiting
23:06:54 (25570): No heartbeat from core client for 30 sec - exiting
23:06:55 (25570): No heartbeat from core client for 30 sec - exiting
23:06:56 (25570): No heartbeat from core client for 30 sec - exiting
23:06:57 (25570): No heartbeat from core client for 30 sec - exiting
23:06:58 (25570): No heartbeat from core client for 30 sec - exiting
23:06:59 (25570): No heartbeat from core client for 30 sec - exiting
23:07:00 (25570): No heartbeat from core client for 30 sec - exiting
23:07:01 (25570): No heartbeat from core client for 30 sec - exiting
23:07:02 (25570): No heartbeat from core client for 30 sec - exiting
23:07:03 (25570): No heartbeat from core client for 30 sec - exiting
23:07:04 (25570): No heartbeat from core client for 30 sec - exiting
23:07:05 (25570): No heartbeat from core client for 30 sec - exiting
23:07:06 (25570): No heartbeat from core client for 30 sec - exiting
23:07:07 (25570): No heartbeat from core client for 30 sec - exiting
23:07:08 (25570): No heartbeat from core client for 30 sec - exiting
23:07:09 (25570): No heartbeat from core client for 30 sec - exiting
23:07:10 (25570): No heartbeat from core client for 30 sec - exiting
23:07:11 (25570): No heartbeat from core client for 30 sec - exiting
23:07:12 (25570): No heartbeat from core client for 30 sec - exiting
23:07:13 (25570): No heartbeat from core client for 30 sec - exiting
23:07:14 (25570): No heartbeat from core client for 30 sec - exiting
23:07:15 (25570): No heartbeat from core client for 30 sec - exiting
23:07:16 (25570): No heartbeat from core client for 30 sec - exiting
23:07:17 (25570): No heartbeat from core client for 30 sec - exiting
23:07:18 (25570): No heartbeat from core client for 30 sec - exiting
23:07:19 (25570): No heartbeat from core client for 30 sec - exiting
23:07:58 (26851): No heartbeat from core client for 30 sec - exiting
23:07:59 (26851): No heartbeat from core client for 30 sec - exiting
23:08:00 (26851): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:08:55 (26992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:13:33 (27954): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:13:35 (27954): No heartbeat from core client for 30 sec - exiting
23:13:36 (27954): No heartbeat from core client for 30 sec - exiting
23:14:24 (28726): No heartbeat from core client for 30 sec - exiting
23:14:25 (28726): No heartbeat from core client for 30 sec - exiting
23:14:26 (28726): No heartbeat from core client for 30 sec - exiting
23:14:27 (28726): No heartbeat from core client for 30 sec - exiting
23:14:28 (28726): No heartbeat from core client for 30 sec - exiting
23:14:29 (28726): No heartbeat from core client for 30 sec - exiting
23:14:30 (28726): No heartbeat from core client for 30 sec - exiting
23:14:31 (28726): No heartbeat from core client for 30 sec - exiting
23:14:32 (28726): No heartbeat from core client for 30 sec - exiting
23:14:33 (28726): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:15:21 (28896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:16:47 (29199): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:17:29 (29535): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:18:37 (29703): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:23:36 (30026): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:24:54 (31155): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
05:09:47 (31456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:29:45 (88417): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:29:47 (88417): No heartbeat from core client for 30 sec - exiting
05:29:48 (88417): No heartbeat from core client for 30 sec - exiting
05:30:54 (93517): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:32:23 (93863): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:34:07 (94390): No heartbeat from core client for 30 sec - exiting
05:34:08 (94390): No heartbeat from core client for 30 sec - exiting
05:34:09 (94390): No heartbeat from core client for 30 sec - exiting
05:34:10 (94390): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
05:35:17 (94593): No heartbeat from core client for 30 sec - exiting
05:35:19 (94593): No heartbeat from core client for 30 sec - exiting
05:35:20 (94593): No heartbeat from core client for 30 sec - exiting
05:35:21 (94593): No heartbeat from core client for 30 sec - exiting
05:35:22 (94593): No heartbeat from core client for 30 sec - exiting
05:35:23 (94593): No heartbeat from core client for 30 sec - exiting
05:35:24 (94593): No heartbeat from core client for 30 sec - exiting
05:35:25 (94593): No heartbeat from core client for 30 sec - exiting
05:35:26 (94593): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:38:16 (95492): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:41:01 (95930): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:47:33 (97100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:23:34 (1230): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:33:51 (585): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x19ff804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x19ff800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x19ff804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x19ff800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x19ff804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x19ff800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x19ff804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x19ff800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x19ff800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.3 build 11D43
Tue Jan 17 21:43:53 2012

hadcm3n_6.07_i686-apple-darwin(4428,0xad0482c0) malloc: *** error for object 0x39f3804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
Thread 0 Crashed:

Thread 1:
atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
hadcm3n_6.07_i686-apple-darwin(75744,0xad0482c0) malloc: *** error for object 0x2257e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75744,0xad0482c0) malloc: *** error for object 0x2257e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75744,0xad0482c0) malloc: *** error for object 0x525be00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
23:24:47 (75744): No heartbeat from core client for 30 sec - exiting
23:24:50 (75744): No heartbeat from core client for 30 sec - exiting
23:24:51 (75744): No heartbeat from core client for 30 sec - exiting
03:52:35 (75744): No heartbeat from core client for 30 sec - exiting
03:52:36 (75744): No heartbeat from core client for 30 sec - exiting
03:52:37 (75744): No heartbeat from core client for 30 sec - exiting
03:52:38 (75744): No heartbeat from core client for 30 sec - exiting
03:52:39 (75744): No heartbeat from core client for 30 sec - exiting
03:52:40 (75744): No heartbeat from core client for 30 sec - exiting
03:52:41 (75744): No heartbeat from core client for 30 sec - exiting
03:52:42 (75744): No heartbeat from core client for 30 sec - exiting
03:52:43 (75744): No heartbeat from core client for 30 sec - exiting
03:52:44 (75744): No heartbeat from core client for 30 sec - exiting
03:52:45 (75744): No heartbeat from core client for 30 sec - exiting
03:52:46 (75744): No heartbeat from core client for 30 sec - exiting
03:52:47 (75744): No heartbeat from core client for 30 sec - exiting
03:52:48 (75744): No heartbeat from core client for 30 sec - exiting
03:52:49 (75744): No heartbeat from core client for 30 sec - exiting
03:52:50 (75744): No heartbeat from core client for 30 sec - exiting
03:56:31 (75744): No heartbeat from core client for 30 sec - exiting
03:56:33 (75744): No heartbeat from core client for 30 sec - exiting
03:56:34 (75744): No heartbeat from core client for 30 sec - exiting
03:56:35 (75744): No heartbeat from core client for 30 sec - exiting
03:56:36 (75744): No heartbeat from core client for 30 sec - exiting
03:56:37 (75744): No heartbeat from core client for 30 sec - exiting
03:56:38 (75744): No heartbeat from core client for 30 sec - exiting
03:56:39 (75744): No heartbeat from core client for 30 sec - exiting
03:56:40 (75744): No heartbeat from core client for 30 sec - exiting
03:56:41 (75744): No heartbeat from core client for 30 sec - exiting
03:56:42 (75744): No heartbeat from core client for 30 sec - exiting
03:56:43 (75744): No heartbeat from core client for 30 sec - exiting
03:56:44 (75744): No heartbeat from core client for 30 sec - exiting
03:56:45 (75744): No heartbeat from core client for 30 sec - exiting
03:56:46 (75744): No heartbeat from core client for 30 sec - exiting
03:56:47 (75744): No heartbeat from core client for 30 sec - exiting
03:56:48 (75744): No heartbeat from core client for 30 sec - exiting
03:56:49 (75744): No heartbeat from core client for 30 sec - exiting
03:56:50 (75744): No heartbeat from core client for 30 sec - exiting
03:56:51 (75744): No heartbeat from core client for 30 sec - exiting
03:56:52 (75744): No heartbeat from core client for 30 sec - exiting
03:56:53 (75744): No heartbeat from core client for 30 sec - exiting
03:56:54 (75744): No heartbeat from core client for 30 sec - exiting
03:56:55 (75744): No heartbeat from core client for 30 sec - exiting
03:56:56 (75744): No heartbeat from core client for 30 sec - exiting
03:56:57 (75744): No heartbeat from core client for 30 sec - exiting
03:56:58 (75744): No heartbeat from core client for 30 sec - exiting
03:56:59 (75744): No heartbeat from core client for 30 sec - exiting
03:57:00 (75744): No heartbeat from core client for 30 sec - exiting
03:57:02 (75744): No heartbeat from core client for 30 sec - exiting
03:57:03 (75744): No heartbeat from core client for 30 sec - exiting
03:57:04 (75744): No heartbeat from core client for 30 sec - exiting
03:57:05 (75744): No heartbeat from core client for 30 sec - exiting
03:57:06 (75744): No heartbeat from core client for 30 sec - exiting
03:57:07 (75744): No heartbeat from core client for 30 sec - exiting
03:57:08 (75744): No heartbeat from core client for 30 sec - exiting
03:57:09 (75744): No heartbeat from core client for 30 sec - exiting
03:57:10 (75744): No heartbeat from core client for 30 sec - exiting
03:57:11 (75744): No heartbeat from core client for 30 sec - exiting
03:57:12 (75744): No heartbeat from core client for 30 sec - exiting
03:57:13 (75744): No heartbeat from core client for 30 sec - exiting
03:57:14 (75744): No heartbeat from core client for 30 sec - exiting
03:57:15 (75744): No heartbeat from core client for 30 sec - exiting
03:57:16 (75744): No heartbeat from core client for 30 sec - exiting
03:57:17 (75744): No heartbeat from core client for 30 sec - exiting
03:57:18 (75744): No heartbeat from core client for 30 sec - exiting
03:57:19 (75744): No heartbeat from core client for 30 sec - exiting
03:57:20 (75744): No heartbeat from core client for 30 sec - exiting
03:57:21 (75744): No heartbeat from core client for 30 sec - exiting
03:57:22 (75744): No heartbeat from core client for 30 sec - exiting
03:57:23 (75744): No heartbeat from core client for 30 sec - exiting
07:11:08 (75744): No heartbeat from core client for 30 sec - exiting
07:11:11 (75744): No heartbeat from core client for 30 sec - exiting
07:11:12 (75744): No heartbeat from core client for 30 sec - exiting
07:11:13 (75744): No heartbeat from core client for 30 sec - exiting
07:11:14 (75744): No heartbeat from core client for 30 sec - exiting
07:11:15 (75744): No heartbeat from core client for 30 sec - exiting
07:11:16 (75744): No heartbeat from core client for 30 sec - exiting
07:11:17 (75744): No heartbeat from core client for 30 sec - exiting
07:12:06 (75744): No heartbeat from core client for 30 sec - exiting
07:12:08 (75744): No heartbeat from core client for 30 sec - exiting
07:12:09 (75744): No heartbeat from core client for 30 sec - exiting
07:12:10 (75744): No heartbeat from core client for 30 sec - exiting
07:12:11 (75744): No heartbeat from core client for 30 sec - exiting
07:12:12 (75744): No heartbeat from core client for 30 sec - exiting
07:12:13 (75744): No heartbeat from core client for 30 sec - exiting
07:12:14 (75744): No heartbeat from core client for 30 sec - exiting
07:12:15 (75744): No heartbeat from core client for 30 sec - exiting
07:12:16 (75744): No heartbeat from core client for 30 sec - exiting
07:12:17 (75744): No heartbeat from core client for 30 sec - exiting
07:12:18 (75744): No heartbeat from core client for 30 sec - exiting
07:12:19 (75744): No heartbeat from core client for 30 sec - exiting
07:12:50 (75744): No heartbeat from core client for 30 sec - exiting
07:12:51 (75744): No heartbeat from core client for 30 sec - exiting
07:12:52 (75744): No heartbeat from core client for 30 sec - exiting
07:12:53 (75744): No heartbeat from core client for 30 sec - exiting
07:12:54 (75744): No heartbeat from core client for 30 sec - exiting
07:12:55 (75744): No heartbeat from core client for 30 sec - exiting
07:12:56 (75744): No heartbeat from core client for 30 sec - exiting
07:12:57 (75744): No heartbeat from core client for 30 sec - exiting
07:12:58 (75744): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0xba2404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0xba2400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x43a5604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x43a5600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x43a5604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x43a5600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x43a5604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x43a5600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x43a5604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.3 build 11D43
Wed Jan 18 12:11:28 2012

hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a2604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a2a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a3004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a3404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a3804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a3c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a4004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a4604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a4a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a4e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a5204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a5804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a5c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a6004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a6404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a6804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a6e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a7204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a7604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a7a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a7e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a8204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a8604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a8a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a8e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a9404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33a9a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33aa404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(596,0xac6592c0) malloc: *** error for object 0x33aa400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
Thread 0 Crashed:

Thread 1:

atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd98 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/14/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x91ed7000 - 0x91edffff /usr/lib/system/libcopyfile.dylib
0x92c84000 - 0x92c85fff /usr/lib/system/libremovefile.dylib
0x92d19000 - 0x92d2ffff /usr/lib/system/libxpc.dylib
0x94e06000 - 0x94e68fff /usr/lib/libstdc++.6.dylib
0x95347000 - 0x95350fff /usr/lib/libc++abi.dylib
0x95355000 - 0x95356fff /usr/lib/system/libunc.dylib
0x95357000 - 0x95422fff /usr/lib/system/libsystem_c.dylib
0x95424000 - 0x95429fff /usr/lib/system/libmacho.dylib
0x95432000 - 0x95461fff /usr/lib/system/libsystem_info.dylib
0x954d1000 - 0x954d2fff /usr/lib/system/libsystem_sandbox.dylib
0x95b14000 - 0x95b1bfff /usr/lib/system/libsystem_dnssd.dylib
0x96ad8000 - 0x96adffff /usr/lib/system/libsystem_notify.dylib
0x96fdb000 - 0x96fe9fff /usr/lib/libz.1.dylib
0x9708f000 - 0x97092fff /usr/lib/system/libcompiler_rt.dylib
0x97c77000 - 0x97c7ffff /usr/lib/system/libunwind.dylib
0x97cc2000 - 0x97cc5fff /usr/lib/system/libmathCommon.A.dylib
0x9851d000 - 0x9853bfff /usr/lib/system/libsystem_kernel.dylib
0x9890b000 - 0x9890ffff /usr/lib/system/libcache.dylib
0x98f7a000 - 0x98fa8fff /usr/lib/libSystem.B.dylib
0x98feb000 - 0x98fedfff /usr/lib/system/libdyld.dylib
0x98ff9000 - 0x98ffdfff /usr/lib/system/libsystem_network.dylib
0x996e3000 - 0x996e4fff /usr/lib/system/libsystem_blocks.dylib
0x99a4c000 - 0x99a4dfff /usr/lib/system/libquarantine.dylib
0x9a467000 - 0x9a46ffff /usr/lib/system/liblaunch.dylib
0x9a5d6000 - 0x9a5e4fff /usr/lib/system/libdispatch.dylib
0x9ad8e000 - 0x9ad8efff /usr/lib/system/libdnsinfo.dylib
0x9af1c000 - 0x9af5ffff /usr/lib/system/libcommonCrypto.dylib
0x9b381000 - 0x9b381fff /usr/lib/system/libkeymgr.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 Jan 2012 05:48:31 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 1,036,800 1,703,064 1.6426
17 Jan 2012 12:59:09 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 1,010,880 1,664,731 1.6468
16 Jan 2012 19:49:52 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 984,960 1,626,254 1.6511
15 Jan 2012 23:47:42 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 959,040 1,583,161 1.6508
15 Jan 2012 03:49:25 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 933,120 1,540,149 1.6505
14 Jan 2012 08:02:01 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 907,200 1,496,978 1.6501
13 Jan 2012 15:49:13 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 881,280 1,457,102 1.6534
12 Jan 2012 19:59:20 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 855,360 1,414,931 1.6542
11 Jan 2012 23:30:31 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 829,440 1,372,143 1.6543
11 Jan 2012 04:53:03 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 803,520 1,329,119 1.6541
10 Jan 2012 11:23:58 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 777,600 1,288,453 1.6570
09 Jan 2012 18:16:07 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 751,680 1,247,237 1.6593
08 Jan 2012 19:29:06 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 725,760 1,204,696 1.6599
07 Jan 2012 21:47:24 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 699,840 1,162,118 1.6605
07 Jan 2012 01:05:37 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 673,920 1,119,344 1.6609
06 Jan 2012 05:22:20 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 648,000 1,076,592 1.6614
05 Jan 2012 11:15:07 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 622,080 1,035,731 1.6649
04 Jan 2012 19:55:03 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 596,160 995,836 1.6704
27 Dec 2011 02:25:59 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 570,240 952,763 1.6708
26 Dec 2011 07:39:54 6011 13583327 hadcm3n_yjto_1900_40_007524764_2 544,320 909,662 1.6712


©2024 climateprediction.net