Task 13539037

Name	hadcm3n_ygqk_1900_40_007516680_1
Workunit	7714155
Created	28 Oct 2011, 12:48:30 UTC
Sent	22 Nov 2011, 17:53:15 UTC
Report deadline	22 Feb 2012, 1:20:26 UTC
Received	11 Dec 2011, 16:00:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1159853
Run time	12 days 16 hours 59 min 5 sec
CPU time	8 days 14 hours 29 min 19 sec
Validate state	Invalid
Credit	4,043.52
Device peak FLOPS	2.50 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:09:13 (531): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:09:15 (531): No heartbeat from core client for 30 sec - exiting 22:09:16 (531): No heartbeat from core client for 30 sec - exiting 22:09:17 (531): No heartbeat from core client for 30 sec - exiting 22:09:18 (531): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:19:09 (11257): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:02:31 (36132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:27 (73181): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:41:24 (97012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:12:07 (8017): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:12:08 (8017): No heartbeat from core client for 30 sec - exiting 22:12:09 (8017): No heartbeat from core client for 30 sec - exiting 22:12:10 (8017): No heartbeat from core client for 30 sec - exiting 22:20:12 (12645): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:48:54 (14441): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:19:21 (28141): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:44:23 (26904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:00:47 (72664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:39:16 (539): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:39:17 (539): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:35:40 (512): No heartbeat from core client for 30 sec - exiting 10:35:41 (512): No heartbeat from core client for 30 sec - exiting 10:35:42 (512): No heartbeat from core client for 30 sec - exiting 10:35:43 (512): No heartbeat from core client for 30 sec - exiting 10:35:44 (512): No heartbeat from core client for 30 sec - exiting 10:35:45 (512): No heartbeat from core client for 30 sec - exiting 10:35:48 (512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:06:56 (35091): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:37:55 (35128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:31:34 (82820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x81ff204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x81ff200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x6a00004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x6a00000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x6a00004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x6a00000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x6a00004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x6a00000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x6a00004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x6a00000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x8203204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x8211804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5438,0xac5952c0) malloc: * error for object 0x8211800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:02:37 (5438): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:29:18 (72621): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:18:06 (88366): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:15:57 (11749): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:14:18 (46458): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:14:20 (46458): No heartbeat from core client for 30 sec - exiting 23:14:21 (46458): No heartbeat from core client for 30 sec - exiting 23:27:19 (46501): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:58:06 (48351): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:07 (48351): No heartbeat from core client for 30 sec - exiting 01:58:08 (48351): No heartbeat from core client for 30 sec - exiting 01:58:09 (48351): No heartbeat from core client for 30 sec - exiting 01:58:11 (48351): No heartbeat from core client for 30 sec - exiting 02:02:31 (52780): No heartbeat from core client for 30 sec - exiting 02:02:32 (52780): No heartbeat from core client for 30 sec - exiting 02:02:33 (52780): No heartbeat from core client for 30 sec - exiting 02:02:34 (52780): No heartbeat from core client for 30 sec - exiting 02:02:35 (52780): No heartbeat from core client for 30 sec - exiting 02:02:36 (52780): No heartbeat from core client for 30 sec - exiting 02:02:37 (52780): No heartbeat from core client for 30 sec - exiting 02:02:38 (52780): No heartbeat from core client for 30 sec - exiting 02:02:39 (52780): No heartbeat from core client for 30 sec - exiting 02:02:40 (52780): No heartbeat from core client for 30 sec - exiting 02:02:41 (52780): No heartbeat from core client for 30 sec - exiting 02:02:42 (52780): No heartbeat from core client for 30 sec - exiting 02:02:43 (52780): No heartbeat from core client for 30 sec - exiting 02:02:44 (52780): No heartbeat from core client for 30 sec - exiting 02:02:45 (52780): No heartbeat from core client for 30 sec - exiting 02:02:46 (52780): No heartbeat from core client for 30 sec - exiting 02:02:47 (52780): No heartbeat from core client for 30 sec - exiting 02:02:48 (52780): No heartbeat from core client for 30 sec - exiting 02:02:49 (52780): No heartbeat from core client for 30 sec - exiting 02:02:50 (52780): No heartbeat from core client for 30 sec - exiting 02:02:51 (52780): No heartbeat from core client for 30 sec - exiting 02:02:52 (52780): No heartbeat from core client for 30 sec - exiting 02:02:53 (52780): No heartbeat from core client for 30 sec - exiting 02:02:54 (52780): No heartbeat from core client for 30 sec - exiting 02:02:55 (52780): No heartbeat from core client for 30 sec - exiting 02:02:56 (52780): No heartbeat from core client for 30 sec - exiting 02:02:57 (52780): No heartbeat from core client for 30 sec - exiting 02:02:58 (52780): No heartbeat from core client for 30 sec - exiting 02:02:59 (52780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:43 (52847): No heartbeat from core client for 30 sec - exiting 02:05:45 (52847): No heartbeat from core client for 30 sec - exiting 02:05:46 (52847): No heartbeat from core client for 30 sec - exiting 02:05:47 (52847): No heartbeat from core client for 30 sec - exiting 02:05:48 (52847): No heartbeat from core client for 30 sec - exiting 02:05:49 (52847): No heartbeat from core client for 30 sec - exiting 02:05:50 (52847): No heartbeat from core client for 30 sec - exiting 02:05:51 (52847): No heartbeat from core client for 30 sec - exiting 02:05:52 (52847): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:15:57 (52908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:15:59 (52908): No heartbeat from core client for 30 sec - exiting 02:16:00 (52908): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:49:02 (53102): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:36:29 (72651): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:48:22 (76925): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:42:21 (640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:45:08 (669): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:45:09 (669): No heartbeat from core client for 30 sec - exiting 01:45:10 (669): No heartbeat from core client for 30 sec - exiting 05:08:57 (14041): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Sun Dec 11 05:09:16 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90c7f000 - 0x90c7ffff /usr/lib/system/libkeymgr.dylib 0x91aa1000 - 0x91aaffff /usr/lib/libz.1.dylib 0x91af1000 - 0x91af5fff /usr/lib/system/libcache.dylib 0x91cd6000 - 0x91ce4fff /usr/lib/system/libdispatch.dylib 0x92218000 - 0x9221afff /usr/lib/system/libdyld.dylib 0x9248c000 - 0x9248dfff /usr/lib/system/libquarantine.dylib 0x93af2000 - 0x93b08fff /usr/lib/system/libxpc.dylib 0x94605000 - 0x9460dfff /usr/lib/system/liblaunch.dylib 0x94b8b000 - 0x94c56fff /usr/lib/system/libsystem_c.dylib 0x951b7000 - 0x951befff /usr/lib/system/libsystem_dnssd.dylib 0x95eb7000 - 0x95eb8fff /usr/lib/system/libsystem_blocks.dylib 0x9633e000 - 0x9635cfff /usr/lib/system/libsystem_kernel.dylib 0x9635d000 - 0x9638cfff /usr/lib/system/libsystem_info.dylib 0x963b4000 - 0x963bbfff /usr/lib/system/libsystem_notify.dylib 0x96546000 - 0x96549fff /usr/lib/system/libcompiler_rt.dylib 0x96b6b000 - 0x96b6cfff /usr/lib/system/libsystem_sandbox.dylib 0x96da0000 - 0x96da3fff /usr/lib/system/libmathCommon.A.dylib 0x97595000 - 0x97599fff /usr/lib/system/libsystem_network.dylib 0x983ad000 - 0x983adfff /usr/lib/system/libdnsinfo.dylib 0x98ae0000 - 0x98ae1fff /usr/lib/system/libremovefile.dylib 0x9933c000 - 0x99344fff /usr/lib/system/libcopyfile.dylib 0x9a65b000 - 0x9a660fff /usr/lib/system/libmacho.dylib 0x9ad83000 - 0x9adb1fff /usr/lib/libSystem.B.dylib 0x9b360000 - 0x9b368fff /usr/lib/system/libunwind.dylib 0x9c049000 - 0x9c08cfff /usr/lib/system/libcommonCrypto.dylib 0x9c5bc000 - 0x9c5bdfff /usr/lib/system/libunc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19622, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Sun Dec 11 05:09:20 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90c7f000 - 0x90c7ffff /usr/lib/system/libkeymgr.dylib 0x91aa1000 - 0x91aaffff /usr/lib/libz.1.dylib 0x91af1000 - 0x91af5fff /usr/lib/system/libcache.dylib 0x91cd6000 - 0x91ce4fff /usr/lib/system/libdispatch.dylib 0x92218000 - 0x9221afff /usr/lib/system/libdyld.dylib 0x9248c000 - 0x9248dfff /usr/lib/system/libquarantine.dylib 0x93af2000 - 0x93b08fff /usr/lib/system/libxpc.dylib 0x94605000 - 0x9460dfff /usr/lib/system/liblaunch.dylib 0x94b8b000 - 0x94c56fff /usr/lib/system/libsystem_c.dylib 0x951b7000 - 0x951befff /usr/lib/system/libsystem_dnssd.dylib 0x95eb7000 - 0x95eb8fff /usr/lib/system/libsystem_blocks.dylib 0x9633e000 - 0x9635cfff /usr/lib/system/libsystem_kernel.dylib 0x9635d000 - 0x9638cfff /usr/lib/system/libsystem_info.dylib 0x963b4000 - 0x963bbfff /usr/lib/system/libsystem_notify.dylib 0x96546000 - 0x96549fff /usr/lib/system/libcompiler_rt.dylib 0x96b6b000 - 0x96b6cfff /usr/lib/system/libsystem_sandbox.dylib 0x96da0000 - 0x96da3fff /usr/lib/system/libmathCommon.A.dylib 0x97595000 - 0x97599fff /usr/lib/system/libsystem_network.dylib 0x983ad000 - 0x983adfff /usr/lib/system/libdnsinfo.dylib 0x98ae0000 - 0x98ae1fff /usr/lib/system/libremovefile.dylib 0x9933c000 - 0x99344fff /usr/lib/system/libcopyfile.dylib 0x9a65b000 - 0x9a660fff /usr/lib/system/libmacho.dylib 0x9ad83000 - 0x9adb1fff /usr/lib/libSystem.B.dylib 0x9b360000 - 0x9b368fff /usr/lib/system/libunwind.dylib 0x9c049000 - 0x9c08cfff /usr/lib/system/libcommonCrypto.dylib 0x9c5bc000 - 0x9c5bdfff /usr/lib/system/libunc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19622, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Sun Dec 11 05:09:24 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90c7f000 - 0x90c7ffff /usr/lib/system/libkeymgr.dylib 0x91aa1000 - 0x91aaffff /usr/lib/libz.1.dylib 0x91af1000 - 0x91af5fff /usr/lib/system/libcache.dylib 0x91cd6000 - 0x91ce4fff /usr/lib/system/libdispatch.dylib 0x92218000 - 0x9221afff /usr/lib/system/libdyld.dylib 0x9248c000 - 0x9248dfff /usr/lib/system/libquarantine.dylib 0x93af2000 - 0x93b08fff /usr/lib/system/libxpc.dylib 0x94605000 - 0x9460dfff /usr/lib/system/liblaunch.dylib 0x94b8b000 - 0x94c56fff /usr/lib/system/libsystem_c.dylib 0x951b7000 - 0x951befff /usr/lib/system/libsystem_dnssd.dylib 0x95eb7000 - 0x95eb8fff /usr/lib/system/libsystem_blocks.dylib 0x9633e000 - 0x9635cfff /usr/lib/system/libsystem_kernel.dylib 0x9635d000 - 0x9638cfff /usr/lib/system/libsystem_info.dylib 0x963b4000 - 0x963bbfff /usr/lib/system/libsystem_notify.dylib 0x96546000 - 0x96549fff /usr/lib/system/libcompiler_rt.dylib 0x96b6b000 - 0x96b6cfff /usr/lib/system/libsystem_sandbox.dylib 0x96da0000 - 0x96da3fff /usr/lib/system/libmathCommon.A.dylib 0x97595000 - 0x97599fff /usr/lib/system/libsystem_network.dylib 0x983ad000 - 0x983adfff /usr/lib/system/libdnsinfo.dylib 0x98ae0000 - 0x98ae1fff /usr/lib/system/libremovefile.dylib 0x9933c000 - 0x99344fff /usr/lib/system/libcopyfile.dylib 0x9a65b000 - 0x9a660fff /usr/lib/system/libmacho.dylib 0x9ad83000 - 0x9adb1fff /usr/lib/libSystem.B.dylib 0x9b360000 - 0x9b368fff /usr/lib/system/libunwind.dylib 0x9c049000 - 0x9c08cfff /usr/lib/system/libcommonCrypto.dylib 0x9c5bc000 - 0x9c5bdfff /usr/lib/system/libunc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19622, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Sun Dec 11 05:09:26 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90c7f000 - 0x90c7ffff /usr/lib/system/libkeymgr.dylib 0x91aa1000 - 0x91aaffff /usr/lib/libz.1.dylib 0x91af1000 - 0x91af5fff /usr/lib/system/libcache.dylib 0x91cd6000 - 0x91ce4fff /usr/lib/system/libdispatch.dylib 0x92218000 - 0x9221afff /usr/lib/system/libdyld.dylib 0x9248c000 - 0x9248dfff /usr/lib/system/libquarantine.dylib 0x93af2000 - 0x93b08fff /usr/lib/system/libxpc.dylib 0x94605000 - 0x9460dfff /usr/lib/system/liblaunch.dylib 0x94b8b000 - 0x94c56fff /usr/lib/system/libsystem_c.dylib 0x951b7000 - 0x951befff /usr/lib/system/libsystem_dnssd.dylib 0x95eb7000 - 0x95eb8fff /usr/lib/system/libsystem_blocks.dylib 0x9633e000 - 0x9635cfff /usr/lib/system/libsystem_kernel.dylib 0x9635d000 - 0x9638cfff /usr/lib/system/libsystem_info.dylib 0x963b4000 - 0x963bbfff /usr/lib/system/libsystem_notify.dylib 0x96546000 - 0x96549fff /usr/lib/system/libcompiler_rt.dylib 0x96b6b000 - 0x96b6cfff /usr/lib/system/libsystem_sandbox.dylib 0x96da0000 - 0x96da3fff /usr/lib/system/libmathCommon.A.dylib 0x97595000 - 0x97599fff /usr/lib/system/libsystem_network.dylib 0x983ad000 - 0x983adfff /usr/lib/system/libdnsinfo.dylib 0x98ae0000 - 0x98ae1fff /usr/lib/system/libremovefile.dylib 0x9933c000 - 0x99344fff /usr/lib/system/libcopyfile.dylib 0x9a65b000 - 0x9a660fff /usr/lib/system/libmacho.dylib 0x9ad83000 - 0x9adb1fff /usr/lib/libSystem.B.dylib 0x9b360000 - 0x9b368fff /usr/lib/system/libunwind.dylib 0x9c049000 - 0x9c08cfff /usr/lib/system/libcommonCrypto.dylib 0x9c5bc000 - 0x9c5bdfff /usr/lib/system/libunc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19622, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Sun Dec 11 05:09:29 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90c7f000 - 0x90c7ffff /usr/lib/system/libkeymgr.dylib 0x91aa1000 - 0x91aaffff /usr/lib/libz.1.dylib 0x91af1000 - 0x91af5fff /usr/lib/system/libcache.dylib 0x91cd6000 - 0x91ce4fff /usr/lib/system/libdispatch.dylib 0x92218000 - 0x9221afff /usr/lib/system/libdyld.dylib 0x9248c000 - 0x9248dfff /usr/lib/system/libquarantine.dylib 0x93af2000 - 0x93b08fff /usr/lib/system/libxpc.dylib 0x94605000 - 0x9460dfff /usr/lib/system/liblaunch.dylib 0x94b8b000 - 0x94c56fff /usr/lib/system/libsystem_c.dylib 0x951b7000 - 0x951befff /usr/lib/system/libsystem_dnssd.dylib 0x95eb7000 - 0x95eb8fff /usr/lib/system/libsystem_blocks.dylib 0x9633e000 - 0x9635cfff /usr/lib/system/libsystem_kernel.dylib 0x9635d000 - 0x9638cfff /usr/lib/system/libsystem_info.dylib 0x963b4000 - 0x963bbfff /usr/lib/system/libsystem_notify.dylib 0x96546000 - 0x96549fff /usr/lib/system/libcompiler_rt.dylib 0x96b6b000 - 0x96b6cfff /usr/lib/system/libsystem_sandbox.dylib 0x96da0000 - 0x96da3fff /usr/lib/system/libmathCommon.A.dylib 0x97595000 - 0x97599fff /usr/lib/system/libsystem_network.dylib 0x983ad000 - 0x983adfff /usr/lib/system/libdnsinfo.dylib 0x98ae0000 - 0x98ae1fff /usr/lib/system/libremovefile.dylib 0x9933c000 - 0x99344fff /usr/lib/system/libcopyfile.dylib 0x9a65b000 - 0x9a660fff /usr/lib/system/libmacho.dylib 0x9ad83000 - 0x9adb1fff /usr/lib/libSystem.B.dylib 0x9b360000 - 0x9b368fff /usr/lib/system/libunwind.dylib 0x9c049000 - 0x9c08cfff /usr/lib/system/libcommonCrypto.dylib 0x9c5bc000 - 0x9c5bdfff /usr/lib/system/libunc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19622, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Sun Dec 11 05:09:33 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90c7f000 - 0x90c7ffff /usr/lib/system/libkeymgr.dylib 0x91aa1000 - 0x91aaffff /usr/lib/libz.1.dylib 0x91af1000 - 0x91af5fff /usr/lib/system/libcache.dylib 0x91cd6000 - 0x91ce4fff /usr/lib/system/libdispatch.dylib 0x92218000 - 0x9221afff /usr/lib/system/libdyld.dylib 0x9248c000 - 0x9248dfff /usr/lib/system/libquarantine.dylib 0x93af2000 - 0x93b08fff /usr/lib/system/libxpc.dylib 0x94605000 - 0x9460dfff /usr/lib/system/liblaunch.dylib 0x94b8b000 - 0x94c56fff /usr/lib/system/libsystem_c.dylib 0x951b7000 - 0x951befff /usr/lib/system/libsystem_dnssd.dylib 0x95eb7000 - 0x95eb8fff /usr/lib/system/libsystem_blocks.dylib 0x9633e000 - 0x9635cfff /usr/lib/system/libsystem_kernel.dylib 0x9635d000 - 0x9638cfff /usr/lib/system/libsystem_info.dylib 0x963b4000 - 0x963bbfff /usr/lib/system/libsystem_notify.dylib 0x96546000 - 0x96549fff /usr/lib/system/libcompiler_rt.dylib 0x96b6b000 - 0x96b6cfff /usr/lib/system/libsystem_sandbox.dylib 0x96da0000 - 0x96da3fff /usr/lib/system/libmathCommon.A.dylib 0x97595000 - 0x97599fff /usr/lib/system/libsystem_network.dylib 0x983ad000 - 0x983adfff /usr/lib/system/libdnsinfo.dylib 0x98ae0000 - 0x98ae1fff /usr/lib/system/libremovefile.dylib 0x9933c000 - 0x99344fff /usr/lib/system/libcopyfile.dylib 0x9a65b000 - 0x9a660fff /usr/lib/system/libmacho.dylib 0x9ad83000 - 0x9adb1fff /usr/lib/libSystem.B.dylib 0x9b360000 - 0x9b368fff /usr/lib/system/libunwind.dylib 0x9c049000 - 0x9c08cfff /usr/lib/system/libcommonCrypto.dylib 0x9c5bc000 - 0x9c5bdfff /usr/lib/system/libunc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19622, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Dec 2011 12:28:33	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	336,960	694,525	2.0611
07 Dec 2011 11:07:31	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	311,040	641,372	2.0620
06 Dec 2011 11:50:47	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	285,120	588,369	2.0636
05 Dec 2011 13:17:14	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	259,200	535,092	2.0644
04 Dec 2011 13:56:13	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	233,280	482,181	2.0670
03 Dec 2011 13:27:20	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	207,360	427,217	2.0603
01 Dec 2011 03:49:06	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	181,440	374,081	2.0617
30 Nov 2011 06:30:47	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	155,520	320,738	2.0624
29 Nov 2011 01:28:39	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	129,600	265,467	2.0484
27 Nov 2011 08:25:37	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	103,680	211,330	2.0383
26 Nov 2011 11:10:11	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	77,760	158,471	2.0380
25 Nov 2011 13:42:13	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	51,840	105,542	2.0359
24 Nov 2011 16:13:33	1159853	13539037	hadcm3n_ygqk_1900_40_007516680_1	25,920	52,840	2.0386