Task 12929271

Name	hadcm3n_o3zy_1940_40_007267796_1
Workunit	7466036
Created	3 Jun 2011, 5:40:19 UTC
Sent	3 Jun 2011, 5:40:26 UTC
Report deadline	2 Sep 2011, 13:07:37 UTC
Received	27 Jun 2011, 5:18:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1127383
Run time	5 days 16 hours 47 min 13 sec
CPU time	5 days 13 hours 5 min 25 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.85 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.59</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:36:15 (2353): No heartbeat from core client for 30 sec - exiting 20:36:16 (2353): No heartbeat from core client for 30 sec - exiting 20:36:17 (2353): No heartbeat from core client for 30 sec - exiting 20:36:18 (2353): No heartbeat from core client for 30 sec - exiting 20:36:19 (2353): No heartbeat from core client for 30 sec - exiting 20:36:21 (2353): No heartbeat from core client for 30 sec - exiting 20:36:22 (2353): No heartbeat from core client for 30 sec - exiting 20:36:23 (2353): No heartbeat from core client for 30 sec - exiting 20:36:24 (2353): No heartbeat from core client for 30 sec - exiting 20:36:27 (2353): No heartbeat from core client for 30 sec - exiting 20:36:28 (2353): No heartbeat from core client for 30 sec - exiting 20:36:29 (2353): No heartbeat from core client for 30 sec - exiting 20:36:30 (2353): No heartbeat from core client for 30 sec - exiting 20:36:31 (2353): No heartbeat from core client for 30 sec - exiting 20:36:32 (2353): No heartbeat from core client for 30 sec - exiting 20:36:33 (2353): No heartbeat from core client for 30 sec - exiting 20:36:34 (2353): No heartbeat from core client for 30 sec - exiting 20:36:35 (2353): No heartbeat from core client for 30 sec - exiting 20:36:36 (2353): No heartbeat from core client for 30 sec - exiting 20:36:37 (2353): No heartbeat from core client for 30 sec - exiting 20:36:38 (2353): No heartbeat from core client for 30 sec - exiting 20:36:39 (2353): No heartbeat from core client for 30 sec - exiting 20:36:41 (2353): No heartbeat from core client for 30 sec - exiting 20:36:42 (2353): No heartbeat from core client for 30 sec - exiting 20:36:43 (2353): No heartbeat from core client for 30 sec - exiting 20:36:44 (2353): No heartbeat from core client for 30 sec - exiting 20:36:45 (2353): No heartbeat from core client for 30 sec - exiting 20:36:46 (2353): No heartbeat from core client for 30 sec - exiting 20:36:47 (2353): No heartbeat from core client for 30 sec - exiting 20:36:48 (2353): No heartbeat from core client for 30 sec - exiting 20:36:49 (2353): No heartbeat from core client for 30 sec - exiting 20:36:51 (2353): No heartbeat from core client for 30 sec - exiting 20:36:52 (2353): No heartbeat from core client for 30 sec - exiting 20:36:53 (2353): No heartbeat from core client for 30 sec - exiting 20:36:54 (2353): No heartbeat from core client for 30 sec - exiting 20:36:55 (2353): No heartbeat from core client for 30 sec - exiting 20:36:57 (2353): No heartbeat from core client for 30 sec - exiting 20:36:58 (2353): No heartbeat from core client for 30 sec - exiting 20:36:59 (2353): No heartbeat from core client for 30 sec - exiting 20:37:00 (2353): No heartbeat from core client for 30 sec - exiting 20:37:01 (2353): No heartbeat from core client for 30 sec - exiting 20:37:02 (2353): No heartbeat from core client for 30 sec - exiting 20:37:03 (2353): No heartbeat from core client for 30 sec - exiting 20:37:04 (2353): No heartbeat from core client for 30 sec - exiting 20:37:06 (2353): No heartbeat from core client for 30 sec - exiting 20:37:07 (2353): No heartbeat from core client for 30 sec - exiting 20:37:08 (2353): No heartbeat from core client for 30 sec - exiting 20:37:09 (2353): No heartbeat from core client for 30 sec - exiting 20:37:10 (2353): No heartbeat from core client for 30 sec - exiting 20:37:12 (2353): No heartbeat from core client for 30 sec - exiting 20:37:13 (2353): No heartbeat from core client for 30 sec - exiting 20:37:14 (2353): No heartbeat from core client for 30 sec - exiting 20:37:15 (2353): No heartbeat from core client for 30 sec - exiting 20:37:16 (2353): No heartbeat from core client for 30 sec - exiting 20:37:17 (2353): No heartbeat from core client for 30 sec - exiting 20:37:18 (2353): No heartbeat from core client for 30 sec - exiting 20:37:19 (2353): No heartbeat from core client for 30 sec - exiting 20:37:21 (2353): No heartbeat from core client for 30 sec - exiting 20:37:22 (2353): No heartbeat from core client for 30 sec - exiting 20:37:23 (2353): No heartbeat from core client for 30 sec - exiting 20:37:24 (2353): No heartbeat from core client for 30 sec - exiting 20:37:25 (2353): No heartbeat from core client for 30 sec - exiting 20:37:26 (2353): No heartbeat from core client for 30 sec - exiting 20:37:27 (2353): No heartbeat from core client for 30 sec - exiting 20:37:28 (2353): No heartbeat from core client for 30 sec - exiting 20:37:29 (2353): No heartbeat from core client for 30 sec - exiting 20:37:30 (2353): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:11 (2381): No heartbeat from core client for 30 sec - exiting 20:40:12 (2381): No heartbeat from core client for 30 sec - exiting 20:40:13 (2381): No heartbeat from core client for 30 sec - exiting 20:40:14 (2381): No heartbeat from core client for 30 sec - exiting 20:40:15 (2381): No heartbeat from core client for 30 sec - exiting 20:40:17 (2381): No heartbeat from core client for 30 sec - exiting 20:40:18 (2381): No heartbeat from core client for 30 sec - exiting 20:40:19 (2381): No heartbeat from core client for 30 sec - exiting 20:40:20 (2381): No heartbeat from core client for 30 sec - exiting 20:40:21 (2381): No heartbeat from core client for 30 sec - exiting 20:40:22 (2381): No heartbeat from core client for 30 sec - exiting 20:40:23 (2381): No heartbeat from core client for 30 sec - exiting 20:40:24 (2381): No heartbeat from core client for 30 sec - exiting 20:40:25 (2381): No heartbeat from core client for 30 sec - exiting 20:40:26 (2381): No heartbeat from core client for 30 sec - exiting 20:40:27 (2381): No heartbeat from core client for 30 sec - exiting 20:40:28 (2381): No heartbeat from core client for 30 sec - exiting 20:40:29 (2381): No heartbeat from core client for 30 sec - exiting 20:40:30 (2381): No heartbeat from core client for 30 sec - exiting 20:40:31 (2381): No heartbeat from core client for 30 sec - exiting 20:40:32 (2381): No heartbeat from core client for 30 sec - exiting 20:40:33 (2381): No heartbeat from core client for 30 sec - exiting 20:40:34 (2381): No heartbeat from core client for 30 sec - exiting 20:40:35 (2381): No heartbeat from core client for 30 sec - exiting 20:40:36 (2381): No heartbeat from core client for 30 sec - exiting 20:40:37 (2381): No heartbeat from core client for 30 sec - exiting 20:40:38 (2381): No heartbeat from core client for 30 sec - exiting 20:40:39 (2381): No heartbeat from core client for 30 sec - exiting 20:40:40 (2381): No heartbeat from core client for 30 sec - exiting 20:40:41 (2381): No heartbeat from core client for 30 sec - exiting 20:40:43 (2381): No heartbeat from core client for 30 sec - exiting 20:40:44 (2381): No heartbeat from core client for 30 sec - exiting 20:40:45 (2381): No heartbeat from core client for 30 sec - exiting 20:40:46 (2381): No heartbeat from core client for 30 sec - exiting 20:40:47 (2381): No heartbeat from core client for 30 sec - exiting 20:40:48 (2381): No heartbeat from core client for 30 sec - exiting 20:40:49 (2381): No heartbeat from core client for 30 sec - exiting 20:40:50 (2381): No heartbeat from core client for 30 sec - exiting 20:40:51 (2381): No heartbeat from core client for 30 sec - exiting 20:40:52 (2381): No heartbeat from core client for 30 sec - exiting 20:40:53 (2381): No heartbeat from core client for 30 sec - exiting 20:40:55 (2381): No heartbeat from core client for 30 sec - exiting 20:40:56 (2381): No heartbeat from core client for 30 sec - exiting 20:40:57 (2381): No heartbeat from core client for 30 sec - exiting 20:40:58 (2381): No heartbeat from core client for 30 sec - exiting 20:40:59 (2381): No heartbeat from core client for 30 sec - exiting 20:41:01 (2381): No heartbeat from core client for 30 sec - exiting 20:41:02 (2381): No heartbeat from core client for 30 sec - exiting 20:41:03 (2381): No heartbeat from core client for 30 sec - exiting 20:41:04 (2381): No heartbeat from core client for 30 sec - exiting 20:41:06 (2381): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:04 (2556): No heartbeat from core client for 30 sec - exiting 20:44:05 (2556): No heartbeat from core client for 30 sec - exiting 20:44:06 (2556): No heartbeat from core client for 30 sec - exiting 20:44:07 (2556): No heartbeat from core client for 30 sec - exiting 20:44:08 (2556): No heartbeat from core client for 30 sec - exiting 20:44:40 (2556): No heartbeat from core client for 30 sec - exiting 20:44:41 (2556): No heartbeat from core client for 30 sec - exiting 20:44:42 (2556): No heartbeat from core client for 30 sec - exiting 20:44:43 (2556): No heartbeat from core client for 30 sec - exiting 20:44:44 (2556): No heartbeat from core client for 30 sec - exiting 20:44:45 (2556): No heartbeat from core client for 30 sec - exiting 20:44:46 (2556): No heartbeat from core client for 30 sec - exiting 20:44:47 (2556): No heartbeat from core client for 30 sec - exiting 20:44:48 (2556): No heartbeat from core client for 30 sec - exiting 20:44:49 (2556): No heartbeat from core client for 30 sec - exiting 20:44:50 (2556): No heartbeat from core client for 30 sec - exiting 20:44:51 (2556): No heartbeat from core client for 30 sec - exiting 20:44:52 (2556): No heartbeat from core client for 30 sec - exiting 20:44:53 (2556): No heartbeat from core client for 30 sec - exiting 20:44:56 (2556): No heartbeat from core client for 30 sec - exiting 20:44:57 (2556): No heartbeat from core client for 30 sec - exiting 20:44:58 (2556): No heartbeat from core client for 30 sec - exiting 20:45:00 (2556): No heartbeat from core client for 30 sec - exiting 20:45:01 (2556): No heartbeat from core client for 30 sec - exiting 20:45:02 (2556): No heartbeat from core client for 30 sec - exiting 20:45:03 (2556): No heartbeat from core client for 30 sec - exiting 20:45:04 (2556): No heartbeat from core client for 30 sec - exiting 20:45:05 (2556): No heartbeat from core client for 30 sec - exiting 20:45:06 (2556): No heartbeat from core client for 30 sec - exiting 20:45:07 (2556): No heartbeat from core client for 30 sec - exiting 20:45:08 (2556): No heartbeat from core client for 30 sec - exiting 20:45:09 (2556): No heartbeat from core client for 30 sec - exiting 20:45:10 (2556): No heartbeat from core client for 30 sec - exiting 20:45:11 (2556): No heartbeat from core client for 30 sec - exiting 20:45:12 (2556): No heartbeat from core client for 30 sec - exiting 20:45:13 (2556): No heartbeat from core client for 30 sec - exiting 20:45:14 (2556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:40 (2572): No heartbeat from core client for 30 sec - exiting 20:49:41 (2572): No heartbeat from core client for 30 sec - exiting 20:49:42 (2572): No heartbeat from core client for 30 sec - exiting 20:49:43 (2572): No heartbeat from core client for 30 sec - exiting 20:49:44 (2572): No heartbeat from core client for 30 sec - exiting 20:49:46 (2572): No heartbeat from core client for 30 sec - exiting 20:49:47 (2572): No heartbeat from core client for 30 sec - exiting 20:49:48 (2572): No heartbeat from core client for 30 sec - exiting 20:49:49 (2572): No heartbeat from core client for 30 sec - exiting 20:49:50 (2572): No heartbeat from core client for 30 sec - exiting 20:49:51 (2572): No heartbeat from core client for 30 sec - exiting 20:49:52 (2572): No heartbeat from core client for 30 sec - exiting 20:49:53 (2572): No heartbeat from core client for 30 sec - exiting 20:49:54 (2572): No heartbeat from core client for 30 sec - exiting 20:49:55 (2572): No heartbeat from core client for 30 sec - exiting 20:49:56 (2572): No heartbeat from core client for 30 sec - exiting 20:49:57 (2572): No heartbeat from core client for 30 sec - exiting 20:49:58 (2572): No heartbeat from core client for 30 sec - exiting 20:49:59 (2572): No heartbeat from core client for 30 sec - exiting 20:50:00 (2572): No heartbeat from core client for 30 sec - exiting 20:50:01 (2572): No heartbeat from core client for 30 sec - exiting 20:50:02 (2572): No heartbeat from core client for 30 sec - exiting 20:50:03 (2572): No heartbeat from core client for 30 sec - exiting 20:50:04 (2572): No heartbeat from core client for 30 sec - exiting 20:50:05 (2572): No heartbeat from core client for 30 sec - exiting 20:50:36 (2572): No heartbeat from core client for 30 sec - exiting 20:50:37 (2572): No heartbeat from core client for 30 sec - exiting 20:50:38 (2572): No heartbeat from core client for 30 sec - exiting 20:50:39 (2572): No heartbeat from core client for 30 sec - exiting 20:50:40 (2572): No heartbeat from core client for 30 sec - exiting 20:50:41 (2572): No heartbeat from core client for 30 sec - exiting 20:50:42 (2572): No heartbeat from core client for 30 sec - exiting 20:50:43 (2572): No heartbeat from core client for 30 sec - exiting 20:50:44 (2572): No heartbeat from core client for 30 sec - exiting 20:50:45 (2572): No heartbeat from core client for 30 sec - exiting 20:50:46 (2572): No heartbeat from core client for 30 sec - exiting 20:50:47 (2572): No heartbeat from core client for 30 sec - exiting 20:50:48 (2572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:43 (2582): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09d4a788 *** ======= Backtrace: ========= /lib/i386-linux-gnu/libc.so.6(+0x6b961)[0x40b961] /lib/i386-linux-gnu/libc.so.6(+0x6d28b)[0x40d28b] /lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x41041d] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x21)[0x35f4d1] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1d)[0x35f52d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xe7)[0x3b6e37] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 00157000-00158000 r-xp 00000000 00:00 0 [vdso] 001d4000-001f8000 r-xp 00000000 08:01 2493938 /lib/i386-linux-gnu/libm-2.13.so 001f8000-001f9000 r--p 00023000 08:01 2493938 /lib/i386-linux-gnu/libm-2.13.so 001f9000-001fa000 rw-p 00024000 08:01 2493938 /lib/i386-linux-gnu/libm-2.13.so 002b5000-00394000 r-xp 00000000 08:01 26611435 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.14 00394000-00398000 r--p 000de000 08:01 26611435 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.14 00398000-00399000 rw-p 000e2000 08:01 26611435 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.14 00399000-003a0000 rw-p 00000000 00:00 0 003a0000-004fa000 r-xp 00000000 08:01 2493920 /lib/i386-linux-gnu/libc-2.13.so 004fa000-004fb000 ---p 0015a000 08:01 2493920 /lib/i386-linux-gnu/libc-2.13.so 004fb000-004fd000 r--p 0015a000 08:01 2493920 /lib/i386-linux-gnu/libc-2.13.so 004fd000-004fe000 rw-p 0015c000 08:01 2493920 /lib/i386-linux-gnu/libc-2.13.so 004fe000-00501000 rw-p 00000000 00:00 0 00565000-00581000 r-xp 00000000 08:01 2493939 /lib/i386-linux-gnu/ld-2.13.so 00581000-00582000 r--p 0001b000 08:01 2493939 /lib/i386-linux-gnu/ld-2.13.so 00582000-00583000 rw-p 0001c000 08:01 2493939 /lib/i386-linux-gnu/ld-2.13.so 00731000-0074b000 r-xp 00000000 08:01 2494026 /lib/i386-linux-gnu/libgcc_s.so.1 0074b000-0074c000 r--p 00019000 08:01 2494026 /lib/i386-linux-gnu/libgcc_s.so.1 0074c000-0074d000 rw-p 0001a000 08:01 2494026 /lib/i386-linux-gnu/libgcc_s.so.1 007e6000-007fb000 r-xp 00000000 08:01 2493934 /lib/i386-linux-gnu/libpthread-2.13.so 007fb000-007fc000 r--p 00015000 08:01 2493934 /lib/i386-linux-gnu/libpthread-2.13.so 007fc000-007fd000 rw-p 00016000 08:01 2493934 /lib/i386-linux-gnu/libpthread-2.13.so 007fd000-007ff000 rw-p 00000000 00:00 0 00dda000-00ddc000 r-xp 00000000 08:01 2493936 /lib/i386-linux-gnu/libdl-2.13.so 00ddc000-00ddd000 r--p 00001000 08:01 2493936 /lib/i386-linux-gnu/libdl-2.13.so 00ddd000-00dde000 rw-p 00002000 08:01 2493936 /lib/i386-linux-gnu/libdl-2.13.so 08048000-080e3000 r-xp 00000000 08:01 8782044 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:01 8782044 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09cf5000-09d5a000 rw-p 00000000 00:00 0 [heap] b7200000-b7221000 rw-p 00000000 00:00 0 b7221000-b7300000 ---p 00000000 00:00 0 b733d000-b77b8000 rw-s 00000000 08:01 8782360 /var/lib/boinc-client/slots/5/139750 b77b8000-b77bc000 rw-p 00000000 00:00 0 b77c7000-b77c8000 rw-p 00000000 00:00 0 b77c8000-b77c9000 ---p 00000000 00:00 0 b77c9000-b77cc000 rw-p 00000000 00:00 0 b77cc000-b77ce000 rw-s 00000000 08:01 8782278 /var/lib/boinc-client/slots/5/boinc_mmap_file b77ce000-b77d0000 rw-p 00000000 00:00 0 bfcf7000-bfd67000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0x157400] [0x157416] /lib/i386-linux-gnu/libc.so.6(gsignal+0x51)[0x3cae71] /lib/i386-linux-gnu/libc.so.6(abort+0x17e)[0x3ce34e] /lib/i386-linux-gnu/libc.so.6(+0x61577)[0x401577] /lib/i386-linux-gnu/libc.so.6(+0x6b961)[0x40b961] /lib/i386-linux-gnu/libc.so.6(+0x6d28b)[0x40d28b] /lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x41041d] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x21)[0x35f4d1] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1d)[0x35f52d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xe7)[0x3b6e37] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jun 2011 20:20:07	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	259,200	479,120	1.8485
23 Jun 2011 14:39:05	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	233,280	430,854	1.8469
22 Jun 2011 21:02:40	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	207,360	383,584	1.8498
21 Jun 2011 18:18:49	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	181,440	335,441	1.8488
19 Jun 2011 23:40:58	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	155,520	287,781	1.8504
19 Jun 2011 22:38:56	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	129,600	237,882	1.8355
16 Jun 2011 14:52:33	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	103,680	189,481	1.8276
12 Jun 2011 09:53:40	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	77,760	141,470	1.8193
10 Jun 2011 09:44:18	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	51,840	94,701	1.8268
08 Jun 2011 06:49:14	1127383	12929271	hadcm3n_o3zy_1940_40_007267796_1	25,920	47,037	1.8147