Task 13626694

Name	hadcm3n_o0be_1940_40_007543413_1
Workunit	7740645
Created	10 Nov 2011, 1:33:14 UTC
Sent	16 Nov 2011, 8:42:13 UTC
Report deadline	15 Feb 2012, 16:09:24 UTC
Received	23 Dec 2011, 0:29:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1145333
Run time	19 days 8 hours 35 min 32 sec
CPU time	19 days 8 hours 35 min 32 sec
Validate state	Invalid
Credit	11,819.52
Device peak FLOPS	3.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.4.5</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> nd request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:02:57 (24256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:06:21 (24584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:10:17 (24603): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:15:38 (24631): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:19:39 (24720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:19 (24728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:25:05 (24732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:29:29 (24749): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:38:16 (24833): No heartbeat from core client for 30 sec - exiting 23:38:19 (24833): No heartbeat from core client for 30 sec - exiting 23:38:20 (24833): No heartbeat from core client for 30 sec - exiting 23:38:21 (24833): No heartbeat from core client for 30 sec - exiting 23:38:22 (24833): No heartbeat from core client for 30 sec - exiting 23:38:23 (24833): No heartbeat from core client for 30 sec - exiting 23:38:24 (24833): No heartbeat from core client for 30 sec - exiting 23:38:25 (24833): No heartbeat from core client for 30 sec - exiting 23:38:26 (24833): No heartbeat from core client for 30 sec - exiting 23:38:27 (24833): No heartbeat from core client for 30 sec - exiting 23:38:28 (24833): No heartbeat from core client for 30 sec - exiting 23:38:29 (24833): No heartbeat from core client for 30 sec - exiting 23:38:30 (24833): No heartbeat from core client for 30 sec - exiting 23:38:31 (24833): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:32 (24833): No heartbeat from core client for 30 sec - exiting 23:38:33 (24833): No heartbeat from core client for 30 sec - exiting 23:38:34 (24833): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:44:12 (24864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:47:07 (24909): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:51:22 (25018): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:57:32 (25028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:01:00 (25079): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:04:46 (25109): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:07:56 (25115): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:16:38 (25141): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:22:53 (25192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:28:32 (25226): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:28:33 (25226): No heartbeat from core client for 30 sec - exiting 00:28:34 (25226): No heartbeat from core client for 30 sec - exiting 00:28:35 (25226): No heartbeat from core client for 30 sec - exiting 00:28:36 (25226): No heartbeat from core client for 30 sec - exiting 00:28:37 (25226): No heartbeat from core client for 30 sec - exiting 00:28:38 (25226): No heartbeat from core client for 30 sec - exiting 00:28:39 (25226): No heartbeat from core client for 30 sec - exiting 00:28:40 (25226): No heartbeat from core client for 30 sec - exiting 00:28:41 (25226): No heartbeat from core client for 30 sec - exiting 00:28:42 (25226): No heartbeat from core client for 30 sec - exiting 00:28:43 (25226): No heartbeat from core client for 30 sec - exiting 00:28:44 (25226): No heartbeat from core client for 30 sec - exiting 00:28:45 (25226): No heartbeat from core client for 30 sec - exiting 00:28:46 (25226): No heartbeat from core client for 30 sec - exiting 00:28:47 (25226): No heartbeat from core client for 30 sec - exiting 00:28:48 (25226): No heartbeat from core client for 30 sec - exiting 00:28:49 (25226): No heartbeat from core client for 30 sec - exiting 00:28:50 (25226): No heartbeat from core client for 30 sec - exiting 00:28:51 (25226): No heartbeat from core client for 30 sec - exiting 00:28:52 (25226): No heartbeat from core client for 30 sec - exiting 00:28:53 (25226): No heartbeat from core client for 30 sec - exiting 00:28:54 (25226): No heartbeat from core client for 30 sec - exiting 00:28:55 (25226): No heartbeat from core client for 30 sec - exiting SIGABRT: abort called 00:35:42 (25288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:43 (25288): No heartbeat from core client for 30 sec - exiting 00:35:44 (25288): No heartbeat from core client for 30 sec - exiting 00:35:45 (25288): No heartbeat from core client for 30 sec - exiting 00:35:46 (25288): No heartbeat from core client for 30 sec - exiting 00:35:47 (25288): No heartbeat from core client for 30 sec - exiting 00:35:48 (25288): No heartbeat from core client for 30 sec - exiting 00:35:49 (25288): No heartbeat from core client for 30 sec - exiting 00:35:50 (25288): No heartbeat from core client for 30 sec - exiting 00:35:51 (25288): No heartbeat from core client for 30 sec - exiting 00:35:52 (25288): No heartbeat from core client for 30 sec - exiting 00:35:53 (25288): No heartbeat from core client for 30 sec - exiting 00:35:54 (25288): No heartbeat from core client for 30 sec - exiting 00:35:55 (25288): No heartbeat from core client for 30 sec - exiting 00:35:56 (25288): No heartbeat from core client for 30 sec - exiting 00:35:57 (25288): No heartbeat from core client for 30 sec - exiting 00:35:58 (25288): No heartbeat from core client for 30 sec - exiting 00:35:59 (25288): No heartbeat from core client for 30 sec - exiting 00:36:00 (25288): No heartbeat from core client for 30 sec - exiting 00:36:01 (25288): No heartbeat from core client for 30 sec - exiting 00:36:02 (25288): No heartbeat from core client for 30 sec - exiting 00:36:03 (25288): No heartbeat from core client for 30 sec - exiting 00:36:04 (25288): No heartbeat from core client for 30 sec - exiting 00:36:05 (25288): No heartbeat from core client for 30 sec - exiting 00:36:06 (25288): No heartbeat from core client for 30 sec - exiting 00:36:07 (25288): No heartbeat from core client for 30 sec - exiting 00:36:08 (25288): No heartbeat from core client for 30 sec - exiting 00:36:09 (25288): No heartbeat from core client for 30 sec - exiting 00:36:10 (25288): No heartbeat from core client for 30 sec - exiting 00:36:11 (25288): No heartbeat from core client for 30 sec - exiting 00:36:12 (25288): No heartbeat from core client for 30 sec - exiting 00:36:13 (25288): No heartbeat from core client for 30 sec - exiting 00:36:14 (25288): No heartbeat from core client for 30 sec - exiting 00:36:15 (25288): No heartbeat from core client for 30 sec - exiting 00:36:16 (25288): No heartbeat from core client for 30 sec - exiting 00:36:17 (25288): No heartbeat from core client for 30 sec - exiting 00:36:18 (25288): No heartbeat from core client for 30 sec - exiting 00:36:19 (25288): No heartbeat from core client for 30 sec - exiting 00:36:20 (25288): No heartbeat from core client for 30 sec - exiting 00:36:21 (25288): No heartbeat from core client for 30 sec - exiting 00:36:22 (25288): No heartbeat from core client for 30 sec - exiting 00:36:23 (25288): No heartbeat from core client for 30 sec - exiting 00:36:24 (25288): No heartbeat from core client for 30 sec - exiting 00:36:25 (25288): No heartbeat from core client for 30 sec - exiting 00:36:26 (25288): No heartbeat from core client for 30 sec - exiting 00:36:27 (25288): No heartbeat from core client for 30 sec - exiting 00:36:28 (25288): No heartbeat from core client for 30 sec - exiting 00:36:29 (25288): No heartbeat from core client for 30 sec - exiting 00:36:30 (25288): No heartbeat from core client for 30 sec - exiting 00:36:31 (25288): No heartbeat from core client for 30 sec - exiting 00:36:32 (25288): No heartbeat from core client for 30 sec - exiting 00:36:33 (25288): No heartbeat from core client for 30 sec - exiting 00:36:34 (25288): No heartbeat from core client for 30 sec - exiting 00:36:35 (25288): No heartbeat from core client for 30 sec - exiting 00:36:36 (25288): No heartbeat from core client for 30 sec - exiting 00:36:37 (25288): No heartbeat from core client for 30 sec - exiting 00:36:38 (25288): No heartbeat from core client for 30 sec - exiting 00:36:39 (25288): No heartbeat from core client for 30 sec - exiting 00:36:40 (25288): No heartbeat from core client for 30 sec - exiting 00:36:41 (25288): No heartbeat from core client for 30 sec - exiting 00:36:42 (25288): No heartbeat from core client for 30 sec - exiting 00:36:43 (25288): No heartbeat from core client for 30 sec - exiting 00:36:44 (25288): No heartbeat from core client for 30 sec - exiting 00:36:45 (25288): No heartbeat from core client for 30 sec - exiting 00:36:46 (25288): No heartbeat from core client for 30 sec - exiting 00:36:47 (25288): No heartbeat from core client for 30 sec - exiting 00:36:48 (25288): No heartbeat from core client for 30 sec - exiting 00:36:49 (25288): No heartbeat from core client for 30 sec - exiting 00:36:50 (25288): No heartbeat from core client for 30 sec - exiting 00:36:51 (25288): No heartbeat from core client for 30 sec - exiting 00:36:52 (25288): No heartbeat from core client for 30 sec - exiting 00:36:53 (25288): No heartbeat from core client for 30 sec - exiting 00:36:54 (25288): No heartbeat from core client for 30 sec - exiting 00:36:55 (25288): No heartbeat from core client for 30 sec - exiting 00:36:56 (25288): No heartbeat from core client for 30 sec - exiting 00:36:57 (25288): No heartbeat from core client for 30 sec - exiting 00:36:58 (25288): No heartbeat from core client for 30 sec - exiting 00:36:59 (25288): No heartbeat from core client for 30 sec - exiting 00:37:00 (25288): No heartbeat from core client for 30 sec - exiting 00:37:01 (25288): No heartbeat from core client for 30 sec - exiting 00:37:02 (25288): No heartbeat from core client for 30 sec - exiting 00:37:03 (25288): No heartbeat from core client for 30 sec - exiting 00:37:04 (25288): No heartbeat from core client for 30 sec - exiting 00:37:05 (25288): No heartbeat from core client for 30 sec - exiting 00:37:06 (25288): No heartbeat from core client for 30 sec - exiting 00:37:07 (25288): No heartbeat from core client for 30 sec - exiting 00:37:08 (25288): No heartbeat from core client for 30 sec - exiting 00:37:09 (25288): No heartbeat from core client for 30 sec - exiting 00:37:10 (25288): No heartbeat from core client for 30 sec - exiting 00:37:11 (25288): No heartbeat from core client for 30 sec - exiting 00:37:12 (25288): No heartbeat from core client for 30 sec - exiting 00:37:13 (25288): No heartbeat from core client for 30 sec - exiting 00:37:14 (25288): No heartbeat from core client for 30 sec - exiting 00:37:15 (25288): No heartbeat from core client for 30 sec - exiting 00:37:16 (25288): No heartbeat from core client for 30 sec - exiting 00:37:17 (25288): No heartbeat from core client for 30 sec - exiting 00:37:18 (25288): No heartbeat from core client for 30 sec - exiting 00:37:19 (25288): No heartbeat from core client for 30 sec - exiting 00:37:20 (25288): No heartbeat from core client for 30 sec - exiting 00:37:21 (25288): No heartbeat from core client for 30 sec - exiting 00:37:22 (25288): No heartbeat from core client for 30 sec - exiting 00:37:23 (25288): No heartbeat from core client for 30 sec - exiting 00:37:24 (25288): No heartbeat from core client for 30 sec - exiting 00:37:25 (25288): No heartbeat from core client for 30 sec - exiting 00:37:26 (25288): No heartbeat from core client for 30 sec - exiting 00:37:27 (25288): No heartbeat from core client for 30 sec - exiting 00:37:28 (25288): No heartbeat from core client for 30 sec - exiting 00:37:29 (25288): No heartbeat from core client for 30 sec - exiting 00:37:30 (25288): No heartbeat from core client for 30 sec - exiting 00:37:31 (25288): No heartbeat from core client for 30 sec - exiting 00:37:32 (25288): No heartbeat from core client for 30 sec - exiting 00:37:33 (25288): No heartbeat from core client for 30 sec - exiting 00:37:34 (25288): No heartbeat from core client for 30 sec - exiting 00:37:35 (25288): No heartbeat from core client for 30 sec - exiting 00:37:36 (25288): No heartbeat from core client for 30 sec - exiting 00:37:37 (25288): No heartbeat from core client for 30 sec - exiting 00:37:38 (25288): No heartbeat from core client for 30 sec - exiting 00:37:39 (25288): No heartbeat from core client for 30 sec - exiting 00:37:40 (25288): No heartbeat from core client for 30 sec - exiting 00:37:41 (25288): No heartbeat from core client for 30 sec - exiting 00:37:42 (25288): No heartbeat from core client for 30 sec - exiting 00:37:43 (25288): No heartbeat from core client for 30 sec - exiting 00:37:44 (25288): No heartbeat from core client for 30 sec - exiting 00:37:45 (25288): No heartbeat from core client for 30 sec - exiting 00:37:46 (25288): No heartbeat from core client for 30 sec - exiting 00:37:47 (25288): No heartbeat from core client for 30 sec - exiting 00:37:48 (25288): No heartbeat from core client for 30 sec - exiting 00:37:49 (25288): No heartbeat from core client for 30 sec - exiting 00:37:50 (25288): No heartbeat from core client for 30 sec - exiting 00:37:51 (25288): No heartbeat from core client for 30 sec - exiting 00:37:52 (25288): No heartbeat from core client for 30 sec - exiting 00:37:53 (25288): No heartbeat from core client for 30 sec - exiting 00:37:54 (25288): No heartbeat from core client for 30 sec - exiting 00:37:55 (25288): No heartbeat from core client for 30 sec - exiting 00:37:56 (25288): No heartbeat from core client for 30 sec - exiting 00:37:57 (25288): No heartbeat from core client for 30 sec - exiting 00:37:58 (25288): No heartbeat from core client for 30 sec - exiting 00:37:59 (25288): No heartbeat from core client for 30 sec - exiting 00:38:00 (25288): No heartbeat from core client for 30 sec - exiting 00:38:01 (25288): No heartbeat from core client for 30 sec - exiting 00:38:02 (25288): No heartbeat from core client for 30 sec - exiting 00:38:03 (25288): No heartbeat from core client for 30 sec - exiting 00:38:04 (25288): No heartbeat from core client for 30 sec - exiting 00:38:05 (25288): No heartbeat from core client for 30 sec - exiting 00:38:06 (25288): No heartbeat from core client for 30 sec - exiting 00:38:07 (25288): No heartbeat from core client for 30 sec - exiting 00:38:08 (25288): No heartbeat from core client for 30 sec - exiting 00:38:09 (25288): No heartbeat from core client for 30 sec - exiting 00:38:10 (25288): No heartbeat from core client for 30 sec - exiting 00:38:11 (25288): No heartbeat from core client for 30 sec - exiting 00:38:12 (25288): No heartbeat from core client for 30 sec - exiting 00:38:13 (25288): No heartbeat from core client for 30 sec - exiting 00:38:14 (25288): No heartbeat from core client for 30 sec - exiting 00:38:15 (25288): No heartbeat from core client for 30 sec - exiting 00:38:16 (25288): No heartbeat from core client for 30 sec - exiting 00:38:17 (25288): No heartbeat from core client for 30 sec - exiting 00:38:18 (25288): No heartbeat from core client for 30 sec - exiting 00:38:19 (25288): No heartbeat from core client for 30 sec - exiting 00:38:20 (25288): No heartbeat from core client for 30 sec - exiting 00:38:21 (25288): No heartbeat from core client for 30 sec - exiting 00:38:22 (25288): No heartbeat from core client for 30 sec - exiting 00:38:23 (25288): No heartbeat from core client for 30 sec - exiting 00:38:24 (25288): No heartbeat from core client for 30 sec - exiting 00:38:25 (25288): No heartbeat from core client for 30 sec - exiting 00:38:26 (25288): No heartbeat from core client for 30 sec - exiting 00:38:27 (25288): No heartbeat from core client for 30 sec - exiting 00:38:28 (25288): No heartbeat from core client for 30 sec - exiting 00:38:29 (25288): No heartbeat from core client for 30 sec - exiting 00:38:30 (25288): No heartbeat from core client for 30 sec - exiting 00:38:31 (25288): No heartbeat from core client for 30 sec - exiting 00:38:32 (25288): No heartbeat from core client for 30 sec - exiting 00:38:33 (25288): No heartbeat from core client for 30 sec - exiting 00:38:34 (25288): No heartbeat from core client for 30 sec - exiting 00:38:35 (25288): No heartbeat from core client for 30 sec - exiting 00:38:36 (25288): No heartbeat from core client for 30 sec - exiting 00:38:37 (25288): No heartbeat from core client for 30 sec - exiting 00:38:38 (25288): No heartbeat from core client for 30 sec - exiting 00:38:39 (25288): No heartbeat from core client for 30 sec - exiting 00:38:40 (25288): No heartbeat from core client for 30 sec - exiting 00:38:41 (25288): No heartbeat from core client for 30 sec - exiting 00:38:42 (25288): No heartbeat from core client for 30 sec - exiting 00:38:43 (25288): No heartbeat from core client for 30 sec - exiting 00:38:44 (25288): No heartbeat from core client for 30 sec - exiting 00:38:45 (25288): No heartbeat from core client for 30 sec - exiting 00:38:46 (25288): No heartbeat from core client for 30 sec - exiting 00:38:47 (25288): No heartbeat from core client for 30 sec - exiting 00:38:48 (25288): No heartbeat from core client for 30 sec - exiting 00:38:49 (25288): No heartbeat from core client for 30 sec - exiting 00:38:50 (25288): No heartbeat from core client for 30 sec - exiting 00:38:51 (25288): No heartbeat from core client for 30 sec - exiting 00:38:52 (25288): No heartbeat from core client for 30 sec - exiting 00:38:53 (25288): No heartbeat from core client for 30 sec - exiting 00:38:54 (25288): No heartbeat from core client for 30 sec - exiting 00:38:55 (25288): No heartbeat from core client for 30 sec - exiting 00:38:56 (25288): No heartbeat from core client for 30 sec - exiting 00:38:57 (25288): No heartbeat from core client for 30 sec - exiting 00:38:58 (25288): No heartbeat from core client for 30 sec - exiting 00:38:59 (25288): No heartbeat from core client for 30 sec - exiting 00:39:00 (25288): No heartbeat from core client for 30 sec - exiting 00:39:01 (25288): No heartbeat from core client for 30 sec - exiting 00:39:02 (25288): No heartbeat from core client for 30 sec - exiting 00:39:03 (25288): No heartbeat from core client for 30 sec - exiting 00:39:04 (25288): No heartbeat from core client for 30 sec - exiting 00:39:05 (25288): No heartbeat from core client for 30 sec - exiting SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf762f7af] /lib/libc.so.6(abort+0x180)[0xf76310f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf761ac0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25307, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75bb7af] /lib/libc.so.6(abort+0x180)[0xf75bd0f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf75a6c0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25307, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75dd7af] /lib/libc.so.6(abort+0x180)[0xf75df0f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf75c8c0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25307, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75f07af] /lib/libc.so.6(abort+0x180)[0xf75f20f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf75dbc0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25307, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75e27af] /lib/libc.so.6(abort+0x180)[0xf75e40f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf75cdc0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25307, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75617af] /lib/libc.so.6(abort+0x180)[0xf75630f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf754cc0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25307, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 00:43:56 (25324): Can't acquire lockfile (-154) - waiting 35s 00:44:31 (25324): Can't acquire lockfile (-154) - exiting cpdnmonitor: cannot open input file /DATA/BOINC/projects/climateprediction.net/hadcm3n_o0be_1940_40_007543413/dataout/atmos_restart.day after 11 attempts SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf763a7af] /lib/libc.so.6(abort+0x180)[0xf763c0f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7625c0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25351, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /DATA/BOINC/projects/climateprediction.net/hadcm3n_o0be_1940_40_007543413/dataout/atmos_restart.day after 11 attempts SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75d97af] /lib/libc.so.6(abort+0x180)[0xf75db0f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf75c4c0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25351, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /DATA/BOINC/projects/climateprediction.net/hadcm3n_o0be_1940_40_007543413/dataout/atmos_restart.day after 11 attempts SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75987af] /lib/libc.so.6(abort+0x180)[0xf759a0f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7583c0e] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25351, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /DATA/BOINC/projects/climateprediction.net/hadcm3n_o0be_1940_40_007543413/dataout/atmos_restart.day after 11 attempts SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75a87af] /lib/libc.so.6(abort+0x180)[0xf75aa0f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7593c0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25351, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... cpdnmonitor: cannot open input file /DATA/BOINC/projects/climateprediction.net/hadcm3n_o0be_1940_40_007543413/dataout/atmos_restart.day after 11 attempts SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75b57af] /lib/libc.so.6(abort+0x180)[0xf75b70f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf75a0c0e] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25351, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /DATA/BOINC/projects/climateprediction.net/hadcm3n_o0be_1940_40_007543413/dataout/atmos_restart.day after 11 attempts SIGABRT: abort called Stack trace (9 frames): /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf75907af] /lib/libc.so.6(abort+0x180)[0xf75920f0] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /DATA/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xfe)[0xf757bc0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25351, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Dec 2011 20:17:16	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	984,960	1,665,211	1.6906
22 Dec 2011 05:37:30	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	959,040	1,623,118	1.6924
21 Dec 2011 13:29:10	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	933,120	1,579,697	1.6929
20 Dec 2011 16:31:08	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	907,200	1,535,763	1.6929
19 Dec 2011 19:12:15	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	881,280	1,491,745	1.6927
18 Dec 2011 20:59:41	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	855,360	1,447,723	1.6925
17 Dec 2011 23:05:31	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	829,440	1,403,659	1.6923
17 Dec 2011 04:02:45	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	803,520	1,359,417	1.6918
16 Dec 2011 09:26:42	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	777,600	1,314,888	1.6910
15 Dec 2011 13:21:25	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	751,680	1,270,740	1.6905
14 Dec 2011 13:49:18	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	725,760	1,226,660	1.6902
13 Dec 2011 15:23:13	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	699,840	1,182,764	1.6900
12 Dec 2011 17:06:15	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	673,920	1,138,689	1.6897
11 Dec 2011 17:54:40	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	648,000	1,094,544	1.6891
10 Dec 2011 20:08:05	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	622,080	1,050,498	1.6887
09 Dec 2011 22:23:26	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	596,160	1,006,345	1.6880
08 Dec 2011 23:55:29	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	570,240	962,278	1.6875
07 Dec 2011 22:49:43	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	544,320	918,376	1.6872
06 Dec 2011 21:26:25	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	518,400	874,484	1.6869
05 Dec 2011 19:39:42	1145333	13626694	hadcm3n_o0be_1940_40_007543413_1	492,480	830,576	1.6865