Task 15494835

Name	hadcm3n_3jqp_1940_40_008265630_0
Workunit	8420754
Created	21 Dec 2012, 13:19:26 UTC
Sent	22 Dec 2012, 18:58:11 UTC
Report deadline	24 Mar 2013, 2:25:22 UTC
Received	1 Sep 2013, 21:20:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1156715
Run time	10 days 22 hours 1 min 38 sec
CPU time	10 days 11 hours 57 min
Validate state	Invalid
Credit	6,842.88
Device peak FLOPS	3.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognise the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:56:40 (13940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:18:51 (11960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:41:21 (10844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:51:31 (7796): No heartbeat from core client for 30 sec - exiting 00:51:32 (7796): No heartbeat from core client for 30 sec - exiting 00:51:33 (7796): No heartbeat from core client for 30 sec - exiting 00:51:34 (7796): No heartbeat from core client for 30 sec - exiting 00:51:35 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:08:18 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:24:28 (8596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:26:05 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:27:33 (8424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:29:36 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:01:38 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:28 (10276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:31:31 (8924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:32 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:14:45 (6868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:54:48 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:46 (8868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:53 (9020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:23 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:26 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:28 (2784): No heartbeat from core client for 30 sec - exiting 08:04:40 (7628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:17 (4088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:30 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:09:27 (7612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:20 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:58 (8184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:42:32 (6892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:43:29 (11340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:00:24 (8020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:50:21 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:08:47 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:39:56 (4696): No heartbeat from core client for 30 sec - exiting 00:39:57 (4696): No heartbeat from core client for 30 sec - exiting 00:39:58 (4696): No heartbeat from core client for 30 sec - exiting 00:39:59 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:02 (6244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:36 (7008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:21:02 (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:23:24 (184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:11:33 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:16:41 (776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:30:25 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:27 (748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:17 (1820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:39:26 (11152): No heartbeat from core client for 30 sec - exiting 17:39:29 (11152): No heartbeat from core client for 30 sec - exiting 17:39:30 (11152): No heartbeat from core client for 30 sec - exiting 17:39:31 (11152): No heartbeat from core client for 30 sec - exiting 17:39:34 (11152): No heartbeat from core client for 30 sec - exiting 17:39:35 (11152): No heartbeat from core client for 30 sec - exiting 17:39:36 (11152): No heartbeat from core client for 30 sec - exiting 17:39:39 (11152): No heartbeat from core client for 30 sec - exiting 17:39:40 (11152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:17:14 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:22:14 (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:17 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:01:58 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:01:42 (3264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 08/07/13 13:03:05 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_3jqp_1940_40_008265630;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77b20000 00157000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.9200.16578) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77260000 00130000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.9200.16627) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77140000 000a6000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.9200.16451) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 753b0000 00116000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 756c0000 000fd000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.9200.16622) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.2.9200.16622 (win8_gdr.130523-1504) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16622 ModLoad: 77090000 000ae000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6a290000 000ce000 C:\WINDOWS\SYSTEM32\OPENGL32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : opengl32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 73d10000 00023000 C:\WINDOWS\SYSTEM32\GLU32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : glu32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 754d0000 00012000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 76fd0000 000b1000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9200.16384 ModLoad: 76920000 00034000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77490000 000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74a10000 000d9000 C:\WINDOWS\SYSTEM32\DDRAW.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : ddraw.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75130000 0001c000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.2.9200.16420 (win8_gdr.120919-1813) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16420 ModLoad: 74890000 00007000 C:\WINDOWS\SYSTEM32\DCIMAN32.dll (6.2.9200.16453) (-exported- Symbols Loaded) Linked PDB Filename : dciman32.pdb File Version : 6.2.9200.16453 (win8_gdr.121107-1502) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16453 ModLoad: 75120000 00009000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 750c0000 00051000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75390000 00020000 C:\WINDOWS\system32\IMM32.DLL (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77540000 000dd000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.2.9200.16496) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6f5d0000 00129000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74cb0000 00008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 9144 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 - Registers - eax=1132f9b8 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe eip=77154b32 esp=1132f9b8 ebp=1132fa14 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 KERNELBASE!RaiseException+0x0 1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 1132fad4 00408130 1132fae8 002a38b1 1132fae8 002a3839 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff84 7728850d 7ffde000 1132ffd4 77b7bf39 7ffde000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff90 77b7bf39 7ffde000 fe95c451 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 1132ffd4 77b7bf0c 007bde7f 7ffde000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 1132ffec 00000000 007bde7f 7ffde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 3432 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00000000 ebx=43eaff44 ecx=00000000 edx=00000000 esi=43eaff44 edi=00000000 eip=77b4df34 esp=43eaff04 ebp=43eaff68 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 43eaff68 7714119c 00000064 00000000 43eaff84 00749924 ntdll!ZwDelayExecution+0x0 43eaff78 00749924 00000064 43eaff90 7728850d 00000000 KERNELBASE!Sleep+0x0 43eaff84 7728850d 00000000 43eaffd4 77b7bf39 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 43eaff90 77b7bf39 00000000 ac4dc451 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 43eaffd4 77b7bf0c 00749910 00000000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 43eaffec 00000000 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9248, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 08/07/13 13:03:17 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_3jqp_1940_40_008265630;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77b20000 00157000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.9200.16578) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77260000 00130000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.9200.16627) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77140000 000a6000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.9200.16451) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 753b0000 00116000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 756c0000 000fd000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.9200.16622) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.2.9200.16622 (win8_gdr.130523-1504) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16622 ModLoad: 77090000 000ae000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6a290000 000ce000 C:\WINDOWS\SYSTEM32\OPENGL32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : opengl32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 73d10000 00023000 C:\WINDOWS\SYSTEM32\GLU32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : glu32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 754d0000 00012000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 76fd0000 000b1000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9200.16384 ModLoad: 76920000 00034000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77490000 000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74a10000 000d9000 C:\WINDOWS\SYSTEM32\DDRAW.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : ddraw.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75130000 0001c000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.9200.16420) (-nosymbols- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.2.9200.16420 (win8_gdr.120919-1813) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16420 ModLoad: 74890000 00007000 C:\WINDOWS\SYSTEM32\DCIMAN32.dll (6.2.9200.16453) (-nosymbols- Symbols Loaded) Linked PDB Filename : dciman32.pdb File Version : 6.2.9200.16453 (win8_gdr.121107-1502) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16453 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 2364 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 - Registers - eax=1132f9b8 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe eip=77154b32 esp=1132f9b8 ebp=1132fa14 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 KERNELBASE!RaiseException+0x0 1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 1132fad4 00408130 1132fae8 001638b1 1132fae8 00163839 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff84 7728850d 7ffde000 1132ffd4 77b7bf39 7ffde000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff90 77b7bf39 7ffde000 cdeaca0e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 1132ffd4 77b7bf0c 007bde7f 7ffde000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 1132ffec 00000000 007bde7f 7ffde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 1140 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00749910 ebx=43ebff44 ecx=00000000 edx=00000000 esi=43ebff44 edi=00000000 eip=77b4df34 esp=43ebff04 ebp=43ebff68 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 43ebff68 7714119c 00000064 00000000 43ebff84 00749924 ntdll!ZwDelayExecution+0x0 43ebff78 00749924 00000064 43ebff90 7728850d 00000000 KERNELBASE!Sleep+0x0 43ebff84 7728850d 00000000 43ebffd4 77b7bf39 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 43ebff90 77b7bf39 00000000 9f33ca0e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 43ebffd4 77b7bf0c 00749910 00000000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 43ebffec 00000000 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9248, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 08/07/13 13:03:21 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_3jqp_1940_40_008265630;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77b20000 00157000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.9200.16578) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77260000 00130000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.9200.16627) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77140000 000a6000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.9200.16451) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 753b0000 00116000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 756c0000 000fd000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.9200.16622) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.2.9200.16622 (win8_gdr.130523-1504) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16622 ModLoad: 77090000 000ae000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6a290000 000ce000 C:\WINDOWS\SYSTEM32\OPENGL32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : opengl32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 73d10000 00023000 C:\WINDOWS\SYSTEM32\GLU32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : glu32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 754d0000 00012000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 76fd0000 000b1000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9200.16384 ModLoad: 76920000 00034000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77490000 000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74a10000 000d9000 C:\WINDOWS\SYSTEM32\DDRAW.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : ddraw.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75130000 0001c000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.2.9200.16420 (win8_gdr.120919-1813) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16420 ModLoad: 74890000 00007000 C:\WINDOWS\SYSTEM32\DCIMAN32.dll (6.2.9200.16453) (-exported- Symbols Loaded) Linked PDB Filename : dciman32.pdb File Version : 6.2.9200.16453 (win8_gdr.121107-1502) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16453 ModLoad: 75120000 00009000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 750c0000 00051000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75390000 00020000 C:\WINDOWS\system32\IMM32.DLL (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77540000 000dd000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.2.9200.16496) (-nosymbols- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6f5d0000 00129000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74cb0000 00008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 3580 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 - Registers - eax=1132f9b8 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe eip=77154b32 esp=1132f9b8 ebp=1132fa14 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 KERNELBASE!RaiseException+0x0 1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 1132fad4 00408130 1132fae8 001638b1 1132fae8 00163839 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff84 7728850d 7ffde000 1132ffd4 77b7bf39 7ffde000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff90 77b7bf39 7ffde000 dff4044a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 1132ffd4 77b7bf0c 007bde7f 7ffde000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 1132ffec 00000000 007bde7f 7ffde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 4840 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00749910 ebx=43e4ff44 ecx=00000000 edx=00000000 esi=43e4ff44 edi=00000000 eip=77b4df34 esp=43e4ff04 ebp=43e4ff68 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 43e4ff68 7714119c 00000064 00000000 43e4ff84 00749924 ntdll!ZwDelayExecution+0x0 43e4ff78 00749924 00000064 43e4ff90 7728850d 00000000 KERNELBASE!Sleep+0x0 43e4ff84 7728850d 00000000 43e4ffd4 77b7bf39 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 43e4ff90 77b7bf39 00000000 8d22044a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 43e4ffd4 77b7bf0c 00749910 00000000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 43e4ffec 00000000 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9248, iMonCtr=1 Model crash detected, will try to restar

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jan 2013 12:40:12	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	570,240	880,250	1.5436
12 Jan 2013 23:47:58	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	544,320	838,188	1.5399
12 Jan 2013 07:34:04	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	518,400	794,595	1.5328
11 Jan 2013 04:18:33	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	492,480	750,289	1.5235
10 Jan 2013 06:58:21	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	466,560	703,817	1.5085
08 Jan 2013 22:47:50	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	440,640	662,463	1.5034
08 Jan 2013 09:12:08	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	414,720	623,779	1.5041
05 Jan 2013 09:46:01	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	388,800	583,332	1.5003
03 Jan 2013 20:51:27	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	362,880	542,073	1.4938
03 Jan 2013 01:19:17	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	336,960	504,213	1.4964
02 Jan 2013 06:44:39	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	311,040	465,437	1.4964
01 Jan 2013 12:45:22	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	285,120	427,247	1.4985
31 Dec 2012 08:58:29	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	259,200	388,702	1.4996
29 Dec 2012 18:58:26	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	233,280	349,225	1.4970
28 Dec 2012 23:07:57	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	207,360	311,209	1.5008
27 Dec 2012 22:11:50	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	181,440	272,126	1.4998
26 Dec 2012 14:45:15	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	155,520	234,165	1.5057
25 Dec 2012 17:36:37	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	129,600	195,857	1.5112
24 Dec 2012 20:18:13	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	103,680	157,130	1.5155
24 Dec 2012 05:06:57	1156715	15494835	hadcm3n_3jqp_1940_40_008265630_0	77,760	117,763	1.5144