Task 13408006

Name	hadcm3n_u5rg_1980_40_007458859_1
Workunit	7656362
Created	22 Sep 2011, 16:41:54 UTC
Sent	25 Sep 2011, 18:16:04 UTC
Report deadline	26 Dec 2011, 1:43:15 UTC
Received	17 Oct 2011, 0:57:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	893865
Run time	12 days 1 hours 30 min 43 sec
CPU time	8 days 11 hours 54 min 39 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3548, iMonCtr=1 Model crash detected, will try to restart... 23:32:07 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:32:08 (6192): No heartbeat from core client for 30 sec - exiting 23:32:09 (6192): No heartbeat from core client for 30 sec - exiting 23:32:10 (6192): No heartbeat from core client for 30 sec - exiting 23:33:23 (7572): No heartbeat from core client for 30 sec - exiting 23:33:24 (7572): No heartbeat from core client for 30 sec - exiting 23:33:26 (7572): No heartbeat from core client for 30 sec - exiting 23:33:27 (7572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2220, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7444, iMonCtr=1 Model crash detected, will try to restart... 09:51:11 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:51:14 (4216): No heartbeat from core client for 30 sec - exiting 09:51:15 (4216): No heartbeat from core client for 30 sec - exiting 09:51:19 (4216): No heartbeat from core client for 30 sec - exiting 09:53:15 (6852): No heartbeat from core client for 30 sec - exiting 09:53:16 (6852): No heartbeat from core client for 30 sec - exiting 09:53:17 (6852): No heartbeat from core client for 30 sec - exiting 09:53:18 (6852): No heartbeat from core client for 30 sec - exiting 09:53:19 (6852): No heartbeat from core client for 30 sec - exiting 09:53:20 (6852): No heartbeat from core client for 30 sec - exiting 09:53:21 (6852): No heartbeat from core client for 30 sec - exiting 09:53:22 (6852): No heartbeat from core client for 30 sec - exiting 09:53:23 (6852): No heartbeat from core client for 30 sec - exiting 09:53:24 (6852): No heartbeat from core client for 30 sec - exiting 09:53:25 (6852): No heartbeat from core client for 30 sec - exiting 09:53:26 (6852): No heartbeat from core client for 30 sec - exiting 09:53:27 (6852): No heartbeat from core client for 30 sec - exiting 09:53:28 (6852): No heartbeat from core client for 30 sec - exiting 09:53:29 (6852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:27 (7360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:29 (7360): No heartbeat from core client for 30 sec - exiting 09:59:30 (7360): No heartbeat from core client for 30 sec - exiting 10:03:10 (7740): No heartbeat from core client for 30 sec - exiting 10:03:11 (7740): No heartbeat from core client for 30 sec - exiting 10:03:12 (7740): No heartbeat from core client for 30 sec - exiting 10:03:13 (7740): No heartbeat from core client for 30 sec - exiting 10:03:14 (7740): No heartbeat from core client for 30 sec - exiting 10:03:15 (7740): No heartbeat from core client for 30 sec - exiting 10:03:16 (7740): No heartbeat from core client for 30 sec - exiting 10:03:17 (7740): No heartbeat from core client for 30 sec - exiting 10:03:18 (7740): No heartbeat from core client for 30 sec - exiting 10:03:19 (7740): No heartbeat from core client for 30 sec - exiting 10:03:20 (7740): No heartbeat from core client for 30 sec - exiting 10:03:21 (7740): No heartbeat from core client for 30 sec - exiting 10:03:22 (7740): No heartbeat from core client for 30 sec - exiting 10:03:23 (7740): No heartbeat from core client for 30 sec - exiting 10:03:24 (7740): No heartbeat from core client for 30 sec - exiting 10:03:25 (7740): No heartbeat from core client for 30 sec - exiting 10:03:26 (7740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:07:13 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:14:30 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:14:42 (7784): Can't acquire lockfile (32) - waiting 35s 18:28:32 (7784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:34 (7784): No heartbeat from core client for 30 sec - exiting 19:26:18 (6252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:19 (6252): No heartbeat from core client for 30 sec - exiting 19:26:20 (6252): No heartbeat from core client for 30 sec - exiting 19:32:15 (6756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:58:02 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:58:04 (3060): No heartbeat from core client for 30 sec - exiting 19:58:05 (3060): No heartbeat from core client for 30 sec - exiting 20:29:37 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:38 (7100): No heartbeat from core client for 30 sec - exiting 22:32:26 (7276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:27 (7276): No heartbeat from core client for 30 sec - exiting 22:32:28 (7276): No heartbeat from core client for 30 sec - exiting 22:32:29 (7276): No heartbeat from core client for 30 sec - exiting 22:33:48 (236): No heartbeat from core client for 30 sec - exiting 22:33:49 (236): No heartbeat from core client for 30 sec - exiting 22:33:50 (236): No heartbeat from core client for 30 sec - exiting 22:33:51 (236): No heartbeat from core client for 30 sec - exiting 22:33:52 (236): No heartbeat from core client for 30 sec - exiting 22:33:53 (236): No heartbeat from core client for 30 sec - exiting 22:33:54 (236): No heartbeat from core client for 30 sec - exiting 22:33:55 (236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:37 (1284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:38 (1284): No heartbeat from core client for 30 sec - exiting 23:04:39 (1284): No heartbeat from core client for 30 sec - exiting 23:05:28 (4220): No heartbeat from core client for 30 sec - exiting 23:05:29 (4220): No heartbeat from core client for 30 sec - exiting 23:05:30 (4220): No heartbeat from core client for 30 sec - exiting 23:05:31 (4220): No heartbeat from core client for 30 sec - exiting 23:05:32 (4220): No heartbeat from core client for 30 sec - exiting 23:05:33 (4220): No heartbeat from core client for 30 sec - exiting 23:05:34 (4220): No heartbeat from core client for 30 sec - exiting 23:05:35 (4220): No heartbeat from core client for 30 sec - exiting 23:05:36 (4220): No heartbeat from core client for 30 sec - exiting 23:05:37 (4220): No heartbeat from core client for 30 sec - exiting 23:05:38 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:19 (7504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:20 (7504): No heartbeat from core client for 30 sec - exiting 23:36:21 (7504): No heartbeat from core client for 30 sec - exiting 23:37:21 (6548): No heartbeat from core client for 30 sec - exiting 23:37:22 (6548): No heartbeat from core client for 30 sec - exiting 23:37:23 (6548): No heartbeat from core client for 30 sec - exiting 23:37:24 (6548): No heartbeat from core client for 30 sec - exiting 23:37:25 (6548): No heartbeat from core client for 30 sec - exiting 23:37:26 (6548): No heartbeat from core client for 30 sec - exiting 23:37:27 (6548): No heartbeat from core client for 30 sec - exiting 23:37:28 (6548): No heartbeat from core client for 30 sec - exiting 23:37:29 (6548): No heartbeat from core client for 30 sec - exiting 23:37:30 (6548): No heartbeat from core client for 30 sec - exiting 23:37:31 (6548): No heartbeat from core client for 30 sec - exiting 23:37:32 (6548): No heartbeat from core client for 30 sec - exiting 23:37:33 (6548): No heartbeat from core client for 30 sec - exiting 23:37:34 (6548): No heartbeat from core client for 30 sec - exiting 23:37:35 (6548): No heartbeat from core client for 30 sec - exiting 23:37:36 (6548): No heartbeat from core client for 30 sec - exiting 23:37:37 (6548): No heartbeat from core client for 30 sec - exiting 23:37:38 (6548): No heartbeat from core client for 30 sec - exiting 23:37:39 (6548): No heartbeat from core client for 30 sec - exiting 23:37:40 (6548): No heartbeat from core client for 30 sec - exiting 23:37:41 (6548): No heartbeat from core client for 30 sec - exiting 23:37:42 (6548): No heartbeat from core client for 30 sec - exiting 23:37:43 (6548): No heartbeat from core client for 30 sec - exiting 23:37:44 (6548): No heartbeat from core client for 30 sec - exiting 23:37:45 (6548): No heartbeat from core client for 30 sec - exiting 23:37:46 (6548): No heartbeat from core client for 30 sec - exiting 23:37:47 (6548): No heartbeat from core client for 30 sec - exiting 23:37:48 (6548): No heartbeat from core client for 30 sec - exiting 23:37:49 (6548): No heartbeat from core client for 30 sec - exiting 23:37:50 (6548): No heartbeat from core client for 30 sec - exiting 23:37:51 (6548): No heartbeat from core client for 30 sec - exiting 23:37:52 (6548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C10:19:02 (164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3880, iMonCtr=1 Model crash detected, will try to restart... 07:29:46 (1848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:33:14 (6640): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:39:26 (6640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:25:18 (6848): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:25:19 (6848): No heartbeat from core client for 30 sec - exiting 23:25:20 (6848): No heartbeat from core client for 30 sec - exiting 23:25:21 (6848): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:42:52 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:53 (6692): No heartbeat from core client for 30 sec - exiting 23:42:54 (6692): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:27:24 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:27:25 (5388): No heartbeat from core client for 30 sec - exiting 02:27:27 (5388): No heartbeat from core client for 30 sec - exiting 02:27:28 (5388): No heartbeat from core client for 30 sec - exiting 05:10:06 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:10:07 (7364): No heartbeat from core client for 30 sec - exiting 05:10:08 (7364): No heartbeat from core client for 30 sec - exiting 09:13:31 (6684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:59:39 (1112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7324, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:06:57 (3096): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:06:58 (3096): No heartbeat from core client for 30 sec - exiting 10:07:00 (3096): No heartbeat from core client for 30 sec - exiting 10:07:01 (3096): No heartbeat from core client for 30 sec - exiting 10:07:02 (3096): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:05:15 (3564): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:05:16 (3564): No heartbeat from core client for 30 sec - exiting 12:05:17 (3564): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:14:19 (5620): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:14:21 (5620): No heartbeat from core client for 30 sec - exiting 12:14:22 (5620): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:54:31 (1484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:54:33 (1484): No heartbeat from core client for 30 sec - exiting 22:54:34 (1484): No heartbeat from core client for 30 sec - exiting 22:54:35 (1484): No heartbeat from core client for 30 sec - exiting 22:54:36 (1484): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8172, iMonCtr=1 Model crash detected, will try to restart... 08:45:00 (3052): No heartbeat from core client for 30 sec - exiting 08:45:02 (3052): No heartbeat from core client for 30 sec - exiting 08:45:03 (3052): No heartbeat from core client for 30 sec - exiting 08:45:04 (3052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:45:05 (3052): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7400, iMonCtr=1 Model crash detected, will try to restart... 15:07:15 (6228): No heartbeat from core client for 30 sec - exiting 15:07:16 (6228): No heartbeat from core client for 30 sec - exiting 15:07:17 (6228): No heartbeat from core client for 30 sec - exiting 15:07:18 (6228): No heartbeat from core client for 30 sec - exiting 15:07:19 (6228): No heartbeat from core client for 30 sec - exiting 15:07:21 (6228): No heartbeat from core client for 30 sec - exiting 15:07:22 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:18:05 (6316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:18:06 (6316): No heartbeat from core client for 30 sec - exiting 15:18:49 (2740): No heartbeat from core client for 30 sec - exiting 15:18:50 (2740): No heartbeat from core client for 30 sec - exiting 15:18:51 (2740): No heartbeat from core client for 30 sec - exiting 15:18:52 (2740): No heartbeat from core client for 30 sec - exiting 15:18:53 (2740): No heartbeat from core client for 30 sec - exiting 15:18:54 (2740): No heartbeat from core client for 30 sec - exiting 15:18:55 (2740): No heartbeat from core client for 30 sec - exiting 15:18:56 (2740): No heartbeat from core client for 30 sec - exiting 15:18:57 (2740): No heartbeat from core client for 30 sec - exiting 15:18:58 (2740): No heartbeat from core client for 30 sec - exiting 15:18:59 (2740): No heartbeat from core client for 30 sec - exiting 15:19:00 (2740): No heartbeat from core client for 30 sec - exiting 15:19:01 (2740): No heartbeat from core client for 30 sec - exiting 15:19:02 (2740): No heartbeat from core client for 30 sec - exiting 15:19:03 (2740): No heartbeat from core client for 30 sec - exiting 15:19:04 (2740): No heartbeat from core client for 30 sec - exiting 15:19:05 (2740): No heartbeat from core client for 30 sec - exiting 15:19:06 (2740): No heartbeat from core client for 30 sec - exiting 15:19:07 (2740): No heartbeat from core client for 30 sec - exiting 15:19:08 (2740): No heartbeat from core client for 30 sec - exiting 15:19:09 (2740): No heartbeat from core client for 30 sec - exiting 15:19:10 (2740): No heartbeat from core client for 30 sec - exiting 15:19:11 (2740): No heartbeat from core client for 30 sec - exiting 15:19:12 (2740): No heartbeat from core client for 30 sec - exiting 15:19:13 (2740): No heartbeat from core client for 30 sec - exiting 15:19:14 (2740): No heartbeat from core client for 30 sec - exiting 15:19:15 (2740): No heartbeat from core client for 30 sec - exiting 15:19:16 (2740): No heartbeat from core client for 30 sec - exiting 15:19:18 (2740): No heartbeat from core client for 30 sec - exiting 15:19:19 (2740): No heartbeat from core client for 30 sec - exiting 15:19:20 (2740): No heartbeat from core client for 30 sec - exiting 15:19:21 (2740): No heartbeat from core client for 30 sec - exiting 15:19:22 (2740): No heartbeat from core client for 30 sec - exiting 15:19:23 (2740): No heartbeat from core client for 30 sec - exiting 15:19:24 (2740): No heartbeat from core client for 30 sec - exiting 15:19:25 (2740): No heartbeat from core client for 30 sec - exiting 15:19:26 (2740): No heartbeat from core client for 30 sec - exiting 15:19:27 (2740): No heartbeat from core client for 30 sec - exiting 15:19:28 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:51:49 (7912): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:51:50 (7912): No heartbeat from core client for 30 sec - exiting 23:51:51 (7912): No heartbeat from core client for 30 sec - exiting 23:51:52 (7912): No heartbeat from core client for 30 sec - exiting 23:51:53 (7912): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:00:00 (1336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:01 (1336): No heartbeat from core client for 30 sec - exiting 10:00:02 (1336): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2580, iMonCtr=1 Model crash detected, will try to restart... 07:50:56 (3680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:50:57 (3680): No heartbeat from core client for 30 sec - exiting 11:11:39 (6680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... 07:09:37 (8092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:09:39 (8092): No heartbeat from core client for 30 sec - exiting 07:16:32 (7484): No heartbeat from core client for 30 sec - exiting 07:16:34 (7484): No heartbeat from core client for 30 sec - exiting 07:16:35 (7484): No heartbeat from core client for 30 sec - exiting 07:16:36 (7484): No heartbeat from core client for 30 sec - exiting 07:16:37 (7484): No heartbeat from core client for 30 sec - exiting 07:16:38 (7484): No heartbeat from core client for 30 sec - exiting 07:16:39 (7484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7416, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4696, iMonCtr=1 Model crash detected, will try to restart... 22:22:31 (6808): No heartbeat from core client for 30 sec - exiting 22:22:32 (6808): No heartbeat from core client for 30 sec - exiting 22:22:33 (6808): No heartbeat from core client for 30 sec - exiting 22:22:34 (6808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8092, iMonCtr=1 Model crash detected, will try to restart... 08:07:24 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:07:26 (4520): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:23:41 (8052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:23:43 (8052): No heartbeat from core client for 30 sec - exiting 12:23:44 (8052): No heartbeat from core client for 30 sec - exiting 12:23:45 (8052): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7232, iMonCtr=1 Model crash detected, will try to restart... 09:07:26 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:37:56 (6944): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:37:57 (6944): No heartbeat from core client for 30 sec - exiting 14:37:58 (6944): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3456, iMonCtr=1 Model crash detected, will try to restart... 08:37:37 (5940): No heartbeat from core client for 30 sec - exiting 08:37:39 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:34 (6612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:35 (6612): No heartbeat from core client for 30 sec - exiting 09:07:26 (7308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:07:27 (7308): No heartbeat from core client for 30 sec - exiting 09:07:28 (7308): No heartbeat from core client for 30 sec - exiting 09:38:38 (8128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:38:39 (8128): No heartbeat from core client for 30 sec - exiting 00:25:28 (7928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:29 (7928): No heartbeat from core client for 30 sec - exiting 00:25:30 (7928): No heartbeat from core client for 30 sec - exiting 00:25:31 (7928): No heartbeat from core client for 30 sec - exiting 08:29:52 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:53 (6260): No heartbeat from core client for 30 sec - exiting 08:29:54 (6260): No heartbeat from core client for 30 sec - exiting 08:29:55 (6260): No heartbeat from core client for 30 sec - exiting 11:40:37 (8876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:39 (8876): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9980, iMonCtr=1 Model crash detected, will try to restart... 10:09:37 (6324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:38 (6324): No heartbeat from core client for 30 sec - exiting 10:09:39 (6324): No heartbeat from core client for 30 sec - exiting 10:09:40 (6324): No heartbeat from core client for 30 sec - exiting 10:11:16 (7376): No heartbeat from core client for 30 sec - exiting 10:11:17 (7376): No heartbeat from core client for 30 sec - exiting 10:11:18 (7376): No heartbeat from core client for 30 sec - exiting 10:11:19 (7376): No heartbeat from core client for 30 sec - exiting 10:11:20 (7376): No heartbeat from core client for 30 sec - exiting 10:11:21 (7376): No heartbeat from core client for 30 sec - exiting 10:11:22 (7376): No heartbeat from core client for 30 sec - exiting 10:11:23 (7376): No heartbeat from core client for 30 sec - exiting 10:11:24 (7376): No heartbeat from core client for 30 sec - exiting 10:11:25 (7376): No heartbeat from core client for 30 sec - exiting 10:11:26 (7376): No heartbeat from core client for 30 sec - exiting 10:11:27 (7376): No heartbeat from core client for 30 sec - exiting 10:11:28 (7376): No heartbeat from core client for 30 sec - exiting 10:11:29 (7376): No heartbeat from core client for 30 sec - exiting 10:11:30 (7376): No heartbeat from core client for 30 sec - exiting 10:11:31 (7376): No heartbeat from core client for 30 sec - exiting 10:11:32 (7376): No heartbeat from core client for 30 sec - exiting 10:11:33 (7376): No heartbeat from core client for 30 sec - exiting 10:11:34 (7376): No heartbeat from core client for 30 sec - exiting 10:11:35 (7376): No heartbeat from core client for 30 sec - exiting 10:11:36 (7376): No heartbeat from core client for 30 sec - exiting 10:11:37 (7376): No heartbeat from core client for 30 sec - exiting 10:11:38 (7376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:13:32 (2708): No heartbeat from core client for 30 sec - exiting 10:13:33 (2708): No heartbeat from core client for 30 sec - exiting 10:13:34 (2708): No heartbeat from core client for 30 sec - exiting 10:13:35 (2708): No heartbeat from core client for 30 sec - exiting 10:13:36 (2708): No heartbeat from core client for 30 sec - exiting 10:13:37 (2708): No heartbeat from core client for 30 sec - exiting 10:13:38 (2708): No heartbeat from core client for 30 sec - exiting 10:13:39 (2708): No heartbeat from core client for 30 sec - exiting 10:13:40 (2708): No heartbeat from core client for 30 sec - exiting 10:13:41 (2708): No heartbeat from core client for 30 sec - exiting 10:13:42 (2708): No heartbeat from core client for 30 sec - exiting 10:13:43 (2708): No heartbeat from core client for 30 sec - exiting 10:13:44 (2708): No heartbeat from core client for 30 sec - exiting 10:13:45 (2708): No heartbeat from core client for 30 sec - exiting 10:13:46 (2708): No heartbeat from core client for 30 sec - exiting 10:13:47 (2708): No heartbeat from core client for 30 sec - exiting 10:13:48 (2708): No heartbeat from core client for 30 sec - exiting 10:13:49 (2708): No heartbeat from core client for 30 sec - exiting 10:13:50 (2708): No heartbeat from core client for 30 sec - exiting 10:13:51 (2708): No heartbeat from core client for 30 sec - exiting 10:13:52 (2708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:26:11 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:12 (2692): No heartbeat from core client for 30 sec - exiting 10:27:01 (8068): No heartbeat from core client for 30 sec - exiting 10:27:02 (8068): No heartbeat from core client for 30 sec - exiting 10:27:03 (8068): No heartbeat from core client for 30 sec - exiting 10:27:04 (8068): No heartbeat from core client for 30 sec - exiting 10:27:05 (8068): No heartbeat from core client for 30 sec - exiting 10:27:06 (8068): No heartbeat from core client for 30 sec - exiting 10:27:07 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:08 (8068): No heartbeat from core client for 30 sec - exiting 10:45:02 (7172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:03 (7172): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4776, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 23:27:30 (7120): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:27:36 (6248): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6248, iMonCtr=1 Model crash detected, will try to restart... 10:09:45 (8024): No heartbeat from core client for 30 sec - exiting 10:09:46 (8024): No heartbeat from core client for 30 sec - exiting 10:10:20 (8024): No heartbeat from core client for 30 sec - exiting 10:10:21 (8024): No heartbeat from core client for 30 sec - exiting 10:10:22 (8024): No heartbeat from core client for 30 sec - exiting 10:10:23 (8024): No heartbeat from core client for 30 sec - exiting 10:10:24 (8024): No heartbeat from core client for 30 sec - exiting 10:10:25 (8024): No heartbeat from core client for 30 sec - exiting 10:10:26 (8024): No heartbeat from core client for 30 sec - exiting 10:10:27 (8024): No heartbeat from core client for 30 sec - exiting 10:10:28 (8024): No heartbeat from core client for 30 sec - exiting 10:10:29 (8024): No heartbeat from core client for 30 sec - exiting 10:10:30 (8024): No heartbeat from core client for 30 sec - exiting 10:10:31 (8024): No heartbeat from core client for 30 sec - exiting 10:10:32 (8024): No heartbeat from core client for 30 sec - exiting 10:10:33 (8024): No heartbeat from core client for 30 sec - exiting 10:10:34 (8024): No heartbeat from core client for 30 sec - exiting 10:10:35 (8024): No heartbeat from core client for 30 sec - exiting 10:10:36 (8024): No heartbeat from core client for 30 sec - exiting 10:10:37 (8024): No heartbeat from core client for 30 sec - exiting 10:10:38 (8024): No heartbeat from core client for 30 sec - exiting 10:10:39 (8024): No heartbeat from core client for 30 sec - exiting 10:10:40 (8024): No heartbeat from core client for 30 sec - exiting 10:10:41 (8024): No heartbeat from core client for 30 sec - exiting 10:10:42 (8024): No heartbeat from core client for 30 sec - exiting 10:10:43 (8024): No heartbeat from core client for 30 sec - exiting 10:10:44 (8024): No heartbeat from core client for 30 sec - exiting 10:10:45 (8024): No heartbeat from core client for 30 sec - exiting 10:10:46 (8024): No heartbeat from core client for 30 sec - exiting 10:10:47 (8024): No heartbeat from core client for 30 sec - exiting 10:10:48 (8024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:49 (8024): No heartbeat from core client for 30 sec - exiting 10:10:50 (8024): No heartbeat from core client for 30 sec - exiting 10:10:51 (8024): No heartbeat from core client for 30 sec - exiting 10:16:23 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:59:36 (6964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:37 (6964): No heartbeat from core client for 30 sec - exiting 11:00:19 (6568): No heartbeat from core client for 30 sec - exiting 11:00:20 (6568): No heartbeat from core client for 30 sec - exiting 11:00:21 (6568): No heartbeat from core client for 30 sec - exiting 11:00:22 (6568): No heartbeat from core client for 30 sec - exiting 11:00:23 (6568): No heartbeat from core client for 30 sec - exiting 11:00:24 (6568): No heartbeat from core client for 30 sec - exiting 11:00:25 (6568): No heartbeat from core client for 30 sec - exiting 11:00:26 (6568): No heartbeat from core client for 30 sec - exiting 11:00:27 (6568): No heartbeat from core client for 30 sec - exiting 11:00:28 (6568): No heartbeat from core client for 30 sec - exiting 11:00:29 (6568): No heartbeat from core client for 30 sec - exiting 11:00:30 (6568): No heartbeat from core client for 30 sec - exiting 11:00:31 (6568): No heartbeat from core client for 30 sec - exiting 11:00:32 (6568): No heartbeat from core client for 30 sec - exiting 11:00:33 (6568): No heartbeat from core client for 30 sec - exiting 11:00:34 (6568): No heartbeat from core client for 30 sec - exiting 11:00:35 (6568): No heartbeat from core client for 30 sec - exiting 11:00:36 (6568): No heartbeat from core client for 30 sec - exiting 11:00:37 (6568): No heartbeat from core client for 30 sec - exiting 11:00:38 (6568): No heartbeat from core client for 30 sec - exiting 11:00:39 (6568): No heartbeat from core client for 30 sec - exiting 11:00:40 (6568): No heartbeat from core client for 30 sec - exiting 11:00:41 (6568): No heartbeat from core client for 30 sec - exiting 11:00:42 (6568): No heartbeat from core client for 30 sec - exiting 11:00:43 (6568): No heartbeat from core client for 30 sec - exiting 11:00:44 (6568): No heartbeat from core client for 30 sec - exiting 11:00:45 (6568): No heartbeat from core client for 30 sec - exiting 11:00:46 (6568): No heartbeat from core client for 30 sec - exiting 11:00:47 (6568): No heartbeat from core client for 30 sec - exiting 11:00:48 (6568): No heartbeat from core client for 30 sec - exiting 11:00:49 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:00 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:01 (4204): No heartbeat from core client for 30 sec - exiting 00:36:02 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:36:03 (4780): No heartbeat from core client for 30 sec - exiting 00:36:04 (4780): No heartbeat from core client for 30 sec - exiting 00:36:05 (4780): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4512, iMonCtr=1 Model crash detected, will try to restart... 11:02:03 (6680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:04 (6680): No heartbeat from core client for 30 sec - exiting 15:52:32 (6724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:33 (6724): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77421C94 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_u5rg_1980_40_007458859/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Oct 2011 01:00:41	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	259,200	734,066	2.8320
13 Oct 2011 01:32:15	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	233,280	659,542	2.8273
11 Oct 2011 15:32:23	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	207,360	585,512	2.8236
09 Oct 2011 16:54:22	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	181,440	513,325	2.8292
07 Oct 2011 15:34:50	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	155,520	439,644	2.8269
05 Oct 2011 19:34:49	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	129,600	367,698	2.8372
03 Oct 2011 22:32:11	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	103,680	294,540	2.8409
02 Oct 2011 00:54:34	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	77,760	221,522	2.8488
29 Sep 2011 20:34:24	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	51,840	147,483	2.8450
27 Sep 2011 16:23:08	893865	13408006	hadcm3n_u5rg_1980_40_007458859_1	25,920	74,297	2.8664