Task 15832915

Name	hadcm3n_3ifw_2020_40_008362400_1
Workunit	8513259
Created	6 Jun 2013, 12:33:50 UTC
Sent	6 Jun 2013, 12:52:07 UTC
Report deadline	5 Sep 2013, 20:19:18 UTC
Received	20 Jul 2013, 23:01:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1016016
Run time	26 days 11 hours 13 min 5 sec
CPU time	23 days 12 hours 44 min 19 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	1.43 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 09:00:39 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:51:14 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:51:15 (5196): No heartbeat from core client for 30 sec - exiting 00:51:16 (5196): No heartbeat from core client for 30 sec - exiting 02:55:26 (27348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:55:27 (27348): No heartbeat from core client for 30 sec - exiting 04:11:21 (19488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:22 (19488): No heartbeat from core client for 30 sec - exiting 05:13:40 (23976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:51 (17340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:52 (17340): No heartbeat from core client for 30 sec - exiting 02:14:58 (25608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:09 (20948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:10 (20948): No heartbeat from core client for 30 sec - exiting 16:13:11 (20948): No heartbeat from core client for 30 sec - exiting 16:13:12 (20948): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:55:39 (11212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:55:40 (11212): No heartbeat from core client for 30 sec - exiting 10:05:41 (6596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:42 (6596): No heartbeat from core client for 30 sec - exiting 10:06:49 (1600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:00:55 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:57 (6768): No heartbeat from core client for 30 sec - exiting 10:00:58 (6768): No heartbeat from core client for 30 sec - exiting 10:00:59 (6768): No heartbeat from core client for 30 sec - exiting 10:01:00 (6768): No heartbeat from core client for 30 sec - exiting 10:02:10 (8552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:57 (18008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:40 (17756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:59 (7172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:51 (16224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:01 (16532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:02 (16532): No heartbeat from core client for 30 sec - exiting 10:36:47 (8972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:01 (11440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:03 (15448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:02 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:04:38 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:04:40 (4352): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3340, iMonCtr=1 Model crash detected, will try to restart... 08:59:42 (2384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:43 (2384): No heartbeat from core client for 30 sec - exiting 10:26:30 (2076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:08 (3040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:51 (1444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:19:52 (5008): No heartbeat from core client for 30 sec - exiting 00:19:53 (5008): No heartbeat from core client for 30 sec - exiting 00:19:54 (5008): No heartbeat from core client for 30 sec - exiting 00:19:55 (5008): No heartbeat from core client for 30 sec - exiting 00:19:56 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:39:32 (1260): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:39:34 (1260): No heartbeat from core client for 30 sec - exiting 15:39:35 (1260): No heartbeat from core client for 30 sec - exiting 15:40:42 (32284): No heartbeat from core client for 30 sec - exiting 15:40:43 (32284): No heartbeat from core client for 30 sec - exiting 15:40:44 (32284): No heartbeat from core client for 30 sec - exiting 15:40:45 (32284): No heartbeat from core client for 30 sec - exiting 15:40:46 (32284): No heartbeat from core client for 30 sec - exiting 15:40:47 (32284): No heartbeat from core client for 30 sec - exiting 15:40:48 (32284): No heartbeat from core client for 30 sec - exiting 15:40:49 (32284): No heartbeat from core client for 30 sec - exiting 15:40:50 (32284): No heartbeat from core client for 30 sec - exiting 15:40:51 (32284): No heartbeat from core client for 30 sec - exiting 15:40:52 (32284): No heartbeat from core client for 30 sec - exiting 15:40:53 (32284): No heartbeat from core client for 30 sec - exiting 15:40:54 (32284): No heartbeat from core client for 30 sec - exiting 15:40:55 (32284): No heartbeat from core client for 30 sec - exiting 15:40:56 (32284): No heartbeat from core client for 30 sec - exiting 15:40:57 (32284): No heartbeat from core client for 30 sec - exiting 15:40:58 (32284): No heartbeat from core client for 30 sec - exiting 15:40:59 (32284): No heartbeat from core client for 30 sec - exiting 15:41:00 (32284): No heartbeat from core client for 30 sec - exiting 15:41:01 (32284): No heartbeat from core client for 30 sec - exiting 15:41:02 (32284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=33256, iMonCtr=1 Model crash detected, will try to restart... 00:57:34 (2260): No heartbeat from core client for 30 sec - exiting 00:57:35 (2260): No heartbeat from core client for 30 sec - exiting 00:57:36 (2260): No heartbeat from core client for 30 sec - exiting 00:57:37 (2260): No heartbeat from core client for 30 sec - exiting 00:57:39 (2260): No heartbeat from core client for 30 sec - exiting 00:57:40 (2260): No heartbeat from core client for 30 sec - exiting 00:57:41 (2260): No heartbeat from core client for 30 sec - exiting 00:57:42 (2260): No heartbeat from core client for 30 sec - exiting 00:57:43 (2260): No heartbeat from core client for 30 sec - exiting 00:57:44 (2260): No heartbeat from core client for 30 sec - exiting 00:57:45 (2260): No heartbeat from core client for 30 sec - exiting 00:57:46 (2260): No heartbeat from core client for 30 sec - exiting 00:57:47 (2260): No heartbeat from core client for 30 sec - exiting 00:57:48 (2260): No heartbeat from core client for 30 sec - exiting 00:57:50 (2260): No heartbeat from core client for 30 sec - exiting 00:57:51 (2260): No heartbeat from core client for 30 sec - exiting 00:57:52 (2260): No heartbeat from core client for 30 sec - exiting 00:57:53 (2260): No heartbeat from core client for 30 sec - exiting 00:57:54 (2260): No heartbeat from core client for 30 sec - exiting 00:57:55 (2260): No heartbeat from core client for 30 sec - exiting 00:57:56 (2260): No heartbeat from core client for 30 sec - exiting 00:57:57 (2260): No heartbeat from core client for 30 sec - exiting 00:57:58 (2260): No heartbeat from core client for 30 sec - exiting 00:57:59 (2260): No heartbeat from core client for 30 sec - exiting 00:58:01 (2260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:37 (4308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:38 (4308): No heartbeat from core client for 30 sec - exiting 03:32:39 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3924, iMonCtr=1 Model crash detected, will try to restart... 22:18:00 (3616): No heartbeat from core client for 30 sec - exiting 22:18:01 (3616): No heartbeat from core client for 30 sec - exiting 22:18:02 (3616): No heartbeat from core client for 30 sec - exiting 22:18:03 (3616): No heartbeat from core client for 30 sec - exiting 22:18:04 (3616): No heartbeat from core client for 30 sec - exiting 22:18:05 (3616): No heartbeat from core client for 30 sec - exiting 22:18:06 (3616): No heartbeat from core client for 30 sec - exiting 22:18:08 (3616): No heartbeat from core client for 30 sec - exiting 22:18:09 (3616): No heartbeat from core client for 30 sec - exiting 22:18:10 (3616): No heartbeat from core client for 30 sec - exiting 22:18:11 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:14:03 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:04 (4496): No heartbeat from core client for 30 sec - exiting 09:07:37 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:05 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:06 (4064): No heartbeat from core client for 30 sec - exiting 23:38:07 (4064): No heartbeat from core client for 30 sec - exiting 23:38:08 (4064): No heartbeat from core client for 30 sec - exiting 23:38:09 (4064): No heartbeat from core client for 30 sec - exiting 23:38:10 (4064): No heartbeat from core client for 30 sec - exiting 23:38:11 (4064): No heartbeat from core client for 30 sec - exiting 23:38:12 (4064): No heartbeat from core client for 30 sec - exiting 23:38:13 (4064): No heartbeat from core client for 30 sec - exiting 23:38:14 (4064): No heartbeat from core client for 30 sec - exiting 23:38:15 (4064): No heartbeat from core client for 30 sec - exiting 23:39:20 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:39:21 (4216): No heartbeat from core client for 30 sec - exiting 23:39:22 (4216): No heartbeat from core client for 30 sec - exiting 23:39:23 (4216): No heartbeat from core client for 30 sec - exiting 23:39:24 (4216): No heartbeat from core client for 30 sec - exiting 23:39:25 (4216): No heartbeat from core client for 30 sec - exiting 23:39:26 (4216): No heartbeat from core client for 30 sec - exiting 23:39:27 (4216): No heartbeat from core client for 30 sec - exiting 23:39:28 (4216): No heartbeat from core client for 30 sec - exiting 23:39:29 (4216): No heartbeat from core client for 30 sec - exiting 23:39:30 (4216): No heartbeat from core client for 30 sec - exiting 02:45:18 (11000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:45:19 (11000): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on 3ifwko.dao49u0 15:50:07 (2976): No heartbeat from core client for 30 sec - exiting 15:50:08 (2976): No heartbeat from core client for 30 sec - exiting 15:50:09 (2976): No heartbeat from core client for 30 sec - exiting 15:50:10 (2976): No heartbeat from core client for 30 sec - exiting 15:50:11 (2976): No heartbeat from core client for 30 sec - exiting 15:50:12 (2976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Ocean Restart file copy failed on 3ifwko.dao5190 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:12:46 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:11:02 (3580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 20:07:05	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	777,600	2,033,046	2.6145
23 Jul 2013 15:14:20	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	751,680	1,967,809	2.6179
23 Jul 2013 15:14:20	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	725,760	1,902,701	2.6217
23 Jul 2013 15:14:20	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	699,840	1,837,685	2.6259
23 Jul 2013 15:14:19	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	673,920	1,772,547	2.6302
23 Jul 2013 15:14:19	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	648,000	1,708,673	2.6368
11 Jul 2013 20:14:22	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	622,080	1,644,464	2.6435
04 Jul 2013 18:57:27	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	596,160	1,576,863	2.6450
03 Jul 2013 16:04:11	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	570,240	1,510,452	2.6488
02 Jul 2013 18:49:04	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	544,320	1,443,101	2.6512
02 Jul 2013 11:51:58	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	518,400	1,375,915	2.6542
02 Jul 2013 10:58:15	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	492,480	1,308,764	2.6575
02 Jul 2013 10:20:28	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	466,560	1,240,372	2.6585
02 Jul 2013 09:52:09	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	440,640	1,172,451	2.6608
28 Jun 2013 01:24:48	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	414,720	1,104,037	2.6621
27 Jun 2013 04:06:57	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	388,800	1,035,913	2.6644
26 Jun 2013 06:58:47	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	362,880	969,323	2.6712
25 Jun 2013 08:41:08	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	336,960	900,197	2.6715
24 Jun 2013 05:28:26	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	311,040	831,802	2.6743
23 Jun 2013 06:55:57	1016016	15832915	hadcm3n_3ifw_2020_40_008362400_1	285,120	764,349	2.6808