Task 11935207

Name	famous_v55x_1599_200_006736950_1
Workunit	6940290
Created	10 Oct 2010, 17:35:02 UTC
Sent	11 Oct 2010, 7:23:35 UTC
Report deadline	10 Jan 2011, 14:50:46 UTC
Received	16 Oct 2010, 23:23:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1106244
Run time	1 days 21 hours 35 min 9 sec
CPU time	1 days 20 hours 13 min 41 sec
Validate state	Invalid
Credit	1,389.76
Device peak FLOPS	2.88 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 20:41:10 (3428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:29 (3516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:30 (3516): No heartbeat from core client for 30 sec - exiting 21:36:31 (3516): No heartbeat from core client for 30 sec - exiting 21:36:32 (3516): No heartbeat from core client for 30 sec - exiting 21:36:33 (3516): No heartbeat from core client for 30 sec - exiting 21:36:34 (3516): No heartbeat from core client for 30 sec - exiting 21:36:35 (3516): No heartbeat from core client for 30 sec - exiting 21:36:36 (3516): No heartbeat from core client for 30 sec - exiting 21:36:37 (3516): No heartbeat from core client for 30 sec - exiting 21:38:53 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:54 (3752): No heartbeat from core client for 30 sec - exiting 21:38:55 (3752): No heartbeat from core client for 30 sec - exiting 21:38:56 (3752): No heartbeat from core client for 30 sec - exiting 21:38:57 (3752): No heartbeat from core client for 30 sec - exiting 21:38:58 (3752): No heartbeat from core client for 30 sec - exiting 21:38:59 (3752): No heartbeat from core client for 30 sec - exiting 21:39:00 (3752): No heartbeat from core client for 30 sec - exiting 21:39:01 (3752): No heartbeat from core client for 30 sec - exiting 21:40:22 (1392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:53 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:40:47 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:25:58 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:38:37 (744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:38:38 (744): No heartbeat from core client for 30 sec - exiting 09:38:39 (744): No heartbeat from core client for 30 sec - exiting 09:38:40 (744): No heartbeat from core client for 30 sec - exiting 09:40:09 (1100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:33 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:53 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:13:42 (1480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:07:15 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:02 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:49 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:50 (1824): No heartbeat from core client for 30 sec - exiting 19:03:51 (1824): No heartbeat from core client for 30 sec - exiting 19:03:52 (1824): No heartbeat from core client for 30 sec - exiting 19:03:53 (1824): No heartbeat from core client for 30 sec - exiting 19:08:56 (2420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:48 (1028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:49 (1028): No heartbeat from core client for 30 sec - exiting 20:58:50 (1028): No heartbeat from core client for 30 sec - exiting 20:58:52 (1028): No heartbeat from core client for 30 sec - exiting 20:58:53 (1028): No heartbeat from core client for 30 sec - exiting 20:58:54 (1028): No heartbeat from core client for 30 sec - exiting 20:58:55 (1028): No heartbeat from core client for 30 sec - exiting 20:58:56 (1028): No heartbeat from core client for 30 sec - exiting 20:58:57 (1028): No heartbeat from core client for 30 sec - exiting 21:02:14 (1940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:15 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:16 (3872): No heartbeat from core client for 30 sec - exiting 21:04:17 (3872): No heartbeat from core client for 30 sec - exiting 21:04:18 (3872): No heartbeat from core client for 30 sec - exiting 21:04:19 (3872): No heartbeat from core client for 30 sec - exiting 21:04:20 (3872): No heartbeat from core client for 30 sec - exiting 21:04:21 (3872): No heartbeat from core client for 30 sec - exiting 21:04:22 (3872): No heartbeat from core client for 30 sec - exiting 21:04:23 (3872): No heartbeat from core client for 30 sec - exiting 21:04:25 (3872): No heartbeat from core client for 30 sec - exiting 21:04:26 (3872): No heartbeat from core client for 30 sec - exiting 22:58:57 (3792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:01:34 (1104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:02:09 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:15 (3632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:16 (3632): No heartbeat from core client for 30 sec - exiting 23:03:17 (3632): No heartbeat from core client for 30 sec - exiting 23:03:18 (3632): No heartbeat from core client for 30 sec - exiting 23:03:19 (3632): No heartbeat from core client for 30 sec - exiting 23:03:20 (3632): No heartbeat from core client for 30 sec - exiting 23:03:21 (3632): No heartbeat from core client for 30 sec - exiting 23:03:22 (3632): No heartbeat from core client for 30 sec - exiting 23:03:23 (3632): No heartbeat from core client for 30 sec - exiting 23:03:24 (3632): No heartbeat from core client for 30 sec - exiting 23:03:25 (3632): No heartbeat from core client for 30 sec - exiting 23:04:38 (824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:53:56 (1744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:00:07 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:06 (2412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:05:58 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:12 (736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:28 (1028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:44:40 (3592): No heartbeat from core client for 30 sec - exiting 07:44:41 (3592): No heartbeat from core client for 30 sec - exiting 07:44:42 (3592): No heartbeat from core client for 30 sec - exiting 07:44:43 (3592): No heartbeat from core client for 30 sec - exiting 07:44:44 (3592): No heartbeat from core client for 30 sec - exiting 07:44:45 (3592): No heartbeat from core client for 30 sec - exiting 07:44:46 (3592): No heartbeat from core client for 30 sec - exiting 07:44:47 (3592): No heartbeat from core client for 30 sec - exiting 07:44:48 (3592): No heartbeat from core client for 30 sec - exiting 07:44:49 (3592): No heartbeat from core client for 30 sec - exiting 07:44:50 (3592): No heartbeat from core client for 30 sec - exiting 07:44:51 (3592): No heartbeat from core client for 30 sec - exiting 07:44:52 (3592): No heartbeat from core client for 30 sec - exiting 07:44:53 (3592): No heartbeat from core client for 30 sec - exiting 07:44:54 (3592): No heartbeat from core client for 30 sec - exiting 07:44:55 (3592): No heartbeat from core client for 30 sec - exiting 07:44:56 (3592): No heartbeat from core client for 30 sec - exiting 07:44:57 (3592): No heartbeat from core client for 30 sec - exiting 07:44:58 (3592): No heartbeat from core client for 30 sec - exiting 07:44:59 (3592): No heartbeat from core client for 30 sec - exiting 07:45:00 (3592): No heartbeat from core client for 30 sec - exiting 07:45:01 (3592): No heartbeat from core client for 30 sec - exiting 07:45:02 (3592): No heartbeat from core client for 30 sec - exiting 07:45:03 (3592): No heartbeat from core client for 30 sec - exiting 07:45:04 (3592): No heartbeat from core client for 30 sec - exiting 07:45:05 (3592): No heartbeat from core client for 30 sec - exiting 07:45:06 (3592): No heartbeat from core client for 30 sec - exiting 07:45:07 (3592): No heartbeat from core client for 30 sec - exiting 07:45:08 (3592): No heartbeat from core client for 30 sec - exiting 07:45:09 (3592): No heartbeat from core client for 30 sec - exiting 07:45:10 (3592): No heartbeat from core client for 30 sec - exiting 07:45:11 (3592): No heartbeat from core client for 30 sec - exiting 07:45:12 (3592): No heartbeat from core client for 30 sec - exiting 07:45:13 (3592): No heartbeat from core client for 30 sec - exiting 07:45:14 (3592): No heartbeat from core client for 30 sec - exiting 07:45:15 (3592): No heartbeat from core client for 30 sec - exiting 07:45:16 (3592): No heartbeat from core client for 30 sec - exiting 07:45:17 (3592): No heartbeat from core client for 30 sec - exiting 07:45:18 (3592): No heartbeat from core client for 30 sec - exiting 07:45:19 (3592): No heartbeat from core client for 30 sec - exiting 07:45:20 (3592): No heartbeat from core client for 30 sec - exiting 07:45:21 (3592): No heartbeat from core client for 30 sec - exiting 07:45:22 (3592): No heartbeat from core client for 30 sec - exiting 07:45:23 (3592): No heartbeat from core client for 30 sec - exiting 07:45:24 (3592): No heartbeat from core client for 30 sec - exiting 07:45:25 (3592): No heartbeat from core client for 30 sec - exiting 07:45:26 (3592): No heartbeat from core client for 30 sec - exiting 07:45:27 (3592): No heartbeat from core client for 30 sec - exiting 07:45:28 (3592): No heartbeat from core client for 30 sec - exiting 07:45:29 (3592): No heartbeat from core client for 30 sec - exiting 07:45:30 (3592): No heartbeat from core client for 30 sec - exiting 07:45:31 (3592): No heartbeat from core client for 30 sec - exiting 07:45:32 (3592): No heartbeat from core client for 30 sec - exiting 07:45:33 (3592): No heartbeat from core client for 30 sec - exiting 07:45:34 (3592): No heartbeat from core client for 30 sec - exiting 07:45:35 (3592): No heartbeat from core client for 30 sec - exiting 07:45:36 (3592): No heartbeat from core client for 30 sec - exiting 07:45:37 (3592): No heartbeat from core client for 30 sec - exiting 07:45:38 (3592): No heartbeat from core client for 30 sec - exiting 07:45:39 (3592): No heartbeat from core client for 30 sec - exiting 07:45:40 (3592): No heartbeat from core client for 30 sec - exiting 07:45:41 (3592): No heartbeat from core client for 30 sec - exiting 07:45:42 (3592): No heartbeat from core client for 30 sec - exiting 07:45:43 (3592): No heartbeat from core client for 30 sec - exiting 07:45:44 (3592): No heartbeat from core client for 30 sec - exiting 07:45:45 (3592): No heartbeat from core client for 30 sec - exiting 07:45:46 (3592): No heartbeat from core client for 30 sec - exiting 07:45:47 (3592): No heartbeat from core client for 30 sec - exiting 07:45:48 (3592): No heartbeat from core client for 30 sec - exiting 07:45:49 (3592): No heartbeat from core client for 30 sec - exiting 07:45:50 (3592): No heartbeat from core client for 30 sec - exiting 07:45:51 (3592): No heartbeat from core client for 30 sec - exiting 07:45:52 (3592): No heartbeat from core client for 30 sec - exiting 07:45:53 (3592): No heartbeat from core client for 30 sec - exiting 07:45:54 (3592): No heartbeat from core client for 30 sec - exiting 07:45:55 (3592): No heartbeat from core client for 30 sec - exiting 07:45:56 (3592): No heartbeat from core client for 30 sec - exiting 07:45:57 (3592): No heartbeat from core client for 30 sec - exiting 07:45:58 (3592): No heartbeat from core client for 30 sec - exiting 07:45:59 (3592): No heartbeat from core client for 30 sec - exiting 07:46:00 (3592): No heartbeat from core client for 30 sec - exiting 07:46:01 (3592): No heartbeat from core client for 30 sec - exiting 07:46:02 (3592): No heartbeat from core client for 30 sec - exiting 07:46:03 (3592): No heartbeat from core client for 30 sec - exiting 07:46:04 (3592): No heartbeat from core client for 30 sec - exiting 07:46:05 (3592): No heartbeat from core client for 30 sec - exiting 07:46:06 (3592): No heartbeat from core client for 30 sec - exiting 07:46:07 (3592): No heartbeat from core client for 30 sec - exiting 07:46:08 (3592): No heartbeat from core client for 30 sec - exiting 07:46:09 (3592): No heartbeat from core client for 30 sec - exiting 07:46:10 (3592): No heartbeat from core client for 30 sec - exiting 07:46:11 (3592): No heartbeat from core client for 30 sec - exiting 07:46:12 (3592): No heartbeat from core client for 30 sec - exiting 07:46:13 (3592): No heartbeat from core client for 30 sec - exiting 07:46:14 (3592): No heartbeat from core client for 30 sec - exiting 07:46:46 (3592): No heartbeat from core client for 30 sec - exiting 07:46:47 (3592): No heartbeat from core client for 30 sec - exiting 07:46:48 (3592): No heartbeat from core client for 30 sec - exiting 07:46:49 (3592): No heartbeat from core client for 30 sec - exiting 07:46:50 (3592): No heartbeat from core client for 30 sec - exiting 07:46:51 (3592): No heartbeat from core client for 30 sec - exiting 07:46:52 (3592): No heartbeat from core client for 30 sec - exiting 07:46:53 (3592): No heartbeat from core client for 30 sec - exiting 07:46:54 (3592): No heartbeat from core client for 30 sec - exiting 07:46:55 (3592): No heartbeat from core client for 30 sec - exiting 07:46:56 (3592): No heartbeat from core client for 30 sec - exiting 07:46:57 (3592): No heartbeat from core client for 30 sec - exiting 07:46:58 (3592): No heartbeat from core client for 30 sec - exiting 07:46:59 (3592): No heartbeat from core client for 30 sec - exiting 07:47:00 (3592): No heartbeat from core client for 30 sec - exiting 07:47:01 (3592): No heartbeat from core client for 30 sec - exiting 07:47:02 (3592): No heartbeat from core client for 30 sec - exiting 07:47:03 (3592): No heartbeat from core client for 30 sec - exiting 07:47:04 (3592): No heartbeat from core client for 30 sec - exiting 07:47:05 (3592): No heartbeat from core client for 30 sec - exiting 07:47:06 (3592): No heartbeat from core client for 30 sec - exiting 07:47:07 (3592): No heartbeat from core client for 30 sec - exiting 07:47:08 (3592): No heartbeat from core client for 30 sec - exiting 07:47:09 (3592): No heartbeat from core client for 30 sec - exiting 07:47:10 (3592): No heartbeat from core client for 30 sec - exiting 07:47:11 (3592): No heartbeat from core client for 30 sec - exiting 07:47:12 (3592): No heartbeat from core client for 30 sec - exiting 07:47:13 (3592): No heartbeat from core client for 30 sec - exiting 07:47:14 (3592): No heartbeat from core client for 30 sec - exiting 07:47:15 (3592): No heartbeat from core client for 30 sec - exiting 07:47:16 (3592): No heartbeat from core client for 30 sec - exiting 07:47:17 (3592): No heartbeat from core client for 30 sec - exiting 07:47:18 (3592): No heartbeat from core client for 30 sec - exiting 07:47:19 (3592): No heartbeat from core client for 30 sec - exiting 07:47:20 (3592): No heartbeat from core client for 30 sec - exiting 07:47:21 (3592): No heartbeat from core client for 30 sec - exiting 07:47:22 (3592): No heartbeat from core client for 30 sec - exiting 07:47:23 (3592): No heartbeat from core client for 30 sec - exiting 07:47:24 (3592): No heartbeat from core client for 30 sec - exiting 07:47:25 (3592): No heartbeat from core client for 30 sec - exiting 07:47:26 (3592): No heartbeat from core client for 30 sec - exiting 07:47:27 (3592): No heartbeat from core client for 30 sec - exiting 07:47:28 (3592): No heartbeat from core client for 30 sec - exiting 07:47:29 (3592): No heartbeat from core client for 30 sec - exiting 07:47:30 (3592): No heartbeat from core client for 30 sec - exiting 07:47:31 (3592): No heartbeat from core client for 30 sec - exiting 07:47:32 (3592): No heartbeat from core client for 30 sec - exiting 07:47:33 (3592): No heartbeat from core client for 30 sec - exiting 07:47:34 (3592): No heartbeat from core client for 30 sec - exiting 07:47:35 (3592): No heartbeat from core client for 30 sec - exiting 07:47:36 (3592): No heartbeat from core client for 30 sec - exiting 07:47:37 (3592): No heartbeat from core client for 30 sec - exiting 07:47:38 (3592): No heartbeat from core client for 30 sec - exiting 07:47:39 (3592): No heartbeat from core client for 30 sec - exiting 07:47:40 (3592): No heartbeat from core client for 30 sec - exiting 07:47:41 (3592): No heartbeat from core client for 30 sec - exiting 07:47:42 (3592): No heartbeat from core client for 30 sec - exiting 07:47:43 (3592): No heartbeat from core client for 30 sec - exiting 07:47:44 (3592): No heartbeat from core client for 30 sec - exiting 07:47:45 (3592): No heartbeat from core client for 30 sec - exiting 07:47:46 (3592): No heartbeat from core client for 30 sec - exiting 07:47:47 (3592): No heartbeat from core client for 30 sec - exiting 07:47:48 (3592): No heartbeat from core client for 30 sec - exiting 07:47:49 (3592): No heartbeat from core client for 30 sec - exiting 07:47:50 (3592): No heartbeat from core client for 30 sec - exiting 07:47:51 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 09:35:05 (2184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:06 (2184): No heartbeat from core client for 30 sec - exiting 09:39:42 (972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:39 (3396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:40 (3396): No heartbeat from core client for 30 sec - exiting 11:28:41 (3396): No heartbeat from core client for 30 sec - exiting 11:28:42 (3396): No heartbeat from core client for 30 sec - exiting 11:28:43 (3396): No heartbeat from core client for 30 sec - exiting 11:28:44 (3396): No heartbeat from core client for 30 sec - exiting 11:28:45 (3396): No heartbeat from core client for 30 sec - exiting 11:28:46 (3396): No heartbeat from core client for 30 sec - exiting 11:28:47 (3396): No heartbeat from core client for 30 sec - exiting 11:28:48 (3396): No heartbeat from core client for 30 sec - exiting 11:28:49 (3396): No heartbeat from core client for 30 sec - exiting 11:32:17 (1100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:21:44 (1516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:21:45 (1516): No heartbeat from core client for 30 sec - exiting 17:21:46 (1516): No heartbeat from core client for 30 sec - exiting 17:21:47 (1516): No heartbeat from core client for 30 sec - exiting 17:21:48 (1516): No heartbeat from core client for 30 sec - exiting 17:21:49 (1516): No heartbeat from core client for 30 sec - exiting 17:21:50 (1516): No heartbeat from core client for 30 sec - exiting 17:21:51 (1516): No heartbeat from core client for 30 sec - exiting 17:21:52 (1516): No heartbeat from core client for 30 sec - exiting 17:21:53 (1516): No heartbeat from core client for 30 sec - exiting 17:21:54 (1516): No heartbeat from core client for 30 sec - exiting Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 17:24:10 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:11 (2852): No heartbeat from core client for 30 sec - exiting 17:24:12 (2852): No heartbeat from core client for 30 sec - exiting 17:24:14 (2852): No heartbeat from core client for 30 sec - exiting 17:24:15 (2852): No heartbeat from core client for 30 sec - exiting 17:24:16 (2852): No heartbeat from core client for 30 sec - exiting 17:24:17 (2852): No heartbeat from core client for 30 sec - exiting 17:24:18 (2852): No heartbeat from core client for 30 sec - exiting 17:24:19 (2852): No heartbeat from core client for 30 sec - exiting 17:24:20 (2852): No heartbeat from core client for 30 sec - exiting 17:24:21 (2852): No heartbeat from core client for 30 sec - exiting Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Sorry, too many model crashes! :-( 17:25:40 (2412): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Oct 2010 23:25:57	1106244	11935207	famous_v55x_1599_200_006736950_1	421,226	156,069	0.3705
16 Oct 2010 23:25:57	1106244	11935207	famous_v55x_1599_200_006736950_1	411,866	152,795	0.3710
16 Oct 2010 23:25:57	1106244	11935207	famous_v55x_1599_200_006736950_1	402,506	149,515	0.3715
16 Oct 2010 23:25:57	1106244	11935207	famous_v55x_1599_200_006736950_1	393,146	146,229	0.3719
16 Oct 2010 23:25:57	1106244	11935207	famous_v55x_1599_200_006736950_1	383,786	143,005	0.3726
16 Oct 2010 23:25:57	1106244	11935207	famous_v55x_1599_200_006736950_1	374,426	139,736	0.3732
16 Oct 2010 23:25:57	1106244	11935207	famous_v55x_1599_200_006736950_1	365,066	136,449	0.3738
16 Oct 2010 23:25:57	1106244	11935207	famous_v55x_1599_200_006736950_1	355,706	133,175	0.3744
16 Oct 2010 23:25:57	1106244	11935207	famous_v55x_1599_200_006736950_1	346,346	129,908	0.3751
16 Oct 2010 06:30:07	1106244	11935207	famous_v55x_1599_200_006736950_1	336,986	126,773	0.3762
16 Oct 2010 04:36:51	1106244	11935207	famous_v55x_1599_200_006736950_1	327,626	122,808	0.3748
16 Oct 2010 04:03:25	1106244	11935207	famous_v55x_1599_200_006736950_1	318,266	118,967	0.3738
16 Oct 2010 04:03:25	1106244	11935207	famous_v55x_1599_200_006736950_1	308,906	115,148	0.3728
16 Oct 2010 04:03:25	1106244	11935207	famous_v55x_1599_200_006736950_1	299,546	111,289	0.3715
16 Oct 2010 00:00:25	1106244	11935207	famous_v55x_1599_200_006736950_1	290,186	107,587	0.3708
15 Oct 2010 23:50:13	1106244	11935207	famous_v55x_1599_200_006736950_1	280,826	104,932	0.3737
15 Oct 2010 23:50:13	1106244	11935207	famous_v55x_1599_200_006736950_1	271,466	102,198	0.3765
15 Oct 2010 23:50:13	1106244	11935207	famous_v55x_1599_200_006736950_1	262,106	99,301	0.3789
15 Oct 2010 23:50:13	1106244	11935207	famous_v55x_1599_200_006736950_1	252,746	96,410	0.3815
15 Oct 2010 23:50:13	1106244	11935207	famous_v55x_1599_200_006736950_1	243,386	93,510	0.3842