Task 13797933

Name	hadam3p_saf_79su_2007_1_007569639_1
Workunit	7747769
Created	19 Dec 2011, 18:33:29 UTC
Sent	19 Dec 2011, 19:39:16 UTC
Report deadline	1 Dec 2012, 0:59:16 UTC
Received	8 Jan 2012, 6:52:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1399171
Run time	3 days 10 hours 33 min 36 sec
CPU time	3 days 2 hours 33 min 49 sec
Validate state	Invalid
Credit	1,683.45
Device peak FLOPS	2.15 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... 06:07:46 (1380): No heartbeat from core client for 30 sec - exiting 06:07:47 (1380): No heartbeat from core client for 30 sec - exiting 06:07:48 (1380): No heartbeat from core client for 30 sec - exiting 06:07:49 (1380): No heartbeat from core client for 30 sec - exiting 06:07:50 (1380): No heartbeat from core client for 30 sec - exiting 06:07:51 (1380): No heartbeat from core client for 30 sec - exiting 06:07:52 (1380): No heartbeat from core client for 30 sec - exiting 06:07:53 (1380): No heartbeat from core client for 30 sec - exiting 06:07:54 (1380): No heartbeat from core client for 30 sec - exiting 06:07:55 (1380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2204, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3824, iMonCtr=2 Model crash detected, will try to restart... 16:25:06 (2324): No heartbeat from core client for 30 sec - exiting 16:25:07 (2324): No heartbeat from core client for 30 sec - exiting 16:25:08 (2324): No heartbeat from core client for 30 sec - exiting 16:25:09 (2324): No heartbeat from core client for 30 sec - exiting 16:25:10 (2324): No heartbeat from core client for 30 sec - exiting 16:25:11 (2324): No heartbeat from core client for 30 sec - exiting 16:25:12 (2324): No heartbeat from core client for 30 sec - exiting 16:25:13 (2324): No heartbeat from core client for 30 sec - exiting 16:25:14 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5616, selfPID=5616, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 06:06:10 (2552): No heartbeat from core client for 30 sec - exiting 06:06:11 (2552): No heartbeat from core client for 30 sec - exiting 06:06:12 (2552): No heartbeat from core client for 30 sec - exiting 06:06:13 (2552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6444, selfPID=6444, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 23:17:22 (2144): No heartbeat from core client for 30 sec - exiting 23:17:23 (2144): No heartbeat from core client for 30 sec - exiting 23:17:24 (2144): No heartbeat from core client for 30 sec - exiting 23:17:25 (2144): No heartbeat from core client for 30 sec - exiting 23:17:26 (2144): No heartbeat from core client for 30 sec - exiting 23:17:27 (2144): No heartbeat from core client for 30 sec - exiting 23:17:28 (2144): No heartbeat from core client for 30 sec - exiting 23:17:29 (2144): No heartbeat from core client for 30 sec - exiting 23:17:30 (2144): No heartbeat from core client for 30 sec - exiting 23:17:31 (2144): No heartbeat from core client for 30 sec - exiting 23:17:32 (2144): No heartbeat from core client for 30 sec - exiting 23:17:33 (2144): No heartbeat from core client for 30 sec - exiting 23:17:34 (2144): No heartbeat from core client for 30 sec - exiting 23:17:35 (2144): No heartbeat from core client for 30 sec - exiting 23:17:36 (2144): No heartbeat from core client for 30 sec - exiting 23:17:37 (2144): No heartbeat from core client for 30 sec - exiting 23:17:38 (2144): No heartbeat from core client for 30 sec - exiting 23:17:39 (2144): No heartbeat from core client for 30 sec - exiting 23:17:40 (2144): No heartbeat from core client for 30 sec - exiting 23:17:41 (2144): No heartbeat from core client for 30 sec - exiting 23:17:42 (2144): No heartbeat from core client for 30 sec - exiting 23:17:43 (2144): No heartbeat from core client for 30 sec - exiting 23:17:44 (2144): No heartbeat from core client for 30 sec - exiting 23:17:45 (2144): No heartbeat from core client for 30 sec - exiting 23:17:46 (2144): No heartbeat from core client for 30 sec - exiting 23:17:47 (2144): No heartbeat from core client for 30 sec - exiting 23:17:48 (2144): No heartbeat from core client for 30 sec - exiting 23:17:49 (2144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5208, selfPID=5168, iMonCtr=1 Model crash detected, will try to restart... 06:39:47 (4856): No heartbeat from core client for 30 sec - exiting 06:39:48 (4856): No heartbeat from core client for 30 sec - exiting 06:39:49 (4856): No heartbeat from core client for 30 sec - exiting 06:39:50 (4856): No heartbeat from core client for 30 sec - exiting 06:39:51 (4856): No heartbeat from core client for 30 sec - exiting 06:39:52 (4856): No heartbeat from core client for 30 sec - exiting 06:39:53 (4856): No heartbeat from core client for 30 sec - exiting 06:39:54 (4856): No heartbeat from core client for 30 sec - exiting 06:39:55 (4856): No heartbeat from core client for 30 sec - exiting 06:39:56 (4856): No heartbeat from core client for 30 sec - exiting 06:39:57 (4856): No heartbeat from core client for 30 sec - exiting 06:39:58 (4856): No heartbeat from core client for 30 sec - exiting 06:39:59 (4856): No heartbeat from core client for 30 sec - exiting 06:40:00 (4856): No heartbeat from core client for 30 sec - exiting 06:40:01 (4856): No heartbeat from core client for 30 sec - exiting 06:40:02 (4856): No heartbeat from core client for 30 sec - exiting 06:40:03 (4856): No heartbeat from core client for 30 sec - exiting 06:40:04 (4856): No heartbeat from core client for 30 sec - exiting 06:40:05 (4856): No heartbeat from core client for 30 sec - exiting 06:40:06 (4856): No heartbeat from core client for 30 sec - exiting 06:40:07 (4856): No heartbeat from core client for 30 sec - exiting 06:40:08 (4856): No heartbeat from core client for 30 sec - exiting 06:40:09 (4856): No heartbeat from core client for 30 sec - exiting 06:40:10 (4856): No heartbeat from core client for 30 sec - exiting 06:40:11 (4856): No heartbeat from core client for 30 sec - exiting 06:40:12 (4856): No heartbeat from core client for 30 sec - exiting 06:40:13 (4856): No heartbeat from core client for 30 sec - exiting 06:40:14 (4856): No heartbeat from core client for 30 sec - exiting 06:40:15 (4856): No heartbeat from core client for 30 sec - exiting 06:40:16 (4856): No heartbeat from core client for 30 sec - exiting 06:40:17 (4856): No heartbeat from core client for 30 sec - exiting 06:40:18 (4856): No heartbeat from core client for 30 sec - exiting 06:40:19 (4856): No heartbeat from core client for 30 sec - exiting 06:40:20 (4856): No heartbeat from core client for 30 sec - exiting 06:40:21 (4856): No heartbeat from core client for 30 sec - exiting 06:40:22 (4856): No heartbeat from core client for 30 sec - exiting 06:40:23 (4856): No heartbeat from core client for 30 sec - exiting 06:40:24 (4856): No heartbeat from core client for 30 sec - exiting 06:40:25 (4856): No heartbeat from core client for 30 sec - exiting 06:40:26 (4856): No heartbeat from core client for 30 sec - exiting 06:40:27 (4856): No heartbeat from core client for 30 sec - exiting 06:40:28 (4856): No heartbeat from core client for 30 sec - exiting 06:40:29 (4856): No heartbeat from core client for 30 sec - exiting 06:40:30 (4856): No heartbeat from core client for 30 sec - exiting 06:40:31 (4856): No heartbeat from core client for 30 sec - exiting 06:40:32 (4856): No heartbeat from core client for 30 sec - exiting 06:40:33 (4856): No heartbeat from core client for 30 sec - exiting 06:40:34 (4856): No heartbeat from core client for 30 sec - exiting 06:40:35 (4856): No heartbeat from core client for 30 sec - exiting 06:40:36 (4856): No heartbeat from core client for 30 sec - exiting 06:40:37 (4856): No heartbeat from core client for 30 sec - exiting 06:40:38 (4856): No heartbeat from core client for 30 sec - exiting 06:40:39 (4856): No heartbeat from core client for 30 sec - exiting 06:40:40 (4856): No heartbeat from core client for 30 sec - exiting 06:40:41 (4856): No heartbeat from core client for 30 sec - exiting 06:40:42 (4856): No heartbeat from core client for 30 sec - exiting 06:40:43 (4856): No heartbeat from core client for 30 sec - exiting 06:40:44 (4856): No heartbeat from core client for 30 sec - exiting 06:40:45 (4856): No heartbeat from core client for 30 sec - exiting 06:41:16 (4856): No heartbeat from core client for 30 sec - exiting 06:41:17 (4856): No heartbeat from core client for 30 sec - exiting 06:41:18 (4856): No heartbeat from core client for 30 sec - exiting 06:41:19 (4856): No heartbeat from core client for 30 sec - exiting 06:41:20 (4856): No heartbeat from core client for 30 sec - exiting 06:41:21 (4856): No heartbeat from core client for 30 sec - exiting 06:41:22 (4856): No heartbeat from core client for 30 sec - exiting 06:41:23 (4856): No heartbeat from core client for 30 sec - exiting 06:41:24 (4856): No heartbeat from core client for 30 sec - exiting 06:41:25 (4856): No heartbeat from core client for 30 sec - exiting 06:41:26 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4168, selfPID=4168, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2764, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4056, selfPID=4056, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4464, selfPID=4464, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1076, selfPID=1076, iMonCtr=2 06:04:31 (1784): No heartbeat from core client for 30 sec - exiting 06:04:32 (1784): No heartbeat from core client for 30 sec - exiting 06:04:33 (1784): No heartbeat from core client for 30 sec - exiting 06:04:34 (1784): No heartbeat from core client for 30 sec - exiting 06:04:35 (1784): No heartbeat from core client for 30 sec - exiting 06:04:36 (1784): No heartbeat from core client for 30 sec - exiting 06:04:37 (1784): No heartbeat from core client for 30 sec - exiting 06:04:38 (1784): No heartbeat from core client for 30 sec - exiting 06:04:39 (1784): No heartbeat from core client for 30 sec - exiting 06:04:40 (1784): No heartbeat from core client for 30 sec - exiting 06:04:41 (1784): No heartbeat from core client for 30 sec - exiting 06:04:42 (1784): No heartbeat from core client for 30 sec - exiting 06:04:43 (1784): No heartbeat from core client for 30 sec - exiting 06:04:44 (1784): No heartbeat from core client for 30 sec - exiting 06:04:45 (1784): No heartbeat from core client for 30 sec - exiting 06:04:46 (1784): No heartbeat from core client for 30 sec - exiting 06:04:47 (1784): No heartbeat from core client for 30 sec - exiting 06:04:48 (1784): No heartbeat from core client for 30 sec - exiting 06:04:49 (1784): No heartbeat from core client for 30 sec - exiting 06:04:50 (1784): No heartbeat from core client for 30 sec - exiting 06:04:51 (1784): No heartbeat from core client for 30 sec - exiting 06:04:52 (1784): No heartbeat from core client for 30 sec - exiting 06:04:53 (1784): No heartbeat from core client for 30 sec - exiting 06:04:54 (1784): No heartbeat from core client for 30 sec - exiting 06:04:55 (1784): No heartbeat from core client for 30 sec - exiting 06:04:56 (1784): No heartbeat from core client for 30 sec - exiting 06:04:57 (1784): No heartbeat from core client for 30 sec - exiting 06:04:58 (1784): No heartbeat from core client for 30 sec - exiting 06:04:59 (1784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3024, selfPID=3024, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4352, selfPID=4352, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6712, selfPID=6712, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:18:58 (880): No heartbeat from core client for 30 sec - exiting 19:18:59 (880): No heartbeat from core client for 30 sec - exiting 19:19:00 (880): No heartbeat from core client for 30 sec - exiting 19:19:01 (880): No heartbeat from core client for 30 sec - exiting 19:19:02 (880): No heartbeat from core client for 30 sec - exiting 19:19:03 (880): No heartbeat from core client for 30 sec - exiting 19:19:04 (880): No heartbeat from core client for 30 sec - exiting 19:19:05 (880): No heartbeat from core client for 30 sec - exiting 19:19:06 (880): No heartbeat from core client for 30 sec - exiting 19:19:07 (880): No heartbeat from core client for 30 sec - exiting 19:19:08 (880): No heartbeat from core client for 30 sec - exiting 19:19:09 (880): No heartbeat from core client for 30 sec - exiting 19:19:10 (880): No heartbeat from core client for 30 sec - exiting 19:19:11 (880): No heartbeat from core client for 30 sec - exiting 19:19:42 (880): No heartbeat from core client for 30 sec - exiting 19:19:43 (880): No heartbeat from core client for 30 sec - exiting 19:19:44 (880): No heartbeat from core client for 30 sec - exiting 19:19:45 (880): No heartbeat from core client for 30 sec - exiting 19:19:46 (880): No heartbeat from core client for 30 sec - exiting 19:19:47 (880): No heartbeat from core client for 30 sec - exiting 19:19:48 (880): No heartbeat from core client for 30 sec - exiting 19:19:49 (880): No heartbeat from core client for 30 sec - exiting 19:19:50 (880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6704, selfPID=6704, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6636, selfPID=6636, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6828, selfPID=6828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6312, selfPID=6312, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5256, selfPID=4704, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:57:54 (4064): No heartbeat from core client for 30 sec - exiting 17:57:55 (4064): No heartbeat from core client for 30 sec - exiting 17:57:56 (4064): No heartbeat from core client for 30 sec - exiting 17:57:57 (4064): No heartbeat from core client for 30 sec - exiting 17:57:58 (4064): No heartbeat from core client for 30 sec - exiting 17:57:59 (4064): No heartbeat from core client for 30 sec - exiting 17:58:00 (4064): No heartbeat from core client for 30 sec - exiting 17:58:01 (4064): No heartbeat from core client for 30 sec - exiting 17:58:02 (4064): No heartbeat from core client for 30 sec - exiting 17:58:03 (4064): No heartbeat from core client for 30 sec - exiting 17:58:04 (4064): No heartbeat from core client for 30 sec - exiting 17:58:05 (4064): No heartbeat from core client for 30 sec - exiting 17:58:06 (4064): No heartbeat from core client for 30 sec - exiting 17:58:07 (4064): No heartbeat from core client for 30 sec - exiting 17:58:08 (4064): No heartbeat from core client for 30 sec - exiting 17:58:09 (4064): No heartbeat from core client for 30 sec - exiting 17:58:10 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1044, selfPID=1044, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5504, selfPID=5504, iMonCtr=2 22:06:41 (1164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5736, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5668, selfPID=4288, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... 16:20:06 (5716): No heartbeat from core client for 30 sec - exiting 16:20:07 (5716): No heartbeat from core client for 30 sec - exiting 16:20:08 (5716): No heartbeat from core client for 30 sec - exiting 16:20:09 (5716): No heartbeat from core client for 30 sec - exiting 16:20:10 (5716): No heartbeat from core client for 30 sec - exiting 16:20:11 (5716): No heartbeat from core client for 30 sec - exiting 16:20:12 (5716): No heartbeat from core client for 30 sec - exiting 16:20:13 (5716): No heartbeat from core client for 30 sec - exiting 16:20:14 (5716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2288, selfPID=2288, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5224, selfPID=5224, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3012, selfPID=3012, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6672, selfPID=6672, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5392, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5508, selfPID=180, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 16:18:05 (4272): No heartbeat from core client for 30 sec - exiting 16:18:06 (4272): No heartbeat from core client for 30 sec - exiting 16:18:07 (4272): No heartbeat from core client for 30 sec - exiting 16:18:08 (4272): No heartbeat from core client for 30 sec - exiting 16:18:09 (4272): No heartbeat from core client for 30 sec - exiting 16:18:10 (4272): No heartbeat from core client for 30 sec - exiting 16:18:11 (4272): No heartbeat from core client for 30 sec - exiting 16:18:12 (4272): No heartbeat from core client for 30 sec - exiting 16:18:13 (4272): No heartbeat from core client for 30 sec - exiting 16:18:14 (4272): No heartbeat from core client for 30 sec - exiting 16:18:15 (4272): No heartbeat from core client for 30 sec - exiting 16:18:16 (4272): No heartbeat from core client for 30 sec - exiting 16:18:17 (4272): No heartbeat from core client for 30 sec - exiting 16:18:18 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:21:25 (5536): No heartbeat from core client for 30 sec - exiting 08:21:26 (5536): No heartbeat from core client for 30 sec - exiting 08:21:27 (5536): No heartbeat from core client for 30 sec - exiting 08:21:28 (5536): No heartbeat from core client for 30 sec - exiting 08:21:29 (5536): No heartbeat from core client for 30 sec - exiting 08:21:30 (5536): No heartbeat from core client for 30 sec - exiting 08:21:31 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_79su_2007_1_007569639_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_79su_2007_1_007569639_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_79su_2007_1_007569639_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jan 2012 17:50:24	1154365	13797933	hadam3p_saf_79su_2007_1_007569639_1	103,776	243,086	2.3424
04 Jan 2012 16:38:00	1154365	13797933	hadam3p_saf_79su_2007_1_007569639_1	92,256	216,611	2.3479
02 Jan 2012 04:59:00	1154365	13797933	hadam3p_saf_79su_2007_1_007569639_1	80,736	189,977	2.3531
01 Jan 2012 11:37:52	1154365	13797933	hadam3p_saf_79su_2007_1_007569639_1	69,216	163,386	2.3605
31 Dec 2011 13:27:30	1154365	13797933	hadam3p_saf_79su_2007_1_007569639_1	57,696	136,377	2.3637
29 Dec 2011 19:24:05	1154365	13797933	hadam3p_saf_79su_2007_1_007569639_1	46,176	109,482	2.3710
27 Dec 2011 23:37:34	1154365	13797933	hadam3p_saf_79su_2007_1_007569639_1	34,656	82,364	2.3766
26 Dec 2011 16:11:32	1154365	13797933	hadam3p_saf_79su_2007_1_007569639_1	23,136	55,205	2.3861
21 Dec 2011 17:15:12	1154365	13797933	hadam3p_saf_79su_2007_1_007569639_1	11,616	27,776	2.3912