Task 11960555

Name	hadam3p_pnw_v3c0_1960_1_006722921_2
Workunit	6926171
Created	2 Nov 2010, 17:55:41 UTC
Sent	2 Nov 2010, 18:07:33 UTC
Report deadline	15 Oct 2011, 23:27:33 UTC
Received	9 Mar 2011, 16:20:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1111379
Run time	9 days 19 hours 33 min 50 sec
CPU time	6 days 18 hours 51 min 9 sec
Validate state	Invalid
Credit	2,004.63
Device peak FLOPS	1.90 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.05 windows_intelx86
Stderr	<core_client_version>6.6.38</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7172, iMonCtr=2 18:55:37 (4696): No heartbeat from core client for 30 sec - exiting 18:55:38 (4696): No heartbeat from core client for 30 sec - exiting 18:55:39 (4696): No heartbeat from core client for 30 sec - exiting 18:55:40 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:24:11 (1396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1264, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5428, selfPID=5428, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4428, selfPID=4428, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1752, selfPID=1752, iMonCtr=2 17:33:35 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3288, selfPID=4252, iMonCtr=1 Model crash detected, will try to restart... 19:06:21 (496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4604, selfPID=632, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:10:40 (4040): No heartbeat from core client for 30 sec - exiting 11:10:41 (4040): No heartbeat from core client for 30 sec - exiting 11:10:42 (4040): No heartbeat from core client for 30 sec - exiting 11:10:43 (4040): No heartbeat from core client for 30 sec - exiting 11:10:44 (4040): No heartbeat from core client for 30 sec - exiting 11:10:45 (4040): No heartbeat from core client for 30 sec - exiting 11:10:46 (4040): No heartbeat from core client for 30 sec - exiting 11:10:47 (4040): No heartbeat from core client for 30 sec - exiting 11:10:48 (4040): No heartbeat from core client for 30 sec - exiting 11:10:49 (4040): No heartbeat from core client for 30 sec - exiting 11:10:50 (4040): No heartbeat from core client for 30 sec - exiting 11:10:51 (4040): No heartbeat from core client for 30 sec - exiting 11:10:52 (4040): No heartbeat from core client for 30 sec - exiting 11:10:53 (4040): No heartbeat from core client for 30 sec - exiting 11:10:54 (4040): No heartbeat from core client for 30 sec - exiting 11:10:55 (4040): No heartbeat from core client for 30 sec - exiting 11:10:56 (4040): No heartbeat from core client for 30 sec - exiting 11:10:57 (4040): No heartbeat from core client for 30 sec - exiting 11:10:58 (4040): No heartbeat from core client for 30 sec - exiting 11:10:59 (4040): No heartbeat from core client for 30 sec - exiting 11:11:00 (4040): No heartbeat from core client for 30 sec - exiting 11:11:01 (4040): No heartbeat from core client for 30 sec - exiting 11:11:02 (4040): No heartbeat from core client for 30 sec - exiting 11:11:03 (4040): No heartbeat from core client for 30 sec - exiting 11:11:04 (4040): No heartbeat from core client for 30 sec - exiting 11:11:05 (4040): No heartbeat from core client for 30 sec - exiting 11:11:06 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7024, selfPID=7024, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6964, selfPID=6212, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7120, selfPID=7336, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6784, selfPID=7504, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6340, selfPID=6340, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6100, selfPID=6712, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6284, selfPID=6284, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7452, selfPID=6372, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4920, selfPID=4920, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4780, selfPID=4780, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:02:56 (3260): Can't set up shared mem: -1. Will run in standalone mode. 09:04:09 (5444): Can't set up shared mem: -1. Will run in standalone mode. 09:04:11 (4624): Can't set up shared mem: -1. Will run in standalone mode. 10:34:02 (5344): Can't acquire lockfile (32) - waiting 35s 10:34:38 (5344): Can't acquire lockfile (32) - exiting 10:34:38 (5344): Error: The process cannot access the file because it is being used by another process. (0x20) 10:34:38 (5224): Can't acquire lockfile (32) - waiting 35s 10:35:13 (5224): Can't acquire lockfile (32) - exiting 10:35:13 (5224): Error: The process cannot access the file because it is being used by another process. (0x20) 10:35:14 (5568): Can't acquire lockfile (32) - waiting 35s 10:35:49 (5568): Can't acquire lockfile (32) - exiting 10:35:49 (5568): Error: The process cannot access the file because it is being used by another process. (0x20) 10:35:49 (6044): Can't acquire lockfile (32) - waiting 35s 10:36:24 (6044): Can't acquire lockfile (32) - exiting 10:36:24 (6044): Error: The process cannot access the file because it is being used by another process. (0x20) 10:36:25 (5920): Can't acquire lockfile (32) - waiting 35s 10:37:00 (5920): Can't acquire lockfile (32) - exiting 10:37:00 (5920): Error: The process cannot access the file because it is being used by another process. (0x20) 10:37:00 (4320): Can't acquire lockfile (32) - waiting 35s 10:37:35 (4320): Can't acquire lockfile (32) - exiting 10:37:35 (4320): Error: The process cannot access the file because it is being used by another process. (0x20) 10:37:35 (5640): Can't acquire lockfile (32) - waiting 35s 10:38:10 (5640): Can't acquire lockfile (32) - exiting 10:38:10 (5640): Error: The process cannot access the file because it is being used by another process. (0x20) 10:38:10 (3868): Can't acquire lockfile (32) - waiting 35s 10:38:45 (3868): Can't acquire lockfile (32) - exiting 10:38:45 (3868): Error: The process cannot access the file because it is being used by another process. (0x20) 10:38:45 (1448): Can't acquire lockfile (32) - waiting 35s 10:39:20 (1448): Can't acquire lockfile (32) - exiting 10:39:20 (1448): Error: The process cannot access the file because it is being used by another process. (0x20) 10:39:21 (4120): Can't acquire lockfile (32) - waiting 35s 10:39:56 (4120): Can't acquire lockfile (32) - exiting 10:39:56 (4120): Error: The process cannot access the file because it is being used by another process. (0x20) 10:39:56 (6020): Can't acquire lockfile (32) - waiting 35s 10:40:31 (6020): Can't acquire lockfile (32) - exiting 10:40:31 (6020): Error: The process cannot access the file because it is being used by another process. (0x20) 10:40:32 (1404): Can't acquire lockfile (32) - waiting 35s 10:41:07 (1404): Can't acquire lockfile (32) - exiting 10:41:07 (1404): Error: The process cannot access the file because it is being used by another process. (0x20) 10:41:07 (3956): Can't acquire lockfile (32) - waiting 35s 10:41:42 (3956): Can't acquire lockfile (32) - exiting 10:41:42 (3956): Error: The process cannot access the file because it is being used by another process. (0x20) 10:41:42 (980): Can't acquire lockfile (32) - waiting 35s 10:42:17 (980): Can't acquire lockfile (32) - exiting 10:42:17 (980): Error: The process cannot access the file because it is being used by another process. (0x20) 10:42:18 (2164): Can't acquire lockfile (32) - waiting 35s 10:42:53 (2164): Can't acquire lockfile (32) - exiting 10:42:53 (2164): Error: The process cannot access the file because it is being used by another process. (0x20) 10:42:53 (5252): Can't acquire lockfile (32) - waiting 35s 10:43:28 (5252): Can't acquire lockfile (32) - exiting 10:43:28 (5252): Error: The process cannot access the file because it is being used by another process. (0x20) 10:43:28 (5636): Can't acquire lockfile (32) - waiting 35s 10:44:03 (5636): Can't acquire lockfile (32) - exiting 10:44:03 (5636): Error: The process cannot access the file because it is being used by another process. (0x20) 10:44:04 (4112): Can't acquire lockfile (32) - waiting 35s 10:44:39 (4112): Can't acquire lockfile (32) - exiting 10:44:39 (4112): Error: The process cannot access the file because it is being used by another process. (0x20) 10:44:39 (3324): Can't acquire lockfile (32) - waiting 35s 10:45:14 (3324): Can't acquire lockfile (32) - exiting 10:45:14 (3324): Error: The process cannot access the file because it is being used by another process. (0x20) 10:45:15 (1400): Can't acquire lockfile (32) - waiting 35s 10:45:50 (1400): Can't acquire lockfile (32) - exiting 10:45:50 (1400): Error: The process cannot access the file because it is being used by another process. (0x20) 10:45:50 (1360): Can't acquire lockfile (32) - waiting 35s 10:46:25 (1360): Can't acquire lockfile (32) - exiting 10:46:25 (1360): Error: The process cannot access the file because it is being used by another process. (0x20) 10:46:25 (676): Can't acquire lockfile (32) - waiting 35s 10:47:00 (676): Can't acquire lockfile (32) - exiting 10:47:00 (676): Error: The process cannot access the file because it is being used by another process. (0x20) 10:47:00 (3776): Can't acquire lockfile (32) - waiting 35s 10:47:35 (3776): Can't acquire lockfile (32) - exiting 10:47:35 (3776): Error: The process cannot access the file because it is being used by another process. (0x20) 10:47:36 (940): Can't acquire lockfile (32) - waiting 35s 10:48:11 (940): Can't acquire lockfile (32) - exiting 10:48:11 (940): Error: The process cannot access the file because it is being used by another process. (0x20) 10:48:11 (4304): Can't acquire lockfile (32) - waiting 35s 10:48:46 (4304): Can't acquire lockfile (32) - exiting 10:48:46 (4304): Error: The process cannot access the file because it is being used by another process. (0x20) 10:48:46 (4200): Can't acquire lockfile (32) - waiting 35s 10:49:21 (4200): Can't acquire lockfile (32) - exiting 10:49:21 (4200): Error: The process cannot access the file because it is being used by another process. (0x20) 10:49:21 (580): Can't acquire lockfile (32) - waiting 35s 10:49:56 (580): Can't acquire lockfile (32) - exiting 10:49:56 (580): Error: The process cannot access the file because it is being used by another process. (0x20) 10:49:57 (696): Can't acquire lockfile (32) - waiting 35s 10:50:32 (696): Can't acquire lockfile (32) - exiting 10:50:32 (696): Error: The process cannot access the file because it is being used by another process. (0x20) 10:50:32 (1872): Can't acquire lockfile (32) - waiting 35s 10:51:07 (1872): Can't acquire lockfile (32) - exiting 10:51:07 (1872): Error: The process cannot access the file because it is being used by another process. (0x20) 10:51:07 (4944): Can't acquire lockfile (32) - waiting 35s 10:51:42 (4944): Can't acquire lockfile (32) - exiting 10:51:42 (4944): Error: The process cannot access the file because it is being used by another process. (0x20) 10:51:42 (2224): Can't acquire lockfile (32) - waiting 35s 10:52:17 (2224): Can't acquire lockfile (32) - exiting 10:52:17 (2224): Error: The process cannot access the file because it is being used by another process. (0x20) 10:52:18 (5904): Can't acquire lockfile (32) - waiting 35s 10:52:53 (5904): Can't acquire lockfile (32) - exiting 10:52:53 (5904): Error: The process cannot access the file because it is being used by another process. (0x20) 10:52:53 (5692): Can't acquire lockfile (32) - waiting 35s 10:53:28 (5692): Can't acquire lockfile (32) - exiting 10:53:28 (5692): Error: The process cannot access the file because it is being used by another process. (0x20) 10:53:29 (3124): Can't acquire lockfile (32) - waiting 35s 10:54:04 (3124): Can't acquire lockfile (32) - exiting 10:54:04 (3124): Error: The process cannot access the file because it is being used by another process. (0x20) 10:54:04 (1764): Can't acquire lockfile (32) - waiting 35s 10:54:39 (1764): Can't acquire lockfile (32) - exiting 10:54:39 (1764): Error: The process cannot access the file because it is being used by another process. (0x20) 10:54:39 (1692): Can't acquire lockfile (32) - waiting 35s 10:55:14 (1692): Can't acquire lockfile (32) - exiting 10:55:14 (1692): Error: The process cannot access the file because it is being used by another process. (0x20) 10:55:14 (3780): Can't acquire lockfile (32) - waiting 35s 10:55:49 (3780): Can't acquire lockfile (32) - exiting 10:55:49 (3780): Error: The process cannot access the file because it is being used by another process. (0x20) 10:55:49 (4940): Can't acquire lockfile (32) - waiting 35s 10:56:24 (4940): Can't acquire lockfile (32) - exiting 10:56:24 (4940): Error: The process cannot access the file because it is being used by another process. (0x20) 10:56:25 (4100): Can't acquire lockfile (32) - waiting 35s 10:57:00 (4100): Can't acquire lockfile (32) - exiting 10:57:00 (4100): Error: The process cannot access the file because it is being used by another process. (0x20) 10:57:00 (5428): Can't acquire lockfile (32) - waiting 35s 10:57:35 (5428): Can't acquire lockfile (32) - exiting 10:57:35 (5428): Error: The process cannot access the file because it is being used by another process. (0x20) 10:57:35 (1872): Can't acquire lockfile (32) - waiting 35s 10:58:10 (1872): Can't acquire lockfile (32) - exiting 10:58:10 (1872): Error: The process cannot access the file because it is being used by another process. (0x20) 10:58:11 (3152): Can't acquire lockfile (32) - waiting 35s 10:58:46 (3152): Can't acquire lockfile (32) - exiting 10:58:46 (3152): Error: The process cannot access the file because it is being used by another process. (0x20) 10:58:46 (5484): Can't acquire lockfile (32) - waiting 35s 10:59:21 (5484): Can't acquire lockfile (32) - exiting 10:59:21 (5484): Error: The process cannot access the file because it is being used by another process. (0x20) 10:59:21 (4644): Can't acquire lockfile (32) - waiting 35s 10:59:56 (4644): Can't acquire lockfile (32) - exiting 10:59:56 (4644): Error: The process cannot access the file because it is being used by another process. (0x20) 10:59:56 (5944): Can't acquire lockfile (32) - waiting 35s 11:00:31 (5944): Can't acquire lockfile (32) - exiting 11:00:31 (5944): Error: The process cannot access the file because it is being used by another process. (0x20) 11:00:31 (1104): Can't acquire lockfile (32) - waiting 35s 11:01:06 (1104): Can't acquire lockfile (32) - exiting 11:01:06 (1104): Error: The process cannot access the file because it is being used by another process. (0x20) 11:01:07 (5484): Can't acquire lockfile (32) - waiting 35s 11:01:42 (5484): Can't acquire lockfile (32) - exiting 11:01:42 (5484): Error: The process cannot access the file because it is being used by another process. (0x20) 11:01:42 (4276): Can't acquire lockfile (32) - waiting 35s 11:02:17 (4276): Can't acquire lockfile (32) - exiting 11:02:17 (4276): Error: The process cannot access the file because it is being used by another process. (0x20) 11:02:17 (5904): Can't acquire lockfile (32) - waiting 35s 11:02:52 (5904): Can't acquire lockfile (32) - exiting 11:02:52 (5904): Error: The process cannot access the file because it is being used by another process. (0x20) 11:02:53 (592): Can't acquire lockfile (32) - waiting 35s 11:03:28 (592): Can't acquire lockfile (32) - exiting 11:03:28 (592): Error: The process cannot access the file because it is being used by another process. (0x20) 11:03:28 (3124): Can't acquire lockfile (32) - waiting 35s 11:04:03 (3124): Can't acquire lockfile (32) - exiting 11:04:03 (3124): Error: The process cannot access the file because it is being used by another process. (0x20) 11:04:03 (4104): Can't acquire lockfile (32) - waiting 35s 11:04:38 (4104): Can't acquire lockfile (32) - exiting 11:04:38 (4104): Error: The process cannot access the file because it is being used by another process. (0x20) 11:04:38 (5756): Can't acquire lockfile (32) - waiting 35s 11:05:13 (5756): Can't acquire lockfile (32) - exiting 11:05:13 (5756): Error: The process cannot access the file because it is being used by another process. (0x20) 11:05:13 (3124): Can't acquire lockfile (32) - waiting 35s 11:05:48 (3124): Can't acquire lockfile (32) - exiting 11:05:48 (3124): Error: The process cannot access the file because it is being used by another process. (0x20) 11:05:49 (3780): Can't acquire lockfile (32) - waiting 35s 11:06:24 (3780): Can't acquire lockfile (32) - exiting 11:06:24 (3780): Error: The process cannot access the file because it is being used by another process. (0x20) 11:06:24 (600): Can't acquire lockfile (32) - waiting 35s 11:06:59 (600): Can't acquire lockfile (32) - exiting 11:06:59 (600): Error: The process cannot access the file because it is being used by another process. (0x20) 11:06:59 (2376): Can't acquire lockfile (32) - waiting 35s 11:07:34 (2376): Can't acquire lockfile (32) - exiting 11:07:34 (2376): Error: The process cannot access the file because it is being used by another process. (0x20) 11:07:34 (3120): Can't acquire lockfile (32) - waiting 35s 11:08:09 (3120): Can't acquire lockfile (32) - exiting 11:08:09 (3120): Error: The process cannot access the file because it is being used by another process. (0x20) 11:08:10 (3320): Can't acquire lockfile (32) - waiting 35s 11:08:45 (3320): Can't acquire lockfile (32) - exiting 11:08:45 (3320): Error: The process cannot access the file because it is being used by another process. (0x20) 11:08:45 (4104): Can't acquire lockfile (32) - waiting 35s 11:09:20 (4104): Can't acquire lockfile (32) - exiting 11:09:20 (4104): Error: The process cannot access the file because it is being used by another process. (0x20) 11:09:20 (5728): Can't acquire lockfile (32) - waiting 35s 11:09:55 (5728): Can't acquire lockfile (32) - exiting 11:09:55 (5728): Error: The process cannot access the file because it is being used by another process. (0x20) 11:09:55 (980): Can't acquire lockfile (32) - waiting 35s 11:10:30 (980): Can't acquire lockfile (32) - exiting 11:10:30 (980): Error: The process cannot access the file because it is being used by another process. (0x20) 11:10:31 (1404): Can't acquire lockfile (32) - waiting 35s 11:11:06 (1404): Can't acquire lockfile (32) - exiting 11:11:06 (1404): Error: The process cannot access the file because it is being used by another process. (0x20) 11:11:06 (3780): Can't acquire lockfile (32) - waiting 35s 11:11:41 (3780): Can't acquire lockfile (32) - exiting 11:11:41 (3780): Error: The process cannot access the file because it is being used by another process. (0x20) 11:11:41 (2416): Can't acquire lockfile (32) - waiting 35s 11:12:16 (2416): Can't acquire lockfile (32) - exiting 11:12:16 (2416): Error: The process cannot access the file because it is being used by another process. (0x20) 11:12:17 (4100): Can't acquire lockfile (32) - waiting 35s 11:12:52 (4100): Can't acquire lockfile (32) - exiting 11:12:52 (4100): Error: The process cannot access the file because it is being used by another process. (0x20) 11:12:53 (1400): Can't acquire lockfile (32) - waiting 35s 11:13:28 (1400): Can't acquire lockfile (32) - exiting 11:13:28 (1400): Error: The process cannot access the file because it is being used by another process. (0x20) 11:13:28 (5416): Can't acquire lockfile (32) - waiting 35s 11:14:03 (5416): Can't acquire lockfile (32) - exiting 11:14:03 (5416): Error: The process cannot access the file because it is being used by another process. (0x20) 11:14:03 (4828): Can't acquire lockfile (32) - waiting 35s 11:14:38 (4828): Can't acquire lockfile (32) - exiting 11:14:38 (4828): Error: The process cannot access the file because it is being used by another process. (0x20) 11:14:38 (5944): Can't acquire lockfile (32) - waiting 35s 11:15:13 (5944): Can't acquire lockfile (32) - exiting 11:15:13 (5944): Error: The process cannot access the file because it is being used by another process. (0x20) 11:15:14 (5568): Can't acquire lockfile (32) - waiting 35s 11:15:49 (5568): Can't acquire lockfile (32) - exiting 11:15:49 (5568): Error: The process cannot access the file because it is being used by another process. (0x20) 11:15:49 (5756): Can't acquire lockfile (32) - waiting 35s 11:16:24 (5756): Can't acquire lockfile (32) - exiting 11:16:24 (5756): Error: The process cannot access the file because it is being used by another process. (0x20) 11:16:24 (1104): Can't acquire lockfile (32) - waiting 35s 11:16:59 (1104): Can't acquire lockfile (32) - exiting 11:16:59 (1104): Error: The process cannot access the file because it is being used by another process. (0x20) 11:16:59 (4748): Can't acquire lockfile (32) - waiting 35s 11:17:34 (4748): Can't acquire lockfile (32) - exiting 11:17:34 (4748): Error: The process cannot access the file because it is being used by another process. (0x20) 11:17:35 (3244): Can't acquire lockfile (32) - waiting 35s 11:18:10 (3244): Can't acquire lockfile (32) - exiting 11:18:10 (3244): Error: The process cannot access the file because it is being used by another process. (0x20) 11:18:10 (1852): Can't acquire lockfile (32) - waiting 35s 11:18:45 (1852): Can't acquire lockfile (32) - exiting 11:18:45 (1852): Error: The process cannot access the file because it is being used by another process. (0x20) 11:18:45 (5612): Can't acquire lockfile (32) - waiting 35s 11:19:20 (5612): Can't acquire lockfile (32) - exiting 11:19:20 (5612): Error: The process cannot access the file because it is being used by another process. (0x20) 11:19:20 (5756): Can't acquire lockfile (32) - waiting 35s 11:19:55 (5756): Can't acquire lockfile (32) - exiting 11:19:55 (5756): Error: The process cannot access the file because it is being used by another process. (0x20) 11:19:56 (3612): Can't acquire lockfile (32) - waiting 35s 11:20:31 (3612): Can't acquire lockfile (32) - exiting 11:20:31 (3612): Error: The process cannot access the file because it is being used by another process. (0x20) 11:20:31 (4996): Can't acquire lockfile (32) - waiting 35s 11:21:06 (4996): Can't acquire lockfile (32) - exiting 11:21:06 (4996): Error: The process cannot access the file because it is being used by another process. (0x20) 11:21:06 (4940): Can't acquire lockfile (32) - waiting 35s 11:21:41 (4940): Can't acquire lockfile (32) - exiting 11:21:41 (4940): Error: The process cannot access the file because it is being used by another process. (0x20) 11:21:42 (4944): Can't acquire lockfile (32) - waiting 35s 11:22:17 (4944): Can't acquire lockfile (32) - exiting 11:22:17 (4944): Error: The process cannot access the file because it is being used by another process. (0x20) 11:22:18 (3144): Can't acquire lockfile (32) - waiting 35s 11:22:53 (3144): Can't acquire lockfile (32) - exiting 11:22:53 (3144): Error: The process cannot access the file because it is being used by another process. (0x20) 11:22:53 (3212): Can't acquire lockfile (32) - waiting 35s 11:23:28 (3212): Can't acquire lockfile (32) - exiting 11:23:28 (3212): Error: The process cannot access the file because it is being used by another process. (0x20) 11:23:28 (2376): Can't acquire lockfile (32) - waiting 35s 11:24:03 (2376): Can't acquire lockfile (32) - exiting 11:24:03 (2376): Error: The process cannot access the file because it is being used by another process. (0x20) 11:24:03 (5484): Can't acquire lockfile (32) - waiting 35s 11:24:38 (5484): Can't acquire lockfile (32) - exiting 11:24:38 (5484): Error: The process cannot access the file because it is being used by another process. (0x20) 11:24:39 (700): Can't acquire lockfile (32) - waiting 35s 11:25:14 (700): Can't acquire lockfile (32) - exiting 11:25:14 (700): Error: The process cannot access the file because it is being used by another process. (0x20) 11:25:14 (4300): Can't acquire lockfile (32) - waiting 35s 11:25:49 (4300): Can't acquire lockfile (32) - exiting 11:25:49 (4300): Error: The process cannot access the file because it is being used by another process. (0x20) 11:25:49 (5984): Can't acquire lockfile (32) - waiting 35s 11:26:24 (5984): Can't acquire lockfile (32) - exiting 11:26:24 (5984): Error: The process cannot access the file because it is being used by another process. (0x20) 11:26:24 (6044): Can't acquire lockfile (32) - waiting 35s 11:26:59 (6044): Can't acquire lockfile (32) - exiting 11:26:59 (6044): Error: The process cannot access the file because it is being used by another process. (0x20) 11:27:00 (1936): Can't acquire lockfile (32) - waiting 35s 11:27:35 (1936): Can't acquire lockfile (32) - exiting 11:27:35 (1936): Error: The process cannot access the file because it is being used by another process. (0x20) 11:27:35 (2248): Can't acquire lockfile (32) - waiting 35s 11:28:10 (2248): Can't acquire lockfile (32) - exiting 11:28:10 (2248): Error: The process cannot access the file because it is being used by another process. (0x20) 11:28:10 (3852): Can't acquire lockfile (32) - waiting 35s 11:28:45 (3852): Can't acquire lockfile (32) - exiting 11:28:45 (3852): Error: The process cannot access the file because it is being used by another process. (0x20) 11:28:45 (5052): Can't acquire lockfile (32) - waiting 35s 11:29:20 (5052): Can't acquire lockfile (32) - exiting 11:29:20 (5052): Error: The process cannot access the file because it is being used by another process. (0x20) 11:29:21 (3716): Can't acquire lockfile (32) - waiting 35s 11:29:56 (3716): Can't acquire lockfile (32) - exiting 11:29:56 (3716): Error: The process cannot access the file because it is being used by another process. (0x20) 11:29:56 (5664): Can't acquire lockfile (32) - waiting 35s 11:30:31 (5664): Can't acquire lockfile (32) - exiting 11:30:31 (5664): Error: The process cannot access the file because it is being used by another process. (0x20) 11:30:31 (2512): Can't acquire lockfile (32) - waiting 35s 11:31:06 (2512): Can't acquire lockfile (32) - exiting 11:31:06 (2512): Error: The process cannot access the file because it is being used by another process. (0x20) 11:31:06 (648): Can't acquire lockfile (32) - waiting 35s 11:31:41 (648): Can't acquire lockfile (32) - exiting 11:31:41 (648): Error: The process cannot access the file because it is being used by another process. (0x20) 11:31:42 (6064): Can't acquire lockfile (32) - waiting 35s 11:32:17 (6064): Can't acquire lockfile (32) - exiting 11:32:17 (6064): Error: The process cannot access the file because it is being used by another process. (0x20) 11:32:18 (2344): Can't acquire lockfile (32) - waiting 35s 11:32:53 (2344): Can't acquire lockfile (32) - exiting 11:32:53 (2344): Error: The process cannot access the file because it is being used by another process. (0x20) 11:32:53 (5568): Can't acquire lockfile (32) - waiting 35s 11:33:28 (5568): Can't acquire lockfile (32) - exiting 11:33:28 (5568): Error: The process cannot access the file because it is being used by another process. (0x20) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Feb 2011 15:37:24	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	92,257	571,213	6.1915
22 Feb 2011 05:33:43	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	92,256	570,315	6.1819
16 Feb 2011 21:07:01	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	80,736	496,880	6.1544
12 Feb 2011 10:06:57	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	69,216	421,058	6.0832
05 Feb 2011 23:19:43	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	57,697	353,330	6.1239
05 Feb 2011 21:16:09	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	57,696	352,542	6.1103
01 Feb 2011 19:20:33	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	46,176	284,319	6.1573
27 Jan 2011 22:27:01	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	34,656	217,544	6.2772
02 Dec 2010 21:50:25	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	23,136	153,094	6.6171
21 Nov 2010 18:05:13	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	11,621	89,128	7.6696
18 Nov 2010 23:53:09	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	11,618	88,264	7.5972
18 Nov 2010 19:03:41	1111379	11960555	hadam3p_pnw_v3c0_1960_1_006722921_2	11,616	87,542	7.5363