Task 14863727

Name	hadam3p_pnw_bxn2_1998_1_008028828_0
Workunit	8183942
Created	4 Jul 2012, 21:12:41 UTC
Sent	4 Jul 2012, 21:12:55 UTC
Report deadline	17 Jun 2013, 2:32:55 UTC
Received	27 Aug 2012, 5:09:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1175227
Run time	3 days 9 hours 16 min 40 sec
CPU time	2 days 12 hours 55 min 24 sec
Validate state	Invalid
Credit	2,004.61
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6432, selfPID=6432, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:00:26 (5420): No heartbeat from core client for 30 sec - exiting 14:00:27 (5420): No heartbeat from core client for 30 sec - exiting 14:00:28 (5420): No heartbeat from core client for 30 sec - exiting 14:00:29 (5420): No heartbeat from core client for 30 sec - exiting 14:00:30 (5420): No heartbeat from core client for 30 sec - exiting 14:00:31 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7004, selfPID=7004, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6260, selfPID=6260, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:04:02 (8164): No heartbeat from core client for 30 sec - exiting 07:04:03 (8164): No heartbeat from core client for 30 sec - exiting 07:04:04 (8164): No heartbeat from core client for 30 sec - exiting 07:04:05 (8164): No heartbeat from core client for 30 sec - exiting 07:04:06 (8164): No heartbeat from core client for 30 sec - exiting 07:04:07 (8164): No heartbeat from core client for 30 sec - exiting 07:04:08 (8164): No heartbeat from core client for 30 sec - exiting 07:04:09 (8164): No heartbeat from core client for 30 sec - exiting 07:04:10 (8164): No heartbeat from core client for 30 sec - exiting 07:04:11 (8164): No heartbeat from core client for 30 sec - exiting 07:04:12 (8164): No heartbeat from core client for 30 sec - exiting 07:04:13 (8164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5416, selfPID=5416, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1152, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1280, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3544, selfPID=3544, iMonCtr=2 17:16:41 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6864, selfPID=6864, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5476, selfPID=5476, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6180, selfPID=6180, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4220, selfPID=4220, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=48076, selfPID=48076, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:06:48 (4972): No heartbeat from core client for 30 sec - exiting 16:06:49 (4972): No heartbeat from core client for 30 sec - exiting 16:06:50 (4972): No heartbeat from core client for 30 sec - exiting 16:06:51 (4972): No heartbeat from core client for 30 sec - exiting 16:06:52 (4972): No heartbeat from core client for 30 sec - exiting 16:06:53 (4972): No heartbeat from core client for 30 sec - exiting 16:06:54 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:21:30 (5496): No heartbeat from core client for 30 sec - exiting 07:21:32 (5496): No heartbeat from core client for 30 sec - exiting 07:21:33 (5496): No heartbeat from core client for 30 sec - exiting 07:21:34 (5496): No heartbeat from core client for 30 sec - exiting 07:21:35 (5496): No heartbeat from core client for 30 sec - exiting 07:21:36 (5496): No heartbeat from core client for 30 sec - exiting 07:21:37 (5496): No heartbeat from core client for 30 sec - exiting 07:21:38 (5496): No heartbeat from core client for 30 sec - exiting 07:21:39 (5496): No heartbeat from core client for 30 sec - exiting 07:21:40 (5496): No heartbeat from core client for 30 sec - exiting 07:21:41 (5496): No heartbeat from core client for 30 sec - exiting 07:21:42 (5496): No heartbeat from core client for 30 sec - exiting 07:21:43 (5496): No heartbeat from core client for 30 sec - exiting 07:21:44 (5496): No heartbeat from core client for 30 sec - exiting 07:21:45 (5496): No heartbeat from core client for 30 sec - exiting 07:21:46 (5496): No heartbeat from core client for 30 sec - exiting 07:21:47 (5496): No heartbeat from core client for 30 sec - exiting 07:21:48 (5496): No heartbeat from core client for 30 sec - exiting 07:21:49 (5496): No heartbeat from core client for 30 sec - exiting 07:21:50 (5496): No heartbeat from core client for 30 sec - exiting 07:21:51 (5496): No heartbeat from core client for 30 sec - exiting 07:21:52 (5496): No heartbeat from core client for 30 sec - exiting 07:21:53 (5496): No heartbeat from core client for 30 sec - exiting 07:21:54 (5496): No heartbeat from core client for 30 sec - exiting 07:21:55 (5496): No heartbeat from core client for 30 sec - exiting 07:21:56 (5496): No heartbeat from core client for 30 sec - exiting 07:21:57 (5496): No heartbeat from core client for 30 sec - exiting 07:21:58 (5496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:59 (5496): No heartbeat from core client for 30 sec - exiting 19:40:59 (7964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:11:38 (3312): No heartbeat from core client for 30 sec - exiting 07:11:39 (3312): No heartbeat from core client for 30 sec - exiting 07:11:40 (3312): No heartbeat from core client for 30 sec - exiting 07:11:41 (3312): No heartbeat from core client for 30 sec - exiting 07:11:42 (3312): No heartbeat from core client for 30 sec - exiting 07:11:43 (3312): No heartbeat from core client for 30 sec - exiting 07:11:44 (3312): No heartbeat from core client for 30 sec - exiting 07:11:45 (3312): No heartbeat from core client for 30 sec - exiting 07:11:46 (3312): No heartbeat from core client for 30 sec - exiting 07:11:47 (3312): No heartbeat from core client for 30 sec - exiting 07:11:48 (3312): No heartbeat from core client for 30 sec - exiting 07:11:49 (3312): No heartbeat from core client for 30 sec - exiting 07:11:50 (3312): No heartbeat from core client for 30 sec - exiting 07:11:51 (3312): No heartbeat from core client for 30 sec - exiting 07:11:52 (3312): No heartbeat from core client for 30 sec - exiting 07:12:23 (3312): No heartbeat from core client for 30 sec - exiting 07:12:24 (3312): No heartbeat from core client for 30 sec - exiting 07:12:25 (3312): No heartbeat from core client for 30 sec - exiting 07:12:26 (3312): No heartbeat from core client for 30 sec - exiting 07:12:27 (3312): No heartbeat from core client for 30 sec - exiting 07:12:28 (3312): No heartbeat from core client for 30 sec - exiting 07:12:29 (3312): No heartbeat from core client for 30 sec - exiting 07:12:30 (3312): No heartbeat from core client for 30 sec - exiting 07:12:31 (3312): No heartbeat from core client for 30 sec - exiting 07:12:32 (3312): No heartbeat from core client for 30 sec - exiting 07:12:33 (3312): No heartbeat from core client for 30 sec - exiting 07:12:34 (3312): No heartbeat from core client for 30 sec - exiting 07:12:35 (3312): No heartbeat from core client for 30 sec - exiting 07:12:36 (3312): No heartbeat from core client for 30 sec - exiting 07:12:37 (3312): No heartbeat from core client for 30 sec - exiting 07:12:38 (3312): No heartbeat from core client for 30 sec - exiting 07:12:39 (3312): No heartbeat from core client for 30 sec - exiting 07:12:40 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4176, selfPID=4176, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 23:45:02 (2536): No heartbeat from core client for 30 sec - exiting 23:45:03 (2536): No heartbeat from core client for 30 sec - exiting 23:45:04 (2536): No heartbeat from core client for 30 sec - exiting 23:45:05 (2536): No heartbeat from core client for 30 sec - exiting 23:45:06 (2536): No heartbeat from core client for 30 sec - exiting 23:45:07 (2536): No heartbeat from core client for 30 sec - exiting 23:45:08 (2536): No heartbeat from core client for 30 sec - exiting 23:45:09 (2536): No heartbeat from core client for 30 sec - exiting 23:45:10 (2536): No heartbeat from core client for 30 sec - exiting 23:45:11 (2536): No heartbeat from core client for 30 sec - exiting 23:45:12 (2536): No heartbeat from core client for 30 sec - exiting 23:45:13 (2536): No heartbeat from core client for 30 sec - exiting 23:45:14 (2536): No heartbeat from core client for 30 sec - exiting 23:45:15 (2536): No heartbeat from core client for 30 sec - exiting 23:45:16 (2536): No heartbeat from core client for 30 sec - exiting 23:45:17 (2536): No heartbeat from core client for 30 sec - exiting 23:45:18 (2536): No heartbeat from core client for 30 sec - exiting 23:45:19 (2536): No heartbeat from core client for 30 sec - exiting 23:45:50 (2536): No heartbeat from core client for 30 sec - exiting 23:45:51 (2536): No heartbeat from core client for 30 sec - exiting 23:45:52 (2536): No heartbeat from core client for 30 sec - exiting 23:45:53 (2536): No heartbeat from core client for 30 sec - exiting 23:45:54 (2536): No heartbeat from core client for 30 sec - exiting 23:45:55 (2536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:26:48 (4380): No heartbeat from core client for 30 sec - exiting 07:26:49 (4380): No heartbeat from core client for 30 sec - exiting 07:26:50 (4380): No heartbeat from core client for 30 sec - exiting 07:26:51 (4380): No heartbeat from core client for 30 sec - exiting 07:26:52 (4380): No heartbeat from core client for 30 sec - exiting 07:26:53 (4380): No heartbeat from core client for 30 sec - exiting 07:26:54 (4380): No heartbeat from core client for 30 sec - exiting 07:26:55 (4380): No heartbeat from core client for 30 sec - exiting 07:26:56 (4380): No heartbeat from core client for 30 sec - exiting 07:26:57 (4380): No heartbeat from core client for 30 sec - exiting 07:26:58 (4380): No heartbeat from core client for 30 sec - exiting 07:26:59 (4380): No heartbeat from core client for 30 sec - exiting 07:27:00 (4380): No heartbeat from core client for 30 sec - exiting 07:27:01 (4380): No heartbeat from core client for 30 sec - exiting 07:27:02 (4380): No heartbeat from core client for 30 sec - exiting 07:27:03 (4380): No heartbeat from core client for 30 sec - exiting 07:27:04 (4380): No heartbeat from core client for 30 sec - exiting 07:27:05 (4380): No heartbeat from core client for 30 sec - exiting 07:27:06 (4380): No heartbeat from core client for 30 sec - exiting 07:27:07 (4380): No heartbeat from core client for 30 sec - exiting 07:27:08 (4380): No heartbeat from core client for 30 sec - exiting 07:27:09 (4380): No heartbeat from core client for 30 sec - exiting 07:27:10 (4380): No heartbeat from core client for 30 sec - exiting 07:27:11 (4380): No heartbeat from core client for 30 sec - exiting 07:27:12 (4380): No heartbeat from core client for 30 sec - exiting 07:27:13 (4380): No heartbeat from core client for 30 sec - exiting 07:27:14 (4380): No heartbeat from core client for 30 sec - exiting 07:27:15 (4380): No heartbeat from core client for 30 sec - exiting 07:27:16 (4380): No heartbeat from core client for 30 sec - exiting 07:27:17 (4380): No heartbeat from core client for 30 sec - exiting 07:27:18 (4380): No heartbeat from core client for 30 sec - exiting 07:27:19 (4380): No heartbeat from core client for 30 sec - exiting 07:27:20 (4380): No heartbeat from core client for 30 sec - exiting 07:27:21 (4380): No heartbeat from core client for 30 sec - exiting 07:27:22 (4380): No heartbeat from core client for 30 sec - exiting 07:27:23 (4380): No heartbeat from core client for 30 sec - exiting 07:27:24 (4380): No heartbeat from core client for 30 sec - exiting 07:27:25 (4380): No heartbeat from core client for 30 sec - exiting 07:27:26 (4380): No heartbeat from core client for 30 sec - exiting 07:27:27 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5864, selfPID=5864, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:26:39 (5504): No heartbeat from core client for 30 sec - exiting 07:26:40 (5504): No heartbeat from core client for 30 sec - exiting 07:26:41 (5504): No heartbeat from core client for 30 sec - exiting 07:26:42 (5504): No heartbeat from core client for 30 sec - exiting 07:26:43 (5504): No heartbeat from core client for 30 sec - exiting 07:26:44 (5504): No heartbeat from core client for 30 sec - exiting 07:26:45 (5504): No heartbeat from core client for 30 sec - exiting 07:26:46 (5504): No heartbeat from core client for 30 sec - exiting 07:26:47 (5504): No heartbeat from core client for 30 sec - exiting 07:26:48 (5504): No heartbeat from core client for 30 sec - exiting 07:26:49 (5504): No heartbeat from core client for 30 sec - exiting 07:26:50 (5504): No heartbeat from core client for 30 sec - exiting 07:26:51 (5504): No heartbeat from core client for 30 sec - exiting 07:26:52 (5504): No heartbeat from core client for 30 sec - exiting 07:26:53 (5504): No heartbeat from core client for 30 sec - exiting 07:26:54 (5504): No heartbeat from core client for 30 sec - exiting 07:26:55 (5504): No heartbeat from core client for 30 sec - exiting 07:26:56 (5504): No heartbeat from core client for 30 sec - exiting 07:26:57 (5504): No heartbeat from core client for 30 sec - exiting 07:26:58 (5504): No heartbeat from core client for 30 sec - exiting 07:26:59 (5504): No heartbeat from core client for 30 sec - exiting 07:27:00 (5504): No heartbeat from core client for 30 sec - exiting 07:27:01 (5504): No heartbeat from core client for 30 sec - exiting 07:27:02 (5504): No heartbeat from core client for 30 sec - exiting 07:27:03 (5504): No heartbeat from core client for 30 sec - exiting 07:27:04 (5504): No heartbeat from core client for 30 sec - exiting 07:27:05 (5504): No heartbeat from core client for 30 sec - exiting 07:27:06 (5504): No heartbeat from core client for 30 sec - exiting 07:27:07 (5504): No heartbeat from core client for 30 sec - exiting 07:27:08 (5504): No heartbeat from core client for 30 sec - exiting 07:27:09 (5504): No heartbeat from core client for 30 sec - exiting 07:27:10 (5504): No heartbeat from core client for 30 sec - exiting 07:27:11 (5504): No heartbeat from core client for 30 sec - exiting 07:27:12 (5504): No heartbeat from core client for 30 sec - exiting 07:27:13 (5504): No heartbeat from core client for 30 sec - exiting 07:27:14 (5504): No heartbeat from core client for 30 sec - exiting 07:27:15 (5504): No heartbeat from core client for 30 sec - exiting 07:27:16 (5504): No heartbeat from core client for 30 sec - exiting 07:27:17 (5504): No heartbeat from core client for 30 sec - exiting 07:27:18 (5504): No heartbeat from core client for 30 sec - exiting 07:27:19 (5504): No heartbeat from core client for 30 sec - exiting 07:27:20 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5988, selfPID=5988, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:33:55 (2924): No heartbeat from core client for 30 sec - exiting 15:33:56 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3004, selfPID=3004, iMonCtr=2 12:24:43 (6012): No heartbeat from core client for 30 sec - exiting 12:24:44 (6012): No heartbeat from core client for 30 sec - exiting 12:24:45 (6012): No heartbeat from core client for 30 sec - exiting 12:24:46 (6012): No heartbeat from core client for 30 sec - exiting 12:24:47 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=592, selfPID=592, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6684, selfPID=6684, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1072, selfPID=1072, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:30:14 (1236): No heartbeat from core client for 30 sec - exiting 14:30:15 (1236): No heartbeat from core client for 30 sec - exiting 14:30:16 (1236): No heartbeat from core client for 30 sec - exiting 14:30:17 (1236): No heartbeat from core client for 30 sec - exiting 14:30:18 (1236): No heartbeat from core client for 30 sec - exiting 14:30:19 (1236): No heartbeat from core client for 30 sec - exiting 14:30:20 (1236): No heartbeat from core client for 30 sec - exiting 14:30:21 (1236): No heartbeat from core client for 30 sec - exiting 14:30:22 (1236): No heartbeat from core client for 30 sec - exiting 14:30:23 (1236): No heartbeat from core client for 30 sec - exiting 14:30:24 (1236): No heartbeat from core client for 30 sec - exiting 14:30:26 (1236): No heartbeat from core client for 30 sec - exiting 14:30:27 (1236): No heartbeat from core client for 30 sec - exiting 14:30:28 (1236): No heartbeat from core client for 30 sec - exiting 14:30:29 (1236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:49 (4092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6512, selfPID=6512, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6196, selfPID=6196, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7152, selfPID=7152, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:48:14 (4212): No heartbeat from core client for 30 sec - exiting 16:48:16 (4212): No heartbeat from core client for 30 sec - exiting 16:48:17 (4212): No heartbeat from core client for 30 sec - exiting 16:48:18 (4212): No heartbeat from core client for 30 sec - exiting 16:48:19 (4212): No heartbeat from core client for 30 sec - exiting 16:48:20 (4212): No heartbeat from core client for 30 sec - exiting 16:48:55 (4212): No heartbeat from core client for 30 sec - exiting 16:48:56 (4212): No heartbeat from core client for 30 sec - exiting 16:48:57 (4212): No heartbeat from core client for 30 sec - exiting 16:48:58 (4212): No heartbeat from core client for 30 sec - exiting 16:48:59 (4212): No heartbeat from core client for 30 sec - exiting 16:49:00 (4212): No heartbeat from core client for 30 sec - exiting 16:49:01 (4212): No heartbeat from core client for 30 sec - exiting 16:49:02 (4212): No heartbeat from core client for 30 sec - exiting 16:49:03 (4212): No heartbeat from core client for 30 sec - exiting 16:49:04 (4212): No heartbeat from core client for 30 sec - exiting 16:49:05 (4212): No heartbeat from core client for 30 sec - exiting 16:49:07 (4212): No heartbeat from core client for 30 sec - exiting 16:49:08 (4212): No heartbeat from core client for 30 sec - exiting 16:49:09 (4212): No heartbeat from core client for 30 sec - exiting 16:49:10 (4212): No heartbeat from core client for 30 sec - exiting 16:49:11 (4212): No heartbeat from core client for 30 sec - exiting 16:49:12 (4212): No heartbeat from core client for 30 sec - exiting 16:49:13 (4212): No heartbeat from core client for 30 sec - exiting 16:49:14 (4212): No heartbeat from core client for 30 sec - exiting 16:49:15 (4212): No heartbeat from core client for 30 sec - exiting 16:49:16 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3116, selfPID=3116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2884, selfPID=2884, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6472, selfPID=408, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6324, selfPID=6324, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7956, selfPID=7956, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23060, selfPID=23060, iMonCtr=2 06:46:49 (4876): No heartbeat from core client for 30 sec - exiting 06:46:50 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7076, selfPID=7076, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3572, selfPID=3572, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=27404, selfPID=29572, iMonCtr=1 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Aug 2012 06:19:44	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	92,256	212,733	2.3059
19 Aug 2012 21:32:03	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	80,736	186,882	2.3147
16 Aug 2012 10:16:14	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	69,216	160,421	2.3177
14 Aug 2012 06:46:06	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	57,696	133,874	2.3203
04 Aug 2012 11:05:49	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	46,176	107,840	2.3354
27 Jul 2012 06:04:34	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	34,656	81,245	2.3443
19 Jul 2012 22:44:57	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	23,158	54,884	2.3700
19 Jul 2012 21:44:41	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	23,153	54,542	2.3557
19 Jul 2012 21:44:41	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	23,141	54,225	2.3432
18 Jul 2012 22:59:08	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	23,136	53,920	2.3306
07 Jul 2012 16:42:29	1175227	14863727	hadam3p_pnw_bxn2_1998_1_008028828_0	11,616	26,956	2.3206