Task 12393035

Name	hadam3p_pnw_zu6m_2005_1_007041638_1
Workunit	7244954
Created	18 Dec 2010, 11:42:36 UTC
Sent	18 Dec 2010, 11:51:43 UTC
Report deadline	30 Nov 2011, 17:11:43 UTC
Received	21 Jan 2011, 19:43:44 UTC
Server state	Over
Outcome	Didn't need
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1110553
Run time	15 hours 4 min 17 sec
CPU time	14 hours 32 min 44 sec
Validate state	Invalid
Credit	252.73
Device peak FLOPS	2.77 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5736, selfPID=5736, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4788, selfPID=4788, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6552, selfPID=6552, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7080, selfPID=7080, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6420, selfPID=6420, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1056, selfPID=1056, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5072, selfPID=5072, iMonCtr=2 21:57:26 (4032): No heartbeat from core client for 30 sec - exiting 21:57:27 (4032): No heartbeat from core client for 30 sec - exiting 21:57:28 (4032): No heartbeat from core client for 30 sec - exiting 21:57:29 (4032): No heartbeat from core client for 30 sec - exiting 21:57:30 (4032): No heartbeat from core client for 30 sec - exiting 21:57:31 (4032): No heartbeat from core client for 30 sec - exiting 21:57:32 (4032): No heartbeat from core client for 30 sec - exiting 21:57:33 (4032): No heartbeat from core client for 30 sec - exiting 21:57:34 (4032): No heartbeat from core client for 30 sec - exiting 21:57:35 (4032): No heartbeat from core client for 30 sec - exiting 21:57:36 (4032): No heartbeat from core client for 30 sec - exiting 21:57:37 (4032): No heartbeat from core client for 30 sec - exiting 21:57:38 (4032): No heartbeat from core client for 30 sec - exiting 21:57:39 (4032): No heartbeat from core client for 30 sec - exiting 21:57:40 (4032): No heartbeat from core client for 30 sec - exiting 21:57:41 (4032): No heartbeat from core client for 30 sec - exiting 21:57:42 (4032): No heartbeat from core client for 30 sec - exiting 21:57:43 (4032): No heartbeat from core client for 30 sec - exiting 21:57:44 (4032): No heartbeat from core client for 30 sec - exiting 21:57:45 (4032): No heartbeat from core client for 30 sec - exiting 21:57:46 (4032): No heartbeat from core client for 30 sec - exiting 21:57:47 (4032): No heartbeat from core client for 30 sec - exiting 21:57:48 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4944, selfPID=3060, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2908, selfPID=2908, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3620, selfPID=3620, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3332, selfPID=3332, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5048, selfPID=5048, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:40:19 (2768): No heartbeat from core client for 30 sec - exiting 20:40:20 (2768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:40:53 (5080): No heartbeat from core client for 30 sec - exiting 13:40:54 (5080): No heartbeat from core client for 30 sec - exiting 13:40:55 (5080): No heartbeat from core client for 30 sec - exiting 13:40:56 (5080): No heartbeat from core client for 30 sec - exiting 13:40:57 (5080): No heartbeat from core client for 30 sec - exiting 13:40:58 (5080): No heartbeat from core client for 30 sec - exiting 13:40:59 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:42:45 (5016): No heartbeat from core client for 30 sec - exiting 17:42:46 (5016): No heartbeat from core client for 30 sec - exiting 17:42:47 (5016): No heartbeat from core client for 30 sec - exiting 17:42:48 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2808, selfPID=2808, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2396, selfPID=2396, iMonCtr=2 11:50:42 (4820): No heartbeat from core client for 30 sec - exiting 11:50:43 (4820): No heartbeat from core client for 30 sec - exiting 11:50:44 (4820): No heartbeat from core client for 30 sec - exiting 11:50:45 (4820): No heartbeat from core client for 30 sec - exiting 11:50:46 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:05:22 (5760): No heartbeat from core client for 30 sec - exiting 16:05:23 (5760): No heartbeat from core client for 30 sec - exiting 16:05:24 (5760): No heartbeat from core client for 30 sec - exiting 16:05:25 (5760): No heartbeat from core client for 30 sec - exiting 16:05:26 (5760): No heartbeat from core client for 30 sec - exiting 16:05:27 (5760): No heartbeat from core client for 30 sec - exiting 16:05:28 (5760): No heartbeat from core client for 30 sec - exiting 16:05:29 (5760): No heartbeat from core client for 30 sec - exiting 16:05:30 (5760): No heartbeat from core client for 30 sec - exiting 16:05:32 (5760): No heartbeat from core client for 30 sec - exiting 16:05:33 (5760): No heartbeat from core client for 30 sec - exiting 16:05:34 (5760): No heartbeat from core client for 30 sec - exiting 16:05:35 (5760): No heartbeat from core client for 30 sec - exiting 16:05:36 (5760): No heartbeat from core client for 30 sec - exiting 16:05:37 (5760): No heartbeat from core client for 30 sec - exiting 16:05:38 (5760): No heartbeat from core client for 30 sec - exiting 16:05:39 (5760): No heartbeat from core client for 30 sec - exiting 16:05:40 (5760): No heartbeat from core client for 30 sec - exiting 16:05:41 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5656, selfPID=5656, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1216, selfPID=1216, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5060, selfPID=5060, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2352, selfPID=2352, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:32:25 (2656): No heartbeat from core client for 30 sec - exiting 16:32:26 (2656): No heartbeat from core client for 30 sec - exiting 16:32:27 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6068, selfPID=6068, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:58:12 (5724): No heartbeat from core client for 30 sec - exiting 15:58:13 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3572, selfPID=3572, iMonCtr=2 23:31:25 (4700): No heartbeat from core client for 30 sec - exiting 23:31:26 (4700): No heartbeat from core client for 30 sec - exiting 23:31:27 (4700): No heartbeat from core client for 30 sec - exiting 23:31:28 (4700): No heartbeat from core client for 30 sec - exiting 23:31:29 (4700): No heartbeat from core client for 30 sec - exiting 23:31:30 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:35 (400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:40:24 (1680): No heartbeat from core client for 30 sec - exiting 01:40:25 (1680): No heartbeat from core client for 30 sec - exiting 01:40:26 (1680): No heartbeat from core client for 30 sec - exiting 01:40:27 (1680): No heartbeat from core client for 30 sec - exiting 01:40:28 (1680): No heartbeat from core client for 30 sec - exiting 01:40:29 (1680): No heartbeat from core client for 30 sec - exiting 01:40:30 (1680): No heartbeat from core client for 30 sec - exiting 01:40:31 (1680): No heartbeat from core client for 30 sec - exiting 01:40:32 (1680): No heartbeat from core client for 30 sec - exiting 01:40:33 (1680): No heartbeat from core client for 30 sec - exiting 01:40:34 (1680): No heartbeat from core client for 30 sec - exiting 01:40:35 (1680): No heartbeat from core client for 30 sec - exiting 01:40:36 (1680): No heartbeat from core client for 30 sec - exiting 01:40:37 (1680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:36:24 (1264): No heartbeat from core client for 30 sec - exiting 21:36:25 (1264): No heartbeat from core client for 30 sec - exiting 21:36:26 (1264): No heartbeat from core client for 30 sec - exiting 21:36:27 (1264): No heartbeat from core client for 30 sec - exiting 21:36:28 (1264): No heartbeat from core client for 30 sec - exiting 21:36:29 (1264): No heartbeat from core client for 30 sec - exiting 21:36:30 (1264): No heartbeat from core client for 30 sec - exiting 21:36:31 (1264): No heartbeat from core client for 30 sec - exiting 21:36:32 (1264): No heartbeat from core client for 30 sec - exiting 21:36:33 (1264): No heartbeat from core client for 30 sec - exiting 21:36:34 (1264): No heartbeat from core client for 30 sec - exiting 21:36:35 (1264): No heartbeat from core client for 30 sec - exiting 21:36:36 (1264): No heartbeat from core client for 30 sec - exiting 21:36:37 (1264): No heartbeat from core client for 30 sec - exiting 21:36:38 (1264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:44:59 (5388): No heartbeat from core client for 30 sec - exiting 11:45:00 (5388): No heartbeat from core client for 30 sec - exiting 11:45:01 (5388): No heartbeat from core client for 30 sec - exiting 11:45:02 (5388): No heartbeat from core client for 30 sec - exiting 11:45:03 (5388): No heartbeat from core client for 30 sec - exiting 11:45:05 (5388): No heartbeat from core client for 30 sec - exiting 11:45:06 (5388): No heartbeat from core client for 30 sec - exiting 11:45:07 (5388): No heartbeat from core client for 30 sec - exiting 11:45:08 (5388): No heartbeat from core client for 30 sec - exiting 11:45:09 (5388): No heartbeat from core client for 30 sec - exiting 11:45:10 (5388): No heartbeat from core client for 30 sec - exiting 11:45:11 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:52:00 (4068): No heartbeat from core client for 30 sec - exiting 13:52:01 (4068): No heartbeat from core client for 30 sec - exiting 13:52:02 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:29 (212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:11:33 (4320): No heartbeat from core client for 30 sec - exiting 15:11:34 (4320): No heartbeat from core client for 30 sec - exiting 15:11:35 (4320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4180, selfPID=4180, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:40:07 (1756): No heartbeat from core client for 30 sec - exiting 20:40:08 (1756): No heartbeat from core client for 30 sec - exiting 20:40:09 (1756): No heartbeat from core client for 30 sec - exiting 20:40:10 (1756): No heartbeat from core client for 30 sec - exiting 20:40:11 (1756): No heartbeat from core client for 30 sec - exiting 20:40:12 (1756): No heartbeat from core client for 30 sec - exiting 20:40:13 (1756): No heartbeat from core client for 30 sec - exiting 20:40:14 (1756): No heartbeat from core client for 30 sec - exiting 20:40:15 (1756): No heartbeat from core client for 30 sec - exiting 20:40:16 (1756): No heartbeat from core client for 30 sec - exiting 20:40:17 (1756): No heartbeat from core client for 30 sec - exiting 20:40:18 (1756): No heartbeat from core client for 30 sec - exiting 20:40:19 (1756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:55:19 (3996): No heartbeat from core client for 30 sec - exiting 23:55:20 (3996): No heartbeat from core client for 30 sec - exiting 23:55:21 (3996): No heartbeat from core client for 30 sec - exiting 23:55:22 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:46:13 (4648): No heartbeat from core client for 30 sec - exiting 16:46:14 (4648): No heartbeat from core client for 30 sec - exiting 16:46:15 (4648): No heartbeat from core client for 30 sec - exiting 16:46:16 (4648): No heartbeat from core client for 30 sec - exiting 16:46:17 (4648): No heartbeat from core client for 30 sec - exiting 16:46:18 (4648): No heartbeat from core client for 30 sec - exiting 16:46:19 (4648): No heartbeat from core client for 30 sec - exiting 16:46:20 (4648): No heartbeat from core client for 30 sec - exiting 16:46:21 (4648): No heartbeat from core client for 30 sec - exiting 16:46:22 (4648): No heartbeat from core client for 30 sec - exiting 16:46:23 (4648): No heartbeat from core client for 30 sec - exiting 16:46:24 (4648): No heartbeat from core client for 30 sec - exiting 16:46:25 (4648): No heartbeat from core client for 30 sec - exiting 16:46:26 (4648): No heartbeat from core client for 30 sec - exiting 16:46:27 (4648): No heartbeat from core client for 30 sec - exiting 16:46:28 (4648): No heartbeat from core client for 30 sec - exiting 16:46:29 (4648): No heartbeat from core client for 30 sec - exiting 16:46:30 (4648): No heartbeat from core client for 30 sec - exiting 16:46:31 (4648): No heartbeat from core client for 30 sec - exiting 16:46:32 (4648): No heartbeat from core client for 30 sec - exiting 16:46:33 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:10:40 (1968): No heartbeat from core client for 30 sec - exiting 19:10:41 (1968): No heartbeat from core client for 30 sec - exiting 19:10:42 (1968): No heartbeat from core client for 30 sec - exiting 19:10:43 (1968): No heartbeat from core client for 30 sec - exiting 19:10:44 (1968): No heartbeat from core client for 30 sec - exiting 19:10:45 (1968): No heartbeat from core client for 30 sec - exiting 19:10:46 (1968): No heartbeat from core client for 30 sec - exiting 19:10:47 (1968): No heartbeat from core client for 30 sec - exiting 19:10:48 (1968): No heartbeat from core client for 30 sec - exiting 19:10:49 (1968): No heartbeat from core client for 30 sec - exiting 19:10:50 (1968): No heartbeat from core client for 30 sec - exiting 19:10:51 (1968): No heartbeat from core client for 30 sec - exiting 19:10:52 (1968): No heartbeat from core client for 30 sec - exiting 19:10:53 (1968): No heartbeat from core client for 30 sec - exiting 19:10:54 (1968): No heartbeat from core client for 30 sec - exiting 19:10:55 (1968): No heartbeat from core client for 30 sec - exiting 19:10:56 (1968): No heartbeat from core client for 30 sec - exiting 19:10:57 (1968): No heartbeat from core client for 30 sec - exiting 19:10:58 (1968): No heartbeat from core client for 30 sec - exiting 19:10:59 (1968): No heartbeat from core client for 30 sec - exiting 19:11:00 (1968): No heartbeat from core client for 30 sec - exiting 19:11:01 (1968): No heartbeat from core client for 30 sec - exiting 19:11:02 (1968): No heartbeat from core client for 30 sec - exiting 19:11:03 (1968): No heartbeat from core client for 30 sec - exiting 19:11:04 (1968): No heartbeat from core client for 30 sec - exiting 19:11:05 (1968): No heartbeat from core client for 30 sec - exiting 19:11:06 (1968): No heartbeat from core client for 30 sec - exiting 19:11:07 (1968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:36:51 (5516): No heartbeat from core client for 30 sec - exiting 17:36:52 (5516): No heartbeat from core client for 30 sec - exiting 17:36:53 (5516): No heartbeat from core client for 30 sec - exiting 17:36:54 (5516): No heartbeat from core client for 30 sec - exiting 17:36:55 (5516): No heartbeat from core client for 30 sec - exiting 17:36:56 (5516): No heartbeat from core client for 30 sec - exiting 17:36:57 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4928, selfPID=4928, iMonCtr=2 16:36:30 (2740): No heartbeat from core client for 30 sec - exiting 16:36:31 (2740): No heartbeat from core client for 30 sec - exiting 16:36:32 (2740): No heartbeat from core client for 30 sec - exiting 16:36:33 (2740): No heartbeat from core client for 30 sec - exiting 16:36:34 (2740): No heartbeat from core client for 30 sec - exiting 16:36:35 (2740): No heartbeat from core client for 30 sec - exiting 16:36:36 (2740): No heartbeat from core client for 30 sec - exiting 16:36:37 (2740): No heartbeat from core client for 30 sec - exiting 16:36:38 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4796, selfPID=4796, iMonCtr=2 16:54:52 (2784): No heartbeat from core client for 30 sec - exiting 16:54:54 (2784): No heartbeat from core client for 30 sec - exiting 16:54:55 (2784): No heartbeat from core client for 30 sec - exiting 16:54:56 (2784): No heartbeat from core client for 30 sec - exiting 16:54:57 (2784): No heartbeat from core client for 30 sec - exiting 16:54:58 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2780, selfPID=2780, iMonCtr=2 19:38:30 (1268): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... 16:00:28 (4412): No heartbeat from core client for 30 sec - exiting 16:00:29 (4412): No heartbeat from core client for 30 sec - exiting 16:00:30 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 20:44:52 (3772): No heartbeat from core client for 30 sec - exiting 20:44:53 (3772): No heartbeat from core client for 30 sec - exiting 20:44:54 (3772): No heartbeat from core client for 30 sec - exiting 20:44:55 (3772): No heartbeat from core client for 30 sec - exiting 20:44:56 (3772): No heartbeat from core client for 30 sec - exiting 20:44:57 (3772): No heartbeat from core client for 30 sec - exiting 20:44:58 (3772): No heartbeat from core client for 30 sec - exiting 20:44:59 (3772): No heartbeat from core client for 30 sec - exiting 20:45:00 (3772): No heartbeat from core client for 30 sec - exiting 20:45:01 (3772): No heartbeat from core client for 30 sec - exiting 20:45:02 (3772): No heartbeat from core client for 30 sec - exiting 20:45:03 (3772): No heartbeat from core client for 30 sec - exiting 20:45:04 (3772): No heartbeat from core client for 30 sec - exiting 20:45:05 (3772): No heartbeat from core client for 30 sec - exiting 20:45:06 (3772): No heartbeat from core client for 30 sec - exiting 20:45:07 (3772): No heartbeat from core client for 30 sec - exiting 20:45:08 (3772): No heartbeat from core client for 30 sec - exiting 20:45:09 (3772): No heartbeat from core client for 30 sec - exiting 20:45:10 (3772): No heartbeat from core client for 30 sec - exiting 20:45:11 (3772): No heartbeat from core client for 30 sec - exiting 20:45:12 (3772): No heartbeat from core client for 30 sec - exiting 20:45:13 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:14 (3772): No heartbeat from core client for 30 sec - exiting 20:45:15 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=744, selfPID=744, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=456, selfPID=456, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:33:10 (4496): No heartbeat from core client for 30 sec - exiting 16:33:12 (4496): No heartbeat from core client for 30 sec - exiting 16:33:13 (4496): No heartbeat from core client for 30 sec - exiting 16:33:14 (4496): No heartbeat from core client for 30 sec - exiting 16:33:15 (4496): No heartbeat from core client for 30 sec - exiting 16:33:16 (4496): No heartbeat from core client for 30 sec - exiting 16:33:17 (4496): No heartbeat from core client for 30 sec - exiting No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... 19:39:38 (1120): called boinc_finish Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4064, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_pnw_zu6m_2005_1_007041638/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_pnw_zu6m_2005_1_007041638/dataout/region_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_pnw_zu6m_2005_1_007041638/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_pnw_zu6m_2005_1_007041638/dataout/region_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 19:42:32 (5112): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zu6m_2005_1_007041638_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jan 2011 18:27:18	1110553	12393035	hadam3p_pnw_zu6m_2005_1_007041638_1	11,631	37,965	3.2641
05 Jan 2011 16:20:13	1110553	12393035	hadam3p_pnw_zu6m_2005_1_007041638_1	11,626	37,523	3.2275
02 Jan 2011 16:35:15	1110553	12393035	hadam3p_pnw_zu6m_2005_1_007041638_1	11,623	37,098	3.1918
02 Jan 2011 16:19:33	1110553	12393035	hadam3p_pnw_zu6m_2005_1_007041638_1	11,617	36,664	3.1561
02 Jan 2011 01:34:25	1110553	12393035	hadam3p_pnw_zu6m_2005_1_007041638_1	11,616	36,244	3.1202