Task 13666707

Name	hadam3p_eu_wi3j_1991_1_007056585_1
Workunit	7259901
Created	28 Nov 2011, 21:54:04 UTC
Sent	28 Nov 2011, 21:54:35 UTC
Report deadline	10 Nov 2012, 3:14:35 UTC
Received	30 Mar 2012, 6:27:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1175227
Run time	2 days 15 hours 24 min 7 sec
CPU time	2 days 5 hours 22 min 58 sec
Validate state	Invalid
Credit	1,591.48
Device peak FLOPS	2.66 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=29116, selfPID=29116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:18:19 (4860): No heartbeat from core client for 30 sec - exiting 04:18:20 (4860): No heartbeat from core client for 30 sec - exiting 04:18:21 (4860): No heartbeat from core client for 30 sec - exiting 04:18:22 (4860): No heartbeat from core client for 30 sec - exiting 04:18:23 (4860): No heartbeat from core client for 30 sec - exiting 04:18:24 (4860): No heartbeat from core client for 30 sec - exiting 04:18:26 (4860): No heartbeat from core client for 30 sec - exiting 04:18:27 (4860): No heartbeat from core client for 30 sec - exiting 04:18:28 (4860): No heartbeat from core client for 30 sec - exiting 04:18:29 (4860): No heartbeat from core client for 30 sec - exiting 04:18:30 (4860): No heartbeat from core client for 30 sec - exiting 04:18:31 (4860): No heartbeat from core client for 30 sec - exiting 04:18:32 (4860): No heartbeat from core client for 30 sec - exiting 04:18:33 (4860): No heartbeat from core client for 30 sec - exiting 04:18:34 (4860): No heartbeat from core client for 30 sec - exiting 04:18:35 (4860): No heartbeat from core client for 30 sec - exiting 04:18:36 (4860): No heartbeat from core client for 30 sec - exiting 04:18:38 (4860): No heartbeat from core client for 30 sec - exiting 04:18:39 (4860): No heartbeat from core client for 30 sec - exiting 04:18:40 (4860): No heartbeat from core client for 30 sec - exiting 04:18:41 (4860): No heartbeat from core client for 30 sec - exiting 04:18:42 (4860): No heartbeat from core client for 30 sec - exiting 04:18:43 (4860): No heartbeat from core client for 30 sec - exiting 04:18:44 (4860): No heartbeat from core client for 30 sec - exiting 04:18:45 (4860): No heartbeat from core client for 30 sec - exiting 04:18:46 (4860): No heartbeat from core client for 30 sec - exiting 04:18:47 (4860): No heartbeat from core client for 30 sec - exiting 04:18:48 (4860): No heartbeat from core client for 30 sec - exiting 04:18:50 (4860): No heartbeat from core client for 30 sec - exiting 04:18:51 (4860): No heartbeat from core client for 30 sec - exiting 04:18:52 (4860): No heartbeat from core client for 30 sec - exiting 04:18:53 (4860): No heartbeat from core client for 30 sec - exiting 04:18:54 (4860): No heartbeat from core client for 30 sec - exiting 04:18:55 (4860): No heartbeat from core client for 30 sec - exiting 04:18:56 (4860): No heartbeat from core client for 30 sec - exiting 04:18:57 (4860): No heartbeat from core client for 30 sec - exiting 04:18:58 (4860): No heartbeat from core client for 30 sec - exiting 04:18:59 (4860): No heartbeat from core client for 30 sec - exiting 04:19:00 (4860): No heartbeat from core client for 30 sec - exiting 04:19:02 (4860): No heartbeat from core client for 30 sec - exiting 04:19:03 (4860): No heartbeat from core client for 30 sec - exiting 04:19:04 (4860): No heartbeat from core client for 30 sec - exiting 04:19:05 (4860): No heartbeat from core client for 30 sec - exiting 04:19:06 (4860): No heartbeat from core client for 30 sec - exiting 04:19:07 (4860): No heartbeat from core client for 30 sec - exiting 04:19:08 (4860): No heartbeat from core client for 30 sec - exiting 04:19:09 (4860): No heartbeat from core client for 30 sec - exiting 04:19:10 (4860): No heartbeat from core client for 30 sec - exiting 04:19:11 (4860): No heartbeat from core client for 30 sec - exiting 04:19:12 (4860): No heartbeat from core client for 30 sec - exiting 04:19:14 (4860): No heartbeat from core client for 30 sec - exiting 04:19:15 (4860): No heartbeat from core client for 30 sec - exiting 04:19:16 (4860): No heartbeat from core client for 30 sec - exiting 04:19:17 (4860): No heartbeat from core client for 30 sec - exiting 04:19:18 (4860): No heartbeat from core client for 30 sec - exiting 04:19:19 (4860): No heartbeat from core client for 30 sec - exiting 04:19:20 (4860): No heartbeat from core client for 30 sec - exiting 04:19:21 (4860): No heartbeat from core client for 30 sec - exiting 04:19:22 (4860): No heartbeat from core client for 30 sec - exiting 04:19:23 (4860): No heartbeat from core client for 30 sec - exiting 04:19:24 (4860): No heartbeat from core client for 30 sec - exiting 04:19:26 (4860): No heartbeat from core client for 30 sec - exiting 04:19:27 (4860): No heartbeat from core client for 30 sec - exiting 04:19:28 (4860): No heartbeat from core client for 30 sec - exiting 04:19:29 (4860): No heartbeat from core client for 30 sec - exiting 04:19:30 (4860): No heartbeat from core client for 30 sec - exiting 04:19:31 (4860): No heartbeat from core client for 30 sec - exiting 04:19:32 (4860): No heartbeat from core client for 30 sec - exiting 04:19:33 (4860): No heartbeat from core client for 30 sec - exiting 04:19:34 (4860): No heartbeat from core client for 30 sec - exiting 04:19:35 (4860): No heartbeat from core client for 30 sec - exiting 04:19:36 (4860): No heartbeat from core client for 30 sec - exiting 04:19:38 (4860): No heartbeat from core client for 30 sec - exiting 04:19:39 (4860): No heartbeat from core client for 30 sec - exiting 04:19:40 (4860): No heartbeat from core client for 30 sec - exiting 04:19:41 (4860): No heartbeat from core client for 30 sec - exiting 04:19:42 (4860): No heartbeat from core client for 30 sec - exiting 04:19:43 (4860): No heartbeat from core client for 30 sec - exiting 04:19:44 (4860): No heartbeat from core client for 30 sec - exiting 04:19:45 (4860): No heartbeat from core client for 30 sec - exiting 04:19:46 (4860): No heartbeat from core client for 30 sec - exiting 04:19:47 (4860): No heartbeat from core client for 30 sec - exiting 04:19:49 (4860): No heartbeat from core client for 30 sec - exiting 04:19:50 (4860): No heartbeat from core client for 30 sec - exiting 04:19:51 (4860): No heartbeat from core client for 30 sec - exiting 04:19:52 (4860): No heartbeat from core client for 30 sec - exiting 04:19:53 (4860): No heartbeat from core client for 30 sec - exiting 04:19:54 (4860): No heartbeat from core client for 30 sec - exiting 04:19:55 (4860): No heartbeat from core client for 30 sec - exiting 04:19:56 (4860): No heartbeat from core client for 30 sec - exiting 04:19:57 (4860): No heartbeat from core client for 30 sec - exiting 04:19:58 (4860): No heartbeat from core client for 30 sec - exiting 04:19:59 (4860): No heartbeat from core client for 30 sec - exiting 04:20:01 (4860): No heartbeat from core client for 30 sec - exiting 04:20:02 (4860): No heartbeat from core client for 30 sec - exiting 04:20:03 (4860): No heartbeat from core client for 30 sec - exiting 04:20:04 (4860): No heartbeat from core client for 30 sec - exiting 04:20:05 (4860): No heartbeat from core client for 30 sec - exiting 04:20:06 (4860): No heartbeat from core client for 30 sec - exiting 04:20:07 (4860): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=5268, iMonCtr=1 CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=29744, selfPID=29744, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19804, selfPID=19804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=32072, selfPID=32072, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:17:22 (4848): No heartbeat from core client for 30 sec - exiting 07:17:23 (4848): No heartbeat from core client for 30 sec - exiting 07:17:24 (4848): No heartbeat from core client for 30 sec - exiting 07:17:25 (4848): No heartbeat from core client for 30 sec - exiting 07:17:26 (4848): No heartbeat from core client for 30 sec - exiting 07:17:27 (4848): No heartbeat from core client for 30 sec - exiting 07:17:28 (4848): No heartbeat from core client for 30 sec - exiting 07:17:30 (4848): No heartbeat from core client for 30 sec - exiting 07:17:31 (4848): No heartbeat from core client for 30 sec - exiting 07:17:32 (4848): No heartbeat from core client for 30 sec - exiting 07:17:33 (4848): No heartbeat from core client for 30 sec - exiting 07:17:34 (4848): No heartbeat from core client for 30 sec - exiting 07:17:35 (4848): No heartbeat from core client for 30 sec - exiting 07:17:36 (4848): No heartbeat from core client for 30 sec - exiting 07:17:37 (4848): No heartbeat from core client for 30 sec - exiting 07:17:38 (4848): No heartbeat from core client for 30 sec - exiting 07:17:39 (4848): No heartbeat from core client for 30 sec - exiting 07:17:40 (4848): No heartbeat from core client for 30 sec - exiting 07:17:42 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:19:51 (2116): No heartbeat from core client for 30 sec - exiting 07:19:52 (2116): No heartbeat from core client for 30 sec - exiting 07:19:53 (2116): No heartbeat from core client for 30 sec - exiting 07:19:54 (2116): No heartbeat from core client for 30 sec - exiting 07:19:55 (2116): No heartbeat from core client for 30 sec - exiting 07:19:56 (2116): No heartbeat from core client for 30 sec - exiting 07:19:57 (2116): No heartbeat from core client for 30 sec - exiting 07:19:58 (2116): No heartbeat from core client for 30 sec - exiting 07:19:59 (2116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=420, selfPID=420, iMonCtr=2 07:03:38 (4564): No heartbeat from core client for 30 sec - exiting 07:03:40 (4564): No heartbeat from core client for 30 sec - exiting 07:03:41 (4564): No heartbeat from core client for 30 sec - exiting 07:03:42 (4564): No heartbeat from core client for 30 sec - exiting 07:03:43 (4564): No heartbeat from core client for 30 sec - exiting 07:03:44 (4564): No heartbeat from core client for 30 sec - exiting 07:03:45 (4564): No heartbeat from core client for 30 sec - exiting 07:03:46 (4564): No heartbeat from core client for 30 sec - exiting 07:03:47 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:09:59 (4876): No heartbeat from core client for 30 sec - exiting 15:10:01 (4876): No heartbeat from core client for 30 sec - exiting 15:10:02 (4876): No heartbeat from core client for 30 sec - exiting 15:10:03 (4876): No heartbeat from core client for 30 sec - exiting 15:10:04 (4876): No heartbeat from core client for 30 sec - exiting 15:10:05 (4876): No heartbeat from core client for 30 sec - exiting 15:10:06 (4876): No heartbeat from core client for 30 sec - exiting 15:10:07 (4876): No heartbeat from core client for 30 sec - exiting 15:10:08 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20716, selfPID=10052, iMonCtr=1 Model crash detected, will try to restart... 07:12:26 (5792): No heartbeat from core client for 30 sec - exiting 07:12:27 (5792): No heartbeat from core client for 30 sec - exiting 07:12:28 (5792): No heartbeat from core client for 30 sec - exiting 07:12:29 (5792): No heartbeat from core client for 30 sec - exiting 07:12:30 (5792): No heartbeat from core client for 30 sec - exiting 07:12:31 (5792): No heartbeat from core client for 30 sec - exiting 07:12:32 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4640, selfPID=4640, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:00:32 (3108): No heartbeat from core client for 30 sec - exiting 21:00:34 (3108): No heartbeat from core client for 30 sec - exiting 21:00:35 (3108): No heartbeat from core client for 30 sec - exiting 21:00:36 (3108): No heartbeat from core client for 30 sec - exiting 21:00:37 (3108): No heartbeat from core client for 30 sec - exiting 21:00:38 (3108): No heartbeat from core client for 30 sec - exiting 21:01:10 (3108): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4448, iMonCtr=1 21:01:11 (3108): No heartbeat from core client for 30 sec - exiting 21:01:12 (3108): No heartbeat from core client for 30 sec - exiting 21:01:13 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:12 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:18:32 (2856): No heartbeat from core client for 30 sec - exiting 07:18:33 (2856): No heartbeat from core client for 30 sec - exiting 07:18:34 (2856): No heartbeat from core client for 30 sec - exiting 07:18:35 (2856): No heartbeat from core client for 30 sec - exiting 07:18:36 (2856): No heartbeat from core client for 30 sec - exiting 07:18:38 (2856): No heartbeat from core client for 30 sec - exiting 07:18:39 (2856): No heartbeat from core client for 30 sec - exiting 07:18:40 (2856): No heartbeat from core client for 30 sec - exiting 07:18:41 (2856): No heartbeat from core client for 30 sec - exiting 07:18:42 (2856): No heartbeat from core client for 30 sec - exiting 07:18:43 (2856): No heartbeat from core client for 30 sec - exiting 07:18:44 (2856): No heartbeat from core client for 30 sec - exiting 07:18:45 (2856): No heartbeat from core client for 30 sec - exiting 07:18:46 (2856): No heartbeat from core client for 30 sec - exiting 07:18:47 (2856): No heartbeat from core client for 30 sec - exiting 07:18:48 (2856): No heartbeat from core client for 30 sec - exiting 07:18:50 (2856): No heartbeat from core client for 30 sec - exiting 07:18:52 (2856): No heartbeat from core client for 30 sec - exiting 07:18:53 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5380, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8648, selfPID=8648, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8648, selfPID=9032, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6772, selfPID=6772, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:52:39 (5748): No heartbeat from core client for 30 sec - exiting 15:52:40 (5748): No heartbeat from core client for 30 sec - exiting 15:52:41 (5748): No heartbeat from core client for 30 sec - exiting 15:52:42 (5748): No heartbeat from core client for 30 sec - exiting 15:52:43 (5748): No heartbeat from core client for 30 sec - exiting 15:52:44 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5900, selfPID=5900, iMonCtr=2 12:24:04 (4620): No heartbeat from core client for 30 sec - exiting 12:24:05 (4620): No heartbeat from core client for 30 sec - exiting 12:24:06 (4620): No heartbeat from core client for 30 sec - exiting 12:24:07 (4620): No heartbeat from core client for 30 sec - exiting 12:24:08 (4620): No heartbeat from core client for 30 sec - exiting 12:24:09 (4620): No heartbeat from core client for 30 sec - exiting 12:24:10 (4620): No heartbeat from core client for 30 sec - exiting 12:24:11 (4620): No heartbeat from core client for 30 sec - exiting 12:24:12 (4620): No heartbeat from core client for 30 sec - exiting 12:24:13 (4620): No heartbeat from core client for 30 sec - exiting 12:24:14 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5536, selfPID=5536, iMonCtr=2 06:23:13 (4840): No heartbeat from core client for 30 sec - exiting 06:23:14 (4840): No heartbeat from core client for 30 sec - exiting 06:23:15 (4840): No heartbeat from core client for 30 sec - exiting 06:23:16 (4840): No heartbeat from core client for 30 sec - exiting 06:23:17 (4840): No heartbeat from core client for 30 sec - exiting 06:23:18 (4840): No heartbeat from core client for 30 sec - exiting 06:23:19 (4840): No heartbeat from core client for 30 sec - exiting 06:23:20 (4840): No heartbeat from core client for 30 sec - exiting 06:23:21 (4840): No heartbeat from core client for 30 sec - exiting 06:23:23 (4840): No heartbeat from core client for 30 sec - exiting 06:23:24 (4840): No heartbeat from core client for 30 sec - exiting 06:23:25 (4840): No heartbeat from core client for 30 sec - exiting 06:23:26 (4840): No heartbeat from core client for 30 sec - exiting 06:23:27 (4840): No heartbeat from core client for 30 sec - exiting 06:23:28 (4840): No heartbeat from core client for 30 sec - exiting 06:23:29 (4840): No heartbeat from core client for 30 sec - exiting 06:23:30 (4840): No heartbeat from core client for 30 sec - exiting 06:23:31 (4840): No heartbeat from core client for 30 sec - exiting 06:23:32 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:21:30 (5480): No heartbeat from core client for 30 sec - exiting 07:21:31 (5480): No heartbeat from core client for 30 sec - exiting 07:21:32 (5480): No heartbeat from core client for 30 sec - exiting 07:21:33 (5480): No heartbeat from core client for 30 sec - exiting 07:21:34 (5480): No heartbeat from core client for 30 sec - exiting 07:21:35 (5480): No heartbeat from core client for 30 sec - exiting 07:21:36 (5480): No heartbeat from core client for 30 sec - exiting 07:21:37 (5480): No heartbeat from core client for 30 sec - exiting 07:21:38 (5480): No heartbeat from core client for 30 sec - exiting 07:21:39 (5480): No heartbeat from core client for 30 sec - exiting 07:21:41 (5480): No heartbeat from core client for 30 sec - exiting 07:21:42 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=924, selfPID=924, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:09:27 (5336): No heartbeat from core client for 30 sec - exiting 15:09:28 (5336): No heartbeat from core client for 30 sec - exiting 15:09:29 (5336): No heartbeat from core client for 30 sec - exiting 15:09:30 (5336): No heartbeat from core client for 30 sec - exiting 15:09:32 (5336): No heartbeat from core client for 30 sec - exiting 15:09:33 (5336): No heartbeat from core client for 30 sec - exiting 15:09:34 (5336): No heartbeat from core client for 30 sec - exiting 15:09:35 (5336): No heartbeat from core client for 30 sec - exiting 15:09:36 (5336): No heartbeat from core client for 30 sec - exiting 15:09:37 (5336): No heartbeat from core client for 30 sec - exiting 15:09:38 (5336): No heartbeat from core client for 30 sec - exiting 15:09:39 (5336): No heartbeat from core client for 30 sec - exiting 15:09:40 (5336): No heartbeat from core client for 30 sec - exiting 15:09:41 (5336): No heartbeat from core client for 30 sec - exiting 15:09:42 (5336): No heartbeat from core client for 30 sec - exiting 15:09:44 (5336): No heartbeat from core client for 30 sec - exiting 15:09:45 (5336): No heartbeat from core client for 30 sec - exiting 15:09:46 (5336): No heartbeat from core client for 30 sec - exiting 15:09:47 (5336): No heartbeat from core client for 30 sec - exiting 15:09:48 (5336): No heartbeat from core client for 30 sec - exiting 15:09:49 (5336): No heartbeat from core client for 30 sec - exiting 15:09:50 (5336): No heartbeat from core client for 30 sec - exiting 15:09:51 (5336): No heartbeat from core client for 30 sec - exiting 15:09:52 (5336): No heartbeat from core client for 30 sec - exiting 15:09:53 (5336): No heartbeat from core client for 30 sec - exiting 15:09:54 (5336): No heartbeat from core client for 30 sec - exiting 15:09:56 (5336): No heartbeat from core client for 30 sec - exiting 15:09:57 (5336): No heartbeat from core client for 30 sec - exiting 15:09:58 (5336): No heartbeat from core client for 30 sec - exiting 15:09:59 (5336): No heartbeat from core client for 30 sec - exiting 15:10:00 (5336): No heartbeat from core client for 30 sec - exiting 15:10:01 (5336): No heartbeat from core client for 30 sec - exiting 15:10:02 (5336): No heartbeat from core client for 30 sec - exiting 15:10:03 (5336): No heartbeat from core client for 30 sec - exiting 15:10:04 (5336): No heartbeat from core client for 30 sec - exiting 15:10:05 (5336): No heartbeat from core client for 30 sec - exiting 15:10:06 (5336): No heartbeat from core client for 30 sec - exiting 15:10:08 (5336): No heartbeat from core client for 30 sec - exiting 15:10:09 (5336): No heartbeat from core client for 30 sec - exiting 15:10:10 (5336): No heartbeat from core client for 30 sec - exiting 15:10:11 (5336): No heartbeat from core client for 30 sec - exiting 15:10:12 (5336): No heartbeat from core client for 30 sec - exiting 15:10:13 (5336): No heartbeat from core client for 30 sec - exiting 15:10:14 (5336): No heartbeat from core client for 30 sec - exiting 15:10:15 (5336): No heartbeat from core client for 30 sec - exiting 15:10:16 (5336): No heartbeat from core client for 30 sec - exiting 15:10:17 (5336): No heartbeat from core client for 30 sec - exiting 15:10:19 (5336): No heartbeat from core client for 30 sec - exiting 15:10:20 (5336): No heartbeat from core client for 30 sec - exiting 15:10:21 (5336): No heartbeat from core client for 30 sec - exiting 15:10:22 (5336): No heartbeat from core client for 30 sec - exiting 15:10:23 (5336): No heartbeat from core client for 30 sec - exiting 15:10:24 (5336): No heartbeat from core client for 30 sec - exiting 15:10:25 (5336): No heartbeat from core client for 30 sec - exiting 15:10:26 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5520, selfPID=5520, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5732, selfPID=5732, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5280, selfPID=5280, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5800, selfPID=5800, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6644, selfPID=6644, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=3432, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3276, selfPID=3188, iMonCtr=1 Model crash detected, will try to restart... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3276, selfPID=3276, iMonCtr=2 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_wi3j_1991_1_007056585_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wi3j_1991_1_007056585_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wi3j_1991_1_007056585_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wi3j_1991_1_007056585_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Mar 2012 08:10:30	1175227	13666707	hadam3p_eu_wi3j_1991_1_007056585_1	92,256	187,226	2.0294
14 Mar 2012 22:29:30	1175227	13666707	hadam3p_eu_wi3j_1991_1_007056585_1	80,736	164,564	2.0383
29 Feb 2012 16:21:58	1175227	13666707	hadam3p_eu_wi3j_1991_1_007056585_1	69,216	141,601	2.0458
03 Jan 2012 01:39:32	1175227	13666707	hadam3p_eu_wi3j_1991_1_007056585_1	57,696	118,127	2.0474
14 Dec 2011 13:44:17	1175227	13666707	hadam3p_eu_wi3j_1991_1_007056585_1	46,176	94,861	2.0543
14 Dec 2011 01:45:49	1175227	13666707	hadam3p_eu_wi3j_1991_1_007056585_1	34,656	71,369	2.0594
10 Dec 2011 12:06:48	1175227	13666707	hadam3p_eu_wi3j_1991_1_007056585_1	23,136	47,800	2.0660
09 Dec 2011 02:21:07	1175227	13666707	hadam3p_eu_wi3j_1991_1_007056585_1	11,619	24,210	2.0837
08 Dec 2011 09:38:28	1175227	13666707	hadam3p_eu_wi3j_1991_1_007056585_1	11,616	23,902	2.0577