Task 16419005

Name	hadam3p_anz_naup_2012_1_008601681_0
Workunit	8748193
Created	26 Mar 2014, 19:26:09 UTC
Sent	27 Mar 2014, 3:07:09 UTC
Report deadline	9 Mar 2015, 8:27:09 UTC
Received	14 Apr 2014, 9:47:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1302497
Run time	8 days 21 hours 39 min 18 sec
CPU time	8 days 5 hours 33 min 16 sec
Validate state	Invalid
Credit	2,989.68
Device peak FLOPS	1.71 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.28</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13988, selfPID=13988, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18504, selfPID=17676, iMonCtr=1 Model crash detected, will try to restart... 08:39:36 (6220): No heartbeat from core client for 30 sec - exiting 08:39:37 (6220): No heartbeat from core client for 30 sec - exiting 08:39:38 (6220): No heartbeat from core client for 30 sec - exiting 08:39:39 (6220): No heartbeat from core client for 30 sec - exiting 08:39:40 (6220): No heartbeat from core client for 30 sec - exiting 08:39:41 (6220): No heartbeat from core client for 30 sec - exiting 08:39:42 (6220): No heartbeat from core client for 30 sec - exiting 08:39:43 (6220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13156, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13048, selfPID=2452, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:00:14 (11776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18864, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not runningLeaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14096, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8484, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6648, selfPID=13376, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6920, selfPID=2008, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17124, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5652, selfPID=12880, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 09:14:31 (6792): No heartbeat from core client for 30 sec - exiting 09:14:33 (6792): No heartbeat from core client for 30 sec - exiting 09:14:34 (6792): No heartbeat from core client for 30 sec - exiting 09:14:35 (6792): No heartbeat from core client for 30 sec - exiting 09:14:36 (6792): No heartbeat from core client for 30 sec - exiting 09:14:37 (6792): No heartbeat from core client for 30 sec - exiting 09:14:38 (6792): No heartbeat from core client for 30 sec - exiting 09:14:39 (6792): No heartbeat from core client for 30 sec - exiting 09:14:40 (6792): No heartbeat from core client for 30 sec - exiting 09:14:41 (6792): No heartbeat from core client for 30 sec - exiting 09:14:42 (6792): No heartbeat from core client for 30 sec - exiting 09:14:43 (6792): No heartbeat from core client for 30 sec - exiting 09:14:44 (6792): No heartbeat from core client for 30 sec - exiting 09:14:45 (6792): No heartbeat from core client for 30 sec - exiting 09:14:46 (6792): No heartbeat from core client for 30 sec - exiting 09:14:47 (6792): No heartbeat from core client for 30 sec - exiting 09:14:48 (6792): No heartbeat from core client for 30 sec - exiting 09:14:49 (6792): No heartbeat from core client for 30 sec - exiting 09:14:50 (6792): No heartbeat from core client for 30 sec - exiting 09:14:51 (6792): No heartbeat from core client for 30 sec - exiting 09:14:52 (6792): No heartbeat from core client for 30 sec - exiting 09:14:53 (6792): No heartbeat from core client for 30 sec - exiting 09:14:54 (6792): No heartbeat from core client for 30 sec - exiting 09:14:55 (6792): No heartbeat from core client for 30 sec - exiting 09:14:56 (6792): No heartbeat from core client for 30 sec - exiting 09:14:57 (6792): No heartbeat from core client for 30 sec - exiting 09:14:58 (6792): No heartbeat from core client for 30 sec - exiting 09:14:59 (6792): No heartbeat from core client for 30 sec - exiting 09:15:00 (6792): No heartbeat from core client for 30 sec - exiting 09:15:01 (6792): No heartbeat from core client for 30 sec - exiting 09:15:02 (6792): No heartbeat from core client for 30 sec - exiting 09:15:03 (6792): No heartbeat from core client for 30 sec - exiting 09:15:04 (6792): No heartbeat from core client for 30 sec - exiting 09:15:05 (6792): No heartbeat from core client for 30 sec - exiting 09:15:06 (6792): No heartbeat from core client for 30 sec - exiting 09:15:07 (6792): No heartbeat from core client for 30 sec - exiting 09:15:08 (6792): No heartbeat from core client for 30 sec - exiting 09:15:09 (6792): No heartbeat from core client for 30 sec - exiting 09:15:10 (6792): No heartbeat from core client for 30 sec - exiting 09:15:11 (6792): No heartbeat from core client for 30 sec - exiting 09:15:12 (6792): No heartbeat from core client for 30 sec - exiting 09:15:13 (6792): No heartbeat from core client for 30 sec - exiting 09:15:14 (6792): No heartbeat from core client for 30 sec - exiting 09:15:15 (6792): No heartbeat from core client for 30 sec - exiting 09:15:16 (6792): No heartbeat from core client for 30 sec - exiting 09:15:17 (6792): No heartbeat from core client for 30 sec - exiting 09:15:18 (6792): No heartbeat from core client for 30 sec - exiting 09:15:19 (6792): No heartbeat from core client for 30 sec - exiting 09:15:20 (6792): No heartbeat from core client for 30 sec - exiting 09:15:21 (6792): No heartbeat from core client for 30 sec - exiting 09:15:22 (6792): No heartbeat from core client for 30 sec - exiting 09:15:23 (6792): No heartbeat from core client for 30 sec - exiting 09:15:24 (6792): No heartbeat from core client for 30 sec - exiting 09:15:25 (6792): No heartbeat from core client for 30 sec - exiting 09:15:26 (6792): No heartbeat from core client for 30 sec - exiting 09:15:27 (6792): No heartbeat from core client for 30 sec - exiting 09:15:28 (6792): No heartbeat from core client for 30 sec - exiting 09:15:29 (6792): No heartbeat from core client for 30 sec - exiting 09:15:30 (6792): No heartbeat from core client for 30 sec - exiting 09:15:31 (6792): No heartbeat from core client for 30 sec - exiting 09:15:32 (6792): No heartbeat from core client for 30 sec - exiting 09:15:33 (6792): No heartbeat from core client for 30 sec - exiting 09:15:34 (6792): No heartbeat from core client for 30 sec - exiting 09:15:35 (6792): No heartbeat from core client for 30 sec - exiting 09:15:36 (6792): No heartbeat from core client for 30 sec - exiting 09:15:37 (6792): No heartbeat from core client for 30 sec - exiting 09:15:38 (6792): No heartbeat from core client for 30 sec - exiting 09:15:39 (6792): No heartbeat from core client for 30 sec - exiting 09:15:40 (6792): No heartbeat from core client for 30 sec - exiting 09:15:41 (6792): No heartbeat from core client for 30 sec - exiting 09:15:42 (6792): No heartbeat from core client for 30 sec - exiting 09:15:43 (6792): No heartbeat from core client for 30 sec - exiting 09:15:44 (6792): No heartbeat from core client for 30 sec - exiting 09:15:45 (6792): No heartbeat from core client for 30 sec - exiting 09:15:46 (6792): No heartbeat from core client for 30 sec - exiting 09:15:47 (6792): No heartbeat from core client for 30 sec - exiting 09:15:48 (6792): No heartbeat from core client for 30 sec - exiting 09:15:49 (6792): No heartbeat from core client for 30 sec - exiting 09:15:50 (6792): No heartbeat from core client for 30 sec - exiting 09:15:51 (6792): No heartbeat from core client for 30 sec - exiting 09:15:52 (6792): No heartbeat from core client for 30 sec - exiting 09:15:53 (6792): No heartbeat from core client for 30 sec - exiting 09:15:54 (6792): No heartbeat from core client for 30 sec - exiting 09:15:55 (6792): No heartbeat from core client for 30 sec - exiting 09:15:56 (6792): No heartbeat from core client for 30 sec - exiting 09:15:57 (6792): No heartbeat from core client for 30 sec - exiting 09:15:58 (6792): No heartbeat from core client for 30 sec - exiting 09:15:59 (6792): No heartbeat from core client for 30 sec - exiting 09:16:00 (6792): No heartbeat from core client for 30 sec - exiting 09:16:01 (6792): No heartbeat from core client for 30 sec - exiting 09:16:02 (6792): No heartbeat from core client for 30 sec - exiting 09:16:03 (6792): No heartbeat from core client for 30 sec - exiting 09:16:04 (6792): No heartbeat from core client for 30 sec - exiting 09:16:05 (6792): No heartbeat from core client for 30 sec - exiting 09:16:06 (6792): No heartbeat from core client for 30 sec - exiting 09:16:07 (6792): No heartbeat from core client for 30 sec - exiting 09:16:08 (6792): No heartbeat from core client for 30 sec - exiting 09:16:09 (6792): No heartbeat from core client for 30 sec - exiting 09:16:10 (6792): No heartbeat from core client for 30 sec - exiting 09:16:11 (6792): No heartbeat from core client for 30 sec - exiting 09:16:12 (6792): No heartbeat from core client for 30 sec - exiting 09:16:13 (6792): No heartbeat from core client for 30 sec - exiting 09:16:14 (6792): No heartbeat from core client for 30 sec - exiting 09:16:15 (6792): No heartbeat from core client for 30 sec - exiting 09:16:16 (6792): No heartbeat from core client for 30 sec - exiting 09:16:17 (6792): No heartbeat from core client for 30 sec - exiting 09:16:18 (6792): No heartbeat from core client for 30 sec - exiting 09:16:19 (6792): No heartbeat from core client for 30 sec - exiting 09:16:20 (6792): No heartbeat from core client for 30 sec - exiting 09:16:21 (6792): No heartbeat from core client for 30 sec - exiting 09:16:22 (6792): No heartbeat from core client for 30 sec - exiting 09:16:23 (6792): No heartbeat from core client for 30 sec - exiting 09:16:24 (6792): No heartbeat from core client for 30 sec - exiting 09:16:25 (6792): No heartbeat from core client for 30 sec - exiting 09:16:26 (6792): No heartbeat from core client for 30 sec - exiting 09:16:27 (6792): No heartbeat from core client for 30 sec - exiting 09:16:28 (6792): No heartbeat from core client for 30 sec - exiting 09:16:29 (6792): No heartbeat from core client for 30 sec - exiting 09:16:30 (6792): No heartbeat from core client for 30 sec - exiting 09:16:31 (6792): No heartbeat from core client for 30 sec - exiting 09:16:32 (6792): No heartbeat from core client for 30 sec - exiting 09:16:33 (6792): No heartbeat from core client for 30 sec - exiting 09:16:34 (6792): No heartbeat from core client for 30 sec - exiting 09:16:35 (6792): No heartbeat from core client for 30 sec - exiting 09:16:36 (6792): No heartbeat from core client for 30 sec - exiting 09:16:37 (6792): No heartbeat from core client for 30 sec - exiting 09:16:38 (6792): No heartbeat from core client for 30 sec - exiting 09:16:39 (6792): No heartbeat from core client for 30 sec - exiting 09:16:40 (6792): No heartbeat from core client for 30 sec - exiting 09:16:41 (6792): No heartbeat from core client for 30 sec - exiting 09:16:42 (6792): No heartbeat from core client for 30 sec - exiting 09:16:43 (6792): No heartbeat from core client for 30 sec - exiting 09:16:44 (6792): No heartbeat from core client for 30 sec - exiting 09:16:45 (6792): No heartbeat from core client for 30 sec - exiting 09:16:46 (6792): No heartbeat from core client for 30 sec - exiting 09:16:47 (6792): No heartbeat from core client for 30 sec - exiting 09:16:48 (6792): No heartbeat from core client for 30 sec - exiting 09:16:49 (6792): No heartbeat from core client for 30 sec - exiting 09:16:50 (6792): No heartbeat from core client for 30 sec - exiting 09:16:51 (6792): No heartbeat from core client for 30 sec - exiting 09:16:52 (6792): No heartbeat from core client for 30 sec - exiting 09:16:53 (6792): No heartbeat from core client for 30 sec - exiting 09:16:54 (6792): No heartbeat from core client for 30 sec - exiting 09:16:55 (6792): No heartbeat from core client for 30 sec - exiting 09:16:56 (6792): No heartbeat from core client for 30 sec - exiting 09:16:57 (6792): No heartbeat from core client for 30 sec - exiting 09:16:58 (6792): No heartbeat from core client for 30 sec - exiting 09:16:59 (6792): No heartbeat from core client for 30 sec - exiting 09:17:00 (6792): No heartbeat from core client for 30 sec - exiting 09:17:01 (6792): No heartbeat from core client for 30 sec - exiting 09:17:02 (6792): No heartbeat from core client for 30 sec - exiting 09:17:03 (6792): No heartbeat from core client for 30 sec - exiting 09:17:04 (6792): No heartbeat from core client for 30 sec - exiting 09:17:05 (6792): No heartbeat from core client for 30 sec - exiting 09:17:06 (6792): No heartbeat from core client for 30 sec - exiting 09:17:07 (6792): No heartbeat from core client for 30 sec - exiting 09:17:08 (6792): No heartbeat from core client for 30 sec - exiting 09:17:09 (6792): No heartbeat from core client for 30 sec - exiting 09:17:10 (6792): No heartbeat from core client for 30 sec - exiting 09:17:11 (6792): No heartbeat from core client for 30 sec - exiting 09:17:12 (6792): No heartbeat from core client for 30 sec - exiting 09:17:13 (6792): No heartbeat from core client for 30 sec - exiting 09:17:14 (6792): No heartbeat from core client for 30 sec - exiting 09:17:15 (6792): No heartbeat from core client for 30 sec - exiting 09:17:16 (6792): No heartbeat from core client for 30 sec - exiting 09:17:17 (6792): No heartbeat from core client for 30 sec - exiting 09:17:18 (6792): No heartbeat from core client for 30 sec - exiting 09:17:19 (6792): No heartbeat from core client for 30 sec - exiting 09:17:20 (6792): No heartbeat from core client for 30 sec - exiting 09:17:21 (6792): No heartbeat from core client for 30 sec - exiting 09:17:22 (6792): No heartbeat from core client for 30 sec - exiting 09:17:23 (6792): No heartbeat from core client for 30 sec - exiting 09:17:24 (6792): No heartbeat from core client for 30 sec - exiting 09:17:25 (6792): No heartbeat from core client for 30 sec - exiting 09:17:26 (6792): No heartbeat from core client for 30 sec - exiting 09:17:27 (6792): No heartbeat from core client for 30 sec - exiting 09:17:28 (6792): No heartbeat from core client for 30 sec - exiting 09:17:29 (6792): No heartbeat from core client for 30 sec - exiting 09:17:30 (6792): No heartbeat from core client for 30 sec - exiting 09:17:31 (6792): No heartbeat from core client for 30 sec - exiting 09:17:32 (6792): No heartbeat from core client for 30 sec - exiting 09:17:33 (6792): No heartbeat from core client for 30 sec - exiting 09:17:34 (6792): No heartbeat from core client for 30 sec - exiting 09:17:35 (6792): No heartbeat from core client for 30 sec - exiting 09:17:36 (6792): No heartbeat from core client for 30 sec - exiting 09:17:37 (6792): No heartbeat from core client for 30 sec - exiting 09:17:38 (6792): No heartbeat from core client for 30 sec - exiting 09:17:39 (6792): No heartbeat from core client for 30 sec - exiting 09:17:40 (6792): No heartbeat from core client for 30 sec - exiting 09:17:41 (6792): No heartbeat from core client for 30 sec - exiting 09:17:42 (6792): No heartbeat from core client for 30 sec - exiting 09:17:43 (6792): No heartbeat from core client for 30 sec - exiting 09:17:44 (6792): No heartbeat from core client for 30 sec - exiting 09:17:45 (6792): No heartbeat from core client for 30 sec - exiting 09:17:46 (6792): No heartbeat from core client for 30 sec - exiting 09:17:47 (6792): No heartbeat from core client for 30 sec - exiting 09:17:48 (6792): No heartbeat from core client for 30 sec - exiting 09:17:49 (6792): No heartbeat from core client for 30 sec - exiting 09:17:50 (6792): No heartbeat from core client for 30 sec - exiting 09:17:51 (6792): No heartbeat from core client for 30 sec - exiting 09:17:52 (6792): No heartbeat from core client for 30 sec - exiting 09:17:53 (6792): No heartbeat from core client for 30 sec - exiting 09:17:54 (6792): No heartbeat from core client for 30 sec - exiting 09:17:55 (6792): No heartbeat from core client for 30 sec - exiting 09:17:56 (6792): No heartbeat from core client for 30 sec - exiting 09:17:57 (6792): No heartbeat from core client for 30 sec - exiting 09:17:58 (6792): No heartbeat from core client for 30 sec - exiting 09:17:59 (6792): No heartbeat from core client for 30 sec - exiting 09:18:00 (6792): No heartbeat from core client for 30 sec - exiting 09:18:01 (6792): No heartbeat from core client for 30 sec - exiting 09:18:02 (6792): No heartbeat from core client for 30 sec - exiting 09:18:03 (6792): No heartbeat from core client for 30 sec - exiting 09:18:04 (6792): No heartbeat from core client for 30 sec - exiting 09:18:05 (6792): No heartbeat from core client for 30 sec - exiting 09:18:06 (6792): No heartbeat from core client for 30 sec - exiting 09:18:07 (6792): No heartbeat from core client for 30 sec - exiting 09:18:08 (6792): No heartbeat from core client for 30 sec - exiting 09:18:09 (6792): No heartbeat from core client for 30 sec - exiting 09:18:10 (6792): No heartbeat from core client for 30 sec - exiting 09:18:11 (6792): No heartbeat from core client for 30 sec - exiting 09:18:12 (6792): No heartbeat from core client for 30 sec - exiting 09:18:13 (6792): No heartbeat from core client for 30 sec - exiting 09:18:14 (6792): No heartbeat from core client for 30 sec - exiting 09:18:15 (6792): No heartbeat from core client for 30 sec - exiting 09:18:16 (6792): No heartbeat from core client for 30 sec - exiting 09:18:17 (6792): No heartbeat from core client for 30 sec - exiting 09:18:18 (6792): No heartbeat from core client for 30 sec - exiting 09:18:19 (6792): No heartbeat from core client for 30 sec - exiting 09:18:20 (6792): No heartbeat from core client for 30 sec - exiting 09:18:21 (6792): No heartbeat from core client for 30 sec - exiting 09:18:22 (6792): No heartbeat from core client for 30 sec - exiting 09:18:23 (6792): No heartbeat from core client for 30 sec - exiting 09:18:24 (6792): No heartbeat from core client for 30 sec - exiting 09:18:25 (6792): No heartbeat from core client for 30 sec - exiting 09:18:26 (6792): No heartbeat from core client for 30 sec - exiting 09:18:27 (6792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14080, selfPID=14080, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18400, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10880, iMonCtr=2 Model crash detected, will try to restart... 21:45:27 (11396): No heartbeat from core client for 30 sec - exiting 21:45:28 (11396): No heartbeat from core client for 30 sec - exiting 21:45:29 (11396): No heartbeat from core client for 30 sec - exiting 21:45:30 (11396): No heartbeat from core client for 30 sec - exiting 21:45:31 (11396): No heartbeat from core client for 30 sec - exiting 21:45:32 (11396): No heartbeat from core client for 30 sec - exiting 21:45:33 (11396): No heartbeat from core client for 30 sec - exiting 21:45:34 (11396): No heartbeat from core client for 30 sec - exiting 21:45:35 (11396): No heartbeat from core client for 30 sec - exiting 21:45:36 (11396): No heartbeat from core client for 30 sec - exiting 21:45:37 (11396): No heartbeat from core client for 30 sec - exiting 21:45:38 (11396): No heartbeat from core client for 30 sec - exiting 21:45:39 (11396): No heartbeat from core client for 30 sec - exiting 21:45:40 (11396): No heartbeat from core client for 30 sec - exiting 21:45:41 (11396): No heartbeat from core client for 30 sec - exiting 21:45:42 (11396): No heartbeat from core client for 30 sec - exiting 21:45:43 (11396): No heartbeat from core client for 30 sec - exiting 21:45:44 (11396): No heartbeat from core client for 30 sec - exiting 21:45:45 (11396): No heartbeat from core client for 30 sec - exiting 21:45:46 (11396): No heartbeat from core client for 30 sec - exiting 21:45:47 (11396): No heartbeat from core client for 30 sec - exiting 21:45:48 (11396): No heartbeat from core client for 30 sec - exiting 21:45:49 (11396): No heartbeat from core client for 30 sec - exiting 21:45:50 (11396): No heartbeat from core client for 30 sec - exiting 21:45:51 (11396): No heartbeat from core client for 30 sec - exiting 21:45:52 (11396): No heartbeat from core client for 30 sec - exiting 21:45:53 (11396): No heartbeat from core client for 30 sec - exiting 21:45:54 (11396): No heartbeat from core client for 30 sec - exiting 21:45:55 (11396): No heartbeat from core client for 30 sec - exiting 21:45:56 (11396): No heartbeat from core client for 30 sec - exiting 21:45:57 (11396): No heartbeat from core client for 30 sec - exiting 21:45:58 (11396): No heartbeat from core client for 30 sec - exiting 21:45:59 (11396): No heartbeat from core client for 30 sec - exiting 21:46:00 (11396): No heartbeat from core client for 30 sec - exiting 21:46:01 (11396): No heartbeat from core client for 30 sec - exiting 21:46:02 (11396): No heartbeat from core client for 30 sec - exiting 21:46:03 (11396): No heartbeat from core client for 30 sec - exiting 21:46:04 (11396): No heartbeat from core client for 30 sec - exiting 21:46:05 (11396): No heartbeat from core client for 30 sec - exiting 21:46:06 (11396): No heartbeat from core client for 30 sec - exiting 21:46:07 (11396): No heartbeat from core client for 30 sec - exiting 21:46:08 (11396): No heartbeat from core client for 30 sec - exiting 21:46:09 (11396): No heartbeat from core client for 30 sec - exiting 21:46:10 (11396): No heartbeat from core client for 30 sec - exiting 21:46:11 (11396): No heartbeat from core client for 30 sec - exiting 21:46:12 (11396): No heartbeat from core client for 30 sec - exiting 21:46:13 (11396): No heartbeat from core client for 30 sec - exiting 21:46:14 (11396): No heartbeat from core client for 30 sec - exiting 21:46:15 (11396): No heartbeat from core client for 30 sec - exiting 21:46:16 (11396): No heartbeat from core client for 30 sec - exiting 21:46:17 (11396): No heartbeat from core client for 30 sec - exiting 21:46:18 (11396): No heartbeat from core client for 30 sec - exiting 21:46:19 (11396): No heartbeat from core client for 30 sec - exiting 21:46:20 (11396): No heartbeat from core client for 30 sec - exiting 21:46:21 (11396): No heartbeat from core client for 30 sec - exiting 21:46:22 (11396): No heartbeat from core client for 30 sec - exiting 21:46:23 (11396): No heartbeat from core client for 30 sec - exiting 21:46:24 (11396): No heartbeat from core client for 30 sec - exiting 21:46:25 (11396): No heartbeat from core client for 30 sec - exiting 21:46:26 (11396): No heartbeat from core client for 30 sec - exiting 21:46:27 (11396): No heartbeat from core client for 30 sec - exiting 21:46:28 (11396): No heartbeat from core client for 30 sec - exiting 21:46:29 (11396): No heartbeat from core client for 30 sec - exiting 21:46:30 (11396): No heartbeat from core client for 30 sec - exiting 21:46:31 (11396): No heartbeat from core client for 30 sec - exiting 21:46:32 (11396): No heartbeat from core client for 30 sec - exiting 21:46:33 (11396): No heartbeat from core client for 30 sec - exiting 21:46:34 (11396): No heartbeat from core client for 30 sec - exiting 21:46:35 (11396): No heartbeat from core client for 30 sec - exiting 21:46:36 (11396): No heartbeat from core client for 30 sec - exiting 21:46:37 (11396): No heartbeat from core client for 30 sec - exiting 21:46:38 (11396): No heartbeat from core client for 30 sec - exiting 21:46:39 (11396): No heartbeat from core client for 30 sec - exiting 21:46:40 (11396): No heartbeat from core client for 30 sec - exiting 21:46:41 (11396): No heartbeat from core client for 30 sec - exiting 21:46:42 (11396): No heartbeat from core client for 30 sec - exiting 21:46:43 (11396): No heartbeat from core client for 30 sec - exiting 21:46:44 (11396): No heartbeat from core client for 30 sec - exiting 21:46:45 (11396): No heartbeat from core client for 30 sec - exiting 21:46:46 (11396): No heartbeat from core client for 30 sec - exiting 21:46:47 (11396): No heartbeat from core client for 30 sec - exiting 21:46:48 (11396): No heartbeat from core client for 30 sec - exiting 21:46:49 (11396): No heartbeat from core client for 30 sec - exiting 21:46:50 (11396): No heartbeat from core client for 30 sec - exiting 21:46:51 (11396): No heartbeat from core client for 30 sec - exiting 21:46:52 (11396): No heartbeat from core client for 30 sec - exiting 21:46:53 (11396): No heartbeat from core client for 30 sec - exiting 21:46:54 (11396): No heartbeat from core client for 30 sec - exiting 21:46:55 (11396): No heartbeat from core client for 30 sec - exiting 21:46:56 (11396): No heartbeat from core client for 30 sec - exiting 21:46:57 (11396): No heartbeat from core client for 30 sec - exiting 21:46:58 (11396): No heartbeat from core client for 30 sec - exiting 21:46:59 (11396): No heartbeat from core client for 30 sec - exiting 21:47:00 (11396): No heartbeat from core client for 30 sec - exiting 21:47:01 (11396): No heartbeat from core client for 30 sec - exiting 21:47:02 (11396): No heartbeat from core client for 30 sec - exiting 21:47:03 (11396): No heartbeat from core client for 30 sec - exiting 21:47:04 (11396): No heartbeat from core client for 30 sec - exiting 21:47:05 (11396): No heartbeat from core client for 30 sec - exiting 21:47:06 (11396): No heartbeat from core client for 30 sec - exiting 21:47:07 (11396): No heartbeat from core client for 30 sec - exiting 21:47:08 (11396): No heartbeat from core client for 30 sec - exiting 21:47:09 (11396): No heartbeat from core client for 30 sec - exiting 21:47:10 (11396): No heartbeat from core client for 30 sec - exiting 21:47:11 (11396): No heartbeat from core client for 30 sec - exiting 21:47:12 (11396): No heartbeat from core client for 30 sec - exiting 21:47:13 (11396): No heartbeat from core client for 30 sec - exiting 21:47:14 (11396): No heartbeat from core client for 30 sec - exiting 21:47:15 (11396): No heartbeat from core client for 30 sec - exiting 21:47:16 (11396): No heartbeat from core client for 30 sec - exiting 21:47:17 (11396): No heartbeat from core client for 30 sec - exiting 21:47:18 (11396): No heartbeat from core client for 30 sec - exiting 21:47:19 (11396): No heartbeat from core client for 30 sec - exiting 21:47:20 (11396): No heartbeat from core client for 30 sec - exiting 21:47:21 (11396): No heartbeat from core client for 30 sec - exiting 21:47:22 (11396): No heartbeat from core client for 30 sec - exiting 21:47:23 (11396): No heartbeat from core client for 30 sec - exiting 21:47:24 (11396): No heartbeat from core client for 30 sec - exiting 21:47:25 (11396): No heartbeat from core client for 30 sec - exiting 21:47:26 (11396): No heartbeat from core client for 30 sec - exiting 21:47:27 (11396): No heartbeat from core client for 30 sec - exiting 21:47:28 (11396): No heartbeat from core client for 30 sec - exiting 21:47:29 (11396): No heartbeat from core client for 30 sec - exiting 21:47:30 (11396): No heartbeat from core client for 30 sec - exiting 21:47:31 (11396): No heartbeat from core client for 30 sec - exiting 21:47:32 (11396): No heartbeat from core client for 30 sec - exiting 21:47:33 (11396): No heartbeat from core client for 30 sec - exiting 21:47:34 (11396): No heartbeat from core client for 30 sec - exiting 21:47:35 (11396): No heartbeat from core client for 30 sec - exiting 21:47:36 (11396): No heartbeat from core client for 30 sec - exiting 21:47:37 (11396): No heartbeat from core client for 30 sec - exiting 21:47:38 (11396): No heartbeat from core client for 30 sec - exiting 21:47:39 (11396): No heartbeat from core client for 30 sec - exiting 21:47:40 (11396): No heartbeat from core client for 30 sec - exiting 21:47:41 (11396): No heartbeat from core client for 30 sec - exiting 21:47:42 (11396): No heartbeat from core client for 30 sec - exiting 21:47:43 (11396): No heartbeat from core client for 30 sec - exiting 21:47:44 (11396): No heartbeat from core client for 30 sec - exiting 21:47:45 (11396): No heartbeat from core client for 30 sec - exiting 21:47:46 (11396): No heartbeat from core client for 30 sec - exiting 21:47:47 (11396): No heartbeat from core client for 30 sec - exiting 21:47:48 (11396): No heartbeat from core client for 30 sec - exiting 21:47:49 (11396): No heartbeat from core client for 30 sec - exiting 21:47:50 (11396): No heartbeat from core client for 30 sec - exiting 21:47:51 (11396): No heartbeat from core client for 30 sec - exiting 21:47:52 (11396): No heartbeat from core client for 30 sec - exiting 21:47:53 (11396): No heartbeat from core client for 30 sec - exiting 21:47:54 (11396): No heartbeat from core client for 30 sec - exiting 21:47:55 (11396): No heartbeat from core client for 30 sec - exiting 21:47:56 (11396): No heartbeat from core client for 30 sec - exiting 21:47:57 (11396): No heartbeat from core client for 30 sec - exiting 21:47:58 (11396): No heartbeat from core client for 30 sec - exiting 21:47:59 (11396): No heartbeat from core client for 30 sec - exiting 21:48:00 (11396): No heartbeat from core client for 30 sec - exiting 21:48:01 (11396): No heartbeat from core client for 30 sec - exiting 21:48:02 (11396): No heartbeat from core client for 30 sec - exiting 21:48:03 (11396): No heartbeat from core client for 30 sec - exiting 21:48:04 (11396): No heartbeat from core client for 30 sec - exiting 21:48:05 (11396): No heartbeat from core client for 30 sec - exiting 21:48:06 (11396): No heartbeat from core client for 30 sec - exiting 21:48:07 (11396): No heartbeat from core client for 30 sec - exiting 21:48:08 (11396): No heartbeat from core client for 30 sec - exiting 21:48:09 (11396): No heartbeat from core client for 30 sec - exiting 21:48:10 (11396): No heartbeat from core client for 30 sec - exiting 21:48:11 (11396): No heartbeat from core client for 30 sec - exiting 21:48:12 (11396): No heartbeat from core client for 30 sec - exiting 21:48:13 (11396): No heartbeat from core client for 30 sec - exiting 21:48:14 (11396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11080, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1368, selfPID=5096, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_naup_2012_1_008601681_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_naup_2012_1_008601681_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_naup_2012_1_008601681_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_naup_2012_1_008601681_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_naup_2012_1_008601681_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_naup_2012_1_008601681_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Apr 2014 09:13:14	1302497	16419005	hadam3p_anz_naup_2012_1_008601681_0	69,323	665,189	9.5955
09 Apr 2014 09:14:48	1302497	16419005	hadam3p_anz_naup_2012_1_008601681_0	57,803	556,809	9.6329
07 Apr 2014 01:09:15	1302497	16419005	hadam3p_anz_naup_2012_1_008601681_0	46,283	450,505	9.7337
04 Apr 2014 03:28:55	1302497	16419005	hadam3p_anz_naup_2012_1_008601681_0	34,763	341,031	9.8102
01 Apr 2014 22:49:53	1302497	16419005	hadam3p_anz_naup_2012_1_008601681_0	23,339	229,951	9.8527
29 Mar 2014 08:45:58	1302497	16419005	hadam3p_anz_naup_2012_1_008601681_0	11,819	117,637	9.9532