Task 16615099

Name	hadam3p_anz_r1ie_2012_1_008731572_0
Workunit	8877550
Created	8 May 2014, 18:12:52 UTC
Sent	20 May 2014, 21:46:17 UTC
Report deadline	3 May 2015, 3:06:17 UTC
Received	19 Jun 2014, 19:04:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1291948
Run time	2 days 1 hours 0 min 41 sec
CPU time	1 days 21 hours 52 min 39 sec
Validate state	Invalid
Credit	2,000.18
Device peak FLOPS	3.45 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> 07:18:33 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:29:43 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:40:47 (5000): No heartbeat from core client for 30 sec - exiting 18:40:48 (5000): No heartbeat from core client for 30 sec - exiting 18:40:50 (5000): No heartbeat from core client for 30 sec - exiting 18:40:51 (5000): No heartbeat from core client for 30 sec - exiting 18:40:52 (5000): No heartbeat from core client for 30 sec - exiting 18:40:53 (5000): No heartbeat from core client for 30 sec - exiting 18:40:54 (5000): No heartbeat from core client for 30 sec - exiting 18:40:55 (5000): No heartbeat from core client for 30 sec - exiting 18:40:56 (5000): No heartbeat from core client for 30 sec - exiting 18:40:57 (5000): No heartbeat from core client for 30 sec - exiting 18:40:58 (5000): No heartbeat from core client for 30 sec - exiting 18:40:59 (5000): No heartbeat from core client for 30 sec - exiting 18:41:00 (5000): No heartbeat from core client for 30 sec - exiting 18:41:02 (5000): No heartbeat from core client for 30 sec - exiting 18:41:03 (5000): No heartbeat from core client for 30 sec - exiting 18:41:04 (5000): No heartbeat from core client for 30 sec - exiting 18:41:05 (5000): No heartbeat from core client for 30 sec - exiting 18:41:06 (5000): No heartbeat from core client for 30 sec - exiting 18:41:07 (5000): No heartbeat from core client for 30 sec - exiting 18:41:08 (5000): No heartbeat from core client for 30 sec - exiting 18:41:09 (5000): No heartbeat from core client for 30 sec - exiting 18:41:10 (5000): No heartbeat from core client for 30 sec - exiting 18:41:11 (5000): No heartbeat from core client for 30 sec - exiting 18:41:13 (5000): No heartbeat from core client for 30 sec - exiting 18:41:14 (5000): No heartbeat from core client for 30 sec - exiting 18:41:15 (5000): No heartbeat from core client for 30 sec - exiting 18:41:16 (5000): No heartbeat from core client for 30 sec - exiting 18:41:17 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3976, selfPID=4272, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11260, iMonCtr=2 15:15:04 (5356): No heartbeat from core client for 30 sec - exiting 15:15:05 (5356): No heartbeat from core client for 30 sec - exiting 15:15:06 (5356): No heartbeat from core client for 30 sec - exiting 15:15:07 (5356): No heartbeat from core client for 30 sec - exiting 15:15:08 (5356): No heartbeat from core client for 30 sec - exiting 15:15:09 (5356): No heartbeat from core client for 30 sec - exiting 15:15:10 (5356): No heartbeat from core client for 30 sec - exiting 15:15:11 (5356): No heartbeat from core client for 30 sec - exiting 15:15:13 (5356): No heartbeat from core client for 30 sec - exiting 15:15:14 (5356): No heartbeat from core client for 30 sec - exiting 15:15:15 (5356): No heartbeat from core client for 30 sec - exiting 15:15:16 (5356): No heartbeat from core client for 30 sec - exiting 15:15:17 (5356): No heartbeat from core client for 30 sec - exiting 15:15:18 (5356): No heartbeat from core client for 30 sec - exiting 15:15:19 (5356): No heartbeat from core client for 30 sec - exiting 15:15:20 (5356): No heartbeat from core client for 30 sec - exiting 15:15:21 (5356): No heartbeat from core client for 30 sec - exiting 15:15:22 (5356): No heartbeat from core client for 30 sec - exiting 15:15:23 (5356): No heartbeat from core client for 30 sec - exiting 15:15:25 (5356): No heartbeat from core client for 30 sec - exiting 15:15:26 (5356): No heartbeat from core client for 30 sec - exiting 15:15:27 (5356): No heartbeat from core client for 30 sec - exiting 15:15:28 (5356): No heartbeat from core client for 30 sec - exiting 15:15:29 (5356): No heartbeat from core client for 30 sec - exiting 15:15:30 (5356): No heartbeat from core client for 30 sec - exiting 15:15:31 (5356): No heartbeat from core client for 30 sec - exiting 15:15:32 (5356): No heartbeat from core client for 30 sec - exiting 15:15:33 (5356): No heartbeat from core client for 30 sec - exiting 15:15:34 (5356): No heartbeat from core client for 30 sec - exiting 15:15:35 (5356): No heartbeat from core client for 30 sec - exiting 15:15:37 (5356): No heartbeat from core client for 30 sec - exiting 15:15:38 (5356): No heartbeat from core client for 30 sec - exiting 15:15:39 (5356): No heartbeat from core client for 30 sec - exiting 15:15:40 (5356): No heartbeat from core client for 30 sec - exiting 15:15:41 (5356): No heartbeat from core client for 30 sec - exiting 15:15:42 (5356): No heartbeat from core client for 30 sec - exiting 15:15:43 (5356): No heartbeat from core client for 30 sec - exiting 15:15:44 (5356): No heartbeat from core client for 30 sec - exiting 15:15:45 (5356): No heartbeat from core client for 30 sec - exiting 15:15:46 (5356): No heartbeat from core client for 30 sec - exiting 15:15:48 (5356): No heartbeat from core client for 30 sec - exiting 15:15:49 (5356): No heartbeat from core client for 30 sec - exiting 15:15:50 (5356): No heartbeat from core client for 30 sec - exiting 15:15:51 (5356): No heartbeat from core client for 30 sec - exiting 15:15:52 (5356): No heartbeat from core client for 30 sec - exiting 15:15:53 (5356): No heartbeat from core client for 30 sec - exiting 15:15:54 (5356): No heartbeat from core client for 30 sec - exiting 15:15:55 (5356): No heartbeat from core client for 30 sec - exiting 15:15:56 (5356): No heartbeat from core client for 30 sec - exiting 15:15:57 (5356): No heartbeat from core client for 30 sec - exiting 15:15:58 (5356): No heartbeat from core client for 30 sec - exiting 15:16:00 (5356): No heartbeat from core client for 30 sec - exiting 15:16:01 (5356): No heartbeat from core client for 30 sec - exiting 15:16:02 (5356): No heartbeat from core client for 30 sec - exiting 15:16:03 (5356): No heartbeat from core client for 30 sec - exiting 15:16:04 (5356): No heartbeat from core client for 30 sec - exiting 15:16:05 (5356): No heartbeat from core client for 30 sec - exiting 15:16:06 (5356): No heartbeat from core client for 30 sec - exiting 15:16:07 (5356): No heartbeat from core client for 30 sec - exiting 15:16:08 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1228, selfPID=1228, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:10:55 (2664): No heartbeat from core client for 30 sec - exiting 09:10:56 (2664): No heartbeat from core client for 30 sec - exiting 09:10:57 (2664): No heartbeat from core client for 30 sec - exiting 09:10:58 (2664): No heartbeat from core client for 30 sec - exiting 09:11:00 (2664): No heartbeat from core client for 30 sec - exiting 09:11:01 (2664): No heartbeat from core client for 30 sec - exiting 09:11:02 (2664): No heartbeat from core client for 30 sec - exiting 09:11:03 (2664): No heartbeat from core client for 30 sec - exiting 09:11:04 (2664): No heartbeat from core client for 30 sec - exiting 09:11:05 (2664): No heartbeat from core client for 30 sec - exiting 09:11:06 (2664): No heartbeat from core client for 30 sec - exiting 09:11:07 (2664): No heartbeat from core client for 30 sec - exiting 09:11:08 (2664): No heartbeat from core client for 30 sec - exiting 09:11:09 (2664): No heartbeat from core client for 30 sec - exiting 09:11:10 (2664): No heartbeat from core client for 30 sec - exiting 09:11:12 (2664): No heartbeat from core client for 30 sec - exiting 09:11:13 (2664): No heartbeat from core client for 30 sec - exiting 09:11:14 (2664): No heartbeat from core client for 30 sec - exiting 09:11:15 (2664): No heartbeat from core client for 30 sec - exiting 09:11:16 (2664): No heartbeat from core client for 30 sec - exiting 09:11:17 (2664): No heartbeat from core client for 30 sec - exiting 09:11:18 (2664): No heartbeat from core client for 30 sec - exiting 09:11:19 (2664): No heartbeat from core client for 30 sec - exiting 09:11:20 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7020, selfPID=7020, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:23:44 (2228): No heartbeat from core client for 30 sec - exiting 07:23:45 (2228): No heartbeat from core client for 30 sec - exiting 07:23:46 (2228): No heartbeat from core client for 30 sec - exiting 07:23:47 (2228): No heartbeat from core client for 30 sec - exiting 07:23:49 (2228): No heartbeat from core client for 30 sec - exiting 07:23:50 (2228): No heartbeat from core client for 30 sec - exiting 07:23:51 (2228): No heartbeat from core client for 30 sec - exiting 07:23:52 (2228): No heartbeat from core client for 30 sec - exiting 07:23:53 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5372, selfPID=5372, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:28:02 (3296): No heartbeat from core client for 30 sec - exiting 07:28:03 (3296): No heartbeat from core client for 30 sec - exiting 07:28:04 (3296): No heartbeat from core client for 30 sec - exiting 07:28:05 (3296): No heartbeat from core client for 30 sec - exiting 07:28:06 (3296): No heartbeat from core client for 30 sec - exiting 07:28:07 (3296): No heartbeat from core client for 30 sec - exiting 07:28:08 (3296): No heartbeat from core client for 30 sec - exiting 07:28:10 (3296): No heartbeat from core client for 30 sec - exiting 07:28:11 (3296): No heartbeat from core client for 30 sec - exiting 07:28:12 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4756, selfPID=4756, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:05:31 (5048): No heartbeat from core client for 30 sec - exiting 08:05:32 (5048): No heartbeat from core client for 30 sec - exiting 08:05:33 (5048): No heartbeat from core client for 30 sec - exiting 08:05:34 (5048): No heartbeat from core client for 30 sec - exiting 08:05:36 (5048): No heartbeat from core client for 30 sec - exiting 08:05:37 (5048): No heartbeat from core client for 30 sec - exiting 08:05:38 (5048): No heartbeat from core client for 30 sec - exiting 08:05:39 (5048): No heartbeat from core client for 30 sec - exiting 08:05:40 (5048): No heartbeat from core client for 30 sec - exiting 08:05:41 (5048): No heartbeat from core client for 30 sec - exiting 08:05:42 (5048): No heartbeat from core client for 30 sec - exiting 08:05:43 (5048): No heartbeat from core client for 30 sec - exiting 08:05:44 (5048): No heartbeat from core client for 30 sec - exiting 08:05:45 (5048): No heartbeat from core client for 30 sec - exiting 08:05:46 (5048): No heartbeat from core client for 30 sec - exiting 08:05:48 (5048): No heartbeat from core client for 30 sec - exiting 08:05:49 (5048): No heartbeat from core client for 30 sec - exiting 08:05:50 (5048): No heartbeat from core client for 30 sec - exiting 08:05:51 (5048): No heartbeat from core client for 30 sec - exiting 08:05:52 (5048): No heartbeat from core client for 30 sec - exiting 08:05:53 (5048): No heartbeat from core client for 30 sec - exiting 08:05:54 (5048): No heartbeat from core client for 30 sec - exiting 08:05:55 (5048): No heartbeat from core client for 30 sec - exiting 08:05:56 (5048): No heartbeat from core client for 30 sec - exiting 08:05:57 (5048): No heartbeat from core client for 30 sec - exiting 08:05:58 (5048): No heartbeat from core client for 30 sec - exiting 08:06:00 (5048): No heartbeat from core client for 30 sec - exiting 08:06:01 (5048): No heartbeat from core client for 30 sec - exiting 08:06:02 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:24:38 (3496): No heartbeat from core client for 30 sec - exiting 07:24:39 (3496): No heartbeat from core client for 30 sec - exiting 07:24:40 (3496): No heartbeat from core client for 30 sec - exiting 07:24:41 (3496): No heartbeat from core client for 30 sec - exiting 07:24:42 (3496): No heartbeat from core client for 30 sec - exiting 07:24:43 (3496): No heartbeat from core client for 30 sec - exiting 07:24:45 (3496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1708, selfPID=1708, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3428, selfPID=3428, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2592, selfPID=6220, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_r1ie_2012_1_008731572_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r1ie_2012_1_008731572_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r1ie_2012_1_008731572_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r1ie_2012_1_008731572_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r1ie_2012_1_008731572_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r1ie_2012_1_008731572_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r1ie_2012_1_008731572_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r1ie_2012_1_008731572_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Jun 2014 10:01:11	1291948	16615099	hadam3p_anz_r1ie_2012_1_008731572_0	46,379	139,869	3.0158
13 Jun 2014 15:22:27	1291948	16615099	hadam3p_anz_r1ie_2012_1_008731572_0	34,859	106,608	3.0583
06 Jun 2014 16:50:39	1291948	16615099	hadam3p_anz_r1ie_2012_1_008731572_0	23,339	71,096	3.0462
23 May 2014 17:17:19	1291948	16615099	hadam3p_anz_r1ie_2012_1_008731572_0	11,819	35,262	2.9835