Task 17600261

Name	hadam3p_anz_d2n0_2012_1_009313916_0
Workunit	9398104
Created	17 Dec 2014, 20:48:37 UTC
Sent	18 Dec 2014, 12:45:30 UTC
Report deadline	30 Nov 2015, 18:05:30 UTC
Received	10 Jan 2015, 9:27:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1339046
Run time	2 days 3 hours 17 min 47 sec
CPU time	1 days 21 hours 59 min 15 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	3.66 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 13:17:18 (4564): No heartbeat from core client for 30 sec - exiting 13:17:19 (4564): No heartbeat from core client for 30 sec - exiting 13:17:20 (4564): No heartbeat from core client for 30 sec - exiting 13:17:21 (4564): No heartbeat from core client for 30 sec - exiting 13:17:22 (4564): No heartbeat from core client for 30 sec - exiting 13:17:23 (4564): No heartbeat from core client for 30 sec - exiting 13:17:24 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:23:49 (3560): No heartbeat from core client for 30 sec - exiting 21:23:50 (3560): No heartbeat from core client for 30 sec - exiting 21:23:51 (3560): No heartbeat from core client for 30 sec - exiting 21:23:52 (3560): No heartbeat from core client for 30 sec - exiting 21:23:53 (3560): No heartbeat from core client for 30 sec - exiting 21:23:54 (3560): No heartbeat from core client for 30 sec - exiting 21:23:55 (3560): No heartbeat from core client for 30 sec - exiting 21:23:56 (3560): No heartbeat from core client for 30 sec - exiting 21:23:57 (3560): No heartbeat from core client for 30 sec - exiting 21:23:58 (3560): No heartbeat from core client for 30 sec - exiting 21:23:59 (3560): No heartbeat from core client for 30 sec - exiting 21:24:00 (3560): No heartbeat from core client for 30 sec - exiting 21:24:01 (3560): No heartbeat from core client for 30 sec - exiting 21:24:02 (3560): No heartbeat from core client for 30 sec - exiting 21:24:03 (3560): No heartbeat from core client for 30 sec - exiting 21:24:04 (3560): No heartbeat from core client for 30 sec - exiting 21:24:05 (3560): No heartbeat from core client for 30 sec - exiting 21:24:06 (3560): No heartbeat from core client for 30 sec - exiting 21:24:07 (3560): No heartbeat from core client for 30 sec - exiting 21:24:08 (3560): No heartbeat from core client for 30 sec - exiting 21:24:09 (3560): No heartbeat from core client for 30 sec - exiting 21:24:10 (3560): No heartbeat from core client for 30 sec - exiting 21:24:11 (3560): No heartbeat from core client for 30 sec - exiting 21:24:12 (3560): No heartbeat from core client for 30 sec - exiting 21:24:13 (3560): No heartbeat from core client for 30 sec - exiting 21:24:14 (3560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4580, selfPID=4888, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 09:27:59 (4576): No heartbeat from core client for 30 sec - exiting 09:28:00 (4576): No heartbeat from core client for 30 sec - exiting 09:28:01 (4576): No heartbeat from core client for 30 sec - exiting 09:28:02 (4576): No heartbeat from core client for 30 sec - exiting 09:28:03 (4576): No heartbeat from core client for 30 sec - exiting 09:28:04 (4576): No heartbeat from core client for 30 sec - exiting 09:28:05 (4576): No heartbeat from core client for 30 sec - exiting 09:28:06 (4576): No heartbeat from core client for 30 sec - exiting 09:28:07 (4576): No heartbeat from core client for 30 sec - exiting 09:28:08 (4576): No heartbeat from core client for 30 sec - exiting 09:28:09 (4576): No heartbeat from core client for 30 sec - exiting 09:28:10 (4576): No heartbeat from core client for 30 sec - exiting 09:28:11 (4576): No heartbeat from core client for 30 sec - exiting 09:28:12 (4576): No heartbeat from core client for 30 sec - exiting 09:28:13 (4576): No heartbeat from core client for 30 sec - exiting 09:28:14 (4576): No heartbeat from core client for 30 sec - exiting 09:28:15 (4576): No heartbeat from core client for 30 sec - exiting 09:28:16 (4576): No heartbeat from core client for 30 sec - exiting 09:28:17 (4576): No heartbeat from core client for 30 sec - exiting 09:28:18 (4576): No heartbeat from core client for 30 sec - exiting 09:28:19 (4576): No heartbeat from core client for 30 sec - exiting 09:28:20 (4576): No heartbeat from core client for 30 sec - exiting 09:28:21 (4576): No heartbeat from core client for 30 sec - exiting 09:28:22 (4576): No heartbeat from core client for 30 sec - exiting 09:28:23 (4576): No heartbeat from core client for 30 sec - exiting 09:28:24 (4576): No heartbeat from core client for 30 sec - exiting 09:28:25 (4576): No heartbeat from core client for 30 sec - exiting 09:28:26 (4576): No heartbeat from core client for 30 sec - exiting 09:28:27 (4576): No heartbeat from core client for 30 sec - exiting 09:28:28 (4576): No heartbeat from core client for 30 sec - exiting 09:28:29 (4576): No heartbeat from core client for 30 sec - exiting 09:28:30 (4576): No heartbeat from core client for 30 sec - exiting 09:28:31 (4576): No heartbeat from core client for 30 sec - exiting 09:28:32 (4576): No heartbeat from core client for 30 sec - exiting 09:28:33 (4576): No heartbeat from core client for 30 sec - exiting 09:28:34 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3356, iMonCtr=2 11:56:36 (4428): No heartbeat from core client for 30 sec - exiting 11:56:37 (4428): No heartbeat from core client for 30 sec - exiting 11:56:38 (4428): No heartbeat from core client for 30 sec - exiting 11:56:39 (4428): No heartbeat from core client for 30 sec - exiting 11:56:40 (4428): No heartbeat from core client for 30 sec - exiting 11:56:41 (4428): No heartbeat from core client for 30 sec - exiting 11:56:42 (4428): No heartbeat from core client for 30 sec - exiting 11:56:43 (4428): No heartbeat from core client for 30 sec - exiting 11:56:44 (4428): No heartbeat from core client for 30 sec - exiting 11:56:45 (4428): No heartbeat from core client for 30 sec - exiting 11:56:46 (4428): No heartbeat from core client for 30 sec - exiting 11:56:47 (4428): No heartbeat from core client for 30 sec - exiting 11:56:48 (4428): No heartbeat from core client for 30 sec - exiting 11:56:49 (4428): No heartbeat from core client for 30 sec - exiting 11:56:50 (4428): No heartbeat from core client for 30 sec - exiting 11:56:51 (4428): No heartbeat from core client for 30 sec - exiting 11:56:52 (4428): No heartbeat from core client for 30 sec - exiting 11:56:53 (4428): No heartbeat from core client for 30 sec - exiting 11:56:54 (4428): No heartbeat from core client for 30 sec - exiting 11:56:55 (4428): No heartbeat from core client for 30 sec - exiting 11:56:56 (4428): No heartbeat from core client for 30 sec - exiting 11:56:57 (4428): No heartbeat from core client for 30 sec - exiting 11:56:58 (4428): No heartbeat from core client for 30 sec - exiting 11:56:59 (4428): No heartbeat from core client for 30 sec - exiting 11:57:00 (4428): No heartbeat from core client for 30 sec - exiting 11:57:01 (4428): No heartbeat from core client for 30 sec - exiting 11:57:02 (4428): No heartbeat from core client for 30 sec - exiting 11:57:03 (4428): No heartbeat from core client for 30 sec - exiting 11:57:04 (4428): No heartbeat from core client for 30 sec - exiting 11:57:05 (4428): No heartbeat from core client for 30 sec - exiting 11:57:06 (4428): No heartbeat from core client for 30 sec - exiting 11:57:07 (4428): No heartbeat from core client for 30 sec - exiting 11:57:08 (4428): No heartbeat from core client for 30 sec - exiting 11:57:09 (4428): No heartbeat from core client for 30 sec - exiting 11:57:10 (4428): No heartbeat from core client for 30 sec - exiting 11:57:11 (4428): No heartbeat from core client for 30 sec - exiting 11:57:12 (4428): No heartbeat from core client for 30 sec - exiting 11:57:13 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:33:03 (4380): No heartbeat from core client for 30 sec - exiting 17:33:04 (4380): No heartbeat from core client for 30 sec - exiting 17:33:05 (4380): No heartbeat from core client for 30 sec - exiting 17:33:06 (4380): No heartbeat from core client for 30 sec - exiting 17:33:07 (4380): No heartbeat from core client for 30 sec - exiting 17:33:08 (4380): No heartbeat from core client for 30 sec - exiting 17:33:09 (4380): No heartbeat from core client for 30 sec - exiting 17:33:10 (4380): No heartbeat from core client for 30 sec - exiting 17:33:11 (4380): No heartbeat from core client for 30 sec - exiting 17:33:12 (4380): No heartbeat from core client for 30 sec - exiting 17:33:13 (4380): No heartbeat from core client for 30 sec - exiting 17:33:14 (4380): No heartbeat from core client for 30 sec - exiting 17:33:15 (4380): No heartbeat from core client for 30 sec - exiting 17:33:16 (4380): No heartbeat from core client for 30 sec - exiting 17:33:17 (4380): No heartbeat from core client for 30 sec - exiting 17:33:18 (4380): No heartbeat from core client for 30 sec - exiting 17:33:19 (4380): No heartbeat from core client for 30 sec - exiting 17:33:20 (4380): No heartbeat from core client for 30 sec - exiting 17:33:21 (4380): No heartbeat from core client for 30 sec - exiting 17:33:22 (4380): No heartbeat from core client for 30 sec - exiting 17:33:23 (4380): No heartbeat from core client for 30 sec - exiting 17:33:24 (4380): No heartbeat from core client for 30 sec - exiting 17:33:25 (4380): No heartbeat from core client for 30 sec - exiting 17:33:26 (4380): No heartbeat from core client for 30 sec - exiting 17:33:27 (4380): No heartbeat from core client for 30 sec - exiting 17:33:28 (4380): No heartbeat from core client for 30 sec - exiting 17:33:29 (4380): No heartbeat from core client for 30 sec - exiting 17:33:30 (4380): No heartbeat from core client for 30 sec - exiting 17:33:31 (4380): No heartbeat from core client for 30 sec - exiting 17:33:32 (4380): No heartbeat from core client for 30 sec - exiting 17:33:33 (4380): No heartbeat from core client for 30 sec - exiting 17:33:34 (4380): No heartbeat from core client for 30 sec - exiting 17:33:35 (4380): No heartbeat from core client for 30 sec - exiting 17:33:36 (4380): No heartbeat from core client for 30 sec - exiting 17:33:37 (4380): No heartbeat from core client for 30 sec - exiting 17:33:38 (4380): No heartbeat from core client for 30 sec - exiting 17:33:39 (4380): No heartbeat from core client for 30 sec - exiting 17:33:40 (4380): No heartbeat from core client for 30 sec - exiting 17:33:41 (4380): No heartbeat from core client for 30 sec - exiting 17:33:42 (4380): No heartbeat from core client for 30 sec - exiting 17:33:43 (4380): No heartbeat from core client for 30 sec - exiting 17:33:44 (4380): No heartbeat from core client for 30 sec - exiting 17:33:45 (4380): No heartbeat from core client for 30 sec - exiting 17:33:46 (4380): No heartbeat from core client for 30 sec - exiting 17:33:47 (4380): No heartbeat from core client for 30 sec - exiting 17:33:48 (4380): No heartbeat from core client for 30 sec - exiting 17:33:49 (4380): No heartbeat from core client for 30 sec - exiting 17:33:50 (4380): No heartbeat from core client for 30 sec - exiting 17:33:51 (4380): No heartbeat from core client for 30 sec - exiting 17:33:52 (4380): No heartbeat from core client for 30 sec - exiting 17:33:53 (4380): No heartbeat from core client for 30 sec - exiting 17:33:54 (4380): No heartbeat from core client for 30 sec - exiting 17:33:55 (4380): No heartbeat from core client for 30 sec - exiting 17:33:56 (4380): No heartbeat from core client for 30 sec - exiting 17:33:57 (4380): No heartbeat from core client for 30 sec - exiting 17:33:58 (4380): No heartbeat from core client for 30 sec - exiting 17:33:59 (4380): No heartbeat from core client for 30 sec - exiting 17:34:00 (4380): No heartbeat from core client for 30 sec - exiting 17:34:01 (4380): No heartbeat from core client for 30 sec - exiting 17:34:02 (4380): No heartbeat from core client for 30 sec - exiting 17:34:03 (4380): No heartbeat from core client for 30 sec - exiting 17:34:04 (4380): No heartbeat from core client for 30 sec - exiting 17:34:05 (4380): No heartbeat from core client for 30 sec - exiting 17:34:06 (4380): No heartbeat from core client for 30 sec - exiting 17:34:07 (4380): No heartbeat from core client for 30 sec - exiting 17:34:08 (4380): No heartbeat from core client for 30 sec - exiting 17:34:09 (4380): No heartbeat from core client for 30 sec - exiting 17:34:10 (4380): No heartbeat from core client for 30 sec - exiting 17:34:11 (4380): No heartbeat from core client for 30 sec - exiting 17:34:12 (4380): No heartbeat from core client for 30 sec - exiting 17:34:13 (4380): No heartbeat from core client for 30 sec - exiting 17:34:14 (4380): No heartbeat from core client for 30 sec - exiting 17:34:15 (4380): No heartbeat from core client for 30 sec - exiting 17:34:16 (4380): No heartbeat from core client for 30 sec - exiting 17:34:17 (4380): No heartbeat from core client for 30 sec - exiting 17:34:18 (4380): No heartbeat from core client for 30 sec - exiting 17:34:19 (4380): No heartbeat from core client for 30 sec - exiting 17:34:20 (4380): No heartbeat from core client for 30 sec - exiting 17:34:21 (4380): No heartbeat from core client for 30 sec - exiting 17:34:22 (4380): No heartbeat from core client for 30 sec - exiting 17:34:23 (4380): No heartbeat from core client for 30 sec - exiting 17:34:24 (4380): No heartbeat from core client for 30 sec - exiting 17:34:25 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:28:10 (4248): No heartbeat from core client for 30 sec - exiting 10:28:12 (4248): No heartbeat from core client for 30 sec - exiting 10:28:13 (4248): No heartbeat from core client for 30 sec - exiting 10:28:14 (4248): No heartbeat from core client for 30 sec - exiting 10:28:15 (4248): No heartbeat from core client for 30 sec - exiting 10:28:16 (4248): No heartbeat from core client for 30 sec - exiting 10:28:17 (4248): No heartbeat from core client for 30 sec - exiting 10:28:18 (4248): No heartbeat from core client for 30 sec - exiting 10:28:19 (4248): No heartbeat from core client for 30 sec - exiting 10:28:20 (4248): No heartbeat from core client for 30 sec - exiting 10:28:21 (4248): No heartbeat from core client for 30 sec - exiting 10:28:22 (4248): No heartbeat from core client for 30 sec - exiting 10:28:23 (4248): No heartbeat from core client for 30 sec - exiting 10:28:24 (4248): No heartbeat from core client for 30 sec - exiting 10:28:25 (4248): No heartbeat from core client for 30 sec - exiting 10:28:26 (4248): No heartbeat from core client for 30 sec - exiting 10:28:27 (4248): No heartbeat from core client for 30 sec - exiting 10:28:28 (4248): No heartbeat from core client for 30 sec - exiting 10:28:29 (4248): No heartbeat from core client for 30 sec - exiting 10:28:30 (4248): No heartbeat from core client for 30 sec - exiting 10:28:31 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3868, selfPID=1984, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=3764, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5212, selfPID=5212, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5212, selfPID=4780, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_d2n0_2012_1_009313916_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d2n0_2012_1_009313916_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d2n0_2012_1_009313916_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d2n0_2012_1_009313916_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d2n0_2012_1_009313916_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d2n0_2012_1_009313916_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d2n0_2012_1_009313916_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jan 2015 17:08:29	1339046	17600261	hadam3p_anz_d2n0_2012_1_009313916_0	57,899	149,603	2.5839
08 Jan 2015 16:23:33	1339046	17600261	hadam3p_anz_d2n0_2012_1_009313916_0	46,379	119,900	2.5852
08 Jan 2015 16:18:25	1339046	17600261	hadam3p_anz_d2n0_2012_1_009313916_0	34,859	90,033	2.5828
04 Jan 2015 21:40:36	1339046	17600261	hadam3p_anz_d2n0_2012_1_009313916_0	23,339	59,916	2.5672
19 Dec 2014 13:26:33	1339046	17600261	hadam3p_anz_d2n0_2012_1_009313916_0	11,819	29,879	2.5280