Task 15108361

Name	hadam3p_saf_1oxk_1967_1_006988944_1
Workunit	7192260
Created	13 Aug 2012, 9:30:36 UTC
Sent	13 Aug 2012, 9:31:59 UTC
Report deadline	26 Jul 2013, 14:51:59 UTC
Received	25 Nov 2012, 22:08:10 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1186953
Run time	4 days 6 hours 34 min 21 sec
CPU time	3 days 23 hours 12 min 32 sec
Validate state	Initial
Credit	2,244.09
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:02:53 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:55 (5144): No heartbeat from core client for 30 sec - exiting 19:02:56 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5952, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3444, iMonCtr=2 Model crash detected, will try to restart... 20:54:37 (1420): No heartbeat from core client for 30 sec - exiting 20:54:38 (1420): No heartbeat from core client for 30 sec - exiting 20:54:39 (1420): No heartbeat from core client for 30 sec - exiting 20:54:40 (1420): No heartbeat from core client for 30 sec - exiting 20:54:41 (1420): No heartbeat from core client for 30 sec - exiting 20:54:43 (1420): No heartbeat from core client for 30 sec - exiting 20:54:44 (1420): No heartbeat from core client for 30 sec - exiting 20:54:45 (1420): No heartbeat from core client for 30 sec - exiting 20:54:46 (1420): No heartbeat from core client for 30 sec - exiting 20:54:47 (1420): No heartbeat from core client for 30 sec - exiting 20:54:48 (1420): No heartbeat from core client for 30 sec - exiting 20:54:49 (1420): No heartbeat from core client for 30 sec - exiting 20:54:50 (1420): No heartbeat from core client for 30 sec - exiting 20:54:51 (1420): No heartbeat from core client for 30 sec - exiting 20:54:52 (1420): No heartbeat from core client for 30 sec - exiting 20:54:53 (1420): No heartbeat from core client for 30 sec - exiting 20:54:55 (1420): No heartbeat from core client for 30 sec - exiting 20:54:56 (1420): No heartbeat from core client for 30 sec - exiting 20:54:57 (1420): No heartbeat from core client for 30 sec - exiting 20:54:58 (1420): No heartbeat from core client for 30 sec - exiting 20:54:59 (1420): No heartbeat from core client for 30 sec - exiting 20:55:00 (1420): No heartbeat from core client for 30 sec - exiting 20:55:01 (1420): No heartbeat from core client for 30 sec - exiting 20:55:02 (1420): No heartbeat from core client for 30 sec - exiting 20:55:03 (1420): No heartbeat from core client for 30 sec - exiting 20:55:04 (1420): No heartbeat from core client for 30 sec - exiting 20:55:06 (1420): No heartbeat from core client for 30 sec - exiting 20:55:07 (1420): No heartbeat from core client for 30 sec - exiting 20:55:08 (1420): No heartbeat from core client for 30 sec - exiting 20:55:09 (1420): No heartbeat from core client for 30 sec - exiting 20:55:10 (1420): No heartbeat from core client for 30 sec - exiting 20:55:11 (1420): No heartbeat from core client for 30 sec - exiting 20:55:12 (1420): No heartbeat from core client for 30 sec - exiting 20:55:13 (1420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:14 (1420): No heartbeat from core client for 30 sec - exiting 20:55:15 (1420): No heartbeat from core client for 30 sec - exiting 20:55:16 (1420): No heartbeat from core client for 30 sec - exiting 20:55:18 (1420): No heartbeat from core client for 30 sec - exiting 20:55:19 (1420): No heartbeat from core client for 30 sec - exiting 20:55:20 (1420): No heartbeat from core client for 30 sec - exiting 20:55:21 (1420): No heartbeat from core client for 30 sec - exiting 20:55:22 (1420): No heartbeat from core client for 30 sec - exiting 20:55:23 (1420): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1508, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:02 (3096): No heartbeat from core client for 30 sec - exiting 19:13:03 (3096): No heartbeat from core client for 30 sec - exiting 19:13:04 (3096): No heartbeat from core client for 30 sec - exiting 19:13:05 (3096): No heartbeat from core client for 30 sec - exiting 19:13:06 (3096): No heartbeat from core client for 30 sec - exiting 19:13:07 (3096): No heartbeat from core client for 30 sec - exiting 19:13:08 (3096): No heartbeat from core client for 30 sec - exiting 19:13:09 (3096): No heartbeat from core client for 30 sec - exiting 19:13:10 (3096): No heartbeat from core client for 30 sec - exiting 19:13:11 (3096): No heartbeat from core client for 30 sec - exiting 19:13:12 (3096): No heartbeat from core client for 30 sec - exiting 19:13:14 (3096): No heartbeat from core client for 30 sec - exiting 19:13:15 (3096): No heartbeat from core client for 30 sec - exiting 19:13:16 (3096): No heartbeat from core client for 30 sec - exiting 19:13:17 (3096): No heartbeat from core client for 30 sec - exiting 19:13:18 (3096): No heartbeat from core client for 30 sec - exiting 19:13:19 (3096): No heartbeat from core client for 30 sec - exiting 19:13:20 (3096): No heartbeat from core client for 30 sec - exiting 19:13:21 (3096): No heartbeat from core client for 30 sec - exiting 19:14:50 (3096): No heartbeat from core client for 30 sec - exiting 19:14:51 (3096): No heartbeat from core client for 30 sec - exiting 19:14:53 (3096): No heartbeat from core client for 30 sec - exiting 19:14:54 (3096): No heartbeat from core client for 30 sec - exiting 19:14:55 (3096): No heartbeat from core client for 30 sec - exiting 19:14:56 (3096): No heartbeat from core client for 30 sec - exiting 19:14:57 (3096): No heartbeat from core client for 30 sec - exiting 19:14:58 (3096): No heartbeat from core client for 30 sec - exiting 19:14:59 (3096): No heartbeat from core client for 30 sec - exiting 19:15:00 (3096): No heartbeat from core client for 30 sec - exiting 19:15:01 (3096): No heartbeat from core client for 30 sec - exiting 19:15:02 (3096): No heartbeat from core client for 30 sec - exiting 19:15:03 (3096): No heartbeat from core client for 30 sec - exiting 19:15:05 (3096): No heartbeat from core client for 30 sec - exiting 19:15:06 (3096): No heartbeat from core client for 30 sec - exiting 19:15:07 (3096): No heartbeat from core client for 30 sec - exiting 19:15:08 (3096): No heartbeat from core client for 30 sec - exiting 19:15:09 (3096): No heartbeat from core client for 30 sec - exiting 19:15:10 (3096): No heartbeat from core client for 30 sec - exiting 19:15:11 (3096): No heartbeat from core client for 30 sec - exiting 19:15:12 (3096): No heartbeat from core client for 30 sec - exiting 19:15:13 (3096): No heartbeat from core client for 30 sec - exiting 19:15:14 (3096): No heartbeat from core client for 30 sec - exiting 19:15:15 (3096): No heartbeat from core client for 30 sec - exiting 19:15:17 (3096): No heartbeat from core client for 30 sec - exiting 19:15:18 (3096): No heartbeat from core client for 30 sec - exiting 19:15:19 (3096): No heartbeat from core client for 30 sec - exiting 19:15:20 (3096): No heartbeat from core client for 30 sec - exiting 19:15:21 (3096): No heartbeat from core client for 30 sec - exiting 19:15:22 (3096): No heartbeat from core client for 30 sec - exiting 19:15:23 (3096): No heartbeat from core client for 30 sec - exiting 19:15:24 (3096): No heartbeat from core client for 30 sec - exiting 19:15:25 (3096): No heartbeat from core client for 30 sec - exiting 19:15:26 (3096): No heartbeat from core client for 30 sec - exiting 19:15:27 (3096): No heartbeat from core client for 30 sec - exiting 19:15:29 (3096): No heartbeat from core client for 30 sec - exiting 19:15:30 (3096): No heartbeat from core client for 30 sec - exiting 19:15:31 (3096): No heartbeat from core client for 30 sec - exiting 19:15:32 (3096): No heartbeat from core client for 30 sec - exiting 19:15:33 (3096): No heartbeat from core client for 30 sec - exiting 19:15:34 (3096): No heartbeat from core client for 30 sec - exiting 19:15:35 (3096): No heartbeat from core client for 30 sec - exiting 19:15:36 (3096): No heartbeat from core client for 30 sec - exiting 19:15:37 (3096): No heartbeat from core client for 30 sec - exiting 19:15:38 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:15 (1484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:16 (1484): No heartbeat from core client for 30 sec - exiting 20:17:17 (1484): No heartbeat from core client for 30 sec - exiting 20:17:18 (1484): No heartbeat from core client for 30 sec - exiting 20:18:46 (3736): No heartbeat from core client for 30 sec - exiting 20:18:47 (3736): No heartbeat from core client for 30 sec - exiting 20:18:48 (3736): No heartbeat from core client for 30 sec - exiting 20:18:49 (3736): No heartbeat from core client for 30 sec - exiting 20:18:50 (3736): No heartbeat from core client for 30 sec - exiting 20:18:51 (3736): No heartbeat from core client for 30 sec - exiting 20:18:52 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4136, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10040, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8672, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5896, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3736, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4068, selfPID=4300, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3316, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4512, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... 21:59:45 (3824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:47 (3824): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3120, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:21:15 (1940): No heartbeat from core client for 30 sec - exiting 20:21:17 (1940): No heartbeat from core client for 30 sec - exiting 20:21:18 (1940): No heartbeat from core client for 30 sec - exiting 20:21:19 (1940): No heartbeat from core client for 30 sec - exiting 20:21:20 (1940): No heartbeat from core client for 30 sec - exiting 20:21:21 (1940): No heartbeat from core client for 30 sec - exiting 20:21:22 (1940): No heartbeat from core client for 30 sec - exiting 20:21:23 (1940): No heartbeat from core client for 30 sec - exiting 20:21:24 (1940): No heartbeat from core client for 30 sec - exiting 20:21:25 (1940): No heartbeat from core client for 30 sec - exiting 20:21:26 (1940): No heartbeat from core client for 30 sec - exiting 20:21:27 (1940): No heartbeat from core client for 30 sec - exiting 20:21:29 (1940): No heartbeat from core client for 30 sec - exiting 20:21:30 (1940): No heartbeat from core client for 30 sec - exiting 20:21:31 (1940): No heartbeat from core client for 30 sec - exiting 20:21:32 (1940): No heartbeat from core client for 30 sec - exiting 20:21:33 (1940): No heartbeat from core client for 30 sec - exiting 20:21:34 (1940): No heartbeat from core client for 30 sec - exiting 20:21:35 (1940): No heartbeat from core client for 30 sec - exiting 20:21:36 (1940): No heartbeat from core client for 30 sec - exiting 20:21:37 (1940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:56:37 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3896, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4820,17:49:54 (2416): No heartbeat from core client for 30 sec - exiting 17:49:55 (2416): No heartbeat from core client for 30 sec - exiting 17:49:56 (2416): No heartbeat from core client for 30 sec - exiting 17:49:57 (2416): No heartbeat from core client for 30 sec - exiting 17:49:58 (2416): No heartbeat from core client for 30 sec - exiting 17:49:59 (2416): No heartbeat from core client for 30 sec - exiting 17:50:00 (2416): No heartbeat from core client for 30 sec - exiting 17:50:01 (2416): No heartbeat from core client for 30 sec - exiting 17:50:02 (2416): No heartbeat from core client for 30 sec - exiting 17:50:04 (2416): No heartbeat from core client for 30 sec - exiting 17:50:05 (2416): No heartbeat from core client for 30 sec - exiting 17:50:06 (2416): No heartbeat from core client for 30 sec - exiting 17:50:07 (2416): No heartbeat from core client for 30 sec - exiting 17:50:08 (2416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:50:09 (2416): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3948, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5308, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3312, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 13:46:13 (3104): No heartbeat from core client for 30 sec - exiting 13:46:14 (3104): No heartbeat from core client for 30 sec - exiting 13:46:15 (3104): No heartbeat from core client for 30 sec - exiting 13:46:16 (3104): No heartbeat from core client for 30 sec - exiting 13:46:17 (3104): No heartbeat from core client for 30 sec - exiting 13:46:18 (3104): No heartbeat from core client for 30 sec - exiting 13:46:19 (3104): No heartbeat from core client for 30 sec - exiting 13:46:21 (3104): No heartbeat from core client for 30 sec - exiting 13:46:22 (3104): No heartbeat from core client for 30 sec - exiting 13:46:23 (3104): No heartbeat from core client for 30 sec - exiting 13:46:24 (3104): No heartbeat from core client for 30 sec - exiting 13:46:25 (3104): No heartbeat from core client for 30 sec - exiting 13:46:26 (3104): No heartbeat from core client for 30 sec - exiting 13:46:27 (3104): No heartbeat from core client for 30 sec - exiting 13:46:28 (3104): No heartbeat from core client for 30 sec - exiting 13:46:29 (3104): No heartbeat from core client for 30 sec - exiting 13:46:30 (3104): No heartbeat from core client for 30 sec - exiting 13:46:31 (3104): No heartbeat from core client for 30 sec - exiting 13:46:33 (3104): No heartbeat from core client for 30 sec - exiting 13:46:34 (3104): No heartbeat from core client for 30 sec - exiting 13:46:35 (3104): No heartbeat from core client for 30 sec - exiting 13:46:36 (3104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Nov 2012 21:02:00	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	138,336	342,163	2.4734
23 Nov 2012 20:38:37	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	126,816	313,201	2.4697
21 Nov 2012 17:09:42	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	115,296	286,570	2.4855
03 Nov 2012 21:08:19	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	103,776	259,171	2.4974
31 Oct 2012 21:54:09	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	92,256	229,532	2.4880
13 Oct 2012 16:49:03	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	80,736	200,424	2.4825
11 Oct 2012 20:17:07	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	69,216	172,907	2.4981
11 Oct 2012 11:36:17	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	57,696	145,655	2.5245
30 Sep 2012 21:02:43	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	46,176	116,928	2.5322
27 Sep 2012 21:13:21	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	34,656	87,927	2.5371
24 Sep 2012 13:36:04	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	23,136	58,212	2.5161
27 Aug 2012 12:52:18	1186953	15108361	hadam3p_saf_1oxk_1967_1_006988944_1	11,616	29,659	2.5533