Task 13665908

Name	hadam3p_saf_248v_1990_1_007037591_2
Workunit	7240907
Created	28 Nov 2011, 18:45:15 UTC
Sent	28 Nov 2011, 18:45:21 UTC
Report deadline	10 Nov 2012, 0:05:21 UTC
Received	20 Dec 2011, 11:38:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1179400
Run time	3 days 12 hours 59 min 31 sec
CPU time	3 days 6 hours 49 min 50 sec
Validate state	Invalid
Credit	1,683.45
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> Fonction incorrecte. (0x1) - exit code 1 (0x1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 09:25:14 (6156): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:25:16 (6156): No heartbeat from core client for 30 sec - exiting 09:25:17 (6156): No heartbeat from core client for 30 sec - exiting 09:25:18 (6156): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:16:04 (7636): No heartbeat from core client for 30 sec - exiting 08:16:05 (7636): No heartbeat from core client for 30 sec - exiting 08:16:06 (7636): No heartbeat from core client for 30 sec - exiting 08:16:07 (7636): No heartbeat from core client for 30 sec - exiting 08:16:08 (7636): No heartbeat from core client for 30 sec - exiting 08:16:09 (7636): No heartbeat from core client for 30 sec - exiting 08:16:10 (7636): No heartbeat from core client for 30 sec - exiting 08:16:11 (7636): No heartbeat from core client for 30 sec - exiting 08:16:12 (7636): No heartbeat from core client for 30 sec - exiting 08:16:13 (7636): No heartbeat from core client for 30 sec - exiting 08:16:14 (7636): No heartbeat from core client for 30 sec - exiting 08:16:15 (7636): No heartbeat from core client for 30 sec - exiting 08:16:17 (7636): No heartbeat from core client for 30 sec - exiting 08:16:18 (7636): No heartbeat from core client for 30 sec - exiting 08:16:19 (7636): No heartbeat from core client for 30 sec - exiting 08:16:20 (7636): No heartbeat from core client for 30 sec - exiting 08:16:21 (7636): No heartbeat from core client for 30 sec - exiting 08:16:22 (7636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:30:32 (8148): No heartbeat from core client for 30 sec - exiting 16:30:33 (8148): No heartbeat from core client for 30 sec - exiting 16:30:34 (8148): No heartbeat from core client for 30 sec - exiting 16:30:35 (8148): No heartbeat from core client for 30 sec - exiting 16:30:36 (8148): No heartbeat from core client for 30 sec - exiting 16:30:37 (8148): No heartbeat from core client for 30 sec - exiting 16:30:38 (8148): No heartbeat from core client for 30 sec - exiting 16:30:39 (8148): No heartbeat from core client for 30 sec - exiting 16:30:40 (8148): No heartbeat from core client for 30 sec - exiting 16:30:41 (8148): No heartbeat from core client for 30 sec - exiting 16:30:42 (8148): No heartbeat from core client for 30 sec - exiting 16:30:43 (8148): No heartbeat from core client for 30 sec - exiting 16:30:44 (8148): No heartbeat from core client for 30 sec - exiting 16:30:45 (8148): No heartbeat from core client for 30 sec - exiting 16:30:46 (8148): No heartbeat from core client for 30 sec - exiting 16:30:47 (8148): No heartbeat from core client for 30 sec - exiting 16:30:48 (8148): No heartbeat from core client for 30 sec - exiting 16:30:49 (8148): No heartbeat from core client for 30 sec - exiting 16:30:51 (8148): No heartbeat from core client for 30 sec - exiting 16:30:52 (8148): No heartbeat from core client for 30 sec - exiting 16:30:53 (8148): No heartbeat from core client for 30 sec - exiting 16:30:54 (8148): No heartbeat from core client for 30 sec - exiting 16:30:55 (8148): No heartbeat from core client for 30 sec - exiting 16:30:56 (8148): No heartbeat from core client for 30 sec - exiting 16:30:57 (8148): No heartbeat from core client for 30 sec - exiting 16:30:58 (8148): No heartbeat from core client for 30 sec - exiting 16:30:59 (8148): No heartbeat from core client for 30 sec - exiting 16:31:00 (8148): No heartbeat from core client for 30 sec - exiting 16:31:01 (8148): No heartbeat from core client for 30 sec - exiting 16:31:02 (8148): No heartbeat from core client for 30 sec - exiting 16:31:03 (8148): No heartbeat from core client for 30 sec - exiting 16:31:04 (8148): No heartbeat from core client for 30 sec - exiting 16:31:05 (8148): No heartbeat from core client for 30 sec - exiting 16:31:06 (8148): No heartbeat from core client for 30 sec - exiting 16:31:07 (8148): No heartbeat from core client for 30 sec - exiting 16:31:08 (8148): No heartbeat from core client for 30 sec - exiting 16:31:09 (8148): No heartbeat from core client for 30 sec - exiting 16:31:10 (8148): No heartbeat from core client for 30 sec - exiting 16:31:11 (8148): No heartbeat from core client for 30 sec - exiting 16:31:12 (8148): No heartbeat from core client for 30 sec - exiting 16:31:13 (8148): No heartbeat from core client for 30 sec - exiting 16:31:14 (8148): No heartbeat from core client for 30 sec - exiting 16:31:15 (8148): No heartbeat from core client for 30 sec - exiting 16:31:16 (8148): No heartbeat from core client for 30 sec - exiting 16:31:17 (8148): No heartbeat from core client for 30 sec - exiting 16:31:18 (8148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:33:00 (3816): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:33:01 (3816): No heartbeat from core client for 30 sec - exiting 17:33:02 (3816): No heartbeat from core client for 30 sec - exiting 17:33:03 (3816): No heartbeat from core client for 30 sec - exiting 17:33:04 (3816): No heartbeat from core client for 30 sec - exiting 17:33:05 (3816): No heartbeat from core client for 30 sec - exiting 17:33:06 (3816): No heartbeat from core client for 30 sec - exiting 17:33:07 (3816): No heartbeat from core client for 30 sec - exiting 17:33:08 (3816): No heartbeat from core client for 30 sec - exiting 17:33:09 (3816): No heartbeat from core client for 30 sec - exiting 17:33:10 (3816): No heartbeat from core client for 30 sec - exiting 17:33:11 (3816): No heartbeat from core client for 30 sec - exiting 17:33:12 (3816): No heartbeat from core client for 30 sec - exiting 17:33:13 (3816): No heartbeat from core client for 30 sec - exiting 17:33:14 (3816): No heartbeat from core client for 30 sec - exiting 17:33:15 (3816): No heartbeat from core client for 30 sec - exiting 17:33:16 (3816): No heartbeat from core client for 30 sec - exiting 17:33:17 (3816): No heartbeat from core client for 30 sec - exiting 17:33:18 (3816): No heartbeat from core client for 30 sec - exiting 17:33:19 (3816): No heartbeat from core client for 30 sec - exiting 17:33:20 (3816): No heartbeat from core client for 30 sec - exiting 11:14:44 (6048): No heartbeat from core client for 30 sec - exiting 11:14:45 (6048): No heartbeat from core client for 30 sec - exiting 11:14:46 (6048): No heartbeat from core client for 30 sec - exiting 11:14:47 (6048): No heartbeat from core client for 30 sec - exiting 11:14:48 (6048): No heartbeat from core client for 30 sec - exiting 11:14:49 (6048): No heartbeat from core client for 30 sec - exiting 11:14:50 (6048): No heartbeat from core client for 30 sec - exiting 11:14:51 (6048): No heartbeat from core client for 30 sec - exiting 11:14:52 (6048): No heartbeat from core client for 30 sec - exiting 11:14:53 (6048): No heartbeat from core client for 30 sec - exiting 11:14:54 (6048): No heartbeat from core client for 30 sec - exiting 11:14:55 (6048): No heartbeat from core client for 30 sec - exiting 11:14:56 (6048): No heartbeat from core client for 30 sec - exiting 11:14:57 (6048): No heartbeat from core client for 30 sec - exiting 11:14:58 (6048): No heartbeat from core client for 30 sec - exiting 11:14:59 (6048): No heartbeat from core client for 30 sec - exiting 11:15:00 (6048): No heartbeat from core client for 30 sec - exiting 11:15:01 (6048): No heartbeat from core client for 30 sec - exiting 11:15:02 (6048): No heartbeat from core client for 30 sec - exiting 11:15:03 (6048): No heartbeat from core client for 30 sec - exiting 11:15:04 (6048): No heartbeat from core client for 30 sec - exiting 11:15:05 (6048): No heartbeat from core client for 30 sec - exiting 11:15:06 (6048): No heartbeat from core client for 30 sec - exiting 11:15:07 (6048): No heartbeat from core client for 30 sec - exiting 11:15:08 (6048): No heartbeat from core client for 30 sec - exiting 11:15:09 (6048): No heartbeat from core client for 30 sec - exiting 11:15:10 (6048): No heartbeat from core client for 30 sec - exiting 11:15:11 (6048): No heartbeat from core client for 30 sec - exiting 11:15:12 (6048): No heartbeat from core client for 30 sec - exiting 11:15:13 (6048): No heartbeat from core client for 30 sec - exiting 11:15:14 (6048): No heartbeat from core client for 30 sec - exiting 11:15:15 (6048): No heartbeat from core client for 30 sec - exiting 11:15:16 (6048): No heartbeat from core client for 30 sec - exiting 11:15:17 (6048): No heartbeat from core client for 30 sec - exiting 11:15:18 (6048): No heartbeat from core client for 30 sec - exiting 11:15:19 (6048): No heartbeat from core client for 30 sec - exiting 11:15:20 (6048): No heartbeat from core client for 30 sec - exiting 11:15:21 (6048): No heartbeat from core client for 30 sec - exiting 11:15:22 (6048): No heartbeat from core client for 30 sec - exiting 11:15:23 (6048): No heartbeat from core client for 30 sec - exiting 11:15:24 (6048): No heartbeat from core client for 30 sec - exiting 11:15:25 (6048): No heartbeat from core client for 30 sec - exiting 11:15:26 (6048): No heartbeat from core client for 30 sec - exiting 11:15:27 (6048): No heartbeat from core client for 30 sec - exiting 11:15:28 (6048): No heartbeat from core client for 30 sec - exiting 11:15:29 (6048): No heartbeat from core client for 30 sec - exiting 11:15:30 (6048): No heartbeat from core client for 30 sec - exiting 11:15:31 (6048): No heartbeat from core client for 30 sec - exiting 11:15:32 (6048): No heartbeat from core client for 30 sec - exiting 11:15:33 (6048): No heartbeat from core client for 30 sec - exiting 11:15:34 (6048): No heartbeat from core client for 30 sec - exiting 11:15:35 (6048): No heartbeat from core client for 30 sec - exiting 11:15:36 (6048): No heartbeat from core client for 30 sec - exiting 11:15:37 (6048): No heartbeat from core client for 30 sec - exiting 11:15:38 (6048): No heartbeat from core client for 30 sec - exiting 11:15:39 (6048): No heartbeat from core client for 30 sec - exiting 11:15:40 (6048): No heartbeat from core client for 30 sec - exiting 11:15:41 (6048): No heartbeat from core client for 30 sec - exiting 11:15:42 (6048): No heartbeat from core client for 30 sec - exiting 11:15:43 (6048): No heartbeat from core client for 30 sec - exiting 11:15:44 (6048): No heartbeat from core client for 30 sec - exiting 11:15:45 (6048): No heartbeat from core client for 30 sec - exiting 11:15:46 (6048): No heartbeat from core client for 30 sec - exiting 11:15:47 (6048): No heartbeat from core client for 30 sec - exiting 11:15:48 (6048): No heartbeat from core client for 30 sec - exiting 11:15:49 (6048): No heartbeat from core client for 30 sec - exiting 11:15:50 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:13:04 (8600): No heartbeat from core client for 30 sec - exiting 07:13:05 (8600): No heartbeat from core client for 30 sec - exiting 07:13:06 (8600): No heartbeat from core client for 30 sec - exiting 07:13:07 (8600): No heartbeat from core client for 30 sec - exiting 07:13:08 (8600): No heartbeat from core client for 30 sec - exiting 07:13:09 (8600): No heartbeat from core client for 30 sec - exiting 07:13:10 (8600): No heartbeat from core client for 30 sec - exiting 07:13:11 (8600): No heartbeat from core client for 30 sec - exiting 07:13:12 (8600): No heartbeat from core client for 30 sec - exiting 07:13:13 (8600): No heartbeat from core client for 30 sec - exiting 07:13:14 (8600): No heartbeat from core client for 30 sec - exiting 07:13:15 (8600): No heartbeat from core client for 30 sec - exiting 07:13:16 (8600): No heartbeat from core client for 30 sec - exiting 07:13:17 (8600): No heartbeat from core client for 30 sec - exiting 07:13:18 (8600): No heartbeat from core client for 30 sec - exiting 07:13:19 (8600): No heartbeat from core client for 30 sec - exiting 07:13:20 (8600): No heartbeat from core client for 30 sec - exiting 07:13:21 (8600): No heartbeat from core client for 30 sec - exiting 07:13:22 (8600): No heartbeat from core client for 30 sec - exiting 07:13:23 (8600): No heartbeat from core client for 30 sec - exiting 07:13:24 (8600): No heartbeat from core client for 30 sec - exiting 07:13:25 (8600): No heartbeat from core client for 30 sec - exiting 07:13:26 (8600): No heartbeat from core client for 30 sec - exiting 07:13:27 (8600): No heartbeat from core client for 30 sec - exiting 07:13:28 (8600): No heartbeat from core client for 30 sec - exiting 07:13:29 (8600): No heartbeat from core client for 30 sec - exiting 07:13:30 (8600): No heartbeat from core client for 30 sec - exiting 07:13:31 (8600): No heartbeat from core client for 30 sec - exiting 07:13:32 (8600): No heartbeat from core client for 30 sec - exiting 07:13:33 (8600): No heartbeat from core client for 30 sec - exiting 07:13:34 (8600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9964, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6148, selfPID=9084, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 07:03:51 (6328): No heartbeat from core client for 30 sec - exiting 07:03:52 (6328): No heartbeat from core client for 30 sec - exiting 07:03:53 (6328): No heartbeat from core client for 30 sec - exiting 07:03:55 (6328): No heartbeat from core client for 30 sec - exiting 07:03:56 (6328): No heartbeat from core client for 30 sec - exiting 07:03:57 (6328): No heartbeat from core client for 30 sec - exiting 07:03:58 (6328): No heartbeat from core client for 30 sec - exiting 07:03:59 (6328): No heartbeat from core client for 30 sec - exiting 07:04:00 (6328): No heartbeat from core client for 30 sec - exiting 07:04:01 (6328): No heartbeat from core client for 30 sec - exiting 07:04:02 (6328): No heartbeat from core client for 30 sec - exiting 07:04:03 (6328): No heartbeat from core client for 30 sec - exiting 07:04:04 (6328): No heartbeat from core client for 30 sec - exiting 07:04:05 (6328): No heartbeat from core client for 30 sec - exiting 07:04:06 (6328): No heartbeat from core client for 30 sec - exiting 07:04:07 (6328): No heartbeat from core client for 30 sec - exiting 07:04:08 (6328): No heartbeat from core client for 30 sec - exiting 07:04:09 (6328): No heartbeat from core client for 30 sec - exiting 07:04:10 (6328): No heartbeat from core client for 30 sec - exiting 07:04:11 (6328): No heartbeat from core client for 30 sec - exiting 07:04:12 (6328): No heartbeat from core client for 30 sec - exiting 07:04:13 (6328): No heartbeat from core client for 30 sec - exiting 07:04:14 (6328): No heartbeat from core client for 30 sec - exiting 07:04:15 (6328): No heartbeat from core client for 30 sec - exiting 07:04:16 (6328): No heartbeat from core client for 30 sec - exiting 07:04:17 (6328): No heartbeat from core client for 30 sec - exiting 07:04:18 (6328): No heartbeat from core client for 30 sec - exiting 07:04:19 (6328): No heartbeat from core client for 30 sec - exiting 07:04:20 (6328): No heartbeat from core client for 30 sec - exiting 07:04:21 (6328): No heartbeat from core client for 30 sec - exiting 07:04:22 (6328): No heartbeat from core client for 30 sec - exiting 07:04:23 (6328): No heartbeat from core client for 30 sec - exiting 07:04:24 (6328): No heartbeat from core client for 30 sec - exiting 07:04:25 (6328): No heartbeat from core client for 30 sec - exiting 07:04:26 (6328): No heartbeat from core client for 30 sec - exiting 07:04:27 (6328): No heartbeat from core client for 30 sec - exiting 07:04:28 (6328): No heartbeat from core client for 30 sec - exiting 07:04:29 (6328): No heartbeat from core client for 30 sec - exiting 07:04:30 (6328): No heartbeat from core client for 30 sec - exiting 07:04:31 (6328): No heartbeat from core client for 30 sec - exiting 07:04:32 (6328): No heartbeat from core client for 30 sec - exiting 07:04:33 (6328): No heartbeat from core client for 30 sec - exiting 07:04:34 (6328): No heartbeat from core client for 30 sec - exiting 07:04:35 (6328): No heartbeat from core client for 30 sec - exiting 07:04:36 (6328): No heartbeat from core client for 30 sec - exiting 07:04:37 (6328): No heartbeat from core client for 30 sec - exiting 07:04:38 (6328): No heartbeat from core client for 30 sec - exiting 07:04:39 (6328): No heartbeat from core client for 30 sec - exiting 07:04:40 (6328): No heartbeat from core client for 30 sec - exiting 07:04:41 (6328): No heartbeat from core client for 30 sec - exiting 07:04:42 (6328): No heartbeat from core client for 30 sec - exiting 07:04:43 (6328): No heartbeat from core client for 30 sec - exiting 07:04:44 (6328): No heartbeat from core client for 30 sec - exiting 07:04:45 (6328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:08:04 (8600): No heartbeat from core client for 30 sec - exiting 07:08:05 (8600): No heartbeat from core client for 30 sec - exiting 07:08:06 (8600): No heartbeat from core client for 30 sec - exiting 07:08:07 (8600): No heartbeat from core client for 30 sec - exiting 07:08:08 (8600): No heartbeat from core client for 30 sec - exiting 07:08:09 (8600): No heartbeat from core client for 30 sec - exiting 07:08:10 (8600): No heartbeat from core client for 30 sec - exiting 07:08:11 (8600): No heartbeat from core client for 30 sec - exiting 07:08:12 (8600): No heartbeat from core client for 30 sec - exiting 07:08:13 (8600): No heartbeat from core client for 30 sec - exiting 07:08:14 (8600): No heartbeat from core client for 30 sec - exiting 07:08:15 (8600): No heartbeat from core client for 30 sec - exiting 07:08:16 (8600): No heartbeat from core client for 30 sec - exiting 07:08:17 (8600): No heartbeat from core client for 30 sec - exiting 07:08:18 (8600): No heartbeat from core client for 30 sec - exiting 07:08:19 (8600): No heartbeat from core client for 30 sec - exiting 07:08:20 (8600): No heartbeat from core client for 30 sec - exiting 07:08:21 (8600): No heartbeat from core client for 30 sec - exiting 07:08:22 (8600): No heartbeat from core client for 30 sec - exiting 07:08:23 (8600): No heartbeat from core client for 30 sec - exiting 07:08:24 (8600): No heartbeat from core client for 30 sec - exiting 07:08:25 (8600): No heartbeat from core client for 30 sec - exiting 07:08:26 (8600): No heartbeat from core client for 30 sec - exiting 07:08:27 (8600): No heartbeat from core client for 30 sec - exiting 07:08:28 (8600): No heartbeat from core client for 30 sec - exiting 07:08:29 (8600): No heartbeat from core client for 30 sec - exiting 07:08:30 (8600): No heartbeat from core client for 30 sec - exiting 07:08:31 (8600): No heartbeat from core client for 30 sec - exiting 07:08:32 (8600): No heartbeat from core client for 30 sec - exiting 07:08:33 (8600): No heartbeat from core client for 30 sec - exiting 07:08:34 (8600): No heartbeat from core client for 30 sec - exiting 07:08:35 (8600): No heartbeat from core client for 30 sec - exiting 07:08:36 (8600): No heartbeat from core client for 30 sec - exiting 07:08:37 (8600): No heartbeat from core client for 30 sec - exiting 07:08:38 (8600): No heartbeat from core client for 30 sec - exiting 07:08:39 (8600): No heartbeat from core client for 30 sec - exiting 07:08:40 (8600): No heartbeat from core client for 30 sec - exiting 07:08:41 (8600): No heartbeat from core client for 30 sec - exiting 07:08:42 (8600): No heartbeat from core client for 30 sec - exiting 07:08:43 (8600): No heartbeat from core client for 30 sec - exiting 07:08:44 (8600): No heartbeat from core client for 30 sec - exiting 07:08:45 (8600): No heartbeat from core client for 30 sec - exiting 07:08:46 (8600): No heartbeat from core client for 30 sec - exiting 07:10:34 (8600): No heartbeat from core client for 30 sec - exiting 07:10:35 (8600): No heartbeat from core client for 30 sec - exiting 07:10:36 (8600): No heartbeat from core client for 30 sec - exiting 07:10:37 (8600): No heartbeat from core client for 30 sec - exiting 07:10:38 (8600): No heartbeat from core client for 30 sec - exiting 07:10:39 (8600): No heartbeat from core client for 30 sec - exiting 07:10:40 (8600): No heartbeat from core client for 30 sec - exiting 07:10:41 (8600): No heartbeat from core client for 30 sec - exiting 07:10:42 (8600): No heartbeat from core client for 30 sec - exiting 07:10:43 (8600): No heartbeat from core client for 30 sec - exiting 07:10:44 (8600): No heartbeat from core client for 30 sec - exiting 07:10:45 (8600): No heartbeat from core client for 30 sec - exiting 07:10:46 (8600): No heartbeat from core client for 30 sec - exiting 07:10:47 (8600): No heartbeat from core client for 30 sec - exiting 07:10:48 (8600): No heartbeat from core client for 30 sec - exiting 07:10:49 (8600): No heartbeat from core client for 30 sec - exiting 07:10:50 (8600): No heartbeat from core client for 30 sec - exiting 07:10:51 (8600): No heartbeat from core client for 30 sec - exiting 07:10:52 (8600): No heartbeat from core client for 30 sec - exiting 07:10:53 (8600): No heartbeat from core client for 30 sec - exiting 07:10:54 (8600): No heartbeat from core client for 30 sec - exiting 07:10:55 (8600): No heartbeat from core client for 30 sec - exiting 07:10:56 (8600): No heartbeat from core client for 30 sec - exiting 07:10:57 (8600): No heartbeat from core client for 30 sec - exiting 07:10:58 (8600): No heartbeat from core client for 30 sec - exiting 07:10:59 (8600): No heartbeat from core client for 30 sec - exiting 07:11:00 (8600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:12:25 (7520): No heartbeat from core client for 30 sec - exiting 07:12:26 (7520): No heartbeat from core client for 30 sec - exiting 07:12:27 (7520): No heartbeat from core client for 30 sec - exiting 07:12:28 (7520): No heartbeat from core client for 30 sec - exiting 07:12:30 (7520): No heartbeat from core client for 30 sec - exiting 07:12:31 (7520): No heartbeat from core client for 30 sec - exiting 07:12:32 (7520): No heartbeat from core client for 30 sec - exiting 07:12:33 (7520): No heartbeat from core client for 30 sec - exiting 07:12:34 (7520): No heartbeat from core client for 30 sec - exiting 07:12:35 (7520): No heartbeat from core client for 30 sec - exiting 07:12:36 (7520): No heartbeat from core client for 30 sec - exiting 07:12:37 (7520): No heartbeat from core client for 30 sec - exiting 07:12:38 (7520): No heartbeat from core client for 30 sec - exiting 07:12:39 (7520): No heartbeat from core client for 30 sec - exiting 07:12:40 (7520): No heartbeat from core client for 30 sec - exiting 07:12:42 (7520): No heartbeat from core client for 30 sec - exiting 07:12:43 (7520): No heartbeat from core client for 30 sec - exiting 07:12:44 (7520): No heartbeat from core client for 30 sec - exiting 07:12:45 (7520): No heartbeat from core client for 30 sec - exiting 07:12:46 (7520): No heartbeat from core client for 30 sec - exiting 07:12:47 (7520): No heartbeat from core client for 30 sec - exiting 07:12:48 (7520): No heartbeat from core client for 30 sec - exiting 07:12:49 (7520): No heartbeat from core client for 30 sec - exiting 07:12:50 (7520): No heartbeat from core client for 30 sec - exiting 07:12:51 (7520): No heartbeat from core client for 30 sec - exiting 07:12:52 (7520): No heartbeat from core client for 30 sec - exiting 07:12:53 (7520): No heartbeat from core client for 30 sec - exiting 07:12:54 (7520): No heartbeat from core client for 30 sec - exiting 07:12:55 (7520): No heartbeat from core client for 30 sec - exiting 07:12:56 (7520): No heartbeat from core client for 30 sec - exiting 07:12:57 (7520): No heartbeat from core client for 30 sec - exiting 07:12:58 (7520): No heartbeat from core client for 30 sec - exiting 07:12:59 (7520): No heartbeat from core client for 30 sec - exiting 07:13:00 (7520): No heartbeat from core client for 30 sec - exiting 07:13:02 (7520): No heartbeat from core client for 30 sec - exiting 07:13:03 (7520): No heartbeat from core client for 30 sec - exiting 07:13:04 (7520): No heartbeat from core client for 30 sec - exiting 07:13:05 (7520): No heartbeat from core client for 30 sec - exiting 07:13:06 (7520): No heartbeat from core client for 30 sec - exiting 07:13:07 (7520): No heartbeat from core client for 30 sec - exiting 07:13:08 (7520): No heartbeat from core client for 30 sec - exiting 07:13:09 (7520): No heartbeat from core client for 30 sec - exiting 07:13:10 (7520): No heartbeat from core client for 30 sec - exiting 07:13:11 (7520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7028, iMonCtr=2 18:09:53 (6984): No heartbeat from core client for 30 sec - exiting 18:09:54 (6984): No heartbeat from core client for 30 sec - exiting 18:09:55 (6984): No heartbeat from core client for 30 sec - exiting 18:09:56 (6984): No heartbeat from core client for 30 sec - exiting 18:09:58 (6984): No heartbeat from core client for 30 sec - exiting 18:09:58 (6984): No heartbeat from core client for 30 sec - exiting 18:09:59 (6984): No heartbeat from core client for 30 sec - exiting 18:10:00 (6984): No heartbeat from core client for 30 sec - exiting 18:10:01 (6984): No heartbeat from core client for 30 sec - exiting 18:10:02 (6984): No heartbeat from core client for 30 sec - exiting 18:10:04 (6984): No heartbeat from core client for 30 sec - exiting 18:10:05 (6984): No heartbeat from core client for 30 sec - exiting 18:10:06 (6984): No heartbeat from core client for 30 sec - exiting 18:10:07 (6984): No heartbeat from core client for 30 sec - exiting 18:10:08 (6984): No heartbeat from core client for 30 sec - exiting 18:10:09 (6984): No heartbeat from core client for 30 sec - exiting 18:10:10 (6984): No heartbeat from core client for 30 sec - exiting 18:10:11 (6984): No heartbeat from core client for 30 sec - exiting 18:10:12 (6984): No heartbeat from core client for 30 sec - exiting 18:10:13 (6984): No heartbeat from core client for 30 sec - exiting 18:10:14 (6984): No heartbeat from core client for 30 sec - exiting 18:10:15 (6984): No heartbeat from core client for 30 sec - exiting 18:10:16 (6984): No heartbeat from core client for 30 sec - exiting 18:10:17 (6984): No heartbeat from core client for 30 sec - exiting 18:10:18 (6984): No heartbeat from core client for 30 sec - exiting 18:10:19 (6984): No heartbeat from core client for 30 sec - exiting 18:10:20 (6984): No heartbeat from core client for 30 sec - exiting 18:10:21 (6984): No heartbeat from core client for 30 sec - exiting 18:10:22 (6984): No heartbeat from core client for 30 sec - exiting 18:10:23 (6984): No heartbeat from core client for 30 sec - exiting 18:10:24 (6984): No heartbeat from core client for 30 sec - exiting 18:10:25 (6984): No heartbeat from core client for 30 sec - exiting 18:10:26 (6984): No heartbeat from core client for 30 sec - exiting 18:10:27 (6984): No heartbeat from core client for 30 sec - exiting 18:10:28 (6984): No heartbeat from core client for 30 sec - exiting 18:10:29 (6984): No heartbeat from core client for 30 sec - exiting 18:10:30 (6984): No heartbeat from core client for 30 sec - exiting 18:10:31 (6984): No heartbeat from core client for 30 sec - exiting 18:10:32 (6984): No heartbeat from core client for 30 sec - exiting 18:10:33 (6984): No heartbeat from core client for 30 sec - exiting 18:10:34 (6984): No heartbeat from core client for 30 sec - exiting 18:10:35 (6984): No heartbeat from core client for 30 sec - exiting 18:10:36 (6984): No heartbeat from core client for 30 sec - exiting 18:10:37 (6984): No heartbeat from core client for 30 sec - exiting 18:10:38 (6984): No heartbeat from core client for 30 sec - exiting 18:10:39 (6984): No heartbeat from core client for 30 sec - exiting 18:10:40 (6984): No heartbeat from core client for 30 sec - exiting 18:10:41 (6984): No heartbeat from core client for 30 sec - exiting 18:10:42 (6984): No heartbeat from core client for 30 sec - exiting 18:10:43 (6984): No heartbeat from core client for 30 sec - exiting 18:10:44 (6984): No heartbeat from core client for 30 sec - exiting 18:10:45 (6984): No heartbeat from core client for 30 sec - exiting 18:10:46 (6984): No heartbeat from core client for 30 sec - exiting 18:10:47 (6984): No heartbeat from core client for 30 sec - exiting 18:10:48 (6984): No heartbeat from core client for 30 sec - exiting 18:10:49 (6984): No heartbeat from core client for 30 sec - exiting 18:10:50 (6984): No heartbeat from core client for 30 sec - exiting 18:10:51 (6984): No heartbeat from core client for 30 sec - exiting 18:10:52 (6984): No heartbeat from core client for 30 sec - exiting 18:10:53 (6984): No heartbeat from core client for 30 sec - exiting 18:10:54 (6984): No heartbeat from core client for 30 sec - exiting 18:10:55 (6984): No heartbeat from core client for 30 sec - exiting 18:10:56 (6984): No heartbeat from core client for 30 sec - exiting 18:10:57 (6984): No heartbeat from core client for 30 sec - exiting 18:10:58 (6984): No heartbeat from core client for 30 sec - exiting 18:10:59 (6984): No heartbeat from core client for 30 sec - exiting 18:11:00 (6984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8552, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7824, selfPID=4440, iMonCtr=1 Model crash detected, will try to restart... 07:25:28 (7032): No heartbeat from core client for 30 sec - exiting 07:25:29 (7032): No heartbeat from core client for 30 sec - exiting 07:25:30 (7032): No heartbeat from core client for 30 sec - exiting 07:25:31 (7032): No heartbeat from core client for 30 sec - exiting 07:25:32 (7032): No heartbeat from core client for 30 sec - exiting 07:25:33 (7032): No heartbeat from core client for 30 sec - exiting 07:25:34 (7032): No heartbeat from core client for 30 sec - exiting 07:25:35 (7032): No heartbeat from core client for 30 sec - exiting 07:25:37 (7032): No heartbeat from core client for 30 sec - exiting 07:25:38 (7032): No heartbeat from core client for 30 sec - exiting 07:25:39 (7032): No heartbeat from core client for 30 sec - exiting 07:25:40 (7032): No heartbeat from core client for 30 sec - exiting 07:25:41 (7032): No heartbeat from core client for 30 sec - exiting 07:25:42 (7032): No heartbeat from core client for 30 sec - exiting 07:25:43 (7032): No heartbeat from core client for 30 sec - exiting 07:25:44 (7032): No heartbeat from core client for 30 sec - exiting 07:25:45 (7032): No heartbeat from core client for 30 sec - exiting 07:25:46 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:13:39 (7424): No heartbeat from core client for 30 sec - exiting 07:13:40 (7424): No heartbeat from core client for 30 sec - exiting 07:13:41 (7424): No heartbeat from core client for 30 sec - exiting 07:13:42 (7424): No heartbeat from core client for 30 sec - exiting 07:13:43 (7424): No heartbeat from core client for 30 sec - exiting 07:13:44 (7424): No heartbeat from core client for 30 sec - exiting 07:13:45 (7424): No heartbeat from core client for 30 sec - exiting 07:13:46 (7424): No heartbeat from core client for 30 sec - exiting 07:13:47 (7424): No heartbeat from core client for 30 sec - exiting 07:13:48 (7424): No heartbeat from core client for 30 sec - exiting 07:13:49 (7424): No heartbeat from core client for 30 sec - exiting 07:13:50 (7424): No heartbeat from core client for 30 sec - exiting 07:13:51 (7424): No heartbeat from core client for 30 sec - exiting 07:13:52 (7424): No heartbeat from core client for 30 sec - exiting 07:13:54 (7424): No heartbeat from core client for 30 sec - exiting 07:13:55 (7424): No heartbeat from core client for 30 sec - exiting 07:13:56 (7424): No heartbeat from core client for 30 sec - exiting 07:13:57 (7424): No heartbeat from core client for 30 sec - exiting 07:13:58 (7424): No heartbeat from core client for 30 sec - exiting 07:13:59 (7424): No heartbeat from core client for 30 sec - exiting 07:14:00 (7424): No heartbeat from core client for 30 sec - exiting 07:14:01 (7424): No heartbeat from core client for 30 sec - exiting 07:14:02 (7424): No heartbeat from core client for 30 sec - exiting 07:14:03 (7424): No heartbeat from core client for 30 sec - exiting 07:14:04 (7424): No heartbeat from core client for 30 sec - exiting 07:14:06 (7424): No heartbeat from core client for 30 sec - exiting 07:14:07 (7424): No heartbeat from core client for 30 sec - exiting 07:14:08 (7424): No heartbeat from core client for 30 sec - exiting 07:14:09 (7424): No heartbeat from core client for 30 sec - exiting 07:14:10 (7424): No heartbeat from core client for 30 sec - exiting 07:14:11 (7424): No heartbeat from core client for 30 sec - exiting 07:14:12 (7424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:23:45 (7260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:54 (11032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7468, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8028, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 12:35:59 (8028): No heartbeat from core client for 30 sec - exiting 12:36:00 (8028): No heartbeat from core client for 30 sec - exiting 12:36:01 (8028): No heartbeat from core client for 30 sec - exiting 12:36:02 (8028): No heartbeat from core client for 30 sec - exiting 12:36:03 (8028): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Dec 2011 15:19:14	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	103,776	257,552	2.4818
18 Dec 2011 17:53:36	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	92,256	229,358	2.4861
15 Dec 2011 12:00:37	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	80,736	201,112	2.4910
14 Dec 2011 09:32:54	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	69,216	173,003	2.4995
13 Dec 2011 07:15:22	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	57,696	144,585	2.5060
12 Dec 2011 09:23:34	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	46,176	115,776	2.5073
07 Dec 2011 17:04:48	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	34,656	86,951	2.5090
04 Dec 2011 10:30:22	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	23,143	57,919	2.5027
03 Dec 2011 19:20:42	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	23,136	57,544	2.4872
02 Dec 2011 08:01:37	1179400	13665908	hadam3p_saf_248v_1990_1_007037591_2	11,616	28,847	2.4834