Task 12226854

Name	hadam3p_saf_1e9x_1980_1_006946333_0
Workunit	7149649
Created	22 Nov 2010, 16:16:51 UTC
Sent	9 Mar 2011, 10:15:37 UTC
Report deadline	19 Feb 2012, 15:35:37 UTC
Received	4 Dec 2011, 14:51:58 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	1073807364 (0x40010004) Unknown error code
Computer ID	1079170
Run time
CPU time	9 days 2 hours 15 min 57 sec
Validate state	Invalid
Credit	1,870.33
Device peak FLOPS	1.99 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>5.4.11</core_client_version> <message> - exit code 1073807364 (0x40010004) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3208, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2560, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:00:36 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:37 (3520): No heartbeat from core client for 30 sec - exiting 10:00:38 (3520): No heartbeat from core client for 30 sec - exiting 10:00:39 (3520): No heartbeat from core client for 30 sec - exiting 10:00:40 (3520): No heartbeat from core client for 30 sec - exiting 10:00:41 (3520): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2304, selfPID=2304, iMonCtr=2 10:00:42 (3520): No heartbeat from core client for 30 sec - exiting 10:00:43 (3520): No heartbeat from core client for 30 sec - exiting 10:00:44 (3520): No heartbeat from core client for 30 sec - exiting 10:00:45 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2716, selfPID=2716, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:43:57 (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:58 (2508): No heartbeat from core client for 30 sec - exiting 08:43:59 (2508): No heartbeat from core client for 30 sec - exiting 08:44:00 (2508): No heartbeat from core client for 30 sec - exiting 08:44:01 (2508): No heartbeat from core client for 30 sec - exiting 08:44:02 (2508): No heartbeat from core client for 30 sec - exiting 08:44:03 (2508): No heartbeat from core client for 30 sec - exiting 08:44:04 (2508): No heartbeat from core client for 30 sec - exiting 08:44:10 (2508): No heartbeat from core client for 30 sec - exiting 08:44:11 (2508): No heartbeat from core client for 30 sec - exiting 08:44:12 (2508): No heartbeat from core client for 30 sec - exiting 08:46:36 (3248): No heartbeat from core client for 30 sec - exiting 08:46:37 (3248): No heartbeat from core client for 30 sec - exiting 08:46:38 (3248): No heartbeat from core client for 30 sec - exiting 08:46:39 (3248): No heartbeat from core client for 30 sec - exiting 08:46:40 (3248): No heartbeat from core client for 30 sec - exiting 08:46:41 (3248): No heartbeat from core client for 30 sec - exiting 08:46:42 (3248): No heartbeat from core client for 30 sec - exiting 08:46:43 (3248): No heartbeat from core client for 30 sec - exiting 08:46:44 (3248): No heartbeat from core client for 30 sec - exiting 08:46:45 (3248): No heartbeat from core client for 30 sec - exiting 08:46:46 (3248): No heartbeat from core client for 30 sec - exiting 08:46:47 (3248): No heartbeat from core client for 30 sec - exiting 08:47:25 (3248): No heartbeat from core client for 30 sec - exiting 08:47:26 (3248): No heartbeat from core client for 30 sec - exiting 08:47:27 (3248): No heartbeat from core client for 30 sec - exiting 08:48:59 (3248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:51 (2132): No heartbeat from core client for 30 sec - exiting 08:55:04 (2132): No heartbeat from core client for 30 sec - exiting 08:55:05 (2132): No heartbeat from core client for 30 sec - exiting 08:55:06 (2132): No heartbeat from core client for 30 sec - exiting 08:55:07 (2132): No heartbeat from core client for 30 sec - exiting 08:55:08 (2132): No heartbeat from core client for 30 sec - exiting 08:55:09 (2132): No heartbeat from core client for 30 sec - exiting 08:55:10 (2132): No heartbeat from core client for 30 sec - exiting 08:55:11 (2132): No heartbeat from core client for 30 sec - exiting 08:55:12 (2132): No heartbeat from core client for 30 sec - exiting 08:55:13 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:58 (3956): No heartbeat from core client for 30 sec - exiting 08:57:59 (3956): No heartbeat from core client for 30 sec - exiting 08:58:00 (3956): No heartbeat from core client for 30 sec - exiting 08:58:01 (3956): No heartbeat from core client for 30 sec - exiting 08:58:02 (3956): No heartbeat from core client for 30 sec - exiting 08:59:21 (3956): No heartbeat from core client for 30 sec - exiting 08:59:22 (3956): No heartbeat from core client for 30 sec - exiting 08:59:23 (3956): No heartbeat from core client for 30 sec - exiting 08:59:24 (3956): No heartbeat from core client for 30 sec - exiting 08:59:25 (3956): No heartbeat from core client for 30 sec - exiting 08:59:26 (3956): No heartbeat from core client for 30 sec - exiting 08:59:27 (3956): No heartbeat from core client for 30 sec - exiting 08:59:28 (3956): No heartbeat from core client for 30 sec - exiting 08:59:29 (3956): No heartbeat from core client for 30 sec - exiting 08:59:30 (3956): No heartbeat from core client for 30 sec - exiting 08:59:31 (3956): No heartbeat from core client for 30 sec - exiting 08:59:32 (3956): No heartbeat from core client for 30 sec - exiting 08:59:33 (3956): No heartbeat from core client for 30 sec - exiting 08:59:34 (3956): No heartbeat from core client for 30 sec - exiting 09:00:48 (3956): No heartbeat from core client for 30 sec - exiting 09:00:49 (3956): No heartbeat from core client for 30 sec - exiting 09:00:50 (3956): No heartbeat from core client for 30 sec - exiting 09:00:51 (3956): No heartbeat from core client for 30 sec - exiting 09:00:52 (3956): No heartbeat from core client for 30 sec - exiting 09:00:53 (3956): No heartbeat from core client for 30 sec - exiting 09:00:54 (3956): No heartbeat from core client for 30 sec - exiting 09:00:55 (3956): No heartbeat from core client for 30 sec - exiting 09:00:56 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:57 (3956): No heartbeat from core client for 30 sec - exiting 09:01:03 (3956): No heartbeat from core client for 30 sec - exiting 09:04:28 (2712): No heartbeat from core client for 30 sec - exiting 09:04:29 (2712): No heartbeat from core client for 30 sec - exiting 09:04:30 (2712): No heartbeat from core client for 30 sec - exiting 09:04:31 (2712): No heartbeat from core client for 30 sec - exiting 09:04:32 (2712): No heartbeat from core client for 30 sec - exiting 09:04:38 (2712): No heartbeat from core client for 30 sec - exiting 09:04:39 (2712): No heartbeat from core client for 30 sec - exiting 09:04:40 (2712): No heartbeat from core client for 30 sec - exiting 09:04:42 (2712): No heartbeat from core client for 30 sec - exiting 09:05:50 (2712): No heartbeat from core client for 30 sec - exiting 09:05:51 (2712): No heartbeat from core client for 30 sec - exiting 09:05:52 (2712): No heartbeat from core client for 30 sec - exiting 09:05:53 (2712): No heartbeat from core client for 30 sec - exiting 09:05:54 (2712): No heartbeat from core client for 30 sec - exiting 09:05:55 (2712): No heartbeat from core client for 30 sec - exiting 09:05:56 (2712): No heartbeat from core client for 30 sec - exiting 09:05:57 (2712): No heartbeat from core client for 30 sec - exiting 09:05:58 (2712): No heartbeat from core client for 30 sec - exiting 09:05:59 (2712): No heartbeat from core client for 30 sec - exiting 09:06:00 (2712): No heartbeat from core client for 30 sec - exiting 09:06:01 (2712): No heartbeat from core client for 30 sec - exiting 09:06:02 (2712): No heartbeat from core client for 30 sec - exiting 09:06:03 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3340, selfPID=3340, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3384, selfPID=3384, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:34:21 (1040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:22 (1040): No heartbeat from core client for 30 sec - exiting 09:34:23 (1040): No heartbeat from core client for 30 sec - exiting 09:34:24 (1040): No heartbeat from core client for 30 sec - exiting 09:34:25 (1040): No heartbeat from core client for 30 sec - exiting 09:34:26 (1040): No heartbeat from core client for 30 sec - exiting 09:34:27 (1040): No heartbeat from core client for 30 sec - exiting 09:37:16 (3976): No heartbeat from core client for 30 sec - exiting 09:37:17 (3976): No heartbeat from core client for 30 sec - exiting 09:37:18 (3976): No heartbeat from core client for 30 sec - exiting 09:37:19 (3976): No heartbeat from core client for 30 sec - exiting 09:37:20 (3976): No heartbeat from core client for 30 sec - exiting 09:37:27 (3976): No heartbeat from core client for 30 sec - exiting 09:37:28 (3976): No heartbeat from core client for 30 sec - exiting 09:39:14 (3976): No heartbeat from core client for 30 sec - exiting 09:39:15 (3976): No heartbeat from core client for 30 sec - exiting 09:39:16 (3976): No heartbeat from core client for 30 sec - exiting 09:39:17 (3976): No heartbeat from core client for 30 sec - exiting 09:39:18 (3976): No heartbeat from core client for 30 sec - exiting 09:39:19 (3976): No heartbeat from core client for 30 sec - exiting 09:39:20 (3976): No heartbeat from core client for 30 sec - exiting 09:39:27 (3976): No heartbeat from core client for 30 sec - exiting 09:39:28 (3976): No heartbeat from core client for 30 sec - exiting 09:39:29 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:11 (3648): No heartbeat from core client for 30 sec - exiting 09:44:12 (3648): No heartbeat from core client for 30 sec - exiting 09:44:13 (3648): No heartbeat from core client for 30 sec - exiting 09:44:14 (3648): No heartbeat from core client for 30 sec - exiting 09:44:15 (3648): No heartbeat from core client for 30 sec - exiting 09:44:16 (3648): No heartbeat from core client for 30 sec - exiting 09:44:17 (3648): No heartbeat from core client for 30 sec - exiting 09:44:18 (3648): No heartbeat from core client for 30 sec - exiting 09:44:19 (3648): No heartbeat from core client for 30 sec - exiting 09:44:20 (3648): No heartbeat from core client for 30 sec - exiting 09:44:21 (3648): No heartbeat from core client for 30 sec - exiting 09:45:31 (3648): No heartbeat from core client for 30 sec - exiting 09:45:32 (3648): No heartbeat from core client for 30 sec - exiting 09:45:34 (3648): No heartbeat from core client for 30 sec - exiting 09:45:40 (3648): No heartbeat from core client for 30 sec - exiting 09:45:41 (3648): No heartbeat from core client for 30 sec - exiting 09:45:42 (3648): No heartbeat from core client for 30 sec - exiting 09:45:43 (3648): No heartbeat from core client for 30 sec - exiting 09:45:44 (3648): No heartbeat from core client for 30 sec - exiting 09:45:45 (3648): No heartbeat from core client for 30 sec - exiting 09:45:46 (3648): No heartbeat from core client for 30 sec - exiting 09:45:47 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:03 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:04 (3968): No heartbeat from core client for 30 sec - exiting 10:00:05 (3968): No heartbeat from core client for 30 sec - exiting 10:00:06 (3968): No heartbeat from core client for 30 sec - exiting 10:00:07 (3968): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2356, selfPID=2356, iMonCtr=2 10:02:56 (1484): No heartbeat from core client for 30 sec - exiting 10:02:57 (1484): No heartbeat from core client for 30 sec - exiting 10:04:00 (1484): No heartbeat from core client for 30 sec - exiting 10:04:01 (1484): No heartbeat from core client for 30 sec - exiting 10:04:02 (1484): No heartbeat from core client for 30 sec - exiting 10:04:03 (1484): No heartbeat from core client for 30 sec - exiting 10:04:04 (1484): No heartbeat from core client for 30 sec - exiting 10:04:05 (1484): No heartbeat from core client for 30 sec - exiting 10:04:06 (1484): No heartbeat from core client for 30 sec - exiting 10:04:07 (1484): No heartbeat from core client for 30 sec - exiting 10:04:08 (1484): No heartbeat from core client for 30 sec - exiting 10:04:09 (1484): No heartbeat from core client for 30 sec - exiting 10:04:10 (1484): No heartbeat from core client for 30 sec - exiting 10:04:11 (1484): No heartbeat from core client for 30 sec - exiting 10:04:12 (1484): No heartbeat from core client for 30 sec - exiting 10:04:13 (1484): No heartbeat from core client for 30 sec - exiting 10:05:53 (1484): No heartbeat from core client for 30 sec - exiting 10:05:54 (1484): No heartbeat from core client for 30 sec - exiting 10:05:55 (1484): No heartbeat from core client for 30 sec - exiting 10:05:56 (1484): No heartbeat from core client for 30 sec - exiting 10:05:57 (1484): No heartbeat from core client for 30 sec - exiting 10:05:58 (1484): No heartbeat from core client for 30 sec - exiting 10:06:30 (1484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:58 (4080): No heartbeat from core client for 30 sec - exiting 10:10:43 (4080): No heartbeat from core client for 30 sec - exiting 10:10:44 (4080): No heartbeat from core client for 30 sec - exiting 10:10:45 (4080): No heartbeat from core client for 30 sec - exiting 10:10:46 (4080): No heartbeat from core client for 30 sec - exiting 10:10:47 (4080): No heartbeat from core client for 30 sec - exiting 10:10:48 (4080): No heartbeat from core client for 30 sec - exiting 10:10:49 (4080): No heartbeat from core client for 30 sec - exiting 10:10:50 (4080): No heartbeat from core client for 30 sec - exiting 10:10:51 (4080): No heartbeat from core client for 30 sec - exiting 10:10:52 (4080): No heartbeat from core client for 30 sec - exiting 10:10:53 (4080): No heartbeat from core client for 30 sec - exiting 10:10:54 (4080): No heartbeat from core client for 30 sec - exiting 10:10:55 (4080): No heartbeat from core client for 30 sec - exiting 10:10:56 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:18 (1064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:19 (1064): No heartbeat from core client for 30 sec - exiting 10:18:20 (1064): No heartbeat from core client for 30 sec - exiting 10:18:21 (1064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2376, iMonCtr=2 Model crash detected, will try to restart... 09:04:18 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:25 (3256): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2548, selfPID=2548, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3016, selfPID=3016, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4080, selfPID=4080, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2756, selfPID=2756, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 11:09:27 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:28 (3456): No heartbeat from core client for 30 sec - exiting 11:09:32 (3456): No heartbeat from core client for 30 sec - exiting 11:09:33 (3456): No heartbeat from core client for 30 sec - exiting 11:09:34 (3456): No heartbeat from core client for 30 sec - exiting 11:09:35 (3456): No heartbeat from core client for 30 sec - exiting 11:09:36 (3456): No heartbeat from core client for 30 sec - exiting 11:09:37 (3456): No heartbeat from core client for 30 sec - exiting 11:09:39 (3456): No heartbeat from core client for 30 sec - exiting 11:09:41 (3456): No heartbeat from core client for 30 sec - exiting 11:09:42 (3456): No heartbeat from core client for 30 sec - exiting 11:09:43 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2668, selfPID=3124, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4408, selfPID=4408, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3968, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:48:19 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:20 (3916): No heartbeat from core client for 30 sec - exiting 15:48:21 (3916): No heartbeat from core client for 30 sec - exiting 15:48:22 (3916): No heartbeat from core client for 30 sec - exiting 15:48:23 (3916): No heartbeat from core client for 30 sec - exiting 15:48:24 (3916): No heartbeat from core client for 30 sec - exiting 15:48:26 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3804, iMonCtr=2 Mode l crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3832, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2908, selfPID=2908, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 08:21:39 (2364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1876, selfPID=1876, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3768, iMonCtr=2 Model crash detected, will try to restart... CG12:56:15 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:16 (3812): No heartbeat from core client for 30 sec - exiting 12:56:18 (3812): No heartbeat from core client for 30 sec - exiting 12:56:19 (3812): No heartbeat from core client for 30 sec - exiting 12:56:20 (3812): No heartbeat from core client for 30 sec - exiting 12:56:21 (3812): No heartbeat from core client for 30 sec - exiting 12:56:22 (3812): No heartbeat from core client for 30 sec - exiting 12:56:23 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:31:44 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:45 (3728): No heartbeat from core client for 30 sec - exiting 19:31:46 (3728): No heartbeat from core client for 30 sec - exiting 19:31:47 (3728): No heartbeat from core client for 30 sec - exiting 19:31:48 (3728): No heartbeat from core client for 30 sec - exiting 19:31:49 (3728): No heartbeat from core client for 30 sec - exiting 19:31:50 (3728): No heartbeat from core client for 30 sec - exiting 19:31:51 (3728): No heartbeat from core client for 30 sec - exiting 19:31:52 (3728): No heartbeat from core client for 30 sec - exiting 19:31:53 (3728): No heartbeat from core client for 30 sec - exiting 19:31:54 (3728): No heartbeat from core client for 30 sec - exiting 19:31:55 (3728): No heartbeat from core client for 30 sec - exiting 19:31:56 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2660, selfPID=2660, iMonCtr=2 GCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GCPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1900, selfPID=4084, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:34:49 (4076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3064, selfPID=3064, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3988, selfPID=3988, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1744, selfPID=1744, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3264, selfPID=2408, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2320, selfPID=2320, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1564, selfPID=1564, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3664, selfPID=3928, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Nov 2011 17:03:27	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	115,296	773,257	6.7067
15 Nov 2011 17:16:01	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	103,776	706,041	6.8035
15 Nov 2011 17:16:01	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	92,256	634,517	6.8778
15 Nov 2011 17:16:01	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	80,736	557,204	6.9016
20 Aug 2011 20:02:04	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	69,216	480,526	6.9424
07 Aug 2011 11:20:48	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	57,698	403,203	6.9882
05 Aug 2011 15:40:09	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	57,696	401,869	6.9653
25 Jul 2011 14:47:11	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	46,176	321,897	6.9711
12 Jun 2011 17:36:51	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	34,656	237,237	6.8455
10 May 2011 13:45:12	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	23,136	157,386	6.8026
01 Apr 2011 17:22:23	1079170	12226854	hadam3p_saf_1e9x_1980_1_006946333_0	11,616	81,501	7.0163