Task 15511246

Name	hadam3p_pnw_dh3z_2044_1_008278539_2
Workunit	8429674
Created	25 Dec 2012, 15:37:24 UTC
Sent	25 Dec 2012, 16:31:50 UTC
Report deadline	7 Dec 2013, 21:51:50 UTC
Received	2 Jan 2013, 3:56:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1253823
Run time	5 days 12 hours 51 min 9 sec
CPU time	5 days 5 hours 49 min 53 sec
Validate state	Invalid
Credit	2,254.93
Device peak FLOPS	2.01 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> 02:35:19 (6480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:21 (6480): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4200, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4016, iMonCtr=2 Model crash detected, will try to restart... 17:19:50 (3120): No heartbeat from core client for 30 sec - exiting 17:19:51 (3120): No heartbeat from core client for 30 sec - exiting 17:19:52 (3120): No heartbeat from core client for 30 sec - exiting 17:19:53 (3120): No heartbeat from core client for 30 sec - exiting 17:19:55 (3120): No heartbeat from core client for 30 sec - exiting 17:19:56 (3120): No heartbeat from core client for 30 sec - exiting 17:19:57 (3120): No heartbeat from core client for 30 sec - exiting 17:19:58 (3120): No heartbeat from core client for 30 sec - exiting 17:19:59 (3120): No heartbeat from core client for 30 sec - exiting 17:20:00 (3120): No heartbeat from core client for 30 sec - exiting 17:20:01 (3120): No heartbeat from core client for 30 sec - exiting 17:20:02 (3120): No heartbeat from core client for 30 sec - exiting 17:20:03 (3120): No heartbeat from core client for 30 sec - exiting 17:20:04 (3120): No heartbeat from core client for 30 sec - exiting 17:20:05 (3120): No heartbeat from core client for 30 sec - exiting 17:20:07 (3120): No heartbeat from core client for 30 sec - exiting 17:20:08 (3120): No heartbeat from core client for 30 sec - exiting 17:20:09 (3120): No heartbeat from core client for 30 sec - exiting 17:20:10 (3120): No heartbeat from core client for 30 sec - exiting 17:20:11 (3120): No heartbeat from core client for 30 sec - exiting 17:20:12 (3120): No heartbeat from core client for 30 sec - exiting 17:20:13 (3120): No heartbeat from core client for 30 sec - exiting 17:20:14 (3120): No heartbeat from core client for 30 sec - exiting 17:20:15 (3120): No heartbeat from core client for 30 sec - exiting 17:20:16 (3120): No heartbeat from core client for 30 sec - exiting 17:20:17 (3120): No heartbeat from core client for 30 sec - exiting 17:20:19 (3120): No heartbeat from core client for 30 sec - exiting 17:20:20 (3120): No heartbeat from core client for 30 sec - exiting 17:20:21 (3120): No heartbeat from core client for 30 sec - exiting 17:20:22 (3120): No heartbeat from core client for 30 sec - exiting 17:20:23 (3120): No heartbeat from core client for 30 sec - exiting 17:20:24 (3120): No heartbeat from core client for 30 sec - exiting 17:20:25 (3120): No heartbeat from core client for 30 sec - exiting 17:20:26 (3120): No heartbeat from core client for 30 sec - exiting 17:20:27 (3120): No heartbeat from core client for 30 sec - exiting 17:20:28 (3120): No heartbeat from core client for 30 sec - exiting 17:20:29 (3120): No heartbeat from core client for 30 sec - exiting 17:20:31 (3120): No heartbeat from core client for 30 sec - exiting 17:20:32 (3120): No heartbeat from core client for 30 sec - exiting 17:20:33 (3120): No heartbeat from core client for 30 sec - exiting 17:20:34 (3120): No heartbeat from core client for 30 sec - exiting 17:20:35 (3120): No heartbeat from core client for 30 sec - exiting 17:20:36 (3120): No heartbeat from core client for 30 sec - exiting 17:20:37 (3120): No heartbeat from core client for 30 sec - exiting 17:20:38 (3120): No heartbeat from core client for 30 sec - exiting 17:20:39 (3120): No heartbeat from core client for 30 sec - exiting 17:20:40 (3120): No heartbeat from core client for 30 sec - exiting 17:20:42 (3120): No heartbeat from core client for 30 sec - exiting 17:20:43 (3120): No heartbeat from core client for 30 sec - exiting 17:20:44 (3120): No heartbeat from core client for 30 sec - exiting 17:20:45 (3120): No heartbeat from core client for 30 sec - exiting 17:20:46 (3120): No heartbeat from core client for 30 sec - exiting 17:20:47 (3120): No heartbeat from core client for 30 sec - exiting 17:20:48 (3120): No heartbeat from core client for 30 sec - exiting 17:20:49 (3120): No heartbeat from core client for 30 sec - exiting 17:20:50 (3120): No heartbeat from core client for 30 sec - exiting 17:20:51 (3120): No heartbeat from core client for 30 sec - exiting 17:20:52 (3120): No heartbeat from core client for 30 sec - exiting 17:20:54 (3120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:55 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:02 (5444): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5264, selfPID=5264, iMonCtr=2 20:28:57 (5308): No heartbeat from core client for 30 sec - exiting 20:29:00 (5308): No heartbeat from core client for 30 sec - exiting 20:29:04 (5308): No heartbeat from core client for 30 sec - exiting 20:29:07 (5308): No heartbeat from core client for 30 sec - exiting 20:29:08 (5308): No heartbeat from core client for 30 sec - exiting 20:29:40 (5308): No heartbeat from core client for 30 sec - exiting 20:29:44 (5308): No heartbeat from core client for 30 sec - exiting 20:29:49 (5308): No heartbeat from core client for 30 sec - exiting 20:29:52 (5308): No heartbeat from core client for 30 sec - exiting 20:29:54 (5308): No heartbeat from core client for 30 sec - exiting 20:29:59 (5308): No heartbeat from core client for 30 sec - exiting 20:30:01 (5308): No heartbeat from core client for 30 sec - exiting 20:30:32 (5308): No heartbeat from core client for 30 sec - exiting 20:30:34 (5308): No heartbeat from core client for 30 sec - exiting 20:30:35 (5308): No heartbeat from core client for 30 sec - exiting 20:30:37 (5308): No heartbeat from core client for 30 sec - exiting 20:30:40 (5308): No heartbeat from core client for 30 sec - exiting 20:30:42 (5308): No heartbeat from core client for 30 sec - exiting 20:30:44 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:48 (5308): No heartbeat from core client for 30 sec - exiting 20:30:52 (5308): No heartbeat from core client for 30 sec - exiting 20:30:56 (5308): No heartbeat from core client for 30 sec - exiting 20:30:59 (5308): No heartbeat from core client for 30 sec - exiting 20:36:24 (1140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:25 (1140): No heartbeat from core client for 30 sec - exiting 20:36:28 (1140): No heartbeat from core client for 30 sec - exiting 23:00:46 (1440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:48 (1440): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4596, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 17:53:33 (4908): No heartbeat from core client for 30 sec - exiting 17:53:34 (4908): No heartbeat from core client for 30 sec - exiting 17:53:35 (4908): No heartbeat from core client for 30 sec - exiting 17:53:37 (4908): No heartbeat from core client for 30 sec - exiting 17:53:38 (4908): No heartbeat from core client for 30 sec - exiting 17:53:39 (4908): No heartbeat from core client for 30 sec - exiting 17:53:40 (4908): No heartbeat from core client for 30 sec - exiting 17:53:41 (4908): No heartbeat from core client for 30 sec - exiting 17:53:42 (4908): No heartbeat from core client for 30 sec - exiting 17:53:43 (4908): No heartbeat from core client for 30 sec - exiting 17:53:44 (4908): No heartbeat from core client for 30 sec - exiting 17:53:45 (4908): No heartbeat from core client for 30 sec - exiting 17:53:46 (4908): No heartbeat from core client for 30 sec - exiting 17:53:47 (4908): No heartbeat from core client for 30 sec - exiting 17:53:49 (4908): No heartbeat from core client for 30 sec - exiting 17:53:50 (4908): No heartbeat from core client for 30 sec - exiting 17:53:51 (4908): No heartbeat from core client for 30 sec - exiting 17:53:52 (4908): No heartbeat from core client for 30 sec - exiting 17:53:53 (4908): No heartbeat from core client for 30 sec - exiting 17:53:54 (4908): No heartbeat from core client for 30 sec - exiting 17:53:55 (4908): No heartbeat from core client for 30 sec - exiting 17:53:56 (4908): No heartbeat from core client for 30 sec - exiting 17:53:57 (4908): No heartbeat from core client for 30 sec - exiting 17:53:58 (4908): No heartbeat from core client for 30 sec - exiting 17:53:59 (4908): No heartbeat from core client for 30 sec - exiting 17:54:01 (4908): No heartbeat from core client for 30 sec - exiting 17:54:02 (4908): No heartbeat from core client for 30 sec - exiting 17:54:03 (4908): No heartbeat from core client for 30 sec - exiting 17:54:04 (4908): No heartbeat from core client for 30 sec - exiting 17:54:05 (4908): No heartbeat from core client for 30 sec - exiting 17:54:06 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:07:10 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:15:44 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:15:45 (3304): No heartbeat from core client for 30 sec - exiting 22:21:46 (7116): No heartbeat from core client for 30 sec - exiting 22:21:47 (7116): No heartbeat from core client for 30 sec - exiting 22:21:50 (7116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:59 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R2:29:00 (3312): No heartbeat from core client for 30 sec - exiting egional Worker:: C22:34:44 (4536): No heartbeat from core client for 30 sec - exiting 22:34:45 (4536): No heartbeat from core client for 30 sec - exiting 22:34:48 (4536): No heartbeat from core client for 30 sec - exiting 22:34:50 (4536): No heartbeat from core client for 30 sec - exiting 22:34:52 (4536): No heartbeat from core client for 30 sec - exiting 22:34:55 (4536): No heartbeat from core client for 30 sec - exiting 22:34:57 (4536): No heartbeat from core client for 30 sec - exiting 22:35:00 (4536): No heartbeat from core client for 30 sec - exiting 22:35:33 (4536): No heartbeat from core client for 30 sec - exiting 22:35:36 (4536): No heartbeat from core client for 30 sec - exiting 22:35:39 (4536): No heartbeat from core client for 30 sec - exiting 22:35:40 (4536): No heartbeat from core client for 30 sec - exiting 22:35:41 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:06:31 (6584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:42 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:44 (5192): No heartbeat from core client for 30 sec - exiting 2e:11:47 (5192): No heartbeat from core client for 30 sec - exiting 23:20:34 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:20:37 (7036): No heartbeat from core client for 30 sec - exiting 23:20:40 (7036): No heartbeat from core client for 30 sec - exiting 23:20:43 (7036): No heartbeat from core client for 30 sec - exiting 23:20:46 (7036): No heartbeat from core client for 30 sec - exiting 23:32:30 (4884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:32:33 (4884): No heartbeat from core client for 30 sec - exiting 23:32:36 (4884): No heartbeat from core client for 30 sec - exiting 23:41:09 (5128): No heartbeat from core client for 30 sec - exiting 23:41:12 (5128): No heartbeat from core client for 30 sec - exiting 23:41:14 (5128): No heartbeat from core client for 30 sec - exiting 23:41:16 (5128): No heartbeat from core client for 30 sec - exiting 23:41:18 (5128): No heartbeat from core client for 30 sec - exiting 23:41:21 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:46:44 (6348): No heartbeat from core client for 30 sec - exiting 23:46:48 (6348): No heartbeat from core client for 30 sec - exiting 23:46:51 (6348): No heartbeat from core client for 30 sec - exiting 23:46:54 (6348): No heartbeat from core client for 30 sec - exiting 23:46:57 (6348): No heartbeat from core client for 30 sec - exiting 23:47:00 (6348): No heartbeat from core client for 30 sec - exiting 23:47:03 (6348): No heartbeat from core client for 30 sec - exiting 23:47:07 (6348): No heartbeat from core client for 30 sec - exiting 23:47:10 (6348): No heartbeat from core client for 30 sec - exiting 23:47:13 (6348): No heartbeat from core client for 30 sec - exiting 23:47:16 (6348): No heartbeat from core client for 30 sec - exiting 23:47:19 (6348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:06:56 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:06:58 (6976): No heartbeat from core client for 30 sec - exiting R0:07:00 (6976): No heartbeat from core client for 30 sec - exiting 00:13:51 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:09 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:12 (6568): No heartbeat from core client for 30 sec - exiting R0:15:14 (6568): No heartbeat from core client for 30 sec - exiting 00:19:00 (2116): No heartbeat from core client for 30 sec - exiting 00:19:02 (2116): No heartbeat from core client for 30 sec - exiting 00:19:33 (2116): No heartbeat from core client for 30 sec - exiting 00:19:34 (2116): No heartbeat from core client for 30 sec - exiting 00:19:35 (2116): No heartbeat from core client for 30 sec - exiting 00:19:37 (2116): No heartbeat from core client for 30 sec - exiting 00:19:39 (2116): No heartbeat from core client for 30 sec - exiting 00:19:40 (2116): No heartbeat from core client for 30 sec - exiting 00:19:41 (2116): No heartbeat from core client for 30 sec - exiting 00:19:42 (2116): No heartbeat from core client for 30 sec - exiting 00:19:43 (2116): No heartbeat from core client for 30 sec - exiting 00:19:45 (2116): No heartbeat from core client for 30 sec - exiting 00:19:46 (2116): No heartbeat from core client for 30 sec - exiting 00:19:47 (2116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:19:49 (2116): No heartbeat from core client for 30 sec - exiting 00:19:50 (2116): No heartbeat from core client for 30 sec - exiting 00:31:45 (5664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:31:47 (5664): No heartbeat from core client for 30 sec - exiting 00:54:29 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:30 (5752): No heartbeat from core client for 30 sec - exiting 01:04:00 (6556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:03 (6556): No heartbeat from core client for 30 sec - exiting 01:04:06 (6556): No heartbeat from core client for 30 sec - exiting 01:07:02 (2800): No heartbeat from core client for 30 sec - exiting 01:07:05 (2800): No heartbeat from core client for 30 sec - exiting 01:07:07 (2800): No heartbeat from core client for 30 sec - exiting 01:07:09 (2800): No heartbeat from core client for 30 sec - exiting 01:07:12 (2800): No heartbeat from core client for 30 sec - exiting 01:07:13 (2800): No heartbeat from core client for 30 sec - exiting 01:07:15 (2800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:26 (3452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:29 (3452): No heartbeat from core client for 30 sec - exiting R1:28:31 (3452): No heartbeat from core client for 30 sec - exiting 01:31:47 (384): No heartbeat from core client for 30 sec - exiting 01:31:49 (384): No heartbeat from core client for 30 sec - exiting 01:31:52 (384): No heartbeat from core client for 30 sec - exiting 01:31:53 (384): No heartbeat from core client for 30 sec - exiting 01:31:55 (384): No heartbeat from core client for 30 sec - exiting 01:31:56 (384): No heartbeat from core client for 30 sec - exiting 01:31:58 (384): No heartbeat from core client for 30 sec - exiting 01:31:59 (384): No heartbeat from core client for 30 sec - exiting 01:32:00 (384): No heartbeat from core client for 30 sec - exiting 01:32:01 (384): No heartbeat from core client for 30 sec - exiting 01:32:02 (384): No heartbeat from core client for 30 sec - exiting 01:32:04 (384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:37 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:39 (3964): No heartbeat from core client for 30 sec - exiting 04:03:42 (3964): No heartbeat from core client for 30 sec - exiting 04:05:48 (2640): No heartbeat from core client for 30 sec - exiting 04:05:50 (2640): No heartbeat from core client for 30 sec - exiting 04:05:51 (2640): No heartbeat from core client for 30 sec - exiting 04:05:52 (2640): No heartbeat from core client for 30 sec - exiting 04:05:54 (2640): No heartbeat from core client for 30 sec - exiting 04:05:55 (2640): No heartbeat from core client for 30 sec - exiting 04:05:56 (2640): No heartbeat from core client for 30 sec - exiting 04:05:58 (2640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:20 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:22 (5708): No heartbeat from core client for 30 sec - exiting 04:26:24 (5708): No heartbeat from core client for 30 sec - exiting 04:32:01 (1296): No heartbeat from core client for 30 sec - exiting 04:32:03 (1296): No heartbeat from core client for 30 sec - exiting 04:32:05 (1296): No heartbeat from core client for 30 sec - exiting 04:32:07 (1296): No heartbeat from core client for 30 sec - exiting 04:32:09 (1296): No heartbeat from core client for 30 sec - exiting 04:32:11 (1296): No heartbeat from core client for 30 sec - exiting 04:32:13 (1296): No heartbeat from core client for 30 sec - exiting 04:32:15 (1296): No heartbeat from core client for 30 sec - exiting 04:32:18 (1296): No heartbeat from core client for 30 sec - exiting 04:32:50 (1296): No heartbeat from core client for 30 sec - exiting 04:32:52 (1296): No heartbeat from core client for 30 sec - exiting 04:32:54 (1296): No heartbeat from core client for 30 sec - exiting 04:32:56 (1296): No heartbeat from core client for 30 sec - exiting 04:32:58 (1296): No heartbeat from core client for 30 sec - exiting 04:33:00 (1296): No heartbeat from core client for 30 sec - exiting 04:33:02 (1296): No heartbeat from core client for 30 sec - exiting 04:33:04 (1296): No heartbeat from core client for 30 sec - exiting 04:33:06 (1296): No heartbeat from core client for 30 sec - exiting 04:33:08 (1296): No heartbeat from core client for 30 sec - exiting 04:33:10 (1296): No heartbeat from core client for 30 sec - exiting 04:33:13 (1296): No heartbeat from core client for 30 sec - exiting 04:33:15 (1296): No heartbeat from core client for 30 sec - exiting 04:33:17 (1296): No heartbeat from core client for 30 sec - exiting 04:33:19 (1296): No heartbeat from core client for 30 sec - exiting 04:33:21 (1296): No heartbeat from core client for 30 sec - exiting 04:33:23 (1296): No heartbeat from core client for 30 sec - exiting 04:33:25 (1296): No heartbeat from core client for 30 sec - exiting 04:33:27 (1296): No heartbeat from core client for 30 sec - exiting 04:33:29 (1296): No heartbeat from core client for 30 sec - exiting 04:33:31 (1296): No heartbeat from core client for 30 sec - exiting 04:33:33 (1296): No heartbeat from core client for 30 sec - exiting 04:33:34 (1296): No heartbeat from core client for 30 sec - exiting 04:33:36 (1296): No heartbeat from core client for 30 sec - exiting 04:33:38 (1296): No heartbeat from core client for 30 sec - exiting 04:33:40 (1296): No heartbeat from core client for 30 sec - exiting 04:33:41 (1296): No heartbeat from core client for 30 sec - exiting 04:33:43 (1296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:33:45 (1296): No heartbeat from core client for 30 sec - exiting 04:33:47 (1296): No heartbeat from core client for 30 sec - exiting 04:33:49 (1296): No heartbeat from core client for 30 sec - exiting 04:33:52 (1296): No heartbeat from core client for 30 sec - exiting 04:35:45 (6152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:35:47 (6152): No heartbeat from core client for 30 sec - exiting 04:38:45 (4340): No heartbeat from core client for 30 sec - exiting 04:38:46 (4340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:49:07 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:49:08 (6920): No heartbeat from core client for 30 sec - exiting 04:49:11 (6920): No heartbeat from core client for 30 sec - exiting 04:57:27 (3832): No heartbeat from core client for 30 sec - exiting 04:57:29 (3832): No heartbeat from core client for 30 sec - exiting 04:58:00 (3832): No heartbeat from core client for 30 sec - exiting 04:58:01 (3832): No heartbeat from core client for 30 sec - exiting 04:58:04 (3832): No heartbeat from core client for 30 sec - exiting 04:58:06 (3832): No heartbeat from core client for 30 sec - exiting 04:58:09 (3832): No heartbeat from core client for 30 sec - exiting 04:58:12 (3832): No heartbeat from core client for 30 sec - exiting 04:58:14 (3832): No heartbeat from core client for 30 sec - exiting 04:58:17 (3832): No heartbeat from core client for 30 sec - exiting 04:58:20 (3832): No heartbeat from core client for 30 sec - exiting 04:58:23 (3832): No heartbeat from core client for 30 sec - exiting 04:58:25 (3832): No heartbeat from core client for 30 sec - exiting 04:58:28 (3832): No heartbeat from core client for 30 sec - exiting 04:58:30 (3832): No heartbeat from core client for 30 sec - exiting 04:58:33 (3832): No heartbeat from core client for 30 sec - exiting 04:58:36 (3832): No heartbeat from core client for 30 sec - exiting 04:58:39 (3832): No heartbeat from core client for 30 sec - exiting 04:58:42 (3832): No heartbeat from core client for 30 sec - exiting 04:58:44 (3832): No heartbeat from core client for 30 sec - exiting 04:58:47 (3832): No heartbeat from core client for 30 sec - exiting 04:58:50 (3832): No heartbeat from core client for 30 sec - exiting 04:58:53 (3832): No heartbeat from core client for 30 sec - exiting 04:58:56 (3832): No heartbeat from core client for 30 sec - exiting 04:58:59 (3832): No heartbeat from core client for 30 sec - exiting 04:59:01 (3832): No heartbeat from core client for 30 sec - exiting 04:59:04 (3832): No heartbeat from core client for 30 sec - exiting 04:59:07 (3832): No heartbeat from core client for 30 sec - exiting 04:59:09 (3832): No heartbeat from core client for 30 sec - exiting 04:59:12 (3832): No heartbeat from core client for 30 sec - exiting 04:59:14 (3832): No heartbeat from core client for 30 sec - exiting 04:59:16 (3832): No heartbeat from core client for 30 sec - exiting 04:59:19 (3832): No heartbeat from core client for 30 sec - exiting 04:59:21 (3832): No heartbeat from core client for 30 sec - exiting 04:59:24 (3832): No heartbeat from core client for 30 sec - exiting 04:59:27 (3832): No heartbeat from core client for 30 sec - exiting 04:59:29 (3832): No heartbeat from core client for 30 sec - exiting 04:59:32 (3832): No heartbeat from core client for 30 sec - exiting 04:59:35 (3832): No heartbeat from core client for 30 sec - exiting 04:59:37 (3832): No heartbeat from core client for 30 sec - exiting 04:59:40 (3832): No heartbeat from core client for 30 sec - exiting 04:59:43 (3832): No heartbeat from core client for 30 sec - exiting 04:59:45 (3832): No heartbeat from core client for 30 sec - exiting 04:59:48 (3832): No heartbeat from core client for 30 sec - exiting 04:59:50 (3832): No heartbeat from core client for 30 sec - exiting 04:59:53 (3832): No heartbeat from core client for 30 sec - exiting 04:59:56 (3832): No heartbeat from core client for 30 sec - exiting 04:59:58 (3832): No heartbeat from core client for 30 sec - exiting 05:00:01 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:06:44 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:06:47 (5668): No heartbeat from core client for 30 sec - exiting 02:06:49 (5668): No heartbeat from core client for 30 sec - exiting 03:10:20 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:22 (3712): No heartbeat from core client for 30 sec - exiting 03:10:24 (3712): No heartbeat from core client for 30 sec - exiting 03:10:27 (3712): No heartbeat from core client for 30 sec - exiting 03:35:27 (2704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:35:29 (2704): No heartbeat from core client for 30 sec - exiting 03:56:34 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:37 (2580): No heartbeat from core client for 30 sec - exiting 04:19:58 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:20:03 (4880): No heartbeat from core client for 30 sec - exiting 04:20:05 (4880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:31:47 (7440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:48 (7440): No heartbeat from core client for 30 sec - exiting R9:31:50 (7440): No heartbeat from core client for 30 sec - exiting 09:36:24 (9004): No heartbeat from core client for 30 sec - exiting 09:36:27 (9004): No heartbeat from core client for 30 sec - exiting 09:36:30 (9004): No heartbeat from core client for 30 sec - exiting 09:36:32 (9004): No heartbeat from core client for 30 sec - exiting 09:36:36 (9004): No heartbeat from core client for 30 sec - exiting 09:36:38 (9004): No heartbeat from core client for 30 sec - exiting 09:36:41 (9004): No heartbeat from core client for 30 sec - exiting 09:37:13 (9004): No heartbeat from core client for 30 sec - exiting 09:37:15 (9004): No heartbeat from core client for 30 sec - exiting 09:37:17 (9004): No heartbeat from core client for 30 sec - exiting 09:37:22 (9004): No heartbeat from core client for 30 sec - exiting 09:37:24 (9004): No heartbeat from core client for 30 sec - exiting 09:37:27 (9004): No heartbeat from core client for 30 sec - exiting 09:37:29 (9004): No heartbeat from core client for 30 sec - exiting 09:37:33 (9004): No heartbeat from core client for 30 sec - exiting 09:37:35 (9004): No heartbeat from core client for 30 sec - exiting 09:37:38 (9004): No heartbeat from core client for 30 sec - exiting 09:37:40 (9004): No heartbeat from core client for 30 sec - exiting 09:37:43 (9004): No heartbeat from core client for 30 sec - exiting 09:37:45 (9004): No heartbeat from core client for 30 sec - exiting 09:37:47 (9004): No heartbeat from core client for 30 sec - exiting 09:38:19 (9004): No heartbeat from core client for 30 sec - exiting 09:38:21 (9004): No heartbeat from core client for 30 sec - exiting 09:38:23 (9004): No heartbeat from core client for 30 sec - exiting 09:38:26 (9004): No heartbeat from core client for 30 sec - exiting 09:38:28 (9004): No heartbeat from core client for 30 sec - exiting 09:38:30 (9004): No heartbeat from core client for 30 sec - exiting 09:38:32 (9004): No heartbeat from core client for 30 sec - exiting 09:38:34 (9004): No heartbeat from core client for 30 sec - exiting 09:38:36 (9004): No heartbeat from core client for 30 sec - exiting 09:38:39 (9004): No heartbeat from core client for 30 sec - exiting 09:38:42 (9004): No heartbeat from core client for 30 sec - exiting 09:38:44 (9004): No heartbeat from core client for 30 sec - exiting 09:38:47 (9004): No heartbeat from core client for 30 sec - exiting 09:38:49 (9004): No heartbeat from core client for 30 sec - exiting 09:38:51 (9004): No heartbeat from core client for 30 sec - exiting 09:38:53 (9004): No heartbeat from core client for 30 sec - exiting 09:38:56 (9004): No heartbeat from core client for 30 sec - exiting 09:38:59 (9004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:24:51 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:24:52 (3916): No heartbeat from core client for 30 sec - exiting 10:24:54 (3916): No heartbeat from core client for 30 sec - exiting 10:30:35 (8056): No heartbeat from core client for 30 sec - exiting 10:30:36 (8056): No heartbeat from core client for 30 sec - exiting 10:31:08 (8056): No heartbeat from core client for 30 sec - exiting 10:31:11 (8056): No heartbeat from core client for 30 sec - exiting 10:31:14 (8056): No heartbeat from core client for 30 sec - exiting 10:31:17 (8056): No heartbeat from core client for 30 sec - exiting 10:31:19 (8056): No heartbeat from core client for 30 sec - exiting 10:31:21 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:01 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:02 (5544): No heartbeat from core client for 30 sec - exiting 10:43:56 (7252): No heartbeat from core client for 30 sec - exiting 10:43:58 (7252): No heartbeat from core client for 30 sec - exiting 10:44:00 (7252): No heartbeat from core client for 30 sec - exiting 10:44:01 (7252): No heartbeat from core client for 30 sec - exiting 10:44:03 (7252): No heartbeat from core client for 30 sec - exiting 10:44:05 (7252): No heartbeat from core client for 30 sec - exiting 10:44:07 (7252): No heartbeat from core client for 30 sec - exiting 10:44:08 (7252): No heartbeat from core client for 30 sec - exiting 10:44:09 (7252): No heartbeat from core client for 30 sec - exiting 10:44:10 (7252): No heartbeat from core client for 30 sec - exiting 10:44:41 (7252): No heartbeat from core client for 30 sec - exiting 10:44:43 (7252): No heartbeat from core client for 30 sec - exiting 10:44:45 (7252): No heartbeat from core client for 30 sec - exiting 10:44:46 (7252): No heartbeat from core client for 30 sec - exiting 10:44:47 (7252): No heartbeat from core client for 30 sec - exiting 10:44:48 (7252): No heartbeat from core client for 30 sec - exiting 10:44:50 (7252): No heartbeat from core client for 30 sec - exiting 10:44:51 (7252): No heartbeat from core client for 30 sec - exiting 10:44:53 (7252): No heartbeat from core client for 30 sec - exiting 10:44:56 (7252): No heartbeat from core client for 30 sec - exiting 10:44:58 (7252): No heartbeat from core client for 30 sec - exiting 10:44:59 (7252): No heartbeat from core client for 30 sec - exiting 10:45:01 (7252): No heartbeat from core client for 30 sec - exiting 10:45:02 (7252): No heartbeat from core client for 30 sec - exiting 10:45:04 (7252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:41 (8236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7232, selfPID=7232, iMonCtr=2 10:57:35 (3116): No heartbeat from core client for 30 sec - exiting 10:57:36 (3116): No heartbeat from core client for 30 sec - exiting 10:57:37 (3116): No heartbeat from core client for 30 sec - exiting 10:57:39 (3116): No heartbeat from core client for 30 sec - exiting 10:57:40 (3116): No heartbeat from core client for 30 sec - exiting 10:57:42 (3116): No heartbeat from core client for 30 sec - exiting 10:57:44 (3116): No heartbeat from core client for 30 sec - exiting 10:57:46 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:48 (3116): No heartbeat from core client for 30 sec - exiting 10:57:50 (3116): No heartbeat from core client for 30 sec - exiting 10:57:52 (3116): No heartbeat from core client for 30 sec - exiting 10:57:54 (3116): No heartbeat from core client for 30 sec - exiting 10:57:56 (3116): No heartbeat from core client for 30 sec - exiting 10:57:58 (3116): No heartbeat from core client for 30 sec - exiting 10:58:00 (3116): No heartbeat from core client for 30 sec - exiting 10:58:01 (3116): No heartbeat from core client for 30 sec - exiting 10:58:03 (3116): No heartbeat from core client for 30 sec - exiting 10:58:05 (3116): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_dh3z_2044_1_008278539_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_dh3z_2044_1_008278539_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_dh3z_2044_1_008278539_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Jan 2013 23:22:53	1253823	15511246	hadam3p_pnw_dh3z_2044_1_008278539_2	103,776	442,469	4.2637
01 Jan 2013 07:56:12	1253823	15511246	hadam3p_pnw_dh3z_2044_1_008278539_2	92,256	395,389	4.2858
31 Dec 2012 14:00:35	1253823	15511246	hadam3p_pnw_dh3z_2044_1_008278539_2	80,736	349,477	4.3286
30 Dec 2012 04:13:18	1253823	15511246	hadam3p_pnw_dh3z_2044_1_008278539_2	69,216	299,574	4.3281
29 Dec 2012 13:46:43	1253823	15511246	hadam3p_pnw_dh3z_2044_1_008278539_2	57,696	249,948	4.3322
28 Dec 2012 22:22:44	1253823	15511246	hadam3p_pnw_dh3z_2044_1_008278539_2	46,176	198,827	4.3059
28 Dec 2012 09:44:42	1253823	15511246	hadam3p_pnw_dh3z_2044_1_008278539_2	34,656	147,242	4.2487
27 Dec 2012 16:46:10	1253823	15511246	hadam3p_pnw_dh3z_2044_1_008278539_2	23,136	96,678	4.1787
27 Dec 2012 02:02:57	1253823	15511246	hadam3p_pnw_dh3z_2044_1_008278539_2	11,616	46,540	4.0065