Task 16129153

Name	hadam3p_eu_j7to_1993_1_008501985_0
Workunit	8652798
Created	3 Dec 2013, 22:39:33 UTC
Sent	3 Dec 2013, 22:41:00 UTC
Report deadline	16 Nov 2014, 4:01:00 UTC
Received	9 Dec 2013, 17:38:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1230461
Run time	4 days 14 hours 35 min 44 sec
CPU time	3 days 11 hours 24 min 35 sec
Validate state	Invalid
Credit	1,589.83
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> 19:29:29 (7716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:05 (2676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:07 (2676): No heartbeat from core client for 30 sec - exiting 20:37:08 (2676): No heartbeat from core client for 30 sec - exiting 20:37:09 (2676): No heartbeat from core client for 30 sec - exiting 20:37:10 (2676): No heartbeat from core client for 30 sec - exiting 20:37:11 (2676): No heartbeat from core client for 30 sec - exiting 20:37:12 (2676): No heartbeat from core client for 30 sec - exiting 20:37:13 (2676): No heartbeat from core client for 30 sec - exiting 20:37:14 (2676): No heartbeat from core client for 30 sec - exiting 20:37:15 (2676): No heartbeat from core client for 30 sec - exiting 20:38:11 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:03:21 (2396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:16 (9308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:03 (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:17:23 (7580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:49:57 (22088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:37:02 (21500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:37:03 (21500): No heartbeat from core client for 30 sec - exiting 15:37:43 (14616): No heartbeat from core client for 30 sec - exiting 15:37:44 (14616): No heartbeat from core client for 30 sec - exiting 15:37:45 (14616): No heartbeat from core client for 30 sec - exiting 15:37:46 (14616): No heartbeat from core client for 30 sec - exiting 15:37:47 (14616): No heartbeat from core client for 30 sec - exiting 15:37:48 (14616): No heartbeat from core client for 30 sec - exiting 15:37:49 (14616): No heartbeat from core client for 30 sec - exiting 15:37:50 (14616): No heartbeat from core client for 30 sec - exiting 15:37:51 (14616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:07:52 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:45:16 (113404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:23:30 (11020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:22 (114288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:33 (114288): No heartbeat from core client for 30 sec - exiting 05:49:34 (114288): No heartbeat from core client for 30 sec - exiting 05:49:35 (114288): No heartbeat from core client for 30 sec - exiting 05:49:36 (114288): No heartbeat from core client for 30 sec - exiting 05:49:37 (114288): No heartbeat from core client for 30 sec - exiting 05:49:38 (114288): No heartbeat from core client for 30 sec - exiting 08:43:14 (113004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:33 (114144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=114000, selfPID=114000, iMonCtr=2 09:48:47 (112984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7588, selfPID=7588, iMonCtr=2 09:48:56 (112984): No heartbeat from core client for 30 sec - exiting 09:48:57 (112984): No heartbeat from core client for 30 sec - exiting 09:48:58 (112984): No heartbeat from core client for 30 sec - exiting 09:48:59 (112984): No heartbeat from core client for 30 sec - exiting 09:49:00 (112984): No heartbeat from core client for 30 sec - exiting 09:49:01 (112984): No heartbeat from core client for 30 sec - exiting 09:49:02 (112984): No heartbeat from core client for 30 sec - exiting 09:49:03 (112984): No heartbeat from core client for 30 sec - exiting 09:49:04 (112984): No heartbeat from core client for 30 sec - exiting 09:49:05 (112984): No heartbeat from core client for 30 sec - exiting 09:49:06 (112984): No heartbeat from core client for 30 sec - exiting 09:49:07 (112984): No heartbeat from core client for 30 sec - exiting 09:49:08 (112984): No heartbeat from core client for 30 sec - exiting 09:49:09 (112984): No heartbeat from core client for 30 sec - exiting 09:49:10 (112984): No heartbeat from core client for 30 sec - exiting 09:49:11 (112984): No heartbeat from core client for 30 sec - exiting 09:49:12 (112984): No heartbeat from core client for 30 sec - exiting 09:49:13 (112984): No heartbeat from core client for 30 sec - exiting 09:49:14 (112984): No heartbeat from core client for 30 sec - exiting 09:49:15 (112984): No heartbeat from core client for 30 sec - exiting 09:49:16 (112984): No heartbeat from core client for 30 sec - exiting 09:49:18 (112984): No heartbeat from core client for 30 sec - exiting 09:49:19 (112984): No heartbeat from core client for 30 sec - exiting 09:49:20 (112984): No heartbeat from core client for 30 sec - exiting 09:49:21 (112984): No heartbeat from core client for 30 sec - exiting 09:49:22 (112984): No heartbeat from core client for 30 sec - exiting 09:49:23 (112984): No heartbeat from core client for 30 sec - exiting 09:49:24 (112984): No heartbeat from core client for 30 sec - exiting 09:49:25 (112984): No heartbeat from core client for 30 sec - exiting 09:49:26 (112984): No heartbeat from core client for 30 sec - exiting 09:49:27 (112984): No heartbeat from core client for 30 sec - exiting 09:49:28 (112984): No heartbeat from core client for 30 sec - exiting 09:49:29 (112984): No heartbeat from core client for 30 sec - exiting 09:49:30 (112984): No heartbeat from core client for 30 sec - exiting 09:49:31 (112984): No heartbeat from core client for 30 sec - exiting 15:34:55 (114576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=111636, selfPID=111636, iMonCtr=2 15:35:03 (114576): No heartbeat from core client for 30 sec - exiting 15:35:04 (114576): No heartbeat from core client for 30 sec - exiting 15:35:05 (114576): No heartbeat from core client for 30 sec - exiting 15:35:06 (114576): No heartbeat from core client for 30 sec - exiting 15:35:07 (114576): No heartbeat from core client for 30 sec - exiting 15:35:08 (114576): No heartbeat from core client for 30 sec - exiting 15:35:09 (114576): No heartbeat from core client for 30 sec - exiting 15:35:10 (114576): No heartbeat from core client for 30 sec - exiting 15:35:11 (114576): No heartbeat from core client for 30 sec - exiting 16:34:40 (21060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:35:16 (21060): No heartbeat from core client for 30 sec - exiting 16:35:17 (21060): No heartbeat from core client for 30 sec - exiting 16:35:18 (21060): No heartbeat from core client for 30 sec - exiting 16:35:19 (21060): No heartbeat from core client for 30 sec - exiting 16:35:20 (21060): No heartbeat from core client for 30 sec - exiting 16:35:21 (21060): No heartbeat from core client for 30 sec - exiting 16:35:22 (21060): No heartbeat from core client for 30 sec - exiting 16:35:23 (21060): No heartbeat from core client for 30 sec - exiting 16:35:24 (21060): No heartbeat from core client for 30 sec - exiting 16:35:25 (21060): No heartbeat from core client for 30 sec - exiting Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_j7to_1993_1_008501985/dataout\j7toga.pej4feb 20:18:50 (113504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_j7to_1993_1_008501985/dataout\j7toga.pej4feb 23:51:28 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:50 (26288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:01 (26288): No heartbeat from core client for 30 sec - exiting 01:00:02 (26288): No heartbeat from core client for 30 sec - exiting 01:00:03 (26288): No heartbeat from core client for 30 sec - exiting 01:00:04 (26288): No heartbeat from core client for 30 sec - exiting 01:00:05 (26288): No heartbeat from core client for 30 sec - exiting 01:00:06 (26288): No heartbeat from core client for 30 sec - exiting 01:00:07 (26288): No heartbeat from core client for 30 sec - exiting 01:00:08 (26288): No heartbeat from core client for 30 sec - exiting 02:45:28 (113560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:54:14 (114544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:04 (116000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:07 (112932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:45 (14616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:08 (116300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=116032, selfPID=116032, iMonCtr=2 13:42:28 (10892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:02:59 (6664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:03:00 (6664): No heartbeat from core client for 30 sec - exiting 15:03:01 (6664): No heartbeat from core client for 30 sec - exiting 15:03:02 (6664): No heartbeat from core client for 30 sec - exiting 15:03:03 (6664): No heartbeat from core client for 30 sec - exiting 15:03:04 (6664): No heartbeat from core client for 30 sec - exiting 15:03:05 (6664): No heartbeat from core client for 30 sec - exiting 15:03:06 (6664): No heartbeat from core client for 30 sec - exiting 15:03:07 (6664): No heartbeat from core client for 30 sec - exiting 15:03:08 (6664): No heartbeat from core client for 30 sec - exiting 15:03:09 (6664): No heartbeat from core client for 30 sec - exiting 15:03:10 (6664): No heartbeat from core client for 30 sec - exiting 15:03:11 (6664): No heartbeat from core client for 30 sec - exiting 15:03:12 (6664): No heartbeat from core client for 30 sec - exiting 15:03:13 (6664): No heartbeat from core client for 30 sec - exiting 15:03:14 (6664): No heartbeat from core client for 30 sec - exiting 15:03:15 (6664): No heartbeat from core client for 30 sec - exiting 15:03:16 (6664): No heartbeat from core client for 30 sec - exiting 15:03:17 (6664): No heartbeat from core client for 30 sec - exiting 15:03:18 (6664): No heartbeat from core client for 30 sec - exiting 15:03:19 (6664): No heartbeat from core client for 30 sec - exiting 15:03:20 (6664): No heartbeat from core client for 30 sec - exiting 15:03:21 (6664): No heartbeat from core client for 30 sec - exiting 15:03:22 (6664): No heartbeat from core client for 30 sec - exiting 15:03:23 (6664): No heartbeat from core client for 30 sec - exiting 15:03:24 (6664): No heartbeat from core client for 30 sec - exiting 15:03:25 (6664): No heartbeat from core client for 30 sec - exiting 15:03:26 (6664): No heartbeat from core client for 30 sec - exiting 15:03:27 (6664): No heartbeat from core client for 30 sec - exiting 15:03:28 (6664): No heartbeat from core client for 30 sec - exiting 15:03:29 (6664): No heartbeat from core client for 30 sec - exiting 16:55:28 (115152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:12 (114480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:33 (7804): Can't acquire lockfile (32) - waiting 35s 19:51:14 (7804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:15 (7804): No heartbeat from core client for 30 sec - exiting 19:51:16 (7804): No heartbeat from core client for 30 sec - exiting 19:51:17 (7804): No heartbeat from core client for 30 sec - exiting 19:51:18 (7804): No heartbeat from core client for 30 sec - exiting 19:51:19 (7804): No heartbeat from core client for 30 sec - exiting 19:51:20 (7804): No heartbeat from core client for 30 sec - exiting 19:51:21 (7804): No heartbeat from core client for 30 sec - exiting 19:51:22 (7804): No heartbeat from core client for 30 sec - exiting 19:51:23 (7804): No heartbeat from core client for 30 sec - exiting 19:51:24 (7804): No heartbeat from core client for 30 sec - exiting 19:51:25 (7804): No heartbeat from core client for 30 sec - exiting 19:51:26 (7804): No heartbeat from core client for 30 sec - exiting 19:51:27 (7804): No heartbeat from core client for 30 sec - exiting 19:51:28 (7804): No heartbeat from core client for 30 sec - exiting 19:51:29 (7804): No heartbeat from core client for 30 sec - exiting 19:51:30 (7804): No heartbeat from core client for 30 sec - exiting 19:51:31 (7804): No heartbeat from core client for 30 sec - exiting 19:51:32 (7804): No heartbeat from core client for 30 sec - exiting 19:51:33 (7804): No heartbeat from core client for 30 sec - exiting 19:51:34 (7804): No heartbeat from core client for 30 sec - exiting 19:51:35 (7804): No heartbeat from core client for 30 sec - exiting 19:51:36 (7804): No heartbeat from core client for 30 sec - exiting 19:51:37 (7804): No heartbeat from core client for 30 sec - exiting 19:51:38 (7804): No heartbeat from core client for 30 sec - exiting 19:51:39 (7804): No heartbeat from core client for 30 sec - exiting 19:51:40 (7804): No heartbeat from core client for 30 sec - exiting 19:51:41 (7804): No heartbeat from core client for 30 sec - exiting 19:51:42 (7804): No heartbeat from core client for 30 sec - exiting 19:51:43 (7804): No heartbeat from core client for 30 sec - exiting 19:51:44 (7804): No heartbeat from core client for 30 sec - exiting 19:51:45 (7804): No heartbeat from core client for 30 sec - exiting 19:51:46 (7804): No heartbeat from core client for 30 sec - exiting 19:51:47 (7804): No heartbeat from core client for 30 sec - exiting 19:51:48 (7804): No heartbeat from core client for 30 sec - exiting 19:51:49 (7804): No heartbeat from core client for 30 sec - exiting 20:57:04 (114728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:49 (113008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:06 (116796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:33 (117680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:37:40 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:49 (116032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:15 (115604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:49 (117312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:51:15 (116808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:22 (115592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:01 (116252): No heartbeat from core client for 30 sec - exiting 09:18:02 (116252): No heartbeat from core client for 30 sec - exiting 09:18:03 (116252): No heartbeat from core client for 30 sec - exiting 09:18:04 (116252): No heartbeat from core client for 30 sec - exiting 09:18:05 (116252): No heartbeat from core client for 30 sec - exiting 09:18:06 (116252): No heartbeat from core client for 30 sec - exiting 09:18:07 (116252): No heartbeat from core client for 30 sec - exiting 09:18:08 (116252): No heartbeat from core client for 30 sec - exiting 09:18:09 (116252): No heartbeat from core client for 30 sec - exiting 09:18:10 (116252): No heartbeat from core client for 30 sec - exiting 09:18:11 (116252): No heartbeat from core client for 30 sec - exiting 09:18:12 (116252): No heartbeat from core client for 30 sec - exiting 09:18:13 (116252): No heartbeat from core client for 30 sec - exiting 09:18:14 (116252): No heartbeat from core client for 30 sec - exiting 09:18:15 (116252): No heartbeat from core client for 30 sec - exiting 09:18:16 (116252): No heartbeat from core client for 30 sec - exiting 09:18:17 (116252): No heartbeat from core client for 30 sec - exiting 09:18:18 (116252): No heartbeat from core client for 30 sec - exiting 09:18:19 (116252): No heartbeat from core client for 30 sec - exiting 09:18:20 (116252): No heartbeat from core client for 30 sec - exiting 09:18:21 (116252): No heartbeat from core client for 30 sec - exiting 09:18:22 (116252): No heartbeat from core client for 30 sec - exiting 09:18:23 (116252): No heartbeat from core client for 30 sec - exiting 09:18:24 (116252): No heartbeat from core client for 30 sec - exiting 09:18:25 (116252): No heartbeat from core client for 30 sec - exiting 09:18:26 (116252): No heartbeat from core client for 30 sec - exiting 09:18:27 (116252): No heartbeat from core client for 30 sec - exiting 09:18:28 (116252): No heartbeat from core client for 30 sec - exiting 09:18:29 (116252): No heartbeat from core client for 30 sec - exiting 09:18:30 (116252): No heartbeat from core client for 30 sec - exiting 09:18:31 (116252): No heartbeat from core client for 30 sec - exiting 09:18:32 (116252): No heartbeat from core client for 30 sec - exiting 09:18:33 (116252): No heartbeat from core client for 30 sec - exiting 09:18:34 (116252): No heartbeat from core client for 30 sec - exiting 09:18:35 (116252): No heartbeat from core client for 30 sec - exiting 09:18:36 (116252): No heartbeat from core client for 30 sec - exiting 09:18:37 (116252): No heartbeat from core client for 30 sec - exiting 09:18:38 (116252): No heartbeat from core client for 30 sec - exiting 09:18:39 (116252): No heartbeat from core client for 30 sec - exiting 09:18:40 (116252): No heartbeat from core client for 30 sec - exiting 09:18:41 (116252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:42 (116252): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:29:45 (9916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:45 (116216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:51:20 (113004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:34 (116608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:23 (112220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:08 (115764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:17 (115764): No heartbeat from core client for 30 sec - exiting 14:56:18 (115764): No heartbeat from core client for 30 sec - exiting 14:56:19 (115764): No heartbeat from core client for 30 sec - exiting 14:56:20 (115764): No heartbeat from core client for 30 sec - exiting 14:56:21 (115764): No heartbeat from core client for 30 sec - exiting 14:56:22 (115764): No heartbeat from core client for 30 sec - exiting 14:56:23 (115764): No heartbeat from core client for 30 sec - exiting 14:56:24 (115764): No heartbeat from core client for 30 sec - exiting 14:56:25 (115764): No heartbeat from core client for 30 sec - exiting 14:56:26 (115764): No heartbeat from core client for 30 sec - exiting 14:56:27 (115764): No heartbeat from core client for 30 sec - exiting 14:56:28 (115764): No heartbeat from core client for 30 sec - exiting 14:56:29 (115764): No heartbeat from core client for 30 sec - exiting 14:56:30 (115764): No heartbeat from core client for 30 sec - exiting 14:56:31 (115764): No heartbeat from core client for 30 sec - exiting 14:56:32 (115764): No heartbeat from core client for 30 sec - exiting 14:56:33 (115764): No heartbeat from core client for 30 sec - exiting 14:56:34 (115764): No heartbeat from core client for 30 sec - exiting 14:56:35 (115764): No heartbeat from core client for 30 sec - exiting 14:56:36 (115764): No heartbeat from core client for 30 sec - exiting 14:56:37 (115764): No heartbeat from core client for 30 sec - exiting 14:56:38 (115764): No heartbeat from core client for 30 sec - exiting 14:56:39 (115764): No heartbeat from core client for 30 sec - exiting 14:56:40 (115764): No heartbeat from core client for 30 sec - exiting 14:57:35 (115864): No heartbeat from core client for 30 sec - exiting 14:57:36 (115864): No heartbeat from core client for 30 sec - exiting 14:57:37 (115864): No heartbeat from core client for 30 sec - exiting 14:57:38 (115864): No heartbeat from core client for 30 sec - exiting 14:57:39 (115864): No heartbeat from core client for 30 sec - exiting 14:57:40 (115864): No heartbeat from core client for 30 sec - exiting 14:57:41 (115864): No heartbeat from core client for 30 sec - exiting 14:57:42 (115864): No heartbeat from core client for 30 sec - exiting 14:57:43 (115864): No heartbeat from core client for 30 sec - exiting 14:57:44 (115864): No heartbeat from core client for 30 sec - exiting 14:57:45 (115864): No heartbeat from core client for 30 sec - exiting 14:57:46 (115864): No heartbeat from core client for 30 sec - exiting 14:57:47 (115864): No heartbeat from core client for 30 sec - exiting 14:57:48 (115864): No heartbeat from core client for 30 sec - exiting 14:57:49 (115864): No heartbeat from core client for 30 sec - exiting 14:57:50 (115864): No heartbeat from core client for 30 sec - exiting 14:57:51 (115864): No heartbeat from core client for 30 sec - exiting 14:57:52 (115864): No heartbeat from core client for 30 sec - exiting 14:57:53 (115864): No heartbeat from core client for 30 sec - exiting 14:57:54 (115864): No heartbeat from core client for 30 sec - exiting 14:57:55 (115864): No heartbeat from core client for 30 sec - exiting 14:57:56 (115864): No heartbeat from core client for 30 sec - exiting 14:57:57 (115864): No heartbeat from core client for 30 sec - exiting 14:57:58 (115864): No heartbeat from core client for 30 sec - exiting 14:57:59 (115864): No heartbeat from core client for 30 sec - exiting 14:58:00 (115864): No heartbeat from core client for 30 sec - exiting 14:58:02 (115864): No heartbeat from core client for 30 sec - exiting 14:58:03 (115864): No heartbeat from core client for 30 sec - exiting 14:58:04 (115864): No heartbeat from core client for 30 sec - exiting 14:58:05 (115864): No heartbeat from core client for 30 sec - exiting 14:58:06 (115864): No heartbeat from core client for 30 sec - exiting 14:58:07 (115864): No heartbeat from core client for 30 sec - exiting 14:58:08 (115864): No heartbeat from core client for 30 sec - exiting 14:58:09 (115864): No heartbeat from core client for 30 sec - exiting 14:58:10 (115864): No heartbeat from core client for 30 sec - exiting 14:58:11 (115864): No heartbeat from core client for 30 sec - exiting 14:58:12 (115864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:58:47 (112664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:21 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:44 (4016): No heartbeat from core client for 30 sec - exiting 17:51:45 (4016): No heartbeat from core client for 30 sec - exiting 17:51:46 (4016): No heartbeat from core client for 30 sec - exiting 17:51:47 (4016): No heartbeat from core client for 30 sec - exiting 17:51:48 (4016): No heartbeat from core client for 30 sec - exiting 17:51:49 (4016): No heartbeat from core client for 30 sec - exiting 17:51:50 (4016): No heartbeat from core client for 30 sec - exiting 17:51:51 (4016): No heartbeat from core client for 30 sec - exiting 17:51:52 (4016): No heartbeat from core client for 30 sec - exiting 17:51:53 (4016): No heartbeat from core client for 30 sec - exiting 17:51:54 (4016): No heartbeat from core client for 30 sec - exiting 17:51:55 (4016): No heartbeat from core client for 30 sec - exiting 17:51:56 (4016): No heartbeat from core client for 30 sec - exiting 17:51:57 (4016): No heartbeat from core client for 30 sec - exiting 17:51:58 (4016): No heartbeat from core client for 30 sec - exiting 17:51:59 (4016): No heartbeat from core client for 30 sec - exiting 17:52:33 (118628): No heartbeat from core client for 30 sec - exiting 17:52:34 (118628): No heartbeat from core client for 30 sec - exiting 17:52:35 (118628): No heartbeat from core client for 30 sec - exiting 17:52:36 (118628): No heartbeat from core client for 30 sec - exiting 17:52:37 (118628): No heartbeat from core client for 30 sec - exiting 17:52:38 (118628): No heartbeat from core client for 30 sec - exiting 17:52:39 (118628): No heartbeat from core client for 30 sec - exiting 17:52:40 (118628): No heartbeat from core client for 30 sec - exiting 17:52:41 (118628): No heartbeat from core client for 30 sec - exiting 17:52:42 (118628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:07:34 (116120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:35:02 (116096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:35:03 (116096): No heartbeat from core client for 30 sec - exiting 03:35:04 (116096): No heartbeat from core client for 30 sec - exiting 03:35:05 (116096): No heartbeat from core client for 30 sec - exiting 03:35:06 (116096): No heartbeat from core client for 30 sec - exiting 03:35:07 (116096): No heartbeat from core client for 30 sec - exiting 03:35:08 (116096): No heartbeat from core client for 30 sec - exiting 03:35:09 (116096): No heartbeat from core client for 30 sec - exiting 03:35:10 (116096): No heartbeat from core client for 30 sec - exiting 03:35:11 (116096): No heartbeat from core client for 30 sec - exiting 03:35:12 (116096): No heartbeat from core client for 30 sec - exiting 05:15:22 (116164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:48 (117412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:00 (117412): No heartbeat from core client for 30 sec - exiting 05:53:01 (117412): No heartbeat from core client for 30 sec - exiting 05:53:02 (117412): No heartbeat from core client for 30 sec - exiting 05:53:03 (117412): No heartbeat from core client for 30 sec - exiting 05:53:04 (117412): No heartbeat from core client for 30 sec - exiting 05:53:05 (117412): No heartbeat from core client for 30 sec - exiting 05:53:06 (117412): No heartbeat from core client for 30 sec - exiting 05:53:07 (117412): No heartbeat from core client for 30 sec - exiting 05:53:08 (117412): No heartbeat from core client for 30 sec - exiting 05:53:09 (117412): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:03:19 (116172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:28:20 (116128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:28:21 (116128): No heartbeat from core client for 30 sec - exiting 06:28:22 (116128): No heartbeat from core client for 30 sec - exiting 06:28:23 (116128): No heartbeat from core client for 30 sec - exiting 06:28:24 (116128): No heartbeat from core client for 30 sec - exiting 06:28:25 (116128): No heartbeat from core client for 30 sec - exiting 06:28:26 (116128): No heartbeat from core client for 30 sec - exiting 06:28:27 (116128): No heartbeat from core client for 30 sec - exiting 06:28:28 (116128): No heartbeat from core client for 30 sec - exiting 06:28:29 (116128): No heartbeat from core client for 30 sec - exiting 06:39:12 (119784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:39:13 (119784): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:46:54 (116208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=119272, selfPID=119272, iMonCtr=2 11:46:55 (116208): No heartbeat from core client for 30 sec - exiting 11:46:56 (116208): No heartbeat from core client for 30 sec - exiting 11:46:57 (116208): No heartbeat from core client for 30 sec - exiting 15:11:02 (117628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:12:28 (117628): No heartbeat from core client for 30 sec - exiting 15:12:48 (118852): Can't acquire lockfile (32) - waiting 35s 17:12:58 (118852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:13:09 (118852): No heartbeat from core client for 30 sec - exiting 17:13:10 (118852): No heartbeat from core client for 30 sec - exiting 17:13:11 (118852): No heartbeat from core client for 30 sec - exiting 17:13:12 (118852): No heartbeat from core client for 30 sec - exiting 17:13:13 (118852): No heartbeat from core client for 30 sec - exiting 17:13:14 (118852): No heartbeat from core client for 30 sec - exiting 17:13:15 (118852): No heartbeat from core client for 30 sec - exiting 17:14:21 (116100): No heartbeat from core client for 30 sec - exiting 17:14:22 (116100): No heartbeat from core client for 30 sec - exiting 17:14:23 (116100): No heartbeat from core client for 30 sec - exiting 17:14:24 (116100): No heartbeat from core client for 30 sec - exiting 17:14:25 (116100): No heartbeat from core client for 30 sec - exiting 17:14:26 (116100): No heartbeat from core client for 30 sec - exiting 17:14:27 (116100): No heartbeat from core client for 30 sec - exiting 17:14:28 (116100): No heartbeat from core client for 30 sec - exiting 17:14:29 (116100): No heartbeat from core client for 30 sec - exiting 17:14:30 (116100): No heartbeat from core client for 30 sec - exiting 17:14:31 (116100): No heartbeat from core client for 30 sec - exiting 17:14:32 (116100): No heartbeat from core client for 30 sec - exiting 17:14:33 (116100): No heartbeat from core client for 30 sec - exiting 17:14:34 (116100): No heartbeat from core client for 30 sec - exiting 17:14:35 (116100): No heartbeat from core client for 30 sec - exiting 17:14:36 (116100): No heartbeat from core client for 30 sec - exiting 17:14:37 (116100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:46:14 (1016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:44:45 (119488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:50 (118164): No heartbeat from core client for 30 sec - exiting 18:45:51 (118164): No heartbeat from core client for 30 sec - exiting 18:45:52 (118164): No heartbeat from core client for 30 sec - exiting 18:45:53 (118164): No heartbeat from core client for 30 sec - exiting 18:45:54 (118164): No heartbeat from core client for 30 sec - exiting 18:45:55 (118164): No heartbeat from core client for 30 sec - exiting 18:45:56 (118164): No heartbeat from core client for 30 sec - exiting 18:45:57 (118164): No heartbeat from core client for 30 sec - exiting 18:45:58 (118164): No heartbeat from core client for 30 sec - exiting 18:45:59 (118164): No heartbeat from core client for 30 sec - exiting 18:46:00 (118164): No heartbeat from core client for 30 sec - exiting 18:46:01 (118164): No heartbeat from core client for 30 sec - exiting 18:46:02 (118164): No heartbeat from core client for 30 sec - exiting 18:46:03 (118164): No heartbeat from core client for 30 sec - exiting 18:46:04 (118164): No heartbeat from core client for 30 sec - exiting 18:46:05 (118164): No heartbeat from core client for 30 sec - exiting 18:46:06 (118164): No heartbeat from core client for 30 sec - exiting 18:46:07 (118164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:46:08 (118164): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:34:55 (115956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:37 (114092): No heartbeat from core client for 30 sec - exiting 19:35:38 (114092): No heartbeat from core client for 30 sec - exiting 19:35:39 (114092): No heartbeat from core client for 30 sec - exiting 19:35:40 (114092): No heartbeat from core client for 30 sec - exiting 19:35:41 (114092): No heartbeat from core client for 30 sec - exiting 19:35:42 (114092): No heartbeat from core client for 30 sec - exiting 19:35:43 (114092): No heartbeat from core client for 30 sec - exiting 19:35:44 (114092): No heartbeat from core client for 30 sec - exiting 19:35:45 (114092): No heartbeat from core client for 30 sec - exiting 19:35:46 (114092): No heartbeat from core client for 30 sec - exiting 19:35:47 (114092): No heartbeat from core client for 30 sec - exiting 19:35:48 (114092): No heartbeat from core client for 30 sec - exiting 19:35:49 (114092): No heartbeat from core client for 30 sec - exiting 19:35:50 (114092): No heartbeat from core client for 30 sec - exiting 19:35:51 (114092): No heartbeat from core client for 30 sec - exiting 19:35:52 (114092): No heartbeat from core client for 30 sec - exiting 19:35:53 (114092): No heartbeat from core client for 30 sec - exiting 19:35:54 (114092): No heartbeat from core client for 30 sec - exiting 19:35:55 (114092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:58:33 (119176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:04 (119176): No heartbeat from core client for 30 sec - exiting 19:59:05 (119176): No heartbeat from core client for 30 sec - exiting 19:59:06 (119176): No heartbeat from core client for 30 sec - exiting 19:59:07 (119176): No heartbeat from core client for 30 sec - exiting 19:59:14 (119176): No heartbeat from core client for 30 sec - exiting 19:59:15 (119176): No heartbeat from core client for 30 sec - exiting 20:11:59 (1288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:00 (1288): No heartbeat from core client for 30 sec - exiting 23:14:02 (115000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:17:32 (119964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:52:59 (118392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:22:04 (119900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:57:15 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:52 (119060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:57 (119576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:58 (119576): No heartbeat from core client for 30 sec - exiting 02:46:59 (119576): No heartbeat from core client for 30 sec - exiting 02:47:00 (119576): No heartbeat from core client for 30 sec - exiting 02:56:47 (120708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:20:50 (119312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:20:51 (119312): No heartbeat from core client for 30 sec - exiting 03:20:52 (119312): No heartbeat from core client for 30 sec - exiting 03:20:53 (119312): No heartbeat from core client for 30 sec - exiting 03:20:54 (119312): No heartbeat from core client for 30 sec - exiting 03:20:55 (119312): No heartbeat from core client for 30 sec - exiting 03:20:56 (119312): No heartbeat from core client for 30 sec - exiting 03:20:57 (119312): No heartbeat from core client for 30 sec - exiting 03:20:58 (119312): No heartbeat from core client for 30 sec - exiting 03:20:59 (119312): No heartbeat from core client for 30 sec - exiting 03:21:00 (119312): No heartbeat from core client for 30 sec - exiting 03:21:01 (119312): No heartbeat from core client for 30 sec - exiting 03:21:02 (119312): No heartbeat from core client for 30 sec - exiting 03:21:03 (119312): No heartbeat from core client for 30 sec - exiting 03:21:04 (119312): No heartbeat from core client for 30 sec - exiting 03:21:05 (119312): No heartbeat from core client for 30 sec - exiting 03:21:06 (119312): No heartbeat from core client for 30 sec - exiting 03:21:07 (119312): No heartbeat from core client for 30 sec - exiting 03:21:08 (119312): No heartbeat from core client for 30 sec - exiting 03:21:09 (119312): No heartbeat from core client for 30 sec - exiting 03:59:34 (119304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:18 (120264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=116652, selfPID=116652, iMonCtr=2 05:48:37 (120264): No heartbeat from core client for 30 sec - exiting 07:55:45 (114548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:40:29 (116892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:55:35 (117184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=118056, selfPID=118056, iMonCtr=2 11:32:16 (118380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:34 (118300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:32:04 (119424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=119888, selfPID=119888, iMonCtr=2 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_j7to_1993_1_008501985_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j7to_1993_1_008501985_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j7to_1993_1_008501985_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j7to_1993_1_008501985_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Dec 2013 11:00:00	1230461	16129153	hadam3p_eu_j7to_1993_1_008501985_0	92,160	288,752	3.1332
08 Dec 2013 19:53:45	1230461	16129153	hadam3p_eu_j7to_1993_1_008501985_0	80,640	255,144	3.1640
08 Dec 2013 02:22:06	1230461	16129153	hadam3p_eu_j7to_1993_1_008501985_0	69,120	220,536	3.1906
07 Dec 2013 11:06:06	1230461	16129153	hadam3p_eu_j7to_1993_1_008501985_0	57,600	184,553	3.2040
06 Dec 2013 18:29:31	1230461	16129153	hadam3p_eu_j7to_1993_1_008501985_0	46,176	148,808	3.2226
06 Dec 2013 01:44:42	1230461	16129153	hadam3p_eu_j7to_1993_1_008501985_0	34,658	110,982	3.2022
06 Dec 2013 01:44:42	1230461	16129153	hadam3p_eu_j7to_1993_1_008501985_0	34,656	110,502	3.1885
05 Dec 2013 10:53:05	1230461	16129153	hadam3p_eu_j7to_1993_1_008501985_0	23,136	75,343	3.2565
04 Dec 2013 18:32:10	1230461	16129153	hadam3p_eu_j7to_1993_1_008501985_0	11,616	37,504	3.2287