Task 17593140

Name	hadam3p_anz_m5oh_2012_1_009306887_0
Workunit	9391075
Created	17 Dec 2014, 19:50:56 UTC
Sent	21 Dec 2014, 23:38:59 UTC
Report deadline	4 Dec 2015, 4:58:59 UTC
Received	23 Mar 2015, 0:55:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1143523
Run time	10 days 10 hours 20 min 54 sec
CPU time	9 days 15 hours 52 min 40 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	2.89 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.36</core_client_version> <![CDATA[ <stderr_txt> 22:19:14 (5048): No heartbeat from core client for 30 sec - exiting 22:19:15 (5048): No heartbeat from core client for 30 sec - exiting 22:19:16 (5048): No heartbeat from core client for 30 sec - exiting 22:19:17 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:11 (5560): No heartbeat from core client for 30 sec - exiting 13:00:12 (5560): No heartbeat from core client for 30 sec - exiting 13:00:13 (5560): No heartbeat from core client for 30 sec - exiting 13:00:14 (5560): No heartbeat from core client for 30 sec - exiting 13:00:15 (5560): No heartbeat from core client for 30 sec - exiting 13:00:16 (5560): No heartbeat from core client for 30 sec - exiting 13:00:17 (5560): No heartbeat from core client for 30 sec - exiting 13:00:18 (5560): No heartbeat from core client for 30 sec - exiting 13:00:19 (5560): No heartbeat from core client for 30 sec - exiting 13:00:20 (5560): No heartbeat from core client for 30 sec - exiting 13:00:21 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:21 (5236): No heartbeat from core client for 30 sec - exiting 19:42:22 (5236): No heartbeat from core client for 30 sec - exiting 19:42:23 (5236): No heartbeat from core client for 30 sec - exiting 19:42:24 (5236): No heartbeat from core client for 30 sec - exiting 19:42:25 (5236): No heartbeat from core client for 30 sec - exiting 19:42:26 (5236): No heartbeat from core client for 30 sec - exiting 19:42:27 (5236): No heartbeat from core client for 30 sec - exiting 19:42:28 (5236): No heartbeat from core client for 30 sec - exiting 19:42:29 (5236): No heartbeat from core client for 30 sec - exiting 19:42:30 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:41 (4580): No heartbeat from core client for 30 sec - exiting 13:49:42 (4580): No heartbeat from core client for 30 sec - exiting 13:49:43 (4580): No heartbeat from core client for 30 sec - exiting 13:49:44 (4580): No heartbeat from core client for 30 sec - exiting 13:49:45 (4580): No heartbeat from core client for 30 sec - exiting 13:49:46 (4580): No heartbeat from core client for 30 sec - exiting 13:49:47 (4580): No heartbeat from core client for 30 sec - exiting 13:49:48 (4580): No heartbeat from core client for 30 sec - exiting 13:49:49 (4580): No heartbeat from core client for 30 sec - exiting 13:49:50 (4580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:58:42 (4320): No heartbeat from core client for 30 sec - exiting 17:58:43 (4320): No heartbeat from core client for 30 sec - exiting 17:58:44 (4320): No heartbeat from core client for 30 sec - exiting 17:58:45 (4320): No heartbeat from core client for 30 sec - exiting 17:58:46 (4320): No heartbeat from core client for 30 sec - exiting 17:58:47 (4320): No heartbeat from core client for 30 sec - exiting 17:58:48 (4320): No heartbeat from core client for 30 sec - exiting 17:58:49 (4320): No heartbeat from core client for 30 sec - exiting 17:58:50 (4320): No heartbeat from core client for 30 sec - exiting 17:58:51 (4320): No heartbeat from core client for 30 sec - exiting 17:58:52 (4320): No heartbeat from core client for 30 sec - exiting 17:58:53 (4320): No heartbeat from core client for 30 sec - exiting 17:58:54 (4320): No heartbeat from core client for 30 sec - exiting 17:58:55 (4320): No heartbeat from core client for 30 sec - exiting 17:58:56 (4320): No heartbeat from core client for 30 sec - exiting 17:58:57 (4320): No heartbeat from core client for 30 sec - exiting 17:58:58 (4320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:42 (5632): No heartbeat from core client for 30 sec - exiting 22:26:43 (5632): No heartbeat from core client for 30 sec - exiting 22:26:44 (5632): No heartbeat from core client for 30 sec - exiting 22:26:45 (5632): No heartbeat from core client for 30 sec - exiting 22:26:46 (5632): No heartbeat from core client for 30 sec - exiting 22:26:47 (5632): No heartbeat from core client for 30 sec - exiting 22:26:48 (5632): No heartbeat from core client for 30 sec - exiting 22:26:49 (5632): No heartbeat from core client for 30 sec - exiting 22:26:50 (5632): No heartbeat from core client for 30 sec - exiting 22:26:51 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:03 (5328): No heartbeat from core client for 30 sec - exiting 13:01:04 (5328): No heartbeat from core client for 30 sec - exiting 13:01:05 (5328): No heartbeat from core client for 30 sec - exiting 13:01:06 (5328): No heartbeat from core client for 30 sec - exiting 13:01:07 (5328): No heartbeat from core client for 30 sec - exiting 13:01:08 (5328): No heartbeat from core client for 30 sec - exiting 13:01:09 (5328): No heartbeat from core client for 30 sec - exiting 13:01:10 (5328): No heartbeat from core client for 30 sec - exiting 13:01:11 (5328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3864, iMonCtr=2 Model crash detected, will try to restart... 20:40:22 (4144): No heartbeat from core client for 30 sec - exiting 20:40:23 (4144): No heartbeat from core client for 30 sec - exiting 20:40:24 (4144): No heartbeat from core client for 30 sec - exiting 20:40:25 (4144): No heartbeat from core client for 30 sec - exiting 20:40:26 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:28 (5192): No heartbeat from core client for 30 sec - exiting 17:33:29 (5192): No heartbeat from core client for 30 sec - exiting 17:33:30 (5192): No heartbeat from core client for 30 sec - exiting 17:33:31 (5192): No heartbeat from core client for 30 sec - exiting 17:33:32 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:03 (5384): No heartbeat from core client for 30 sec - exiting 18:03:04 (5384): No heartbeat from core client for 30 sec - exiting 18:03:05 (5384): No heartbeat from core client for 30 sec - exiting 18:03:06 (5384): No heartbeat from core client for 30 sec - exiting 18:03:07 (5384): No heartbeat from core client for 30 sec - exiting 18:03:08 (5384): No heartbeat from core client for 30 sec - exiting 18:03:09 (5384): No heartbeat from core client for 30 sec - exiting 18:03:10 (5384): No heartbeat from core client for 30 sec - exiting 18:03:11 (5384): No heartbeat from core client for 30 sec - exiting 18:03:12 (5384): No heartbeat from core client for 30 sec - exiting 18:03:13 (5384): No heartbeat from core client for 30 sec - exiting 18:03:14 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:15 (5384): No heartbeat from core client for 30 sec - exiting 20:26:14 (5612): No heartbeat from core client for 30 sec - exiting 20:26:15 (5612): No heartbeat from core client for 30 sec - exiting 20:26:16 (5612): No heartbeat from core client for 30 sec - exiting 20:26:17 (5612): No heartbeat from core client for 30 sec - exiting 20:26:18 (5612): No heartbeat from core client for 30 sec - exiting 20:26:19 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:32:47 (1660): No heartbeat from core client for 30 sec - exiting 15:32:48 (1660): No heartbeat from core client for 30 sec - exiting 15:32:49 (1660): No heartbeat from core client for 30 sec - exiting 15:32:50 (1660): No heartbeat from core client for 30 sec - exiting 15:32:51 (1660): No heartbeat from core client for 30 sec - exiting 15:32:52 (1660): No heartbeat from core client for 30 sec - exiting 15:32:53 (1660): No heartbeat from core client for 30 sec - exiting 15:32:54 (1660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exitingController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5696, iMonCtr=2 Model crash detected, will try to restart... 17:40:56 (5484): No heartbeat from core client for 30 sec - exiting 17:40:57 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:26:06 (4200): No heartbeat from core client for 30 sec - exiting 16:26:07 (4200): No heartbeat from core client for 30 sec - exiting 16:26:08 (4200): No heartbeat from core client for 30 sec - exiting 16:26:09 (4200): No heartbeat from core client for 30 sec - exiting 16:26:10 (4200): No heartbeat from core client for 30 sec - exiting 16:26:11 (4200): No heartbeat from core client for 30 sec - exiting 16:26:12 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4196, selfPID=6112, iMonCtr=1 Model crash detected, will try to restart... 17:38:35 (3808): No heartbeat from core client for 30 sec - exiting 17:38:36 (3808): No heartbeat from core client for 30 sec - exiting 17:38:37 (3808): No heartbeat from core client for 30 sec - exiting 17:38:38 (3808): No heartbeat from core client for 30 sec - exiting 17:38:39 (3808): No heartbeat from core client for 30 sec - exiting 17:38:40 (3808): No heartbeat from core client for 30 sec - exiting 17:38:41 (3808): No heartbeat from core client for 30 sec - exiting 17:38:42 (3808): No heartbeat from core client for 30 sec - exiting 17:38:43 (3808): No heartbeat from core client for 30 sec - exiting 17:38:44 (3808): No heartbeat from core client for 30 sec - exiting 17:38:45 (3808): No heartbeat from core client for 30 sec - exiting 17:38:46 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:37 (5460): No heartbeat from core client for 30 sec - exiting 22:03:38 (5460): No heartbeat from core client for 30 sec - exiting 22:03:39 (5460): No heartbeat from core client for 30 sec - exiting 22:03:40 (5460): No heartbeat from core client for 30 sec - exiting 22:03:41 (5460): No heartbeat from core client for 30 sec - exiting 22:03:42 (5460): No heartbeat from core client for 30 sec - exiting 22:03:43 (5460): No heartbeat from core client for 30 sec - exiting 22:03:44 (5460): No heartbeat from core client for 30 sec - exiting 22:03:45 (5460): No heartbeat from core client for 30 sec - exiting 22:03:46 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2196, iMonCtr=2 11:41:24 (5192): No heartbeat from core client for 30 sec - exiting 11:41:25 (5192): No heartbeat from core client for 30 sec - exiting 11:41:26 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... G13:01:15 (5516): No heartbeat from core client for 30 sec - exiting 13:01:16 (5516): No heartbeat from core client for 30 sec - exiting 13:01:17 (5516): No heartbeat from core client for 30 sec - exiting 13:01:18 (5516): No heartbeat from core client for 30 sec - exiting 13:01:19 (5516): No heartbeat from core client for 30 sec - exiting 13:01:20 (5516): No heartbeat from core client for 30 sec - exiting 13:01:21 (5516): No heartbeat from core client for 30 sec - exiting 13:01:22 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:26:14 (5424): No heartbeat from core client for 30 sec - exiting 18:26:15 (5424): No heartbeat from core client for 30 sec - exiting 18:26:16 (5424): No heartbeat from core client for 30 sec - exiting 18:26:17 (5424): No heartbeat from core client for 30 sec - exiting 18:26:18 (5424): No heartbeat from core client for 30 sec - exiting 18:26:19 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=2 Model crash detected, will try to restart... 20:07:30 (4064): No heartbeat from core client for 30 sec - exiting 20:07:31 (4064): No heartbeat from core client for 30 sec - exiting 20:07:32 (4064): No heartbeat from core client for 30 sec - exiting 20:07:33 (4064): No heartbeat from core client for 30 sec - exiting 20:07:34 (4064): No heartbeat from core client for 30 sec - exiting 20:07:35 (4064): No heartbeat from core client for 30 sec - exiting 20:07:36 (4064): No heartbeat from core client for 30 sec - exiting 20:07:37 (4064): No heartbeat from core client for 30 sec - exiting 20:07:38 (4064): No heartbeat from core client for 30 sec - exiting 20:07:39 (4064): No heartbeat from core client for 30 sec - exiting 20:07:40 (4064): No heartbeat from core client for 30 sec - exiting 20:07:41 (4064): No heartbeat from core client for 30 sec - exiting 20:07:42 (4064): No heartbeat from core client for 30 sec - exiting 20:07:43 (4064): No heartbeat from core client for 30 sec - exiting 20:07:44 (4064): No heartbeat from core client for 30 sec - exiting 20:07:45 (4064): No heartbeat from core client for 30 sec - exiting 20:07:46 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:11 (4960): No heartbeat from core client for 30 sec - exiting 20:43:12 (4960): No heartbeat from core client for 30 sec - exiting 20:43:13 (4960): No heartbeat from core client for 30 sec - exiting 20:43:14 (4960): No heartbeat from core client for 30 sec - exiting 20:43:15 (4960): No heartbeat from core client for 30 sec - exiting 20:43:16 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:41 (892): No heartbeat from core client for 30 sec - exiting 21:36:42 (892): No heartbeat from core client for 30 sec - exiting 21:36:43 (892): No heartbeat from core client for 30 sec - exiting 21:36:44 (892): No heartbeat from core client for 30 sec - exiting 21:36:45 (892): No heartbeat from core client for 30 sec - exiting 21:36:46 (892): No heartbeat from core client for 30 sec - exiting 21:36:47 (892): No heartbeat from core client for 30 sec - exiting 21:36:48 (892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:49 (892): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5744, selfPID=5744, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6000, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1244, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2884, selfPID=5860, iMonCtr=1 Model crash detected, will try to restart... 21:31:35 (5680): No heartbeat from core client for 30 sec - exiting 21:31:36 (5680): No heartbeat from core client for 30 sec - exiting 21:31:37 (5680): No heartbeat from core client for 30 sec - exiting 21:31:38 (5680): No heartbeat from core client for 30 sec - exiting 21:31:39 (5680): No heartbeat from core client for 30 sec - exiting 21:31:40 (5680): No heartbeat from core client for 30 sec - exiting 21:31:41 (5680): No heartbeat from core client for 30 sec - exiting 21:31:42 (5680): No heartbeat from core client for 30 sec - exiting 21:31:43 (5680): No heartbeat from core client for 30 sec - exiting 21:31:44 (5680): No heartbeat from core client for 30 sec - exiting 21:31:45 (5680): No heartbeat from core client for 30 sec - exiting 21:31:46 (5680): No heartbeat from core client for 30 sec - exiting 21:31:47 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:19:13 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:41 (4744): No heartbeat from core client for 30 sec - exiting 17:02:42 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:19:12 (5296): No heartbeat from core client for 30 sec - exiting 18:19:13 (5296): No heartbeat from core client for 30 sec - exiting 18:19:14 (5296): No heartbeat from core client for 30 sec - exiting 18:19:15 (5296): No heartbeat from core client for 30 sec - exiting 18:19:16 (5296): No heartbeat from core client for 30 sec - exiting 18:19:17 (5296): No heartbeat from core client for 30 sec - exiting 18:19:18 (5296): No heartbeat from core client for 30 sec - exiting 18:19:19 (5296): No heartbeat from core client for 30 sec - exiting 18:19:20 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:09 (5668): No heartbeat from core client for 30 sec - exiting 12:00:10 (5668): No heartbeat from core client for 30 sec - exiting 12:00:11 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5284, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3760, selfPID=5828, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5768, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... 18:56:36 (5916): No heartbeat from core client for 30 sec - exiting 18:56:37 (5916): No heartbeat from core client for 30 sec - exiting 18:56:38 (5916): No heartbeat from core client for 30 sec - exiting 18:56:39 (5916): No heartbeat from core client for 30 sec - exiting 18:56:40 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:42 (5564): No heartbeat from core client for 30 sec - exiting 18:15:43 (5564): No heartbeat from core client for 30 sec - exiting 18:15:44 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2492, selfPID=2492, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2740, selfPID=2528, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5800, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6008, selfPID=4804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=2 Model crash detected, will try to restart... 10:45:58 (5428): No heartbeat from core client for 30 sec - exiting 10:45:59 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:49 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6088, selfPID=6088, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6048, selfPID=5748, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4636, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3668, selfPID=6024, iMonCtr=1 Model crash detected, will try to restart... 17:57:49 (5700): No heartbeat from core client for 30 sec - exiting 17:57:50 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5400, selfPID=5400, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5572, selfPID=5668, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6000, iMonCtr=2 19:24:44 (5548): No heartbeat from core client for 30 sec - exiting 19:24:45 (5548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5788, selfPID=5632, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5828, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... 17:56:56 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3460, selfPID=3460, iMonCtr=2 21:49:50 (5236): No heartbeat from core client for 30 sec - exiting 21:49:51 (5236): No heartbeat from core client for 30 sec - exiting 21:49:52 (5236): No heartbeat from core client for 30 sec - exiting 21:49:53 (5236): No heartbeat from core client for 30 sec - exiting 21:49:54 (5236): No heartbeat from core client for 30 sec - exiting 21:49:55 (5236): No heartbeat from core client for 30 sec - exiting 21:49:56 (5236): No heartbeat from core client for 30 sec - exiting 21:49:57 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:00 (5676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:12 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:41:28 (5540): No heartbeat from core client for 30 sec - exiting 16:41:29 (5540): No heartbeat from core client for 30 sec - exiting 16:41:30 (5540): No heartbeat from core client for 30 sec - exiting 16:41:31 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4820, iMonCtr=2 19:47:40 (5632): No heartbeat from core client for 30 sec - exiting 19:47:41 (5632): No heartbeat from core client for 30 sec - exiting 19:47:42 (5632): No heartbeat from core client for 30 sec - exiting 19:47:43 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5796, selfPID=5480, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5620, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5932, selfPID=5892, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5680, selfPID=5128, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5480, iMonCtr=2 18:31:10 (6084): No heartbeat from core client for 30 sec - exiting 18:31:11 (6084): No heartbeat from core client for 30 sec - exiting 18:31:12 (6084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:04:54 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5476, selfPID=5476, iMonCtr=2 11:06:35 (4588): No heartbeat from core client for 30 sec - exiting 11:06:36 (4588): No heartbeat from core client for 30 sec - exiting 11:06:37 (4588): No heartbeat from core client for 30 sec - exiting 11:06:38 (4588): No heartbeat from core client for 30 sec - exiting 11:06:39 (4588): No heartbeat from core client for 30 sec - exiting 11:06:40 (4588): No heartbeat from core client for 30 sec - exiting 11:06:41 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:35 (5768): No heartbeat from core client for 30 sec - exiting 11:15:36 (5768): No heartbeat from core client for 30 sec - exiting 11:15:37 (5768): No heartbeat from core client for 30 sec - exiting 11:15:38 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5860, iMonCtr=2 19:21:59 (5624): No heartbeat from core client for 30 sec - exiting 19:22:00 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5688, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6020, selfPID=4064, iMonCtr=1 Model crash detected, will try to restart... 10:10:49 (1448): No heartbeat from core client for 30 sec - exiting 10:10:50 (1448): No heartbeat from core client for 30 sec - exiting 10:10:51 (1448): No heartbeat from core client for 30 sec - exiting 10:10:52 (1448): No heartbeat from core client for 30 sec - exiting 10:10:53 (1448): No heartbeat from core client for 30 sec - exiting 10:10:54 (1448): No heartbeat from core client for 30 sec - exiting 10:10:55 (1448): No heartbeat from core client for 30 sec - exiting 10:10:56 (1448): No heartbeat from core client for 30 sec - exiting 10:10:57 (1448): No heartbeat from core client for 30 sec - exiting 10:10:58 (1448): No heartbeat from core client for 30 sec - exiting 10:10:59 (1448): No heartbeat from core client for 30 sec - exiting 10:11:00 (1448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5380, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5496, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:24:10 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2228, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6076, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5432, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6108, iMonCtr=2 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=224, selfPID=5388, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_m5oh_2012_1_009306887_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m5oh_2012_1_009306887_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Mar 2015 13:37:57	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	115,499	815,106	7.0573
14 Mar 2015 16:54:41	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	103,979	734,023	7.0593
04 Mar 2015 22:31:16	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	92,459	652,870	7.0612
26 Feb 2015 00:45:38	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	80,939	572,229	7.0699
18 Feb 2015 00:42:57	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	69,419	490,856	7.0709
03 Feb 2015 14:46:45	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	57,899	410,149	7.0839
18 Jan 2015 22:05:12	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	46,379	329,781	7.1106
11 Jan 2015 16:55:01	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	34,859	248,464	7.1277
05 Jan 2015 01:01:17	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	23,339	167,080	7.1588
30 Dec 2014 23:06:19	1143523	17593140	hadam3p_anz_m5oh_2012_1_009306887_0	11,819	84,743	7.1701