Task 17561116

Name	hadam3p_pnw_h2rm_2012_1_009288426_0
Workunit	9372614
Created	9 Dec 2014, 19:32:46 UTC
Sent	11 Dec 2014, 15:46:38 UTC
Report deadline	23 Nov 2015, 21:06:38 UTC
Received	7 Jan 2015, 23:46:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1224712
Run time	2 days 3 hours 52 min 44 sec
CPU time	1 days 19 hours 41 min 59 sec
Validate state	Invalid
Credit	1,007.76
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.22 windows_intelx86
Stderr	<core_client_version>6.8.42</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5404, selfPID=5404, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3812, selfPID=3812, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=404, selfPID=404, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4900, selfPID=4900, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2596, selfPID=2596, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:03:10 (4416): No heartbeat from client for 30 sec - exiting 16:03:10 (4416): timer handler: client dead, exiting 16:03:11 (4416): No heartbeat from client for 30 sec - exiting 16:03:11 (4416): timer handler: client dead, exiting 16:03:12 (4416): No heartbeat from client for 30 sec - exiting 16:03:12 (4416): timer handler: client dead, exiting 16:03:13 (4416): No heartbeat from client for 30 sec - exiting 16:03:13 (4416): timer handler: client dead, exiting 16:03:14 (4416): No heartbeat from client for 30 sec - exiting 16:03:14 (4416): timer handler: client dead, exiting 16:03:15 (4416): No heartbeat from client for 30 sec - exiting 16:03:15 (4416): timer handler: client dead, exiting 16:03:16 (4416): No heartbeat from client for 30 sec - exiting 16:03:16 (4416): timer handler: client dead, exiting 16:03:17 (4416): No heartbeat from client for 30 sec - exiting 16:03:17 (4416): timer handler: client dead, exiting 16:03:18 (4416): No heartbeat from client for 30 sec - exiting 16:03:18 (4416): timer handler: client dead, exiting 16:03:19 (4416): No heartbeat from client for 30 sec - exiting 16:03:19 (4416): timer handler: client dead, exiting 16:03:20 (4416): No heartbeat from client for 30 sec - exiting 16:03:20 (4416): timer handler: client dead, exiting 16:03:21 (4416): No heartbeat from client for 30 sec - exiting 16:03:21 (4416): timer handler: client dead, exiting 16:03:22 (4416): No heartbeat from client for 30 sec - exiting 16:03:22 (4416): timer handler: client dead, exiting 16:03:23 (4416): No heartbeat from client for 30 sec - exiting 16:03:23 (4416): timer handler: client dead, exiting 16:03:24 (4416): No heartbeat from client for 30 sec - exiting 16:03:24 (4416): timer handler: client dead, exiting 16:03:25 (4416): No heartbeat from client for 30 sec - exiting 16:03:25 (4416): timer handler: client dead, exiting 16:03:26 (4416): No heartbeat from client for 30 sec - exiting 16:03:26 (4416): timer handler: client dead, exiting 16:03:27 (4416): No heartbeat from client for 30 sec - exiting 16:03:27 (4416): timer handler: client dead, exiting 16:03:28 (4416): No heartbeat from client for 30 sec - exiting 16:03:28 (4416): timer handler: client dead, exiting 16:03:29 (4416): No heartbeat from client for 30 sec - exiting 16:03:29 (4416): timer handler: client dead, exiting 16:03:30 (4416): No heartbeat from client for 30 sec - exiting 16:03:30 (4416): timer handler: client dead, exiting 16:03:31 (4416): No heartbeat from client for 30 sec - exiting 16:03:31 (4416): timer handler: client dead, exiting 16:03:32 (4416): No heartbeat from client for 30 sec - exiting 16:03:32 (4416): timer handler: client dead, exiting 16:03:33 (4416): No heartbeat from client for 30 sec - exiting 16:03:33 (4416): timer handler: client dead, exiting 16:03:34 (4416): No heartbeat from client for 30 sec - exiting 16:03:34 (4416): timer handler: client dead, exiting 16:03:35 (4416): No heartbeat from client for 30 sec - exiting 16:03:35 (4416): timer handler: client dead, exiting 16:03:36 (4416): No heartbeat from client for 30 sec - exiting 16:03:36 (4416): timer handler: client dead, exiting 16:03:37 (4416): No heartbeat from client for 30 sec - exiting 16:03:37 (4416): timer handler: client dead, exiting 16:03:38 (4416): No heartbeat from client for 30 sec - exiting 16:03:38 (4416): timer handler: client dead, exiting 16:03:39 (4416): No heartbeat from client for 30 sec - exiting 16:03:39 (4416): timer handler: client dead, exiting 16:03:40 (4416): No heartbeat from client for 30 sec - exiting 16:03:40 (4416): timer handler: client dead, exiting 16:03:41 (4416): No heartbeat from client for 30 sec - exiting 16:03:41 (4416): timer handler: client dead, exiting 16:03:42 (4416): No heartbeat from client for 30 sec - exiting 16:03:42 (4416): timer handler: client dead, exiting 16:03:43 (4416): No heartbeat from client for 30 sec - exiting 16:03:43 (4416): timer handler: client dead, exiting 16:03:44 (4416): No heartbeat from client for 30 sec - exiting 16:03:44 (4416): timer handler: client dead, exiting 16:03:45 (4416): No heartbeat from client for 30 sec - exiting 16:03:45 (4416): timer handler: client dead, exiting 16:03:46 (4416): No heartbeat from client for 30 sec - exiting 16:03:46 (4416): timer handler: client dead, exiting 16:03:47 (4416): No heartbeat from client for 30 sec - exiting 16:03:47 (4416): timer handler: client dead, exiting 16:03:48 (4416): No heartbeat from client for 30 sec - exiting 16:03:48 (4416): timer handler: client dead, exiting 16:03:49 (4416): No heartbeat from client for 30 sec - exiting 16:03:49 (4416): timer handler: client dead, exiting 16:03:50 (4416): No heartbeat from client for 30 sec - exiting 16:03:50 (4416): timer handler: client dead, exiting 16:03:51 (4416): No heartbeat from client for 30 sec - exiting 16:03:51 (4416): timer handler: client dead, exiting 16:03:52 (4416): No heartbeat from client for 30 sec - exiting 16:03:52 (4416): timer handler: client dead, exiting 16:03:53 (4416): No heartbeat from client for 30 sec - exiting 16:03:53 (4416): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:14:29 (980): No heartbeat from client for 30 sec - exiting 22:14:30 (980): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:51:24 (4716): No heartbeat from client for 30 sec - exiting 14:51:24 (4716): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:51:25 (4716): No heartbeat from client for 30 sec - exiting 14:51:25 (4716): timer handler: client dead, exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1320, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6092, selfPID=6092, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:42:41 (4292): No heartbeat from client for 30 sec - exiting 14:42:41 (4292): timer handler: client dead, exiting 14:42:42 (4292): No heartbeat from client for 30 sec - exiting 14:42:42 (4292): timer handler: client dead, exiting 14:42:43 (4292): No heartbeat from client for 30 sec - exiting 14:42:43 (4292): timer handler: client dead, exiting 14:42:44 (4292): No heartbeat from client for 30 sec - exiting 14:42:44 (4292): timer handler: client dead, exiting 14:42:45 (4292): No heartbeat from client for 30 sec - exiting 14:42:45 (4292): timer handler: client dead, exiting 14:42:46 (4292): No heartbeat from client for 30 sec - exiting 14:42:46 (4292): timer handler: client dead, exiting 14:42:47 (4292): No heartbeat from client for 30 sec - exiting 14:42:47 (4292): timer handler: client dead, exiting 14:42:48 (4292): No heartbeat from client for 30 sec - exiting 14:42:48 (4292): timer handler: client dead, exiting 14:42:49 (4292): No heartbeat from client for 30 sec - exiting 14:42:49 (4292): timer handler: client dead, exiting 14:42:50 (4292): No heartbeat from client for 30 sec - exiting 14:42:50 (4292): timer handler: client dead, exiting 14:42:51 (4292): No heartbeat from client for 30 sec - exiting 14:42:51 (4292): timer handler: client dead, exiting 14:42:52 (4292): No heartbeat from client for 30 sec - exiting 14:42:52 (4292): timer handler: client dead, exiting 14:42:53 (4292): No heartbeat from client for 30 sec - exiting 14:42:53 (4292): timer handler: client dead, exiting 14:42:54 (4292): No heartbeat from client for 30 sec - exiting 14:42:54 (4292): timer handler: client dead, exiting 14:42:55 (4292): No heartbeat from client for 30 sec - exiting 14:42:55 (4292): timer handler: client dead, exiting 14:42:56 (4292): No heartbeat from client for 30 sec - exiting 14:42:56 (4292): timer handler: client dead, exiting 14:42:57 (4292): No heartbeat from client for 30 sec - exiting 14:42:57 (4292): timer handler: client dead, exiting 14:42:58 (4292): No heartbeat from client for 30 sec - exiting 14:42:58 (4292): timer handler: client dead, exiting 14:42:59 (4292): No heartbeat from client for 30 sec - exiting 14:42:59 (4292): timer handler: client dead, exiting 14:43:00 (4292): No heartbeat from client for 30 sec - exiting 14:43:00 (4292): timer handler: client dead, exiting 14:43:01 (4292): No heartbeat from client for 30 sec - exiting 14:43:01 (4292): timer handler: client dead, exiting 14:43:02 (4292): No heartbeat from client for 30 sec - exiting 14:43:02 (4292): timer handler: client dead, exiting 14:43:03 (4292): No heartbeat from client for 30 sec - exiting 14:43:03 (4292): timer handler: client dead, exiting 14:43:04 (4292): No heartbeat from client for 30 sec - exiting 14:43:04 (4292): timer handler: client dead, exiting 14:43:05 (4292): No heartbeat from client for 30 sec - exiting 14:43:05 (4292): timer handler: client dead, exiting 14:43:06 (4292): No heartbeat from client for 30 sec - exiting 14:43:06 (4292): timer handler: client dead, exiting 14:43:07 (4292): No heartbeat from client for 30 sec - exiting 14:43:07 (4292): timer handler: client dead, exiting 14:43:08 (4292): No heartbeat from client for 30 sec - exiting 14:43:08 (4292): timer handler: client dead, exiting 14:43:09 (4292): No heartbeat from client for 30 sec - exiting 14:43:09 (4292): timer handler: client dead, exiting 14:43:10 (4292): No heartbeat from client for 30 sec - exiting 14:43:10 (4292): timer handler: client dead, exiting 14:43:11 (4292): No heartbeat from client for 30 sec - exiting 14:43:11 (4292): timer handler: client dead, exiting 14:43:12 (4292): No heartbeat from client for 30 sec - exiting 14:43:12 (4292): timer handler: client dead, exiting 14:43:13 (4292): No heartbeat from client for 30 sec - exiting 14:43:13 (4292): timer handler: client dead, exiting 14:43:14 (4292): No heartbeat from client for 30 sec - exiting 14:43:14 (4292): timer handler: client dead, exiting 14:43:15 (4292): No heartbeat from client for 30 sec - exiting 14:43:15 (4292): timer handler: client dead, exiting 14:43:16 (4292): No heartbeat from client for 30 sec - exiting 14:43:16 (4292): timer handler: client dead, exiting 14:43:17 (4292): No heartbeat from client for 30 sec - exiting 14:43:17 (4292): timer handler: client dead, exiting 14:43:18 (4292): No heartbeat from client for 30 sec - exiting 14:43:18 (4292): timer handler: client dead, exiting 14:43:19 (4292): No heartbeat from client for 30 sec - exiting 14:43:19 (4292): timer handler: client dead, exiting 14:43:20 (4292): No heartbeat from client for 30 sec - exiting 14:43:20 (4292): timer handler: client dead, exiting 14:43:21 (4292): No heartbeat from client for 30 sec - exiting 14:43:21 (4292): timer handler: client dead, exiting 14:43:22 (4292): No heartbeat from client for 30 sec - exiting 14:43:22 (4292): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:47:49 (4284): No heartbeat from client for 30 sec - exiting 16:47:49 (4284): timer handler: client dead, exiting 16:47:50 (4284): No heartbeat from client for 30 sec - exiting 16:47:50 (4284): timer handler: client dead, exiting 16:47:51 (4284): No heartbeat from client for 30 sec - exiting 16:47:51 (4284): timer handler: client dead, exiting 16:47:52 (4284): No heartbeat from client for 30 sec - exiting 16:47:52 (4284): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:52 (2464): No heartbeat from client for 30 sec - exiting 18:12:52 (2464): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:46 (952): No heartbeat from client for 30 sec - exiting 18:13:46 (952): timer handler: client dead, exiting 18:13:47 (952): No heartbeat from client for 30 sec - exiting 18:13:47 (952): timer handler: client dead, exiting 18:13:48 (952): No heartbeat from client for 30 sec - exiting 18:13:48 (952): timer handler: client dead, exiting 18:13:49 (952): No heartbeat from client for 30 sec - exiting 18:13:49 (952): timer handler: client dead, exiting 18:13:50 (952): No heartbeat from client for 30 sec - exiting 18:13:50 (952): timer handler: client dead, exiting 18:13:51 (952): No heartbeat from client for 30 sec - exiting 18:13:51 (952): timer handler: client dead, exiting 18:13:52 (952): No heartbeat from client for 30 sec - exiting 18:13:52 (952): timer handler: client dead, exiting 18:13:53 (952): No heartbeat from client for 30 sec - exiting 18:13:53 (952): timer handler: client dead, exiting 18:13:54 (952): No heartbeat from client for 30 sec - exiting 18:13:54 (952): timer handler: client dead, exiting 18:13:55 (952): No heartbeat from client for 30 sec - exiting 18:13:55 (952): timer handler: client dead, exiting 18:13:56 (952): No heartbeat from client for 30 sec - exiting 18:13:56 (952): timer handler: client dead, exiting 18:13:57 (952): No heartbeat from client for 30 sec - exiting 18:13:57 (952): timer handler: client dead, exiting 18:13:58 (952): No heartbeat from client for 30 sec - exiting 18:13:58 (952): timer handler: client dead, exiting 18:13:59 (952): No heartbeat from client for 30 sec - exiting 18:13:59 (952): timer handler: client dead, exiting 18:14:00 (952): No heartbeat from client for 30 sec - exiting 18:14:00 (952): timer handler: client dead, exiting 18:14:01 (952): No heartbeat from client for 30 sec - exiting 18:14:01 (952): timer handler: client dead, exiting 18:14:02 (952): No heartbeat from client for 30 sec - exiting 18:14:02 (952): timer handler: client dead, exiting 18:14:03 (952): No heartbeat from client for 30 sec - exiting 18:14:03 (952): timer handler: client dead, exiting 18:14:04 (952): No heartbeat from client for 30 sec - exiting 18:14:04 (952): timer handler: client dead, exiting 18:14:05 (952): No heartbeat from client for 30 sec - exiting 18:14:05 (952): timer handler: client dead, exiting 18:14:06 (952): No heartbeat from client for 30 sec - exiting 18:14:06 (952): timer handler: client dead, exiting 18:14:07 (952): No heartbeat from client for 30 sec - exiting 18:14:07 (952): timer handler: client dead, exiting 18:14:08 (952): No heartbeat from client for 30 sec - exiting 18:14:08 (952): timer handler: client dead, exiting 18:14:09 (952): No heartbeat from client for 30 sec - exiting 18:14:09 (952): timer handler: client dead, exiting 18:14:10 (952): No heartbeat from client for 30 sec - exiting 18:14:10 (952): timer handler: client dead, exiting 18:14:11 (952): No heartbeat from client for 30 sec - exiting 18:14:11 (952): timer handler: client dead, exiting 18:14:12 (952): No heartbeat from client for 30 sec - exiting 18:14:12 (952): timer handler: client dead, exiting 18:14:13 (952): No heartbeat from client for 30 sec - exiting 18:14:13 (952): timer handler: client dead, exiting 18:14:14 (952): No heartbeat from client for 30 sec - exiting 18:14:14 (952): timer handler: client dead, exiting 18:14:15 (952): No heartbeat from client for 30 sec - exiting 18:14:15 (952): timer handler: client dead, exiting 18:14:16 (952): No heartbeat from client for 30 sec - exiting 18:14:16 (952): timer handler: client dead, exiting 18:14:17 (952): No heartbeat from client for 30 sec - exiting 18:14:17 (952): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:14:18 (952): No heartbeat from client for 30 sec - exiting 18:14:18 (952): timer handler: client dead, exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3828, selfPID=3828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:58:05 (4960): No heartbeat from client for 30 sec - exiting 01:58:05 (4960): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2292, selfPID=2644, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Dec 2014 02:42:08	1224712	17561116	hadam3p_pnw_h2rm_2012_1_009288426_0	46,379	131,969	2.8454
19 Dec 2014 05:20:10	1224712	17561116	hadam3p_pnw_h2rm_2012_1_009288426_0	34,859	99,596	2.8571
18 Dec 2014 00:09:38	1224712	17561116	hadam3p_pnw_h2rm_2012_1_009288426_0	23,339	66,552	2.8515
16 Dec 2014 04:42:55	1224712	17561116	hadam3p_pnw_h2rm_2012_1_009288426_0	11,819	33,361	2.8227