Task 17606042

Name	hadam3p_anz_c3pw_2012_1_009312285_1
Workunit	9396473
Created	19 Dec 2014, 4:47:02 UTC
Sent	19 Dec 2014, 5:11:42 UTC
Report deadline	1 Dec 2015, 10:31:42 UTC
Received	17 Jan 2015, 23:22:14 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	957844
Run time	10 days 7 hours 14 min 22 sec
CPU time	10 days 7 hours 14 min 22 sec
Validate state	Workunit error - check skipped
Credit	5,974.74
Device peak FLOPS	2.96 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>6.4.7</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6112, selfPID=2136, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2864, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4756, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1332, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3456, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7384, selfPID=6020, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=01:50:12 (5908): No heartbeat from core client for 30 sec - exiting 01:50:13 (5908): No heartbeat from core client for 30 sec - exiting 01:50:14 (5908): No heartbeat from core client for 30 sec - exiting 01:50:15 (5908): No heartbeat from core client for 30 sec - exiting 01:50:16 (5908): No heartbeat from core client for 30 sec - exiting 01:50:17 (5908): No heartbeat from core client for 30 sec - exiting 01:50:18 (5908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:51 (3140): No heartbeat from core client for 30 sec - exiting 02:09:52 (3140): No heartbeat from core client for 30 sec - exiting 02:09:53 (3140): No heartbeat from core client for 30 sec - exiting 02:09:54 (3140): No heartbeat from core client for 30 sec - exiting 02:09:55 (3140): No heartbeat from core client for 30 sec - exiting 02:09:56 (3140): No heartbeat from core client for 30 sec - exiting 02:09:57 (3140): No heartbeat from core client for 30 sec - exiting 02:09:58 (3140): No heartbeat from core client for 30 sec - exiting 02:09:59 (3140): No heartbeat from core client for 30 sec - exiting 02:10:00 (3140): No heartbeat from core client for 30 sec - exiting 02:10:01 (3140): No heartbeat from core client for 30 sec - exiting 02:10:02 (3140): No heartbeat from core client for 30 sec - exiting 02:10:03 (3140): No heartbeat from core client for 30 sec - exiting 02:10:04 (3140): No heartbeat from core client for 30 sec - exiting 02:10:05 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4864, iMonCtr=2 13:36:17 (5024): No heartbeat from core client for 30 sec - exiting 13:36:18 (5024): No heartbeat from core client for 30 sec - exiting 13:36:19 (5024): No heartbeat from core client for 30 sec - exiting 13:36:20 (5024): No heartbeat from core client for 30 sec - exiting 13:36:21 (5024): No heartbeat from core client for 30 sec - exiting 13:36:22 (5024): No heartbeat from core client for 30 sec - exiting 13:36:23 (5024): No heartbeat from core client for 30 sec - exiting 13:36:24 (5024): No heartbeat from core client for 30 sec - exiting 13:36:25 (5024): No heartbeat from core client for 30 sec - exiting 13:36:26 (5024): No heartbeat from core client for 30 sec - exiting 13:36:27 (5024): No heartbeat from core client for 30 sec - exiting 13:36:28 (5024): No heartbeat from core client for 30 sec - exiting 13:36:29 (5024): No heartbeat from core client for 30 sec - exiting 13:36:30 (5024): No heartbeat from core client for 30 sec - exiting 13:36:31 (5024): No heartbeat from core client for 30 sec - exiting 13:36:32 (5024): No heartbeat from core client for 30 sec - exiting 13:36:33 (5024): No heartbeat from core client for 30 sec - exiting 13:36:34 (5024): No heartbeat from core client for 30 sec - exiting 13:36:35 (5024): No heartbeat from core client for 30 sec - exiting 13:36:36 (5024): No heartbeat from core client for 30 sec - exiting 13:36:37 (5024): No heartbeat from core client for 30 sec - exiting 13:36:38 (5024): No heartbeat from core client for 30 sec - exiting 13:36:39 (5024): No heartbeat from core client for 30 sec - exiting 13:36:40 (5024): No heartbeat from core client for 30 sec - exiting 13:36:41 (5024): No heartbeat from core client for 30 sec - exiting 13:36:42 (5024): No heartbeat from core client for 30 sec - exiting 13:36:43 (5024): No heartbeat from core client for 30 sec - exiting 13:36:44 (5024): No heartbeat from core client for 30 sec - exiting 13:36:45 (5024): No heartbeat from core client for 30 sec - exiting 13:36:46 (5024): No heartbeat from core client for 30 sec - exiting 13:36:47 (5024): No heartbeat from core client for 30 sec - exiting 13:36:48 (5024): No heartbeat from core client for 30 sec - exiting 13:36:49 (5024): No heartbeat from core client for 30 sec - exiting 13:36:50 (5024): No heartbeat from core client for 30 sec - exiting 13:36:51 (5024): No heartbeat from core client for 30 sec - exiting 13:36:52 (5024): No heartbeat from core client for 30 sec - exiting 13:36:53 (5024): No heartbeat from core client for 30 sec - exiting 13:36:54 (5024): No heartbeat from core client for 30 sec - exiting 13:36:55 (5024): No heartbeat from core client for 30 sec - exiting 13:36:56 (5024): No heartbeat from core client for 30 sec - exiting 13:36:57 (5024): No heartbeat from core client for 30 sec - exiting 13:36:58 (5024): No heartbeat from core client for 30 sec - exiting 13:36:59 (5024): No heartbeat from core client for 30 sec - exiting 13:37:00 (5024): No heartbeat from core client for 30 sec - exiting 13:37:01 (5024): No heartbeat from core client for 30 sec - exiting 13:37:02 (5024): No heartbeat from core client for 30 sec - exiting 13:37:03 (5024): No heartbeat from core client for 30 sec - exiting 13:37:04 (5024): No heartbeat from core client for 30 sec - exiting 13:37:05 (5024): No heartbeat from core client for 30 sec - exiting 13:37:06 (5024): No heartbeat from core client for 30 sec - exiting 13:37:07 (5024): No heartbeat from core client for 30 sec - exiting 13:37:08 (5024): No heartbeat from core client for 30 sec - exiting 13:37:09 (5024): No heartbeat from core client for 30 sec - exiting 13:37:10 (5024): No heartbeat from core client for 30 sec - exiting 13:37:11 (5024): No heartbeat from core client for 30 sec - exiting 13:37:12 (5024): No heartbeat from core client for 30 sec - exiting 13:37:13 (5024): No heartbeat from core client for 30 sec - exiting 13:37:14 (5024): No heartbeat from core client for 30 sec - exiting 13:37:15 (5024): No heartbeat from core client for 30 sec - exiting 13:37:16 (5024): No heartbeat from core client for 30 sec - exiting 13:37:17 (5024): No heartbeat from core client for 30 sec - exiting 13:37:18 (5024): No heartbeat from core client for 30 sec - exiting 13:37:19 (5024): No heartbeat from core client for 30 sec - exiting 13:37:20 (5024): No heartbeat from core client for 30 sec - exiting 13:37:21 (5024): No heartbeat from core client for 30 sec - exiting 13:37:22 (5024): No heartbeat from core client for 30 sec - exiting 13:37:23 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:08 (1088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:53 (6236): No heartbeat from core client for 30 sec - exiting 01:18:54 (6236): No heartbeat from core client for 30 sec - exiting 01:18:55 (6236): No heartbeat from core client for 30 sec - exiting 01:18:56 (6236): No heartbeat from core client for 30 sec - exiting 01:18:57 (6236): No heartbeat from core client for 30 sec - exiting 01:18:58 (6236): No heartbeat from core client for 30 sec - exiting 01:18:59 (6236): No heartbeat from core client for 30 sec - exiting 01:19:00 (6236): No heartbeat from core client for 30 sec - exiting 01:19:01 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:45:44 (868): No heartbeat from core client for 30 sec - exiting 11:45:45 (868): No heartbeat from core client for 30 sec - exiting 11:45:46 (868): No heartbeat from core client for 30 sec - exiting 11:45:47 (868): No heartbeat from core client for 30 sec - exiting 11:45:48 (868): No heartbeat from core client for 30 sec - exiting 11:45:49 (868): No heartbeat from core client for 30 sec - exiting 11:45:50 (868): No heartbeat from core client for 30 sec - exiting 11:45:51 (868): No heartbeat from core client for 30 sec - exiting 11:45:52 (868): No heartbeat from core client for 30 sec - exiting 11:45:53 (868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:45:27 (4344): No heartbeat from core client for 30 sec - exiting 23:45:28 (4344): No heartbeat from core client for 30 sec - exiting 23:45:29 (4344): No heartbeat from core client for 30 sec - exiting 23:45:30 (4344): No heartbeat from core client for 30 sec - exiting 23:45:31 (4344): No heartbeat from core client for 30 sec - exiting 23:45:32 (4344): No heartbeat from core client for 30 sec - exiting 23:45:33 (4344): No heartbeat from core client for 30 sec - exiting 23:45:34 (4344): No heartbeat from core client for 30 sec - exiting 23:45:35 (4344): No heartbeat from core client for 30 sec - exiting 23:45:36 (4344): No heartbeat from core client for 30 sec - exiting 23:45:37 (4344): No heartbeat from core client for 30 sec - exiting 23:45:38 (4344): No heartbeat from core client for 30 sec - exiting 23:45:39 (4344): No heartbeat from core client for 30 sec - exiting 23:45:40 (4344): No heartbeat from core client for 30 sec - exiting 23:45:41 (4344): No heartbeat from core client for 30 sec - exiting 23:45:42 (4344): No heartbeat from core client for 30 sec - exiting 23:45:43 (4344): No heartbeat from core client for 30 sec - exiting 23:45:44 (4344): No heartbeat from core client for 30 sec - exiting 23:45:45 (4344): No heartbeat from core client for 30 sec - exiting 23:45:46 (4344): No heartbeat from core client for 30 sec - exiting 23:45:47 (4344): No heartbeat from core client for 30 sec - exiting 23:45:48 (4344): No heartbeat from core client for 30 sec - exiting 23:45:49 (4344): No heartbeat from core client for 30 sec - exiting 23:45:50 (4344): No heartbeat from core client for 30 sec - exiting 23:45:51 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4576, selfPID=4576, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4848, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5720, selfPID=4468, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 00:15:47 (2564): No heartbeat from core client for 30 sec - exiting 00:15:49 (2564): No heartbeat from core client for 30 sec - exiting 00:15:50 (2564): No heartbeat from core client for 30 sec - exiting 00:15:51 (2564): No heartbeat from core client for 30 sec - exiting 00:15:52 (2564): No heartbeat from core client for 30 sec - exiting 00:15:53 (2564): No heartbeat from core client for 30 sec - exiting 00:15:54 (2564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5512, iMonCtr=2 13:38:51 (5756): No heartbeat from core client for 30 sec - exiting 13:38:52 (5756): No heartbeat from core client for 30 sec - exiting 13:38:53 (5756): No heartbeat from core client for 30 sec - exiting 13:38:54 (5756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:49 (5404): No heartbeat from core client for 30 sec - exiting 23:36:50 (5404): No heartbeat from core client for 30 sec - exiting 23:36:51 (5404): No heartbeat from core client for 30 sec - exiting 23:36:52 (5404): No heartbeat from core client for 30 sec - exiting 23:36:53 (5404): No heartbeat from core client for 30 sec - exiting 23:36:54 (5404): No heartbeat from core client for 30 sec - exiting 23:36:55 (5404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:08:11 (1464): No heartbeat from core client for 30 sec - exiting 10:08:12 (1464): No heartbeat from core client for 30 sec - exiting 10:08:13 (1464): No heartbeat from core client for 30 sec - exiting 10:08:14 (1464): No heartbeat from core client for 30 sec - exiting 10:08:15 (1464): No heartbeat from core client for 30 sec - exiting 10:08:16 (1464): No heartbeat from core client for 30 sec - exiting 10:08:17 (1464): No heartbeat from core client for 30 sec - exiting 10:08:18 (1464): No heartbeat from core client for 30 sec - exiting 10:08:19 (1464): No heartbeat from core client for 30 sec - exiting 10:08:20 (1464): No heartbeat from core client for 30 sec - exiting 10:08:21 (1464): No heartbeat from core client for 30 sec - exiting 10:08:22 (1464): No heartbeat from core client for 30 sec - exiting 10:08:23 (1464): No heartbeat from core client for 30 sec - exiting 10:08:24 (1464): No heartbeat from core client for 30 sec - exiting 10:08:25 (1464): No heartbeat from core client for 30 sec - exiting 10:08:26 (1464): No heartbeat from core client for 30 sec - exiting 10:08:27 (1464): No heartbeat from core client for 30 sec - exiting 10:08:28 (1464): No heartbeat from core client for 30 sec - exiting 10:08:29 (1464): No heartbeat from core client for 30 sec - exiting 10:08:30 (1464): No heartbeat from core client for 30 sec - exiting 10:08:31 (1464): No heartbeat from core client for 30 sec - exiting 10:08:32 (1464): No heartbeat from core client for 30 sec - exiting 10:08:33 (1464): No heartbeat from core client for 30 sec - exiting 10:08:34 (1464): No heartbeat from core client for 30 sec - exiting 10:08:35 (1464): No heartbeat from core client for 30 sec - exiting 10:08:36 (1464): No heartbeat from core client for 30 sec - exiting 10:08:37 (1464): No heartbeat from core client for 30 sec - exiting 10:08:38 (1464): No heartbeat from core client for 30 sec - exiting 10:08:39 (1464): No heartbeat from core client for 30 sec - exiting 10:08:40 (1464): No heartbeat from core client for 30 sec - exiting 10:08:41 (1464): No heartbeat from core client for 30 sec - exiting 10:08:42 (1464): No heartbeat from core client for 30 sec - exiting 10:08:43 (1464): No heartbeat from core client for 30 sec - exiting 10:08:44 (1464): No heartbeat from core client for 30 sec - exiting 10:08:45 (1464): No heartbeat from core client for 30 sec - exiting 10:08:46 (1464): No heartbeat from core client for 30 sec - exiting 10:08:47 (1464): No heartbeat from core client for 30 sec - exiting 10:08:48 (1464): No heartbeat from core client for 30 sec - exiting 10:08:49 (1464): No heartbeat from core client for 30 sec - exiting 10:08:50 (1464): No heartbeat from core client for 30 sec - exiting 10:08:51 (1464): No heartbeat from core client for 30 sec - exiting 10:08:52 (1464): No heartbeat from core client for 30 sec - exiting 10:08:53 (1464): No heartbeat from core client for 30 sec - exiting 10:08:54 (1464): No heartbeat from core client for 30 sec - exiting 10:08:55 (1464): No heartbeat from core client for 30 sec - exiting 10:08:56 (1464): No heartbeat from core client for 30 sec - exiting 10:08:57 (1464): No heartbeat from core client for 30 sec - exiting 10:08:58 (1464): No heartbeat from core client for 30 sec - exiting 10:08:59 (1464): No heartbeat from core client for 30 sec - exiting 10:09:00 (1464): No heartbeat from core client for 30 sec - exiting 10:09:01 (1464): No heartbeat from core client for 30 sec - exiting 10:09:02 (1464): No heartbeat from core client for 30 sec - exiting 10:09:03 (1464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:26 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:27:45 (4520): No heartbeat from core client for 30 sec - exiting 11:27:46 (4520): No heartbeat from core client for 30 sec - exiting 11:27:47 (4520): No heartbeat from core client for 30 sec - exiting 11:27:48 (4520): No heartbeat from core client for 30 sec - exiting 11:27:49 (4520): No heartbeat from core client for 30 sec - exiting 11:27:50 (4520): No heartbeat from core client for 30 sec - exiting 11:27:51 (4520): No heartbeat from core client for 30 sec - exiting 11:27:52 (4520): No heartbeat from core client for 30 sec - exiting 11:27:54 (4520): No heartbeat from core client for 30 sec - exiting 11:27:55 (4520): No heartbeat from core client for 30 sec - exiting 11:27:56 (4520): No heartbeat from core client for 30 sec - exiting 11:27:57 (4520): No heartbeat from core client for 30 sec - exiting 11:27:58 (4520): No heartbeat from core client for 30 sec - exiting 11:27:59 (4520): No heartbeat from core client for 30 sec - exiting 11:28:00 (4520): No heartbeat from core client for 30 sec - exiting 11:28:01 (4520): No heartbeat from core client for 30 sec - exiting 11:28:02 (4520): No heartbeat from core client for 30 sec - exiting 11:28:03 (4520): No heartbeat from core client for 30 sec - exiting 11:28:04 (4520): No heartbeat from core client for 30 sec - exiting 11:28:05 (4520): No heartbeat from core client for 30 sec - exiting 11:28:06 (4520): No heartbeat from core client for 30 sec - exiting 11:28:07 (4520): No heartbeat from core client for 30 sec - exiting 11:28:08 (4520): No heartbeat from core client for 30 sec - exiting 11:28:09 (4520): No heartbeat from core client for 30 sec - exiting 11:28:10 (4520): No heartbeat from core client for 30 sec - exiting 11:28:11 (4520): No heartbeat from core client for 30 sec - exiting 11:28:12 (4520): No heartbeat from core client for 30 sec - exiting 11:28:13 (4520): No heartbeat from core client for 30 sec - exiting 11:28:14 (4520): No heartbeat from core client for 30 sec - exiting 11:28:15 (4520): No heartbeat from core client for 30 sec - exiting 11:28:16 (4520): No heartbeat from core client for 30 sec - exiting 11:28:17 (4520): No heartbeat from core client for 30 sec - exiting 11:28:18 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:11:14 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:11:16 (4276): No heartbeat from core client for 30 sec - exiting 09:22:38 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4352, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2468, selfPID=5084, iMonCtr=1 Model crash detected, will try to restart... 23:29:32 (4912): No heartbeat from core client for 30 sec - exiting 23:29:33 (4912): No heartbeat from core client for 30 sec - exiting 23:29:34 (4912): No heartbeat from core client for 30 sec - exiting 23:29:35 (4912): No heartbeat from core client for 30 sec - exiting 23:29:36 (4912): No heartbeat from core client for 30 sec - exiting 23:29:37 (4912): No heartbeat from core client for 30 sec - exiting 23:29:38 (4912): No heartbeat from core client for 30 sec - exiting 23:29:39 (4912): No heartbeat from core client for 30 sec - exiting 23:29:40 (4912): No heartbeat from core client for 30 sec - exiting 23:29:41 (4912): No heartbeat from core client for 30 sec - exiting 23:29:42 (4912): No heartbeat from core client for 30 sec - exiting 23:29:43 (4912): No heartbeat from core client for 30 sec - exiting 23:29:44 (4912): No heartbeat from core client for 30 sec - exiting 23:29:45 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Jan 2015 11:17:59	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	138,539	889,448	6.4202
13 Jan 2015 02:28:31	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	127,019	811,384	6.3879
11 Jan 2015 19:40:26	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	115,499	740,545	6.4117
09 Jan 2015 10:28:43	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	103,979	670,778	6.4511
08 Jan 2015 16:18:39	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	92,459	594,387	6.4287
08 Jan 2015 16:18:39	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	80,939	523,243	6.4647
04 Jan 2015 07:22:58	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	69,419	450,825	6.4943
02 Jan 2015 22:02:59	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	57,899	381,857	6.5952
31 Dec 2014 01:11:40	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	46,379	308,401	6.6496
29 Dec 2014 20:40:58	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	34,859	230,219	6.6043
21 Dec 2014 22:53:44	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	23,339	156,662	6.7125
20 Dec 2014 10:53:54	957844	17606042	hadam3p_anz_c3pw_2012_1_009312285_1	11,819	73,586	6.2261