Task 16624376

Name	hadam3p_anz_r8nc_2012_1_008740822_0
Workunit	8886800
Created	8 May 2014, 19:34:31 UTC
Sent	13 May 2014, 19:44:03 UTC
Report deadline	26 Apr 2015, 1:04:03 UTC
Received	12 Sep 2014, 21:55:04 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1320327
Run time	6 days 9 hours 19 min 16 sec
CPU time	6 days 2 hours 48 min 52 sec
Validate state	Workunit error - check skipped
Credit	5,974.74
Device peak FLOPS	3.53 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=724, selfPID=5136, iMonCtr=1 Model crash detected, will try to restart... 18:34:48 (1140): No heartbeat from core client for 30 sec - exiting 18:34:49 (1140): No heartbeat from core client for 30 sec - exiting 18:34:50 (1140): No heartbeat from core client for 30 sec - exiting 18:34:51 (1140): No heartbeat from core client for 30 sec - exiting 18:34:52 (1140): No heartbeat from core client for 30 sec - exiting 18:34:53 (1140): No heartbeat from core client for 30 sec - exiting 18:34:54 (1140): No heartbeat from core client for 30 sec - exiting 18:34:55 (1140): No heartbeat from core client for 30 sec - exiting 18:34:56 (1140): No heartbeat from core client for 30 sec - exiting 18:34:57 (1140): No heartbeat from core client for 30 sec - exiting 18:34:58 (1140): No heartbeat from core client for 30 sec - exiting 18:34:59 (1140): No heartbeat from core client for 30 sec - exiting 18:35:00 (1140): No heartbeat from core client for 30 sec - exiting 18:35:01 (1140): No heartbeat from core client for 30 sec - exiting 18:35:02 (1140): No heartbeat from core client for 30 sec - exiting 18:35:03 (1140): No heartbeat from core client for 30 sec - exiting 18:35:04 (1140): No heartbeat from core client for 30 sec - exiting 18:35:05 (1140): No heartbeat from core client for 30 sec - exiting 18:35:06 (1140): No heartbeat from core client for 30 sec - exiting 18:35:07 (1140): No heartbeat from core client for 30 sec - exiting 18:35:08 (1140): No heartbeat from core client for 30 sec - exiting 18:35:09 (1140): No heartbeat from core client for 30 sec - exiting 18:35:10 (1140): No heartbeat from core client for 30 sec - exiting 18:35:11 (1140): No heartbeat from core client for 30 sec - exiting 18:35:12 (1140): No heartbeat from core client for 30 sec - exiting 18:35:13 (1140): No heartbeat from core client for 30 sec - exiting 18:35:14 (1140): No heartbeat from core client for 30 sec - exiting 18:35:15 (1140): No heartbeat from core client for 30 sec - exiting 18:35:16 (1140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:49 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:20:48 (2148): No heartbeat from core client for 30 sec - exiting 20:20:49 (2148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:50 (2148): No heartbeat from core client for 30 sec - exiting 12:44:40 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:55:22 (3536): No heartbeat from core client for 30 sec - exiting 13:55:23 (3536): No heartbeat from core client for 30 sec - exiting 13:55:24 (3536): No heartbeat from core client for 30 sec - exiting 13:55:25 (3536): No heartbeat from core client for 30 sec - exiting 13:55:26 (3536): No heartbeat from core client for 30 sec - exiting 13:55:27 (3536): No heartbeat from core client for 30 sec - exiting 13:55:28 (3536): No heartbeat from core client for 30 sec - exiting 13:55:29 (3536): No heartbeat from core client for 30 sec - exiting 13:55:30 (3536): No heartbeat from core client for 30 sec - exiting 13:55:31 (3536): No heartbeat from core client for 30 sec - exiting 13:55:32 (3536): No heartbeat from core client for 30 sec - exiting 13:55:33 (3536): No heartbeat from core client for 30 sec - exiting 13:55:34 (3536): No heartbeat from core client for 30 sec - exiting 13:55:35 (3536): No heartbeat from core client for 30 sec - exiting 13:55:36 (3536): No heartbeat from core client for 30 sec - exiting 13:55:37 (3536): No heartbeat from core client for 30 sec - exiting 13:55:38 (3536): No heartbeat from core client for 30 sec - exiting 13:55:39 (3536): No heartbeat from core client for 30 sec - exiting 13:55:40 (3536): No heartbeat from core client for 30 sec - exiting 13:55:41 (3536): No heartbeat from core client for 30 sec - exiting 13:55:42 (3536): No heartbeat from core client for 30 sec - exiting 13:55:43 (3536): No heartbeat from core client for 30 sec - exiting 13:55:44 (3536): No heartbeat from core client for 30 sec - exiting 13:55:45 (3536): No heartbeat from core client for 30 sec - exiting 13:55:46 (3536): No heartbeat from core client for 30 sec - exiting 13:55:47 (3536): No heartbeat from core client for 30 sec - exiting 13:55:48 (3536): No heartbeat from core client for 30 sec - exiting 13:55:49 (3536): No heartbeat from core client for 30 sec - exiting 13:55:50 (3536): No heartbeat from core client for 30 sec - exiting 13:55:51 (3536): No heartbeat from core client for 30 sec - exiting 13:55:52 (3536): No heartbeat from core client for 30 sec - exiting 13:55:53 (3536): No heartbeat from core client for 30 sec - exiting 13:55:54 (3536): No heartbeat from core client for 30 sec - exiting 13:55:55 (3536): No heartbeat from core client for 30 sec - exiting 13:55:56 (3536): No heartbeat from core client for 30 sec - exiting 13:55:57 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:01:26 (4932): No heartbeat from core client for 30 sec - exiting 18:01:27 (4932): No heartbeat from core client for 30 sec - exiting 18:01:28 (4932): No heartbeat from core client for 30 sec - exiting 18:01:29 (4932): No heartbeat from core client for 30 sec - exiting 18:01:30 (4932): No heartbeat from core client for 30 sec - exiting 18:01:31 (4932): No heartbeat from core client for 30 sec - exiting 18:01:32 (4932): No heartbeat from core client for 30 sec - exiting 18:01:33 (4932): No heartbeat from core client for 30 sec - exiting 18:01:34 (4932): No heartbeat from core client for 30 sec - exiting 18:01:35 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:01:36 (4932): No heartbeat from core client for 30 sec - exiting 18:03:17 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:19:46 (5692): No heartbeat from core client for 30 sec - exiting 22:19:47 (5692): No heartbeat from core client for 30 sec - exiting 22:19:48 (5692): No heartbeat from core client for 30 sec - exiting 22:19:49 (5692): No heartbeat from core client for 30 sec - exiting 22:19:50 (5692): No heartbeat from core client for 30 sec - exiting 22:19:51 (5692): No heartbeat from core client for 30 sec - exiting 22:19:52 (5692): No heartbeat from core client for 30 sec - exiting 22:19:53 (5692): No heartbeat from core client for 30 sec - exiting 22:19:54 (5692): No heartbeat from core client for 30 sec - exiting 22:19:55 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3828, selfPID=3480, iMonCtr=1 Model crash detected, will try to restart... 20:46:40 (1656): No heartbeat from core client for 30 sec - exiting 20:46:41 (1656): No heartbeat from core client for 30 sec - exiting 20:46:42 (1656): No heartbeat from core client for 30 sec - exiting 20:46:43 (1656): No heartbeat from core client for 30 sec - exiting 20:46:44 (1656): No heartbeat from core client for 30 sec - exiting 20:46:45 (1656): No heartbeat from core client for 30 sec - exiting 20:46:46 (1656): No heartbeat from core client for 30 sec - exiting 20:46:48 (1656): No heartbeat from core client for 30 sec - exiting 20:46:49 (1656): No heartbeat from core client for 30 sec - exiting 20:46:50 (1656): No heartbeat from core client for 30 sec - exiting 20:46:51 (1656): No heartbeat from core client for 30 sec - exiting 20:46:52 (1656): No heartbeat from core client for 30 sec - exiting 20:46:53 (1656): No heartbeat from core client for 30 sec - exiting 20:46:54 (1656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:19:59 (4120): No heartbeat from core client for 30 sec - exiting 21:20:00 (4120): No heartbeat from core client for 30 sec - exiting 21:20:01 (4120): No heartbeat from core client for 30 sec - exiting 21:20:02 (4120): No heartbeat from core client for 30 sec - exiting 21:20:03 (4120): No heartbeat from core client for 30 sec - exiting 21:20:04 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:20:46 (1432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:41 (3556): No heartbeat from core client for 30 sec - exiting 21:26:42 (3556): No heartbeat from core client for 30 sec - exiting 21:26:43 (3556): No heartbeat from core client for 30 sec - exiting 21:26:44 (3556): No heartbeat from core client for 30 sec - exiting 21:26:45 (3556): No heartbeat from core client for 30 sec - exiting 21:26:47 (3556): No heartbeat from core client for 30 sec - exiting 21:26:48 (3556): No heartbeat from core client for 30 sec - exiting 21:26:49 (3556): No heartbeat from core client for 30 sec - exiting 21:26:50 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:05 (4280): No heartbeat from core client for 30 sec - exiting 21:59:06 (4280): No heartbeat from core client for 30 sec - exiting 21:59:07 (4280): No heartbeat from core client for 30 sec - exiting 21:59:08 (4280): No heartbeat from core client for 30 sec - exiting 21:59:09 (4280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:51 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=2 13:03:40 (4944): No heartbeat from core client for 30 sec - exiting 13:03:41 (4944): No heartbeat from core client for 30 sec - exiting 13:03:43 (4944): No heartbeat from core client for 30 sec - exiting 13:03:44 (4944): No heartbeat from core client for 30 sec - exiting 13:03:45 (4944): No heartbeat from core client for 30 sec - exiting 13:03:46 (4944): No heartbeat from core client for 30 sec - exiting 13:03:47 (4944): No heartbeat from core client for 30 sec - exiting 13:03:48 (4944): No heartbeat from core client for 30 sec - exiting 13:03:49 (4944): No heartbeat from core client for 30 sec - exiting 13:03:50 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:51 (4944): No heartbeat from core client for 30 sec - exiting 13:04:42 (808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4980, selfPID=4980, iMonCtr=2 14:50:29 (4236): No heartbeat from core client for 30 sec - exiting 14:50:30 (4236): No heartbeat from core client for 30 sec - exiting 14:50:31 (4236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:50:32 (4236): No heartbeat from core client for 30 sec - exiting 14:51:28 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:26:02 (2636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:51 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:03:29 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4584, selfPID=4172, iMonCtr=1 Model crash detected, will try to restart... 18:03:27 (4796): No heartbeat from core client for 30 sec - exiting 18:03:28 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:29 (4796): No heartbeat from core client for 30 sec - exiting 18:56:18 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:48 (2652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:28 (2652): No heartbeat from core client for 30 sec - exiting 20:56:42 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:47:04 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:47:11 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... G22:06:56 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:28 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1400, selfPID=1400, iMonCtr=2 22:38:46 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:17:42 (4740): No heartbeat from core client for 30 sec - exiting 00:17:43 (4740): No heartbeat from core client for 30 sec - exiting 00:17:44 (4740): No heartbeat from core client for 30 sec - exiting 00:17:45 (4740): No heartbeat from core client for 30 sec - exiting 00:17:46 (4740): No heartbeat from core client for 30 sec - exiting 00:17:47 (4740): No heartbeat from core client for 30 sec - exiting 00:17:48 (4740): No heartbeat from core client for 30 sec - exiting 00:17:49 (4740): No heartbeat from core client for 30 sec - exiting 00:17:50 (4740): No heartbeat from core client for 30 sec - exiting 00:17:51 (4740): No heartbeat from core client for 30 sec - exiting 00:17:52 (4740): No heartbeat from core client for 30 sec - exiting 00:17:53 (4740): No heartbeat from core client for 30 sec - exiting 00:17:54 (4740): No heartbeat from core client for 30 sec - exiting 00:17:55 (4740): No heartbeat from core client for 30 sec - exiting 00:17:56 (4740): No heartbeat from core client for 30 sec - exiting 00:17:57 (4740): No heartbeat from core client for 30 sec - exiting 00:17:58 (4740): No heartbeat from core client for 30 sec - exiting 00:17:59 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:52 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:30 (4400): No heartbeat from core client for 30 sec - exiting 17:12:31 (4400): No heartbeat from core client for 30 sec - exiting 17:12:32 (4400): No heartbeat from core client for 30 sec - exiting 17:12:33 (4400): No heartbeat from core client for 30 sec - exiting 17:12:34 (4400): No heartbeat from core client for 30 sec - exiting 17:12:35 (4400): No heartbeat from core client for 30 sec - exiting 17:12:36 (4400): No heartbeat from core client for 30 sec - exiting 17:12:37 (4400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:13:40 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4756, iMonCtr=2 22:00:33 (5032): No heartbeat from core client for 30 sec - exiting 22:00:34 (5032): No heartbeat from core client for 30 sec - exiting 22:00:35 (5032): No heartbeat from core client for 30 sec - exiting 22:00:36 (5032): No heartbeat from core client for 30 sec - exiting 22:00:37 (5032): No heartbeat from core client for 30 sec - exiting 22:00:38 (5032): No heartbeat from core client for 30 sec - exiting 22:00:39 (5032): No heartbeat from core client for 30 sec - exiting 22:00:40 (5032): No heartbeat from core client for 30 sec - exiting 22:00:41 (5032): No heartbeat from core client for 30 sec - exiting 22:00:42 (5032): No heartbeat from core client for 30 sec - exiting 22:00:43 (5032): No heartbeat from core client for 30 sec - exiting 22:00:44 (5032): No heartbeat from core client for 30 sec - exiting 22:00:45 (5032): No heartbeat from core client for 30 sec - exiting 22:00:46 (5032): No heartbeat from core client for 30 sec - exiting 22:00:47 (5032): No heartbeat from core client for 30 sec - exiting 22:00:48 (5032): No heartbeat from core client for 30 sec - exiting 22:00:49 (5032): No heartbeat from core client for 30 sec - exiting 22:00:50 (5032): No heartbeat from core client for 30 sec - exiting 22:00:51 (5032): No heartbeat from core client for 30 sec - exiting 22:00:52 (5032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:53 (5032): No heartbeat from core client for 30 sec - exiting 22:01:46 (3936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4616, selfPID=4616, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 19:28:05 (4144): No heartbeat from core client for 30 sec - exiting 19:28:07 (4144): No heartbeat from core client for 30 sec - exiting 19:28:08 (4144): No heartbeat from core client for 30 sec - exiting 19:28:09 (4144): No heartbeat from core client for 30 sec - exiting 19:28:10 (4144): No heartbeat from core client for 30 sec - exiting 19:28:11 (4144): No heartbeat from core client for 30 sec - exiting 19:28:12 (4144): No heartbeat from core client for 30 sec - exiting 19:28:13 (4144): No heartbeat from core client for 30 sec - exiting 19:28:14 (4144): No heartbeat from core client for 30 sec - exiting 19:28:15 (4144): No heartbeat from core client for 30 sec - exiting 19:28:16 (4144): No heartbeat from core client for 30 sec - exiting 19:28:17 (4144): No heartbeat from core client for 30 sec - exiting 19:28:18 (4144): No heartbeat from core client for 30 sec - exiting 19:28:19 (4144): No heartbeat from core client for 30 sec - exiting 19:28:20 (4144): No heartbeat from core client for 30 sec - exiting 19:28:21 (4144): No heartbeat from core client for 30 sec - exiting 19:28:22 (4144): No heartbeat from core client for 30 sec - exiting 19:28:23 (4144): No heartbeat from core client for 30 sec - exiting 19:28:24 (4144): No heartbeat from core client for 30 sec - exiting 19:28:25 (4144): No heartbeat from core client for 30 sec - exiting 19:28:26 (4144): No heartbeat from core client for 30 sec - exiting 19:28:27 (4144): No heartbeat from core client for 30 sec - exiting 19:28:28 (4144): No heartbeat from core client for 30 sec - exiting 19:28:29 (4144): No heartbeat from core client for 30 sec - exiting 19:28:30 (4144): No heartbeat from core client for 30 sec - exiting 19:28:31 (4144): No heartbeat from core client for 30 sec - exiting 19:28:32 (4144): No heartbeat from core client for 30 sec - exiting 19:28:33 (4144): No heartbeat from core client for 30 sec - exiting 19:28:34 (4144): No heartbeat from core client for 30 sec - exiting 19:28:35 (4144): No heartbeat from core client for 30 sec - exiting 19:28:36 (4144): No heartbeat from core client for 30 sec - exiting 19:28:37 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:31:45 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:58 (3464): No heartbeat from core client for 30 sec - exiting 18:09:59 (3464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Sep 2014 20:59:16	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	138,539	528,141	3.8122
11 Sep 2014 17:22:36	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	127,019	484,851	3.8172
08 Sep 2014 20:09:51	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	115,499	440,214	3.8114
07 Sep 2014 13:26:28	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	103,979	395,214	3.8009
30 Aug 2014 01:23:13	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	92,459	349,405	3.7790
29 Aug 2014 11:11:12	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	80,939	303,516	3.7499
29 Aug 2014 11:11:12	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	69,419	265,120	3.8191
29 Aug 2014 09:14:55	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	57,899	228,882	3.9531
25 Aug 2014 19:32:24	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	46,379	182,802	3.9415
23 Aug 2014 12:27:10	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	34,859	138,393	3.9701
29 Jun 2014 12:16:52	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	23,339	92,246	3.9524
20 Jun 2014 11:06:52	1320327	16624376	hadam3p_anz_r8nc_2012_1_008740822_0	11,819	46,146	3.9044