Task 16402836

Name	hadam3p_anz_natu_2012_1_008587722_0
Workunit	8734234
Created	25 Mar 2014, 20:05:34 UTC
Sent	25 Mar 2014, 22:08:28 UTC
Report deadline	8 Mar 2015, 3:28:28 UTC
Received	23 Jun 2014, 18:49:18 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1143523
Run time	12 days 9 hours 12 min 19 sec
CPU time	11 days 13 hours 52 min 51 sec
Validate state	Workunit error - check skipped
Credit	5,974.74
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=936, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5556, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4060, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3236, iMonCtr=2 Model crash detected, will try to restart... 19:27:18 (4532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4956, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6344, selfPID=5168, iMonCtr=1 Model crash detected, will try to restart... CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5580, iMonCtr=2 GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3496, selfPID=5768, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5996, selfPID=4424, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5448, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5752, selfPID=3280, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3324, selfPID=4832, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5244, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5940, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5728, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3044, iMonCtr=2 16:13:01 (4244): No heartbeat from core client for 30 sec - exiting 16:13:02 (4244): No heartbeat from core client for 30 sec - exiting 16:13:03 (4244): No heartbeat from core client for 30 sec - exiting 16:13:04 (4244): No heartbeat from core client for 30 sec - exiting 16:13:05 (4244): No heartbeat from core client for 30 sec - exiting 16:13:06 (4244): No heartbeat from core client for 30 sec - exiting 16:13:07 (4244): No heartbeat from core client for 30 sec - exiting 16:13:08 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:29 (4908): No heartbeat from core client for 30 sec - exiting 20:56:30 (4908): No heartbeat from core client for 30 sec - exiting 20:56:31 (4908): No heartbeat from core client for 30 sec - exiting 20:56:32 (4908): No heartbeat from core client for 30 sec - exiting 20:56:33 (4908): No heartbeat from core client for 30 sec - exiting 20:56:34 (4908): No heartbeat from core client for 30 sec - exiting 20:56:35 (4908): No heartbeat from core client for 30 sec - exiting 20:56:36 (4908): No heartbeat from core client for 30 sec - exiting 20:56:37 (4908): No heartbeat from core client for 30 sec - exiting 20:56:38 (4908): No heartbeat from core client for 30 sec - exiting 20:56:39 (4908): No heartbeat from core client for 30 sec - exiting 20:56:40 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:31:35 (3324): No heartbeat from core client for 30 sec - exiting 18:31:36 (3324): No heartbeat from core client for 30 sec - exiting 18:31:37 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5652, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5176, iMonCtr=2 18:11:02 (5056): No heartbeat from core client for 30 sec - exiting 18:11:03 (5056): No heartbeat from core client for 30 sec - exiting 18:11:04 (5056): No heartbeat from core client for 30 sec - exiting 18:11:05 (5056): No heartbeat from core client for 30 sec - exiting 18:11:06 (5056): No heartbeat from core client for 30 sec - exiting 18:11:07 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6096, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5172, selfPID=5072, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6088, iMonCtr=2 18:22:32 (4428): No heartbeat from core client for 30 sec - exiting 18:22:33 (4428): No heartbeat from core client for 30 sec - exiting 18:22:34 (4428): No heartbeat from core client for 30 sec - exiting 18:22:35 (4428): No heartbeat from core client for 30 sec - exiting 18:22:36 (4428): No heartbeat from core client for 30 sec - exiting 18:22:37 (4428): No heartbeat from core client for 30 sec - exiting 18:22:38 (4428): No heartbeat from core client for 30 sec - exiting 18:22:39 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:53:58 (6068): No heartbeat from core client for 30 sec - exiting 14:53:59 (6068): No heartbeat from core client for 30 sec - exiting 14:54:00 (6068): No heartbeat from core client for 30 sec - exiting 14:54:01 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:55 (4552): No heartbeat from core client for 30 sec - exiting 18:17:56 (4552): No heartbeat from core client for 30 sec - exiting 18:17:57 (4552): No heartbeat from core client for 30 sec - exiting 18:17:58 (4552): No heartbeat from core client for 30 sec - exiting 18:17:59 (4552): No heartbeat from core client for 30 sec - exiting 18:18:00 (4552): No heartbeat from core client for 30 sec - exiting 18:18:01 (4552): No heartbeat from core client for 30 sec - exiting 18:18:02 (4552): No heartbeat from core client for 30 sec - exiting 18:18:03 (4552): No heartbeat from core client for 30 sec - exiting 18:18:04 (4552): No heartbeat from core client for 30 sec - exiting 18:18:05 (4552): No heartbeat from core client for 30 sec - exiting 18:18:06 (4552): No heartbeat from core client for 30 sec - exiting 18:18:07 (4552): No heartbeat from core client for 30 sec - exiting 18:18:08 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:43 (4596): No heartbeat from core client for 30 sec - exiting 12:39:44 (4596): No heartbeat from core client for 30 sec - exiting 12:39:45 (4596): No heartbeat from core client for 30 sec - exiting 12:39:46 (4596): No heartbeat from core client for 30 sec - exiting 12:39:47 (4596): No heartbeat from core client for 30 sec - exiting 12:39:48 (4596): No heartbeat from core client for 30 sec - exiting 12:39:49 (4596): No heartbeat from core client for 30 sec - exiting 12:39:50 (4596): No heartbeat from core client for 30 sec - exiting 12:39:51 (4596): No heartbeat from core client for 30 sec - exiting 12:39:52 (4596): No heartbeat from core client for 30 sec - exiting 12:39:53 (4596): No heartbeat from core client for 30 sec - exiting 12:39:54 (4596): No heartbeat from core client for 30 sec - exiting 12:39:55 (4596): No heartbeat from core client for 30 sec - exiting 12:39:56 (4596): No heartbeat from core client for 30 sec - exiting 12:39:57 (4596): No heartbeat from core client for 30 sec - exiting 12:39:58 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:56:36 (4584): No heartbeat from core client for 30 sec - exiting 18:56:37 (4584): No heartbeat from core client for 30 sec - exiting 18:56:38 (4584): No heartbeat from core client for 30 sec - exiting 18:56:39 (4584): No heartbeat from core client for 30 sec - exiting 18:56:40 (4584): No heartbeat from core client for 30 sec - exiting 18:56:41 (4584): No heartbeat from core client for 30 sec - exiting 18:56:42 (4584): No heartbeat from core client for 30 sec - exiting 18:56:43 (4584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5688, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6136, selfPID=4916, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6044, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5444, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5592, selfPID=4772, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5748, iMonCtr=2 CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5088, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4312, selfPID=2356, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5428, selfPID=5428, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2616, selfPID=4124, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:41:01 (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4796, selfPID=4796, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5412, selfPID=3700, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5348, selfPID=4460, iMonCtr=1 Model crash detected, will try to restart... 14:08:36 (4292): No heartbeat from core client for 30 sec - exiting 14:08:37 (4292): No heartbeat from core client for 30 sec - exiting 14:08:38 (4292): No heartbeat from core client for 30 sec - exiting 14:08:39 (4292): No heartbeat from core client for 30 sec - exiting 14:08:40 (4292): No heartbeat from core client for 30 sec - exiting 14:08:41 (4292): No heartbeat from core client for 30 sec - exiting 14:08:42 (4292): No heartbeat from core client for 30 sec - exiting 14:08:43 (4292): No heartbeat from core client for 30 sec - exiting 14:08:44 (4292): No heartbeat from core client for 30 sec - exiting 14:08:45 (4292): No heartbeat from core client for 30 sec - exiting 14:08:46 (4292): No heartbeat from core client for 30 sec - exiting 14:08:47 (4292): No heartbeat from core client for 30 sec - exiting 14:08:48 (4292): No heartbeat from core client for 30 sec - exiting 14:08:49 (4292): No heartbeat from core client for 30 sec - exiting 14:08:50 (4292): No heartbeat from core client for 30 sec - exiting 14:08:51 (4292): No heartbeat from core client for 30 sec - exiting 14:08:52 (4292): No heartbeat from core client for 30 sec - exiting 14:08:53 (4292): No heartbeat from core client for 30 sec - exiting 14:08:54 (4292): No heartbeat from core client for 30 sec - exiting 14:08:55 (4292): No heartbeat from core client for 30 sec - exiting 14:08:56 (4292): No heartbeat from core client for 30 sec - exiting 14:08:57 (4292): No heartbeat from core client for 30 sec - exiting 14:08:58 (4292): No heartbeat from core client for 30 sec - exiting 14:08:59 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4836, iMonCtr=2 10:26:50 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5340, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2356, selfPID=5540, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6000, selfPID=4152, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5956, selfPID=5956, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3928, selfPID=6120, iMonCtr=1 Model crash detected, will try to restart... GSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5432, selfPID=5156, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5196, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=2 GGController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6852, selfPID=3296, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3712, selfPID=7400, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8464, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1044, selfPID=5128, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3300, selfPID=5720, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3580, selfPID=5112, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2628, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5012, selfPID=5392, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2188, selfPID=5276, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5672, selfPID=5256, iMonCtr=1 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jun 2014 17:34:45	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	138,539	999,648	7.2156
19 Jun 2014 01:20:01	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	127,019	917,927	7.2267
11 Jun 2014 22:08:26	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	115,499	833,679	7.2181
03 Jun 2014 22:24:07	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	103,979	748,419	7.1978
27 May 2014 00:09:27	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	92,459	666,086	7.2041
23 May 2014 20:18:45	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	80,939	582,061	7.1914
17 May 2014 04:30:36	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	69,419	499,844	7.2004
10 May 2014 19:38:12	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	57,899	416,108	7.1868
03 May 2014 00:15:45	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	46,379	332,783	7.1753
27 Apr 2014 21:26:37	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	34,859	248,515	7.1291
17 Apr 2014 01:22:58	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	23,339	165,928	7.1095
05 Apr 2014 17:35:31	1143523	16402836	hadam3p_anz_natu_2012_1_008587722_0	11,819	82,939	7.0174