Task 12256281

Name	hadam3p_saf_1ki4_1987_1_006973604_0
Workunit	7176920
Created	23 Nov 2010, 14:16:49 UTC
Sent	28 Feb 2011, 8:21:14 UTC
Report deadline	10 Feb 2012, 13:41:14 UTC
Received	21 May 2011, 6:12:06 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1107482
Run time	4 days 6 hours 41 min 26 sec
CPU time	4 days 4 hours 12 min 26 sec
Validate state	Workunit error - check skipped
Credit	2,244.09
Device peak FLOPS	2.94 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> 13:49:02 (3132): No heartbeat from core client for 30 sec - exiting 13:49:03 (3132): No heartbeat from core client for 30 sec - exiting 13:49:04 (3132): No heartbeat from core client for 30 sec - exiting 13:49:05 (3132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:00:58 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:00:44 (2996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4908, selfPID=4908, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 09:26:05 (4444): No heartbeat from core client for 30 sec - exiting 09:26:06 (4444): No heartbeat from core client for 30 sec - exiting 09:26:07 (4444): No heartbeat from core client for 30 sec - exiting 09:26:08 (4444): No heartbeat from core client for 30 sec - exiting 09:26:09 (4444): No heartbeat from core client for 30 sec - exiting 09:26:11 (4444): No heartbeat from core client for 30 sec - exiting 09:26:12 (4444): No heartbeat from core client for 30 sec - exiting 09:26:13 (4444): No heartbeat from core client for 30 sec - exiting 09:26:14 (4444): No heartbeat from core client for 30 sec - exiting 09:26:15 (4444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5500, selfPID=5500, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3044, selfPID=5988, iMonCtr=1 Model crash detected, will try to restart... 10:41:30 (4276): No heartbeat from core client for 30 sec - exiting 10:41:31 (4276): No heartbeat from core client for 30 sec - exiting 10:41:32 (4276): No heartbeat from core client for 30 sec - exiting 10:41:33 (4276): No heartbeat from core client for 30 sec - exiting 10:41:34 (4276): No heartbeat from core client for 30 sec - exiting 10:41:36 (4276): No heartbeat from core client for 30 sec - exiting 10:41:37 (4276): No heartbeat from core client for 30 sec - exiting 10:41:38 (4276): No heartbeat from core client for 30 sec - exiting 10:41:39 (4276): No heartbeat from core client for 30 sec - exiting 10:41:40 (4276): No heartbeat from core client for 30 sec - exiting 10:41:41 (4276): No heartbeat from core client for 30 sec - exiting 10:41:42 (4276): No heartbeat from core client for 30 sec - exiting 10:41:43 (4276): No heartbeat from core client for 30 sec - exiting 10:41:44 (4276): No heartbeat from core client for 30 sec - exiting 10:41:45 (4276): No heartbeat from core client for 30 sec - exiting 10:41:46 (4276): No heartbeat from core client for 30 sec - exiting 10:41:48 (4276): No heartbeat from core client for 30 sec - exiting 10:41:49 (4276): No heartbeat from core client for 30 sec - exiting 10:41:50 (4276): No heartbeat from core client for 30 sec - exiting 10:41:51 (4276): No heartbeat from core client for 30 sec - exiting 10:41:52 (4276): No heartbeat from core client for 30 sec - exiting 10:41:53 (4276): No heartbeat from core client for 30 sec - exiting 10:41:54 (4276): No heartbeat from core client for 30 sec - exiting 10:41:55 (4276): No heartbeat from core client for 30 sec - exiting 10:41:56 (4276): No heartbeat from core client for 30 sec - exiting 10:41:57 (4276): No heartbeat from core client for 30 sec - exiting 10:41:58 (4276): No heartbeat from core client for 30 sec - exiting 10:42:00 (4276): No heartbeat from core client for 30 sec - exiting 10:42:01 (4276): No heartbeat from core client for 30 sec - exiting 10:42:02 (4276): No heartbeat from core client for 30 sec - exiting 10:42:03 (4276): No heartbeat from core client for 30 sec - exiting 10:42:04 (4276): No heartbeat from core client for 30 sec - exiting 10:42:05 (4276): No heartbeat from core client for 30 sec - exiting 10:42:06 (4276): No heartbeat from core client for 30 sec - exiting 10:42:07 (4276): No heartbeat from core client for 30 sec - exiting 10:42:08 (4276): No heartbeat from core client for 30 sec - exiting 10:42:09 (4276): No heartbeat from core client for 30 sec - exiting 10:42:10 (4276): No heartbeat from core client for 30 sec - exiting 10:42:12 (4276): No heartbeat from core client for 30 sec - exiting 10:42:13 (4276): No heartbeat from core client for 30 sec - exiting 10:42:14 (4276): No heartbeat from core client for 30 sec - exiting 10:42:15 (4276): No heartbeat from core client for 30 sec - exiting 10:42:16 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:17 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:12:44 (1348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3232, selfPID=3232, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4480, selfPID=1132, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4572, selfPID=3784, iMonCtr=1 Model crash detected, will try to restart... 09:48:02 (3044): No heartbeat from core client for 30 sec - exiting 09:48:03 (3044): No heartbeat from core client for 30 sec - exiting 09:48:04 (3044): No heartbeat from core client for 30 sec - exiting 09:48:05 (3044): No heartbeat from core client for 30 sec - exiting 09:48:06 (3044): No heartbeat from core client for 30 sec - exiting 09:48:07 (3044): No heartbeat from core client for 30 sec - exiting 09:48:08 (3044): No heartbeat from core client for 30 sec - exiting 09:48:09 (3044): No heartbeat from core client for 30 sec - exiting 09:48:10 (3044): No heartbeat from core client for 30 sec - exiting 09:48:11 (3044): No heartbeat from core client for 30 sec - exiting 09:48:12 (3044): No heartbeat from core client for 30 sec - exiting 09:48:13 (3044): No heartbeat from core client for 30 sec - exiting 09:48:14 (3044): No heartbeat from core client for 30 sec - exiting 09:48:15 (3044): No heartbeat from core client for 30 sec - exiting CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4304, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6736, selfPID=3612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5044, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5704, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5348, selfPID=1788, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5512, selfPID=5100, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4140, selfPID=3168, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3952, selfPID=5296, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4568, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1020, selfPID=5064, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7004, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4904, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4856, selfPID=4172, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4136, selfPID=5040, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2712, selfPID=2928, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5700, selfPID=4376, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4652, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5768, selfPID=5072, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5988, selfPID=1552, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4544, selfPID=3936, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4752, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3284, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4496, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1540, selfPID=1276, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5112, selfPID=2884, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4696, selfPID=4852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4664, selfPID=6868, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3064, selfPID=7260, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4216, selfPID=1168, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3164, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7096, selfPID=3236, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5372, selfPID=4312, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5832, selfPID=432, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6772, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6796, selfPID=5032, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4104, selfPID=2868, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4120, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4860, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4776, selfPID=4856, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6196, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4688, selfPID=5856, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6236, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6984, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6384, selfPID=4352, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3940, selfPID=5024, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4956, selfPID=3324, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5008, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=816, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4780, selfPID=2920, iMonCtr=1 Model crash detected, will try to restart... CGolotroller: CoDN process is not : CPinN ,roeesstisngo, rbnnitg,aeliting, bReckPID=0, ,selfPckIID=4, 0el,PIiM5o4n, ir=2 tro2 el crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5848, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2364, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5496, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5544, selfPID=3572, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3028, selfPID=5824, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6448, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6328, selfPID=4696, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5752, selfPID=3464, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6220, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=940, selfPID=3728, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6116, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2100, selfPID=4796, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4412, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1348, selfPID=5116, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5716, selfPID=1084, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3896, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4244, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4912, selfPID=616, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6340, selfPID=5036, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3188, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4752, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4780, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6420, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5484, selfPID=4692, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5116, selfPID=4076, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3216, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6368, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5948, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5004, selfPID=5004, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1348, selfPID=3860, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4052, selfPID=3192, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5740, selfPID=1704, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:12:00 (4932): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 May 2011 05:59:10	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	138,336	359,831	2.6011
19 May 2011 08:48:50	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	126,832	333,756	2.6315
19 May 2011 07:37:54	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	126,816	333,397	2.6290
17 May 2011 07:13:46	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	115,296	304,054	2.6372
15 May 2011 10:53:32	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	103,776	262,369	2.5282
12 May 2011 06:56:07	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	92,256	227,937	2.4707
10 May 2011 07:55:27	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	80,736	194,134	2.4046
08 May 2011 21:12:14	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	69,216	164,405	2.3752
06 May 2011 09:45:50	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	57,696	129,642	2.2470
03 May 2011 07:33:06	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	46,176	96,807	2.0965
30 Apr 2011 09:14:51	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	34,656	73,016	2.1069
20 Apr 2011 17:48:38	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	23,136	49,640	2.1456
03 Apr 2011 07:56:58	1107482	12256281	hadam3p_saf_1ki4_1987_1_006973604_0	11,616	24,895	2.1432