Task 14802150

Name	hadam3p_pnw_b46m_1982_1_008003319_1
Workunit	8158433
Created	20 Jun 2012, 6:57:25 UTC
Sent	20 Jun 2012, 6:58:14 UTC
Report deadline	2 Jun 2013, 12:18:14 UTC
Received	25 Aug 2012, 13:02:00 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1183189
Run time	5 days 13 hours 19 min 53 sec
CPU time	5 days 5 hours 33 min 42 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	2.32 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8508, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5228, selfPID=4696, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5548, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6132, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5216, selfPID=4636, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5996, selfPID=4732, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6112, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... 00:42:09 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:41:06 (11724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=536, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... 18:30:49 (2684): No heartbeat from core client for 30 sec - exiting 18:30:50 (2684): No heartbeat from core client for 30 sec - exiting 18:30:51 (2684): No heartbeat from core client for 30 sec - exiting 18:30:52 (2684): No heartbeat from core client for 30 sec - exiting 18:30:54 (2684): No heartbeat from core client for 30 sec - exiting 18:30:55 (2684): No heartbeat from core client for 30 sec - exiting 18:30:56 (2684): No heartbeat from core client for 30 sec - exiting 18:30:57 (2684): No heartbeat from core client for 30 sec - exiting 18:30:58 (2684): No heartbeat from core client for 30 sec - exiting 18:30:59 (2684): No heartbeat from core client for 30 sec - exiting 18:31:00 (2684): No heartbeat from core client for 30 sec - exiting 18:31:01 (2684): No heartbeat from core client for 30 sec - exiting 18:31:02 (2684): No heartbeat from core client for 30 sec - exiting 18:31:03 (2684): No heartbeat from core client for 30 sec - exiting 18:31:05 (2684): No heartbeat from core client for 30 sec - exiting 18:31:06 (2684): No heartbeat from core client for 30 sec - exiting 18:31:07 (2684): No heartbeat from core client for 30 sec - exiting 18:31:08 (2684): No heartbeat from core client for 30 sec - exiting 18:31:09 (2684): No heartbeat from core client for 30 sec - exiting 18:31:10 (2684): No heartbeat from core client for 30 sec - exiting 18:31:11 (2684): No heartbeat from core client for 30 sec - exiting 18:31:12 (2684): No heartbeat from core client for 30 sec - exiting 18:31:13 (2684): No heartbeat from core client for 30 sec - exiting 18:31:14 (2684): No heartbeat from core client for 30 sec - exiting 18:31:15 (2684): No heartbeat from core client for 30 sec - exiting 18:31:17 (2684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:31:18 (2684): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:25:26 (332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12252, selfPID=13700, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4216, selfPID=3112, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4872, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10232, selfPID=4624, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 08:52:47 (2096): No heartbeat from core client for 30 sec - exiting 08:52:48 (2096): No heartbeat from core client for 30 sec - exiting 08:52:49 (2096): No heartbeat from core client for 30 sec - exiting 08:52:50 (2096): No heartbeat from core client for 30 sec - exiting 08:52:51 (2096): No heartbeat from core client for 30 sec - exiting 08:52:53 (2096): No heartbeat from core client for 30 sec - exiting 08:52:54 (2096): No heartbeat from core client for 30 sec - exiting 08:52:55 (2096): No heartbeat from core client for 30 sec - exiting 08:52:56 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:57 (2096): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:20:00 (1688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:04 (11540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:53 (8388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2800, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4220, selfPID=5132, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5256, selfPID=6044, iMonCtr=1 Model crash detected, will try to restart... 15:55:23 (5428): No heartbeat from core client for 30 sec - exiting 15:55:25 (5428): No heartbeat from core client for 30 sec - exiting 15:55:26 (5428): No heartbeat from core client for 30 sec - exiting 15:55:27 (5428): No heartbeat from core client for 30 sec - exiting 15:55:28 (5428): No heartbeat from core client for 30 sec - exiting 15:55:29 (5428): No heartbeat from core client for 30 sec - exiting 15:55:30 (5428): No heartbeat from core client for 30 sec - exiting 15:55:31 (5428): No heartbeat from core client for 30 sec - exiting 15:55:32 (5428): No heartbeat from core client for 30 sec - exiting 15:55:33 (5428): No heartbeat from core client for 30 sec - exiting 15:55:34 (5428): No heartbeat from core client for 30 sec - exiting 15:55:35 (5428): No heartbeat from core client for 30 sec - exiting 15:55:37 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3808, selfPID=5940, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=432, iMonCtr=2 GlobalCWoontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5024, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 22:26:23 (13316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:24 (13316): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17476, selfPID=12528, iMonCtr=1 Model crash detected, will try to restart... 17:43:13 (8548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11780, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10200, selfPID=9656, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6140, selfPID=5120, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5212, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... 17:10:04 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5732, selfPID=8904, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2888, selfPID=5552, iMonCtr=1 Model crash detected, will try to restart... 18:32:38 (5872): No heartbeat from core client for 30 sec - exiting 18:32:39 (5872): No heartbeat from core client for 30 sec - exiting 18:32:40 (5872): No heartbeat from core client for 30 sec - exiting 18:32:41 (5872): No heartbeat from core client for 30 sec - exiting 18:32:42 (5872): No heartbeat from core client for 30 sec - exiting 18:32:44 (5872): No heartbeat from core client for 30 sec - exiting 18:32:45 (5872): No heartbeat from core client for 30 sec - exiting 18:32:46 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5956, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7100, selfPID=2364, iMonCtr=1 Model crash detected, will try to restart... C07:46:52 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2064, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5968, selfPID=5044, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CGntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4904, iMonCtr=2 MModel cr ash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2900, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4844, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Aug 2012 13:05:36	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	138,336	451,238	3.2619
20 Aug 2012 02:13:10	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	126,819	414,523	3.2686
19 Aug 2012 22:47:26	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	126,816	414,084	3.2652
17 Aug 2012 12:00:33	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	115,296	376,947	3.2694
12 Aug 2012 20:26:01	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	103,776	339,757	3.2739
09 Aug 2012 02:10:35	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	92,256	300,886	3.2614
07 Aug 2012 00:58:19	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	80,736	265,094	3.2835
15 Jul 2012 00:50:49	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	69,218	228,542	3.3018
14 Jul 2012 23:50:34	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	69,216	228,087	3.2953
09 Jul 2012 03:23:53	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	57,696	191,211	3.3141
02 Jul 2012 19:25:07	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	46,176	154,424	3.3442
26 Jun 2012 02:38:00	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	34,656	116,257	3.3546
25 Jun 2012 02:52:54	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	23,136	77,692	3.3581
23 Jun 2012 20:51:53	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	11,618	38,570	3.3198
23 Jun 2012 19:50:19	1183189	14802150	hadam3p_pnw_b46m_1982_1_008003319_1	11,616	38,096	3.2796