Task 15290334

Name	hadam3p_pnw_zf5g_1963_1_006983756_2
Workunit	7187072
Created	17 Sep 2012, 23:07:13 UTC
Sent	17 Sep 2012, 23:34:27 UTC
Report deadline	31 Aug 2013, 4:54:27 UTC
Received	14 Dec 2012, 0:10:28 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1237729
Run time	4 days 1 hours 30 min 28 sec
CPU time	3 days 18 hours 2 min 49 sec
Validate state	Initial
Credit	3,005.88
Device peak FLOPS	3.20 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=140, selfPID=4276, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2184, selfPID=5124, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6220, selfPID=4456, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9064, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6940, selfPID=6940, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5952, selfPID=5952, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5856, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3992, selfPID=3992, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5756, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5800, selfPID=4120, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8416, selfPID=8416, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5140, selfPID=5140, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:29:31 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:19:24 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10216, selfPID=10216, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8404, selfPID=8404, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9744, selfPID=7272, iMonCtr=1 Model crash detected, will try to restart... 21:32:39 (4860): No heartbeat from core client for 30 sec - exiting 21:32:40 (4860): No heartbeat from core client for 30 sec - exiting 21:33:11 (4860): No heartbeat from core client for 30 sec - exiting 21:33:12 (4860): No heartbeat from core client for 30 sec - exiting 21:33:13 (4860): No heartbeat from core client for 30 sec - exiting 21:33:14 (4860): No heartbeat from core client for 30 sec - exiting 21:33:15 (4860): No heartbeat from core client for 30 sec - exiting 21:33:16 (4860): No heartbeat from core client for 30 sec - exiting 21:33:17 (4860): No heartbeat from core client for 30 sec - exiting 21:33:18 (4860): No heartbeat from core client for 30 sec - exiting 21:33:19 (4860): No heartbeat from core client for 30 sec - exiting 21:33:20 (4860): No heartbeat from core client for 30 sec - exiting 21:33:21 (4860): No heartbeat from core client for 30 sec - exiting 21:33:22 (4860): No heartbeat from core client for 30 sec - exiting 21:33:23 (4860): No heartbeat from core client for 30 sec - exiting 21:33:24 (4860): No heartbeat from core client for 30 sec - exiting 21:33:25 (4860): No heartbeat from core client for 30 sec - exiting 21:33:26 (4860): No heartbeat from core client for 30 sec - exiting 21:33:27 (4860): No heartbeat from core client for 30 sec - exiting 21:33:28 (4860): No heartbeat from core client for 30 sec - exiting 21:33:29 (4860): No heartbeat from core client for 30 sec - exiting 21:33:30 (4860): No heartbeat from core client for 30 sec - exiting 21:33:31 (4860): No heartbeat from core client for 30 sec - exiting 21:33:32 (4860): No heartbeat from core client for 30 sec - exiting 21:33:33 (4860): No heartbeat from core client for 30 sec - exiting 21:33:34 (4860): No heartbeat from core client for 30 sec - exiting 21:33:35 (4860): No heartbeat from core client for 30 sec - exiting 21:33:36 (4860): No heartbeat from core client for 30 sec - exiting 21:33:37 (4860): No heartbeat from core client for 30 sec - exiting 21:33:38 (4860): No heartbeat from core client for 30 sec - exiting 21:33:39 (4860): No heartbeat from core client for 30 sec - exiting 21:33:40 (4860): No heartbeat from core client for 30 sec - exiting 21:33:41 (4860): No heartbeat from core client for 30 sec - exiting 21:33:42 (4860): No heartbeat from core client for 30 sec - exiting 21:33:43 (4860): No heartbeat from core client for 30 sec - exiting 21:33:44 (4860): No heartbeat from core client for 30 sec - exiting 21:33:45 (4860): No heartbeat from core client for 30 sec - exiting 21:34:16 (4860): No heartbeat from core client for 30 sec - exiting 21:34:17 (4860): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Dec 2012 00:13:31	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	138,336	323,811	2.3408
14 Dec 2012 00:13:31	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	126,816	306,828	2.4195
07 Dec 2012 23:29:23	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	115,296	282,812	2.4529
15 Nov 2012 11:34:41	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	103,776	254,214	2.4496
09 Oct 2012 13:06:22	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	92,256	225,621	2.4456
26 Sep 2012 13:29:51	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	80,736	197,093	2.4412
22 Sep 2012 23:28:52	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	69,216	168,515	2.4346
21 Sep 2012 17:55:24	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	57,696	139,816	2.4233
21 Sep 2012 10:03:06	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	46,176	111,072	2.4054
21 Sep 2012 00:55:32	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	34,656	82,180	2.3713
19 Sep 2012 14:59:35	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	23,136	52,615	2.2742
18 Sep 2012 07:45:15	1237729	15290334	hadam3p_pnw_zf5g_1963_1_006983756_2	11,616	23,832	2.0517