Task 12129890

Name	hadam3p_saf_0qov_1990_1_006858167_0
Workunit	7061483
Created	19 Nov 2010, 9:54:06 UTC
Sent	24 Apr 2011, 20:02:56 UTC
Report deadline	6 Apr 2012, 1:22:56 UTC
Received	20 May 2011, 14:06:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	976142
Run time	8 days 15 hours 39 min 31 sec
CPU time	7 days 1 hours 48 min 36 sec
Validate state	Invalid
Credit	2,057.21
Device peak FLOPS	1.92 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.6.28</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5720, selfPID=5720, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3932, selfPID=3932, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4508, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5880, selfPID=576, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5140, selfPID=5140, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4548, selfPID=4548, iMonCtr=2 08:32:44 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4236, selfPID=4236, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5704, selfPID=5704, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7932, selfPID=7932, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:30:42 (1008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7224, selfPID=7224, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6648, selfPID=6648, iMonCtr=2 09:34:59 (6052): No heartbeat from core client for 30 sec - exiting 09:35:00 (6052): No heartbeat from core client for 30 sec - exiting 09:35:01 (6052): No heartbeat from core client for 30 sec - exiting 09:35:02 (6052): No heartbeat from core client for 30 sec - exiting 09:35:04 (6052): No heartbeat from core client for 30 sec - exiting 09:35:05 (6052): No heartbeat from core client for 30 sec - exiting 09:35:06 (6052): No heartbeat from core client for 30 sec - exiting 09:35:07 (6052): No heartbeat from core client for 30 sec - exiting 09:35:08 (6052): No heartbeat from core client for 30 sec - exiting 09:35:09 (6052): No heartbeat from core client for 30 sec - exiting 09:35:10 (6052): No heartbeat from core client for 30 sec - exiting 09:35:11 (6052): No heartbeat from core client for 30 sec - exiting 09:35:12 (6052): No heartbeat from core client for 30 sec - exiting 09:35:13 (6052): No heartbeat from core client for 30 sec - exiting 09:35:14 (6052): No heartbeat from core client for 30 sec - exiting 09:35:16 (6052): No heartbeat from core client for 30 sec - exiting 09:35:17 (6052): No heartbeat from core client for 30 sec - exiting 09:35:18 (6052): No heartbeat from core client for 30 sec - exiting 09:35:19 (6052): No heartbeat from core client for 30 sec - exiting 09:35:20 (6052): No heartbeat from core client for 30 sec - exiting 09:35:21 (6052): No heartbeat from core client for 30 sec - exiting 09:35:22 (6052): No heartbeat from core client for 30 sec - exiting 09:35:23 (6052): No heartbeat from core client for 30 sec - exiting 09:35:24 (6052): No heartbeat from core client for 30 sec - exiting 09:35:25 (6052): No heartbeat from core client for 30 sec - exiting 09:35:26 (6052): No heartbeat from core client for 30 sec - exiting 09:35:28 (6052): No heartbeat from core client for 30 sec - exiting 09:35:29 (6052): No heartbeat from core client for 30 sec - exiting 09:35:30 (6052): No heartbeat from core client for 30 sec - exiting 09:35:31 (6052): No heartbeat from core client for 30 sec - exiting 09:35:32 (6052): No heartbeat from core client for 30 sec - exiting 09:35:33 (6052): No heartbeat from core client for 30 sec - exiting 09:35:34 (6052): No heartbeat from core client for 30 sec - exiting 09:35:35 (6052): No heartbeat from core client for 30 sec - exiting 09:35:36 (6052): No heartbeat from core client for 30 sec - exiting 09:35:37 (6052): No heartbeat from core client for 30 sec - exiting 09:35:39 (6052): No heartbeat from core client for 30 sec - exiting 09:35:40 (6052): No heartbeat from core client for 30 sec - exiting 09:35:41 (6052): No heartbeat from core client for 30 sec - exiting 09:35:42 (6052): No heartbeat from core client for 30 sec - exiting 09:35:43 (6052): No heartbeat from core client for 30 sec - exiting 09:35:44 (6052): No heartbeat from core client for 30 sec - exiting 09:35:45 (6052): No heartbeat from core client for 30 sec - exiting 09:35:46 (6052): No heartbeat from core client for 30 sec - exiting 09:35:47 (6052): No heartbeat from core client for 30 sec - exiting 09:35:48 (6052): No heartbeat from core client for 30 sec - exiting 09:35:49 (6052): No heartbeat from core client for 30 sec - exiting 09:35:51 (6052): No heartbeat from core client for 30 sec - exiting 09:35:52 (6052): No heartbeat from core client for 30 sec - exiting 09:35:53 (6052): No heartbeat from core client for 30 sec - exiting 09:35:54 (6052): No heartbeat from core client for 30 sec - exiting 09:35:55 (6052): No heartbeat from core client for 30 sec - exiting 09:35:56 (6052): No heartbeat from core client for 30 sec - exiting 09:35:57 (6052): No heartbeat from core client for 30 sec - exiting 09:35:58 (6052): No heartbeat from core client for 30 sec - exiting 09:35:59 (6052): No heartbeat from core client for 30 sec - exiting 09:36:00 (6052): No heartbeat from core client for 30 sec - exiting 09:36:01 (6052): No heartbeat from core client for 30 sec - exiting 09:36:03 (6052): No heartbeat from core client for 30 sec - exiting 09:36:04 (6052): No heartbeat from core client for 30 sec - exiting 09:36:05 (6052): No heartbeat from core client for 30 sec - exiting 09:36:06 (6052): No heartbeat from core client for 30 sec - exiting 09:36:07 (6052): No heartbeat from core client for 30 sec - exiting 09:36:08 (6052): No heartbeat from core client for 30 sec - exiting 09:36:09 (6052): No heartbeat from core client for 30 sec - exiting 09:36:10 (6052): No heartbeat from core client for 30 sec - exiting 09:36:11 (6052): No heartbeat from core client for 30 sec - exiting 09:36:12 (6052): No heartbeat from core client for 30 sec - exiting 09:36:13 (6052): No heartbeat from core client for 30 sec - exiting 09:36:15 (6052): No heartbeat from core client for 30 sec - exiting 09:36:16 (6052): No heartbeat from core client for 30 sec - exiting 09:36:17 (6052): No heartbeat from core client for 30 sec - exiting 09:36:18 (6052): No heartbeat from core client for 30 sec - exiting 09:36:19 (6052): No heartbeat from core client for 30 sec - exiting 09:36:20 (6052): No heartbeat from core client for 30 sec - exiting 09:36:21 (6052): No heartbeat from core client for 30 sec - exiting 09:36:22 (6052): No heartbeat from core client for 30 sec - exiting 09:36:23 (6052): No heartbeat from core client for 30 sec - exiting 09:36:24 (6052): No heartbeat from core client for 30 sec - exiting 09:36:26 (6052): No heartbeat from core client for 30 sec - exiting 09:36:27 (6052): No heartbeat from core client for 30 sec - exiting 09:36:28 (6052): No heartbeat from core client for 30 sec - exiting 09:36:29 (6052): No heartbeat from core client for 30 sec - exiting 09:36:30 (6052): No heartbeat from core client for 30 sec - exiting 09:36:31 (6052): No heartbeat from core client for 30 sec - exiting 09:36:32 (6052): No heartbeat from core client for 30 sec - exiting 09:36:33 (6052): No heartbeat from core client for 30 sec - exiting 09:36:34 (6052): No heartbeat from core client for 30 sec - exiting 09:36:35 (6052): No heartbeat from core client for 30 sec - exiting 09:36:36 (6052): No heartbeat from core client for 30 sec - exiting 09:36:38 (6052): No heartbeat from core client for 30 sec - exiting 09:36:39 (6052): No heartbeat from core client for 30 sec - exiting 09:36:40 (6052): No heartbeat from core client for 30 sec - exiting 09:36:41 (6052): No heartbeat from core client for 30 sec - exiting 09:36:42 (6052): No heartbeat from core client for 30 sec - exiting 09:36:43 (6052): No heartbeat from core client for 30 sec - exiting 09:36:44 (6052): No heartbeat from core client for 30 sec - exiting 09:36:45 (6052): No heartbeat from core client for 30 sec - exiting 09:36:46 (6052): No heartbeat from core client for 30 sec - exiting 09:36:47 (6052): No heartbeat from core client for 30 sec - exiting 09:36:48 (6052): No heartbeat from core client for 30 sec - exiting 09:36:50 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:36:51 (6052): No heartbeat from core client for 30 sec - exiting 09:36:52 (6052): No heartbeat from core client for 30 sec - exiting 09:36:53 (6052): No heartbeat from core client for 30 sec - exiting 09:36:54 (6052): No heartbeat from core client for 30 sec - exiting 09:36:55 (6052): No heartbeat from core client for 30 sec - exiting 09:36:56 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:39:05 (2164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6124, selfPID=6124, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3936, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=740, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 May 2011 04:51:50	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	126,816	585,716	4.6186
19 May 2011 11:25:46	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	115,296	533,421	4.6265
18 May 2011 18:34:59	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	103,776	481,730	4.6420
17 May 2011 22:37:08	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	92,256	430,136	4.6624
08 May 2011 15:34:24	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	80,736	377,890	4.6806
07 May 2011 12:19:50	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	69,216	325,630	4.7045
06 May 2011 08:49:38	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	57,696	272,600	4.7248
05 May 2011 05:59:32	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	46,176	218,701	4.7362
04 May 2011 00:57:42	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	34,656	166,754	4.8117
02 May 2011 20:21:42	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	23,136	111,499	4.8193
01 May 2011 09:21:02	976142	12129890	hadam3p_saf_0qov_1990_1_006858167_0	11,616	56,306	4.8473