Task 12591231

Name	hadam3p_eu_2jry_1994_1_007159126_0
Workunit	7343966
Created	18 Feb 2011, 16:59:14 UTC
Sent	12 Mar 2011, 16:14:12 UTC
Report deadline	22 Feb 2012, 21:34:12 UTC
Received	27 Jul 2011, 18:09:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1091233
Run time	11 days 15 hours 39 min 31 sec
CPU time	10 days 0 hours 0 min 48 sec
Validate state	Invalid
Credit	995.30
Device peak FLOPS	0.65 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.08 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/hadam3p_eu_se_6.08_windows_intelx86.dll Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1204, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4676, selfPID=2852, iMonCtr=1 Model crash detected, will try to restart... 18:29:53 (3892): No heartbeat from core client for 30 sec - exiting 18:29:54 (3892): No heartbeat from core client for 30 sec - exiting 18:29:55 (3892): No heartbeat from core client for 30 sec - exiting 18:29:57 (3892): No heartbeat from core client for 30 sec - exiting 18:29:58 (3892): No heartbeat from core client for 30 sec - exiting 18:29:59 (3892): No heartbeat from core client for 30 sec - exiting 18:30:00 (3892): No heartbeat from core client for 30 sec - exiting 18:30:01 (3892): No heartbeat from core client for 30 sec - exiting 18:30:02 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:40:18 (4456): No heartbeat from core client for 30 sec - exiting 18:40:19 (4456): No heartbeat from core client for 30 sec - exiting 18:40:20 (4456): No heartbeat from core client for 30 sec - exiting 18:40:21 (4456): No heartbeat from core client for 30 sec - exiting 18:40:22 (4456): No heartbeat from core client for 30 sec - exiting 18:40:23 (4456): No heartbeat from core client for 30 sec - exiting 18:40:24 (4456): No heartbeat from core client for 30 sec - exiting 18:40:25 (4456): No heartbeat from core client for 30 sec - exiting 18:40:26 (4456): No heartbeat from core client for 30 sec - exiting 18:40:27 (4456): No heartbeat from core client for 30 sec - exiting 18:40:29 (4456): No heartbeat from core client for 30 sec - exiting 18:40:30 (4456): No heartbeat from core client for 30 sec - exiting 18:40:31 (4456): No heartbeat from core client for 30 sec - exiting 18:40:32 (4456): No heartbeat from core client for 30 sec - exiting 18:40:33 (4456): No heartbeat from core client for 30 sec - exiting 18:40:34 (4456): No heartbeat from core client for 30 sec - exiting 18:40:35 (4456): No heartbeat from core client for 30 sec - exiting 18:40:36 (4456): No heartbeat from core client for 30 sec - exiting 18:40:37 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4752, selfPID=4752, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=744, selfPID=744, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5100, selfPID=5100, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4648, iMonCtr=2 20:05:31 (5084): No heartbeat from core client for 30 sec - exiting 20:05:32 (5084): No heartbeat from core client for 30 sec - exiting 20:05:33 (5084): No heartbeat from core client for 30 sec - exiting 20:05:34 (5084): No heartbeat from core client for 30 sec - exiting 20:05:35 (5084): No heartbeat from core client for 30 sec - exiting 20:05:36 (5084): No heartbeat from core client for 30 sec - exiting 20:05:37 (5084): No heartbeat from core client for 30 sec - exiting 20:05:38 (5084): No heartbeat from core client for 30 sec - exiting 20:05:40 (5084): No heartbeat from core client for 30 sec - exiting 20:05:43 (5084): No heartbeat from core client for 30 sec - exiting 20:05:44 (5084): No heartbeat from core client for 30 sec - exiting 20:05:45 (5084): No heartbeat from core client for 30 sec - exiting 20:05:46 (5084): No heartbeat from core client for 30 sec - exiting 20:05:48 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3380, selfPID=3380, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Region11:48:44 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:54:47 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5032, selfPID=5032, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4588, selfPID=4588, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6116, selfPID=6116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1824, selfPID=1824, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 18:48:05 (1364): No heartbeat from core client for 30 sec - exiting 18:48:06 (1364): No heartbeat from core client for 30 sec - exiting 18:48:07 (1364): No heartbeat from core client for 30 sec - exiting 18:48:08 (1364): No heartbeat from core client for 30 sec - exiting 18:48:09 (1364): No heartbeat from core client for 30 sec - exiting 18:48:11 (1364): No heartbeat from core client for 30 sec - exiting 18:48:12 (1364): No heartbeat from core client for 30 sec - exiting 18:48:13 (1364): No heartbeat from core client for 30 sec - exiting 18:48:14 (1364): No heartbeat from core client for 30 sec - exiting 18:48:15 (1364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:17 (1364): No heartbeat from core client for 30 sec - exiting 18:48:18 (1364): No heartbeat from core client for 30 sec - exiting 18:51:47 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:27 (3468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:55:13 (2652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:58:48 (4224): No heartbeat from core client for 30 sec - exiting 18:58:50 (4224): No heartbeat from core client for 30 sec - exiting 18:58:51 (4224): No heartbeat from core client for 30 sec - exiting 18:58:52 (4224): No heartbeat from core client for 30 sec - exiting 18:58:53 (4224): No heartbeat from core client for 30 sec - exiting 18:58:54 (4224): No heartbeat from core client for 30 sec - exiting 18:58:55 (4224): No heartbeat from core client for 30 sec - exiting 18:58:56 (4224): No heartbeat from core client for 30 sec - exiting 18:58:57 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:00:35 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:18 (1820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:01 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:44 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:43 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1676, iMonCtr=2 20:41:30 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:21:52 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3220, selfPID=4800, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3816, selfPID=3816, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3928, selfPID=3928, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5136, selfPID=5136, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4884, selfPID=4884, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5268, selfPID=5268, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is notCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5796, selfPID=5796, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1160, selfPID=1160, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3548, selfPID=3548, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4504, selfPID=4504, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:29:27 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:49 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:17:36 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1168, selfPID=1168, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 19:37:54 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:14:16 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:27:15 (2336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3276, selfPID=3276, iMonCtr=2 09:30:03 (1476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4592, selfPID=3968, iMonCtr=1 Model crash detected, will try to restart... 19:40:44 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4640, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4980, selfPID=4980, iMonCtr=2 Controller:: CPDN process is not running, exiting, bReCPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5192, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5208, selfPID=4408, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 07:43:49 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5472, selfPID=1896, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=2 21:46:44 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5496, selfPID=5496, iMonCtr=2 00:03:45 (4240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:08 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4716, selfPID=2828, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8112, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7380, selfPID=7244, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5020, selfPID=4864, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3292, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jul 2011 22:22:40	1091233	12591231	hadam3p_eu_2jry_1994_1_007159126_0	57,696	779,501	13.5105
02 Jul 2011 15:50:06	1091233	12591231	hadam3p_eu_2jry_1994_1_007159126_0	46,176	621,482	13.4590
26 Jun 2011 14:11:24	1091233	12591231	hadam3p_eu_2jry_1994_1_007159126_0	34,656	468,016	13.5046
07 May 2011 12:14:50	1091233	12591231	hadam3p_eu_2jry_1994_1_007159126_0	23,136	309,056	13.3582
23 Apr 2011 09:54:00	1091233	12591231	hadam3p_eu_2jry_1994_1_007159126_0	11,617	152,826	13.1554
19 Mar 2011 09:45:45	1091233	12591231	hadam3p_eu_2jry_1994_1_007159126_0	11,616	150,753	12.9780