Task 12137656

Name	hadam3p_eu_wonr_1998_1_006865711_0
Workunit	7069027
Created	19 Nov 2010, 11:19:29 UTC
Sent	16 Mar 2011, 3:05:18 UTC
Report deadline	26 Feb 2012, 8:25:18 UTC
Received	25 Mar 2011, 8:59:36 UTC
Server state	Over
Outcome	Didn't need
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	890646
Run time	2 days 18 hours 50 min 6 sec
CPU time	2 days 6 hours 3 min 57 sec
Validate state	Invalid
Credit	995.30
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.08 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3796, selfPID=3796, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3796, selfPID=5160, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5184, selfPID=5184, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3908, selfPID=3908, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2304, selfPID=2304, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:00:08 (6696): No heartbeat from core client for 30 sec - exiting 07:00:09 (6696): No heartbeat from core client for 30 sec - exiting 07:00:10 (6696): No heartbeat from core client for 30 sec - exiting 07:00:11 (6696): No heartbeat from core client for 30 sec - exiting 07:00:12 (6696): No heartbeat from core client for 30 sec - exiting 07:00:13 (6696): No heartbeat from core client for 30 sec - exiting 07:00:15 (6696): No heartbeat from core client for 30 sec - exiting 07:00:16 (6696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:49:40 (6864): No heartbeat from core client for 30 sec - exiting 09:49:42 (6864): No heartbeat from core client for 30 sec - exiting 09:49:43 (6864): No heartbeat from core client for 30 sec - exiting 09:49:44 (6864): No heartbeat from core client for 30 sec - exiting 09:49:45 (6864): No heartbeat from core client for 30 sec - exiting 09:49:46 (6864): No heartbeat from core client for 30 sec - exiting 09:49:47 (6864): No heartbeat from core client for 30 sec - exiting 09:49:48 (6864): No heartbeat from core client for 30 sec - exiting 09:49:49 (6864): No heartbeat from core client for 30 sec - exiting 09:49:50 (6864): No heartbeat from core client for 30 sec - exiting 09:49:51 (6864): No heartbeat from core client for 30 sec - exiting 09:49:53 (6864): No heartbeat from core client for 30 sec - exiting 09:49:54 (6864): No heartbeat from core client for 30 sec - exiting 09:49:55 (6864): No heartbeat from core client for 30 sec - exiting 09:49:56 (6864): No heartbeat from core client for 30 sec - exiting 09:49:57 (6864): No heartbeat from core client for 30 sec - exiting 09:49:58 (6864): No heartbeat from core client for 30 sec - exiting 09:49:59 (6864): No heartbeat from core client for 30 sec - exiting 09:50:00 (6864): No heartbeat from core client for 30 sec - exiting 09:50:01 (6864): No heartbeat from core client for 30 sec - exiting 09:50:02 (6864): No heartbeat from core client for 30 sec - exiting 09:50:03 (6864): No heartbeat from core client for 30 sec - exiting 09:50:05 (6864): No heartbeat from core client for 30 sec - exiting 09:50:06 (6864): No heartbeat from core client for 30 sec - exiting 09:50:07 (6864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:28:33 (4380): No heartbeat from core client for 30 sec - exiting 18:28:35 (4380): No heartbeat from core client for 30 sec - exiting 18:28:36 (4380): No heartbeat from core client for 30 sec - exiting 18:28:37 (4380): No heartbeat from core client for 30 sec - exiting 18:28:38 (4380): No heartbeat from core client for 30 sec - exiting 18:28:39 (4380): No heartbeat from core client for 30 sec - exiting 18:28:40 (4380): No heartbeat from core client for 30 sec - exiting 18:28:41 (4380): No heartbeat from core client for 30 sec - exiting 18:28:42 (4380): No heartbeat from core client for 30 sec - exiting 18:28:43 (4380): No heartbeat from core client for 30 sec - exiting 18:28:44 (4380): No heartbeat from core client for 30 sec - exiting 18:28:45 (4380): No heartbeat from core client for 30 sec - exiting 18:28:46 (4380): No heartbeat from core client for 30 sec - exiting 18:28:47 (4380): No heartbeat from core client for 30 sec - exiting 18:28:48 (4380): No heartbeat from core client for 30 sec - exiting 18:28:49 (4380): No heartbeat from core client for 30 sec - exiting 18:28:50 (4380): No heartbeat from core client for 30 sec - exiting 18:28:51 (4380): No heartbeat from core client for 30 sec - exiting 18:28:52 (4380): No heartbeat from core client for 30 sec - exiting 18:28:53 (4380): No heartbeat from core client for 30 sec - exiting 18:28:54 (4380): No heartbeat from core client for 30 sec - exiting 18:28:55 (4380): No heartbeat from core client for 30 sec - exiting 18:28:56 (4380): No heartbeat from core client for 30 sec - exiting 18:28:57 (4380): No heartbeat from core client for 30 sec - exiting 18:28:58 (4380): No heartbeat from core client for 30 sec - exiting 18:28:59 (4380): No heartbeat from core client for 30 sec - exiting 18:29:00 (4380): No heartbeat from core client for 30 sec - exiting 18:29:01 (4380): No heartbeat from core client for 30 sec - exiting 18:29:02 (4380): No heartbeat from core client for 30 sec - exiting 18:29:03 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4748, selfPID=4748, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6824, selfPID=6824, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:44:42 (7016): No heartbeat from core client for 30 sec - exiting 08:44:43 (7016): No heartbeat from core client for 30 sec - exiting 08:44:44 (7016): No heartbeat from core client for 30 sec - exiting 08:44:45 (7016): No heartbeat from core client for 30 sec - exiting 08:44:46 (7016): No heartbeat from core client for 30 sec - exiting 08:44:47 (7016): No heartbeat from core client for 30 sec - exiting 08:44:49 (7016): No heartbeat from core client for 30 sec - exiting 08:44:50 (7016): No heartbeat from core client for 30 sec - exiting 08:44:51 (7016): No heartbeat from core client for 30 sec - exiting 08:44:52 (7016): No heartbeat from core client for 30 sec - exiting 08:44:53 (7016): No heartbeat from core client for 30 sec - exiting 08:44:54 (7016): No heartbeat from core client for 30 sec - exiting 08:44:55 (7016): No heartbeat from core client for 30 sec - exiting 08:44:56 (7016): No heartbeat from core client for 30 sec - exiting 08:44:57 (7016): No heartbeat from core client for 30 sec - exiting 08:44:58 (7016): No heartbeat from core client for 30 sec - exiting 08:44:59 (7016): No heartbeat from core client for 30 sec - exiting 08:45:01 (7016): No heartbeat from core client for 30 sec - exiting 08:45:02 (7016): No heartbeat from core client for 30 sec - exiting 08:45:03 (7016): No heartbeat from core client for 30 sec - exiting 08:45:04 (7016): No heartbeat from core client for 30 sec - exiting 08:45:05 (7016): No heartbeat from core client for 30 sec - exiting 08:45:06 (7016): No heartbeat from core client for 30 sec - exiting 08:45:07 (7016): No heartbeat from core client for 30 sec - exiting 08:45:08 (7016): No heartbeat from core client for 30 sec - exiting 08:45:09 (7016): No heartbeat from core client for 30 sec - exiting 08:45:10 (7016): No heartbeat from core client for 30 sec - exiting 08:45:11 (7016): No heartbeat from core client for 30 sec - exiting 08:45:12 (7016): No heartbeat from core client for 30 sec - exiting 08:45:14 (7016): No heartbeat from core client for 30 sec - exiting 08:45:15 (7016): No heartbeat from core client for 30 sec - exiting 08:45:16 (7016): No heartbeat from core client for 30 sec - exiting 08:45:17 (7016): No heartbeat from core client for 30 sec - exiting 08:45:18 (7016): No heartbeat from core client for 30 sec - exiting 08:45:19 (7016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3968, selfPID=3968, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5620, selfPID=5620, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 08:28:30 (3116): No heartbeat from core client for 30 sec - exiting 08:28:32 (3116): No heartbeat from core client for 30 sec - exiting 08:28:33 (3116): No heartbeat from core client for 30 sec - exiting 08:28:34 (3116): No heartbeat from core client for 30 sec - exiting 08:28:35 (3116): No heartbeat from core client for 30 sec - exiting 08:28:36 (3116): No heartbeat from core client for 30 sec - exiting 08:28:37 (3116): No heartbeat from core client for 30 sec - exiting 08:28:38 (3116): No heartbeat from core client for 30 sec - exiting 08:28:39 (3116): No heartbeat from core client for 30 sec - exiting 08:28:40 (3116): No heartbeat from core client for 30 sec - exiting 08:28:41 (3116): No heartbeat from core client for 30 sec - exiting 08:28:42 (3116): No heartbeat from core client for 30 sec - exiting 08:28:44 (3116): No heartbeat from core client for 30 sec - exiting 08:28:45 (3116): No heartbeat from core client for 30 sec - exiting 08:28:46 (3116): No heartbeat from core client for 30 sec - exiting 08:28:47 (3116): No heartbeat from core client for 30 sec - exiting 08:28:48 (3116): No heartbeat from core client for 30 sec - exiting 08:28:49 (3116): No heartbeat from core client for 30 sec - exiting 08:28:50 (3116): No heartbeat from core client for 30 sec - exiting 08:28:51 (3116): No heartbeat from core client for 30 sec - exiting 08:28:52 (3116): No heartbeat from core client for 30 sec - exiting 08:28:53 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6664, selfPID=6664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3052, selfPID=3052, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6016, selfPID=6016, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5336, selfPID=5336, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3944, selfPID=3944, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6284, selfPID=6284, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2160, selfPID=2160, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4284, selfPID=4284, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7188, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=2 Leaving CPDN_Main::Monitor... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Mar 2011 16:11:56	890646	12137656	hadam3p_eu_wonr_1998_1_006865711_0	57,696	165,697	2.8719
22 Mar 2011 02:29:22	890646	12137656	hadam3p_eu_wonr_1998_1_006865711_0	46,176	132,429	2.8679
21 Mar 2011 02:53:49	890646	12137656	hadam3p_eu_wonr_1998_1_006865711_0	34,656	99,531	2.8720
19 Mar 2011 03:03:51	890646	12137656	hadam3p_eu_wonr_1998_1_006865711_0	23,136	66,257	2.8638
16 Mar 2011 23:27:01	890646	12137656	hadam3p_eu_wonr_1998_1_006865711_0	11,616	33,415	2.8766