Task 13527827

Name	hadam3p_eu_6sbw_2006_1_007511645_0
Workunit	7709120
Created	27 Oct 2011, 12:59:16 UTC
Sent	27 Oct 2011, 22:30:35 UTC
Report deadline	9 Oct 2012, 3:50:35 UTC
Received	21 Apr 2012, 11:04:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1124341
Run time	22 hours 24 min 12 sec
CPU time	20 hours 51 min 21 sec
Validate state	Invalid
Credit	597.84
Device peak FLOPS	2.62 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> 11:52:11 (5228): No heartbeat from core client for 30 sec - exiting 11:52:12 (5228): No heartbeat from core client for 30 sec - exiting 11:52:13 (5228): No heartbeat from core client for 30 sec - exiting 11:52:14 (5228): No heartbeat from core client for 30 sec - exiting 11:52:15 (5228): No heartbeat from core client for 30 sec - exiting 11:52:16 (5228): No heartbeat from core client for 30 sec - exiting 11:52:18 (5228): No heartbeat from core client for 30 sec - exiting 11:52:19 (5228): No heartbeat from core client for 30 sec - exiting 11:52:20 (5228): No heartbeat from core client for 30 sec - exiting 11:52:21 (5228): No heartbeat from core client for 30 sec - exiting 11:52:22 (5228): No heartbeat from core client for 30 sec - exiting 11:52:23 (5228): No heartbeat from core client for 30 sec - exiting 11:52:24 (5228): No heartbeat from core client for 30 sec - exiting 11:52:25 (5228): No heartbeat from core client for 30 sec - exiting 11:52:26 (5228): No heartbeat from core client for 30 sec - exiting 11:52:27 (5228): No heartbeat from core client for 30 sec - exiting 11:52:28 (5228): No heartbeat from core client for 30 sec - exiting 11:52:30 (5228): No heartbeat from core client for 30 sec - exiting 11:52:31 (5228): No heartbeat from core client for 30 sec - exiting 11:52:32 (5228): No heartbeat from core client for 30 sec - exiting 11:52:33 (5228): No heartbeat from core client for 30 sec - exiting 11:52:34 (5228): No heartbeat from core client for 30 sec - exiting 11:52:35 (5228): No heartbeat from core client for 30 sec - exiting 11:52:36 (5228): No heartbeat from core client for 30 sec - exiting 11:52:37 (5228): No heartbeat from core client for 30 sec - exiting 11:52:38 (5228): No heartbeat from core client for 30 sec - exiting 11:52:39 (5228): No heartbeat from core client for 30 sec - exiting 11:52:41 (5228): No heartbeat from core client for 30 sec - exiting 11:52:42 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:58:00 (5060): No heartbeat from core client for 30 sec - exiting 15:58:01 (5060): No heartbeat from core client for 30 sec - exiting 15:58:02 (5060): No heartbeat from core client for 30 sec - exiting 15:58:03 (5060): No heartbeat from core client for 30 sec - exiting 15:58:04 (5060): No heartbeat from core client for 30 sec - exiting 15:58:05 (5060): No heartbeat from core client for 30 sec - exiting 15:58:07 (5060): No heartbeat from core client for 30 sec - exiting 15:58:08 (5060): No heartbeat from core client for 30 sec - exiting 15:58:09 (5060): No heartbeat from core client for 30 sec - exiting 15:58:10 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:05:45 (5248): No heartbeat from core client for 30 sec - exiting 17:05:46 (5248): No heartbeat from core client for 30 sec - exiting 17:05:47 (5248): No heartbeat from core client for 30 sec - exiting 17:05:48 (5248): No heartbeat from core client for 30 sec - exiting 17:05:49 (5248): No heartbeat from core client for 30 sec - exiting 17:05:50 (5248): No heartbeat from core client for 30 sec - exiting 17:05:51 (5248): No heartbeat from core client for 30 sec - exiting 17:05:52 (5248): No heartbeat from core client for 30 sec - exiting 17:05:53 (5248): No heartbeat from core client for 30 sec - exiting 17:05:55 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=972, selfPID=5556, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:18:33 (4304): No heartbeat from core client for 30 sec - exiting 16:18:34 (4304): No heartbeat from core client for 30 sec - exiting 16:18:35 (4304): No heartbeat from core client for 30 sec - exiting 16:18:36 (4304): No heartbeat from core client for 30 sec - exiting 16:18:37 (4304): No heartbeat from core client for 30 sec - exiting 16:18:38 (4304): No heartbeat from core client for 30 sec - exiting 16:18:39 (4304): No heartbeat from core client for 30 sec - exiting 16:18:41 (4304): No heartbeat from core client for 30 sec - exiting 16:18:42 (4304): No heartbeat from core client for 30 sec - exiting 16:18:43 (4304): No heartbeat from core client for 30 sec - exiting 16:18:44 (4304): No heartbeat from core client for 30 sec - exiting 16:18:45 (4304): No heartbeat from core client for 30 sec - exiting 16:18:46 (4304): No heartbeat from core client for 30 sec - exiting 16:18:47 (4304): No heartbeat from core client for 30 sec - exiting 16:18:48 (4304): No heartbeat from core client for 30 sec - exiting 16:18:49 (4304): No heartbeat from core client for 30 sec - exiting 16:18:50 (4304): No heartbeat from core client for 30 sec - exiting 16:18:51 (4304): No heartbeat from core client for 30 sec - exiting 16:18:53 (4304): No heartbeat from core client for 30 sec - exiting 16:18:54 (4304): No heartbeat from core client for 30 sec - exiting 16:18:55 (4304): No heartbeat from core client for 30 sec - exiting 16:18:56 (4304): No heartbeat from core client for 30 sec - exiting 16:18:57 (4304): No heartbeat from core client for 30 sec - exiting 16:18:58 (4304): No heartbeat from core client for 30 sec - exiting 16:18:59 (4304): No heartbeat from core client for 30 sec - exiting 16:19:00 (4304): No heartbeat from core client for 30 sec - exiting 16:19:01 (4304): No heartbeat from core client for 30 sec - exiting 16:19:02 (4304): No heartbeat from core client for 30 sec - exiting 16:19:04 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:44:17 (5568): No heartbeat from core client for 30 sec - exiting 07:44:18 (5568): No heartbeat from core client for 30 sec - exiting 07:44:19 (5568): No heartbeat from core client for 30 sec - exiting 07:44:20 (5568): No heartbeat from core client for 30 sec - exiting 07:44:21 (5568): No heartbeat from core client for 30 sec - exiting 07:44:22 (5568): No heartbeat from core client for 30 sec - exiting 07:44:24 (5568): No heartbeat from core client for 30 sec - exiting 07:44:25 (5568): No heartbeat from core client for 30 sec - exiting 07:44:26 (5568): No heartbeat from core client for 30 sec - exiting 07:44:27 (5568): No heartbeat from core client for 30 sec - exiting 07:44:28 (5568): No heartbeat from core client for 30 sec - exiting 07:44:29 (5568): No heartbeat from core client for 30 sec - exiting 07:44:30 (5568): No heartbeat from core client for 30 sec - exiting 07:44:31 (5568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:22 (5020): No heartbeat from core client for 30 sec - exiting 19:29:23 (5020): No heartbeat from core client for 30 sec - exiting 19:29:24 (5020): No heartbeat from core client for 30 sec - exiting 19:29:26 (5020): No heartbeat from core client for 30 sec - exiting 19:29:27 (5020): No heartbeat from core client for 30 sec - exiting 19:29:28 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5952, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5916, iMonCtr=2 11:03:03 (5176): No heartbeat from core client for 30 sec - exiting 11:03:04 (5176): No heartbeat from core client for 30 sec - exiting 11:03:05 (5176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1492, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Apr 2012 10:07:49	1124341	13527827	hadam3p_eu_6sbw_2006_1_007511645_0	34,656	73,772	2.1287
17 Apr 2012 18:26:44	1124341	13527827	hadam3p_eu_6sbw_2006_1_007511645_0	23,136	49,336	2.1324
14 Apr 2012 17:45:26	1124341	13527827	hadam3p_eu_6sbw_2006_1_007511645_0	11,616	24,723	2.1284