Task 12559664

Name	hadam3p_eu_xdwt_1988_1_006965637_2
Workunit	7168953
Created	6 Feb 2011, 0:57:54 UTC
Sent	6 Feb 2011, 2:12:49 UTC
Report deadline	19 Jan 2012, 7:32:49 UTC
Received	16 Feb 2012, 13:38:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1132204
Run time	4 days 0 hours 16 min 10 sec
CPU time	3 days 18 hours 9 min 53 sec
Validate state	Invalid
Credit	2,187.67
Device peak FLOPS	2.30 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 14:31:53 (2656): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:31:58 (2656): No heartbeat from core client for 30 sec - exiting 14:31:59 (2656): No heartbeat from core client for 30 sec - exiting 14:32:00 (2656): No heartbeat from core client for 30 sec - exiting 14:34:46 (1216): start_timer_thread(): CreateThread() failed, errno 0 14:48:12 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:43:02 (6092): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:36:09 (2092): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 02:50:35 (3264): start_timer_thread(): CreateThread() failed, errno 0 17:22:49 (7800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:24:13 (7816): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:20:07 (4524): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:29:28 (6076): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5608, selfPID=5608, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 19:34:59 (4884): No heartbeat from core client for 30 sec - exiting 19:35:00 (4884): No heartbeat from core client for 30 sec - exiting 19:35:01 (4884): No heartbeat from core client for 30 sec - exiting 19:35:02 (4884): No heartbeat from core client for 30 sec - exiting 19:35:03 (4884): No heartbeat from core client for 30 sec - exiting 19:35:04 (4884): No heartbeat from core client for 30 sec - exiting 19:35:05 (4884): No heartbeat from core client for 30 sec - exiting 19:35:06 (4884): No heartbeat from core client for 30 sec - exiting 19:35:07 (4884): No heartbeat from core client for 30 sec - exiting 19:35:08 (4884): No heartbeat from core client for 30 sec - exiting 19:35:09 (4884): No heartbeat from core client for 30 sec - exiting 19:35:10 (4884): No heartbeat from core client for 30 sec - exiting 19:35:11 (4884): No heartbeat from core client for 30 sec - exiting 19:35:12 (4884): No heartbeat from core client for 30 sec - exiting 19:35:13 (4884): No heartbeat from core client for 30 sec - exiting 19:35:14 (4884): No heartbeat from core client for 30 sec - exiting 19:35:15 (4884): No heartbeat from core client for 30 sec - exiting 19:35:16 (4884): No heartbeat from core client for 30 sec - exiting 19:35:17 (4884): No heartbeat from core client for 30 sec - exiting 19:35:18 (4884): No heartbeat from core client for 30 sec - exiting 19:35:19 (4884): No heartbeat from core client for 30 sec - exiting 19:35:20 (4884): No heartbeat from core client for 30 sec - exiting 19:35:21 (4884): No heartbeat from core client for 30 sec - exiting 19:35:22 (4884): No heartbeat from core client for 30 sec - exiting 19:35:23 (4884): No heartbeat from core client for 30 sec - exiting 19:35:24 (4884): No heartbeat from core client for 30 sec - exiting 19:35:25 (4884): No heartbeat from core client for 30 sec - exiting 19:35:26 (4884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:37:46 (1412): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:51:58 (5376): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5456, selfPID=5456, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6704, selfPID=6704, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:00:59 (4596): No heartbeat from core client for 30 sec - exiting 21:01:00 (4596): No heartbeat from core client for 30 sec - exiting 21:01:01 (4596): No heartbeat from core client for 30 sec - exiting 21:01:02 (4596): No heartbeat from core client for 30 sec - exiting 21:01:03 (4596): No heartbeat from core client for 30 sec - exiting 21:01:04 (4596): No heartbeat from core client for 30 sec - exiting 21:01:05 (4596): No heartbeat from core client for 30 sec - exiting 21:01:06 (4596): No heartbeat from core client for 30 sec - exiting 21:01:07 (4596): No heartbeat from core client for 30 sec - exiting 21:01:08 (4596): No heartbeat from core client for 30 sec - exiting 21:01:09 (4596): No heartbeat from core client for 30 sec - exiting 21:01:10 (4596): No heartbeat from core client for 30 sec - exiting 21:01:11 (4596): No heartbeat from core client for 30 sec - exiting 21:01:12 (4596): No heartbeat from core client for 30 sec - exiting 21:01:13 (4596): No heartbeat from core client for 30 sec - exiting 21:01:14 (4596): No heartbeat from core client for 30 sec - exiting 21:01:15 (4596): No heartbeat from core client for 30 sec - exiting 21:01:16 (4596): No heartbeat from core client for 30 sec - exiting 21:01:17 (4596): No heartbeat from core client for 30 sec - exiting 21:01:18 (4596): No heartbeat from core client for 30 sec - exiting 21:01:19 (4596): No heartbeat from core client for 30 sec - exiting 21:01:20 (4596): No heartbeat from core client for 30 sec - exiting 21:01:21 (4596): No heartbeat from core client for 30 sec - exiting 21:01:22 (4596): No heartbeat from core client for 30 sec - exiting 21:01:23 (4596): No heartbeat from core client for 30 sec - exiting 21:01:24 (4596): No heartbeat from core client for 30 sec - exiting 21:01:25 (4596): No heartbeat from core client for 30 sec - exiting 21:01:26 (4596): No heartbeat from core client for 30 sec - exiting 21:01:36 (5124): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 21:01:42 (6112): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5688, selfPID=5688, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1012, selfPID=1012, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2716, selfPID=2716, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2880, selfPID=2880, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1228, selfPID=1228, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6192, selfPID=6192, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7036, selfPID=7036, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4532, selfPID=4532, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:48:57 (4508): No heartbeat from core client for 30 sec - exiting 10:48:58 (4508): No heartbeat from core client for 30 sec - exiting 10:48:59 (4508): No heartbeat from core client for 30 sec - exiting 10:49:00 (4508): No heartbeat from core client for 30 sec - exiting 10:49:01 (4508): No heartbeat from core client for 30 sec - exiting 10:49:02 (4508): No heartbeat from core client for 30 sec - exiting 10:49:03 (4508): No heartbeat from core client for 30 sec - exiting 10:49:04 (4508): No heartbeat from core client for 30 sec - exiting 10:49:05 (4508): No heartbeat from core client for 30 sec - exiting 10:49:06 (4508): No heartbeat from core client for 30 sec - exiting 10:49:07 (4508): No heartbeat from core client for 30 sec - exiting 10:49:08 (4508): No heartbeat from core client for 30 sec - exiting 10:49:09 (4508): No heartbeat from core client for 30 sec - exiting 10:49:10 (4508): No heartbeat from core client for 30 sec - exiting 10:49:11 (4508): No heartbeat from core client for 30 sec - exiting 10:49:12 (4508): No heartbeat from core client for 30 sec - exiting 10:49:13 (4508): No heartbeat from core client for 30 sec - exiting 10:49:14 (4508): No heartbeat from core client for 30 sec - exiting 10:49:15 (4508): No heartbeat from core client for 30 sec - exiting 10:49:16 (4508): No heartbeat from core client for 30 sec - exiting 10:49:17 (4508): No heartbeat from core client for 30 sec - exiting 10:49:18 (4508): No heartbeat from core client for 30 sec - exiting 10:49:19 (4508): No heartbeat from core client for 30 sec - exiting 10:49:20 (4508): No heartbeat from core client for 30 sec - exiting 10:49:21 (4508): No heartbeat from core client for 30 sec - exiting 10:49:22 (4508): No heartbeat from core client for 30 sec - exiting 10:49:23 (4508): No heartbeat from core client for 30 sec - exiting 10:49:24 (4508): No heartbeat from core client for 30 sec - exiting 10:49:25 (4508): No heartbeat from core client for 30 sec - exiting 10:49:26 (4508): No heartbeat from core client for 30 sec - exiting 10:49:27 (4508): No heartbeat from core client for 30 sec - exiting 10:49:28 (4508): No heartbeat from core client for 30 sec - exiting 10:49:29 (4508): No heartbeat from core client for 30 sec - exiting 10:49:30 (4508): No heartbeat from core client for 30 sec - exiting 10:49:31 (4508): No heartbeat from core client for 30 sec - exiting 10:49:32 (4508): No heartbeat from core client for 30 sec - exiting 10:49:33 (4508): No heartbeat from core client for 30 sec - exiting 10:49:34 (4508): No heartbeat from core client for 30 sec - exiting 10:49:35 (4508): No heartbeat from core client for 30 sec - exiting 10:49:36 (4508): No heartbeat from core client for 30 sec - exiting 10:49:37 (4508): No heartbeat from core client for 30 sec - exiting 10:49:38 (4508): No heartbeat from core client for 30 sec - exiting 10:49:39 (4508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:46 (4616): No heartbeat from core client for 30 sec - exiting 22:05:47 (4616): No heartbeat from core client for 30 sec - exiting 22:05:48 (4616): No heartbeat from core client for 30 sec - exiting 22:05:49 (4616): No heartbeat from core client for 30 sec - exiting 22:05:50 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:44:43 (4360): No heartbeat from core client for 30 sec - exiting 18:44:44 (4360): No heartbeat from core client for 30 sec - exiting 18:44:45 (4360): No heartbeat from core client for 30 sec - exiting 18:44:46 (4360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5816, selfPID=5816, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 19:29:55 (1504): No heartbeat from core client for 30 sec - exiting 19:29:56 (1504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:54:15 (5460): No heartbeat from core client for 30 sec - exiting 17:54:16 (5460): No heartbeat from core client for 30 sec - exiting 17:54:17 (5460): No heartbeat from core client for 30 sec - exiting 17:54:18 (5460): No heartbeat from core client for 30 sec - exiting 17:54:19 (5460): No heartbeat from core client for 30 sec - exiting 17:54:20 (5460): No heartbeat from core client for 30 sec - exiting 17:54:21 (5460): No heartbeat from core client for 30 sec - exiting 17:54:22 (5460): No heartbeat from core client for 30 sec - exiting 17:54:23 (5460): No heartbeat from core client for 30 sec - exiting 17:54:24 (5460): No heartbeat from core client for 30 sec - exiting 17:54:25 (5460): No heartbeat from core client for 30 sec - exiting 17:54:26 (5460): No heartbeat from core client for 30 sec - exiting 17:54:27 (5460): No heartbeat from core client for 30 sec - exiting 17:54:28 (5460): No heartbeat from core client for 30 sec - exiting 17:54:29 (5460): No heartbeat from core client for 30 sec - exiting 17:54:30 (5460): No heartbeat from core client for 30 sec - exiting 17:54:31 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:35 (5152): No heartbeat from core client for 30 sec - exiting 20:45:36 (5152): No heartbeat from core client for 30 sec - exiting 20:45:37 (5152): No heartbeat from core client for 30 sec - exiting 20:45:38 (5152): No heartbeat from core client for 30 sec - exiting 20:45:39 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:58:32 (4376): No heartbeat from core client for 30 sec - exiting 20:58:33 (4376): No heartbeat from core client for 30 sec - exiting 20:58:34 (4376): No heartbeat from core client for 30 sec - exiting 20:58:35 (4376): No heartbeat from core client for 30 sec - exiting 20:58:36 (4376): No heartbeat from core client for 30 sec - exiting 20:58:37 (4376): No heartbeat from core client for 30 sec - exiting 20:58:38 (4376): No heartbeat from core client for 30 sec - exiting 20:58:39 (4376): No heartbeat from core client for 30 sec - exiting 20:58:40 (4376): No heartbeat from core client for 30 sec - exiting 20:58:41 (4376): No heartbeat from core client for 30 sec - exiting 20:58:42 (4376): No heartbeat from core client for 30 sec - exiting 20:58:43 (4376): No heartbeat from core client for 30 sec - exiting 20:58:44 (4376): No heartbeat from core client for 30 sec - exiting 20:58:45 (4376): No heartbeat from core client for 30 sec - exiting 20:58:46 (4376): No heartbeat from core client for 30 sec - exiting 20:58:47 (4376): No heartbeat from core client for 30 sec - exiting 20:58:48 (4376): No heartbeat from core client for 30 sec - exiting 20:58:49 (4376): No heartbeat from core client for 30 sec - exiting 20:58:50 (4376): No heartbeat from core client for 30 sec - exiting 20:58:51 (4376): No heartbeat from core client for 30 sec - exiting 20:58:52 (4376): No heartbeat from core client for 30 sec - exiting 20:58:53 (4376): No heartbeat from core client for 30 sec - exiting 20:58:54 (4376): No heartbeat from core client for 30 sec - exiting 20:58:55 (4376): No heartbeat from core client for 30 sec - exiting 20:58:56 (4376): No heartbeat from core client for 30 sec - exiting 20:58:57 (4376): No heartbeat from core client for 30 sec - exiting 20:58:58 (4376): No heartbeat from core client for 30 sec - exiting 20:58:59 (4376): No heartbeat from core client for 30 sec - exiting 20:59:00 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Feb 2012 15:24:45	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	126,816	315,381	2.4869
30 Jan 2012 17:31:09	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	115,296	286,611	2.4859
28 Jan 2012 17:02:45	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	103,776	257,979	2.4859
26 Nov 2011 06:19:01	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	92,256	229,644	2.4892
11 Oct 2011 12:59:30	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	80,736	201,640	2.4975
08 Oct 2011 19:13:55	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	69,216	173,444	2.5058
01 Sep 2011 12:19:54	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	57,696	144,918	2.5118
31 Aug 2011 01:25:23	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	46,176	116,406	2.5209
30 Aug 2011 14:25:29	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	34,656	87,370	2.5211
02 Aug 2011 11:37:50	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	23,136	59,082	2.5537
01 Jul 2011 11:54:56	1132204	12559664	hadam3p_eu_xdwt_1988_1_006965637_2	11,616	30,070	2.5887