Task 12529657

Name	hadam3p_saf_2brq_1999_1_007144937_0
Workunit	7329717
Created	26 Jan 2011, 20:33:50 UTC
Sent	6 Feb 2011, 13:28:29 UTC
Report deadline	19 Jan 2012, 18:48:29 UTC
Received	30 Jul 2011, 3:31:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	930227
Run time
CPU time	19 hours 27 min 42 sec
Validate state	Invalid
Credit	188.44
Device peak FLOPS	1.53 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>6.2.19</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 07:57:26 (4728): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3692, selfPID=3692, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3676, selfPID=3676, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:43:01 (3568): No heartbeat from core client for 30 sec - exiting 23:43:02 (3568): No heartbeat from core client for 30 sec - exiting 23:43:03 (3568): No heartbeat from core client for 30 sec - exiting 23:43:04 (3568): No heartbeat from core client for 30 sec - exiting 23:43:05 (3568): No heartbeat from core client for 30 sec - exiting 23:43:06 (3568): No heartbeat from core client for 30 sec - exiting 23:43:07 (3568): No heartbeat from core client for 30 sec - exiting 23:43:08 (3568): No heartbeat from core client for 30 sec - exiting 23:43:09 (3568): No heartbeat from core client for 30 sec - exiting 23:43:11 (3568): No heartbeat from core client for 30 sec - exiting 23:43:12 (3568): No heartbeat from core client for 30 sec - exiting 23:43:13 (3568): No heartbeat from core client for 30 sec - exiting 23:43:14 (3568): No heartbeat from core client for 30 sec - exiting 23:43:15 (3568): No heartbeat from core client for 30 sec - exiting 23:43:16 (3568): No heartbeat from core client for 30 sec - exiting 23:43:17 (3568): No heartbeat from core client for 30 sec - exiting 23:43:18 (3568): No heartbeat from core client for 30 sec - exiting 23:43:19 (3568): No heartbeat from core client for 30 sec - exiting 23:43:20 (3568): No heartbeat from core client for 30 sec - exiting 23:43:22 (3568): No heartbeat from core client for 30 sec - exiting 23:43:23 (3568): No heartbeat from core client for 30 sec - exiting 23:43:24 (3568): No heartbeat from core client for 30 sec - exiting 23:43:25 (3568): No heartbeat from core client for 30 sec - exiting 23:43:26 (3568): No heartbeat from core client for 30 sec - exiting 23:43:27 (3568): No heartbeat from core client for 30 sec - exiting 23:43:28 (3568): No heartbeat from core client for 30 sec - exiting 23:43:29 (3568): No heartbeat from core client for 30 sec - exiting 23:43:30 (3568): No heartbeat from core client for 30 sec - exiting 23:43:31 (3568): No heartbeat from core client for 30 sec - exiting 23:43:32 (3568): No heartbeat from core client for 30 sec - exiting 23:43:34 (3568): No heartbeat from core client for 30 sec - exiting 23:43:35 (3568): No heartbeat from core client for 30 sec - exiting 23:43:36 (3568): No heartbeat from core client for 30 sec - exiting 23:43:37 (3568): No heartbeat from core client for 30 sec - exiting 23:43:38 (3568): No heartbeat from core client for 30 sec - exiting 23:43:39 (3568): No heartbeat from core client for 30 sec - exiting 23:43:40 (3568): No heartbeat from core client for 30 sec - exiting 23:43:41 (3568): No heartbeat from core client for 30 sec - exiting 23:43:42 (3568): No heartbeat from core client for 30 sec - exiting 23:43:43 (3568): No heartbeat from core client for 30 sec - exiting 23:43:44 (3568): No heartbeat from core client for 30 sec - exiting 23:43:46 (3568): No heartbeat from core client for 30 sec - exiting 23:43:47 (3568): No heartbeat from core client for 30 sec - exiting 23:43:48 (3568): No heartbeat from core client for 30 sec - exiting 23:43:49 (3568): No heartbeat from core client for 30 sec - exiting 23:43:50 (3568): No heartbeat from core client for 30 sec - exiting 23:43:51 (3568): No heartbeat from core client for 30 sec - exiting 23:43:52 (3568): No heartbeat from core client for 30 sec - exiting 23:43:53 (3568): No heartbeat from core client for 30 sec - exiting 23:43:54 (3568): No heartbeat from core client for 30 sec - exiting 23:43:55 (3568): No heartbeat from core client for 30 sec - exiting 23:43:57 (3568): No heartbeat from core client for 30 sec - exiting 23:43:58 (3568): No heartbeat from core client for 30 sec - exiting 23:43:59 (3568): No heartbeat from core client for 30 sec - exiting 23:44:00 (3568): No heartbeat from core client for 30 sec - exiting 23:44:01 (3568): No heartbeat from core client for 30 sec - exiting 23:44:02 (3568): No heartbeat from core client for 30 sec - exiting 23:44:03 (3568): No heartbeat from core client for 30 sec - exiting 23:44:04 (3568): No heartbeat from core client for 30 sec - exiting 23:44:05 (3568): No heartbeat from core client for 30 sec - exiting 23:44:06 (3568): No heartbeat from core client for 30 sec - exiting 23:44:07 (3568): No heartbeat from core client for 30 sec - exiting 23:44:09 (3568): No heartbeat from core client for 30 sec - exiting 23:44:10 (3568): No heartbeat from core client for 30 sec - exiting 23:44:11 (3568): No heartbeat from core client for 30 sec - exiting 23:44:12 (3568): No heartbeat from core client for 30 sec - exiting 23:44:13 (3568): No heartbeat from core client for 30 sec - exiting 23:44:14 (3568): No heartbeat from core client for 30 sec - exiting 23:44:15 (3568): No heartbeat from core client for 30 sec - exiting 23:44:16 (3568): No heartbeat from core client for 30 sec - exiting 23:44:17 (3568): No heartbeat from core client for 30 sec - exiting 23:44:18 (3568): No heartbeat from core client for 30 sec - exiting 23:44:19 (3568): No heartbeat from core client for 30 sec - exiting 23:44:21 (3568): No heartbeat from core client for 30 sec - exiting 23:44:22 (3568): No heartbeat from core client for 30 sec - exiting 23:44:23 (3568): No heartbeat from core client for 30 sec - exiting 23:44:24 (3568): No heartbeat from core client for 30 sec - exiting 23:44:25 (3568): No heartbeat from core client for 30 sec - exiting 23:44:26 (3568): No heartbeat from core client for 30 sec - exiting 23:44:27 (3568): No heartbeat from core client for 30 sec - exiting 23:44:28 (3568): No heartbeat from core client for 30 sec - exiting 23:44:29 (3568): No heartbeat from core client for 30 sec - exiting 23:44:30 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3480, selfPID=3480, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:08:19 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:06 (460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:45 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4872, selfPID=4872, iMonCtr=2 04:11:54 (4888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:13:40 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:19 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:15:28 (5988): No heartbeat from core client for 30 sec - exiting 04:15:29 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:17:17 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:19:03 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:20:50 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:22:38 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:24 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:12 (5844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:00 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:29:46 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:31:33 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:33:20 (6160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:35:08 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:36:56 (5728): No heartbeat from core client for 30 sec - exiting 04:36:58 (5728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:37:36 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:38:45 (6252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:40:33 (6292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:42:21 (6316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:08 (6332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:57 (6372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:47:45 (6276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:49:32 (6328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:51:20 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:53:09 (6444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:56 (6480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:44 (6504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:58:32 (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:20 (6508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:02:08 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:55 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:41 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:27 (6688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:08:05 (6632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:15 (6696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:11:03 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:11:42 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:12:50 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:39 (6740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:17 (6728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:26 (6808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:18:13 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:18:52 (6848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:20:01 (6872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:50 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:22:27 (6896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:36 (6884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:24 (6904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:26:03 (6812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:11 (6964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:00 (6800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:37 (6928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:30:47 (6996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:37 (7008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:33:13 (6960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:21 (6864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7004, selfPID=7004, iMonCtr=2 05:36:04 (6844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:39 (6988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:37:47 (7116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:56 (7056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:39 (7024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:41:47 (7140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:42:22 (7176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:30 (7204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:44:05 (7208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:44:39 (7260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:14 (7248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:22 (7304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:30 (7264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:05 (7292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:14 (7020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:22 (7312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:05 (6980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:14 (7344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:57 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:05 (7448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:40 (7456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:48 (7420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:56 (7324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:31 (7516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:00:40 (7544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:01:48 (7460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:02:23 (7196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:32 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:40 (7504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:17 (7632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:24 (7604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:32 (7628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:08:07 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:09:16 (7608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:10:24 (7736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:10:59 (7724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:07 (7752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:16 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:51 (7816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:59 (7600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:16:08 (7496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2011 11:59:18	930227	12529657	hadam3p_saf_2brq_1999_1_007144937_0	11,616	57,350	4.9372