Task 11964649

Name	hadam3p_saf_v9c8_1968_1_006741699_0
Workunit	6945043
Created	3 Nov 2010, 22:11:08 UTC
Sent	3 Nov 2010, 22:19:24 UTC
Report deadline	17 Oct 2011, 3:39:24 UTC
Received	14 Dec 2010, 12:16:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1101581
Run time	1 days 10 hours 28 min 25 sec
CPU time	1 days 9 hours 19 min 27 sec
Validate state	Invalid
Credit	749.07
Device peak FLOPS	2.24 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.05 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7344, selfPID=7344, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8468, selfPID=8468, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1100, selfPID=1100, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6660, selfPID=6660, iMonCtr=2 18:38:21 (6156): No heartbeat from core client for 30 sec - exiting 18:38:22 (6156): No heartbeat from core client for 30 sec - exiting 18:38:23 (6156): No heartbeat from core client for 30 sec - exiting 18:38:24 (6156): No heartbeat from core client for 30 sec - exiting 18:38:25 (6156): No heartbeat from core client for 30 sec - exiting 18:38:26 (6156): No heartbeat from core client for 30 sec - exiting 18:38:27 (6156): No heartbeat from core client for 30 sec - exiting 18:38:28 (6156): No heartbeat from core client for 30 sec - exiting 18:38:29 (6156): No heartbeat from core client for 30 sec - exiting 18:38:30 (6156): No heartbeat from core client for 30 sec - exiting 18:38:31 (6156): No heartbeat from core client for 30 sec - exiting 18:38:32 (6156): No heartbeat from core client for 30 sec - exiting 18:38:33 (6156): No heartbeat from core client for 30 sec - exiting 18:38:34 (6156): No heartbeat from core client for 30 sec - exiting 18:38:35 (6156): No heartbeat from core client for 30 sec - exiting 18:38:36 (6156): No heartbeat from core client for 30 sec - exiting 18:38:37 (6156): No heartbeat from core client for 30 sec - exiting 18:38:38 (6156): No heartbeat from core client for 30 sec - exiting 18:38:39 (6156): No heartbeat from core client for 30 sec - exiting 18:38:40 (6156): No heartbeat from core client for 30 sec - exiting 18:38:41 (6156): No heartbeat from core client for 30 sec - exiting 18:38:42 (6156): No heartbeat from core client for 30 sec - exiting 18:38:43 (6156): No heartbeat from core client for 30 sec - exiting 18:38:44 (6156): No heartbeat from core client for 30 sec - exiting 18:38:45 (6156): No heartbeat from core client for 30 sec - exiting 18:38:46 (6156): No heartbeat from core client for 30 sec - exiting 18:38:51 (6156): No heartbeat from core client for 30 sec - exiting 18:38:52 (6156): No heartbeat from core client for 30 sec - exiting 18:38:53 (6156): No heartbeat from core client for 30 sec - exiting 18:38:54 (6156): No heartbeat from core client for 30 sec - exiting 18:38:55 (6156): No heartbeat from core client for 30 sec - exiting 18:38:56 (6156): No heartbeat from core client for 30 sec - exiting 18:38:57 (6156): No heartbeat from core client for 30 sec - exiting 18:38:58 (6156): No heartbeat from core client for 30 sec - exiting 18:38:59 (6156): No heartbeat from core client for 30 sec - exiting 18:39:00 (6156): No heartbeat from core client for 30 sec - exiting 18:39:01 (6156): No heartbeat from core client for 30 sec - exiting 18:39:02 (6156): No heartbeat from core client for 30 sec - exiting 18:39:03 (6156): No heartbeat from core client for 30 sec - exiting 18:39:04 (6156): No heartbeat from core client for 30 sec - exiting 18:39:05 (6156): No heartbeat from core client for 30 sec - exiting 18:39:06 (6156): No heartbeat from core client for 30 sec - exiting 18:39:07 (6156): No heartbeat from core client for 30 sec - exiting 18:39:08 (6156): No heartbeat from core client for 30 sec - exiting 18:39:09 (6156): No heartbeat from core client for 30 sec - exiting 18:39:10 (6156): No heartbeat from core client for 30 sec - exiting 18:39:11 (6156): No heartbeat from core client for 30 sec - exiting 18:39:12 (6156): No heartbeat from core client for 30 sec - exiting 18:39:13 (6156): No heartbeat from core client for 30 sec - exiting 18:39:14 (6156): No heartbeat from core client for 30 sec - exiting 18:39:15 (6156): No heartbeat from core client for 30 sec - exiting 18:39:16 (6156): No heartbeat from core client for 30 sec - exiting 18:39:17 (6156): No heartbeat from core client for 30 sec - exiting 18:39:18 (6156): No heartbeat from core client for 30 sec - exiting 18:39:19 (6156): No heartbeat from core client for 30 sec - exiting 18:39:20 (6156): No heartbeat from core client for 30 sec - exiting 18:39:21 (6156): No heartbeat from core client for 30 sec - exiting 18:39:22 (6156): No heartbeat from core client for 30 sec - exiting 18:39:23 (6156): No heartbeat from core client for 30 sec - exiting 18:39:24 (6156): No heartbeat from core client for 30 sec - exiting 18:39:25 (6156): No heartbeat from core client for 30 sec - exiting 18:39:26 (6156): No heartbeat from core client for 30 sec - exiting 18:39:27 (6156): No heartbeat from core client for 30 sec - exiting 18:39:28 (6156): No heartbeat from core client for 30 sec - exiting 18:39:29 (6156): No heartbeat from core client for 30 sec - exiting 18:39:30 (6156): No heartbeat from core client for 30 sec - exiting 18:39:31 (6156): No heartbeat from core client for 30 sec - exiting 18:39:32 (6156): No heartbeat from core client for 30 sec - exiting 18:39:33 (6156): No heartbeat from core client for 30 sec - exiting 18:39:34 (6156): No heartbeat from core client for 30 sec - exiting 18:39:35 (6156): No heartbeat from core client for 30 sec - exiting 18:39:36 (6156): No heartbeat from core client for 30 sec - exiting 18:39:37 (6156): No heartbeat from core client for 30 sec - exiting 18:39:38 (6156): No heartbeat from core client for 30 sec - exiting 18:39:39 (6156): No heartbeat from core client for 30 sec - exiting 18:39:40 (6156): No heartbeat from core client for 30 sec - exiting 18:39:41 (6156): No heartbeat from core client for 30 sec - exiting 18:39:42 (6156): No heartbeat from core client for 30 sec - exiting 18:39:43 (6156): No heartbeat from core client for 30 sec - exiting 18:39:44 (6156): No heartbeat from core client for 30 sec - exiting 18:39:45 (6156): No heartbeat from core client for 30 sec - exiting 18:39:46 (6156): No heartbeat from core client for 30 sec - exiting 18:39:47 (6156): No heartbeat from core client for 30 sec - exiting 18:39:48 (6156): No heartbeat from core client for 30 sec - exiting 18:39:49 (6156): No heartbeat from core client for 30 sec - exiting 18:39:50 (6156): No heartbeat from core client for 30 sec - exiting 18:39:51 (6156): No heartbeat from core client for 30 sec - exiting 18:39:52 (6156): No heartbeat from core client for 30 sec - exiting 18:39:53 (6156): No heartbeat from core client for 30 sec - exiting 18:39:54 (6156): No heartbeat from core client for 30 sec - exiting 18:39:55 (6156): No heartbeat from core client for 30 sec - exiting 18:39:57 (6156): No heartbeat from core client for 30 sec - exiting 18:39:58 (6156): No heartbeat from core client for 30 sec - exiting 18:39:59 (6156): No heartbeat from core client for 30 sec - exiting 18:40:00 (6156): No heartbeat from core client for 30 sec - exiting 18:40:01 (6156): No heartbeat from core client for 30 sec - exiting 18:40:02 (6156): No heartbeat from core client for 30 sec - exiting 18:40:03 (6156): No heartbeat from core client for 30 sec - exiting 18:40:04 (6156): No heartbeat from core client for 30 sec - exiting 18:40:05 (6156): No heartbeat from core client for 30 sec - exiting 18:40:06 (6156): No heartbeat from core client for 30 sec - exiting 18:40:07 (6156): No heartbeat from core client for 30 sec - exiting 18:40:08 (6156): No heartbeat from core client for 30 sec - exiting 18:40:09 (6156): No heartbeat from core client for 30 sec - exiting 18:40:10 (6156): No heartbeat from core client for 30 sec - exiting 18:40:11 (6156): No heartbeat from core client for 30 sec - exiting 18:40:12 (6156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:36:25 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5464, selfPID=5464, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4140, selfPID=3932, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7952, selfPID=5652, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4588, selfPID=5380, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5240, selfPID=5240, iMonCtr=2 CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Nov 2010 21:26:08	1101581	11964649	hadam3p_saf_v9c8_1968_1_006741699_0	46,176	111,940	2.4242
15 Nov 2010 23:25:46	1101581	11964649	hadam3p_saf_v9c8_1968_1_006741699_0	34,656	83,661	2.4140
15 Nov 2010 15:39:35	1101581	11964649	hadam3p_saf_v9c8_1968_1_006741699_0	23,136	56,080	2.4239
15 Nov 2010 08:40:43	1101581	11964649	hadam3p_saf_v9c8_1968_1_006741699_0	11,616	28,748	2.4749