Task 12856775

Name	hadam3p_saf_26pu_1975_1_007239663_0
Workunit	7437903
Created	4 May 2011, 5:51:42 UTC
Sent	10 May 2011, 13:22:36 UTC
Report deadline	21 Apr 2012, 18:42:36 UTC
Received	26 May 2011, 16:49:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1148458
Run time	2 days 7 hours 51 min 28 sec
CPU time	2 days 6 hours 8 min 22 sec
Validate state	Invalid
Credit	1,309.70
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> 20:51:53 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6000, selfPID=6000, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3508, selfPID=3508, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 00:32:36 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3732, selfPID=3732, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:11:43 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5372, selfPID=5372, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2528, selfPID=2528, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5908, selfPID=5908, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=644, selfPID=644, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3508, selfPID=3508, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1712, selfPID=1712, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=644, selfPID=644, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:14:10 (2112): No heartbeat from core client for 30 sec - exiting 18:14:11 (2112): No heartbeat from core client for 30 sec - exiting 18:14:12 (2112): No heartbeat from core client for 30 sec - exiting 18:14:13 (2112): No heartbeat from core client for 30 sec - exiting 18:14:14 (2112): No heartbeat from core client for 30 sec - exiting 18:14:15 (2112): No heartbeat from core client for 30 sec - exiting 18:14:16 (2112): No heartbeat from core client for 30 sec - exiting 18:14:17 (2112): No heartbeat from core client for 30 sec - exiting 18:14:18 (2112): No heartbeat from core client for 30 sec - exiting 18:14:19 (2112): No heartbeat from core client for 30 sec - exiting 18:14:21 (2112): No heartbeat from core client for 30 sec - exiting 18:14:22 (2112): No heartbeat from core client for 30 sec - exiting 18:14:23 (2112): No heartbeat from core client for 30 sec - exiting 18:14:24 (2112): No heartbeat from core client for 30 sec - exiting 18:14:25 (2112): No heartbeat from core client for 30 sec - exiting 18:14:26 (2112): No heartbeat from core client for 30 sec - exiting 18:14:27 (2112): No heartbeat from core client for 30 sec - exiting 18:14:28 (2112): No heartbeat from core client for 30 sec - exiting 18:14:29 (2112): No heartbeat from core client for 30 sec - exiting 18:14:30 (2112): No heartbeat from core client for 30 sec - exiting 18:14:32 (2112): No heartbeat from core client for 30 sec - exiting 18:14:33 (2112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:19:14 (5516): No heartbeat from core client for 30 sec - exiting 21:19:15 (5516): No heartbeat from core client for 30 sec - exiting 21:19:16 (5516): No heartbeat from core client for 30 sec - exiting 21:19:17 (5516): No heartbeat from core client for 30 sec - exiting 21:19:18 (5516): No heartbeat from core client for 30 sec - exiting 21:19:19 (5516): No heartbeat from core client for 30 sec - exiting 21:19:20 (5516): No heartbeat from core client for 30 sec - exiting 21:19:22 (5516): No heartbeat from core client for 30 sec - exiting 21:19:23 (5516): No heartbeat from core client for 30 sec - exiting 21:19:24 (5516): No heartbeat from core client for 30 sec - exiting 21:19:25 (5516): No heartbeat from core client for 30 sec - exiting 21:19:26 (5516): No heartbeat from core client for 30 sec - exiting 21:19:27 (5516): No heartbeat from core client for 30 sec - exiting 21:19:28 (5516): No heartbeat from core client for 30 sec - exiting 21:19:29 (5516): No heartbeat from core client for 30 sec - exiting 21:19:30 (5516): No heartbeat from core client for 30 sec - exiting 21:19:31 (5516): No heartbeat from core client for 30 sec - exiting 21:19:32 (5516): No heartbeat from core client for 30 sec - exiting 21:19:34 (5516): No heartbeat from core client for 30 sec - exiting 21:19:35 (5516): No heartbeat from core client for 30 sec - exiting 21:19:36 (5516): No heartbeat from core client for 30 sec - exiting 21:19:37 (5516): No heartbeat from core client for 30 sec - exiting 21:19:38 (5516): No heartbeat from core client for 30 sec - exiting 21:19:39 (5516): No heartbeat from core client for 30 sec - exiting 21:19:40 (5516): No heartbeat from core client for 30 sec - exiting 21:19:41 (5516): No heartbeat from core client for 30 sec - exiting 21:19:42 (5516): No heartbeat from core client for 30 sec - exiting 21:19:43 (5516): No heartbeat from core client for 30 sec - exiting 21:19:45 (5516): No heartbeat from core client for 30 sec - exiting 21:19:46 (5516): No heartbeat from core client for 30 sec - exiting 21:19:47 (5516): No heartbeat from core client for 30 sec - exiting 21:19:48 (5516): No heartbeat from core client for 30 sec - exiting 21:19:49 (5516): No heartbeat from core client for 30 sec - exiting 21:19:50 (5516): No heartbeat from core client for 30 sec - exiting 21:19:51 (5516): No heartbeat from core client for 30 sec - exiting 21:19:52 (5516): No heartbeat from core client for 30 sec - exiting 21:19:53 (5516): No heartbeat from core client for 30 sec - exiting 21:19:54 (5516): No heartbeat from core client for 30 sec - exiting 21:19:55 (5516): No heartbeat from core client for 30 sec - exiting 21:19:57 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:39:47 (3140): No heartbeat from core client for 30 sec - exiting 21:39:49 (3140): No heartbeat from core client for 30 sec - exiting 21:39:50 (3140): No heartbeat from core client for 30 sec - exiting 21:39:51 (3140): No heartbeat from core client for 30 sec - exiting 21:39:52 (3140): No heartbeat from core client for 30 sec - exiting 21:39:53 (3140): No heartbeat from core client for 30 sec - exiting 21:39:54 (3140): No heartbeat from core client for 30 sec - exiting 21:39:55 (3140): No heartbeat from core client for 30 sec - exiting 21:39:56 (3140): No heartbeat from core client for 30 sec - exiting 21:39:57 (3140): No heartbeat from core client for 30 sec - exiting 21:39:58 (3140): No heartbeat from core client for 30 sec - exiting 21:39:59 (3140): No heartbeat from core client for 30 sec - exiting 21:40:00 (3140): No heartbeat from core client for 30 sec - exiting 21:40:01 (3140): No heartbeat from core client for 30 sec - exiting 21:40:02 (3140): No heartbeat from core client for 30 sec - exiting 21:40:03 (3140): No heartbeat from core client for 30 sec - exiting 21:40:04 (3140): No heartbeat from core client for 30 sec - exiting 21:40:05 (3140): No heartbeat from core client for 30 sec - exiting 21:40:06 (3140): No heartbeat from core client for 30 sec - exiting 21:40:07 (3140): No heartbeat from core client for 30 sec - exiting 21:40:08 (3140): No heartbeat from core client for 30 sec - exiting 21:40:09 (3140): No heartbeat from core client for 30 sec - exiting 21:40:10 (3140): No heartbeat from core client for 30 sec - exiting 21:40:11 (3140): No heartbeat from core client for 30 sec - exiting 21:40:12 (3140): No heartbeat from core client for 30 sec - exiting 21:40:13 (3140): No heartbeat from core client for 30 sec - exiting 21:40:14 (3140): No heartbeat from core client for 30 sec - exiting 21:40:15 (3140): No heartbeat from core client for 30 sec - exiting 21:40:16 (3140): No heartbeat from core client for 30 sec - exiting 21:40:17 (3140): No heartbeat from core client for 30 sec - exiting 21:40:18 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=580, selfPID=580, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=624, selfPID=624, iMonCtr=2 23:44:36 (364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2148, selfPID=2148, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3012, selfPID=3012, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4456, selfPID=4456, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4800, selfPID=4800, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:54:13 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4892, selfPID=4892, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional WorCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5100, selfPID=5100, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... RegionCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5444, selfPID=5444, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2980, selfPID=2980, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5564, selfPID=5564, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1052, selfPID=1052, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:04:10 (1804): No heartbeat from core client for 30 sec - exiting 17:04:11 (1804): No heartbeat from core client for 30 sec - exiting 17:04:12 (1804): No heartbeat from core client for 30 sec - exiting 17:04:14 (1804): No heartbeat from core client for 30 sec - exiting 17:04:15 (1804): No heartbeat from core client for 30 sec - exiting 17:04:16 (1804): No heartbeat from core client for 30 sec - exiting 17:04:17 (1804): No heartbeat from core client for 30 sec - exiting 17:04:18 (1804): No heartbeat from core client for 30 sec - exiting 17:04:19 (1804): No heartbeat from core client for 30 sec - exiting 17:04:20 (1804): No heartbeat from core client for 30 sec - exiting 17:04:21 (1804): No heartbeat from core client for 30 sec - exiting 17:04:22 (1804): No heartbeat from core client for 30 sec - exiting 17:04:23 (1804): No heartbeat from core client for 30 sec - exiting 17:04:24 (1804): No heartbeat from core client for 30 sec - exiting 17:04:26 (1804): No heartbeat from core client for 30 sec - exiting 17:04:27 (1804): No heartbeat from core client for 30 sec - exiting 17:04:28 (1804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:29 (1804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4756, CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3584, selfPID=3584, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=408, selfPID=1248, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 May 2011 17:09:07	1148458	12856775	hadam3p_saf_26pu_1975_1_007239663_0	80,736	175,405	2.1726
23 May 2011 11:29:05	1148458	12856775	hadam3p_saf_26pu_1975_1_007239663_0	69,216	150,758	2.1781
19 May 2011 16:14:47	1148458	12856775	hadam3p_saf_26pu_1975_1_007239663_0	57,696	125,668	2.1781
18 May 2011 14:12:44	1148458	12856775	hadam3p_saf_26pu_1975_1_007239663_0	46,176	100,680	2.1804
17 May 2011 20:20:42	1148458	12856775	hadam3p_saf_26pu_1975_1_007239663_0	34,656	75,977	2.1923
16 May 2011 03:24:24	1148458	12856775	hadam3p_saf_26pu_1975_1_007239663_0	23,136	50,689	2.1909
14 May 2011 17:22:03	1148458	12856775	hadam3p_saf_26pu_1975_1_007239663_0	11,616	25,945	2.2336