Task 15707591

Name	hadam3p_eu_qfpk_2001_1_008346149_0
Workunit	8497010
Created	5 Apr 2013, 14:14:40 UTC
Sent	5 Apr 2013, 19:41:57 UTC
Report deadline	19 Mar 2014, 1:01:57 UTC
Received	3 Jun 2013, 22:55:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1266651
Run time	4 days 9 hours 24 min 56 sec
CPU time	2 days 18 hours 20 min 46 sec
Validate state	Invalid
Credit	1,591.48
Device peak FLOPS	2.94 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> Got ack for job that's till active </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3968, selfPID=3968, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:51:48 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=35936, selfPID=35936, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14016, selfPID=14016, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=50528, selfPID=50528, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:58:18 (42848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=62104, selfPID=62104, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=102440, selfPID=102440, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=120032, selfPID=120032, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12248, selfPID=12248, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=72820, selfPID=72820, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=120180, selfPID=120180, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=233412, selfPID=233412, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:23:53 (168852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=224144, selfPID=224144, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=225564, selfPID=225564, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=63540, selfPID=63540, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=114572, selfPID=114572, iMonCtr=2 23:02:29 (142868): No heartbeat from core client for 30 sec - exiting 23:02:30 (142868): No heartbeat from core client for 30 sec - exiting 23:02:31 (142868): No heartbeat from core client for 30 sec - exiting 23:02:32 (142868): No heartbeat from core client for 30 sec - exiting 23:02:33 (142868): No heartbeat from core client for 30 sec - exiting 23:02:34 (142868): No heartbeat from core client for 30 sec - exiting 23:02:35 (142868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:02:36 (142868): No heartbeat from core client for 30 sec - exiting 23:02:37 (142868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=242400, selfPID=240676, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=242400, selfPID=242400, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=31156, selfPID=31156, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=73128, selfPID=73128, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=150784, selfPID=150784, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=170360, selfPID=170360, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=47384, selfPID=47384, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=44876, selfPID=44876, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23140, selfPID=23140, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=62992, selfPID=62992, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=115716, selfPID=115716, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24216, selfPID=24216, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=74832, selfPID=74832, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=54432, selfPID=54432, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=118548, selfPID=118548, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=57556, selfPID=57556, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:29:23 (230804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=33020, selfPID=33020, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=29504, selfPID=29504, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:31:42 (125664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:44 (125664): No heartbeat from core client for 30 sec - exiting 11:31:45 (125664): No heartbeat from core client for 30 sec - exiting 11:31:46 (125664): No heartbeat from core client for 30 sec - exiting 11:31:47 (125664): No heartbeat from core client for 30 sec - exiting 11:31:48 (125664): No heartbeat from core client for 30 sec - exiting 11:33:48 (110208): No heartbeat from core client for 30 sec - exiting 11:33:49 (110208): No heartbeat from core client for 30 sec - exiting 11:33:50 (110208): No heartbeat from core client for 30 sec - exiting 11:33:51 (110208): No heartbeat from core client for 30 sec - exiting 11:33:52 (110208): No heartbeat from core client for 30 sec - exiting 11:33:53 (110208): No heartbeat from core client for 30 sec - exiting 11:33:54 (110208): No heartbeat from core client for 30 sec - exiting 11:33:55 (110208): No heartbeat from core client for 30 sec - exiting 11:33:56 (110208): No heartbeat from core client for 30 sec - exiting 11:33:57 (110208): No heartbeat from core client for 30 sec - exiting 11:33:58 (110208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:59 (110208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=77572, selfPID=77572, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:52:28 (11124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:23:01 (12588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:23:03 (12588): No heartbeat from core client for 30 sec - exiting 23:15:52 (5376): No heartbeat from core client for 30 sec - exiting 23:15:53 (5376): No heartbeat from core client for 30 sec - exiting 23:15:54 (5376): No heartbeat from core client for 30 sec - exiting 23:15:55 (5376): No heartbeat from core client for 30 sec - exiting 23:15:56 (5376): No heartbeat from core client for 30 sec - exiting 23:15:57 (5376): No heartbeat from core client for 30 sec - exiting 23:15:58 (5376): No heartbeat from core client for 30 sec - exiting 23:15:59 (5376): No heartbeat from core client for 30 sec - exiting 23:16:00 (5376): No heartbeat from core client for 30 sec - exiting 23:16:01 (5376): No heartbeat from core client for 30 sec - exiting 23:16:02 (5376): No heartbeat from core client for 30 sec - exiting 23:16:03 (5376): No heartbeat from core client for 30 sec - exiting 23:16:04 (5376): No heartbeat from core client for 30 sec - exiting 23:16:05 (5376): No heartbeat from core client for 30 sec - exiting 23:16:06 (5376): No heartbeat from core client for 30 sec - exiting 23:16:07 (5376): No heartbeat from core client for 30 sec - exiting 23:16:08 (5376): No heartbeat from core client for 30 sec - exiting 23:16:09 (5376): No heartbeat from core client for 30 sec - exiting 23:16:10 (5376): No heartbeat from core client for 30 sec - exiting 23:16:41 (5376): No heartbeat from core client for 30 sec - exiting 23:16:42 (5376): No heartbeat from core client for 30 sec - exiting 23:16:43 (5376): No heartbeat from core client for 30 sec - exiting 23:16:44 (5376): No heartbeat from core client for 30 sec - exiting 23:16:45 (5376): No heartbeat from core client for 30 sec - exiting 23:16:46 (5376): No heartbeat from core client for 30 sec - exiting 23:16:47 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:48 (5376): No heartbeat from core client for 30 sec - exiting 23:16:49 (5376): No heartbeat from core client for 30 sec - exiting 23:16:50 (5376): No heartbeat from core client for 30 sec - exiting 23:16:51 (5376): No heartbeat from core client for 30 sec - exiting 23:16:52 (5376): No heartbeat from core client for 30 sec - exiting 23:16:53 (5376): No heartbeat from core client for 30 sec - exiting 23:17:28 (852): No heartbeat from core client for 30 sec - exiting 23:17:29 (852): No heartbeat from core client for 30 sec - exiting 23:17:30 (852): No heartbeat from core client for 30 sec - exiting 23:17:31 (852): No heartbeat from core client for 30 sec - exiting 23:17:32 (852): No heartbeat from core client for 30 sec - exiting 23:17:33 (852): No heartbeat from core client for 30 sec - exiting 23:17:34 (852): No heartbeat from core client for 30 sec - exiting 23:17:35 (852): No heartbeat from core client for 30 sec - exiting 23:17:36 (852): No heartbeat from core client for 30 sec - exiting 23:17:37 (852): No heartbeat from core client for 30 sec - exiting 23:17:38 (852): No heartbeat from core client for 30 sec - exiting 23:17:39 (852): No heartbeat from core client for 30 sec - exiting 23:17:40 (852): No heartbeat from core client for 30 sec - exiting 23:17:41 (852): No heartbeat from core client for 30 sec - exiting 23:17:42 (852): No heartbeat from core client for 30 sec - exiting 23:17:43 (852): No heartbeat from core client for 30 sec - exiting 23:17:44 (852): No heartbeat from core client for 30 sec - exiting 23:17:45 (852): No heartbeat from core client for 30 sec - exiting 23:17:46 (852): No heartbeat from core client for 30 sec - exiting 23:17:47 (852): No heartbeat from core client for 30 sec - exiting 23:17:48 (852): No heartbeat from core client for 30 sec - exiting 23:17:49 (852): No heartbeat from core client for 30 sec - exiting 23:17:50 (852): No heartbeat from core client for 30 sec - exiting 23:17:51 (852): No heartbeat from core client for 30 sec - exiting 23:17:52 (852): No heartbeat from core client for 30 sec - exiting 23:17:53 (852): No heartbeat from core client for 30 sec - exiting 23:17:54 (852): No heartbeat from core client for 30 sec - exiting 23:17:55 (852): No heartbeat from core client for 30 sec - exiting 23:17:56 (852): No heartbeat from core client for 30 sec - exiting 23:17:57 (852): No heartbeat from core client for 30 sec - exiting 23:17:58 (852): No heartbeat from core client for 30 sec - exiting 23:17:59 (852): No heartbeat from core client for 30 sec - exiting 23:18:00 (852): No heartbeat from core client for 30 sec - exiting 23:18:01 (852): No heartbeat from core client for 30 sec - exiting 23:18:02 (852): No heartbeat from core client for 30 sec - exiting 23:18:03 (852): No heartbeat from core client for 30 sec - exiting 23:18:04 (852): No heartbeat from core client for 30 sec - exiting 23:18:05 (852): No heartbeat from core client for 30 sec - exiting 23:18:06 (852): No heartbeat from core client for 30 sec - exiting 23:18:07 (852): No heartbeat from core client for 30 sec - exiting 23:18:08 (852): No heartbeat from core client for 30 sec - exiting 23:18:09 (852): No heartbeat from core client for 30 sec - exiting 23:18:10 (852): No heartbeat from core client for 30 sec - exiting 23:18:11 (852): No heartbeat from core client for 30 sec - exiting 23:18:12 (852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... zip error: Output file write failure (write error on zip file) Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 May 2013 05:16:42	1266651	15707591	hadam3p_eu_qfpk_2001_1_008346149_0	92,256	220,116	2.3859
28 May 2013 18:39:48	1266651	15707591	hadam3p_eu_qfpk_2001_1_008346149_0	80,736	192,235	2.3810
28 May 2013 09:44:02	1266651	15707591	hadam3p_eu_qfpk_2001_1_008346149_0	69,216	166,416	2.4043
27 May 2013 20:27:46	1266651	15707591	hadam3p_eu_qfpk_2001_1_008346149_0	57,696	143,797	2.4923
15 May 2013 09:40:50	1266651	15707591	hadam3p_eu_qfpk_2001_1_008346149_0	46,176	115,309	2.4972
14 May 2013 12:14:57	1266651	15707591	hadam3p_eu_qfpk_2001_1_008346149_0	34,656	87,081	2.5127
12 May 2013 16:36:10	1266651	15707591	hadam3p_eu_qfpk_2001_1_008346149_0	23,136	57,534	2.4868
10 May 2013 18:21:05	1266651	15707591	hadam3p_eu_qfpk_2001_1_008346149_0	11,616	28,859	2.4844