Task 14333010

Name	hadam3p_saf_7mbn_2002_1_007849429_0
Workunit	8004541
Created	30 Mar 2012, 21:37:38 UTC
Sent	30 Mar 2012, 21:38:10 UTC
Report deadline	13 Mar 2013, 2:58:10 UTC
Received	10 Apr 2012, 23:55:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1123396
Run time	1 days 13 hours 24 min 11 sec
CPU time	1 days 13 hours 7 min 13 sec
Validate state	Invalid
Credit	749.07
Device peak FLOPS	2.55 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:13:13 (1852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=820, selfPID=820, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5744, selfPID=5744, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5384, selfPID=5384, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6084, selfPID=6084, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4352, selfPID=4352, iMonCtr=2 09:01:45 (344): No heartbeat from core client for 30 sec - exiting 09:01:47 (344): No heartbeat from core client for 30 sec - exiting 09:01:50 (344): No heartbeat from core client for 30 sec - exiting 09:01:51 (344): No heartbeat from core client for 30 sec - exiting 09:01:52 (344): No heartbeat from core client for 30 sec - exiting 09:01:54 (344): No heartbeat from core client for 30 sec - exiting 09:01:55 (344): No heartbeat from core client for 30 sec - exiting 09:01:56 (344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:58 (344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=216, selfPID=216, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4668, selfPID=4668, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3152, selfPID=3152, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2572, selfPID=2572, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 10:43:22 (1228): No heartbeat from core client for 30 sec - exiting 10:43:23 (1228): No heartbeat from core client for 30 sec - exiting 10:43:24 (1228): No heartbeat from core client for 30 sec - exiting 10:43:25 (1228): No heartbeat from core client for 30 sec - exiting 10:43:26 (1228): No heartbeat from core client for 30 sec - exiting 10:43:27 (1228): No heartbeat from core client for 30 sec - exiting 10:43:29 (1228): No heartbeat from core client for 30 sec - exiting 10:43:30 (1228): No heartbeat from core client for 30 sec - exiting 10:43:31 (1228): No heartbeat from core client for 30 sec - exiting 10:43:32 (1228): No heartbeat from core client for 30 sec - exiting 10:43:33 (1228): No heartbeat from core client for 30 sec - exiting 10:43:34 (1228): No heartbeat from core client for 30 sec - exiting 10:43:35 (1228): No heartbeat from core client for 30 sec - exiting 10:43:36 (1228): No heartbeat from core client for 30 sec - exiting 10:43:37 (1228): No heartbeat from core client for 30 sec - exiting 10:43:39 (1228): No heartbeat from core client for 30 sec - exiting 10:43:40 (1228): No heartbeat from core client for 30 sec - exiting 10:43:41 (1228): No heartbeat from core client for 30 sec - exiting 10:43:42 (1228): No heartbeat from core client for 30 sec - exiting 10:43:43 (1228): No heartbeat from core client for 30 sec - exiting 10:43:44 (1228): No heartbeat from core client for 30 sec - exiting 10:43:45 (1228): No heartbeat from core client for 30 sec - exiting 10:43:47 (1228): No heartbeat from core client for 30 sec - exiting 10:43:48 (1228): No heartbeat from core client for 30 sec - exiting 10:43:49 (1228): No heartbeat from core client for 30 sec - exiting 10:43:50 (1228): No heartbeat from core client for 30 sec - exiting 10:43:51 (1228): No heartbeat from core client for 30 sec - exiting 10:43:52 (1228): No heartbeat from core client for 30 sec - exiting 10:43:53 (1228): No heartbeat from core client for 30 sec - exiting 10:43:54 (1228): No heartbeat from core client for 30 sec - exiting 10:43:55 (1228): No heartbeat from core client for 30 sec - exiting 10:43:56 (1228): No heartbeat from core client for 30 sec - exiting 10:43:58 (1228): No heartbeat from core client for 30 sec - exiting 10:43:59 (1228): No heartbeat from core client for 30 sec - exiting 10:44:00 (1228): No heartbeat from core client for 30 sec - exiting 10:44:01 (1228): No heartbeat from core client for 30 sec - exiting 10:44:02 (1228): No heartbeat from core client for 30 sec - exiting 10:44:03 (1228): No heartbeat from core client for 30 sec - exiting 10:44:04 (1228): No heartbeat from core client for 30 sec - exiting 10:44:05 (1228): No heartbeat from core client for 30 sec - exiting 10:44:06 (1228): No heartbeat from core client for 30 sec - exiting 10:44:07 (1228): No heartbeat from core client for 30 sec - exiting 10:44:09 (1228): No heartbeat from core client for 30 sec - exiting 10:44:10 (1228): No heartbeat from core client for 30 sec - exiting 10:44:11 (1228): No heartbeat from core client for 30 sec - exiting 10:44:12 (1228): No heartbeat from core client for 30 sec - exiting 10:44:13 (1228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5476, selfPID=5476, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:33:47 (2444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1220, selfPID=1220, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:01:23 (2648): No heartbeat from core client for 30 sec - exiting 08:01:24 (2648): No heartbeat from core client for 30 sec - exiting 08:01:25 (2648): No heartbeat from core client for 30 sec - exiting 08:01:27 (2648): No heartbeat from core client for 30 sec - exiting 08:01:29 (2648): No heartbeat from core client for 30 sec - exiting 08:01:31 (2648): No heartbeat from core client for 30 sec - exiting 08:01:32 (2648): No heartbeat from core client for 30 sec - exiting 08:01:34 (2648): No heartbeat from core client for 30 sec - exiting 08:01:35 (2648): No heartbeat from core client for 30 sec - exiting 08:01:37 (2648): No heartbeat from core client for 30 sec - exiting 08:01:38 (2648): No heartbeat from core client for 30 sec - exiting 08:01:40 (2648): No heartbeat from core client for 30 sec - exiting 08:01:42 (2648): No heartbeat from core client for 30 sec - exiting 08:01:43 (2648): No heartbeat from core client for 30 sec - exiting 08:01:44 (2648): No heartbeat from core client for 30 sec - exiting 08:01:45 (2648): No heartbeat from core client for 30 sec - exiting 08:01:47 (2648): No heartbeat from core client for 30 sec - exiting 08:01:48 (2648): No heartbeat from core client for 30 sec - exiting 08:01:50 (2648): No heartbeat from core client for 30 sec - exiting 08:01:51 (2648): No heartbeat from core client for 30 sec - exiting 08:01:52 (2648): No heartbeat from core client for 30 sec - exiting 08:01:53 (2648): No heartbeat from core client for 30 sec - exiting 08:01:54 (2648): No heartbeat from core client for 30 sec - exiting 08:01:56 (2648): No heartbeat from core client for 30 sec - exiting 08:01:57 (2648): No heartbeat from core client for 30 sec - exiting 08:01:58 (2648): No heartbeat from core client for 30 sec - exiting 08:01:59 (2648): No heartbeat from core client for 30 sec - exiting 08:02:00 (2648): No heartbeat from core client for 30 sec - exiting 08:02:01 (2648): No heartbeat from core client for 30 sec - exiting 08:02:02 (2648): No heartbeat from core client for 30 sec - exiting 08:02:03 (2648): No heartbeat from core client for 30 sec - exiting 08:02:04 (2648): No heartbeat from core client for 30 sec - exiting 08:02:05 (2648): No heartbeat from core client for 30 sec - exiting 08:02:06 (2648): No heartbeat from core client for 30 sec - exiting 08:02:08 (2648): No heartbeat from core client for 30 sec - exiting 08:02:09 (2648): No heartbeat from core client for 30 sec - exiting 08:02:10 (2648): No heartbeat from core client for 30 sec - exiting 08:02:11 (2648): No heartbeat from core client for 30 sec - exiting 08:02:12 (2648): No heartbeat from core client for 30 sec - exiting 08:02:13 (2648): No heartbeat from core client for 30 sec - exiting 08:02:14 (2648): No heartbeat from core client for 30 sec - exiting 08:02:15 (2648): No heartbeat from core client for 30 sec - exiting 08:02:16 (2648): No heartbeat from core client for 30 sec - exiting 08:02:18 (2648): No heartbeat from core client for 30 sec - exiting 08:02:19 (2648): No heartbeat from core client for 30 sec - exiting 08:02:20 (2648): No heartbeat from core client for 30 sec - exiting 08:02:21 (2648): No heartbeat from core client for 30 sec - exiting 08:02:22 (2648): No heartbeat from core client for 30 sec - exiting 08:02:23 (2648): No heartbeat from core client for 30 sec - exiting 08:02:24 (2648): No heartbeat from core client for 30 sec - exiting 08:02:26 (2648): No heartbeat from core client for 30 sec - exiting 08:02:27 (2648): No heartbeat from core client for 30 sec - exiting 08:02:28 (2648): No heartbeat from core client for 30 sec - exiting 08:02:29 (2648): No heartbeat from core client for 30 sec - exiting 08:02:30 (2648): No heartbeat from core client for 30 sec - exiting 08:02:32 (2648): No heartbeat from core client for 30 sec - exiting 08:02:33 (2648): No heartbeat from core client for 30 sec - exiting 08:02:34 (2648): No heartbeat from core client for 30 sec - exiting 08:02:35 (2648): No heartbeat from core client for 30 sec - exiting 08:02:36 (2648): No heartbeat from core client for 30 sec - exiting 08:02:37 (2648): No heartbeat from core client for 30 sec - exiting 08:02:38 (2648): No heartbeat from core client for 30 sec - exiting 08:02:40 (2648): No heartbeat from core client for 30 sec - exiting 08:02:41 (2648): No heartbeat from core client for 30 sec - exiting 08:02:42 (2648): No heartbeat from core client for 30 sec - exiting 08:02:43 (2648): No heartbeat from core client for 30 sec - exiting 08:02:44 (2648): No heartbeat from core client for 30 sec - exiting 08:02:45 (2648): No heartbeat from core client for 30 sec - exiting 08:02:46 (2648): No heartbeat from core client for 30 sec - exiting 08:02:47 (2648): No heartbeat from core client for 30 sec - exiting 08:02:48 (2648): No heartbeat from core client for 30 sec - exiting 08:02:49 (2648): No heartbeat from core client for 30 sec - exiting 08:02:51 (2648): No heartbeat from core client for 30 sec - exiting 08:02:52 (2648): No heartbeat from core client for 30 sec - exiting 08:02:53 (2648): No heartbeat from core client for 30 sec - exiting 08:02:54 (2648): No heartbeat from core client for 30 sec - exiting 08:02:55 (2648): No heartbeat from core client for 30 sec - exiting 08:02:56 (2648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5768, selfPID=5768, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:45:34 (2032): No heartbeat from core client for 30 sec - exiting 11:45:35 (2032): No heartbeat from core client for 30 sec - exiting 11:45:36 (2032): No heartbeat from core client for 30 sec - exiting 11:45:37 (2032): No heartbeat from core client for 30 sec - exiting 11:45:38 (2032): No heartbeat from core client for 30 sec - exiting 11:45:39 (2032): No heartbeat from core client for 30 sec - exiting 11:45:41 (2032): No heartbeat from core client for 30 sec - exiting 11:45:42 (2032): No heartbeat from core client for 30 sec - exiting 11:45:43 (2032): No heartbeat from core client for 30 sec - exiting 11:45:44 (2032): No heartbeat from core client for 30 sec - exiting 11:45:45 (2032): No heartbeat from core client for 30 sec - exiting 11:45:46 (2032): No heartbeat from core client for 30 sec - exiting 11:45:47 (2032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5724, selfPID=5724, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. forrtl: severe (38): error during write, unit 6, file T:\boinc\projects\climateprediction.net\hadam3p_saf_7mbn_2002_1_007849429\dataout\xaakg.out Image PC Routine Line Source hadrm3p_saf_um_6. 0073C52A Unknown Unknown Unknown hadrm3p_saf_um_6. 00739858 Unknown Unknown Unknown hadrm3p_saf_um_6. 006E4460 Unknown Unknown Unknown hadrm3p_saf_um_6. 006E362A Unknown Unknown Unknown hadrm3p_saf_um_6. 006B59F1 Unknown Unknown Unknown hadrm3p_saf_um_6. 006B28F5 Unknown Unknown Unknown hadrm3p_saf_um_6. 00662ACE Unknown Unknown Unknown hadrm3p_saf_um_6. 006635AF Unknown Unknown Unknown hadrm3p_saf_um_6. 00409860 Unknown Unknown Unknown hadrm3p_saf_um_6. 00720893 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5056, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_saf_7mbn_2002_1_007849429_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7mbn_2002_1_007849429_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7mbn_2002_1_007849429_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7mbn_2002_1_007849429_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7mbn_2002_1_007849429_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7mbn_2002_1_007849429_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7mbn_2002_1_007849429_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7mbn_2002_1_007849429_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Apr 2012 13:19:32	1123396	14333010	hadam3p_saf_7mbn_2002_1_007849429_0	46,176	125,507	2.7180
08 Apr 2012 16:07:05	1123396	14333010	hadam3p_saf_7mbn_2002_1_007849429_0	34,656	95,450	2.7542
04 Apr 2012 17:12:18	1123396	14333010	hadam3p_saf_7mbn_2002_1_007849429_0	23,193	64,605	2.7855
04 Apr 2012 16:10:21	1123396	14333010	hadam3p_saf_7mbn_2002_1_007849429_0	23,136	63,127	2.7285
02 Apr 2012 20:51:28	1123396	14333010	hadam3p_saf_7mbn_2002_1_007849429_0	11,616	31,660	2.7256