Task 14305002

Name	hadam3p_eu_wvt3_1999_1_007837436_1
Workunit	7992548
Created	22 Mar 2012, 16:53:29 UTC
Sent	22 Mar 2012, 16:53:50 UTC
Report deadline	4 Mar 2013, 22:13:50 UTC
Received	9 Apr 2012, 17:55:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1183651
Run time	3 days 8 hours 49 min 35 sec
CPU time	3 days 3 hours 15 min 13 sec
Validate state	Invalid
Credit	2,383.08
Device peak FLOPS	3.29 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... zip error: Could not create output file (was replacing the original zip file) CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:05:51 (7044): No heartbeat from core client for 30 sec - exiting 10:05:52 (7044): No heartbeat from core client for 30 sec - exiting 10:05:54 (7044): No heartbeat from core client for 30 sec - exiting 10:05:55 (7044): No heartbeat from core client for 30 sec - exiting 10:05:56 (7044): No heartbeat from core client for 30 sec - exiting 10:05:57 (7044): No heartbeat from core client for 30 sec - exiting 10:05:58 (7044): No heartbeat from core client for 30 sec - exiting 10:05:59 (7044): No heartbeat from core client for 30 sec - exiting 10:06:00 (7044): No heartbeat from core client for 30 sec - exiting 10:06:01 (7044): No heartbeat from core client for 30 sec - exiting 10:06:02 (7044): No heartbeat from core client for 30 sec - exiting 10:06:03 (7044): No heartbeat from core client for 30 sec - exiting 10:06:04 (7044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4696, selfPID=4696, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:41:10 (5772): No heartbeat from core client for 30 sec - exiting 09:41:13 (5772): No heartbeat from core client for 30 sec - exiting 09:41:14 (5772): No heartbeat from core client for 30 sec - exiting 09:41:15 (5772): No heartbeat from core client for 30 sec - exiting 09:41:16 (5772): No heartbeat from core client for 30 sec - exiting 09:41:17 (5772): No heartbeat from core client for 30 sec - exiting 09:41:18 (5772): No heartbeat from core client for 30 sec - exiting 09:41:19 (5772): No heartbeat from core client for 30 sec - exiting 09:41:20 (5772): No heartbeat from core client for 30 sec - exiting 09:41:21 (5772): No heartbeat from core client for 30 sec - exiting 09:41:22 (5772): No heartbeat from core client for 30 sec - exiting 09:41:23 (5772): No heartbeat from core client for 30 sec - exiting 09:41:25 (5772): No heartbeat from core client for 30 sec - exiting 09:41:26 (5772): No heartbeat from core client for 30 sec - exiting 09:41:27 (5772): No heartbeat from core client for 30 sec - exiting 09:41:28 (5772): No heartbeat from core client for 30 sec - exiting 09:41:29 (5772): No heartbeat from core client for 30 sec - exiting 09:41:30 (5772): No heartbeat from core client for 30 sec - exiting 09:41:31 (5772): No heartbeat from core client for 30 sec - exiting 09:41:32 (5772): No heartbeat from core client for 30 sec - exiting 09:41:33 (5772): No heartbeat from core client for 30 sec - exiting 09:41:34 (5772): No heartbeat from core client for 30 sec - exiting 09:41:35 (5772): No heartbeat from core client for 30 sec - exiting 09:41:37 (5772): No heartbeat from core client for 30 sec - exiting 09:41:38 (5772): No heartbeat from core client for 30 sec - exiting 09:41:39 (5772): No heartbeat from core client for 30 sec - exiting 09:41:40 (5772): No heartbeat from core client for 30 sec - exiting 09:41:41 (5772): No heartbeat from core client for 30 sec - exiting 09:41:42 (5772): No heartbeat from core client for 30 sec - exiting 09:41:43 (5772): No heartbeat from core client for 30 sec - exiting 09:41:44 (5772): No heartbeat from core client for 30 sec - exiting 09:41:45 (5772): No heartbeat from core client for 30 sec - exiting 09:41:46 (5772): No heartbeat from core client for 30 sec - exiting 09:41:47 (5772): No heartbeat from core client for 30 sec - exiting 09:41:49 (5772): No heartbeat from core client for 30 sec - exiting 09:41:50 (5772): No heartbeat from core client for 30 sec - exiting 09:41:51 (5772): No heartbeat from core client for 30 sec - exiting 09:41:52 (5772): No heartbeat from core client for 30 sec - exiting 09:41:53 (5772): No heartbeat from core client for 30 sec - exiting 09:41:54 (5772): No heartbeat from core client for 30 sec - exiting 09:41:55 (5772): No heartbeat from core client for 30 sec - exiting 09:41:56 (5772): No heartbeat from core client for 30 sec - exiting 09:41:57 (5772): No heartbeat from core client for 30 sec - exiting 09:41:58 (5772): No heartbeat from core client for 30 sec - exiting 09:41:59 (5772): No heartbeat from core client for 30 sec - exiting 09:42:01 (5772): No heartbeat from core client for 30 sec - exiting 09:42:02 (5772): No heartbeat from core client for 30 sec - exiting 09:42:03 (5772): No heartbeat from core client for 30 sec - exiting 09:42:04 (5772): No heartbeat from core client for 30 sec - exiting 09:42:05 (5772): No heartbeat from core client for 30 sec - exiting 09:42:06 (5772): No heartbeat from core client for 30 sec - exiting 09:42:07 (5772): No heartbeat from core client for 30 sec - exiting 09:42:08 (5772): No heartbeat from core client for 30 sec - exiting 09:42:09 (5772): No heartbeat from core client for 30 sec - exiting 09:42:10 (5772): No heartbeat from core client for 30 sec - exiting 09:42:11 (5772): No heartbeat from core client for 30 sec - exiting 09:42:13 (5772): No heartbeat from core client for 30 sec - exiting 09:42:14 (5772): No heartbeat from core client for 30 sec - exiting 09:42:15 (5772): No heartbeat from core client for 30 sec - exiting 09:42:16 (5772): No heartbeat from core client for 30 sec - exiting 09:42:17 (5772): No heartbeat from core client for 30 sec - exiting 09:42:18 (5772): No heartbeat from core client for 30 sec - exiting 09:42:19 (5772): No heartbeat from core client for 30 sec - exiting 09:42:20 (5772): No heartbeat from core client for 30 sec - exiting 09:42:21 (5772): No heartbeat from core client for 30 sec - exiting 09:42:22 (5772): No heartbeat from core client for 30 sec - exiting 09:42:24 (5772): No heartbeat from core client for 30 sec - exiting 09:42:25 (5772): No heartbeat from core client for 30 sec - exiting 09:42:26 (5772): No heartbeat from core client for 30 sec - exiting 09:42:27 (5772): No heartbeat from core client for 30 sec - exiting 09:42:28 (5772): No heartbeat from core client for 30 sec - exiting 09:42:29 (5772): No heartbeat from core client for 30 sec - exiting 09:42:30 (5772): No heartbeat from core client for 30 sec - exiting 09:42:31 (5772): No heartbeat from core client for 30 sec - exiting 09:42:32 (5772): No heartbeat from core client for 30 sec - exiting 09:42:33 (5772): No heartbeat from core client for 30 sec - exiting 09:42:34 (5772): No heartbeat from core client for 30 sec - exiting 09:42:36 (5772): No heartbeat from core client for 30 sec - exiting 09:42:37 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2776, selfPID=2776, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8912, selfPID=8912, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1980, selfPID=1980, iMonCtr=2 Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0feb CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:50:17 (3268): No heartbeat from core client for 30 sec - exiting 22:50:18 (3268): No heartbeat from core client for 30 sec - exiting 22:50:19 (3268): No heartbeat from core client for 30 sec - exiting 22:50:20 (3268): No heartbeat from core client for 30 sec - exiting 22:50:21 (3268): No heartbeat from core client for 30 sec - exiting 22:50:22 (3268): No heartbeat from core client for 30 sec - exiting 22:50:23 (3268): No heartbeat from core client for 30 sec - exiting 22:50:24 (3268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6416, selfPID=6416, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 10:11:39 (5088): No heartbeat from core client for 30 sec - exiting 10:11:40 (5088): No heartbeat from core client for 30 sec - exiting 10:11:41 (5088): No heartbeat from core client for 30 sec - exiting 10:11:42 (5088): No heartbeat from core client for 30 sec - exiting 10:11:43 (5088): No heartbeat from core client for 30 sec - exiting 10:11:44 (5088): No heartbeat from core client for 30 sec - exiting 10:11:45 (5088): No heartbeat from core client for 30 sec - exiting 10:11:46 (5088): No heartbeat from core client for 30 sec - exiting 10:11:47 (5088): No heartbeat from core client for 30 sec - exiting 10:11:49 (5088): No heartbeat from core client for 30 sec - exiting 10:11:50 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:51 (5088): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5916, iMonCtr=2 10:28:15 (6788): No heartbeat from core client for 30 sec - exiting 10:28:16 (6788): No heartbeat from core client for 30 sec - exiting 10:28:17 (6788): No heartbeat from core client for 30 sec - exiting 10:28:18 (6788): No heartbeat from core client for 30 sec - exiting 10:28:19 (6788): No heartbeat from core client for 30 sec - exiting 10:28:20 (6788): No heartbeat from core client for 30 sec - exiting 10:28:21 (6788): No heartbeat from core client for 30 sec - exiting 10:28:22 (6788): No heartbeat from core client for 30 sec - exiting 10:28:23 (6788): No heartbeat from core client for 30 sec - exiting 10:28:24 (6788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0mar 10:20:30 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4476, selfPID=4476, iMonCtr=2 Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0apr 18:05:06 (6012): No heartbeat from core client for 30 sec - exiting 18:05:08 (6012): No heartbeat from core client for 30 sec - exiting 18:05:09 (6012): No heartbeat from core client for 30 sec - exiting 18:05:10 (6012): No heartbeat from core client for 30 sec - exiting 18:05:11 (6012): No heartbeat from core client for 30 sec - exiting 18:05:12 (6012): No heartbeat from core client for 30 sec - exiting 18:05:13 (6012): No heartbeat from core client for 30 sec - exiting 18:05:14 (6012): No heartbeat from core client for 30 sec - exiting 18:05:15 (6012): No heartbeat from core client for 30 sec - exiting 18:05:16 (6012): No heartbeat from core client for 30 sec - exiting 18:05:17 (6012): No heartbeat from core client for 30 sec - exiting 18:05:19 (6012): No heartbeat from core client for 30 sec - exiting 18:05:20 (6012): No heartbeat from core client for 30 sec - exiting 18:05:21 (6012): No heartbeat from core client for 30 sec - exiting 18:05:22 (6012): No heartbeat from core client for 30 sec - exiting 18:05:23 (6012): No heartbeat from core client for 30 sec - exiting 18:05:24 (6012): No heartbeat from core client for 30 sec - exiting 18:05:25 (6012): No heartbeat from core client for 30 sec - exiting 18:05:26 (6012): No heartbeat from core client for 30 sec - exiting 18:05:27 (6012): No heartbeat from core client for 30 sec - exiting 18:05:28 (6012): No heartbeat from core client for 30 sec - exiting 18:05:29 (6012): No heartbeat from core client for 30 sec - exiting 18:05:30 (6012): No heartbeat from core client for 30 sec - exiting 18:05:31 (6012): No heartbeat from core client for 30 sec - exiting 18:05:32 (6012): No heartbeat from core client for 30 sec - exiting 18:05:33 (6012): No heartbeat from core client for 30 sec - exiting 18:05:34 (6012): No heartbeat from core client for 30 sec - exiting 18:05:35 (6012): No heartbeat from core client for 30 sec - exiting 18:05:36 (6012): No heartbeat from core client for 30 sec - exiting 18:05:37 (6012): No heartbeat from core client for 30 sec - exiting 18:05:38 (6012): No heartbeat from core client for 30 sec - exiting 18:05:39 (6012): No heartbeat from core client for 30 sec - exiting 18:05:40 (6012): No heartbeat from core client for 30 sec - exiting 18:05:41 (6012): No heartbeat from core client for 30 sec - exiting 18:05:43 (6012): No heartbeat from core client for 30 sec - exiting 18:05:44 (6012): No heartbeat from core client for 30 sec - exiting 18:05:45 (6012): No heartbeat from core client for 30 sec - exiting 18:05:46 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:47 (6012): No heartbeat from core client for 30 sec - exiting Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0may Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0jun Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0jul CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN proceCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0aug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9364, selfPID=9364, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3332, selfPID=3332, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6768, selfPID=6768, iMonCtr=2 Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0sep CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5460, selfPID=5460, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8044, selfPID=9188, iMonCtr=1 Model crash detected, will try to restart... 22:44:01 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3140, selfPID=3140, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0oct CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4804, selfPID=3304, iMonCtr=1 Model crash detected, will try to restart... 10:01:54 (7084): No heartbeat from core client for 30 sec - exiting 10:01:55 (7084): No heartbeat from core client for 30 sec - exiting 10:01:57 (7084): No heartbeat from core client for 30 sec - exiting 10:01:58 (7084): No heartbeat from core client for 30 sec - exiting 10:01:59 (7084): No heartbeat from core client for 30 sec - exiting 10:02:00 (7084): No heartbeat from core client for 30 sec - exiting 10:02:01 (7084): No heartbeat from core client for 30 sec - exiting 10:02:02 (7084): No heartbeat from core client for 30 sec - exiting 10:02:03 (7084): No heartbeat from core client for 30 sec - exiting 10:02:04 (7084): No heartbeat from core client for 30 sec - exiting 10:02:05 (7084): No heartbeat from core client for 30 sec - exiting 10:02:06 (7084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_wvt3_1999_1_007837436/dataout\wvt3ma.pck0nov Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_wvt3_1999_1_007837436_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Apr 2012 16:14:22	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	138,144	270,183	1.9558
08 Apr 2012 21:56:22	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	126,624	247,665	1.9559
08 Apr 2012 09:39:45	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	115,104	224,963	1.9544
07 Apr 2012 16:46:49	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	103,584	202,598	1.9559
06 Apr 2012 20:38:24	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	92,064	179,867	1.9537
06 Apr 2012 14:07:00	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	80,544	157,231	1.9521
05 Apr 2012 21:18:25	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	69,024	134,565	1.9495
05 Apr 2012 14:32:28	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	57,504	111,691	1.9423
04 Apr 2012 21:59:12	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	45,984	88,873	1.9327
28 Mar 2012 12:52:06	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	34,464	66,090	1.9177
27 Mar 2012 13:04:33	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	22,944	43,927	1.9145
26 Mar 2012 21:04:40	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	11,522	22,509	1.9536
26 Mar 2012 21:04:40	1183651	14305002	hadam3p_eu_wvt3_1999_1_007837436_1	11,520	22,212	1.9281