Task 14699413

Name	hadam3p_eu_cin0_2009_1_007982301_0
Workunit	8137415
Created	17 May 2012, 9:10:48 UTC
Sent	27 May 2012, 19:25:33 UTC
Report deadline	10 May 2013, 0:45:33 UTC
Received	24 Sep 2012, 11:03:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1207414
Run time	7 days 8 hours 28 min 8 sec
CPU time	6 days 1 hours 35 min 10 sec
Validate state	Invalid
Credit	1,988.94
Device peak FLOPS	2.34 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10056, selfPID=10056, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9452, selfPID=10136, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:00:37 (4512): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6604, selfPID=6604, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=972, selfPID=972, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:03:04 (9376): No heartbeat from core client for 30 sec - exiting 14:03:05 (9376): No heartbeat from core client for 30 sec - exiting 14:03:06 (9376): No heartbeat from core client for 30 sec - exiting 14:03:08 (9376): No heartbeat from core client for 30 sec - exiting 14:03:09 (9376): No heartbeat from core client for 30 sec - exiting 14:03:10 (9376): No heartbeat from core client for 30 sec - exiting 14:03:11 (9376): No heartbeat from core client for 30 sec - exiting 14:03:12 (9376): No heartbeat from core client for 30 sec - exiting 14:03:13 (9376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8584, selfPID=8584, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CGontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3048, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional WoCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3672, selfPID=7452, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9348, selfPID=9348, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9740, selfPID=9740, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4500, selfPID=4500, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9060, selfPID=9060, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3984, selfPID=3984, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8664, selfPID=8664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:19:03 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:19:04 (4352): No heartbeat from core client for 30 sec - exiting 16:19:05 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:36:41 (7912): No heartbeat from core client for 30 sec - exiting 08:36:42 (7912): No heartbeat from core client for 30 sec - exiting 08:36:43 (7912): No heartbeat from core client for 30 sec - exiting 08:36:44 (7912): No heartbeat from core client for 30 sec - exiting 08:36:45 (7912): No heartbeat from core client for 30 sec - exiting 08:36:46 (7912): No heartbeat from core client for 30 sec - exiting 08:36:47 (7912): No heartbeat from core client for 30 sec - exiting 08:36:48 (7912): No heartbeat from core client for 30 sec - exiting 08:36:49 (7912): No heartbeat from core client for 30 sec - exiting 08:36:50 (7912): No heartbeat from core client for 30 sec - exiting 08:36:51 (7912): No heartbeat from core client for 30 sec - exiting 08:36:52 (7912): No heartbeat from core client for 30 sec - exiting 08:36:53 (7912): No heartbeat from core client for 30 sec - exiting 08:36:54 (7912): No heartbeat from core client for 30 sec - exiting 08:36:55 (7912): No heartbeat from core client for 30 sec - exiting 08:36:56 (7912): No heartbeat from core client for 30 sec - exiting 08:36:57 (7912): No heartbeat from core client for 30 sec - exiting 08:36:58 (7912): No heartbeat from core client for 30 sec - exiting 08:36:59 (7912): No heartbeat from core client for 30 sec - exiting 08:37:00 (7912): No heartbeat from core client for 30 sec - exiting 08:37:01 (7912): No heartbeat from core client for 30 sec - exiting 08:37:02 (7912): No heartbeat from core client for 30 sec - exiting 08:37:03 (7912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4064, selfPID=4064, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7588, selfPID=7588, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:24:52 (12652): No heartbeat from core client for 30 sec - exiting 19:24:53 (12652): No heartbeat from core client for 30 sec - exiting 19:24:54 (12652): No heartbeat from core client for 30 sec - exiting 19:24:55 (12652): No heartbeat from core client for 30 sec - exiting 19:24:56 (12652): No heartbeat from core client for 30 sec - exiting 19:24:57 (12652): No heartbeat from core client for 30 sec - exiting 19:24:58 (12652): No heartbeat from core client for 30 sec - exiting 19:24:59 (12652): No heartbeat from core client for 30 sec - exiting 19:25:00 (12652): No heartbeat from core client for 30 sec - exiting 19:25:01 (12652): No heartbeat from core client for 30 sec - exiting 19:25:02 (12652): No heartbeat from core client for 30 sec - exiting 19:25:03 (12652): No heartbeat from core client for 30 sec - exiting 19:25:04 (12652): No heartbeat from core client for 30 sec - exiting 19:25:05 (12652): No heartbeat from core client for 30 sec - exiting 19:25:06 (12652): No heartbeat from core client for 30 sec - exiting 19:25:07 (12652): No heartbeat from core client for 30 sec - exiting 19:25:08 (12652): No heartbeat from core client for 30 sec - exiting 19:25:09 (12652): No heartbeat from core client for 30 sec - exiting 19:25:10 (12652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:33:38 (11100): No heartbeat from core client for 30 sec - exiting 18:33:39 (11100): No heartbeat from core client for 30 sec - exiting 18:33:40 (11100): No heartbeat from core client for 30 sec - exiting 18:33:41 (11100): No heartbeat from core client for 30 sec - exiting 18:33:42 (11100): No heartbeat from core client for 30 sec - exiting 18:33:43 (11100): No heartbeat from core client for 30 sec - exiting 18:33:44 (11100): No heartbeat from core client for 30 sec - exiting 18:33:45 (11100): No heartbeat from core client for 30 sec - exiting 18:33:46 (11100): No heartbeat from core client for 30 sec - exiting 18:33:47 (11100): No heartbeat from core client for 30 sec - exiting 18:33:48 (11100): No heartbeat from core client for 30 sec - exiting 18:33:49 (11100): No heartbeat from core client for 30 sec - exiting 18:33:50 (11100): No heartbeat from core client for 30 sec - exiting 18:33:51 (11100): No heartbeat from core client for 30 sec - exiting 18:33:52 (11100): No heartbeat from core client for 30 sec - exiting 18:33:53 (11100): No heartbeat from core client for 30 sec - exiting 18:33:54 (11100): No heartbeat from core client for 30 sec - exiting 18:33:55 (11100): No heartbeat from core client for 30 sec - exiting 18:33:56 (11100): No heartbeat from core client for 30 sec - exiting 18:33:57 (11100): No heartbeat from core client for 30 sec - exiting 18:33:58 (11100): No heartbeat from core client for 30 sec - exiting 18:33:59 (11100): No heartbeat from core client for 30 sec - exiting 18:34:00 (11100): No heartbeat from core client for 30 sec - exiting 18:34:01 (11100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2820, selfPID=2820, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9220, selfPID=9220, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12088, selfPID=12088, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13792, selfPID=13792, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13264, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8176, selfPID=7392, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2764, selfPID=5316, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5136, selfPID=5000, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_cin0_2009_1_007982301/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_cin0_2009_1_007982301/dataout/region_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_cin0_2009_1_007982301_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cin0_2009_1_007982301_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Sep 2012 12:53:46	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	115,296	484,385	4.2012
04 Sep 2012 18:59:35	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	103,776	434,122	4.1833
29 Aug 2012 18:24:40	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	92,256	388,149	4.2073
25 Aug 2012 13:05:35	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	80,745	345,364	4.2772
25 Aug 2012 12:00:25	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	80,737	344,860	4.2714
24 Aug 2012 20:21:22	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	80,736	344,316	4.2647
19 Aug 2012 17:24:24	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	69,216	292,857	4.2311
30 Jul 2012 22:15:11	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	57,696	242,443	4.2021
25 Jul 2012 15:58:48	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	46,176	190,999	4.1363
20 Jul 2012 01:40:40	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	34,656	142,541	4.1130
07 Jul 2012 15:21:25	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	23,136	90,224	3.8997
21 Jun 2012 19:02:42	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	11,621	46,110	3.9678
21 Jun 2012 18:04:49	1207414	14699413	hadam3p_eu_cin0_2009_1_007982301_0	11,616	45,616	3.9270