Task 12480819

Name	hadam3p_eu_xmu0_1983_1_007010800_2
Workunit	7214116
Created	14 Jan 2011, 18:36:02 UTC
Sent	14 Jan 2011, 18:54:59 UTC
Report deadline	28 Dec 2011, 0:14:59 UTC
Received	13 May 2011, 22:36:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	408667
Run time
CPU time	3 days 21 hours 16 min 48 sec
Validate state	Invalid
Credit	795.71
Device peak FLOPS	1.21 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.08 windows_intelx86
Stderr	<core_client_version>5.3.19</core_client_version> <stderr_txt> CPDN Monitor - Quit request from BOINC... RCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3284, selfPID=3284, iMonCtr=2 06:34:42 (3164): No heartbeat from core client for 30 sec - exiting 06:34:43 (3164): No heartbeat from core client for 30 sec - exiting 06:34:44 (3164): No heartbeat from core client for 30 sec - exiting 06:34:45 (3164): No heartbeat from core client for 30 sec - exiting 06:34:46 (3164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:34:47 (3164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:48:56 (536): No heartbeat from core client for 30 sec - exiting 12:48:57 (536): No heartbeat from core client for 30 sec - exiting 12:48:58 (536): No heartbeat from core client for 30 sec - exiting 12:48:59 (536): No heartbeat from core client for 30 sec - exiting 12:49:00 (536): No heartbeat from core client for 30 sec - exiting 12:49:01 (536): No heartbeat from core client for 30 sec - exiting 12:49:03 (536): No heartbeat from core client for 30 sec - exiting 12:49:04 (536): No heartbeat from core client for 30 sec - exiting 12:49:05 (536): No heartbeat from core client for 30 sec - exiting 12:49:06 (536): No heartbeat from core client for 30 sec - exiting 12:49:07 (536): No heartbeat from core client for 30 sec - exiting 12:49:08 (536): No heartbeat from core client for 30 sec - exiting 12:49:09 (536): No heartbeat from core client for 30 sec - exiting 12:49:10 (536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:57 (2468): No heartbeat from core client for 30 sec - exiting 13:22:58 (2468): No heartbeat from core client for 30 sec - exiting 13:22:59 (2468): No heartbeat from core client for 30 sec - exiting 13:23:01 (2468): No heartbeat from core client for 30 sec - exiting 13:23:02 (2468): No heartbeat from core client for 30 sec - exiting 13:23:03 (2468): No heartbeat from core client for 30 sec - exiting 13:23:04 (2468): No heartbeat from core client for 30 sec - exiting 13:23:05 (2468): No heartbeat from core client for 30 sec - exiting 13:23:06 (2468): No heartbeat from core client for 30 sec - exiting 13:23:07 (2468): No heartbeat from core client for 30 sec - exiting 13:23:08 (2468): No heartbeat from core client for 30 sec - exiting 13:23:09 (2468): No heartbeat from core client for 30 sec - exiting 13:23:10 (2468): No heartbeat from core client for 30 sec - exiting 13:23:11 (2468): No heartbeat from core client for 30 sec - exiting 13:23:13 (2468): No heartbeat from core client for 30 sec - exiting 13:23:14 (2468): No heartbeat from core client for 30 sec - exiting 13:23:15 (2468): No heartbeat from core client for 30 sec - exiting 13:23:16 (2468): No heartbeat from core client for 30 sec - exiting 13:23:17 (2468): No heartbeat from core client for 30 sec - exiting 13:23:18 (2468): No heartbeat from core client for 30 sec - exiting 13:23:19 (2468): No heartbeat from core client for 30 sec - exiting 13:23:20 (2468): No heartbeat from core client for 30 sec - exiting 13:23:21 (2468): No heartbeat from core client for 30 sec - exiting 13:23:23 (2468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=440, selfPID=440, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3448, selfPID=2636, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:36:58 (2696): No heartbeat from core client for 30 sec - exiting 19:36:59 (2696): No heartbeat from core client for 30 sec - exiting 19:37:00 (2696): No heartbeat from core client for 30 sec - exiting 19:37:01 (2696): No heartbeat from core client for 30 sec - exiting 19:37:02 (2696): No heartbeat from core client for 30 sec - exiting 19:37:03 (2696): No heartbeat from core client for 30 sec - exiting 19:37:04 (2696): No heartbeat from core client for 30 sec - exiting 19:37:06 (2696): No heartbeat from core client for 30 sec - exiting 19:37:07 (2696): No heartbeat from core client for 30 sec - exiting 19:37:08 (2696): No heartbeat from core client for 30 sec - exiting 19:37:09 (2696): No heartbeat from core client for 30 sec - exiting 19:37:10 (2696): No heartbeat from core client for 30 sec - exiting 19:37:11 (2696): No heartbeat from core client for 30 sec - exiting 19:37:12 (2696): No heartbeat from core client for 30 sec - exiting 19:37:13 (2696): No heartbeat from core client for 30 sec - exiting 19:37:14 (2696): No heartbeat from core client for 30 sec - exiting 19:37:15 (2696): No heartbeat from core client for 30 sec - exiting 19:37:17 (2696): No heartbeat from core client for 30 sec - exiting 19:37:18 (2696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:02:30 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:33 (3576): No heartbeat from core client for 30 sec - exiting 20:02:34 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 10:54:43 (1492): No heartbeat from core client for 30 sec - exiting 10:54:44 (1492): No heartbeat from core client for 30 sec - exiting 10:54:45 (1492): No heartbeat from core client for 30 sec - exiting 10:54:46 (1492): No heartbeat from core client for 30 sec - exiting 10:54:47 (1492): No heartbeat from core client for 30 sec - exiting 10:54:48 (1492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:12:50 (1456): No heartbeat from core client for 30 sec - exiting 09:12:51 (1456): No heartbeat from core client for 30 sec - exiting 09:12:52 (1456): No heartbeat from core client for 30 sec - exiting 09:12:53 (1456): No heartbeat from core client for 30 sec - exiting 09:12:54 (1456): No heartbeat from core client for 30 sec - exiting 09:12:56 (1456): No heartbeat from core client for 30 sec - exiting 09:12:57 (1456): No heartbeat from core client for 30 sec - exiting 09:12:58 (1456): No heartbeat from core client for 30 sec - exiting 09:12:59 (1456): No heartbeat from core client for 30 sec - exiting 09:13:00 (1456): No heartbeat from core client for 30 sec - exiting 09:13:01 (1456): No heartbeat from core client for 30 sec - exiting 09:13:02 (1456): No heartbeat from core client for 30 sec - exiting 09:13:03 (1456): No heartbeat from core client for 30 sec - exiting 09:13:04 (1456): No heartbeat from core client for 30 sec - exiting 09:13:05 (1456): No heartbeat from core client for 30 sec - exiting 09:13:07 (1456): No heartbeat from core client for 30 sec - exiting 09:13:08 (1456): No heartbeat from core client for 30 sec - exiting 09:13:09 (1456): No heartbeat from core client for 30 sec - exiting 09:13:10 (1456): No heartbeat from core client for 30 sec - exiting 09:13:11 (1456): No heartbeat from core client for 30 sec - exiting 09:13:12 (1456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:39:30 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:31 (3568): No heartbeat from core client for 30 sec - exiting 12:39:32 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... ReCPDN Monitor - Quit request from BOINC... 16:25:06 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:25:07 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... RegCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:12:00 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:12:01 (3524): No heartbeat from core client for 30 sec - exiting 14:12:03 (3524): No heartbeat from core client for 30 sec - exiting 14:59:48 (5068): No heartbeat from core client for 30 sec - exiting 14:59:49 (5068): No heartbeat from core client for 30 sec - exiting 14:59:50 (5068): No heartbeat from core client for 30 sec - exiting 14:59:51 (5068): No heartbeat from core client for 30 sec - exiting 14:59:52 (5068): No heartbeat from core client for 30 sec - exiting 14:59:54 (5068): No heartbeat from core client for 30 sec - exiting 14:59:55 (5068): No heartbeat from core client for 30 sec - exiting 14:59:56 (5068): No heartbeat from core client for 30 sec - exiting 14:59:57 (5068): No heartbeat from core client for 30 sec - exiting 14:59:58 (5068): No heartbeat from core client for 30 sec - exiting 14:59:59 (5068): No heartbeat from core client for 30 sec - exiting 15:00:00 (5068): No heartbeat from core client for 30 sec - exiting 15:00:01 (5068): No heartbeat from core client for 30 sec - exiting 15:00:02 (5068): No heartbeat from core client for 30 sec - exiting 15:00:04 (5068): No heartbeat from core client for 30 sec - exiting 15:00:05 (5068): No heartbeat from core client for 30 sec - exiting 15:00:06 (5068): No heartbeat from core client for 30 sec - exiting 15:00:07 (5068): No heartbeat from core client for 30 sec - exiting 15:00:08 (5068): No heartbeat from core client for 30 sec - exiting 15:00:09 (5068): No heartbeat from core client for 30 sec - exiting 15:00:10 (5068): No heartbeat from core client for 30 sec - exiting 15:00:11 (5068): No heartbeat from core client for 30 sec - exiting 15:00:12 (5068): No heartbeat from core client for 30 sec - exiting 15:00:14 (5068): No heartbeat from core client for 30 sec - exiting 15:00:15 (5068): No heartbeat from core client for 30 sec - exiting 15:00:16 (5068): No heartbeat from core client for 30 sec - exiting 15:00:17 (5068): No heartbeat from core client for 30 sec - exiting 15:00:18 (5068): No heartbeat from core client for 30 sec - exiting 15:00:19 (5068): No heartbeat from core client for 30 sec - exiting 15:00:20 (5068): No heartbeat from core client for 30 sec - exiting 15:00:22 (5068): No heartbeat from core client for 30 sec - exiting 15:00:23 (5068): No heartbeat from core client for 30 sec - exiting 15:00:24 (5068): No heartbeat from core client for 30 sec - exiting 15:00:25 (5068): No heartbeat from core client for 30 sec - exiting 15:00:27 (5068): No heartbeat from core client for 30 sec - exiting 15:00:28 (5068): No heartbeat from core client for 30 sec - exiting 15:00:29 (5068): No heartbeat from core client for 30 sec - exiting 15:00:30 (5068): No heartbeat from core client for 30 sec - exiting 15:00:31 (5068): No heartbeat from core client for 30 sec - exiting 15:00:32 (5068): No heartbeat from core client for 30 sec - exiting 15:00:33 (5068): No heartbeat from core client for 30 sec - exiting 15:00:35 (5068): No heartbeat from core client for 30 sec - exiting 15:00:36 (5068): No heartbeat from core client for 30 sec - exiting 15:00:37 (5068): No heartbeat from core client for 30 sec - exiting 15:00:38 (5068): No heartbeat from core client for 30 sec - exiting 15:00:39 (5068): No heartbeat from core client for 30 sec - exiting 15:00:40 (5068): No heartbeat from core client for 30 sec - exiting 15:00:41 (5068): No heartbeat from core client for 30 sec - exiting 15:00:43 (5068): No heartbeat from core client for 30 sec - exiting 15:00:44 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:30 (6100): No heartbeat from core client for 30 sec - exiting 15:43:32 (6100): No heartbeat from core client for 30 sec - exiting 15:43:33 (6100): No heartbeat from core client for 30 sec - exiting 15:43:34 (6100): No heartbeat from core client for 30 sec - exiting 15:43:35 (6100): No heartbeat from core client for 30 sec - exiting 15:43:36 (6100): No heartbeat from core client for 30 sec - exiting 15:43:37 (6100): No heartbeat from core client for 30 sec - exiting 15:43:38 (6100): No heartbeat from core client for 30 sec - exiting 15:43:39 (6100): No heartbeat from core client for 30 sec - exiting 15:43:41 (6100): No heartbeat from core client for 30 sec - exiting 15:43:42 (6100): No heartbeat from core client for 30 sec - exiting 15:43:43 (6100): No heartbeat from core client for 30 sec - exiting 15:43:44 (6100): No heartbeat from core client for 30 sec - exiting 15:43:45 (6100): No heartbeat from core client for 30 sec - exiting 15:43:46 (6100): No heartbeat from core client for 30 sec - exiting 15:43:48 (6100): No heartbeat from core client for 30 sec - exiting 15:43:49 (6100): No heartbeat from core client for 30 sec - exiting 15:43:50 (6100): No heartbeat from core client for 30 sec - exiting 15:43:51 (6100): No heartbeat from core client for 30 sec - exiting 15:43:52 (6100): No heartbeat from core client for 30 sec - exiting 15:43:53 (6100): No heartbeat from core client for 30 sec - exiting 15:43:54 (6100): No heartbeat from core client for 30 sec - exiting 15:43:55 (6100): No heartbeat from core client for 30 sec - exiting 15:43:56 (6100): No heartbeat from core client for 30 sec - exiting 15:43:58 (6100): No heartbeat from core client for 30 sec - exiting 15:43:59 (6100): No heartbeat from core client for 30 sec - exiting 15:44:00 (6100): No heartbeat from core client for 30 sec - exiting 15:44:01 (6100): No heartbeat from core client for 30 sec - exiting 15:44:02 (6100): No heartbeat from core client for 30 sec - exiting 15:44:03 (6100): No heartbeat from core client for 30 sec - exiting 15:44:05 (6100): No heartbeat from core client for 30 sec - exiting 15:44:06 (6100): No heartbeat from core client for 30 sec - exiting 15:44:07 (6100): No heartbeat from core client for 30 sec - exiting 15:44:08 (6100): No heartbeat from core client for 30 sec - exiting 15:44:09 (6100): No heartbeat from core client for 30 sec - exiting 15:44:10 (6100): No heartbeat from core client for 30 sec - exiting 15:44:11 (6100): No heartbeat from core client for 30 sec - exiting 15:44:13 (6100): No heartbeat from core client for 30 sec - exiting 15:44:14 (6100): No heartbeat from core client for 30 sec - exiting 15:44:15 (6100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Restart file copy failed on xmu0ma.dai4480 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1444, selfPID=164, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 23:35:26 (164): called boinc_finish </stderr_txt> <message><file_xfer_error> <file_name>hadam3p_eu_xmu0_1983_1_007010800_2_5.zip</file_name> <error_code>-161</error_code> <error_message></error_message> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_xmu0_1983_1_007010800_2_6.zip</file_name> <error_code>-161</error_code> <error_message></error_message> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_xmu0_1983_1_007010800_2_7.zip</file_name> <error_code>-161</error_code> <error_message></error_message> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_xmu0_1983_1_007010800_2_8.zip</file_name> <error_code>-161</error_code> <error_message></error_message> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_xmu0_1983_1_007010800_2_9.zip</file_name> <error_code>-161</error_code> <error_message></error_message> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_xmu0_1983_1_007010800_2_10.zip</file_name> <error_code>-161</error_code> <error_message></error_message> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_xmu0_1983_1_007010800_2_11.zip</file_name> <error_code>-161</error_code> <error_message></error_message> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_xmu0_1983_1_007010800_2_12.zip</file_name> <error_code>-161</error_code> <error_message></error_message> </file_xfer_error> </message>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Apr 2011 15:22:57	408667	12480819	hadam3p_eu_xmu0_1983_1_007010800_2	46,126	304,791	6.6078
21 Apr 2011 14:47:29	408667	12480819	hadam3p_eu_xmu0_1983_1_007010800_2	46,107	303,440	6.5812
21 Apr 2011 14:01:54	408667	12480819	hadam3p_eu_xmu0_1983_1_007010800_2	46,080	302,166	6.5574
14 Mar 2011 09:14:08	408667	12480819	hadam3p_eu_xmu0_1983_1_007010800_2	34,560	226,557	6.5555
09 Feb 2011 19:10:04	408667	12480819	hadam3p_eu_xmu0_1983_1_007010800_2	23,041	151,213	6.5628
09 Feb 2011 12:53:31	408667	12480819	hadam3p_eu_xmu0_1983_1_007010800_2	23,040	150,159	6.5173
27 Jan 2011 13:49:04	408667	12480819	hadam3p_eu_xmu0_1983_1_007010800_2	11,536	76,307	6.6147
27 Jan 2011 13:32:10	408667	12480819	hadam3p_eu_xmu0_1983_1_007010800_2	11,521	75,145	6.5224
27 Jan 2011 12:50:25	408667	12480819	hadam3p_eu_xmu0_1983_1_007010800_2	11,520	74,059	6.4287