Task 12226718

Name	hadam3p_saf_1e69_1992_1_006946201_0
Workunit	7149517
Created	22 Nov 2010, 16:15:32 UTC
Sent	9 Mar 2011, 11:06:01 UTC
Report deadline	19 Feb 2012, 16:26:01 UTC
Received	18 Mar 2011, 22:56:04 UTC
Server state	Over
Outcome	No reply
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1093470
Run time	5 days 17 hours 14 min 2 sec
CPU time	4 days 0 hours 11 min 14 sec
Validate state	Invalid
Credit	1,683.45
Device peak FLOPS	2.15 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... 16:54:51 (4688): No heartbeat from core client for 30 sec - exiting 16:54:52 (4688): No heartbeat from core client for 30 sec - exiting 16:54:53 (4688): No heartbeat from core client for 30 sec - exiting 16:54:54 (4688): No heartbeat from core client for 30 sec - exiting 16:54:55 (4688): No heartbeat from core client for 30 sec - exiting 16:54:56 (4688): No heartbeat from core client for 30 sec - exiting 16:54:57 (4688): No heartbeat from core client for 30 sec - exiting 16:54:58 (4688): No heartbeat from core client for 30 sec - exiting 16:54:59 (4688): No heartbeat from core client for 30 sec - exiting 16:55:00 (4688): No heartbeat from core client for 30 sec - exiting 16:55:01 (4688): No heartbeat from core client for 30 sec - exiting 16:55:02 (4688): No heartbeat from core client for 30 sec - exiting 16:55:03 (4688): No heartbeat from core client for 30 sec - exiting 16:55:04 (4688): No heartbeat from core client for 30 sec - exiting 16:55:05 (4688): No heartbeat from core client for 30 sec - exiting 16:55:06 (4688): No heartbeat from core client for 30 sec - exiting 16:55:07 (4688): No heartbeat from core client for 30 sec - exiting 16:55:08 (4688): No heartbeat from core client for 30 sec - exiting 16:55:09 (4688): No heartbeat from core client for 30 sec - exiting 16:55:10 (4688): No heartbeat from core client for 30 sec - exiting 16:55:11 (4688): No heartbeat from core client for 30 sec - exiting 16:55:12 (4688): No heartbeat from core client for 30 sec - exiting 16:55:13 (4688): No heartbeat from core client for 30 sec - exiting 16:55:14 (4688): No heartbeat from core client for 30 sec - exiting 16:55:15 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9032, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5944, selfPID=5944, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:17:53 (3952): No heartbeat from core client for 30 sec - exiting 21:17:54 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... RegionalCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1072, selfPID=1072, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1164, selfPID=1164, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7876, selfPID=7876, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3124, selfPID=3124, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3772, selfPID=3772, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6976, selfPID=6976, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6648, selfPID=6648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4920, selfPID=4920, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5876, selfPID=5876, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1808, selfPID=1808, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4156, selfPID=4156, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3548, selfPID=3548, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1144, selfPID=1144, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2384, selfPID=2384, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4512, selfPID=4512, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5164, selfPID=5164, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4676, selfPID=4676, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4200, selfPID=4200, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7016, selfPID=7016, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6580, selfPID=0, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6580, selfPID=6580, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=1468, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5160, selfPID=4168, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 18:06:31 (4168): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_saf_1e69_1992_1_006946201_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1e69_1992_1_006946201_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1e69_1992_1_006946201_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Mar 2011 16:44:15	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	103,776	321,278	3.0959
16 Mar 2011 22:15:55	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	92,293	286,916	3.1088
16 Mar 2011 21:24:40	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	92,265	286,272	3.1027
16 Mar 2011 20:26:13	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	92,256	285,715	3.0970
16 Mar 2011 07:31:07	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	80,736	251,590	3.1162
15 Mar 2011 09:49:17	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	69,216	217,284	3.1392
14 Mar 2011 10:50:42	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	57,696	182,325	3.1601
13 Mar 2011 13:44:05	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	46,182	146,653	3.1755
13 Mar 2011 13:23:49	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	46,176	146,106	3.1641
12 Mar 2011 06:13:54	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	34,656	108,731	3.1374
11 Mar 2011 14:45:08	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	23,136	72,392	3.1290
10 Mar 2011 22:10:12	1093470	12226718	hadam3p_saf_1e69_1992_1_006946201_0	11,616	35,830	3.0845