Task 13488306

Name	hadam3p_eu_6lz3_2007_1_007495748_0
Workunit	7693223
Created	14 Oct 2011, 19:24:02 UTC
Sent	19 Oct 2011, 1:01:58 UTC
Report deadline	30 Sep 2012, 6:21:58 UTC
Received	15 Nov 2011, 16:40:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1176124
Run time	10 days 16 hours 13 min 4 sec
CPU time	9 days 2 hours 0 min 37 sec
Validate state	Invalid
Credit	1,988.94
Device peak FLOPS	1.35 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6196, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7316, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5424, selfPID=7932, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6520, selfPID=6520, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7556, selfPID=7556, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5980, selfPID=5980, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2528, selfPID=5896, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5432, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6000, selfPID=4156, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5836, selfPID=4704, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5856, selfPID=5860, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6000, selfPID=4880, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5872, selfPID=5872, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8444, selfPID=8444, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Clonalo lWror kPer :r: eCsPiD N tprroncnes sx iis ,nbott aru=nn,icngc,P e=xi tilnPg,= 4bR,eitVnatl 2= o1,l cchsecdktPItDd=0w,l seyltf PIsDa=3.9.4 8, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5340, selfPID=6156, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4252, selfPID=4252, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3256, selfPID=2544, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4524, selfPID=5020, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1248, selfPID=5212, iMonCtr=1 Model crash detected, will try to restart... 11:33:55 (4996): No heartbeat from core client for 30 sec - exiting 11:33:57 (4996): No heartbeat from core client for 30 sec - exiting 11:33:58 (4996): No heartbeat from core client for 30 sec - exiting 11:33:59 (4996): No heartbeat from core client for 30 sec - exiting 11:34:00 (4996): No heartbeat from core client for 30 sec - exiting 11:34:01 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:50 (4948): No heartbeat from core client for 30 sec - exiting 18:23:51 (4948): No heartbeat from core client for 30 sec - exiting 18:23:52 (4948): No heartbeat from core client for 30 sec - exiting 18:23:53 (4948): No heartbeat from core client for 30 sec - exiting 18:23:54 (4948): No heartbeat from core client for 30 sec - exiting 18:23:55 (4948): No heartbeat from core client for 30 sec - exiting 18:23:56 (4948): No heartbeat from core client for 30 sec - exiting 18:23:58 (4948): No heartbeat from core client for 30 sec - exiting 18:23:59 (4948): No heartbeat from core client for 30 sec - exiting 18:24:00 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6928, selfPID=7052, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6628, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6816, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4272, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5676, selfPID=4580, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9080, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8900, selfPID=8636, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2432, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5892, selfPID=1844, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6088, selfPID=1320, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3392, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4600, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5760, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5768, selfPID=4544, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2592, selfPID=2592, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3500, selfPID=6576, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3432, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5312, iMonCtr=2 Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5112, selfPID=5956, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7968, selfPID=7968, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4676, selfPID=2008, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_6lz3_2007_1_007495748_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6lz3_2007_1_007495748_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Nov 2011 16:50:24	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	115,296	722,471	6.2662
08 Nov 2011 15:52:15	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	103,776	645,513	6.2203
06 Nov 2011 11:27:05	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	92,256	572,189	6.2022
03 Nov 2011 11:20:14	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	80,737	496,238	6.1464
03 Nov 2011 08:49:22	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	80,736	495,370	6.1357
31 Oct 2011 18:37:27	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	69,216	423,776	6.1225
31 Oct 2011 17:26:34	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	57,696	352,896	6.1165
31 Oct 2011 16:37:12	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	46,176	281,823	6.1032
31 Oct 2011 13:33:06	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	34,656	210,067	6.0615
31 Oct 2011 13:33:06	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	23,136	139,326	6.0220
31 Oct 2011 13:33:06	1176124	13488306	hadam3p_eu_6lz3_2007_1_007495748_0	11,616	67,099	5.7764