Task 12302066

Name	hadam3p_saf_1vm5_1988_1_007016805_0
Workunit	7220121
Created	24 Nov 2010, 15:25:43 UTC
Sent	22 Jan 2011, 3:59:24 UTC
Report deadline	4 Jan 2012, 9:19:24 UTC
Received	16 Feb 2011, 10:15:25 UTC
Server state	Over
Outcome	No reply
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1078734
Run time	4 days 13 hours 22 min 48 sec
CPU time	3 days 3 hours 29 min 29 sec
Validate state	Invalid
Credit	1,683.45
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>6.10.43</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5652, selfPID=4304, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4836, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4936, selfPID=4452, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4240, selfPID=3632, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2800, selfPID=2448, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5168, selfPID=2816, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5188, selfPID=3068, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 17:26:33 (2696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:27:38 (4768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3784, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3024, selfPID=3632, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5400, selfPID=1020, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3240, iMonCtr=2 Model crash detected, will try to restart... ColobaltWorkerr::: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2760, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5016, selfPID=2980, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3032, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3164, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3532, selfPID=3360, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3176, selfPID=2792, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1996, selfPID=1996, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2000, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5888, selfPID=4736, iMonCtr=1 Model crash detected, will try to restart... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5404, selfPID=3556, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5916, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 16:39:51 (5320): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_saf_1vm5_1988_1_007016805_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1vm5_1988_1_007016805_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1vm5_1988_1_007016805_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Feb 2011 08:05:28	1078734	12302066	hadam3p_saf_1vm5_1988_1_007016805_0	103,776	265,475	2.5582
10 Feb 2011 07:55:09	1078734	12302066	hadam3p_saf_1vm5_1988_1_007016805_0	92,256	236,614	2.5648
09 Feb 2011 21:37:57	1078734	12302066	hadam3p_saf_1vm5_1988_1_007016805_0	80,736	208,760	2.5857
08 Feb 2011 08:04:10	1078734	12302066	hadam3p_saf_1vm5_1988_1_007016805_0	69,216	180,618	2.6095
06 Feb 2011 05:46:32	1078734	12302066	hadam3p_saf_1vm5_1988_1_007016805_0	57,696	152,137	2.6369
05 Feb 2011 00:43:27	1078734	12302066	hadam3p_saf_1vm5_1988_1_007016805_0	46,176	122,720	2.6577
04 Feb 2011 07:23:00	1078734	12302066	hadam3p_saf_1vm5_1988_1_007016805_0	34,656	91,968	2.6537
28 Jan 2011 12:35:31	1078734	12302066	hadam3p_saf_1vm5_1988_1_007016805_0	23,136	61,626	2.6636
25 Jan 2011 20:57:00	1078734	12302066	hadam3p_saf_1vm5_1988_1_007016805_0	11,616	31,396	2.7028