Task 12670208

Name	hadam3p_saf_1yhg_1963_1_007020524_2
Workunit	7223840
Created	16 Mar 2011, 8:36:21 UTC
Sent	16 Mar 2011, 10:44:15 UTC
Report deadline	26 Feb 2012, 16:04:15 UTC
Received	1 Apr 2011, 19:20:01 UTC
Server state	Over
Outcome	No reply
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1126793
Run time	14 days 11 hours 50 min 57 sec
CPU time	9 days 1 hours 20 min 42 sec
Validate state	Invalid
Credit	1,683.45
Device peak FLOPS	1.43 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> 11:47:44 (18548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:47:45 (18548): No heartbeat from core client for 30 sec - exiting 11:47:46 (18548): No heartbeat from core client for 30 sec - exiting 11:47:47 (18548): No heartbeat from core client for 30 sec - exiting 11:47:48 (18548): No heartbeat from core client for 30 sec - exiting 11:47:50 (18548): No heartbeat from core client for 30 sec - exiting 11:47:51 (18548): No heartbeat from core client for 30 sec - exiting 11:47:52 (18548): No heartbeat from core client for 30 sec - exiting 11:47:53 (18548): No heartbeat from core client for 30 sec - exiting 11:47:54 (18548): No heartbeat from core client for 30 sec - exiting 11:47:55 (18548): No heartbeat from core client for 30 sec - exiting 11:47:56 (18548): No heartbeat from core client for 30 sec - exiting 11:47:57 (18548): No heartbeat from core client for 30 sec - exiting 11:49:40 (18932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:42 (18932): No heartbeat from core client for 30 sec - exiting 11:49:43 (18932): No heartbeat from core client for 30 sec - exiting 11:49:44 (18932): No heartbeat from core client for 30 sec - exiting 11:49:45 (18932): No heartbeat from core client for 30 sec - exiting 11:49:46 (18932): No heartbeat from core client for 30 sec - exiting 11:55:29 (14720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20040, selfPID=20040, iMonCtr=2 11:58:31 (20020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18204, selfPID=18204, iMonCtr=2 12:21:15 (20436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:16 (20436): No heartbeat from core client for 30 sec - exiting 12:21:17 (20436): No heartbeat from core client for 30 sec - exiting 12:21:18 (20436): No heartbeat from core client for 30 sec - exiting 12:21:20 (20436): No heartbeat from core client for 30 sec - exiting 12:21:21 (20436): No heartbeat from core client for 30 sec - exiting 12:21:22 (20436): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19524, selfPID=19524, iMonCtr=2 12:21:23 (20436): No heartbeat from core client for 30 sec - exiting 12:21:24 (20436): No heartbeat from core client for 30 sec - exiting 12:21:25 (20436): No heartbeat from core client for 30 sec - exiting 12:21:26 (20436): No heartbeat from core client for 30 sec - exiting 12:59:51 (3168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:59:52 (3168): No heartbeat from core client for 30 sec - exiting 12:59:53 (3168): No heartbeat from core client for 30 sec - exiting 12:59:54 (3168): No heartbeat from core client for 30 sec - exiting 12:59:56 (3168): No heartbeat from core client for 30 sec - exiting 13:47:29 (19512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:30 (19512): No heartbeat from core client for 30 sec - exiting 13:51:51 (19792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:51:52 (19792): No heartbeat from core client for 30 sec - exiting 13:51:53 (19792): No heartbeat from core client for 30 sec - exiting 13:51:54 (19792): No heartbeat from core client for 30 sec - exiting 13:51:55 (19792): No heartbeat from core client for 30 sec - exiting 13:51:57 (19792): No heartbeat from core client for 30 sec - exiting 13:51:58 (19792): No heartbeat from core client for 30 sec - exiting 13:51:59 (19792): No heartbeat from core client for 30 sec - exiting 13:52:00 (19792): No heartbeat from core client for 30 sec - exiting 13:52:01 (19792): No heartbeat from core client for 30 sec - exiting 13:52:02 (19792): No heartbeat from core client for 30 sec - exiting 13:52:03 (19792): No heartbeat from core client for 30 sec - exiting 13:52:04 (19792): No heartbeat from core client for 30 sec - exiting 13:52:05 (19792): No heartbeat from core client for 30 sec - exiting 13:52:06 (19792): No heartbeat from core client for 30 sec - exiting 13:52:07 (19792): No heartbeat from core client for 30 sec - exiting 13:52:09 (19792): No heartbeat from core client for 30 sec - exiting 13:52:10 (19792): No heartbeat from core client for 30 sec - exiting 13:52:11 (19792): No heartbeat from core client for 30 sec - exiting 13:52:12 (19792): No heartbeat from core client for 30 sec - exiting 13:52:13 (19792): No heartbeat from core client for 30 sec - exiting 13:52:14 (19792): No heartbeat from core client for 30 sec - exiting 13:56:36 (18964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:56:37 (18964): No heartbeat from core client for 30 sec - exiting 13:56:38 (18964): No heartbeat from core client for 30 sec - exiting 07:24:09 (18660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:08 (16984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:54:29 (19520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:39:02 (18964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:28:51 (18520): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:22:47 (20328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:38:53 (19492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:04:51 (20216): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:10:48 (19544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:00 (18948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:22:57 (20016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:31:29 (18204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:30 (18204): No heartbeat from core client for 30 sec - exiting 21:31:31 (18204): No heartbeat from core client for 30 sec - exiting 21:31:32 (18204): No heartbeat from core client for 30 sec - exiting 21:31:33 (18204): No heartbeat from core client for 30 sec - exiting 21:31:34 (18204): No heartbeat from core client for 30 sec - exiting 21:31:35 (18204): No heartbeat from core client for 30 sec - exiting 15:26:04 (16540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:03:10 (20344): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:03:11 (20344): No heartbeat from core client for 30 sec - exiting 14:03:12 (20344): No heartbeat from core client for 30 sec - exiting 14:03:13 (20344): No heartbeat from core client for 30 sec - exiting 14:03:14 (20344): No heartbeat from core client for 30 sec - exiting 14:03:16 (20344): No heartbeat from core client for 30 sec - exiting 14:03:17 (20344): No heartbeat from core client for 30 sec - exiting 16:49:15 (19748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:49:17 (19748): No heartbeat from core client for 30 sec - exiting 16:49:18 (19748): No heartbeat from core client for 30 sec - exiting 16:49:19 (19748): No heartbeat from core client for 30 sec - exiting 16:49:20 (19748): No heartbeat from core client for 30 sec - exiting 16:49:21 (19748): No heartbeat from core client for 30 sec - exiting 16:49:22 (19748): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=17068, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18908, selfPID=18908, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18908, selfPID=8428, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 16:52:12 (8428): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_saf_1yhg_1963_1_007020524_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1yhg_1963_1_007020524_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1yhg_1963_1_007020524_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Apr 2011 19:24:33	1126793	12670208	hadam3p_saf_1yhg_1963_1_007020524_2	103,776	733,222	7.0654
01 Apr 2011 10:51:12	1126793	12670208	hadam3p_saf_1yhg_1963_1_007020524_2	92,256	648,334	7.0276
01 Apr 2011 10:51:12	1126793	12670208	hadam3p_saf_1yhg_1963_1_007020524_2	80,736	565,345	7.0024
26 Mar 2011 00:18:35	1126793	12670208	hadam3p_saf_1yhg_1963_1_007020524_2	69,216	485,952	7.0208
24 Mar 2011 10:38:27	1126793	12670208	hadam3p_saf_1yhg_1963_1_007020524_2	57,696	404,459	7.0102
22 Mar 2011 10:52:22	1126793	12670208	hadam3p_saf_1yhg_1963_1_007020524_2	46,176	326,918	7.0798
20 Mar 2011 10:38:51	1126793	12670208	hadam3p_saf_1yhg_1963_1_007020524_2	34,656	238,339	6.8773
20 Mar 2011 10:38:51	1126793	12670208	hadam3p_saf_1yhg_1963_1_007020524_2	23,136	156,358	6.7582
17 Mar 2011 21:30:41	1126793	12670208	hadam3p_saf_1yhg_1963_1_007020524_2	11,616	76,942	6.6238