Task 13310823

Name	hadam3p_saf_2gup_1996_1_007429543_2
Workunit	7627046
Created	29 Aug 2011, 3:09:19 UTC
Sent	29 Aug 2011, 3:15:08 UTC
Report deadline	10 Aug 2012, 8:35:08 UTC
Received	7 Sep 2011, 8:14:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	865085
Run time	3 days 7 hours 11 min 7 sec
CPU time	2 days 23 hours 37 min 38 sec
Validate state	Invalid
Credit	1,309.70
Device peak FLOPS	1.88 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:17:31 (4796): No heartbeat from core client for 30 sec - exiting 10:17:32 (4796): No heartbeat from core client for 30 sec - exiting 10:17:33 (4796): No heartbeat from core client for 30 sec - exiting 10:17:34 (4796): No heartbeat from core client for 30 sec - exiting 10:17:35 (4796): No heartbeat from core client for 30 sec - exiting 10:17:36 (4796): No heartbeat from core client for 30 sec - exiting 10:17:37 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:34 (2824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:33:35 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:33:37 (4392): No heartbeat from core client for 30 sec - exiting 10:35:54 (4332): No heartbeat from core client for 30 sec - exiting 10:35:55 (4332): No heartbeat from core client for 30 sec - exiting 10:35:56 (4332): No heartbeat from core client for 30 sec - exiting 10:35:58 (4332): No heartbeat from core client for 30 sec - exiting 10:35:59 (4332): No heartbeat from core client for 30 sec - exiting 10:36:00 (4332): No heartbeat from core client for 30 sec - exiting 10:36:01 (4332): No heartbeat from core client for 30 sec - exiting 10:36:02 (4332): No heartbeat from core client for 30 sec - exiting 10:36:03 (4332): No heartbeat from core client for 30 sec - exiting 10:36:04 (4332): No heartbeat from core client for 30 sec - exiting 10:36:05 (4332): No heartbeat from core client for 30 sec - exiting 10:36:06 (4332): No heartbeat from core client for 30 sec - exiting 10:36:07 (4332): No heartbeat from core client for 30 sec - exiting 10:36:08 (4332): No heartbeat from core client for 30 sec - exiting 10:36:09 (4332): No heartbeat from core client for 30 sec - exiting 10:36:10 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:11 (4332): No heartbeat from core client for 30 sec - exiting 10:36:12 (4332): No heartbeat from core client for 30 sec - exiting 10:36:13 (4332): No heartbeat from core client for 30 sec - exiting 10:36:14 (4332): No heartbeat from core client for 30 sec - exiting 10:36:15 (4332): No heartbeat from core client for 30 sec - exiting 10:36:16 (4332): No heartbeat from core client for 30 sec - exiting 10:36:17 (4332): No heartbeat from core client for 30 sec - exiting 10:36:18 (4332): No heartbeat from core client for 30 sec - exiting 10:36:19 (4332): No heartbeat from core client for 30 sec - exiting 10:36:20 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 09:58:49 (6140): No heartbeat from core client for 30 sec - exiting 09:58:50 (6140): No heartbeat from core client for 30 sec - exiting 09:58:51 (6140): No heartbeat from core client for 30 sec - exiting 09:58:52 (6140): No heartbeat from core client for 30 sec - exiting 09:58:53 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:51 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:13 (5416): No heartbeat from core client for 30 sec - exiting 10:15:14 (5416): No heartbeat from core client for 30 sec - exiting 10:15:15 (5416): No heartbeat from core client for 30 sec - exiting 10:15:16 (5416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:37:50 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:52 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:03:14 (5312): No heartbeat from core client for 30 sec - exiting 09:03:15 (5312): No heartbeat from core client for 30 sec - exiting 09:03:16 (5312): No heartbeat from core client for 30 sec - exiting 09:05:18 (5312): No heartbeat from core client for 30 sec - exiting 09:05:19 (5312): No heartbeat from core client for 30 sec - exiting 09:05:20 (5312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:13 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:14 (3868): No heartbeat from core client for 30 sec - exiting 09:18:14 (520): No heartbeat from core client for 30 sec - exiting 09:18:15 (520): No heartbeat from core client for 30 sec - exiting 09:18:16 (520): No heartbeat from core client for 30 sec - exiting 09:18:18 (520): No heartbeat from core client for 30 sec - exiting 09:18:19 (520): No heartbeat from core client for 30 sec - exiting 09:18:22 (520): No heartbeat from core client for 30 sec - exiting 09:18:26 (520): No heartbeat from core client for 30 sec - exiting 09:18:28 (520): No heartbeat from core client for 30 sec - exiting 09:18:30 (520): No heartbeat from core client for 30 sec - exiting 09:18:34 (520): No heartbeat from core client for 30 sec - exiting 09:18:38 (520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:50 (5972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:02 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:03 (3728): No heartbeat from core client for 30 sec - exiting 09:27:24 (264): No heartbeat from core client for 30 sec - exiting 09:27:26 (264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:12 (5936): No heartbeat from core client for 30 sec - exiting 09:30:13 (5936): No heartbeat from core client for 30 sec - exiting 09:30:14 (5936): No heartbeat from core client for 30 sec - exiting 09:30:15 (5936): No heartbeat from core client for 30 sec - exiting 09:30:16 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:22 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:28 (2356): No heartbeat from core client for 30 sec - exiting 11:40:29 (2356): No heartbeat from core client for 30 sec - exiting 11:40:30 (2356): No heartbeat from core client for 30 sec - exiting 11:40:31 (2356): No heartbeat from core client for 30 sec - exiting 11:40:32 (2356): No heartbeat from core client for 30 sec - exiting 11:40:33 (2356): No heartbeat from core client for 30 sec - exiting 11:40:34 (2356): No heartbeat from core client for 30 sec - exiting 11:40:35 (2356): No heartbeat from core client for 30 sec - exiting 11:40:36 (2356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:42:35 (2224): No heartbeat from core client for 30 sec - exiting 11:42:36 (2224): No heartbeat from core client for 30 sec - exiting 11:42:37 (2224): No heartbeat from core client for 30 sec - exiting 11:42:38 (2224): No heartbeat from core client for 30 sec - exiting 11:42:39 (2224): No heartbeat from core client for 30 sec - exiting 11:42:40 (2224): No heartbeat from core client for 30 sec - exiting 11:42:41 (2224): No heartbeat from core client for 30 sec - exiting 11:42:42 (2224): No heartbeat from core client for 30 sec - exiting 11:42:43 (2224): No heartbeat from core client for 30 sec - exiting 11:42:44 (2224): No heartbeat from core client for 30 sec - exiting 11:42:45 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:42:46 (2224): No heartbeat from core client for 30 sec - exiting 11:42:47 (2224): No heartbeat from core client for 30 sec - exiting 11:42:48 (2224): No heartbeat from core client for 30 sec - exiting 11:42:49 (2224): No heartbeat from core client for 30 sec - exiting 11:42:50 (2224): No heartbeat from core client for 30 sec - exiting 11:42:51 (2224): No heartbeat from core client for 30 sec - exiting 11:42:52 (2224): No heartbeat from core client for 30 sec - exiting 11:42:53 (2224): No heartbeat from core client for 30 sec - exiting 11:42:54 (2224): No heartbeat from core client for 30 sec - exiting 11:42:55 (2224): No heartbeat from core client for 30 sec - exiting 11:42:56 (2224): No heartbeat from core client for 30 sec - exiting 11:42:57 (2224): No heartbeat from core client for 30 sec - exiting 11:42:58 (2224): No heartbeat from core client for 30 sec - exiting 11:42:59 (2224): No heartbeat from core client for 30 sec - exiting 11:43:00 (2224): No heartbeat from core client for 30 sec - exiting 11:43:01 (2224): No heartbeat from core client for 30 sec - exiting 11:43:02 (2224): No heartbeat from core client for 30 sec - exiting 11:43:03 (2224): No heartbeat from core client for 30 sec - exiting 11:43:04 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5700, selfPID=5700, iMonCtr=2 08:29:15 (2960): No heartbeat from core client for 30 sec - exiting 08:29:16 (2960): No heartbeat from core client for 30 sec - exiting 08:29:17 (2960): No heartbeat from core client for 30 sec - exiting 08:29:18 (2960): No heartbeat from core client for 30 sec - exiting 08:29:19 (2960): No heartbeat from core client for 30 sec - exiting 08:29:21 (2960): No heartbeat from core client for 30 sec - exiting 08:29:22 (2960): No heartbeat from core client for 30 sec - exiting 08:29:23 (2960): No heartbeat from core client for 30 sec - exiting 08:29:24 (2960): No heartbeat from core client for 30 sec - exiting 08:29:25 (2960): No heartbeat from core client for 30 sec - exiting 08:29:26 (2960): No heartbeat from core client for 30 sec - exiting 08:29:27 (2960): No heartbeat from core client for 30 sec - exiting 08:29:28 (2960): No heartbeat from core client for 30 sec - exiting 08:29:29 (2960): No heartbeat from core client for 30 sec - exiting 08:29:30 (2960): No heartbeat from core client for 30 sec - exiting 08:29:32 (2960): No heartbeat from core client for 30 sec - exiting 08:29:33 (2960): No heartbeat from core client for 30 sec - exiting 08:29:34 (2960): No heartbeat from core client for 30 sec - exiting 08:29:35 (2960): No heartbeat from core client for 30 sec - exiting 08:31:47 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:41:32 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:41:34 (5708): No heartbeat from core client for 30 sec - exiting 08:45:00 (4392): No heartbeat from core client for 30 sec - exiting 08:45:01 (4392): No heartbeat from core client for 30 sec - exiting 08:45:02 (4392): No heartbeat from core client for 30 sec - exiting 08:45:04 (4392): No heartbeat from core client for 30 sec - exiting 08:45:05 (4392): No heartbeat from core client for 30 sec - exiting 08:45:08 (4392): No heartbeat from core client for 30 sec - exiting 08:45:09 (4392): No heartbeat from core client for 30 sec - exiting 08:45:11 (4392): No heartbeat from core client for 30 sec - exiting 08:45:12 (4392): No heartbeat from core client for 30 sec - exiting 08:45:13 (4392): No heartbeat from core client for 30 sec - exiting 08:45:15 (4392): No heartbeat from core client for 30 sec - exiting 08:45:16 (4392): No heartbeat from core client for 30 sec - exiting 08:45:17 (4392): No heartbeat from core client for 30 sec - exiting 08:45:18 (4392): No heartbeat from core client for 30 sec - exiting 08:45:20 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:45:22 (4392): No heartbeat from core client for 30 sec - exiting 08:48:39 (5396): No heartbeat from core client for 30 sec - exiting 08:48:41 (5396): No heartbeat from core client for 30 sec - exiting 08:48:44 (5396): No heartbeat from core client for 30 sec - exiting 08:48:46 (5396): No heartbeat from core client for 30 sec - exiting 08:48:48 (5396): No heartbeat from core client for 30 sec - exiting 08:48:49 (5396): No heartbeat from core client for 30 sec - exiting 08:48:51 (5396): No heartbeat from core client for 30 sec - exiting 08:48:53 (5396): No heartbeat from core client for 30 sec - exiting 08:48:57 (5396): No heartbeat from core client for 30 sec - exiting 08:49:00 (5396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:38 (3552): No heartbeat from core client for 30 sec - exiting 08:53:40 (3552): No heartbeat from core client for 30 sec - exiting 08:53:41 (3552): No heartbeat from core client for 30 sec - exiting 08:53:42 (3552): No heartbeat from core client for 30 sec - exiting 08:53:43 (3552): No heartbeat from core client for 30 sec - exiting 08:53:44 (3552): No heartbeat from core client for 30 sec - exiting 08:53:45 (3552): No heartbeat from core client for 30 sec - exiting 08:53:46 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:00:55 (5872): No heartbeat from core client for 30 sec - exiting 09:00:57 (5872): No heartbeat from core client for 30 sec - exiting 09:00:58 (5872): No heartbeat from core client for 30 sec - exiting 09:00:59 (5872): No heartbeat from core client for 30 sec - exiting 09:01:00 (5872): No heartbeat from core client for 30 sec - exiting 09:01:01 (5872): No heartbeat from core client for 30 sec - exiting 09:01:02 (5872): No heartbeat from core client for 30 sec - exiting 09:01:03 (5872): No heartbeat from core client for 30 sec - exiting 09:01:04 (5872): No heartbeat from core client for 30 sec - exiting 09:01:06 (5872): No heartbeat from core client for 30 sec - exiting 09:01:07 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:43 (264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:45 (264): No heartbeat from core client for 30 sec - exiting 09:15:26 (2968): No heartbeat from core client for 30 sec - exiting 09:15:27 (2968): No heartbeat from core client for 30 sec - exiting 09:15:28 (2968): No heartbeat from core client for 30 sec - exiting 09:15:29 (2968): No heartbeat from core client for 30 sec - exiting 09:15:30 (2968): No heartbeat from core client for 30 sec - exiting 09:15:31 (2968): No heartbeat from core client for 30 sec - exiting 09:15:32 (2968): No heartbeat from core client for 30 sec - exiting 09:15:33 (2968): No heartbeat from core client for 30 sec - exiting 09:15:35 (2968): No heartbeat from core client for 30 sec - exiting 09:15:36 (2968): No heartbeat from core client for 30 sec - exiting 09:15:37 (2968): No heartbeat from core client for 30 sec - exiting 09:15:38 (2968): No heartbeat from core client for 30 sec - exiting 09:15:39 (2968): No heartbeat from core client for 30 sec - exiting 09:15:40 (2968): No heartbeat from core client for 30 sec - exiting 09:15:41 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:12 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:22:37 (1908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5364, selfPID=5364, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3300, selfPID=5388, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:13:10 (5388): No heartbeat from core client for 30 sec - exiting 08:13:11 (5388): No heartbeat from core client for 30 sec - exiting 08:13:12 (5388): No heartbeat from core client for 30 sec - exiting 08:13:13 (5388): No heartbeat from core client for 30 sec - exiting 08:13:14 (5388): No heartbeat from core client for 30 sec - exiting 08:13:15 (5388): No heartbeat from core client for 30 sec - exiting 08:13:16 (5388): No heartbeat from core client for 30 sec - exiting 08:13:17 (5388): No heartbeat from core client for 30 sec - exiting 08:13:18 (5388): No heartbeat from core client for 30 sec - exiting 08:13:19 (5388): No heartbeat from core client for 30 sec - exiting 08:13:20 (5388): No heartbeat from core client for 30 sec - exiting 08:13:22 (5388): No heartbeat from core client for 30 sec - exiting 08:13:23 (5388): No heartbeat from core client for 30 sec - exiting 08:13:24 (5388): No heartbeat from core client for 30 sec - exiting Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_saf_2gup_1996_1_007429543_2_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2gup_1996_1_007429543_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2gup_1996_1_007429543_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2gup_1996_1_007429543_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2gup_1996_1_007429543_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Sep 2011 08:15:34	865085	13310823	hadam3p_saf_2gup_1996_1_007429543_2	80,736	243,532	3.0164
07 Sep 2011 08:15:34	865085	13310823	hadam3p_saf_2gup_1996_1_007429543_2	69,216	209,302	3.0239
07 Sep 2011 08:15:34	865085	13310823	hadam3p_saf_2gup_1996_1_007429543_2	57,696	174,773	3.0292
07 Sep 2011 08:15:34	865085	13310823	hadam3p_saf_2gup_1996_1_007429543_2	46,176	139,339	3.0176
07 Sep 2011 08:15:34	865085	13310823	hadam3p_saf_2gup_1996_1_007429543_2	34,656	104,398	3.0124
29 Aug 2011 23:35:11	865085	13310823	hadam3p_saf_2gup_1996_1_007429543_2	23,136	69,914	3.0219
29 Aug 2011 14:42:18	865085	13310823	hadam3p_saf_2gup_1996_1_007429543_2	11,616	35,499	3.0560