Task 14748976

Name	hadam3p_pnw_avo8_1991_1_007880123_2
Workunit	8035235
Created	28 May 2012, 6:39:38 UTC
Sent	28 May 2012, 6:54:33 UTC
Report deadline	10 May 2013, 12:14:33 UTC
Received	16 Aug 2012, 5:03:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1096292
Run time	3 days 17 hours 56 min 27 sec
CPU time	3 days 6 hours 54 min 33 sec
Validate state	Invalid
Credit	1,003.35
Device peak FLOPS	1.86 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2196, selfPID=2196, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2820, selfPID=2820, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3092, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:50:56 (3152): No heartbeat from core client for 30 sec - exiting 19:50:57 (3152): No heartbeat from core client for 30 sec - exiting 19:50:58 (3152): No heartbeat from core client for 30 sec - exiting 19:50:59 (3152): No heartbeat from core client for 30 sec - exiting 19:51:00 (3152): No heartbeat from core client for 30 sec - exiting 19:51:02 (3152): No heartbeat from core client for 30 sec - exiting 19:51:03 (3152): No heartbeat from core client for 30 sec - exiting 19:51:04 (3152): No heartbeat from core client for 30 sec - exiting 19:51:05 (3152): No heartbeat from core client for 30 sec - exiting 19:51:06 (3152): No heartbeat from core client for 30 sec - exiting 19:51:07 (3152): No heartbeat from core client for 30 sec - exiting 19:51:08 (3152): No heartbeat from core client for 30 sec - exiting 19:51:09 (3152): No heartbeat from core client for 30 sec - exiting 19:51:10 (3152): No heartbeat from core client for 30 sec - exiting 19:51:11 (3152): No heartbeat from core client for 30 sec - exiting 19:51:12 (3152): No heartbeat from core client for 30 sec - exiting 19:51:14 (3152): No heartbeat from core client for 30 sec - exiting 19:51:15 (3152): No heartbeat from core client for 30 sec - exiting 19:51:16 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:04:17 (2988): No heartbeat from core client for 30 sec - exiting 21:04:18 (2988): No heartbeat from core client for 30 sec - exiting 21:04:19 (2988): No heartbeat from core client for 30 sec - exiting 21:04:20 (2988): No heartbeat from core client for 30 sec - exiting 21:04:21 (2988): No heartbeat from core client for 30 sec - exiting 21:04:22 (2988): No heartbeat from core client for 30 sec - exiting 21:04:23 (2988): No heartbeat from core client for 30 sec - exiting 21:04:24 (2988): No heartbeat from core client for 30 sec - exiting 21:04:25 (2988): No heartbeat from core client for 30 sec - exiting 21:04:26 (2988): No heartbeat from core client for 30 sec - exiting 21:04:27 (2988): No heartbeat from core client for 30 sec - exiting 21:04:29 (2988): No heartbeat from core client for 30 sec - exiting 21:04:30 (2988): No heartbeat from core client for 30 sec - exiting 21:04:31 (2988): No heartbeat from core client for 30 sec - exiting 21:04:32 (2988): No heartbeat from core client for 30 sec - exiting 21:04:33 (2988): No heartbeat from core client for 30 sec - exiting 21:04:34 (2988): No heartbeat from core client for 30 sec - exiting 21:04:35 (2988): No heartbeat from core client for 30 sec - exiting 21:04:36 (2988): No heartbeat from core client for 30 sec - exiting 21:04:37 (2988): No heartbeat from core client for 30 sec - exiting 21:04:38 (2988): No heartbeat from core client for 30 sec - exiting 21:04:39 (2988): No heartbeat from core client for 30 sec - exiting 21:04:41 (2988): No heartbeat from core client for 30 sec - exiting 21:04:42 (2988): No heartbeat from core client for 30 sec - exiting 21:04:43 (2988): No heartbeat from core client for 30 sec - exiting 21:04:44 (2988): No heartbeat from core client for 30 sec - exiting 21:04:45 (2988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3948, selfPID=3948, iMonCtr=2 08:37:07 (3056): No heartbeat from core client for 30 sec - exiting 08:37:08 (3056): No heartbeat from core client for 30 sec - exiting 08:37:09 (3056): No heartbeat from core client for 30 sec - exiting 08:37:10 (3056): No heartbeat from core client for 30 sec - exiting 08:37:11 (3056): No heartbeat from core client for 30 sec - exiting 08:37:12 (3056): No heartbeat from core client for 30 sec - exiting 08:37:13 (3056): No heartbeat from core client for 30 sec - exiting 08:37:14 (3056): No heartbeat from core client for 30 sec - exiting 08:37:16 (3056): No heartbeat from core client for 30 sec - exiting 08:37:17 (3056): No heartbeat from core client for 30 sec - exiting 08:37:18 (3056): No heartbeat from core client for 30 sec - exiting 08:37:19 (3056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:31 (1664): No heartbeat from core client for 30 sec - exiting 13:16:32 (1664): No heartbeat from core client for 30 sec - exiting 13:16:33 (1664): No heartbeat from core client for 30 sec - exiting 13:16:34 (1664): No heartbeat from core client for 30 sec - exiting 13:16:35 (1664): No heartbeat from core client for 30 sec - exiting 13:16:36 (1664): No heartbeat from core client for 30 sec - exiting 13:16:37 (1664): No heartbeat from core client for 30 sec - exiting 13:16:38 (1664): No heartbeat from core client for 30 sec - exiting 13:16:40 (1664): No heartbeat from core client for 30 sec - exiting 13:16:41 (1664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:45:13 (420): No heartbeat from core client for 30 sec - exiting 09:45:14 (420): No heartbeat from core client for 30 sec - exiting 09:45:15 (420): No heartbeat from core client for 30 sec - exiting 09:45:16 (420): No heartbeat from core client for 30 sec - exiting 09:45:17 (420): No heartbeat from core client for 30 sec - exiting 09:45:18 (420): No heartbeat from core client for 30 sec - exiting 09:45:19 (420): No heartbeat from core client for 30 sec - exiting 09:45:20 (420): No heartbeat from core client for 30 sec - exiting 09:45:22 (420): No heartbeat from core client for 30 sec - exiting 09:45:23 (420): No heartbeat from core client for 30 sec - exiting 09:45:24 (420): No heartbeat from core client for 30 sec - exiting 09:45:25 (420): No heartbeat from core client for 30 sec - exiting 09:45:26 (420): No heartbeat from core client for 30 sec - exiting 09:45:27 (420): No heartbeat from core client for 30 sec - exiting 09:45:28 (420): No heartbeat from core client for 30 sec - exiting 09:45:29 (420): No heartbeat from core client for 30 sec - exiting 09:45:30 (420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:01:42 (3092): No heartbeat from core client for 30 sec - exiting 13:01:43 (3092): No heartbeat from core client for 30 sec - exiting 13:01:44 (3092): No heartbeat from core client for 30 sec - exiting 13:01:46 (3092): No heartbeat from core client for 30 sec - exiting 13:01:47 (3092): No heartbeat from core client for 30 sec - exiting 13:01:48 (3092): No heartbeat from core client for 30 sec - exiting 13:01:49 (3092): No heartbeat from core client for 30 sec - exiting 13:01:50 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2188, selfPID=2188, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:01:19 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:41:30 (3108): No heartbeat from core client for 30 sec - exiting 11:41:31 (3108): No heartbeat from core client for 30 sec - exiting 11:41:32 (3108): No heartbeat from core client for 30 sec - exiting 11:41:33 (3108): No heartbeat from core client for 30 sec - exiting 11:41:34 (3108): No heartbeat from core client for 30 sec - exiting 11:41:35 (3108): No heartbeat from core client for 30 sec - exiting 11:41:36 (3108): No heartbeat from core client for 30 sec - exiting 11:41:37 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2924, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2932, selfPID=4016, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_avo8_1991_1_007880123_2_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_avo8_1991_1_007880123_2_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_avo8_1991_1_007880123_2_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_avo8_1991_1_007880123_2_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_avo8_1991_1_007880123_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_avo8_1991_1_007880123_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_avo8_1991_1_007880123_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_avo8_1991_1_007880123_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Aug 2012 05:53:21	1096292	14748976	hadam3p_pnw_avo8_1991_1_007880123_2	46,176	239,651	5.1899
28 Jul 2012 05:08:31	1096292	14748976	hadam3p_pnw_avo8_1991_1_007880123_2	34,656	179,301	5.1737
07 Jul 2012 06:09:44	1096292	14748976	hadam3p_pnw_avo8_1991_1_007880123_2	23,136	118,269	5.1119
23 Jun 2012 05:14:29	1096292	14748976	hadam3p_pnw_avo8_1991_1_007880123_2	11,620	59,160	5.0912
22 Jun 2012 06:48:43	1096292	14748976	hadam3p_pnw_avo8_1991_1_007880123_2	11,616	58,419	5.0292