Task 12632312

Name	hadam3p_pnw_35jd_1979_1_007187329_1
Workunit	7385611
Created	24 Feb 2011, 7:44:56 UTC
Sent	24 Feb 2011, 8:35:39 UTC
Report deadline	6 Feb 2012, 13:55:39 UTC
Received	8 Mar 2011, 10:41:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1131927
Run time	2 days 7 hours 10 min 23 sec
CPU time	2 days 5 hours 40 min 29 sec
Validate state	Invalid
Credit	1,754.30
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10456, selfPID=9268, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10456, selfPID=10456, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14132, selfPID=8780, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14132, selfPID=14132, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10152, selfPID=9776, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10152, selfPID=10152, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8764, selfPID=12644, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8764, selfPID=8764, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10032, selfPID=8344, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10032, selfPID=10032, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4244, selfPID=13256, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4244, selfPID=4244, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9900, selfPID=12992, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9900, selfPID=9900, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2416, selfPID=5980, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2416, selfPID=2416, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8168, selfPID=5104, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8168, selfPID=8168, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7836, selfPID=7836, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7836, selfPID=2208, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10364, selfPID=10364, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10364, selfPID=10348, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7888, selfPID=8136, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7888, selfPID=7888, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7768, selfPID=5220, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7768, selfPID=7768, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10648, selfPID=9252, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10648, selfPID=10648, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9720, selfPID=9496, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9720, selfPID=9720, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8444, selfPID=8444, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8444, selfPID=5280, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9836, selfPID=9836, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9836, selfPID=5976, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12320, selfPID=12448, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12320, selfPID=12320, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12664, selfPID=15268, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12664, selfPID=12664, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13868, selfPID=13520, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13868, selfPID=13868, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9684, selfPID=10768, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9684, selfPID=9684, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8548, selfPID=15324, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8548, selfPID=8548, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14256, selfPID=6264, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14256, selfPID=14256, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12916, selfPID=12916, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12916, selfPID=5176, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6732, selfPID=9936, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6732, selfPID=6732, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1908, selfPID=12836, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1908, selfPID=1908, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8200, selfPID=11496, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8200, selfPID=8200, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10944, selfPID=10108, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10944, selfPID=10944, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11304, selfPID=11304, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11304, selfPID=10940, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4348, selfPID=13380, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4348, selfPID=4348, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10460, selfPID=1356, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10460, selfPID=10460, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12076, selfPID=1484, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12076, selfPID=12076, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9308, selfPID=9388, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9308, selfPID=9308, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13860, selfPID=11836, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13860, selfPID=13860, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14976, selfPID=12236, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14976, selfPID=14976, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5068, selfPID=13196, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5068, selfPID=5068, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11976, selfPID=11976, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11976, selfPID=14012, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10652, selfPID=13716, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10652, selfPID=10652, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10992, selfPID=11448, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10992, selfPID=10992, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10212, selfPID=10212, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10212, selfPID=8616, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5352, selfPID=12596, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5352, selfPID=5352, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11496, selfPID=1244, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11496, selfPID=11496, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11444, selfPID=8916, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11444, selfPID=11444, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12800, selfPID=11848, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12800, selfPID=12800, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11560, selfPID=11560, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11560, selfPID=14076, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9048, selfPID=9048, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9048, selfPID=4448, iMonCtr=1 15:32:55 (2208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:32:56 (2208): No heartbeat from core client for 30 sec - exiting 15:32:57 (2208): No heartbeat from core client for 30 sec - exiting 15:32:58 (2208): No heartbeat from core client for 30 sec - exiting 15:32:59 (2208): No heartbeat from core client for 30 sec - exiting 15:33:00 (2208): No heartbeat from core client for 30 sec - exiting 15:33:01 (2208): No heartbeat from core client for 30 sec - exiting 15:33:02 (2208): No heartbeat from core client for 30 sec - exiting 15:33:03 (2208): No heartbeat from core client for 30 sec - exiting 15:33:04 (2208): No heartbeat from core client for 30 sec - exiting 15:33:05 (2208): No heartbeat from core client for 30 sec - exiting 15:33:06 (2208): No heartbeat from core client for 30 sec - exiting 15:33:07 (2208): No heartbeat from core client for 30 sec - exiting 15:33:08 (2208): No heartbeat from core client for 30 sec - exiting 15:33:09 (2208): No heartbeat from core client for 30 sec - exiting 15:33:10 (2208): No heartbeat from core client for 30 sec - exiting 15:33:11 (2208): No heartbeat from core client for 30 sec - exiting 15:33:12 (2208): No heartbeat from core client for 30 sec - exiting 15:33:13 (2208): No heartbeat from core client for 30 sec - exiting 15:33:14 (2208): No heartbeat from core client for 30 sec - exiting 15:33:15 (2208): No heartbeat from core client for 30 sec - exiting No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13216, selfPID=13216, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13216, selfPID=5880, iMonCtr=1 15:47:15 (10424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:16 (10424): No heartbeat from core client for 30 sec - exiting 15:47:17 (10424): No heartbeat from core client for 30 sec - exiting 15:47:18 (10424): No heartbeat from core client for 30 sec - exiting 15:47:19 (10424): No heartbeat from core client for 30 sec - exiting 15:47:20 (10424): No heartbeat from core client for 30 sec - exiting 15:47:21 (10424): No heartbeat from core client for 30 sec - exiting 15:47:22 (10424): No heartbeat from core client for 30 sec - exiting 15:47:23 (10424): No heartbeat from core client for 30 sec - exiting 15:47:24 (10424): No heartbeat from core client for 30 sec - exiting 15:47:25 (10424): No heartbeat from core client for 30 sec - exiting 15:47:26 (10424): No heartbeat from core client for 30 sec - exiting 15:47:27 (10424): No heartbeat from core client for 30 sec - exiting 15:47:28 (10424): No heartbeat from core client for 30 sec - exiting 15:47:29 (10424): No heartbeat from core client for 30 sec - exiting 15:47:30 (10424): No heartbeat from core client for 30 sec - exiting 15:47:31 (10424): No heartbeat from core client for 30 sec - exiting 15:47:32 (10424): No heartbeat from core client for 30 sec - exiting 15:47:33 (10424): No heartbeat from core client for 30 sec - exiting 15:47:34 (10424): No heartbeat from core client for 30 sec - exiting 15:47:35 (10424): No heartbeat from core client for 30 sec - exiting No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10372, selfPID=10372, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10372, selfPID=14404, iMonCtr=1 16:05:27 (8456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:05:28 (8456): No heartbeat from core client for 30 sec - exiting 16:05:29 (8456): No heartbeat from core client for 30 sec - exiting 16:05:30 (8456): No heartbeat from core client for 30 sec - exiting 16:05:31 (8456): No heartbeat from core client for 30 sec - exiting 16:05:32 (8456): No heartbeat from core client for 30 sec - exiting 16:05:33 (8456): No heartbeat from core client for 30 sec - exiting 16:05:34 (8456): No heartbeat from core client for 30 sec - exiting 16:05:35 (8456): No heartbeat from core client for 30 sec - exiting 16:05:36 (8456): No heartbeat from core client for 30 sec - exiting 16:05:37 (8456): No heartbeat from core client for 30 sec - exiting 16:05:38 (8456): No heartbeat from core client for 30 sec - exiting 16:05:39 (8456): No heartbeat from core client for 30 sec - exiting 16:05:40 (8456): No heartbeat from core client for 30 sec - exiting 16:05:41 (8456): No heartbeat from core client for 30 sec - exiting 16:05:42 (8456): No heartbeat from core client for 30 sec - exiting 16:05:43 (8456): No heartbeat from core client for 30 sec - exiting 16:05:44 (8456): No heartbeat from core client for 30 sec - exiting 16:05:45 (8456): No heartbeat from core client for 30 sec - exiting 16:05:46 (8456): No heartbeat from core client for 30 sec - exiting 16:05:47 (8456): No heartbeat from core client for 30 sec - exiting No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5116, selfPID=12136, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5116, selfPID=5116, iMonCtr=1 Signal 11 received, exiting... 16:06:54 (13236): called boinc_finish Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11684, selfPID=10228, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 16:07:09 (10228): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_35jd_1979_1_007187329_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_35jd_1979_1_007187329_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_35jd_1979_1_007187329_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_35jd_1979_1_007187329_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_35jd_1979_1_007187329_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2011 10:47:17	1131927	12632312	hadam3p_pnw_35jd_1979_1_007187329_1	80,736	182,737	2.2634
08 Mar 2011 10:47:17	1131927	12632312	hadam3p_pnw_35jd_1979_1_007187329_1	69,216	159,051	2.2979
08 Mar 2011 10:47:17	1131927	12632312	hadam3p_pnw_35jd_1979_1_007187329_1	57,696	132,294	2.2929
08 Mar 2011 10:47:17	1131927	12632312	hadam3p_pnw_35jd_1979_1_007187329_1	46,176	105,019	2.2743
08 Mar 2011 10:47:17	1131927	12632312	hadam3p_pnw_35jd_1979_1_007187329_1	34,656	77,764	2.2439
08 Mar 2011 10:47:17	1131927	12632312	hadam3p_pnw_35jd_1979_1_007187329_1	23,136	50,490	2.1823
08 Mar 2011 10:47:17	1131927	12632312	hadam3p_pnw_35jd_1979_1_007187329_1	11,616	24,372	2.0981