Task 18210011

Name	hadam3p_pnw_wdun_2009_1_009697912_0
Workunit	9772246
Created	25 Mar 2015, 12:52:28 UTC
Sent	28 Mar 2015, 2:57:55 UTC
Report deadline	9 Mar 2016, 8:17:55 UTC
Received	7 May 2015, 11:42:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1211520
Run time	19 hours 2 min 2 sec
CPU time	14 hours 19 min 49 sec
Validate state	Invalid
Credit	507.13
Device peak FLOPS	2.70 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.22 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6476, selfPID=6476, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6452, selfPID=6452, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7344, selfPID=7344, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 19:35:39 (6000): BOINC client no longer exists - exiting 19:35:39 (6000): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:51 (6340): BOINC client no longer exists - exiting 19:35:51 (6340): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:04 (6312): BOINC client no longer exists - exiting 19:36:04 (6312): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:16 (4572): BOINC client no longer exists - exiting 19:36:16 (4572): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:28 (7104): BOINC client no longer exists - exiting 19:36:28 (7104): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1500, selfPID=1500, iMonCtr=2 19:36:41 (4000): BOINC client no longer exists - exiting 19:36:41 (4000): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5496, selfPID=5496, iMonCtr=2 19:36:53 (5388): BOINC client no longer exists - exiting 19:36:53 (5388): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3752, selfPID=3752, iMonCtr=2 19:37:05 (3116): BOINC client no longer exists - exiting 19:37:05 (3116): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:17 (6640): BOINC client no longer exists - exiting 19:37:17 (6640): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:29 (1592): BOINC client no longer exists - exiting 19:37:29 (1592): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:42 (5540): BOINC client no longer exists - exiting 19:37:42 (5540): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:54 (3648): BOINC client no longer exists - exiting 19:37:54 (3648): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not r19:38:06 (6692): BOINC client no longer exists - exiting 19:38:06 (6692): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN19:38:19 (6432): BOINC client no longer exists - exiting 19:38:19 (6432): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:31 (3992): BOINC client no longer exists - exiting 19:38:31 (3992): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:43 (2604): BOINC client no longer exists - exiting 19:38:43 (2604): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3504, selfPID=3504, iMonCtr=2 19:38:55 (5448): BOINC client no longer exists - exiting 19:38:55 (5448): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:08 (7088): BOINC client no longer exists - exiting 19:39:08 (7088): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:20 (7092): BOINC client no longer exists - exiting 19:39:20 (7092): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:32 (3088): BOINC client no longer exists - exiting 19:39:32 (3088): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:43 (6028): BOINC client no longer exists - exiting 19:39:43 (6028): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:55 (5744): BOINC client no longer exists - exiting 19:39:55 (5744): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:08 (4544): BOINC client no longer exists - exiting 19:40:08 (4544): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:20 (5996): BOINC client no longer exists - exiting 19:40:20 (5996): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:32 (6596): BOINC client no longer exists - exiting 19:40:32 (6596): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:44 (1500): BOINC client no longer exists - exiting 19:40:44 (1500): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:56 (4000): BOINC client no longer exists - exiting 19:40:56 (4000): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:08 (4020): BOINC client no longer exists - exiting 19:41:08 (4020): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:20 (5152): BOINC client no longer exists - exiting 19:41:20 (5152): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:33 (1144): BOINC client no longer exists - exiting 19:41:33 (1144): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:45 (2136): BOINC client no longer exists - exiting 19:41:45 (2136): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:58 (2944): BOINC client no longer exists - exiting 19:41:58 (2944): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7088, selfPID=7088, iMonCtr=2 19:42:13 (7084): BOINC client no longer exists - exiting 19:42:13 (7084): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:24 (7020): BOINC client no longer exists - exiting 19:42:24 (7020): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:36 (4784): BOINC client no longer exists - exiting 19:42:36 (4784): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:48 (2956): BOINC client no longer exists - exiting 19:42:48 (2956): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:00 (3504): BOINC client no longer exists - exiting 19:43:00 (3504): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:12 (5652): BOINC client no longer exists - exiting 19:43:12 (5652): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:25 (6292): BOINC client no longer exists - exiting 19:43:25 (6292): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:37 (1688): BOINC client no longer exists - exiting 19:43:37 (1688): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:49 (2900): BOINC client no longer exists - exiting 19:43:49 (2900): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:02 (5536): BOINC client no longer exists - exiting 19:44:02 (5536): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:14 (6172): BOINC client no longer exists - exiting 19:44:14 (6172): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3808, selfPID=3808, iMonCtr=2 19:44:26 (4932): BOINC client no longer exists - exiting 19:44:26 (4932): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5352, selfPID=5352, iMonCtr=2 19:44:38 (5848): BOINC client no longer exists - exiting 19:44:38 (5848): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:51 (2496): BOINC client no longer exists - exiting 19:44:51 (2496): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:03 (6052): BOINC client no longer exists - exiting 19:45:03 (6052): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:15 (5188): BOINC client no longer exists - exiting 19:45:15 (5188): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:26 (3808): BOINC client no longer exists - exiting 19:45:26 (3808): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:39 (6096): BOINC client no longer exists - exiting 19:45:39 (6096): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:51 (5676): BOINC client no longer exists - exiting 19:45:51 (5676): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:02 (1592): BOINC client no longer exists - exiting 19:46:02 (1592): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:14 (3924): BOINC client no longer exists - exiting 19:46:14 (3924): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:26 (5124): BOINC client no longer exists - exiting 19:46:26 (5124): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:39 (2308): BOINC client no longer exists - exiting 19:46:39 (2308): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:51 (1688): BOINC client no longer exists - exiting 19:46:51 (1688): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:03 (6772): BOINC client no longer exists - exiting 19:47:03 (6772): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:15 (2600): BOINC client no longer exists - exiting 19:47:15 (2600): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:28 (4924): BOINC client no longer exists - exiting 19:47:28 (4924): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:40 (5268): BOINC client no longer exists - exiting 19:47:40 (5268): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2900, selfPID=2900, iMonCtr=2 19:47:52 (3424): BOINC client no longer exists - exiting 19:47:52 (3424): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4544, selfPID=4544, iMonCtr=2 19:48:04 (3492): BOINC client no longer exists - exiting 19:48:04 (3492): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:16 (4500): BOINC client no longer exists - exiting 19:48:16 (4500): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:28 (6032): BOINC client no longer exists - exiting 19:48:28 (6032): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3752, selfPID=3752, iMonCtr=2 19:48:41 (3556): BOINC client no longer exists - exiting 19:48:41 (3556): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:53 (6532): BOINC client no longer exists - exiting 19:48:53 (6532): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:05 (3544): BOINC client no longer exists - exiting 19:49:05 (3544): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:17 (5388): BOINC client no longer exists - exiting 19:49:17 (5388): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5092, selfPID=5092, iMonCtr=2 19:49:30 (6220): BOINC client no longer exists - exiting 19:49:30 (6220): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:42 (4304): BOINC client no longer exists - exiting 19:49:42 (4304): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6332, selfPID=6332, iMonCtr=2 19:49:54 (1300): BOINC client no longer exists - exiting 19:49:54 (1300): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:06 (6628): BOINC client no longer exists - exiting 19:50:06 (6628): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6764, selfPID=6764, iMonCtr=2 19:50:18 (1200): BOINC client no longer exists - exiting 19:50:18 (1200): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:30 (6972): BOINC client no longer exists - exiting 19:50:30 (6972): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3088, selfPID=3088, iMonCtr=2 19:50:41 (5164): BOINC client no longer exists - exiting 19:50:41 (5164): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:53 (3040): BOINC client no longer exists - exiting 19:50:53 (3040): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6032, selfPID=6032, iMonCtr=2 19:51:04 (6756): BOINC client no longer exists - exiting 19:51:04 (6756): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5724, selfPID=5724, iMonCtr=2 19:51:16 (6780): BOINC client no longer exists - exiting 19:51:16 (6780): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:31 (6460): BOINC client no longer exists - exiting 19:51:31 (6460): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4188, selfPID=4188, iMonCtr=2 19:51:43 (6028): BOINC client no longer exists - exiting 19:51:43 (6028): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:54 (5852): BOINC client no longer exists - exiting 19:51:54 (5852): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6164, selfPID=6164, iMonCtr=2 19:52:09 (3604): BOINC client no longer exists - exiting 19:52:09 (3604): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1732, selfPID=1732, iMonCtr=2 19:52:24 (784): BOINC client no longer exists - exiting 19:52:24 (784): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:51 (5636): BOINC client no longer exists - exiting 19:52:51 (5636): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3012, selfPID=3012, iMonCtr=2 19:53:03 (3088): BOINC client no longer exists - exiting 19:53:03 (3088): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5680, selfPID=5680, iMonCtr=2 19:53:22 (5012): BOINC client no longer exists - exiting 19:53:22 (5012): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:36 (2216): BOINC client no longer exists - exiting 19:53:36 (2216): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:00 (5896): BOINC client no longer exists - exiting 19:54:00 (5896): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:25 (7084): BOINC client no longer exists - exiting 19:54:25 (7084): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:37 (6000): BOINC client no longer exists - exiting 19:54:37 (6000): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:52 (4488): BOINC client no longer exists - exiting 19:54:52 (4488): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:25 (6436): BOINC client no longer exists - exiting 19:55:25 (6436): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:52 (2800): BOINC client no longer exists - exiting 19:55:52 (2800): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=5384, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6340, selfPID=692, iMonCtr=1 Model crash detected, will try to restart... 19:56:05 (692): BOINC client no longer exists - exiting 19:56:05 (692): timer handler: client dead, exiting Leaving CPDN_Main::Monitor... 19:56:15 (692): called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_wdun_2009_1_009697912_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Apr 2015 07:28:10	1211520	18210011	hadam3p_pnw_wdun_2009_1_009697912_0	23,339	40,544	1.7372
02 Apr 2015 07:20:17	1211520	18210011	hadam3p_pnw_wdun_2009_1_009697912_0	11,819	20,570	1.7404