climateprediction.net home page
Task 21373286

Task 21373286

Name wah2_global_e0ed_208812_145_770_011664889_1
Workunit 11664889
Created 9 Nov 2018, 10:22:44 UTC
Sent 10 Nov 2018, 3:45:06 UTC
Report deadline 23 Oct 2019, 9:05:06 UTC
Received 17 Nov 2018, 2:17:55 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1457068
Run time 4 days 0 hours 46 min 33 sec
CPU time 3 days 21 hours 12 min 26 sec
Validate state Invalid
Credit 8,743.69
Device peak FLOPS 5.26 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 238.48 MB
Peak swap size 174.99 MB
Peak disk usage 253.33 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=2136, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6684, selfPID=6684, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6684, selfPID=7896, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
17:14:13 (7896): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_47.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_48.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_49.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_50.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_51.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_52.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_53.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_54.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_55.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_56.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_57.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_58.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_59.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_60.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_61.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_62.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_63.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_64.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_65.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_66.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_67.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_68.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_69.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_70.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_71.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_72.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_73.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_74.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_75.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_76.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_77.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_78.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_79.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_80.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_81.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_82.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_83.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_84.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_85.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_86.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_87.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_88.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_89.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_90.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_91.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_92.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_93.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_94.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_95.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_96.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_97.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_98.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_99.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_100.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_101.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_102.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_103.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_104.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_105.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_106.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_107.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_108.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_109.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_110.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_111.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_112.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_113.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_114.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_115.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_116.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_117.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_118.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_119.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_120.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_121.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_122.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_123.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_124.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_125.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_126.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_127.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_128.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_129.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_130.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_131.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_132.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_133.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_134.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_135.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_136.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_137.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_138.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_139.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_140.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_141.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_142.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_143.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_144.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_145.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0ed_208812_145_770_011664889_1_r1052423158_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Nov 2018 21:30:31 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 132,547 331,033 2.4975
14 Nov 2018 19:27:06 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 129,667 323,791 2.4971
14 Nov 2018 17:23:55 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 126,787 316,437 2.4958
14 Nov 2018 15:25:40 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 123,907 309,215 2.4955
14 Nov 2018 13:22:18 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 121,027 302,222 2.4971
14 Nov 2018 08:14:03 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 118,147 295,149 2.4982
14 Nov 2018 06:01:01 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 115,267 287,753 2.4964
14 Nov 2018 02:56:39 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 112,387 279,488 2.4868
14 Nov 2018 00:58:36 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 109,507 271,241 2.4769
13 Nov 2018 22:30:44 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 106,627 263,005 2.4666
13 Nov 2018 20:06:30 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 103,747 254,834 2.4563
13 Nov 2018 18:03:31 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 100,867 247,835 2.4570
13 Nov 2018 17:04:33 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 97,987 241,358 2.4632
13 Nov 2018 13:54:51 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 95,107 233,218 2.4522
13 Nov 2018 11:31:12 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 92,227 224,969 2.4393
13 Nov 2018 09:32:49 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 89,347 217,313 2.4322
13 Nov 2018 07:29:55 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 86,467 210,841 2.4384
13 Nov 2018 05:27:03 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 83,587 204,382 2.4451
13 Nov 2018 03:17:47 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 80,707 197,947 2.4527
13 Nov 2018 03:17:47 1457068 21373286 wah2_global_e0ed_208812_145_770_011664889_1 77,827 191,523 2.4609


©2024 climateprediction.net