climateprediction.net home page
Task 19997833

Task 19997833

Name wah2_pnw25_c0ia_200312_49_452_010736636_1
Workunit 10736636
Created 27 Sep 2016, 15:40:12 UTC
Sent 27 Sep 2016, 15:40:15 UTC
Report deadline 9 Sep 2017, 21:00:15 UTC
Received 7 Oct 2016, 6:24:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1310633
Run time 6 days 18 hours 19 min 5 sec
CPU time 6 days 16 hours 28 min 58 sec
Validate state Invalid
Credit 25,857.56
Device peak FLOPS 3.57 GFLOPS
Application version Weather At Home 2 (wah2) v8.19
windows_intelx86
Peak working set size 181.15 MB
Peak swap size 165.93 MB
Peak disk usage 0.04 MB
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<message>
finish file present too long
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk3dec
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4feb
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4mar
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4apr
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4may
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4jun
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4jul
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4aug
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4sep
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4oct
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4nov
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk4dec
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5feb
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5mar
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5apr
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5may
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5jun
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5jul
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5aug
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5sep
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5oct
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk5dec
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk6feb
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk6mar
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk6apr
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk6may
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk6jun
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk6jul
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk6aug
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:32:21 (27592): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c0ia_200312_49_452_010736636/dataout\c0iaga.pdk6sep
CPDN Monitor - Quit request from BOINC...
16:17:45 (20104): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:11:43 (28768): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24068, selfPID=29200, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
19:24:04 (29200): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x004981C4 write attempt to address 0x012BE12C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 10/06/16 23:30:23
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
Loaded Library    : symsrv.dll
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000153000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.19_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000773d0000 0000000000182000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.14393.206) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.14393.206 (rs1_release.160915-0644)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.206

ModLoad: 0000000076a50000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.14393.206 (rs1_release.160915-0644)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.206

ModLoad: 0000000074500000 00000000001a1000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.14393.206) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.14393.206 (rs1_release.160915-0644)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.206

ModLoad: 0000000076d40000 000000000015f000 C:\WINDOWS\System32\USER32.dll (6.2.14393.5) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 00000000771e0000 0000000000015000 C:\WINDOWS\System32\win32u.dll (6.2.14393.51) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.14393.51 (rs1_release_inmarket.160801-1836)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.51

ModLoad: 0000000076b80000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.14393.206) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.14393.206 (rs1_release.160915-0644)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.206

ModLoad: 0000000074700000 000000000015b000 C:\WINDOWS\System32\gdi32full.dll (6.2.14393.206) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.14393.206 (rs1_release.160915-0644)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.206

ModLoad: 0000000077210000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000076c70000 00000000000be000 C:\WINDOWS\System32\msvcrt.dll (7.0.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.14393.0

ModLoad: 00000000769f0000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000077110000 00000000000c1000 C:\WINDOWS\System32\RPCRT4.dll (6.2.14393.82) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000073e70000 000000000001e000 C:\WINDOWS\System32\SspiCli.dll (6.2.14393.187) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.14393.187 (rs1_release_inmarket.160906-1818)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.187

ModLoad: 0000000073e60000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000073e90000 000000000005a000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000074d70000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000073900000 0000000000145000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.14321.1024) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.14321.1024 (rs1_release.160715-1616)
    Company Name          : Microsoft
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14321.1024

ModLoad: 0000000074020000 00000000000e0000 C:\WINDOWS\System32\ucrtbase.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000000ee0000 0000000000048000 C:\Program Files (x86)\Intel\VTune\Shared\Bin\symsrv.dll (6.8.4.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : symsrv.pdb
    File Version          : 6.8.0004.0 (debuggers(dbg).070515-1751)
    Company Name          : Microsoft Corporation
    Product Name          : Debugging Tools for Windows(R)
    Product Version       : 6.8.0004.0

ModLoad: 0000000073e50000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2281, Write: 0, Other 19692

- I/O Transfers Counters -
Read: 0, Write: 2063, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 86000, QuotaPeakPagedPoolUsage: 86160
QuotaNonPagedPoolUsage: 8832, QuotaPeakNonPagedPoolUsage: 9120

- Virtual Memory Usage -
VirtualSize: 53362688, PeakVirtualSize: 53362688

- Pagefile Usage -
PagefileUsage: 3182592, PeakPagefileUsage: 3182592

- Working Set Size -
WorkingSetSize: 5816320, PeakWorkingSetSize: 5959680, PageFaultCount: 1764

*** Dump of thread ID 16264 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 3437500.000000, User Time: 7500000.000000, Wait Time: 888093.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x004981C4 write attempt to address 0x012BE12C

- Registers -
eax=00000065 ebx=004b7451 ecx=0019df28 edx=012be12c esi=0019dce0 edi=0019df58
eip=004981c4 esp=0019dc74 ebp=0019df04
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019df04 0048230c 0019df28 004b7450 00000000 0019df58 wah2_8.19_windows_intelx86!+0x0 
0019df48 004506c2 012be12c 004b7450 004b751c 00000421 wah2_8.19_windows_intelx86!+0x0 
0019df68 00497b50 0000000b 00000000 00000000 00000000 wah2_8.19_windows_intelx86!+0x0 
0019df80 00486891 c0000005 0019dfb4 00491914 00000000 wah2_8.19_windows_intelx86!+0x0 
0019ff80 76a662c4 00333000 76a662a0 7065bcc2 0019ffdc wah2_8.19_windows_intelx86!+0x0 
0019ff94 77430609 00333000 719b72cc 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 774305d4 ffffffff 77452528 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 
0019ffec 00000000 004868be 00333000 00000000 78746341 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 

*** Dump of thread ID 16048 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 887116.000000

- Registers -
eax=00000000 ebx=00705ea0 ecx=00000000 edx=00000000 esi=00706500 edi=007066c0
eip=7743f7fc esp=008ffddc ebp=008fff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
008fff80 76a662c4 00705ea0 76a662a0 70f3bcc2 008fffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 
008fff94 77430609 00705ea0 710d72cc 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
008fffdc 774305d4 ffffffff 77452528 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 
008fffec 00000000 77406020 00705ea0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 

*** Dump of thread ID 16008 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 887116.000000

- Registers -
eax=00000000 ebx=00705ea0 ecx=00000000 edx=00000000 esi=00709a98 edi=00709c58
eip=7743f7fc esp=009ffddc ebp=009fff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
009fff80 76a662c4 00705ea0 76a662a0 70e3bcc2 009fffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 
009fff94 77430609 00705ea0 711d72cc 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
009fffdc 774305d4 ffffffff 77452528 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 
009fffec 00000000 77406020 00705ea0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 

*** Dump of thread ID 11240 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 887116.000000

- Registers -
eax=00000000 ebx=00705ea0 ecx=00000000 edx=00000000 esi=0070b3d0 edi=0070b590
eip=7743f7fc esp=00b3fddc ebp=00b3ff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
00b3ff80 76a662c4 00705ea0 76a662a0 70cfbcc2 00b3ffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00b3ff94 77430609 00705ea0 713172cc 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00b3ffdc 774305d4 ffffffff 77452528 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 
00b3ffec 00000000 77406020 00705ea0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 

*** Dump of thread ID 4352 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 888091.000000

- Registers -
eax=00000000 ebx=011efd1c ecx=00000000 edx=00000000 esi=00000000 edi=011efd1c
eip=7743df4c esp=011efcdc ebp=011efd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
011efd40 745d2acf 00000064 00000000 011eff80 00479834 ntdll!NtDelayExecution+0x0 
011efd50 00479834 00000064 00479810 00479810 00000000 KERNELBASE!Sleep+0x0 
011eff80 76a662c4 00000000 76a662a0 7162bcc2 011effdc wah2_8.19_windows_intelx86!+0x0 
011eff94 77430609 00000000 709c72cc 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
011effdc 774305d4 ffffffff 77452528 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 
011effec 00000000 00479810 00000000 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Oct 2016 21:10:49 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 391,979 576,437 1.4706
06 Oct 2016 12:54:50 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 380,459 558,241 1.4673
06 Oct 2016 08:44:26 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 368,939 540,040 1.4638
06 Oct 2016 02:43:43 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 357,419 521,880 1.4601
05 Oct 2016 16:44:36 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 345,899 503,503 1.4556
05 Oct 2016 12:11:27 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 334,379 485,248 1.4512
05 Oct 2016 06:25:42 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 322,859 466,939 1.4463
05 Oct 2016 01:20:09 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 311,339 448,630 1.4410
04 Oct 2016 10:53:45 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 299,819 430,293 1.4352
04 Oct 2016 04:57:48 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 288,299 411,831 1.4285
03 Oct 2016 14:55:32 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 276,779 394,002 1.4235
03 Oct 2016 10:39:56 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 265,259 378,816 1.4281
03 Oct 2016 06:24:28 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 253,739 363,612 1.4330
03 Oct 2016 02:13:57 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 242,219 348,398 1.4384
02 Oct 2016 20:15:53 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 230,699 332,399 1.4408
02 Oct 2016 15:20:05 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 219,179 314,915 1.4368
02 Oct 2016 09:44:10 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 207,659 296,859 1.4296
02 Oct 2016 04:23:12 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 196,139 278,426 1.4195
01 Oct 2016 22:46:35 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 184,619 259,863 1.4076
01 Oct 2016 15:39:54 1310633 19997833 wah2_pnw25_c0ia_200312_49_452_010736636_1 173,099 242,229 1.3994


©2024 cpdn.org