climateprediction.net home page
Task 11706516

Task 11706516

Name famous_v2rj_1999_200_006689349_2
Workunit 6892602
Created 26 Aug 2010, 15:49:59 UTC
Sent 4 Sep 2010, 18:01:38 UTC
Report deadline 5 Dec 2010, 1:28:49 UTC
Received 11 Sep 2010, 13:30:39 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1009869
Run time 4 days 18 hours 3 min 16 sec
CPU time 4 days 1 hours 37 min 48 sec
Validate state Invalid
Credit 1,482.40
Device peak FLOPS 1.82 GFLOPS
Application version UK Met Office FAMOUS v6.11
windows_intelx86
Stderr 
<core_client_version>6.10.43</core_client_version>
<![CDATA[
<message>
Het apparaat herkent de opdracht niet. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
C/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6192, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6192, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
14:36:25 (6720): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=1
Model crash detected, will try to restart...
14:37:04 (6288): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6440, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4024, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
14:38:44 (2396): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1788, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4124, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6372, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6372, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6640, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
14:42:34 (6588): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1656, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1656, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6500, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
14:45:14 (6916): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
14:47:24 (6768): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7756, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
14:49:16 (6744): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
14:49:54 (2472): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7964, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7944, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
14:51:45 (7260): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5404, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
14:54:05 (5896): Can't acquire lockfile (32) - waiting 35s
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7976, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Leaving CPDN_Main::Monitor...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=816, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=816, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=816, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=816, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=816, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=816, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5632, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2488, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2392, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2392, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2392, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/jobs/afyel.ihist after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\BOINC/projects/climateprediction.net/famous_v2rj_1999_200_006689349/dataout/ocean_restart.day after 11 attempts
forrtl: severe (47): write to READONLY file, unit 6, file D:\BOINC\projects\climateprediction.net\famous_v2rj_1999_200_006689349\dataout\stdout_um.txt
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown
famous_um_6.11_wi  0088196C  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080BD3E  Unknown               Unknown  Unknown
famous_um_6.11_wi  0080B95B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007F028D  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA86B  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0FF  Unknown               Unknown  Unknown
famous_um_6.11_wi  007BA0A0  Unknown               Unknown  Unknown
famous_um_6.11_wi  00776C15  Unknown               Unknown  Unknown
famous_um_6.11_wi  007CA0F6  Unknown               Unknown  Unknown
kernel32.dll       7C7E7077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2392, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
15:05:20 (2392): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Sep 2010 08:06:16 1009869 11706516 famous_v2rj_1999_200_006689349_2 449,306 346,347 0.7708
11 Sep 2010 05:21:03 1009869 11706516 famous_v2rj_1999_200_006689349_2 439,946 339,108 0.7708
11 Sep 2010 02:25:33 1009869 11706516 famous_v2rj_1999_200_006689349_2 430,586 331,848 0.7707
10 Sep 2010 23:42:09 1009869 11706516 famous_v2rj_1999_200_006689349_2 421,226 324,604 0.7706
10 Sep 2010 21:05:57 1009869 11706516 famous_v2rj_1999_200_006689349_2 411,866 317,373 0.7706
10 Sep 2010 17:56:07 1009869 11706516 famous_v2rj_1999_200_006689349_2 402,506 310,130 0.7705
10 Sep 2010 15:08:56 1009869 11706516 famous_v2rj_1999_200_006689349_2 393,146 302,907 0.7705
10 Sep 2010 09:01:06 1009869 11706516 famous_v2rj_1999_200_006689349_2 383,786 295,677 0.7704
10 Sep 2010 06:21:26 1009869 11706516 famous_v2rj_1999_200_006689349_2 374,426 288,450 0.7704
10 Sep 2010 03:37:17 1009869 11706516 famous_v2rj_1999_200_006689349_2 365,066 281,223 0.7703
10 Sep 2010 01:03:22 1009869 11706516 famous_v2rj_1999_200_006689349_2 355,706 273,994 0.7703
09 Sep 2010 22:08:59 1009869 11706516 famous_v2rj_1999_200_006689349_2 346,346 266,764 0.7702
09 Sep 2010 19:24:58 1009869 11706516 famous_v2rj_1999_200_006689349_2 336,986 259,542 0.7702
09 Sep 2010 16:31:23 1009869 11706516 famous_v2rj_1999_200_006689349_2 327,626 252,319 0.7701
09 Sep 2010 13:51:35 1009869 11706516 famous_v2rj_1999_200_006689349_2 318,266 245,096 0.7701
09 Sep 2010 08:02:01 1009869 11706516 famous_v2rj_1999_200_006689349_2 308,906 237,859 0.7700
09 Sep 2010 05:16:24 1009869 11706516 famous_v2rj_1999_200_006689349_2 299,546 230,629 0.7699
09 Sep 2010 02:37:49 1009869 11706516 famous_v2rj_1999_200_006689349_2 290,186 223,399 0.7698
08 Sep 2010 23:53:46 1009869 11706516 famous_v2rj_1999_200_006689349_2 280,826 216,185 0.7698
08 Sep 2010 21:14:16 1009869 11706516 famous_v2rj_1999_200_006689349_2 271,466 208,975 0.7698


©2024 cpdn.org