climateprediction.net home page
Unsure about correct upload of zip files

Unsure about correct upload of zip files

Message boards : Number crunching : Unsure about correct upload of zip files
Message board moderation

To post messages, you must log in.

AuthorMessage
Waldmeister

Send message
Joined: 13 Jun 11
Posts: 34
Credit: 1,415,036
RAC: 1,383
Message 44538 - Posted: 20 Jul 2012, 10:15:19 UTC

Hello folks.

I've got a little problem. Due to a computer problem some 1� days ago, that may or may not have affected Boinc and CPDN (long story), i am not sure about whether file uploads of CPDN have been correct tonight.


May you please have a look at task/Result # 14855580.

Trickles 1-4 and it's associated zip-files should be ok and send up normally some days ago.

But i may have a problem with trickles 5 and 6: Well, trickles 5 and 6 were eventually send up tonight (they are listed in the result pages) and deleted in the CPDN folder of my computer. However, to my amazement, the associated zip-files (or more correctly zip folders) are still in my CPDN folder and NOT deleted!

May you please check weather these zip folders were correctly send up or not
(Folder names: hadam3p_saf_1z67_1990_1_007031015_2_5 and hadam3p_saf_1z67_1990_1_007031015_2_6).

If they are not send up, if they are not within your system, may you give me a hint how to send them up?
Remark: I have all trickles and all zip files(folders) still available.

Thank you in advance for your services.
ID: 44538 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 44543 - Posted: 20 Jul 2012, 20:11:23 UTC

Hello Waldmeister

We moderators do not have access to the files and folders in the server's database and of course we cannot see the files and folders on your computer. However, if the zip files _5 and _6 were not uploaded at the correct time I do not think this is serious. These Hadam models are all part of a series. We run one year and then another computer runs the next year etc. It's the last upload that provides the data for the next model in the series to start running. Hadam has 13 file uploads.

If you wish you can check whether the upload files are being generated by your model at the correct time. Suspend BOINC network access until the model has completed its next month. You should then see the next file waiting in the Transfers tab until you allow network access again. You can then also check the size of the file (about 13MB I think) and see that it uploads.
Cpdn news
ID: 44543 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 44544 - Posted: 20 Jul 2012, 20:33:49 UTC

If the files are still on your computer, then they should appear in the Transfers tab as well.
If BOINC attempted to upload them, there'll be messages in the Messages tab about this, and what happened.
These messages also appear in the file: stdoutdae.txt


Backups: Here
ID: 44544 · Report as offensive     Reply Quote
Waldmeister

Send message
Joined: 13 Jun 11
Posts: 34
Credit: 1,415,036
RAC: 1,383
Message 44548 - Posted: 20 Jul 2012, 21:57:45 UTC

Thank you both!

Well, and there is the great mystery.

I already tried overnight what mo.v suggested and it generated the 7th trickle and 7th zip file (upload manually disabled). And there the great mystery begins: Transfer tab has showing 7th zip-file but not 5th and 6th zip-file. However in CPDN-directory all three zip-files (5 through 7) show up, all with appearently normal content. It also shows the 7th trickle-file.

I am simply not getting that.

Besides, those txt-files, including stdoutdae.txt, show nothing, they all have no recent data/text/messages, for whatever reason.

Everything will be fine if there is a mechanism to send these zip-files 5 and 6 up or some info whether they are already up.

Hmmm, i am clueless.
ID: 44548 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 44549 - Posted: 20 Jul 2012, 22:21:40 UTC - in response to Message 44548.  

ALL messages are recorded, so there's definitely something wrong with your setup.

Try:
In the Projects tab, click on the project name.
Click the Update button.
Click on the Messages tab and watch.
You should get a Sending scheduler message, with a reply from the server before too long.


There is no manual system for uploading data files.
With tens of thousands of them during the course of a batch of model runs, this would be impossible.


Backups: Here
ID: 44549 · Report as offensive     Reply Quote
Waldmeister

Send message
Joined: 13 Jun 11
Posts: 34
Credit: 1,415,036
RAC: 1,383
Message 44550 - Posted: 20 Jul 2012, 23:30:51 UTC

Well, that's the way it is. No messages there for roughly a month, cross project wise. I don't get it either.

I have decided to continue the task. Trickle 7 with zip file now uploaded, now also with conventional message. Zip file 7 also correctly erased from my computer, zips 5/6 still there. And as I said, no older messages available.

Let's see at the end of the task, weather zip-files 5/6 have been send up or not.
If wu/task then shows success, then they are send up. If wu/task still pending, there remains a problem.
ID: 44550 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 44551 - Posted: 21 Jul 2012, 0:23:15 UTC

If you haven't restarted the computer and it's been running continuously, it's possible to see from the BOINC Event Log whether files were uploaded. Usually it's also possible to see from the time the upload took approximately how big the file was.


Cpdn news
ID: 44551 · Report as offensive     Reply Quote

Message boards : Number crunching : Unsure about correct upload of zip files

©2024 cpdn.org