climateprediction.net home page
Cancel high priority run now or later?

Cancel high priority run now or later?

Message boards : Number crunching : Cancel high priority run now or later?
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile old_user280873
Avatar

Send message
Joined: 18 Feb 06
Posts: 17
Credit: 1,769,142
RAC: 0
Message 42146 - Posted: 9 May 2011, 9:18:05 UTC

My pc is working on an Ocean 6.07 model with high priority. The calculation must be done before Aug 4th 2011. My pc will not running all the time, so I can't finish on time.
What is the best thing to do. Cancel now or cancel in August?
Leendert.
ID: 42146 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 42147 - Posted: 9 May 2011, 9:42:52 UTC - in response to Message 42146.  

How about option C)? Don't cancel at all.

As has been posted many times, there IS no deadline with cpdn! But the BOINC software insists on one, (because of how other projects work), so a fake one is used. The data will still be accepted long after the "deadline" expires.

The reason that it's so short this time, is that this first batch is needed quickly to use as input to the next stage. The researchers are on a tight time line, so they're relying on those computers that are running fast 24/7 to provide as many as possible as soon as possible. The slower returns will be used later.

And BOINC will gradually work out that it's not as bad as originally thought, and get out of 'panic mode'. But that will take a week or so.

A thread by the researchers is here on our php board.

There are also some threads on this board about the models.


Backups: Here
ID: 42147 · Report as offensive     Reply Quote
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1084
Credit: 7,753,991
RAC: 4,095
Message 42148 - Posted: 9 May 2011, 9:44:54 UTC
Last modified: 9 May 2011, 9:45:45 UTC

Carry on: the data will still be accepted after the deadline. The 'time-to-completion' estimate may also be too high in the early stages of the model and will come down as the model progresses: you may therefore find that the model does in fact have enough time to finish.

[Edit: Les got there first.]
ID: 42148 · Report as offensive     Reply Quote
old_user657819

Send message
Joined: 10 Jul 11
Posts: 4
Credit: 18,510
RAC: 0
Message 42696 - Posted: 28 Jul 2011, 8:54:09 UTC

Isn't any deadline? So I get EXACTLY the same credit, even if I upload a result the same day I downloded it?
ID: 42696 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 42697 - Posted: 28 Jul 2011, 9:13:16 UTC - in response to Message 42696.  

With this project, credit is given for trickle_up files returned.
These files are created at regular intervals, which differs for each type of model, and they contain some of the result data. The rest is contained in zip files, also created at regular intervals.
No trickles, no credit.

And the shortest model at present takes about 3 days on the fastest processor, running 24/7, with no other projects competing for time. So it's impossible to finish a climate model in just one day.


Backups: Here
ID: 42697 · Report as offensive     Reply Quote
old_user657819

Send message
Joined: 10 Jul 11
Posts: 4
Credit: 18,510
RAC: 0
Message 42698 - Posted: 28 Jul 2011, 9:30:18 UTC

How much credits will I earn then?
ID: 42698 · Report as offensive     Reply Quote
KWSN - Sir Frank of the Wood

Send message
Joined: 3 Nov 10
Posts: 39
Credit: 2,494,427
RAC: 0
Message 42699 - Posted: 28 Jul 2011, 13:52:46 UTC - in response to Message 42698.  

markus:

there are 40 trickles - each trickle is 311 credits;

therefore, you will receive about 12,440 credits for the completed
workunit...
ID: 42699 · Report as offensive     Reply Quote
metalius
Avatar

Send message
Joined: 28 Nov 06
Posts: 89
Credit: 11,967,262
RAC: 2,952
Message 42701 - Posted: 28 Jul 2011, 14:18:19 UTC - in response to Message 42147.  
Last modified: 28 Jul 2011, 14:35:38 UTC

How about option C)? Don't cancel at all.

As has been posted many times, there IS no deadline with cpdn! But the BOINC software insists on one, (because of how other projects work), so a fake one is used. The data will still be accepted long after the "deadline" expires.

An excellent question from Leendert...
I want to add something.
For Ocean models we have:
minimum quorum - 1;
initial replication - 2;
max # of error/total/success tasks - 3, 3, 3.
So, if some of 2 hosts will miss the "deadline", 3rd extra-task may or will be sent.

Questions...
1. This extra-task, if it will be sent? Is it not a CPU-time waste? ;-)
2. My behavior, if I got this 3rd task? Situation - the 2nd host, when my host got 3rd task, was approaching to end of processing and finished it's job few days after it's "deadline", my host has a small progress at that moment. My intuition says - if I don't want to abuse my CPU for useless job, I need to cancel this extra-task. Am I at least partially correct?

Some unpleasant details...
1. I am multi-project participant. CPDN was always a friendly and comfortable project. Now it is a conflicting project, if running Ocean models, because it is blocking another projects, especially when BOINC is upgraded to newest versions.
2. [IMHO] - I don't understand sometimes, how IQ of BOINC is evolving, because at least since versions 6.2.x it is using more and more strange arithmetic - 2x2 is no more 4. [/IMHO] Effects of this are - the high priority is assigned to the task without some explainable reason or, much worse, the task is not running yet in high priority, when it is necessary already. As result of this - the Ocean tasks are missing their "deadlines" on older machines - an example... And I have more...
ID: 42701 · Report as offensive     Reply Quote
old_user657819

Send message
Joined: 10 Jul 11
Posts: 4
Credit: 18,510
RAC: 0
Message 42709 - Posted: 29 Jul 2011, 10:52:51 UTC

So that means no tasks gonna be deleted?
ID: 42709 · Report as offensive     Reply Quote
old_user657819

Send message
Joined: 10 Jul 11
Posts: 4
Credit: 18,510
RAC: 0
Message 42721 - Posted: 30 Jul 2011, 20:27:54 UTC - in response to Message 42709.  

So that means no tasks gonna be deleted?

ID: 42721 · Report as offensive     Reply Quote
metalius
Avatar

Send message
Joined: 28 Nov 06
Posts: 89
Credit: 11,967,262
RAC: 2,952
Message 42726 - Posted: 31 Jul 2011, 9:07:09 UTC - in response to Message 42721.  
Last modified: 31 Jul 2011, 9:08:05 UTC

So that means no tasks gonna be deleted?

1. Your behavior will be correct here if and only if You will finish all of tasks, because the combination of parameters may be unique for every task of the same WU.
2. CPDN servers are accepting everything - every trickle Your machines will send to them.
ID: 42726 · Report as offensive     Reply Quote

Message boards : Number crunching : Cancel high priority run now or later?

©2024 cpdn.org