 |
|
|
11)
Message boards :
Number crunching :
Late Validation pending
(Message 66991)
Posted 21 Dec 2022 by  Conan
Post: Well it seems that these files have finally been validated and I have been awarded credit for them, I think. I have noticed a clean up/out has taken place and a lot of the old past work units that I have done over the years has been removed. Those 2 pending jobs among them. I was awarded some small amount of credit this week when I have not done any work and now it seems that the database has had a bit of a clean out and fix up. Good to see. Conan |
|
12)
Message boards :
Number crunching :
OpenIFS Discussion
(Message 66990)
Posted 21 Dec 2022 by Conan
Post: G'Day Glenn, You may of miss read what I wrote I think. The 11.3 GB was not a file size but the amount of disk writes made in that first 2 hours (now after 5 hours well over 30 Gb). The 2.7 to 4.6 GB were RAM amounts that each work unit was using. This was all taken from System Monitor. I did what you have asked and % cd slots/26 % du -hs . # note the '.' 1.2G . This is the same as your example. % cd projects/climateprediction.net % du -hs . 1.2G . This is similar to your example. du -hs srf* 768 MB srf00370000.0001 So all running fine, so maybe just a bit of a misunderstanding I think with data amounts and RAM usage. Thanks Conan |
|
13)
Message boards :
Number crunching :
OpenIFS Discussion
(Message 66983)
Posted 21 Dec 2022 by Conan
Post: These Oifs _ps tasks really test your system out. Running 9 at once, each using from 2.7 to 4.2 GB of RAM, after 2 hours run time they have written 11.3 GB of data to disk each (101.7 GB), which is huge. Hitting 50 GB of RAM in use out of 64 GB, but I am also running LODA tasks which each use 1 GB of RAM. All 24 threads are running. 12% in and running fine so far. Conan |
|
14)
Message boards :
Number crunching :
OpenIFS Discussion
(Message 66795)
Posted 6 Dec 2022 by Conan
Post: My resent task 22249228 has been sent out twice before. I completed Task 22249324 successfully in just under 17 1/2 hours. |
|
15)
Message boards :
Number crunching :
OpenIFS Discussion
(Message 66793)
Posted 5 Dec 2022 by Conan
Post: My resent task 22249228 has been sent out twice before. Previous Task 22246540 and Task 22248943 Task 22246540 has no Stderr, it failed with a Run Time of 1 Day 5 Hours and a CPU Time of 31 Minutes. It also had an unusual amount of Peak Disk Usage of 23,961.87 MB (or 23.9 GB) way above the norm as I have seen. Task 22248943 has the error "Process exited with code 9" other than that seemed to have run fine. This one belonged to wateroakley I was able to run this WU to completion without error. Another resent task I have running is Task 22249324 Previous Task 22247025 and Task 22249194 Task 22247025 on computer 1524992 it had a Run Time of 42 Minutes with a CPU Time of 20 Seconds with a Peak Disk Usage of just 404.06 MB. This computer still has work on it but has not completed a successful OpenIFS WU all failed work units have the same long run times and short CPU times and have different error codes as well, codes 1, 5 and 148 all appear on this computer. Task 22249194 on computer 1504810 has No Stderr, has a Run Time of 1 Day 1 Hour and CPU Time of 7 Hours. This computer has run 9 OpenIFS work units all have failed with the long Run Time and short CPU Time. This computer belongs to happywetter.at So a few different reasons that some work units have failed or thrown an error. Conan |
|
16)
Message boards :
Number crunching :
OpenIFS Discussion
(Message 66737)
Posted 3 Dec 2022 by Conan
Post: Just downloaded a resend of a Work Unit that failed due to an error. Completed successfully after 16 1/2 hours. Conan |
|
17)
Message boards :
Number crunching :
OpenIFS Discussion
(Message 66718)
Posted 2 Dec 2022 by Conan
Post: Just downloaded a resend of a Work Unit that failed due to an error. This Task 22245903 It failed due to running longer than 5 minutes after the work unit had finished. The WU was run by mikey and other than the longer run time after finishing seemed to have run successfully after over 2 days run time. The run time seems overly long on a Ryzen but did complete. It is now running as Task 22249047 on my Ryzen computer. Will see how it runs for me. Conan |
|
18)
Message boards :
Number crunching :
OpenIFS Discussion
(Message 66684)
Posted 1 Dec 2022 by Conan
Post: Experiment successful, work unit completed without error in a shade under 18 hours. The time may of been due to how loaded up the processor was during this time but still good. Don't know about the cache hits as the experiment was done on an older Intel i5. My newer Ryzen I believe has a larder cache but without looking things up I don't know what it is either. The 2 still on the Ryzen are paused at the moment due to some PrimeGrid work I need to do, they both still have 33% left to run. Conan |
|
19)
Message boards :
Number crunching :
OpenIFS Discussion
(Message 66681)
Posted 30 Nov 2022 by Conan
Post: As an experiment, I have downloaded a work unit to my 4 core 8 GB Linux computer to see how it would run. The computer is running other BOINC projects and at the moment is running LODA and PRIVATE GFN SEARCH plus iThena.Measurements and WUProp@Home. iThena.Measurements and WUProp are Non-CPU intensive. PRIVATE GFN SEARCH uses minimal resources and less than 50 kB of RAM to run, however LODA is different and uses 1 GB per work unit of RAM. When started the Climate model maxed out my 8 GB and used half my SWAP (7.6 GB so about 3 to 4 GB) this is along with the other BOINC projects. So the computer slowed to a crawl but kept running. Once settled down the Climate model is now using from 2 to 4.5 GB and no SWAP even with 3 LODA work units running as well, but does start to lag a lot. With only 2 LODA, 1 PRIVATE GFN SEARCH and 1 Climate Open IFS running it is quite usable. The Open IFS Climate model is now at 76.425% after 13 hours with about 4 1/2 hours or so to go. So it can be done on 8 GB memory but I would not recommend it if you also want to use the computer as well, because you can go to sleep waiting for the screens to change. As an aside to this I have been having no trouble with all the trickles from 5 work units (now 3 as 2 finished) they go as soon as they are ready. Using a hybrid Fibre to the Node and copper cable to the house Broadband system with around 15 MB upload and 25+ MB download (both on good days with low usage by others on the ISP network). I will stick to my RYZEN 5900x with 64 GB RAM, much less hassle even running 4 at a time does not use over 20 GB. Conan |
|
20)
Message boards :
Number crunching :
Task completed, but not all trickles acknowledged yet. Normal?
(Message 66561)
Posted 24 Nov 2022 by Conan
Post: In a similar vein, I have This WU 22236909 that reported all trickles and seems to have been awarded full credit but still says it is on my computer and still running. It uploaded with the last trickle so does anyone know what has happened to it? I do not have it on my computer. (there are 3 failed work units on that same computer reported today but they stem from a power failure which upset them) Thanks Conan |
|
21)
Message boards :
Number crunching :
New work discussion - 2
(Message 66295)
Posted 7 Nov 2022 by Conan
Post: OpenIFS 43r3 Perturbed Surface, has been added to the application list, what does it mainly cover? Thanksit's a modified version of the default OpenIFS in which the surface parameters, instead of the atmospheric ones, can be modified. There are two large (~3000) ensembles planned for this month where each member of the ensemble has slightly different parameters. I'll ask the scientists to write something to the forum about it. Thanks for that Glenn, appreciated. Conan |
|
22)
Message boards :
Number crunching :
New work discussion - 2
(Message 66293)
Posted 7 Nov 2022 by Conan
Post: OpenIFS 43r3 Perturbed Surface, has been added to the application list, what does it mainly cover? Thanks Conan |
|
23)
Message boards :
Number crunching :
New work discussion - 2
(Message 66234)
Posted 24 Oct 2022 by Conan
Post: Thanks, that is what I thought, possibly the reason I could not get access before as well. Thanks Conan |
|
24)
Message boards :
Number crunching :
New work discussion - 2
(Message 66230)
Posted 24 Oct 2022 by Conan
Post: I would like to join the cpdnboinc-dev project to help out but it appears to need an invitation code and it's not mentioned anywhere that I could see. I think I tried a long while back but could not get a leg in, but memory a bit fuzzy about that. My Linux computer was upgraded a while back to 64 GB RAM (for other BOINC projects requiring 1 or more GB of RAM per work unit, with 32 GB and 24 threads I was maxing out my memory). An invitation would be nice but perhaps they might have enough testers? So I might still not get in. Thanks Conan |
|
25)
Message boards :
Number crunching :
New work discussion - 2
(Message 66194)
Posted 15 Oct 2022 by Conan
Post: Thanks Glenn for the update. Hope you get well soon, plenty of fluids and rest. Conan |
|
26)
Message boards :
Number crunching :
New work discussion - 2
(Message 66189)
Posted 15 Oct 2022 by Conan
Post: Any news on how Glenn and Andy are going with the OpenIFS application? (Hoping they are both clear of Covid now of course.) I would like to give it a go. Thanks Conan |
|
27)
Questions and Answers :
Unix/Linux :
Fedora 36
(Message 66063)
Posted 6 Sep 2022 by Conan
Post: I am unsure about downloading lib32 bit libraries for Fedora 36 but having Fedora 25 then updating to Fedora 36 when I got a new computer (I used the old hard disk rather than the NVMe drives in the new machine as everything was already on it), has not been a problem and ClimatePrediction works fine. The 32bit libraries were installed on the older Fedora ages ago and are still accepted with the later spins. Conan |
|
28)
Message boards :
Number crunching :
Hardware requirements for upcoming models
(Message 65912)
Posted 20 Aug 2022 by Conan
Post: Over at Primegrid you can set how ever many cores you want to use to multithread, from none to as many as you think you need or can spare. A Seventeen or Bust (SoB) work unit takes 400 to whatever hours on a single core but this drops to less than 100 hours using 6 cores. I have a ryzen 3900X with 12 cores and 12 threads but limit Primegrid to just 6 cores for multithreading due to the large number of other projects that I run at the same time. The n-body work units from Milkyway use 16 cores and I can't seem to change that but as they only run for a few minutes to an hour or so it is not a problem, still have 8 other cores. At Yafu@home you can set from 1 to 32 cores due to their work unit types. Conan |
|
29)
Message boards :
Number crunching :
New work Discussion
(Message 65781)
Posted 7 Aug 2022 by Conan
Post: Just for information. Hoping these do come to main site soon. One of my Open IFS tasks from testing had the following on the task page. The application has been placed on the Application Page, just awaiting the actual work units to go with it. So something is moving. Conan |
|
30)
Message boards :
Number crunching :
New work Discussion
(Message 65740)
Posted 3 Aug 2022 by Conan
Post: Do you know if they run faster as 64 bit or are they the same? If the same then what is the benefit? Is there any reason (that you know of) why they need so much memory? More expansive models, more parameters or something else? Still keen to try some OpenIFS work units. I have 64 GB of RAM on my AMD 5900X (12 cores/24 threads), as only 4 work units seem to be downloaded at any particular time (in the last two attempts to get work) I should be OK, (I run a lot of other projects as well, so this limits how much work can be downloaded). Conan |
©2024 climateprediction.net