<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
506 H= 506:00 +CPU= 22.447
11:14:29 STEP 507 H= 507:00 +CPU= 34.697
11:14:51 STEP 508 H= 508:00 +CPU= 21.809
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:22:54 STEP 509 H= 509:00 +CPU= 20.825
11:23:33 STEP 510 H= 510:00 +CPU= 37.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:27:08 STEP 511 H= 511:00 +CPU= 23.533
11:27:34 STEP 512 H= 512:00 +CPU= 24.852
11:28:10 STEP 513 H= 513:00 +CPU= 36.241
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:44:58 STEP 514 H= 514:00 +CPU= 24.747
11:45:22 STEP 515 H= 515:00 +CPU= 23.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:47:26 STEP 516 H= 516:00 +CPU= 41.734
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000516
11:47:47 STEP 517 H= 517:00 +CPU= 21.174
11:48:08 STEP 518 H= 518:00 +CPU= 21.058
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:49:54 STEP 519 H= 519:00 +CPU= 33.394
11:50:15 STEP 520 H= 520:00 +CPU= 21.190
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:51:46 STEP 521 H= 521:00 +CPU= 20.252
11:52:21 STEP 522 H= 522:00 +CPU= 34.252
11:52:41 STEP 523 H= 523:00 +CPU= 20.222
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:54:34 STEP 524 H= 524:00 +CPU= 21.111
11:55:08 STEP 525 H= 525:00 +CPU= 33.283
11:55:29 STEP 526 H= 526:00 +CPU= 20.915
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:56:41 STEP 527 H= 527:00 +CPU= 21.510
11:57:19 STEP 528 H= 528:00 +CPU= 37.661
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325_21.zip
Uploading the intermediate file: upload_file_21.zip
11:57:38 STEP 529 H= 529:00 +CPU= 18.929
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:59:03 STEP 530 H= 530:00 +CPU= 21.336
11:59:36 STEP 531 H= 531:00 +CPU= 32.098
11:59:57 STEP 532 H= 532:00 +CPU= 20.923
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:01:29 STEP 533 H= 533:00 +CPU= 21.094
12:02:02 STEP 534 H= 534:00 +CPU= 32.782
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:03:32 STEP 535 H= 535:00 +CPU= 20.325
12:03:54 STEP 536 H= 536:00 +CPU= 21.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:05:38 STEP 537 H= 537:00 +CPU= 32.698
12:05:59 STEP 538 H= 538:00 +CPU= 20.987
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:07:22 STEP 539 H= 539:00 +CPU= 21.179
12:07:57 STEP 540 H= 540:00 +CPU= 35.378
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:09:18 STEP 541 H= 541:00 +CPU= 19.903
12:09:40 STEP 542 H= 542:00 +CPU= 22.088
12:10:13 STEP 543 H= 543:00 +CPU= 32.347
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:11:56 STEP 544 H= 544:00 +CPU= 21.412
12:12:16 STEP 545 H= 545:00 +CPU= 20.747
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:13:51 STEP 546 H= 546:00 +CPU= 33.456
12:14:11 STEP 547 H= 547:00 +CPU= 20.256
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:15:43 STEP 548 H= 548:00 +CPU= 20.835
12:16:16 STEP 549 H= 549:00 +CPU= 32.794
12:16:37 STEP 550 H= 550:00 +CPU= 20.454
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:18:20 STEP 551 H= 551:00 +CPU= 21.426
12:18:58 STEP 552 H= 552:00 +CPU= 38.288
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325_22.zip
Uploading the intermediate file: upload_file_22.zip
12:19:17 STEP 553 H= 553:00 +CPU= 18.881
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:21:00 STEP 554 H= 554:00 +CPU= 20.889
12:21:33 STEP 555 H= 555:00 +CPU= 32.202
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:23:35 STEP 556 H= 556:00 +CPU= 20.976
12:23:56 STEP 557 H= 557:00 +CPU= 21.253
12:24:30 STEP 558 H= 558:00 +CPU= 32.952
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:26:21 STEP 559 H= 559:00 +CPU= 20.252
12:26:43 STEP 560 H= 560:00 +CPU= 21.569
12:27:18 STEP 561 H= 561:00 +CPU= 35.125
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:33:05 STEP 562 H= 562:00 +CPU= 24.646
12:33:28 STEP 563 H= 563:00 +CPU= 22.682
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:52:12 STEP 564 H= 564:00 +CPU= 40.470
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000564
12:52:35 STEP 565 H= 565:00 +CPU= 22.692
12:53:01 STEP 566 H= 566:00 +CPU= 24.901
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:00:41 STEP 567 H= 567:00 +CPU= 37.567
13:01:05 STEP 568 H= 568:00 +CPU= 23.696
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:10:12 STEP 569 H= 569:00 +CPU= 24.316
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:20:52 STEP 570 H= 570:00 +CPU= 36.518
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0598
(argv4) batchid: 953
(argv5) wuid: 12170242
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_839ec7a10311c47c4959da12b6a931ec to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0598_1984050100_123_953_12170242.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0598_1984050100_123_953_12170242.zip
ic_ancil_file: ic_ancil_12170242
ifsdata_file: ifsdata_12170242
climate_data_file: clim_data_12170242
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7f891f431091912802927e03f9e9e5f5 to: /var/lib/boinc-client/slots/2/ic_ancil_12170242.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12170242.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1bdf95e288f03d14195af3e0d878f0b9 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170242.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170242.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170242.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170242.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12170242.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12170242.xml
-- Model is restarting --
Adjusting last_iter, 570, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12170242.xml
last_cpu_time: 16398
upload_file_number: 23
last_iter: 551
last_upload: 1987200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325
The child process has been launched with process id: 3235414
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3235414:3235414] [20221222:132506:1671683106:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:34:33 STEP 552 H= 552:00 +CPU= 39.916
13:34:54 STEP 553 H= 553:00 +CPU= 20.740
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:36:47 STEP 554 H= 554:00 +CPU= 20.583
13:37:19 STEP 555 H= 555:00 +CPU= 32.407
13:37:40 STEP 556 H= 556:00 +CPU= 20.794
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:39:22 STEP 557 H= 557:00 +CPU= 20.731
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:41:08 STEP 558 H= 558:00 +CPU= 33.772
13:41:29 STEP 559 H= 559:00 +CPU= 20.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:43:11 STEP 560 H= 560:00 +CPU= 20.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:44:56 STEP 561 H= 561:00 +CPU= 32.684
13:45:18 STEP 562 H= 562:00 +CPU= 21.680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:46:49 STEP 563 H= 563:00 +CPU= 20.454
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:48:35 STEP 564 H= 564:00 +CPU= 36.382
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000564
13:48:56 STEP 565 H= 565:00 +CPU= 20.077
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:50:38 STEP 566 H= 566:00 +CPU= 20.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:52:13 STEP 567 H= 567:00 +CPU= 33.080
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:53:26 STEP 568 H= 568:00 +CPU= 21.720
13:53:46 STEP 569 H= 569:00 +CPU= 20.021
13:54:19 STEP 570 H= 570:00 +CPU= 32.749
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:56:01 STEP 571 H= 571:00 +CPU= 21.095
13:56:22 STEP 572 H= 572:00 +CPU= 20.625
13:56:54 STEP 573 H= 573:00 +CPU= 32.021
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:58:58 STEP 574 H= 574:00 +CPU= 22.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:00:29 STEP 575 H= 575:00 +CPU= 20.839
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:02:50 STEP 576 H= 576:00 +CPU= 38.672
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325_23.zip
Uploading the intermediate file: upload_file_23.zip
14:03:11 STEP 577 H= 577:00 +CPU= 21.373
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:04:32 STEP 578 H= 578:00 +CPU= 20.626
14:05:05 STEP 579 H= 579:00 +CPU= 32.909
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:06:58 STEP 580 H= 580:00 +CPU= 21.665
14:07:19 STEP 581 H= 581:00 +CPU= 20.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:09:03 STEP 582 H= 582:00 +CPU= 33.290
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:10:26 STEP 583 H= 583:00 +CPU= 20.793
14:10:47 STEP 584 H= 584:00 +CPU= 20.558
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:12:43 STEP 585 H= 585:00 +CPU= 33.581
14:13:04 STEP 586 H= 586:00 +CPU= 21.414
14:13:25 STEP 587 H= 587:00 +CPU= 20.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:15:32 STEP 588 H= 588:00 +CPU= 36.490
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000588
14:15:53 STEP 589 H= 589:00 +CPU= 20.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:17:45 STEP 590 H= 590:00 +CPU= 20.823
14:18:18 STEP 591 H= 591:00 +CPU= 33.460
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:20:01 STEP 592 H= 592:00 +CPU= 21.679
14:20:22 STEP 593 H= 593:00 +CPU= 20.229
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:22:25 STEP 594 H= 594:00 +CPU= 32.927
14:22:47 STEP 595 H= 595:00 +CPU= 21.808
14:23:07 STEP 596 H= 596:00 +CPU= 20.444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:25:32 STEP 597 H= 597:00 +CPU= 32.578
14:25:55 STEP 598 H= 598:00 +CPU= 22.290
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:27:38 STEP 599 H= 599:00 +CPU= 21.687
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:29:58 STEP 600 H= 600:00 +CPU= 38.529
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325_24.zip
Uploading the intermediate file: upload_file_24.zip
14:30:20 STEP 601 H= 601:00 +CPU= 21.556
14:30:40 STEP 602 H= 602:00 +CPU= 20.702
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:33:05 STEP 603 H= 603:00 +CPU= 33.066
14:33:26 STEP 604 H= 604:00 +CPU= 20.918
14:33:47 STEP 605 H= 605:00 +CPU= 20.507
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:35:41 STEP 606 H= 606:00 +CPU= 33.809
14:36:01 STEP 607 H= 607:00 +CPU= 20.640
14:36:23 STEP 608 H= 608:00 +CPU= 21.211
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:38:09 STEP 609 H= 609:00 +CPU= 33.331
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:39:42 STEP 610 H= 610:00 +CPU= 21.675
14:40:04 STEP 611 H= 611:00 +CPU= 21.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:44:34 STEP 612 H= 612:00 +CPU= 36.655
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000612
14:44:55 STEP 613 H= 613:00 +CPU= 21.279
14:45:16 STEP 614 H= 614:00 +CPU= 20.887
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:48:22 STEP 615 H= 615:00 +CPU= 33.992
14:48:44 STEP 616 H= 616:00 +CPU= 21.475
14:49:04 STEP 617 H= 617:00 +CPU= 20.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:50:59 STEP 618 H= 618:00 +CPU= 34.102
14:51:20 STEP 619 H= 619:00 +CPU= 21.138
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:53:03 STEP 620 H= 620:00 +CPU= 21.732
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:54:55 STEP 621 H= 621:00 +CPU= 32.126
14:55:17 STEP 622 H= 622:00 +CPU= 21.891
14:55:38 STEP 623 H= 623:00 +CPU= 20.913
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:58:10 STEP 624 H= 624:00 +CPU= 40.380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325_25.zip
Uploading the intermediate file: upload_file_25.zip
14:58:32 STEP 625 H= 625:00 +CPU= 20.865
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:00:15 STEP 626 H= 626:00 +CPU= 21.708
15:00:48 STEP 627 H= 627:00 +CPU= 32.669
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:02:32 STEP 628 H= 628:00 +CPU= 21.056
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:03:45 STEP 629 H= 629:00 +CPU= 21.150
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:05:19 STEP 630 H= 630:00 +CPU= 33.040
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:06:22 STEP 631 H= 631:00 +CPU= 21.459
15:06:43 STEP 632 H= 632:00 +CPU= 20.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:08:37 STEP 633 H= 633:00 +CPU= 33.001
15:08:58 STEP 634 H= 634:00 +CPU= 21.100
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:10:40 STEP 635 H= 635:00 +CPU= 20.518
15:11:17 STEP 636 H= 636:00 +CPU= 37.163
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000636
15:12:59 STEP 637 H= 637:00 +CPU= 21.208
15:13:20 STEP 638 H= 638:00 +CPU= 20.698
15:13:53 STEP 639 H= 639:00 +CPU= 32.489
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:15:44 STEP 640 H= 640:00 +CPU= 21.295
15:16:04 STEP 641 H= 641:00 +CPU= 19.942
15:16:38 STEP 642 H= 642:00 +CPU= 33.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:18:18 STEP 643 H= 643:00 +CPU= 20.518
15:18:39 STEP 644 H= 644:00 +CPU= 20.658
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:20:34 STEP 645 H= 645:00 +CPU= 33.324
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:22:26 STEP 646 H= 646:00 +CPU= 20.987
15:22:47 STEP 647 H= 647:00 +CPU= 21.465
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:24:57 STEP 648 H= 648:00 +CPU= 38.415
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325_26.zip
Uploading the intermediate file: upload_file_26.zip
15:25:18 STEP 649 H= 649:00 +CPU= 20.678
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:27:10 STEP 650 H= 650:00 +CPU= 21.093
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0598
(argv4) batchid: 953
(argv5) wuid: 12170242
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_839ec7a10311c47c4959da12b6a931ec to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0598_1984050100_123_953_12170242.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0598_1984050100_123_953_12170242.zip
ic_ancil_file: ic_ancil_12170242
ifsdata_file: ifsdata_12170242
climate_data_file: clim_data_12170242
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7f891f431091912802927e03f9e9e5f5 to: /var/lib/boinc-client/slots/2/ic_ancil_12170242.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12170242.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1bdf95e288f03d14195af3e0d878f0b9 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170242.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170242.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170242.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170242.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12170242.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12170242.xml
-- Model is restarting --
Adjusting last_iter, 650, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12170242.xml
last_cpu_time: 18915
upload_file_number: 27
last_iter: 647
last_upload: 2332800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325
The child process has been launched with process id: 3255434
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3255434:3255434] [20221222:152816:1671690496:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:30:26 STEP 648 H= 648:00 +CPU= 36.374
15:30:46 STEP 649 H= 649:00 +CPU= 20.309
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:32:49 STEP 650 H= 650:00 +CPU= 21.469
15:33:21 STEP 651 H= 651:00 +CPU= 31.963
15:33:42 STEP 652 H= 652:00 +CPU= 20.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:35:34 STEP 653 H= 653:00 +CPU= 20.059
15:36:07 STEP 654 H= 654:00 +CPU= 32.726
15:36:27 STEP 655 H= 655:00 +CPU= 20.163
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:38:19 STEP 656 H= 656:00 +CPU= 21.213
15:38:50 STEP 657 H= 657:00 +CPU= 31.655
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:40:33 STEP 658 H= 658:00 +CPU= 21.107
15:40:53 STEP 659 H= 659:00 +CPU= 20.482
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:43:20 STEP 660 H= 660:00 +CPU= 35.254
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000660
15:43:41 STEP 661 H= 661:00 +CPU= 21.416
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:45:04 STEP 662 H= 662:00 +CPU= 21.444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:46:39 STEP 663 H= 663:00 +CPU= 32.973
15:47:02 STEP 664 H= 664:00 +CPU= 22.336
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:48:43 STEP 665 H= 665:00 +CPU= 20.620
15:49:16 STEP 666 H= 666:00 +CPU= 32.502
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:50:59 STEP 667 H= 667:00 +CPU= 21.270
15:51:19 STEP 668 H= 668:00 +CPU= 20.645
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:53:14 STEP 669 H= 669:00 +CPU= 33.140
15:53:35 STEP 670 H= 670:00 +CPU= 21.458
15:53:57 STEP 671 H= 671:00 +CPU= 21.143
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:01:49 STEP 672 H= 672:00 +CPU= 40.384
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325_27.zip
Uploading the intermediate file: upload_file_27.zip
16:02:10 STEP 673 H= 673:00 +CPU= 21.137
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:12:54 STEP 674 H= 674:00 +CPU= 23.586
16:13:29 STEP 675 H= 675:00 +CPU= 34.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:17:43 STEP 676 H= 676:00 +CPU= 23.386
16:18:04 STEP 677 H= 677:00 +CPU= 21.259
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:28:43 STEP 678 H= 678:00 +CPU= 36.314
16:29:06 STEP 679 H= 679:00 +CPU= 22.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:36:30 STEP 680 H= 680:00 +CPU= 21.747
16:37:05 STEP 681 H= 681:00 +CPU= 34.814
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:43:00 STEP 682 H= 682:00 +CPU= 22.416
16:43:22 STEP 683 H= 683:00 +CPU= 22.313
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:47:42 STEP 684 H= 684:00 +CPU= 38.161
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000684
16:48:04 STEP 685 H= 685:00 +CPU= 21.814
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:51:07 STEP 686 H= 686:00 +CPU= 21.865
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:55:15 STEP 687 H= 687:00 +CPU= 34.864
16:55:37 STEP 688 H= 688:00 +CPU= 22.163
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:00:40 STEP 689 H= 689:00 +CPU= 21.438
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:06:08 STEP 690 H= 690:00 +CPU= 36.028
17:06:30 STEP 691 H= 691:00 +CPU= 21.500
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:12:54 STEP 692 H= 692:00 +CPU= 22.608
17:13:29 STEP 693 H= 693:00 +CPU= 35.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:17:04 STEP 694 H= 694:00 +CPU= 21.750
17:17:28 STEP 695 H= 695:00 +CPU= 23.839
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:29:20 STEP 696 H= 696:00 +CPU= 40.602
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325_28.zip
Uploading the intermediate file: upload_file_28.zip
17:29:42 STEP 697 H= 697:00 +CPU= 21.909
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:33:07 STEP 698 H= 698:00 +CPU= 22.622
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0598
(argv4) batchid: 953
(argv5) wuid: 12170242
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_839ec7a10311c47c4959da12b6a931ec to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0598_1984050100_123_953_12170242.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0598_1984050100_123_953_12170242.zip
ic_ancil_file: ic_ancil_12170242
ifsdata_file: ifsdata_12170242
climate_data_file: clim_data_12170242
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7f891f431091912802927e03f9e9e5f5 to: /var/lib/boinc-client/slots/2/ic_ancil_12170242.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12170242.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1bdf95e288f03d14195af3e0d878f0b9 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170242.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12170242.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170242.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12170242.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12170242.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12170242.xml
-- Model is restarting --
Adjusting last_iter, 699, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12170242.xml
last_cpu_time: 20254
upload_file_number: 29
last_iter: 695
last_upload: 2505600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325
The child process has been launched with process id: 3274994
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3274994:3274994] [20221222:173603:1671698163:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:40:31 STEP 696 H= 696:00 +CPU= 39.579
17:40:54 STEP 697 H= 697:00 +CPU= 22.402
17:41:17 STEP 698 H= 698:00 +CPU= 23.044
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:47:35 STEP 699 H= 699:00 +CPU= 35.066
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:51:32 STEP 700 H= 700:00 +CPU= 24.179
17:51:54 STEP 701 H= 701:00 +CPU= 21.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:56:22 STEP 702 H= 702:00 +CPU= 35.846
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:59:06 STEP 703 H= 703:00 +CPU= 22.098
17:59:29 STEP 704 H= 704:00 +CPU= 23.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:03:06 STEP 705 H= 705:00 +CPU= 35.042
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:07:30 STEP 706 H= 706:00 +CPU= 22.729
18:07:53 STEP 707 H= 707:00 +CPU= 22.825
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:11:34 STEP 708 H= 708:00 +CPU= 38.460
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000708
18:11:57 STEP 709 H= 709:00 +CPU= 22.812
18:12:19 STEP 710 H= 710:00 +CPU= 21.621
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:18:28 STEP 711 H= 711:00 +CPU= 35.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:21:51 STEP 712 H= 712:00 +CPU= 21.955
18:22:14 STEP 713 H= 713:00 +CPU= 22.919
18:22:49 STEP 714 H= 714:00 +CPU= 34.513
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:25:53 STEP 715 H= 715:00 +CPU= 22.988
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:29:58 STEP 716 H= 716:00 +CPU= 22.009
18:30:33 STEP 717 H= 717:00 +CPU= 35.044
18:30:56 STEP 718 H= 718:00 +CPU= 22.441
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:37:11 STEP 719 H= 719:00 +CPU= 22.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:45:04 STEP 720 H= 720:00 +CPU= 40.718
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMGGhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMSHhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170242/ICMUAhq0f+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0598_1984050100_123_953_12170242_1_r1249530325_29.zip
Uploading the intermediate file: upload_file_29.zip
18:45:27 STEP 721 H= 721:00 +CPU= 22.089
18:45:49 STEP 722 H= 722:00 +CPU= 22.163
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
