<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
361
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:51:25 STEP 362 H= 362:00 +CPU= 21.827
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:53:18 STEP 363 H= 363:00 +CPU= 32.114
00:53:39 STEP 364 H= 364:00 +CPU= 20.903
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:55:52 STEP 365 H= 365:00 +CPU= 20.774
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:57:38 STEP 366 H= 366:00 +CPU= 33.481
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:59:29 STEP 367 H= 367:00 +CPU= 20.551
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:01:32 STEP 368 H= 368:00 +CPU= 21.459
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:03:25 STEP 369 H= 369:00 +CPU= 31.947
01:03:45 STEP 370 H= 370:00 +CPU= 20.218
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:05:28 STEP 371 H= 371:00 +CPU= 21.108
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:07:24 STEP 372 H= 372:00 +CPU= 35.386
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:09:16 STEP 373 H= 373:00 +CPU= 20.934
01:09:37 STEP 374 H= 374:00 +CPU= 21.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:13:02 STEP 375 H= 375:00 +CPU= 32.447
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0157
(argv4) batchid: 961
(argv5) wuid: 12177801
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_76dad220d90aade3e5905f21f330eacc to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0157_1992050100_123_961_12177801.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0157_1992050100_123_961_12177801.zip
ic_ancil_file: ic_ancil_12177801
ifsdata_file: ifsdata_12177801
climate_data_file: clim_data_12177801
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_af1a3f680026f70d41b57793183d0cf8 to: /var/lib/boinc-client/slots/7/ic_ancil_12177801.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12177801.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dbe618c6735d0515e3ae617cacff4263 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12177801.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12177801.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12177801.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12177801.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12177801.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12177801.xml
-- Model is restarting --
Adjusting last_iter, 376, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12177801.xml
last_cpu_time: 11394
upload_file_number: 15
last_iter: 359
last_upload: 1296000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405
The child process has been launched with process id: 1632195
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1632195:1632195] [20230113:011423:1673540063:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:17:14 STEP 360 H= 360:00 +CPU= 37.157
01:17:35 STEP 361 H= 361:00 +CPU= 20.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:19:37 STEP 362 H= 362:00 +CPU= 21.418
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:21:42 STEP 363 H= 363:00 +CPU= 33.361
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:23:45 STEP 364 H= 364:00 +CPU= 21.062
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:25:07 STEP 365 H= 365:00 +CPU= 20.513
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:26:52 STEP 366 H= 366:00 +CPU= 32.476
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:28:43 STEP 367 H= 367:00 +CPU= 20.770
01:29:05 STEP 368 H= 368:00 +CPU= 22.334
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:31:08 STEP 369 H= 369:00 +CPU= 31.814
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:33:03 STEP 370 H= 370:00 +CPU= 22.197
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:34:54 STEP 371 H= 371:00 +CPU= 20.680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:36:52 STEP 372 H= 372:00 +CPU= 36.248
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000372
01:37:12 STEP 373 H= 373:00 +CPU= 20.405
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:38:45 STEP 374 H= 374:00 +CPU= 21.224
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:40:27 STEP 375 H= 375:00 +CPU= 32.184
01:40:48 STEP 376 H= 376:00 +CPU= 20.658
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:42:39 STEP 377 H= 377:00 +CPU= 20.297
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:44:33 STEP 378 H= 378:00 +CPU= 32.607
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:46:15 STEP 379 H= 379:00 +CPU= 20.193
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:47:57 STEP 380 H= 380:00 +CPU= 20.877
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:49:51 STEP 381 H= 381:00 +CPU= 32.325
01:50:11 STEP 382 H= 382:00 +CPU= 20.610
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:52:03 STEP 383 H= 383:00 +CPU= 20.928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:54:12 STEP 384 H= 384:00 +CPU= 37.602
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405_15.zip
Uploading the intermediate file: upload_file_15.zip
01:54:31 STEP 385 H= 385:00 +CPU= 18.841
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:55:56 STEP 386 H= 386:00 +CPU= 19.576
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:57:49 STEP 387 H= 387:00 +CPU= 32.625
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:59:42 STEP 388 H= 388:00 +CPU= 20.391
02:00:02 STEP 389 H= 389:00 +CPU= 20.493
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:02:26 STEP 390 H= 390:00 +CPU= 32.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:04:18 STEP 391 H= 391:00 +CPU= 20.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:05:41 STEP 392 H= 392:00 +CPU= 21.921
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:07:55 STEP 393 H= 393:00 +CPU= 32.924
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:09:28 STEP 394 H= 394:00 +CPU= 20.585
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:10:50 STEP 395 H= 395:00 +CPU= 20.518
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:12:59 STEP 396 H= 396:00 +CPU= 37.211
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000396
02:13:19 STEP 397 H= 397:00 +CPU= 20.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:15:12 STEP 398 H= 398:00 +CPU= 21.446
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:17:26 STEP 399 H= 399:00 +CPU= 32.484
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:19:18 STEP 400 H= 400:00 +CPU= 20.930
02:19:38 STEP 401 H= 401:00 +CPU= 20.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:21:43 STEP 402 H= 402:00 +CPU= 33.476
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:23:05 STEP 403 H= 403:00 +CPU= 19.913
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:24:59 STEP 404 H= 404:00 +CPU= 21.673
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:26:52 STEP 405 H= 405:00 +CPU= 32.233
02:27:13 STEP 406 H= 406:00 +CPU= 20.673
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:29:05 STEP 407 H= 407:00 +CPU= 21.006
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:31:14 STEP 408 H= 408:00 +CPU= 37.561
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405_16.zip
Uploading the intermediate file: upload_file_16.zip
02:31:35 STEP 409 H= 409:00 +CPU= 20.507
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:33:56 STEP 410 H= 410:00 +CPU= 21.323
02:34:29 STEP 411 H= 411:00 +CPU= 32.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:36:31 STEP 412 H= 412:00 +CPU= 20.890
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:38:13 STEP 413 H= 413:00 +CPU= 20.686
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:40:07 STEP 414 H= 414:00 +CPU= 32.852
02:40:26 STEP 415 H= 415:00 +CPU= 19.481
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:42:40 STEP 416 H= 416:00 +CPU= 21.114
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:44:44 STEP 417 H= 417:00 +CPU= 31.936
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:46:27 STEP 418 H= 418:00 +CPU= 21.529
02:46:48 STEP 419 H= 419:00 +CPU= 20.320
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:48:45 STEP 420 H= 420:00 +CPU= 36.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000420
02:50:26 STEP 421 H= 421:00 +CPU= 20.415
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:52:09 STEP 422 H= 422:00 +CPU= 21.161
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:54:21 STEP 423 H= 423:00 +CPU= 31.659
02:54:42 STEP 424 H= 424:00 +CPU= 20.608
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:56:32 STEP 425 H= 425:00 +CPU= 20.168
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:58:27 STEP 426 H= 426:00 +CPU= 32.742
02:58:48 STEP 427 H= 427:00 +CPU= 20.512
02:59:08 STEP 428 H= 428:00 +CPU= 20.605
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:01:22 STEP 429 H= 429:00 +CPU= 31.899
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:03:33 STEP 430 H= 430:00 +CPU= 20.491
03:03:54 STEP 431 H= 431:00 +CPU= 21.194
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:05:54 STEP 432 H= 432:00 +CPU= 38.615
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405_17.zip
Uploading the intermediate file: upload_file_17.zip
03:06:13 STEP 433 H= 433:00 +CPU= 19.127
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:08:14 STEP 434 H= 434:00 +CPU= 19.910
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:10:18 STEP 435 H= 435:00 +CPU= 32.723
03:10:39 STEP 436 H= 436:00 +CPU= 21.022
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:13:02 STEP 437 H= 437:00 +CPU= 20.497
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:14:57 STEP 438 H= 438:00 +CPU= 33.482
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0157
(argv4) batchid: 961
(argv5) wuid: 12177801
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_76dad220d90aade3e5905f21f330eacc to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0157_1992050100_123_961_12177801.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0157_1992050100_123_961_12177801.zip
ic_ancil_file: ic_ancil_12177801
ifsdata_file: ifsdata_12177801
climate_data_file: clim_data_12177801
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_af1a3f680026f70d41b57793183d0cf8 to: /var/lib/boinc-client/slots/7/ic_ancil_12177801.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12177801.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dbe618c6735d0515e3ae617cacff4263 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12177801.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12177801.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12177801.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12177801.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12177801.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12177801.xml
-- Model is restarting --
Adjusting last_iter, 439, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12177801.xml
last_cpu_time: 13383
upload_file_number: 18
last_iter: 431
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405
The child process has been launched with process id: 1649779
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1649779:1649779] [20230113:031707:1673547427:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:19:27 STEP 432 H= 432:00 +CPU= 36.219
03:19:49 STEP 433 H= 433:00 +CPU= 21.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:21:21 STEP 434 H= 434:00 +CPU= 21.245
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:23:14 STEP 435 H= 435:00 +CPU= 32.123
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:24:27 STEP 436 H= 436:00 +CPU= 21.357
03:24:47 STEP 437 H= 437:00 +CPU= 20.571
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:26:51 STEP 438 H= 438:00 +CPU= 32.809
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:28:32 STEP 439 H= 439:00 +CPU= 20.392
03:28:54 STEP 440 H= 440:00 +CPU= 21.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:32:08 STEP 441 H= 441:00 +CPU= 32.349
03:32:30 STEP 442 H= 442:00 +CPU= 21.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:33:52 STEP 443 H= 443:00 +CPU= 20.482
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:35:39 STEP 444 H= 444:00 +CPU= 36.026
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000444
03:37:11 STEP 445 H= 445:00 +CPU= 20.985
03:37:32 STEP 446 H= 446:00 +CPU= 21.364
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:39:36 STEP 447 H= 447:00 +CPU= 32.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:41:18 STEP 448 H= 448:00 +CPU= 21.175
03:41:39 STEP 449 H= 449:00 +CPU= 20.059
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:43:43 STEP 450 H= 450:00 +CPU= 33.036
03:44:03 STEP 451 H= 451:00 +CPU= 20.228
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:45:56 STEP 452 H= 452:00 +CPU= 21.448
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:47:58 STEP 453 H= 453:00 +CPU= 31.654
03:48:19 STEP 454 H= 454:00 +CPU= 21.039
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:50:01 STEP 455 H= 455:00 +CPU= 20.896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:51:49 STEP 456 H= 456:00 +CPU= 37.752
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405_18.zip
Uploading the intermediate file: upload_file_18.zip
03:52:10 STEP 457 H= 457:00 +CPU= 20.574
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:54:33 STEP 458 H= 458:00 +CPU= 21.123
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:56:49 STEP 459 H= 459:00 +CPU= 33.672
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:58:32 STEP 460 H= 460:00 +CPU= 21.747
03:58:53 STEP 461 H= 461:00 +CPU= 20.775
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:02:09 STEP 462 H= 462:00 +CPU= 34.164
04:02:30 STEP 463 H= 463:00 +CPU= 20.558
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:04:12 STEP 464 H= 464:00 +CPU= 21.135
04:04:45 STEP 465 H= 465:00 +CPU= 32.820
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:06:48 STEP 466 H= 466:00 +CPU= 21.836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:08:40 STEP 467 H= 467:00 +CPU= 19.794
04:09:17 STEP 468 H= 468:00 +CPU= 36.985
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:11:18 STEP 469 H= 469:00 +CPU= 20.268
04:11:39 STEP 470 H= 470:00 +CPU= 20.478
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:13:33 STEP 471 H= 471:00 +CPU= 32.414
04:13:53 STEP 472 H= 472:00 +CPU= 20.470
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:15:44 STEP 473 H= 473:00 +CPU= 20.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:17:49 STEP 474 H= 474:00 +CPU= 33.312
04:18:09 STEP 475 H= 475:00 +CPU= 20.192
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:20:12 STEP 476 H= 476:00 +CPU= 21.775
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:21:56 STEP 477 H= 477:00 +CPU= 32.600
04:22:17 STEP 478 H= 478:00 +CPU= 21.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:24:09 STEP 479 H= 479:00 +CPU= 20.524
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:26:00 STEP 480 H= 480:00 +CPU= 39.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405_19.zip
Uploading the intermediate file: upload_file_19.zip
04:27:31 STEP 481 H= 481:00 +CPU= 20.440
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:29:02 STEP 482 H= 482:00 +CPU= 20.587
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:30:37 STEP 483 H= 483:00 +CPU= 32.260
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:32:10 STEP 484 H= 484:00 +CPU= 20.985
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:33:31 STEP 485 H= 485:00 +CPU= 20.209
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:35:26 STEP 486 H= 486:00 +CPU= 33.598
04:35:47 STEP 487 H= 487:00 +CPU= 20.798
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:37:49 STEP 488 H= 488:00 +CPU= 21.553
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:40:45 STEP 489 H= 489:00 +CPU= 33.121
04:41:08 STEP 490 H= 490:00 +CPU= 23.125
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:43:00 STEP 491 H= 491:00 +CPU= 20.791
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:47:20 STEP 492 H= 492:00 +CPU= 37.125
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000492
04:47:41 STEP 493 H= 493:00 +CPU= 21.147
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:49:54 STEP 494 H= 494:00 +CPU= 21.424
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:51:49 STEP 495 H= 495:00 +CPU= 32.646
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:54:23 STEP 496 H= 496:00 +CPU= 22.386
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:56:57 STEP 497 H= 497:00 +CPU= 21.477
04:57:31 STEP 498 H= 498:00 +CPU= 34.016
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:00:03 STEP 499 H= 499:00 +CPU= 20.987
05:00:25 STEP 500 H= 500:00 +CPU= 21.408
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:03:09 STEP 501 H= 501:00 +CPU= 33.114
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:06:02 STEP 502 H= 502:00 +CPU= 21.968
05:06:24 STEP 503 H= 503:00 +CPU= 21.343
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:09:25 STEP 504 H= 504:00 +CPU= 38.752
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405_20.zip
Uploading the intermediate file: upload_file_20.zip
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:12:07 STEP 505 H= 505:00 +CPU= 21.788
05:12:29 STEP 506 H= 506:00 +CPU= 21.862
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:15:15 STEP 507 H= 507:00 +CPU= 34.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:17:49 STEP 508 H= 508:00 +CPU= 22.473
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0157
(argv4) batchid: 961
(argv5) wuid: 12177801
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_76dad220d90aade3e5905f21f330eacc to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0157_1992050100_123_961_12177801.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0157_1992050100_123_961_12177801.zip
ic_ancil_file: ic_ancil_12177801
ifsdata_file: ifsdata_12177801
climate_data_file: clim_data_12177801
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_af1a3f680026f70d41b57793183d0cf8 to: /var/lib/boinc-client/slots/7/ic_ancil_12177801.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12177801.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dbe618c6735d0515e3ae617cacff4263 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12177801.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12177801.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12177801.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12177801.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12177801.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12177801.xml
-- Model is restarting --
Adjusting last_iter, 508, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12177801.xml
last_cpu_time: 15348
upload_file_number: 21
last_iter: 503
last_upload: 1814400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405
The child process has been launched with process id: 1670460
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:1670460:1670460] [20230113:052020:1673554820:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:22:44 STEP 504 H= 504:00 +CPU= 38.945
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:24:46 STEP 505 H= 505:00 +CPU= 21.494
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:26:49 STEP 506 H= 506:00 +CPU= 21.877
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:29:04 STEP 507 H= 507:00 +CPU= 32.931
05:29:26 STEP 508 H= 508:00 +CPU= 21.927
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:31:27 STEP 509 H= 509:00 +CPU= 20.496
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:34:34 STEP 510 H= 510:00 +CPU= 34.857
05:34:54 STEP 511 H= 511:00 +CPU= 20.619
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:36:36 STEP 512 H= 512:00 +CPU= 21.504
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:38:52 STEP 513 H= 513:00 +CPU= 33.538
05:39:15 STEP 514 H= 514:00 +CPU= 22.354
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:41:37 STEP 515 H= 515:00 +CPU= 20.919
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:44:15 STEP 516 H= 516:00 +CPU= 37.106
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000516
05:44:37 STEP 517 H= 517:00 +CPU= 21.845
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:46:29 STEP 518 H= 518:00 +CPU= 21.168
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:48:24 STEP 519 H= 519:00 +CPU= 32.767
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:50:06 STEP 520 H= 520:00 +CPU= 21.689
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:51:29 STEP 521 H= 521:00 +CPU= 20.578
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:53:25 STEP 522 H= 522:00 +CPU= 33.667
05:53:46 STEP 523 H= 523:00 +CPU= 21.137
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:55:37 STEP 524 H= 524:00 +CPU= 21.122
05:56:09 STEP 525 H= 525:00 +CPU= 31.892
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:58:02 STEP 526 H= 526:00 +CPU= 21.275
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:59:34 STEP 527 H= 527:00 +CPU= 20.994
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:01:44 STEP 528 H= 528:00 +CPU= 38.496
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12177801/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0157_1992050100_123_961_12177801_0_r662860405_21.zip
Uploading the intermediate file: upload_file_21.zip
06:02:05 STEP 529 H= 529:00 +CPU= 21.039
06:02:26 STEP 530 H= 530:00 +CPU= 21.070
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:04:30 STEP 531 H= 531:00 +CPU= 33.134
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:05:53 STEP 532 H= 532:00 +CPU= 21.517
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:07:34 STEP 533 H= 533:00 +CPU= 20.402
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:09:41 STEP 534 H= 534:00 +CPU= 34.136
06:10:02 STEP 535 H= 535:00 +CPU= 20.994
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:11:54 STEP 536 H= 536:00 +CPU= 21.112
06:12:27 STEP 537 H= 537:00 +CPU= 32.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:14:29 STEP 538 H= 538:00 +CPU= 21.471
06:14:50 STEP 539 H= 539:00 +CPU= 20.867
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:16:57 STEP 540 H= 540:00 +CPU= 35.883
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000540
06:17:18 STEP 541 H= 541:00 +CPU= 20.687
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:19:21 STEP 542 H= 542:00 +CPU= 21.260
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:21:04 STEP 543 H= 543:00 +CPU= 32.309
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
