climateprediction.net home page
Task 22256698

Task 22256698

Name oifs_43r3_ps_0605_1986050100_123_955_12172249_0
Workunit 12172249
Created 21 Dec 2022, 9:04:25 UTC
Sent 21 Jan 2023, 12:12:32 UTC
Report deadline 22 Mar 2023, 12:12:32 UTC
Received 21 Jan 2023, 15:14:44 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1533736
Run time 17 min 54 sec
CPU time 15 min 44 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 3.95 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 3,880.41 MB
Peak swap size 4,974.13 MB
Peak disk usage 1,192.47 MB
Stderr
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1986050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0605
(argv4) batchid: 955
(argv5) wuid: 12172249
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/1
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_008e575e3f6d95f462afab58f5ecb3bb to: /var/lib/boinc/slots/1/oifs_43r3_ps_0605_1986050100_123_955_12172249.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/1/oifs_43r3_ps_0605_1986050100_123_955_12172249.zip
ic_ancil_file: ic_ancil_12172249
ifsdata_file: ifsdata_12172249
climate_data_file: clim_data_12172249
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_cb85f3ea2934970a673be4b31c8bec87 to: /var/lib/boinc/slots/1/ic_ancil_12172249.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/1/ic_ancil_12172249.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1086919c16865b9c5523f384e1a58486 to: /var/lib/boinc/slots/1/ifsdata/ifsdata_12172249.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/1/ifsdata/ifsdata_12172249.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/1/159l_2/clim_data_12172249.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/1/159l_2/clim_data_12172249.zip
Checking for progress XML file: /var/lib/boinc/slots/1/progress_file_12172249.xml
Creating progress file: /var/lib/boinc/slots/1/progress_file_12172249.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0605_1986050100_123_955_12172249_0_r1394347964
The child process has been launched with process id: 4593
Executing the command: /var/lib/boinc/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:4593:4593] [20230121:234408:1674312248:0.005] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  23:44:38 STEP    0 H=   0:00 +CPU= 25.411
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+000000
  23:44:54 STEP    1 H=   1:00 +CPU= 16.273
  23:45:09 STEP    2 H=   2:00 +CPU= 14.385
  23:45:35 STEP    3 H=   3:00 +CPU= 24.125
  23:45:51 STEP    4 H=   4:00 +CPU= 16.140
  23:46:05 STEP    5 H=   5:00 +CPU= 13.602
  23:46:48 STEP    6 H=   6:00 +CPU= 26.474
  23:47:03 STEP    7 H=   7:00 +CPU= 14.251
  23:47:18 STEP    8 H=   8:00 +CPU= 14.839
  23:47:41 STEP    9 H=   9:00 +CPU= 21.822
  23:47:55 STEP   10 H=  10:00 +CPU= 13.929
  23:48:11 STEP   11 H=  11:00 +CPU= 16.459
  23:48:36 STEP   12 H=  12:00 +CPU= 24.964
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+000012
  23:48:55 STEP   13 H=  13:00 +CPU= 18.551
  23:49:11 STEP   14 H=  14:00 +CPU= 16.142
  23:49:34 STEP   15 H=  15:00 +CPU= 22.501
  23:49:49 STEP   16 H=  16:00 +CPU= 15.153
  23:50:06 STEP   17 H=  17:00 +CPU= 17.218
  23:50:33 STEP   18 H=  18:00 +CPU= 25.020
  23:50:50 STEP   19 H=  19:00 +CPU= 16.890
  23:51:07 STEP   20 H=  20:00 +CPU= 17.197
  23:51:32 STEP   21 H=  21:00 +CPU= 24.910
  23:51:47 STEP   22 H=  22:00 +CPU= 14.907
  23:52:05 STEP   23 H=  23:00 +CPU= 18.328
  23:52:33 STEP   24 H=  24:00 +CPU= 26.406
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMGGhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMSHhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMUAhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMGGhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMSHhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMUAhq0f+000012
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0605_1986050100_123_955_12172249_0_r1394347964_0.zip
Uploading the intermediate file: upload_file_0.zip
  23:52:48 STEP   25 H=  25:00 +CPU= 14.068
  23:53:02 STEP   26 H=  26:00 +CPU= 14.203
  23:53:25 STEP   27 H=  27:00 +CPU= 23.417
  23:53:39 STEP   28 H=  28:00 +CPU= 14.152
  23:53:54 STEP   29 H=  29:00 +CPU= 14.722
  23:54:32 STEP   30 H=  30:00 +CPU= 30.150
  23:54:47 STEP   31 H=  31:00 +CPU= 14.242
  23:55:06 STEP   32 H=  32:00 +CPU= 17.023
  23:55:31 STEP   33 H=  33:00 +CPU= 24.497
  23:55:45 STEP   34 H=  34:00 +CPU= 14.438
  23:55:59 STEP   35 H=  35:00 +CPU= 14.266
  23:56:23 STEP   36 H=  36:00 +CPU= 23.847
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+000036
  23:56:37 STEP   37 H=  37:00 +CPU= 13.731
  23:56:51 STEP   38 H=  38:00 +CPU= 14.165
  23:57:13 STEP   39 H=  39:00 +CPU= 21.698
  23:57:27 STEP   40 H=  40:00 +CPU= 14.195
  23:57:42 STEP   41 H=  41:00 +CPU= 14.551
  23:58:04 STEP   42 H=  42:00 +CPU= 21.927
  23:58:17 STEP   43 H=  43:00 +CPU= 13.757
  23:58:31 STEP   44 H=  44:00 +CPU= 14.171
  23:58:53 STEP   45 H=  45:00 +CPU= 21.459
  23:59:07 STEP   46 H=  46:00 +CPU= 14.145
  23:59:21 STEP   47 H=  47:00 +CPU= 14.135
  00:00:05 STEP   48 H=  48:00 +CPU= 32.213
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMGGhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMSHhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMGGhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMSHhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12172249/ICMUAhq0f+000036
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0605_1986050100_123_955_12172249_0_r1394347964_1.zip
Uploading the intermediate file: upload_file_1.zip
  00:00:22 STEP   49 H=  49:00 +CPU= 16.456
  00:00:44 STEP   50 H=  50:00 +CPU= 16.453
forrtl: severe (41): insufficient virtual memory
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001D2B9CB  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000012BCFF6  radintg_                  935  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net