climateprediction.net home page
Task 22246009

Task 22246009

Name oifs_43r3_ps_0975_2021050100_123_945_12164064_0
Workunit 12164064
Created 28 Nov 2022, 21:40:46 UTC
Sent 28 Nov 2022, 22:00:17 UTC
Report deadline 28 Dec 2022, 22:00:17 UTC
Received 14 Dec 2022, 19:38:45 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1520573
Run time 30 min 57 sec
CPU time 22 min 53 sec
Validate state Invalid
Credit 241.92
Device peak FLOPS 5.86 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.01
x86_64-pc-linux-gnu
Peak working set size 4,020.17 MB
Peak swap size 4,974.11 MB
Peak disk usage 1,206.63 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0975
(argv4) batchid: 945
(argv5) wuid: 12164064
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_fd54093fe11326b4599f12832f523691 to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0975_2021050100_123_945_12164064.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0975_2021050100_123_945_12164064.zip
ic_ancil_file: ic_ancil_12164064
ifsdata_file: ifsdata_12164064
climate_data_file: clim_data_12164064
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from: ../../projects/climateprediction.net/jf_43854f33bbd5e4731ac504454f342a2c to: /var/lib/boinc-client/slots/4/ic_ancil_12164064.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12164064.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e29f13d6549e87375329a9e930608a88 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12164064.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12164064.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12164064.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12164064.zip
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0975_2021050100_123_945_12164064_0_r849075427
The child process has been launched with process id: 312696
Executing the command: /var/lib/boinc-client/slots/4/./master.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:B14:1:1:312696:312696] [20221214:184640:1671040000:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  18:47:12 STEP    0 H=   0:00 +CPU= 29.698
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000000
  18:47:32 STEP    1 H=   1:00 +CPU= 20.461
  18:47:54 STEP    2 H=   2:00 +CPU= 17.420
  18:48:24 STEP    3 H=   3:00 +CPU= 26.777
  18:48:42 STEP    4 H=   4:00 +CPU= 17.636
  18:55:42 STEP    5 H=   5:00 +CPU= 16.869
  18:56:08 STEP    6 H=   6:00 +CPU= 25.128
  18:56:24 STEP    7 H=   7:00 +CPU= 15.528
  18:56:40 STEP    8 H=   8:00 +CPU= 15.999
  18:57:05 STEP    9 H=   9:00 +CPU= 24.585
  18:57:22 STEP   10 H=  10:00 +CPU= 17.015
  18:57:39 STEP   11 H=  11:00 +CPU= 16.981
  18:58:10 STEP   12 H=  12:00 +CPU= 29.899
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000012
  19:02:17 STEP   13 H=  13:00 +CPU= 18.535
  19:02:41 STEP   14 H=  14:00 +CPU= 17.846
  19:03:11 STEP   15 H=  15:00 +CPU= 26.647
  19:03:31 STEP   16 H=  16:00 +CPU= 17.651
  19:03:48 STEP   17 H=  17:00 +CPU= 17.218
  19:04:16 STEP   18 H=  18:00 +CPU= 27.296
  19:04:33 STEP   19 H=  19:00 +CPU= 17.277
  19:04:51 STEP   20 H=  20:00 +CPU= 17.753
  19:05:18 STEP   21 H=  21:00 +CPU= 26.844
  19:05:36 STEP   22 H=  22:00 +CPU= 17.834
  19:05:55 STEP   23 H=  23:00 +CPU= 17.289
  19:06:44 STEP   24 H=  24:00 +CPU= 30.947
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMGGhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMSHhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMUAhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMGGhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMSHhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMUAhpi1+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0975_2021050100_123_945_12164064_0_r849075427_0.zip
Uploading the intermediate file: upload_file_0.zip
  19:07:03 STEP   25 H=  25:00 +CPU= 17.179
Uploading trickle at timestep: 86400
  19:07:21 STEP   26 H=  26:00 +CPU= 17.511
  19:08:11 STEP   27 H=  27:00 +CPU= 24.797
  19:08:27 STEP   28 H=  28:00 +CPU= 15.930
  19:08:43 STEP   29 H=  29:00 +CPU= 15.462
  19:09:08 STEP   30 H=  30:00 +CPU= 24.934
  19:09:23 STEP   31 H=  31:00 +CPU= 15.554
  19:09:41 STEP   32 H=  32:00 +CPU= 17.531
  19:10:08 STEP   33 H=  33:00 +CPU= 26.831
  19:10:47 STEP   34 H=  34:00 +CPU= 18.217
  19:11:26 STEP   35 H=  35:00 +CPU= 17.112
  19:12:20 STEP   36 H=  36:00 +CPU= 29.614
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000036
  19:12:46 STEP   37 H=  37:00 +CPU= 17.078
  19:13:08 STEP   38 H=  38:00 +CPU= 17.569
  19:13:42 STEP   39 H=  39:00 +CPU= 26.937
  19:14:00 STEP   40 H=  40:00 +CPU= 17.833
  19:14:18 STEP   41 H=  41:00 +CPU= 17.373
  19:14:45 STEP   42 H=  42:00 +CPU= 27.262
  19:15:03 STEP   43 H=  43:00 +CPU= 17.253
  19:15:21 STEP   44 H=  44:00 +CPU= 17.710
  19:15:48 STEP   45 H=  45:00 +CPU= 26.681
  19:16:06 STEP   46 H=  46:00 +CPU= 17.783
  19:16:25 STEP   47 H=  47:00 +CPU= 17.829
  19:17:10 STEP   48 H=  48:00 +CPU= 31.626
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMGGhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMSHhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMGGhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMSHhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164064/ICMUAhpi1+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0975_2021050100_123_945_12164064_0_r849075427_1.zip
Uploading the intermediate file: upload_file_1.zip
  19:17:50 STEP   49 H=  49:00 +CPU= 16.239
Uploading trickle at timestep: 172800
  19:37:13 STEP   50 H=  50:00 +CPU= 17.263
  19:37:39 STEP   51 H=  51:00 +CPU= 24.519
  19:37:55 STEP   52 H=  52:00 +CPU= 16.027
  19:38:10 STEP   53 H=  53:00 +CPU= 15.487
  19:38:39 STEP   54 H=  54:00 +CPU= 25.123
  19:38:55 STEP   55 H=  55:00 +CPU= 15.379
  19:39:14 STEP   56 H=  56:00 +CPU= 17.799
  19:39:43 STEP   57 H=  57:00 +CPU= 27.023
  19:40:33 STEP   58 H=  58:00 +CPU= 18.318
  19:40:57 STEP   59 H=  59:00 +CPU= 16.551
  19:41:59 STEP   60 H=  60:00 +CPU= 29.356
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000060
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000060
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000060
  19:42:41 STEP   61 H=  61:00 +CPU= 17.547
  19:42:59 STEP   62 H=  62:00 +CPU= 17.811
  19:43:30 STEP   63 H=  63:00 +CPU= 26.932
  19:43:48 STEP   64 H=  64:00 +CPU= 17.913
  19:44:05 STEP   65 H=  65:00 +CPU= 17.247
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:42:51 1520573 22246009 oifs_43r3_ps_0975_2021050100_123_945_12164064_0 172,800 1,027 0.0059
09 May 2023 15:42:51 1520573 22246009 oifs_43r3_ps_0975_2021050100_123_945_12164064_0 86,400 534 0.0062


©2024 climateprediction.net