climateprediction.net home page
Task 22248057

Task 22248057

Name oifs_43r3_ps_2933_2021050100_123_947_12166022_0
Workunit 12166022
Created 29 Nov 2022, 15:14:12 UTC
Sent 29 Nov 2022, 15:20:52 UTC
Report deadline 29 Dec 2022, 15:20:52 UTC
Received 13 Dec 2022, 8:41:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1531247
Run time 43 min 33 sec
CPU time 41 min 28 sec
Validate state Invalid
Credit 241.92
Device peak FLOPS 3.13 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.01
x86_64-pc-linux-gnu
Peak working set size 4,355.70 MB
Peak swap size 4,974.32 MB
Peak disk usage 1,214.52 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 2933
(argv4) batchid: 947
(argv5) wuid: 12166022
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/25
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/25/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/25/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_4f80c87ca93c63948ebd159cd3b5db84 to: /var/lib/boinc-client/slots/25/oifs_43r3_ps_2933_2021050100_123_947_12166022.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/25/oifs_43r3_ps_2933_2021050100_123_947_12166022.zip
ic_ancil_file: ic_ancil_12166022
ifsdata_file: ifsdata_12166022
climate_data_file: clim_data_12166022
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from: ../../projects/climateprediction.net/jf_e558d85f96c7b21b581dca32b001a7db to: /var/lib/boinc-client/slots/25/ic_ancil_12166022.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/25/ic_ancil_12166022.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_ada5b55516d757b23a71849a2604fb43 to: /var/lib/boinc-client/slots/25/ifsdata/ifsdata_12166022.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/25/ifsdata/ifsdata_12166022.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/25/159l_2/clim_data_12166022.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/25/159l_2/clim_data_12166022.zip
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_2933_2021050100_123_947_12166022_0_r1838402923
The child process has been launched with process id: 318125
Executing the command: /var/lib/boinc-client/slots/25/./master.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:B34:1:1:318125:318125] [20221213:065654:1670911014:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:58:06 STEP    0 H=   0:00 +CPU= 68.364
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAhpi1+000000
  06:58:54 STEP    1 H=   1:00 +CPU= 47.649
  06:59:46 STEP    2 H=   2:00 +CPU= 46.612
  07:01:09 STEP    3 H=   3:00 +CPU= 63.697
  07:01:49 STEP    4 H=   4:00 +CPU= 39.856
  07:02:28 STEP    5 H=   5:00 +CPU= 39.344
  07:03:40 STEP    6 H=   6:00 +CPU= 65.778
  07:04:56 STEP    7 H=   7:00 +CPU= 48.865
  07:05:36 STEP    8 H=   8:00 +CPU= 39.878
  07:06:36 STEP    9 H=   9:00 +CPU= 60.060
  07:07:23 STEP   10 H=  10:00 +CPU= 40.282
  07:08:04 STEP   11 H=  11:00 +CPU= 40.532
  07:09:38 STEP   12 H=  12:00 +CPU= 74.850
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAhpi1+000012
  07:10:16 STEP   13 H=  13:00 +CPU= 37.760
  07:10:52 STEP   14 H=  14:00 +CPU= 35.803
  07:11:53 STEP   15 H=  15:00 +CPU= 60.546
  07:12:36 STEP   16 H=  16:00 +CPU= 43.258
  07:13:28 STEP   17 H=  17:00 +CPU= 38.934
  07:14:31 STEP   18 H=  18:00 +CPU= 62.012
  07:15:08 STEP   19 H=  19:00 +CPU= 37.084
  07:16:11 STEP   20 H=  20:00 +CPU= 43.206
  07:17:07 STEP   21 H=  21:00 +CPU= 55.944
  07:17:47 STEP   22 H=  22:00 +CPU= 40.338
  07:18:37 STEP   23 H=  23:00 +CPU= 42.329
  07:19:51 STEP   24 H=  24:00 +CPU= 72.896
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMGGhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMSHhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMUAhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMGGhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMSHhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMUAhpi1+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2933_2021050100_123_947_12166022_0_r1838402923_0.zip
Uploading the intermediate file: upload_file_0.zip
Uploading trickle at timestep: 86400
  07:20:35 STEP   25 H=  25:00 +CPU= 39.731
  07:21:12 STEP   26 H=  26:00 +CPU= 37.689
  07:22:21 STEP   27 H=  27:00 +CPU= 59.419
  07:22:58 STEP   28 H=  28:00 +CPU= 36.559
  07:23:37 STEP   29 H=  29:00 +CPU= 39.415
  07:24:43 STEP   30 H=  30:00 +CPU= 63.033
  07:25:22 STEP   31 H=  31:00 +CPU= 38.348
  07:27:06 STEP   32 H=  32:00 +CPU= 58.449
  07:28:09 STEP   33 H=  33:00 +CPU= 62.584
  07:28:52 STEP   34 H=  34:00 +CPU= 41.130
  07:29:36 STEP   35 H=  35:00 +CPU= 41.903
  07:30:52 STEP   36 H=  36:00 +CPU= 73.169
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAhpi1+000036
  07:31:34 STEP   37 H=  37:00 +CPU= 41.563
  07:33:21 STEP   38 H=  38:00 +CPU= 62.297
  07:34:22 STEP   39 H=  39:00 +CPU= 60.172
  07:35:03 STEP   40 H=  40:00 +CPU= 39.677
  07:36:13 STEP   41 H=  41:00 +CPU= 43.546
  07:37:14 STEP   42 H=  42:00 +CPU= 60.097
  07:37:50 STEP   43 H=  43:00 +CPU= 36.578
  07:38:29 STEP   44 H=  44:00 +CPU= 38.658
  07:39:37 STEP   45 H=  45:00 +CPU= 61.220
  07:40:13 STEP   46 H=  46:00 +CPU= 36.750
  07:40:55 STEP   47 H=  47:00 +CPU= 41.343
  07:42:19 STEP   48 H=  48:00 +CPU= 75.318
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAhpi1+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMGGhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMSHhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMGGhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMSHhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166022/ICMUAhpi1+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2933_2021050100_123_947_12166022_0_r1838402923_1.zip
Uploading the intermediate file: upload_file_1.zip
Uploading trickle at timestep: 172800
  07:42:59 STEP   49 H=  49:00 +CPU= 39.829
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:41:38 1531247 22248057 oifs_43r3_ps_2933_2021050100_123_947_12166022_0 172,800 2,446 0.0142
09 May 2023 15:41:32 1531247 22248057 oifs_43r3_ps_2933_2021050100_123_947_12166022_0 86,400 1,249 0.0145


©2024 climateprediction.net