climateprediction.net home page
Task 22444066

Task 22444066

Name oifs_43r3_bl_a1nm_2016092300_20_1018_12290473_0
Workunit 12290473
Created 12 Jun 2024, 23:03:58 UTC
Sent 14 Jun 2024, 5:10:34 UTC
Report deadline 13 Aug 2024, 5:10:34 UTC
Received 14 Jun 2024, 23:16:06 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1499708
Run time 10 hours 34 min 41 sec
CPU time 10 hours 34 min 41 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 6.74 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,488.27 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,356.51 MB
Stderr
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
ving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001488
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001488
  20:50:41 STEP 1489 H= 372:15 +CPU= 16.767
  20:50:59 STEP 1490 H= 372:30 +CPU= 16.744
  20:51:17 STEP 1491 H= 372:45 +CPU= 16.725
  20:51:35 STEP 1492 H= 373:00 +CPU= 17.324
  20:51:53 STEP 1493 H= 373:15 +CPU= 16.668
  20:52:11 STEP 1494 H= 373:30 +CPU= 16.738
  20:52:29 STEP 1495 H= 373:45 +CPU= 16.676
  20:52:48 STEP 1496 H= 374:00 +CPU= 17.322
  20:53:06 STEP 1497 H= 374:15 +CPU= 16.730
  20:53:23 STEP 1498 H= 374:30 +CPU= 16.711
  20:53:40 STEP 1499 H= 374:45 +CPU= 16.624
  20:54:02 STEP 1500 H= 375:00 +CPU= 21.553
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001500
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001500
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001500
  20:54:19 STEP 1501 H= 375:15 +CPU= 16.604
  20:54:35 STEP 1502 H= 375:30 +CPU= 16.509
  20:54:52 STEP 1503 H= 375:45 +CPU= 16.534
  20:55:09 STEP 1504 H= 376:00 +CPU= 17.052
  20:55:26 STEP 1505 H= 376:15 +CPU= 16.700
  20:55:43 STEP 1506 H= 376:30 +CPU= 16.631
  20:56:00 STEP 1507 H= 376:45 +CPU= 16.453
  20:56:17 STEP 1508 H= 377:00 +CPU= 17.093
  20:56:34 STEP 1509 H= 377:15 +CPU= 16.707
  20:56:50 STEP 1510 H= 377:30 +CPU= 16.596
  20:57:07 STEP 1511 H= 377:45 +CPU= 16.692
  20:57:29 STEP 1512 H= 378:00 +CPU= 21.420
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001512
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001512
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001512
  20:57:46 STEP 1513 H= 378:15 +CPU= 16.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:58:23 STEP 1514 H= 378:30 +CPU= 16.181
  20:58:40 STEP 1515 H= 378:45 +CPU= 16.488
  20:58:57 STEP 1516 H= 379:00 +CPU= 17.119
  20:59:14 STEP 1517 H= 379:15 +CPU= 16.504
  20:59:30 STEP 1518 H= 379:30 +CPU= 16.501
  20:59:47 STEP 1519 H= 379:45 +CPU= 16.405
  21:00:04 STEP 1520 H= 380:00 +CPU= 17.086
  21:00:21 STEP 1521 H= 380:15 +CPU= 16.522
  21:00:38 STEP 1522 H= 380:30 +CPU= 16.659
  21:00:54 STEP 1523 H= 380:45 +CPU= 16.645
  21:01:16 STEP 1524 H= 381:00 +CPU= 21.317
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001524
  21:01:32 STEP 1525 H= 381:15 +CPU= 16.598
  21:01:49 STEP 1526 H= 381:30 +CPU= 16.502
  21:02:06 STEP 1527 H= 381:45 +CPU= 16.610
  21:02:23 STEP 1528 H= 382:00 +CPU= 16.964
  21:02:40 STEP 1529 H= 382:15 +CPU= 16.533
  21:02:56 STEP 1530 H= 382:30 +CPU= 16.644
  21:03:13 STEP 1531 H= 382:45 +CPU= 16.659
  21:03:31 STEP 1532 H= 383:00 +CPU= 17.157
  21:03:47 STEP 1533 H= 383:15 +CPU= 16.514
  21:04:04 STEP 1534 H= 383:30 +CPU= 16.575
  21:04:21 STEP 1535 H= 383:45 +CPU= 16.570
  21:04:45 STEP 1536 H= 384:00 +CPU= 23.257
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1nm_2016092300_20_1018_12290473_0_r511739699_15.zip
Uploading the intermediate file: upload_file_15.zip
  21:05:02 STEP 1537 H= 384:15 +CPU= 16.617
  21:05:18 STEP 1538 H= 384:30 +CPU= 16.516
  21:05:35 STEP 1539 H= 384:45 +CPU= 16.543
  21:05:53 STEP 1540 H= 385:00 +CPU= 17.075
Quit request received from BOINC client, ending the child process
>>> Printing last 70 lines from file: NODE.001_01

 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.228481371404544E-07 0.000000000000000E+00 0.176208989359009E-06
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.131136846000866E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.723164568217758E-13 0.000000000000000E+00 0.833578314362251E-08
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.962795390326973E-10 0.000000000000000E+00 0.971222157937411E-09
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.213228309362229E-01 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =  1536 STEPO   F00000000
 CREATE RESTART FILE ./srf00160000.0001                                                                                                                                                                                                                                              
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./srf00160000.0001 MODE=w
 IO-STREAM CLOSED - ./srf00160000.0001
 MPI-TASK:   1 - ************ BYTES IN     46 RECORDS TRANSFERRED IN    1.3423 SECONDS******** Mbytes/s, TOTAL TIME=    1.6019(83.8%)
 CREATE RESTART CONTROL FILE ./rcf                                                                                                                   
 WRRESF: DELETED PREVIOUS RESTART FILE OK: ./srf00151200.0001
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1536 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001536 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+001536
 MPI-TASK:   1 -   1286016612 BYTES IN      6 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0069( 2.9%)
 NSTEP =  1536 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+001536 MODE=w
 IO-STREAM CLOSED - ./ICMSHh7zg+001536
 MPI-TASK:   1 -    707399250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0067 SECONDS105582.0 Mbytes/s, TOTAL TIME=    0.1995( 3.4%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001536 MODE=w
 IO-STREAM CLOSED - ./ICMUAh7zg+001536
 MPI-TASK:   1 -  20576265792 BYTES IN    125 RECORDS TRANSFERRED IN    0.0026 SECONDS******** Mbytes/s, TOTAL TIME=    0.1064( 2.4%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001536 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001536
 MPI-TASK:   1 -           10 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS     0.1 Mbytes/s, TOTAL TIME=    0.0029( 3.4%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001536 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001536
 MPI-TASK:   1 -   1277436883 BYTES IN      4 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0049( 4.1%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =  1536 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1536 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001536 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001536
 MPI-TASK:   1 -   1286016612 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS******** Mbytes/s, TOTAL TIME=    0.0076( 5.3%)
 21:04:45 STEP 1536 H= 384:00 +CPU= 23.257
 NSTEP =  1537 STEPO   0AAA00AAA
 21:05:02 STEP 1537 H= 384:15 +CPU= 16.617
 NSTEP =  1538 STEPO   0AAA00AAA
 21:05:18 STEP 1538 H= 384:30 +CPU= 16.516
 NSTEP =  1539 STEPO   0AAA00AAA
 21:05:35 STEP 1539 H= 384:45 +CPU= 16.543
ISTEP=    1540 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=    1540 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =  1540 STEPO   0AAA00AAA
 21:05:53 STEP 1540 H= 385:00 +CPU= 17.075
 NSTEP =  1541 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 21:04:27 FULLPOS-T DYNFPOS   1536     0.444    0.444    0.444     84:55     91:42 0.27377995539666E-07       2GB       0MB
 21:04:27 0AAA00AAA STEPO     1536     0.443    0.443    0.447     84:56     91:42 0.27377995539666E-07       2GB       0MB
 21:04:45 0AAA00AAA STEPO     1537    17.205   17.205   17.420     85:13     92:00 0.27377995539666E-07       2GB       0MB
 21:05:02 0AAA00AAA STEPO     1538    16.617   16.617   17.184     85:29     92:17 0.27377995539666E-07       2GB       0MB
 21:05:18 0AAA00AAA STEPO     1539    16.516   16.516   16.631     85:46     92:33 0.27377995539666E-07       2GB       0MB
 21:05:35 0AAA00AAA STEPO     1540    16.543   16.543   16.595     86:02     92:50 0.27377995539666E-07       2GB       0MB
 21:05:53 0AAA00AAA STEPO     1541    17.075   17.075   17.967     86:20     93:08 0.27377995539666E-07       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "    1536",
 CTIME   = "00160000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,        1524, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/22/progress_file_12290473.xml

<running_values>
  <last_cpu_time>31289.420000</last_cpu_time>
  <upload_file_number>16</upload_file_number>
  <last_iter>1541</last_iter>
  <last_upload>1382400</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1nm
(argv4) batchid: 1018
(argv5) wuid: 12290473
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/22
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/22/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/22/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_fc643555d4b3693a1c265c6c2a320e27 to: /var/lib/boinc/slots/22/oifs_43r3_bl_a1nm_2016092300_20_1018_12290473.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/22/oifs_43r3_bl_a1nm_2016092300_20_1018_12290473.zip
ic_ancil_file: ic_ancil_12290473
ifsdata_file: ifsdata_12290473
climate_data_file: clim_data_12290473
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/22/ic_ancil_12290473.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/22/ic_ancil_12290473.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_ff4a07b13a9f00fbe1694bd4fa348f34 to: /var/lib/boinc/slots/22/ifsdata/ifsdata_12290473.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/22/ifsdata/ifsdata_12290473.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/22/159l_2/clim_data_12290473.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/22/159l_2/clim_data_12290473.zip
Checking for progress XML file: /var/lib/boinc/slots/22/progress_file_12290473.xml
Opened progress file ok : /var/lib/boinc/slots/22/progress_file_12290473.xml
-- Model is restarting --
Adjusting last_iter, 1541, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/22/progress_file_12290473.xml
last_cpu_time: 31289
upload_file_number: 16
last_iter: 1537
last_upload: 1382400
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1nm_2016092300_20_1018_12290473_0_r511739699
The child process has been launched with process id: 11127
Executing the command: /var/lib/boinc/slots/22/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:11127:11127] [20240614:221130:1718395890:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  22:11:47 STEP 1536 H= 384:00 +CPU= 15.342
  22:12:04 STEP 1537 H= 384:15 +CPU= 16.967
  22:12:22 STEP 1538 H= 384:30 +CPU= 17.395
  22:12:39 STEP 1539 H= 384:45 +CPU= 17.193
  22:12:57 STEP 1540 H= 385:00 +CPU= 17.788
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:13:35 STEP 1541 H= 385:15 +CPU= 16.171
  22:13:52 STEP 1542 H= 385:30 +CPU= 16.873
  22:14:09 STEP 1543 H= 385:45 +CPU= 17.257
  22:14:27 STEP 1544 H= 386:00 +CPU= 17.751
  22:14:44 STEP 1545 H= 386:15 +CPU= 17.257
  22:15:02 STEP 1546 H= 386:30 +CPU= 17.226
  22:15:19 STEP 1547 H= 386:45 +CPU= 17.217
  22:15:41 STEP 1548 H= 387:00 +CPU= 21.886
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001548
  22:15:59 STEP 1549 H= 387:15 +CPU= 17.099
  22:16:16 STEP 1550 H= 387:30 +CPU= 17.139
  22:16:34 STEP 1551 H= 387:45 +CPU= 17.159
  22:16:52 STEP 1552 H= 388:00 +CPU= 17.660
  22:17:10 STEP 1553 H= 388:15 +CPU= 17.311
  22:17:29 STEP 1554 H= 388:30 +CPU= 17.299
  22:17:47 STEP 1555 H= 388:45 +CPU= 17.395
  22:18:06 STEP 1556 H= 389:00 +CPU= 17.841
  22:18:25 STEP 1557 H= 389:15 +CPU= 17.315
  22:18:43 STEP 1558 H= 389:30 +CPU= 17.267
  22:19:01 STEP 1559 H= 389:45 +CPU= 17.330
  22:19:25 STEP 1560 H= 390:00 +CPU= 22.161
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001560
  22:19:43 STEP 1561 H= 390:15 +CPU= 17.180
  22:20:01 STEP 1562 H= 390:30 +CPU= 17.160
  22:20:19 STEP 1563 H= 390:45 +CPU= 17.251
  22:20:38 STEP 1564 H= 391:00 +CPU= 17.877
  22:20:57 STEP 1565 H= 391:15 +CPU= 17.357
  22:21:15 STEP 1566 H= 391:30 +CPU= 17.303
  22:21:34 STEP 1567 H= 391:45 +CPU= 17.298
  22:21:53 STEP 1568 H= 392:00 +CPU= 17.810
  22:22:12 STEP 1569 H= 392:15 +CPU= 17.350
  22:22:30 STEP 1570 H= 392:30 +CPU= 17.243
  22:22:48 STEP 1571 H= 392:45 +CPU= 17.327
  22:23:12 STEP 1572 H= 393:00 +CPU= 21.987
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001572
  22:23:30 STEP 1573 H= 393:15 +CPU= 17.181
  22:23:49 STEP 1574 H= 393:30 +CPU= 17.098
  22:24:09 STEP 1575 H= 393:45 +CPU= 17.406
  22:24:28 STEP 1576 H= 394:00 +CPU= 17.794
  22:24:46 STEP 1577 H= 394:15 +CPU= 17.209
  22:25:05 STEP 1578 H= 394:30 +CPU= 17.261
  22:25:24 STEP 1579 H= 394:45 +CPU= 17.326
  22:25:44 STEP 1580 H= 395:00 +CPU= 17.877
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:26:23 STEP 1581 H= 395:15 +CPU= 17.134
  22:26:41 STEP 1582 H= 395:30 +CPU= 17.270
  22:27:00 STEP 1583 H= 395:45 +CPU= 17.154
  22:27:25 STEP 1584 H= 396:00 +CPU= 23.772
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001584
  22:27:43 STEP 1585 H= 396:15 +CPU= 17.175
  22:28:01 STEP 1586 H= 396:30 +CPU= 17.218
  22:28:19 STEP 1587 H= 396:45 +CPU= 17.120
  22:28:38 STEP 1588 H= 397:00 +CPU= 17.541
  22:28:56 STEP 1589 H= 397:15 +CPU= 17.021
  22:29:14 STEP 1590 H= 397:30 +CPU= 17.073
  22:29:33 STEP 1591 H= 397:45 +CPU= 17.178
  22:29:52 STEP 1592 H= 398:00 +CPU= 17.723
  22:30:10 STEP 1593 H= 398:15 +CPU= 17.002
  22:30:28 STEP 1594 H= 398:30 +CPU= 17.109
  22:30:46 STEP 1595 H= 398:45 +CPU= 17.199
  22:31:10 STEP 1596 H= 399:00 +CPU= 22.006
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001596
  22:31:28 STEP 1597 H= 399:15 +CPU= 17.188
  22:31:47 STEP 1598 H= 399:30 +CPU= 17.092
  22:32:05 STEP 1599 H= 399:45 +CPU= 17.193
  22:32:24 STEP 1600 H= 400:00 +CPU= 17.633
  22:32:43 STEP 1601 H= 400:15 +CPU= 17.067
  22:33:00 STEP 1602 H= 400:30 +CPU= 17.122
  22:33:18 STEP 1603 H= 400:45 +CPU= 17.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:33:56 STEP 1604 H= 401:00 +CPU= 17.673
  22:34:14 STEP 1605 H= 401:15 +CPU= 17.355
  22:34:32 STEP 1606 H= 401:30 +CPU= 17.369
  22:34:50 STEP 1607 H= 401:45 +CPU= 17.289
  22:35:12 STEP 1608 H= 402:00 +CPU= 22.101
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001608
  22:35:30 STEP 1609 H= 402:15 +CPU= 17.280
  22:35:47 STEP 1610 H= 402:30 +CPU= 17.384
  22:36:05 STEP 1611 H= 402:45 +CPU= 17.363
  22:36:23 STEP 1612 H= 403:00 +CPU= 17.806
  22:36:40 STEP 1613 H= 403:15 +CPU= 17.236
  22:36:58 STEP 1614 H= 403:30 +CPU= 17.373
  22:37:15 STEP 1615 H= 403:45 +CPU= 17.200
  22:37:33 STEP 1616 H= 404:00 +CPU= 17.872
  22:37:51 STEP 1617 H= 404:15 +CPU= 17.397
  22:38:09 STEP 1618 H= 404:30 +CPU= 17.461
  22:38:27 STEP 1619 H= 404:45 +CPU= 17.517
  22:38:49 STEP 1620 H= 405:00 +CPU= 22.137
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001620
  22:39:07 STEP 1621 H= 405:15 +CPU= 17.254
  22:39:24 STEP 1622 H= 405:30 +CPU= 17.169
  22:39:41 STEP 1623 H= 405:45 +CPU= 17.246
  22:40:00 STEP 1624 H= 406:00 +CPU= 17.966
  22:40:17 STEP 1625 H= 406:15 +CPU= 17.379
  22:40:35 STEP 1626 H= 406:30 +CPU= 17.289
  22:40:52 STEP 1627 H= 406:45 +CPU= 17.291
  22:41:11 STEP 1628 H= 407:00 +CPU= 17.869
  22:41:28 STEP 1629 H= 407:15 +CPU= 17.360
  22:41:46 STEP 1630 H= 407:30 +CPU= 17.251
  22:42:03 STEP 1631 H= 407:45 +CPU= 17.350
  22:42:28 STEP 1632 H= 408:00 +CPU= 24.136
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1nm_2016092300_20_1018_12290473_0_r511739699_16.zip
Uploading the intermediate file: upload_file_16.zip
  22:42:46 STEP 1633 H= 408:15 +CPU= 17.264
  22:43:03 STEP 1634 H= 408:30 +CPU= 17.255
  22:43:21 STEP 1635 H= 408:45 +CPU= 17.230
  22:43:38 STEP 1636 H= 409:00 +CPU= 17.788
  22:43:56 STEP 1637 H= 409:15 +CPU= 17.285
  22:44:14 STEP 1638 H= 409:30 +CPU= 17.288
  22:44:31 STEP 1639 H= 409:45 +CPU= 17.365
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:45:10 STEP 1640 H= 410:00 +CPU= 17.220
  22:45:27 STEP 1641 H= 410:15 +CPU= 17.180
  22:45:45 STEP 1642 H= 410:30 +CPU= 17.179
  22:46:02 STEP 1643 H= 410:45 +CPU= 17.196
  22:46:25 STEP 1644 H= 411:00 +CPU= 21.985
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001644
  22:46:42 STEP 1645 H= 411:15 +CPU= 17.270
  22:47:00 STEP 1646 H= 411:30 +CPU= 17.402
  22:47:18 STEP 1647 H= 411:45 +CPU= 17.356
  22:47:36 STEP 1648 H= 412:00 +CPU= 17.780
  22:47:53 STEP 1649 H= 412:15 +CPU= 17.378
  22:48:11 STEP 1650 H= 412:30 +CPU= 17.263
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:48:50 STEP 1651 H= 412:45 +CPU= 17.098
  22:49:08 STEP 1652 H= 413:00 +CPU= 17.934
  22:49:25 STEP 1653 H= 413:15 +CPU= 17.311
  22:49:43 STEP 1654 H= 413:30 +CPU= 17.397
  22:50:01 STEP 1655 H= 413:45 +CPU= 17.546
  22:50:23 STEP 1656 H= 414:00 +CPU= 22.382
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001656
  22:50:41 STEP 1657 H= 414:15 +CPU= 17.405
  22:50:59 STEP 1658 H= 414:30 +CPU= 17.537
  22:51:17 STEP 1659 H= 414:45 +CPU= 17.411
  22:51:35 STEP 1660 H= 415:00 +CPU= 17.842
  22:51:53 STEP 1661 H= 415:15 +CPU= 17.281
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:52:32 STEP 1662 H= 415:30 +CPU= 16.968
  22:52:49 STEP 1663 H= 415:45 +CPU= 17.389
  22:53:08 STEP 1664 H= 416:00 +CPU= 17.884
  22:53:25 STEP 1665 H= 416:15 +CPU= 17.079
  22:53:42 STEP 1666 H= 416:30 +CPU= 16.767
  22:53:59 STEP 1667 H= 416:45 +CPU= 17.071
  22:54:22 STEP 1668 H= 417:00 +CPU= 21.976
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001668
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:55:00 STEP 1669 H= 417:15 +CPU= 16.945
  22:55:18 STEP 1670 H= 417:30 +CPU= 17.126
  22:55:35 STEP 1671 H= 417:45 +CPU= 17.140
  22:55:53 STEP 1672 H= 418:00 +CPU= 17.632
  22:56:11 STEP 1673 H= 418:15 +CPU= 17.249
  22:56:29 STEP 1674 H= 418:30 +CPU= 17.531
  22:56:47 STEP 1675 H= 418:45 +CPU= 17.065
  22:57:05 STEP 1676 H= 419:00 +CPU= 17.729
  22:57:23 STEP 1677 H= 419:15 +CPU= 17.670
  22:57:40 STEP 1678 H= 419:30 +CPU= 17.598
  22:57:58 STEP 1679 H= 419:45 +CPU= 17.637
  22:58:22 STEP 1680 H= 420:00 +CPU= 23.651
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001680
  22:58:40 STEP 1681 H= 420:15 +CPU= 17.125
  22:58:57 STEP 1682 H= 420:30 +CPU= 16.849
  22:59:15 STEP 1683 H= 420:45 +CPU= 16.972
  22:59:32 STEP 1684 H= 421:00 +CPU= 17.581
  22:59:50 STEP 1685 H= 421:15 +CPU= 17.271
  23:00:07 STEP 1686 H= 421:30 +CPU= 17.354
  23:00:25 STEP 1687 H= 421:45 +CPU= 17.405
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:01:05 STEP 1688 H= 422:00 +CPU= 17.313
  23:01:22 STEP 1689 H= 422:15 +CPU= 17.692
  23:01:40 STEP 1690 H= 422:30 +CPU= 17.647
  23:01:58 STEP 1691 H= 422:45 +CPU= 17.248
  23:02:21 STEP 1692 H= 423:00 +CPU= 22.387
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001692
  23:02:38 STEP 1693 H= 423:15 +CPU= 17.299
  23:02:56 STEP 1694 H= 423:30 +CPU= 17.526
  23:03:14 STEP 1695 H= 423:45 +CPU= 17.456
  23:03:32 STEP 1696 H= 424:00 +CPU= 17.496
  23:03:50 STEP 1697 H= 424:15 +CPU= 17.248
  23:04:07 STEP 1698 H= 424:30 +CPU= 16.993
  23:04:24 STEP 1699 H= 424:45 +CPU= 17.112
  23:04:42 STEP 1700 H= 425:00 +CPU= 18.053
  23:04:59 STEP 1701 H= 425:15 +CPU= 16.551
  23:05:16 STEP 1702 H= 425:30 +CPU= 16.863
  23:05:34 STEP 1703 H= 425:45 +CPU= 17.716
  23:05:58 STEP 1704 H= 426:00 +CPU= 23.116
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001704
  23:06:15 STEP 1705 H= 426:15 +CPU= 16.934
  23:06:33 STEP 1706 H= 426:30 +CPU= 17.235
  23:06:51 STEP 1707 H= 426:45 +CPU= 17.717
  23:07:09 STEP 1708 H= 427:00 +CPU= 17.767
  23:07:27 STEP 1709 H= 427:15 +CPU= 17.674
  23:07:45 STEP 1710 H= 427:30 +CPU= 17.609
  23:08:02 STEP 1711 H= 427:45 +CPU= 17.395
  23:08:20 STEP 1712 H= 428:00 +CPU= 17.667
  23:08:38 STEP 1713 H= 428:15 +CPU= 17.956
  23:08:56 STEP 1714 H= 428:30 +CPU= 17.683
  23:09:14 STEP 1715 H= 428:45 +CPU= 17.440
  23:09:36 STEP 1716 H= 429:00 +CPU= 21.391
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001716
  23:09:53 STEP 1717 H= 429:15 +CPU= 17.019
  23:10:11 STEP 1718 H= 429:30 +CPU= 17.254
  23:10:28 STEP 1719 H= 429:45 +CPU= 17.205
  23:10:47 STEP 1720 H= 430:00 +CPU= 18.125
  23:11:05 STEP 1721 H= 430:15 +CPU= 17.609
  23:11:23 STEP 1722 H= 430:30 +CPU= 17.372
  23:11:41 STEP 1723 H= 430:45 +CPU= 17.146
  23:11:59 STEP 1724 H= 431:00 +CPU= 17.558
  23:12:16 STEP 1725 H= 431:15 +CPU= 16.933
  23:12:33 STEP 1726 H= 431:30 +CPU= 16.795
  23:12:51 STEP 1727 H= 431:45 +CPU= 17.354
  23:13:16 STEP 1728 H= 432:00 +CPU= 24.535
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1nm_2016092300_20_1018_12290473_0_r511739699_17.zip
Uploading the intermediate file: upload_file_17.zip
  23:13:34 STEP 1729 H= 432:15 +CPU= 17.389
  23:13:51 STEP 1730 H= 432:30 +CPU= 16.956
  23:14:08 STEP 1731 H= 432:45 +CPU= 16.911
  23:14:26 STEP 1732 H= 433:00 +CPU= 17.759
  23:14:43 STEP 1733 H= 433:15 +CPU= 16.746
  23:15:01 STEP 1734 H= 433:30 +CPU= 17.050
  23:15:19 STEP 1735 H= 433:45 +CPU= 17.484
  23:15:37 STEP 1736 H= 434:00 +CPU= 18.079
  23:15:55 STEP 1737 H= 434:15 +CPU= 17.961
  23:16:13 STEP 1738 H= 434:30 +CPU= 17.338
  23:16:31 STEP 1739 H= 434:45 +CPU= 17.321
  23:16:53 STEP 1740 H= 435:00 +CPU= 22.090
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001740
  23:17:11 STEP 1741 H= 435:15 +CPU= 17.334
  23:17:29 STEP 1742 H= 435:30 +CPU= 17.294
  23:17:46 STEP 1743 H= 435:45 +CPU= 17.160
  23:18:05 STEP 1744 H= 436:00 +CPU= 18.021
  23:18:23 STEP 1745 H= 436:15 +CPU= 17.674
  23:18:41 STEP 1746 H= 436:30 +CPU= 17.579
  23:18:58 STEP 1747 H= 436:45 +CPU= 17.012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:19:37 STEP 1748 H= 437:00 +CPU= 17.113
  23:19:55 STEP 1749 H= 437:15 +CPU= 17.537
  23:20:12 STEP 1750 H= 437:30 +CPU= 17.293
  23:20:30 STEP 1751 H= 437:45 +CPU= 17.297
  23:20:53 STEP 1752 H= 438:00 +CPU= 22.360
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001752
  23:21:10 STEP 1753 H= 438:15 +CPU= 17.277
  23:21:28 STEP 1754 H= 438:30 +CPU= 17.265
  23:21:45 STEP 1755 H= 438:45 +CPU= 16.890
  23:22:03 STEP 1756 H= 439:00 +CPU= 17.605
  23:22:20 STEP 1757 H= 439:15 +CPU= 16.954
  23:22:38 STEP 1758 H= 439:30 +CPU= 16.937
  23:22:56 STEP 1759 H= 439:45 +CPU= 17.553
  23:23:14 STEP 1760 H= 440:00 +CPU= 17.729
  23:23:32 STEP 1761 H= 440:15 +CPU= 17.461
  23:23:49 STEP 1762 H= 440:30 +CPU= 17.207
  23:24:06 STEP 1763 H= 440:45 +CPU= 17.153
  23:24:30 STEP 1764 H= 441:00 +CPU= 22.114
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001764
  23:24:48 STEP 1765 H= 441:15 +CPU= 17.142
  23:25:05 STEP 1766 H= 441:30 +CPU= 16.941
  23:25:23 STEP 1767 H= 441:45 +CPU= 17.128
  23:25:41 STEP 1768 H= 442:00 +CPU= 18.123
  23:25:59 STEP 1769 H= 442:15 +CPU= 17.063
  23:26:16 STEP 1770 H= 442:30 +CPU= 16.831
  23:26:33 STEP 1771 H= 442:45 +CPU= 17.136
  23:26:52 STEP 1772 H= 443:00 +CPU= 17.958
  23:27:09 STEP 1773 H= 443:15 +CPU= 17.289
  23:27:27 STEP 1774 H= 443:30 +CPU= 17.218
  23:27:44 STEP 1775 H= 443:45 +CPU= 17.261
  23:28:09 STEP 1776 H= 444:00 +CPU= 24.285
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001776
  23:28:27 STEP 1777 H= 444:15 +CPU= 17.241
  23:28:44 STEP 1778 H= 444:30 +CPU= 16.997
  23:29:02 STEP 1779 H= 444:45 +CPU= 16.757
  23:29:19 STEP 1780 H= 445:00 +CPU= 17.573
  23:29:37 STEP 1781 H= 445:15 +CPU= 16.870
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:30:14 STEP 1782 H= 445:30 +CPU= 16.551
  23:30:31 STEP 1783 H= 445:45 +CPU= 16.542
  23:30:49 STEP 1784 H= 446:00 +CPU= 17.129
  23:31:06 STEP 1785 H= 446:15 +CPU= 16.485
  23:31:22 STEP 1786 H= 446:30 +CPU= 16.472
  23:31:39 STEP 1787 H= 446:45 +CPU= 16.500
  23:32:01 STEP 1788 H= 447:00 +CPU= 21.215
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001788
  23:32:17 STEP 1789 H= 447:15 +CPU= 16.555
  23:32:34 STEP 1790 H= 447:30 +CPU= 16.573
  23:32:51 STEP 1791 H= 447:45 +CPU= 16.578
  23:33:08 STEP 1792 H= 448:00 +CPU= 17.058
  23:33:25 STEP 1793 H= 448:15 +CPU= 16.554
  23:33:42 STEP 1794 H= 448:30 +CPU= 16.630
  23:33:59 STEP 1795 H= 448:45 +CPU= 16.674
  23:34:17 STEP 1796 H= 449:00 +CPU= 17.330
  23:34:34 STEP 1797 H= 449:15 +CPU= 17.003
  23:34:51 STEP 1798 H= 449:30 +CPU= 16.890
  23:35:09 STEP 1799 H= 449:45 +CPU= 16.923
  23:35:31 STEP 1800 H= 450:00 +CPU= 21.577
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001800
  23:35:48 STEP 1801 H= 450:15 +CPU= 16.835
  23:36:05 STEP 1802 H= 450:30 +CPU= 16.835
  23:36:22 STEP 1803 H= 450:45 +CPU= 16.652
  23:36:40 STEP 1804 H= 451:00 +CPU= 17.277
  23:36:57 STEP 1805 H= 451:15 +CPU= 16.739
  23:37:14 STEP 1806 H= 451:30 +CPU= 16.797
  23:37:31 STEP 1807 H= 451:45 +CPU= 16.725
  23:37:48 STEP 1808 H= 452:00 +CPU= 17.305
  23:38:05 STEP 1809 H= 452:15 +CPU= 16.810
  23:38:22 STEP 1810 H= 452:30 +CPU= 16.764
  23:38:39 STEP 1811 H= 452:45 +CPU= 16.914
  23:39:01 STEP 1812 H= 453:00 +CPU= 21.449
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001812
  23:39:18 STEP 1813 H= 453:15 +CPU= 16.861
  23:39:36 STEP 1814 H= 453:30 +CPU= 16.917
  23:39:53 STEP 1815 H= 453:45 +CPU= 16.849
  23:40:10 STEP 1816 H= 454:00 +CPU= 17.404
  23:40:28 STEP 1817 H= 454:15 +CPU= 16.927
  23:40:45 STEP 1818 H= 454:30 +CPU= 16.824
  23:41:02 STEP 1819 H= 454:45 +CPU= 16.843
  23:41:20 STEP 1820 H= 455:00 +CPU= 17.422
  23:41:37 STEP 1821 H= 455:15 +CPU= 17.094
  23:41:54 STEP 1822 H= 455:30 +CPU= 16.849
  23:42:12 STEP 1823 H= 455:45 +CPU= 16.865
  23:42:36 STEP 1824 H= 456:00 +CPU= 23.649
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1nm_2016092300_20_1018_12290473_0_r511739699_18.zip
  23:42:53 STEP 1825 H= 456:15 +CPU= 16.751
Uploading the intermediate file: upload_file_18.zip
  23:43:11 STEP 1826 H= 456:30 +CPU= 16.702
  23:43:28 STEP 1827 H= 456:45 +CPU= 16.810
  23:43:45 STEP 1828 H= 457:00 +CPU= 17.322
  23:44:02 STEP 1829 H= 457:15 +CPU= 16.619
  23:44:19 STEP 1830 H= 457:30 +CPU= 16.778
  23:44:36 STEP 1831 H= 457:45 +CPU= 16.806
  23:44:54 STEP 1832 H= 458:00 +CPU= 17.349
  23:45:11 STEP 1833 H= 458:15 +CPU= 16.726
  23:45:28 STEP 1834 H= 458:30 +CPU= 16.644
  23:45:45 STEP 1835 H= 458:45 +CPU= 16.964
  23:46:08 STEP 1836 H= 459:00 +CPU= 21.728
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001836
  23:46:25 STEP 1837 H= 459:15 +CPU= 17.016
  23:46:43 STEP 1838 H= 459:30 +CPU= 17.124
  23:47:00 STEP 1839 H= 459:45 +CPU= 17.017
  23:47:18 STEP 1840 H= 460:00 +CPU= 17.548
  23:47:35 STEP 1841 H= 460:15 +CPU= 17.007
  23:47:53 STEP 1842 H= 460:30 +CPU= 17.017
  23:48:10 STEP 1843 H= 460:45 +CPU= 16.890
  23:48:28 STEP 1844 H= 461:00 +CPU= 17.668
  23:48:45 STEP 1845 H= 461:15 +CPU= 16.945
  23:49:02 STEP 1846 H= 461:30 +CPU= 16.946
  23:49:19 STEP 1847 H= 461:45 +CPU= 16.842
  23:49:42 STEP 1848 H= 462:00 +CPU= 21.912
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001848
  23:49:59 STEP 1849 H= 462:15 +CPU= 17.071
  23:50:16 STEP 1850 H= 462:30 +CPU= 16.837
  23:50:33 STEP 1851 H= 462:45 +CPU= 16.825
  23:50:51 STEP 1852 H= 463:00 +CPU= 17.540
  23:51:09 STEP 1853 H= 463:15 +CPU= 16.888
  23:51:26 STEP 1854 H= 463:30 +CPU= 16.885
  23:51:43 STEP 1855 H= 463:45 +CPU= 16.964
  23:52:01 STEP 1856 H= 464:00 +CPU= 17.537
  23:52:18 STEP 1857 H= 464:15 +CPU= 16.996
  23:52:35 STEP 1858 H= 464:30 +CPU= 17.077
  23:52:53 STEP 1859 H= 464:45 +CPU= 16.989
  23:53:15 STEP 1860 H= 465:00 +CPU= 21.636
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001860
  23:53:32 STEP 1861 H= 465:15 +CPU= 16.969
  23:53:49 STEP 1862 H= 465:30 +CPU= 16.997
  23:54:07 STEP 1863 H= 465:45 +CPU= 17.081
  23:54:25 STEP 1864 H= 466:00 +CPU= 17.522
  23:54:42 STEP 1865 H= 466:15 +CPU= 16.995
  23:54:59 STEP 1866 H= 466:30 +CPU= 17.100
  23:55:17 STEP 1867 H= 466:45 +CPU= 16.952
  23:55:34 STEP 1868 H= 467:00 +CPU= 17.389
  23:55:52 STEP 1869 H= 467:15 +CPU= 16.864
  23:56:09 STEP 1870 H= 467:30 +CPU= 16.920
  23:56:26 STEP 1871 H= 467:45 +CPU= 16.996
  23:56:51 STEP 1872 H= 468:00 +CPU= 23.748
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001872
  23:57:08 STEP 1873 H= 468:15 +CPU= 17.123
  23:57:26 STEP 1874 H= 468:30 +CPU= 16.926
  23:57:43 STEP 1875 H= 468:45 +CPU= 16.985
  23:58:01 STEP 1876 H= 469:00 +CPU= 17.425
  23:58:18 STEP 1877 H= 469:15 +CPU= 16.874
  23:58:35 STEP 1878 H= 469:30 +CPU= 17.028
  23:58:52 STEP 1879 H= 469:45 +CPU= 16.812
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:59:51 STEP 1880 H= 470:00 +CPU= 16.439
  00:00:09 STEP 1881 H= 470:15 +CPU= 16.865
  00:00:26 STEP 1882 H= 470:30 +CPU= 16.975
  00:00:44 STEP 1883 H= 470:45 +CPU= 17.140
  00:01:06 STEP 1884 H= 471:00 +CPU= 21.719
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001884
  00:01:23 STEP 1885 H= 471:15 +CPU= 17.125
  00:01:41 STEP 1886 H= 471:30 +CPU= 16.999
  00:01:58 STEP 1887 H= 471:45 +CPU= 17.075
  00:02:16 STEP 1888 H= 472:00 +CPU= 17.469
  00:02:33 STEP 1889 H= 472:15 +CPU= 16.865
  00:02:50 STEP 1890 H= 472:30 +CPU= 17.184
  00:03:08 STEP 1891 H= 472:45 +CPU= 17.028
  00:03:26 STEP 1892 H= 473:00 +CPU= 17.631
  00:03:43 STEP 1893 H= 473:15 +CPU= 17.039
  00:04:00 STEP 1894 H= 473:30 +CPU= 17.023
  00:04:18 STEP 1895 H= 473:45 +CPU= 16.933
  00:04:40 STEP 1896 H= 474:00 +CPU= 21.738
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001896
  00:04:57 STEP 1897 H= 474:15 +CPU= 17.063
  00:05:15 STEP 1898 H= 474:30 +CPU= 17.101
  00:05:32 STEP 1899 H= 474:45 +CPU= 17.145
  00:05:51 STEP 1900 H= 475:00 +CPU= 17.711
  00:06:08 STEP 1901 H= 475:15 +CPU= 17.032
  00:06:26 STEP 1902 H= 475:30 +CPU= 17.076
  00:06:43 STEP 1903 H= 475:45 +CPU= 16.985
  00:07:01 STEP 1904 H= 476:00 +CPU= 17.482
  00:07:18 STEP 1905 H= 476:15 +CPU= 17.050
  00:07:36 STEP 1906 H= 476:30 +CPU= 17.143
  00:07:53 STEP 1907 H= 476:45 +CPU= 17.010
  00:08:15 STEP 1908 H= 477:00 +CPU= 21.793
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001908
  00:08:33 STEP 1909 H= 477:15 +CPU= 17.001
  00:08:50 STEP 1910 H= 477:30 +CPU= 17.005
  00:09:07 STEP 1911 H= 477:45 +CPU= 17.041
  00:09:25 STEP 1912 H= 478:00 +CPU= 17.590
  00:09:43 STEP 1913 H= 478:15 +CPU= 16.937
  00:10:00 STEP 1914 H= 478:30 +CPU= 16.912
  00:10:17 STEP 1915 H= 478:45 +CPU= 16.808
  00:10:35 STEP 1916 H= 479:00 +CPU= 17.747
  00:10:52 STEP 1917 H= 479:15 +CPU= 17.123
  00:11:10 STEP 1918 H= 479:30 +CPU= 17.046
  00:11:27 STEP 1919 H= 479:45 +CPU= 17.186
  00:11:51 STEP 1920 H= 480:00 +CPU= 22.651
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1332821428E-20      I       0.6696943850E-08      I
ICloud fractionI      0.0000000000E+00      I       0.1818260800E-01      I
I  Relat. Hum. I      0.2874425217E+00      I       0.3224884705E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.7239614382E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -   1230319204 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0090( 3.3%)
 00:11:51 STEP 1920 H= 480:00 +CPU= 22.651
 END CNT3
 NSTEP =  1920 CNT0   000000000  16.610  16.610  17.010   0.976               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        11440/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    203    0       46      1044068    11440 ************    11.9     0.7    11.2     1.0    23.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 7220639.3 7220639.3    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 7219023.7 7219023.7     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  417    2769.7    2769.7     16.00      0.00
   9 SPCM     - SPECTRAL COMP.                     384     549.2     549.2      2.92      0.00
  10 SCAN2M - PHYSICS                              385    8965.8    8965.8     47.80      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 32     480.8     480.8      0.21      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 17      25.8      25.8      0.01      0.00
  17 GRIDFPOS IN CNT4                               32      20.2      20.2      0.01      0.00
  27 RESTART FILES - WRITING                         8    1922.9    1922.9      0.21      0.00
  28 RESTART FILES - READING                         1    1362.7    1362.7      0.02      0.00
  29 SU4FPOS IN CNT4                                32       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                32    4201.7    4201.7      1.86      0.00
  31 POSDDH IN STEPO                                 2       5.2       5.2      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    385    4171.7    4171.7     22.24      0.00
  39 SU0YOMB                                         1     166.4     166.4      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    385      12.4      12.4      0.07      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              384     185.7     185.7      0.99      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              384      31.2      31.2      0.17      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 17       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      836     263.0     263.0      3.05      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       800     170.8     170.8      1.89      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        800      58.7      58.7      0.65      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       836      96.8      96.8      1.12      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      20.8      20.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            836      19.1      19.1      0.22      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            800      11.9      11.9      0.13      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            836      52.5      52.5      0.61      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            800      28.4      28.4      0.31      0.00
 400 GSTATS                                      45508       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 42288       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     7220.6 CPU TIME    6792.7 VECTOR TIME     6792.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      239.4
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/22/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc/slots/22/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc/slots/22/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc/slots/22/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/22/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12290473/ICMUAh7zg+001920
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1nm_2016092300_20_1018_12290473_0_r511739699_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
00:15:20 (11045): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jun 2024 22:14:47 1499708 22444066 oifs_43r3_bl_a1nm_2016092300_20_1018_12290473_0 1,727,100 38,081 0.0220


©2024 cpdn.org