climateprediction.net home page
Task 22447555

Task 22447555

Name oifs_43r3_bl_a4bv_2016092300_20_1018_12293938_0
Workunit 12293938
Created 13 Jun 2024, 4:08:14 UTC
Sent 14 Jun 2024, 2:36:13 UTC
Report deadline 13 Aug 2024, 2:36:13 UTC
Received 15 Jun 2024, 8:41:37 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537687
Run time 16 hours 20 min 27 sec
CPU time 16 hours 20 min 27 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 7.20 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.84 MB
Peak swap size 5,981.13 MB
Peak disk usage 1,358.59 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
prediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bv_2016092300_20_1018_12293938_0_r759307987_15.zip
Uploading the intermediate file: upload_file_15.zip
  05:01:34 STEP 1536 H= 384:00 +CPU= 25.702
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001536
  05:01:59 STEP 1537 H= 384:15 +CPU= 25.071
  05:02:25 STEP 1538 H= 384:30 +CPU= 25.738
  05:02:52 STEP 1539 H= 384:45 +CPU= 26.522
  05:03:22 STEP 1540 H= 385:00 +CPU= 29.466
  05:03:52 STEP 1541 H= 385:15 +CPU= 29.256
  05:04:21 STEP 1542 H= 385:30 +CPU= 28.958
  05:04:50 STEP 1543 H= 385:45 +CPU= 28.838
  05:05:19 STEP 1544 H= 386:00 +CPU= 29.333
  05:05:48 STEP 1545 H= 386:15 +CPU= 29.040
  05:06:17 STEP 1546 H= 386:30 +CPU= 28.609
  05:06:46 STEP 1547 H= 386:45 +CPU= 28.624
  05:07:22 STEP 1548 H= 387:00 +CPU= 35.513
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001548
  05:07:51 STEP 1549 H= 387:15 +CPU= 28.189
  05:08:21 STEP 1550 H= 387:30 +CPU= 28.723
  05:08:50 STEP 1551 H= 387:45 +CPU= 28.733
  05:09:20 STEP 1552 H= 388:00 +CPU= 29.752
  05:09:49 STEP 1553 H= 388:15 +CPU= 28.843
  05:10:18 STEP 1554 H= 388:30 +CPU= 28.570
  05:10:47 STEP 1555 H= 388:45 +CPU= 28.555
  05:11:17 STEP 1556 H= 389:00 +CPU= 29.168
  05:11:45 STEP 1557 H= 389:15 +CPU= 28.266
  05:12:06 STEP 1558 H= 389:30 +CPU= 20.933
  05:12:26 STEP 1559 H= 389:45 +CPU= 19.783
  05:12:54 STEP 1560 H= 390:00 +CPU= 28.290
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001560
  05:13:21 STEP 1561 H= 390:15 +CPU= 26.621
  05:13:47 STEP 1562 H= 390:30 +CPU= 25.776
  05:14:11 STEP 1563 H= 390:45 +CPU= 24.378
  05:14:37 STEP 1564 H= 391:00 +CPU= 25.419
  05:15:04 STEP 1565 H= 391:15 +CPU= 27.647
  05:15:34 STEP 1566 H= 391:30 +CPU= 28.698
  05:16:03 STEP 1567 H= 391:45 +CPU= 28.860
  05:16:33 STEP 1568 H= 392:00 +CPU= 29.285
  05:17:02 STEP 1569 H= 392:15 +CPU= 28.534
  05:17:31 STEP 1570 H= 392:30 +CPU= 28.879
  05:17:59 STEP 1571 H= 392:45 +CPU= 28.498
  05:18:34 STEP 1572 H= 393:00 +CPU= 34.764
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001572
  05:19:03 STEP 1573 H= 393:15 +CPU= 29.105
  05:19:32 STEP 1574 H= 393:30 +CPU= 28.828
  05:20:02 STEP 1575 H= 393:45 +CPU= 28.993
  05:20:31 STEP 1576 H= 394:00 +CPU= 28.938
  05:21:00 STEP 1577 H= 394:15 +CPU= 28.915
  05:21:29 STEP 1578 H= 394:30 +CPU= 29.131
  05:21:58 STEP 1579 H= 394:45 +CPU= 28.783
  05:22:28 STEP 1580 H= 395:00 +CPU= 29.758
  05:22:56 STEP 1581 H= 395:15 +CPU= 27.361
  05:23:17 STEP 1582 H= 395:30 +CPU= 21.457
  05:23:38 STEP 1583 H= 395:45 +CPU= 20.427
  05:24:10 STEP 1584 H= 396:00 +CPU= 32.017
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001584
  05:24:31 STEP 1585 H= 396:15 +CPU= 20.771
  05:24:54 STEP 1586 H= 396:30 +CPU= 23.291
  05:25:19 STEP 1587 H= 396:45 +CPU= 25.179
  05:25:43 STEP 1588 H= 397:00 +CPU= 23.260
  05:26:10 STEP 1589 H= 397:15 +CPU= 27.056
  05:26:40 STEP 1590 H= 397:30 +CPU= 29.162
  05:27:09 STEP 1591 H= 397:45 +CPU= 29.214
  05:27:39 STEP 1592 H= 398:00 +CPU= 29.329
  05:28:07 STEP 1593 H= 398:15 +CPU= 28.375
  05:28:37 STEP 1594 H= 398:30 +CPU= 29.202
  05:29:07 STEP 1595 H= 398:45 +CPU= 29.062
  05:29:32 STEP 1596 H= 399:00 +CPU= 24.981
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001596
  05:29:50 STEP 1597 H= 399:15 +CPU= 18.433
  05:30:08 STEP 1598 H= 399:30 +CPU= 17.591
  05:30:33 STEP 1599 H= 399:45 +CPU= 25.369
  05:30:59 STEP 1600 H= 400:00 +CPU= 25.717
  05:31:25 STEP 1601 H= 400:15 +CPU= 26.603
  05:31:52 STEP 1602 H= 400:30 +CPU= 26.310
  05:32:19 STEP 1603 H= 400:45 +CPU= 26.701
  05:32:48 STEP 1604 H= 401:00 +CPU= 29.200
  05:33:18 STEP 1605 H= 401:15 +CPU= 28.924
  05:33:47 STEP 1606 H= 401:30 +CPU= 29.000
  05:34:15 STEP 1607 H= 401:45 +CPU= 28.720
  05:34:53 STEP 1608 H= 402:00 +CPU= 35.443
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001608
  05:35:19 STEP 1609 H= 402:15 +CPU= 25.491
  05:35:39 STEP 1610 H= 402:30 +CPU= 20.873
  05:36:04 STEP 1611 H= 402:45 +CPU= 24.514
  05:36:31 STEP 1612 H= 403:00 +CPU= 26.448
  05:36:55 STEP 1613 H= 403:15 +CPU= 24.516
  05:37:18 STEP 1614 H= 403:30 +CPU= 22.971
  05:37:41 STEP 1615 H= 403:45 +CPU= 23.068
  05:38:06 STEP 1616 H= 404:00 +CPU= 24.238
  05:38:30 STEP 1617 H= 404:15 +CPU= 23.963
  05:38:56 STEP 1618 H= 404:30 +CPU= 26.132
  05:39:21 STEP 1619 H= 404:45 +CPU= 24.708
  05:39:52 STEP 1620 H= 405:00 +CPU= 31.430
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001620
  05:40:20 STEP 1621 H= 405:15 +CPU= 27.800
  05:40:50 STEP 1622 H= 405:30 +CPU= 29.052
  05:41:17 STEP 1623 H= 405:45 +CPU= 26.668
  05:41:37 STEP 1624 H= 406:00 +CPU= 20.229
  05:41:59 STEP 1625 H= 406:15 +CPU= 22.324
  05:42:20 STEP 1626 H= 406:30 +CPU= 20.496
  05:42:42 STEP 1627 H= 406:45 +CPU= 22.059
  05:43:07 STEP 1628 H= 407:00 +CPU= 24.930
  05:43:33 STEP 1629 H= 407:15 +CPU= 25.797
  05:43:58 STEP 1630 H= 407:30 +CPU= 25.008
  05:44:25 STEP 1631 H= 407:45 +CPU= 27.088
  05:45:05 STEP 1632 H= 408:00 +CPU= 39.328
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001632
  05:45:35 STEP 1633 H= 408:15 +CPU= 29.164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001632
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bv_2016092300_20_1018_12293938_0_r759307987_16.zip
Uploading the intermediate file: upload_file_16.zip
  05:46:04 STEP 1634 H= 408:30 +CPU= 28.295
  05:46:33 STEP 1635 H= 408:45 +CPU= 27.961
  05:47:03 STEP 1636 H= 409:00 +CPU= 29.066
  05:47:32 STEP 1637 H= 409:15 +CPU= 28.952
  05:47:58 STEP 1638 H= 409:30 +CPU= 25.904
  05:48:24 STEP 1639 H= 409:45 +CPU= 25.875
  05:48:47 STEP 1640 H= 410:00 +CPU= 22.936
  05:49:12 STEP 1641 H= 410:15 +CPU= 25.083
  05:49:39 STEP 1642 H= 410:30 +CPU= 26.149
  05:50:04 STEP 1643 H= 410:45 +CPU= 24.646
  05:50:35 STEP 1644 H= 411:00 +CPU= 31.716
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001644
  05:51:05 STEP 1645 H= 411:15 +CPU= 28.439
  05:51:33 STEP 1646 H= 411:30 +CPU= 28.743
  05:52:03 STEP 1647 H= 411:45 +CPU= 29.069
  05:52:34 STEP 1648 H= 412:00 +CPU= 29.741
  05:53:04 STEP 1649 H= 412:15 +CPU= 29.262
  05:53:30 STEP 1650 H= 412:30 +CPU= 26.450
  05:53:52 STEP 1651 H= 412:45 +CPU= 21.648
  05:54:13 STEP 1652 H= 413:00 +CPU= 21.283
  05:54:37 STEP 1653 H= 413:15 +CPU= 23.235
  05:55:03 STEP 1654 H= 413:30 +CPU= 25.898
  05:55:28 STEP 1655 H= 413:45 +CPU= 25.453
  05:56:00 STEP 1656 H= 414:00 +CPU= 31.531
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001656
  05:56:26 STEP 1657 H= 414:15 +CPU= 26.095
  05:56:55 STEP 1658 H= 414:30 +CPU= 28.267
  05:57:24 STEP 1659 H= 414:45 +CPU= 28.820
  05:57:55 STEP 1660 H= 415:00 +CPU= 29.893
  05:58:24 STEP 1661 H= 415:15 +CPU= 29.001
  05:58:54 STEP 1662 H= 415:30 +CPU= 28.283
  05:59:24 STEP 1663 H= 415:45 +CPU= 29.224
  05:59:50 STEP 1664 H= 416:00 +CPU= 25.782
  06:00:16 STEP 1665 H= 416:15 +CPU= 26.125
  06:00:41 STEP 1666 H= 416:30 +CPU= 25.223
  06:01:07 STEP 1667 H= 416:45 +CPU= 25.812
  06:01:39 STEP 1668 H= 417:00 +CPU= 31.307
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001668
  06:02:03 STEP 1669 H= 417:15 +CPU= 24.564
  06:02:30 STEP 1670 H= 417:30 +CPU= 26.885
  06:03:00 STEP 1671 H= 417:45 +CPU= 28.496
  06:03:30 STEP 1672 H= 418:00 +CPU= 29.738
  06:04:00 STEP 1673 H= 418:15 +CPU= 29.148
  06:04:29 STEP 1674 H= 418:30 +CPU= 29.172
  06:04:59 STEP 1675 H= 418:45 +CPU= 28.725
  06:05:29 STEP 1676 H= 419:00 +CPU= 29.886
  06:05:58 STEP 1677 H= 419:15 +CPU= 29.109
  06:06:28 STEP 1678 H= 419:30 +CPU= 29.165
  06:06:55 STEP 1679 H= 419:45 +CPU= 27.478
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4bv
(argv4) batchid: 1018
(argv5) wuid: 12293938
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/12
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/12/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/12/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8754db6999c6f67ed6911f3167e8ba59 to: /var/lib/boinc-client/slots/12/oifs_43r3_bl_a4bv_2016092300_20_1018_12293938.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/12/oifs_43r3_bl_a4bv_2016092300_20_1018_12293938.zip
ic_ancil_file: ic_ancil_12293938
ifsdata_file: ifsdata_12293938
climate_data_file: clim_data_12293938
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/12/ic_ancil_12293938.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/12/ic_ancil_12293938.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_f6a17c602de14fab29b45a51a336e204 to: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12293938.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12293938.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/12/159l_2/clim_data_12293938.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/12/159l_2/clim_data_12293938.zip
Checking for progress XML file: /var/lib/boinc-client/slots/12/progress_file_12293938.xml
Opened progress file ok : /var/lib/boinc-client/slots/12/progress_file_12293938.xml
-- Model is restarting --
Adjusting last_iter, 1680, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/12/progress_file_12293938.xml
last_cpu_time: 52216
upload_file_number: 17
last_iter: 1681
last_upload: 1469700
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a4bv_2016092300_20_1018_12293938_0_r759307987
The child process has been launched with process id: 889481
Executing the command: /var/lib/boinc-client/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:889481:889481] [20240615:060824:1718431704:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:08:55 STEP 1680 H= 420:00 +CPU= 27.493
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001680
  06:09:19 STEP 1681 H= 420:15 +CPU= 23.863
  06:09:42 STEP 1682 H= 420:30 +CPU= 22.856
  06:10:09 STEP 1683 H= 420:45 +CPU= 26.186
  06:10:38 STEP 1684 H= 421:00 +CPU= 29.381
  06:11:07 STEP 1685 H= 421:15 +CPU= 28.644
  06:11:36 STEP 1686 H= 421:30 +CPU= 28.364
  06:12:05 STEP 1687 H= 421:45 +CPU= 29.098
  06:12:35 STEP 1688 H= 422:00 +CPU= 29.404
  06:13:04 STEP 1689 H= 422:15 +CPU= 28.949
  06:13:26 STEP 1690 H= 422:30 +CPU= 22.712
  06:13:47 STEP 1691 H= 422:45 +CPU= 21.134
  06:14:14 STEP 1692 H= 423:00 +CPU= 26.288
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001692
  06:14:39 STEP 1693 H= 423:15 +CPU= 25.478
  06:15:05 STEP 1694 H= 423:30 +CPU= 25.586
  06:15:31 STEP 1695 H= 423:45 +CPU= 25.585
  06:15:56 STEP 1696 H= 424:00 +CPU= 25.469
  06:16:22 STEP 1697 H= 424:15 +CPU= 25.336
  06:16:50 STEP 1698 H= 424:30 +CPU= 28.164
  06:17:19 STEP 1699 H= 424:45 +CPU= 28.550
  06:17:49 STEP 1700 H= 425:00 +CPU= 29.580
  06:18:18 STEP 1701 H= 425:15 +CPU= 28.933
  06:18:47 STEP 1702 H= 425:30 +CPU= 28.771
  06:19:16 STEP 1703 H= 425:45 +CPU= 28.209
  06:19:53 STEP 1704 H= 426:00 +CPU= 35.604
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001704
  06:20:22 STEP 1705 H= 426:15 +CPU= 27.985
  06:20:52 STEP 1706 H= 426:30 +CPU= 28.571
  06:21:21 STEP 1707 H= 426:45 +CPU= 28.810
  06:21:51 STEP 1708 H= 427:00 +CPU= 29.858
  06:22:20 STEP 1709 H= 427:15 +CPU= 29.248
  06:22:49 STEP 1710 H= 427:30 +CPU= 28.761
  06:23:19 STEP 1711 H= 427:45 +CPU= 29.147
  06:23:48 STEP 1712 H= 428:00 +CPU= 29.271
  06:24:17 STEP 1713 H= 428:15 +CPU= 28.800
  06:24:44 STEP 1714 H= 428:30 +CPU= 27.308
  06:25:07 STEP 1715 H= 428:45 +CPU= 22.954
  06:25:39 STEP 1716 H= 429:00 +CPU= 31.763
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001716
  06:26:06 STEP 1717 H= 429:15 +CPU= 26.570
  06:26:30 STEP 1718 H= 429:30 +CPU= 24.524
  06:26:54 STEP 1719 H= 429:45 +CPU= 24.000
  06:27:20 STEP 1720 H= 430:00 +CPU= 25.394
  06:27:47 STEP 1721 H= 430:15 +CPU= 27.126
  06:28:16 STEP 1722 H= 430:30 +CPU= 28.905
  06:28:46 STEP 1723 H= 430:45 +CPU= 28.950
  06:29:16 STEP 1724 H= 431:00 +CPU= 30.169
  06:29:46 STEP 1725 H= 431:15 +CPU= 29.488
  06:30:15 STEP 1726 H= 431:30 +CPU= 29.040
  06:30:44 STEP 1727 H= 431:45 +CPU= 28.289
  06:31:17 STEP 1728 H= 432:00 +CPU= 33.401
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001728
  06:31:44 STEP 1729 H= 432:15 +CPU= 26.339
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001728
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bv_2016092300_20_1018_12293938_0_r759307987_17.zip
Uploading the intermediate file: upload_file_17.zip
  06:32:08 STEP 1730 H= 432:30 +CPU= 24.074
  06:32:33 STEP 1731 H= 432:45 +CPU= 24.633
  06:32:58 STEP 1732 H= 433:00 +CPU= 25.291
  06:33:22 STEP 1733 H= 433:15 +CPU= 24.052
  06:33:47 STEP 1734 H= 433:30 +CPU= 24.129
  06:34:16 STEP 1735 H= 433:45 +CPU= 28.222
  06:34:46 STEP 1736 H= 434:00 +CPU= 29.766
  06:35:15 STEP 1737 H= 434:15 +CPU= 28.771
  06:35:44 STEP 1738 H= 434:30 +CPU= 29.320
  06:36:15 STEP 1739 H= 434:45 +CPU= 27.796
  06:36:50 STEP 1740 H= 435:00 +CPU= 35.539
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001740
  06:37:19 STEP 1741 H= 435:15 +CPU= 28.690
  06:37:49 STEP 1742 H= 435:30 +CPU= 29.436
  06:38:19 STEP 1743 H= 435:45 +CPU= 28.993
  06:38:48 STEP 1744 H= 436:00 +CPU= 29.564
  06:39:18 STEP 1745 H= 436:15 +CPU= 28.385
  06:39:47 STEP 1746 H= 436:30 +CPU= 28.646
  06:40:16 STEP 1747 H= 436:45 +CPU= 28.846
  06:40:46 STEP 1748 H= 437:00 +CPU= 29.645
  06:41:16 STEP 1749 H= 437:15 +CPU= 28.726
  06:41:45 STEP 1750 H= 437:30 +CPU= 29.221
  06:42:15 STEP 1751 H= 437:45 +CPU= 29.265
  06:42:49 STEP 1752 H= 438:00 +CPU= 34.612
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001752
  06:43:10 STEP 1753 H= 438:15 +CPU= 20.004
  06:43:31 STEP 1754 H= 438:30 +CPU= 21.210
  06:43:53 STEP 1755 H= 438:45 +CPU= 22.676
  06:44:20 STEP 1756 H= 439:00 +CPU= 26.417
  06:44:45 STEP 1757 H= 439:15 +CPU= 24.636
  06:45:10 STEP 1758 H= 439:30 +CPU= 25.209
  06:45:35 STEP 1759 H= 439:45 +CPU= 25.056
  06:46:01 STEP 1760 H= 440:00 +CPU= 25.954
  06:46:30 STEP 1761 H= 440:15 +CPU= 28.784
  06:47:00 STEP 1762 H= 440:30 +CPU= 29.235
  06:47:30 STEP 1763 H= 440:45 +CPU= 29.827
  06:48:06 STEP 1764 H= 441:00 +CPU= 35.070
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001764
  06:48:35 STEP 1765 H= 441:15 +CPU= 28.434
  06:49:04 STEP 1766 H= 441:30 +CPU= 28.982
  06:49:33 STEP 1767 H= 441:45 +CPU= 28.694
  06:50:04 STEP 1768 H= 442:00 +CPU= 29.572
  06:50:34 STEP 1769 H= 442:15 +CPU= 29.066
  06:51:04 STEP 1770 H= 442:30 +CPU= 29.561
  06:51:34 STEP 1771 H= 442:45 +CPU= 29.738
  06:52:04 STEP 1772 H= 443:00 +CPU= 29.707
  06:52:33 STEP 1773 H= 443:15 +CPU= 28.476
  06:53:03 STEP 1774 H= 443:30 +CPU= 29.214
  06:53:32 STEP 1775 H= 443:45 +CPU= 29.338
  06:54:10 STEP 1776 H= 444:00 +CPU= 36.951
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001776
  06:54:32 STEP 1777 H= 444:15 +CPU= 21.389
  06:54:52 STEP 1778 H= 444:30 +CPU= 20.015
  06:55:15 STEP 1779 H= 444:45 +CPU= 22.876
  06:55:41 STEP 1780 H= 445:00 +CPU= 25.930
  06:56:06 STEP 1781 H= 445:15 +CPU= 25.189
  06:56:32 STEP 1782 H= 445:30 +CPU= 25.974
  06:56:59 STEP 1783 H= 445:45 +CPU= 26.096
  06:57:27 STEP 1784 H= 446:00 +CPU= 28.366
  06:57:57 STEP 1785 H= 446:15 +CPU= 28.879
  06:58:26 STEP 1786 H= 446:30 +CPU= 28.735
  06:58:55 STEP 1787 H= 446:45 +CPU= 28.843
  06:59:33 STEP 1788 H= 447:00 +CPU= 36.673
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001788
  07:00:02 STEP 1789 H= 447:15 +CPU= 28.744
  07:00:27 STEP 1790 H= 447:30 +CPU= 24.697
  07:00:51 STEP 1791 H= 447:45 +CPU= 24.489
  07:01:17 STEP 1792 H= 448:00 +CPU= 25.522
  07:01:41 STEP 1793 H= 448:15 +CPU= 23.870
  07:02:06 STEP 1794 H= 448:30 +CPU= 25.224
  07:02:34 STEP 1795 H= 448:45 +CPU= 27.353
  07:03:01 STEP 1796 H= 449:00 +CPU= 26.861
  07:03:30 STEP 1797 H= 449:15 +CPU= 28.049
  07:04:00 STEP 1798 H= 449:30 +CPU= 29.421
  07:04:29 STEP 1799 H= 449:45 +CPU= 28.551
  07:05:06 STEP 1800 H= 450:00 +CPU= 35.413
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001800
  07:05:34 STEP 1801 H= 450:15 +CPU= 28.407
  07:06:04 STEP 1802 H= 450:30 +CPU= 29.052
  07:06:33 STEP 1803 H= 450:45 +CPU= 28.947
  07:07:03 STEP 1804 H= 451:00 +CPU= 29.082
  07:07:32 STEP 1805 H= 451:15 +CPU= 28.892
  07:07:53 STEP 1806 H= 451:30 +CPU= 20.324
  07:08:12 STEP 1807 H= 451:45 +CPU= 19.512
  07:08:35 STEP 1808 H= 452:00 +CPU= 22.616
  07:09:02 STEP 1809 H= 452:15 +CPU= 26.244
  07:09:26 STEP 1810 H= 452:30 +CPU= 24.637
  07:09:50 STEP 1811 H= 452:45 +CPU= 23.478
  07:10:21 STEP 1812 H= 453:00 +CPU= 30.978
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001812
  07:10:49 STEP 1813 H= 453:15 +CPU= 27.738
  07:11:19 STEP 1814 H= 453:30 +CPU= 29.038
  07:11:49 STEP 1815 H= 453:45 +CPU= 28.713
  07:12:20 STEP 1816 H= 454:00 +CPU= 29.878
  07:12:48 STEP 1817 H= 454:15 +CPU= 28.201
  07:13:17 STEP 1818 H= 454:30 +CPU= 27.591
  07:13:36 STEP 1819 H= 454:45 +CPU= 19.473
  07:14:00 STEP 1820 H= 455:00 +CPU= 24.053
  07:14:25 STEP 1821 H= 455:15 +CPU= 24.735
  07:14:50 STEP 1822 H= 455:30 +CPU= 25.418
  07:15:14 STEP 1823 H= 455:45 +CPU= 23.352
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4bv
(argv4) batchid: 1018
(argv5) wuid: 12293938
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/12
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/12/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/12/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8754db6999c6f67ed6911f3167e8ba59 to: /var/lib/boinc-client/slots/12/oifs_43r3_bl_a4bv_2016092300_20_1018_12293938.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/12/oifs_43r3_bl_a4bv_2016092300_20_1018_12293938.zip
ic_ancil_file: ic_ancil_12293938
ifsdata_file: ifsdata_12293938
climate_data_file: clim_data_12293938
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/12/ic_ancil_12293938.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/12/ic_ancil_12293938.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_f6a17c602de14fab29b45a51a336e204 to: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12293938.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12293938.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/12/159l_2/clim_data_12293938.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/12/159l_2/clim_data_12293938.zip
Checking for progress XML file: /var/lib/boinc-client/slots/12/progress_file_12293938.xml
Opened progress file ok : /var/lib/boinc-client/slots/12/progress_file_12293938.xml
-- Model is restarting --
Adjusting last_iter, 1824, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/12/progress_file_12293938.xml
last_cpu_time: 56180
upload_file_number: 18
last_iter: 1825
last_upload: 1556100
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a4bv_2016092300_20_1018_12293938_0_r759307987
The child process has been launched with process id: 896681
Executing the command: /var/lib/boinc-client/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:896681:896681] [20240615:071920:1718435960:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bv_2016092300_20_1018_12293938_0_r759307987_18.zip
Uploading the intermediate file: upload_file_18.zip
  07:19:51 STEP 1824 H= 456:00 +CPU= 27.452
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001824
  07:20:13 STEP 1825 H= 456:15 +CPU= 22.402
  07:20:39 STEP 1826 H= 456:30 +CPU= 25.500
  07:21:05 STEP 1827 H= 456:45 +CPU= 25.626
  07:21:28 STEP 1828 H= 457:00 +CPU= 23.529
  07:21:52 STEP 1829 H= 457:15 +CPU= 23.853
  07:22:16 STEP 1830 H= 457:30 +CPU= 23.905
  07:22:43 STEP 1831 H= 457:45 +CPU= 26.861
  07:23:09 STEP 1832 H= 458:00 +CPU= 25.885
  07:23:34 STEP 1833 H= 458:15 +CPU= 25.471
  07:24:01 STEP 1834 H= 458:30 +CPU= 26.502
  07:24:28 STEP 1835 H= 458:45 +CPU= 27.520
  07:25:03 STEP 1836 H= 459:00 +CPU= 34.794
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001836
  07:25:32 STEP 1837 H= 459:15 +CPU= 28.410
  07:26:01 STEP 1838 H= 459:30 +CPU= 28.526
  07:26:30 STEP 1839 H= 459:45 +CPU= 29.259
  07:27:00 STEP 1840 H= 460:00 +CPU= 29.545
  07:27:29 STEP 1841 H= 460:15 +CPU= 29.039
  07:27:59 STEP 1842 H= 460:30 +CPU= 29.360
  07:28:29 STEP 1843 H= 460:45 +CPU= 29.234
  07:28:59 STEP 1844 H= 461:00 +CPU= 29.754
  07:29:28 STEP 1845 H= 461:15 +CPU= 28.336
  07:29:57 STEP 1846 H= 461:30 +CPU= 28.670
  07:30:27 STEP 1847 H= 461:45 +CPU= 29.294
  07:31:04 STEP 1848 H= 462:00 +CPU= 36.406
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001848
  07:31:32 STEP 1849 H= 462:15 +CPU= 28.062
  07:31:53 STEP 1850 H= 462:30 +CPU= 21.409
  07:32:14 STEP 1851 H= 462:45 +CPU= 20.801
  07:32:39 STEP 1852 H= 463:00 +CPU= 24.779
  07:33:05 STEP 1853 H= 463:15 +CPU= 25.574
  07:33:31 STEP 1854 H= 463:30 +CPU= 25.962
  07:33:58 STEP 1855 H= 463:45 +CPU= 26.776
  07:34:24 STEP 1856 H= 464:00 +CPU= 26.399
  07:34:51 STEP 1857 H= 464:15 +CPU= 27.175
  07:35:21 STEP 1858 H= 464:30 +CPU= 29.013
  07:35:50 STEP 1859 H= 464:45 +CPU= 28.874
  07:36:28 STEP 1860 H= 465:00 +CPU= 36.109
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001860
  07:36:56 STEP 1861 H= 465:15 +CPU= 28.638
  07:37:26 STEP 1862 H= 465:30 +CPU= 29.208
  07:37:53 STEP 1863 H= 465:45 +CPU= 25.831
  07:38:16 STEP 1864 H= 466:00 +CPU= 22.286
  07:38:39 STEP 1865 H= 466:15 +CPU= 23.804
  07:39:04 STEP 1866 H= 466:30 +CPU= 24.598
  07:39:26 STEP 1867 H= 466:45 +CPU= 22.316
  07:39:53 STEP 1868 H= 467:00 +CPU= 26.672
  07:40:17 STEP 1869 H= 467:15 +CPU= 24.275
  07:40:42 STEP 1870 H= 467:30 +CPU= 24.286
  07:41:09 STEP 1871 H= 467:45 +CPU= 27.207
  07:41:48 STEP 1872 H= 468:00 +CPU= 38.885
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001872
  07:42:18 STEP 1873 H= 468:15 +CPU= 29.258
  07:42:48 STEP 1874 H= 468:30 +CPU= 29.197
  07:43:17 STEP 1875 H= 468:45 +CPU= 29.258
  07:43:44 STEP 1876 H= 469:00 +CPU= 26.808
  07:44:04 STEP 1877 H= 469:15 +CPU= 19.587
  07:44:26 STEP 1878 H= 469:30 +CPU= 22.560
  07:44:52 STEP 1879 H= 469:45 +CPU= 25.814
  07:45:19 STEP 1880 H= 470:00 +CPU= 26.561
  07:45:44 STEP 1881 H= 470:15 +CPU= 25.034
  07:46:09 STEP 1882 H= 470:30 +CPU= 25.352
  07:46:35 STEP 1883 H= 470:45 +CPU= 25.247
  07:47:09 STEP 1884 H= 471:00 +CPU= 34.524
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001884
  07:47:39 STEP 1885 H= 471:15 +CPU= 29.201
  07:48:08 STEP 1886 H= 471:30 +CPU= 29.173
  07:48:38 STEP 1887 H= 471:45 +CPU= 29.372
  07:49:08 STEP 1888 H= 472:00 +CPU= 29.921
  07:49:38 STEP 1889 H= 472:15 +CPU= 29.340
  07:50:05 STEP 1890 H= 472:30 +CPU= 27.203
  07:50:31 STEP 1891 H= 472:45 +CPU= 25.787
  07:50:57 STEP 1892 H= 473:00 +CPU= 25.661
  07:51:22 STEP 1893 H= 473:15 +CPU= 25.371
  07:51:48 STEP 1894 H= 473:30 +CPU= 26.242
  07:52:12 STEP 1895 H= 473:45 +CPU= 23.834
  07:52:43 STEP 1896 H= 474:00 +CPU= 30.700
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001896
  07:53:11 STEP 1897 H= 474:15 +CPU= 26.930
  07:53:40 STEP 1898 H= 474:30 +CPU= 28.184
  07:54:09 STEP 1899 H= 474:45 +CPU= 29.402
  07:54:39 STEP 1900 H= 475:00 +CPU= 29.548
  07:55:08 STEP 1901 H= 475:15 +CPU= 29.218
  07:55:38 STEP 1902 H= 475:30 +CPU= 28.843
  07:56:05 STEP 1903 H= 475:45 +CPU= 26.911
  07:56:26 STEP 1904 H= 476:00 +CPU= 21.226
  07:56:51 STEP 1905 H= 476:15 +CPU= 25.469
  07:57:17 STEP 1906 H= 476:30 +CPU= 25.507
  07:57:42 STEP 1907 H= 476:45 +CPU= 24.450
  07:58:12 STEP 1908 H= 477:00 +CPU= 29.317
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001908
  07:58:36 STEP 1909 H= 477:15 +CPU= 24.116
  07:59:03 STEP 1910 H= 477:30 +CPU= 27.131
  07:59:33 STEP 1911 H= 477:45 +CPU= 28.968
  08:00:04 STEP 1912 H= 478:00 +CPU= 30.230
  08:00:33 STEP 1913 H= 478:15 +CPU= 29.349
  08:01:04 STEP 1914 H= 478:30 +CPU= 29.644
  08:01:34 STEP 1915 H= 478:45 +CPU= 29.508
  08:02:04 STEP 1916 H= 479:00 +CPU= 29.843
  08:02:29 STEP 1917 H= 479:15 +CPU= 24.832
  08:02:53 STEP 1918 H= 479:30 +CPU= 23.901
  08:03:17 STEP 1919 H= 479:45 +CPU= 24.214
  08:03:49 STEP 1920 H= 480:00 +CPU= 32.234
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.7749314432E-21      I       0.6524203205E-06      I
ICloud fractionI      0.0000000000E+00      I       0.5781323690E-02      I
I  Relat. Hum. I      0.3898912362E-01      I       0.8311526913E-01      I
I  PASS 01     I      0.0000000000E+00      I       0.1140464226E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    302324788 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS755812.0 Mbytes/s, TOTAL TIME=    0.0115( 3.5%)
 08:03:49 STEP 1920 H= 480:00 +CPU= 32.234
 END CNT3
 NSTEP =  1920 CNT0   000000000  24.165  24.165  24.270   0.996               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         2860/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     53    0       46      1044068     2860 ************     5.6     1.3     4.3     2.2     9.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 2669740.3 2669740.3    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 2666030.5 2666030.5     99.86      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  105    5430.4    5430.4     21.36      0.00
   9 SPCM     - SPECTRAL COMP.                      96     875.4     875.4      3.15      0.00
  10 SCAN2M - PHYSICS                               97   11464.4   11464.4     41.65      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                  8     749.2     749.2      0.22      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  5      73.9      73.9      0.01      0.00
  17 GRIDFPOS IN CNT4                                8      33.4      33.4      0.01      0.00
  27 RESTART FILES - WRITING                         2    2992.8    2992.8      0.22      0.00
  28 RESTART FILES - READING                         1    3187.1    3187.1      0.12      0.00
  29 SU4FPOS IN CNT4                                 8       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                 8    5406.5    5406.5      1.62      0.00
  31 POSDDH IN STEPO                                 1       6.2       6.2      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                     97    5904.3    5904.3     21.45      0.00
  39 SU0YOMB                                         1     312.9     312.9      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                     97      31.6      31.6      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.               96     520.6     520.6      1.87      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.               96      67.1      67.1      0.24      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  5       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      212     378.6     378.6      3.01      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       200     221.3     221.3      1.66      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        200      75.6      75.6      0.57      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       212     105.7     105.7      0.84      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      28.5      28.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            212      63.0      63.0      0.50      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            200      33.8      33.8      0.25      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            212     124.1     124.1      0.99      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            200      56.5      56.5      0.42      0.00
 400 GSTATS                                      12215       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 11311       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     2669.7 CPU TIME    2647.8 VECTOR TIME     2647.8


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      648.2
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/12/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/12/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293938/ICMGGh7zg+001536
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bv_2016092300_20_1018_12293938_0_r759307987_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
08:07:19 (896673): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Jun 2024 08:42:26 1537687 22447555 oifs_43r3_bl_a4bv_2016092300_20_1018_12293938_0 1,727,100 58,827 0.0341


©2024 cpdn.org