climateprediction.net home page
Task 22444699

Task 22444699

Name oifs_43r3_bl_a252_2016092300_20_1018_12291101_0
Workunit 12291101
Created 13 Jun 2024, 0:03:27 UTC
Sent 14 Jun 2024, 9:07:27 UTC
Report deadline 13 Aug 2024, 9:07:27 UTC
Received 15 Jun 2024, 8:48:45 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1541000
Run time 14 hours 32 min 48 sec
CPU time 14 hours 32 min 48 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 4.91 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.34 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,376.71 MB
Stderr
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
008
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001524
  13:49:52 STEP 1525 H= 381:15 +CPU= 42.057
  13:50:35 STEP 1526 H= 381:30 +CPU= 42.277
  13:51:17 STEP 1527 H= 381:45 +CPU= 42.199
  13:52:00 STEP 1528 H= 382:00 +CPU= 42.774
  13:52:42 STEP 1529 H= 382:15 +CPU= 42.253
  13:53:24 STEP 1530 H= 382:30 +CPU= 42.204
  13:54:06 STEP 1531 H= 382:45 +CPU= 42.235
  13:54:49 STEP 1532 H= 383:00 +CPU= 42.904
  13:55:32 STEP 1533 H= 383:15 +CPU= 42.269
  13:56:14 STEP 1534 H= 383:30 +CPU= 42.270
  13:56:57 STEP 1535 H= 383:45 +CPU= 42.417
  13:57:55 STEP 1536 H= 384:00 +CPU= 58.498
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a252_2016092300_20_1018_12291101_0_r23095354_15.zip
Uploading the intermediate file: upload_file_15.zip
  13:58:38 STEP 1537 H= 384:15 +CPU= 42.363
  13:59:20 STEP 1538 H= 384:30 +CPU= 42.360
  14:00:02 STEP 1539 H= 384:45 +CPU= 42.434
  14:00:46 STEP 1540 H= 385:00 +CPU= 43.040
  14:01:28 STEP 1541 H= 385:15 +CPU= 42.218
  14:02:10 STEP 1542 H= 385:30 +CPU= 42.362
  14:02:53 STEP 1543 H= 385:45 +CPU= 42.401
  14:03:36 STEP 1544 H= 386:00 +CPU= 42.998
  14:04:18 STEP 1545 H= 386:15 +CPU= 42.325
  14:05:00 STEP 1546 H= 386:30 +CPU= 42.355
  14:05:43 STEP 1547 H= 386:45 +CPU= 42.392
  14:06:36 STEP 1548 H= 387:00 +CPU= 52.994
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001548
  14:07:18 STEP 1549 H= 387:15 +CPU= 42.301
  14:08:01 STEP 1550 H= 387:30 +CPU= 42.397
  14:08:43 STEP 1551 H= 387:45 +CPU= 42.401
  14:09:26 STEP 1552 H= 388:00 +CPU= 43.050
  14:10:09 STEP 1553 H= 388:15 +CPU= 42.411
  14:10:51 STEP 1554 H= 388:30 +CPU= 42.393
  14:11:34 STEP 1555 H= 388:45 +CPU= 42.380
  14:12:17 STEP 1556 H= 389:00 +CPU= 43.015
  14:12:59 STEP 1557 H= 389:15 +CPU= 42.370
  14:13:42 STEP 1558 H= 389:30 +CPU= 42.372
  14:14:24 STEP 1559 H= 389:45 +CPU= 42.395
  14:15:17 STEP 1560 H= 390:00 +CPU= 53.293
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001560
  14:16:00 STEP 1561 H= 390:15 +CPU= 42.205
  14:16:42 STEP 1562 H= 390:30 +CPU= 42.261
  14:17:24 STEP 1563 H= 390:45 +CPU= 42.284
  14:18:07 STEP 1564 H= 391:00 +CPU= 42.934
  14:18:50 STEP 1565 H= 391:15 +CPU= 42.257
  14:19:32 STEP 1566 H= 391:30 +CPU= 42.269
  14:20:14 STEP 1567 H= 391:45 +CPU= 42.245
  14:20:57 STEP 1568 H= 392:00 +CPU= 42.933
  14:21:40 STEP 1569 H= 392:15 +CPU= 42.300
  14:22:22 STEP 1570 H= 392:30 +CPU= 42.338
  14:23:04 STEP 1571 H= 392:45 +CPU= 42.325
  14:23:57 STEP 1572 H= 393:00 +CPU= 53.007
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001572
  14:24:40 STEP 1573 H= 393:15 +CPU= 42.280
  14:25:22 STEP 1574 H= 393:30 +CPU= 42.205
  14:26:04 STEP 1575 H= 393:45 +CPU= 42.276
  14:26:47 STEP 1576 H= 394:00 +CPU= 42.925
  14:27:30 STEP 1577 H= 394:15 +CPU= 42.313
  14:28:12 STEP 1578 H= 394:30 +CPU= 42.243
  14:28:54 STEP 1579 H= 394:45 +CPU= 42.208
  14:29:37 STEP 1580 H= 395:00 +CPU= 42.894
  14:30:19 STEP 1581 H= 395:15 +CPU= 42.207
  14:31:02 STEP 1582 H= 395:30 +CPU= 42.265
  14:31:44 STEP 1583 H= 395:45 +CPU= 42.286
  14:32:43 STEP 1584 H= 396:00 +CPU= 58.565
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001584
  14:33:25 STEP 1585 H= 396:15 +CPU= 42.471
  14:34:08 STEP 1586 H= 396:30 +CPU= 42.411
  14:34:50 STEP 1587 H= 396:45 +CPU= 42.331
  14:35:33 STEP 1588 H= 397:00 +CPU= 43.024
  14:36:16 STEP 1589 H= 397:15 +CPU= 42.338
  14:36:58 STEP 1590 H= 397:30 +CPU= 42.325
  14:37:40 STEP 1591 H= 397:45 +CPU= 42.360
  14:38:23 STEP 1592 H= 398:00 +CPU= 42.993
  14:39:06 STEP 1593 H= 398:15 +CPU= 42.374
  14:39:48 STEP 1594 H= 398:30 +CPU= 42.490
  14:40:31 STEP 1595 H= 398:45 +CPU= 42.409
  14:41:24 STEP 1596 H= 399:00 +CPU= 53.118
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001596
  14:42:06 STEP 1597 H= 399:15 +CPU= 42.357
  14:42:49 STEP 1598 H= 399:30 +CPU= 42.179
  14:43:31 STEP 1599 H= 399:45 +CPU= 42.275
  14:44:14 STEP 1600 H= 400:00 +CPU= 42.900
  14:44:56 STEP 1601 H= 400:15 +CPU= 42.213
  14:45:39 STEP 1602 H= 400:30 +CPU= 42.293
  14:46:21 STEP 1603 H= 400:45 +CPU= 42.244
  14:47:04 STEP 1604 H= 401:00 +CPU= 42.874
  14:47:46 STEP 1605 H= 401:15 +CPU= 42.347
  14:48:28 STEP 1606 H= 401:30 +CPU= 42.200
  14:49:11 STEP 1607 H= 401:45 +CPU= 42.230
  14:50:04 STEP 1608 H= 402:00 +CPU= 53.228
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001608
  14:50:46 STEP 1609 H= 402:15 +CPU= 42.419
  14:51:29 STEP 1610 H= 402:30 +CPU= 42.417
  14:52:11 STEP 1611 H= 402:45 +CPU= 42.352
  14:52:54 STEP 1612 H= 403:00 +CPU= 43.019
  14:53:37 STEP 1613 H= 403:15 +CPU= 42.331
  14:54:19 STEP 1614 H= 403:30 +CPU= 42.412
  14:55:02 STEP 1615 H= 403:45 +CPU= 42.419
  14:55:45 STEP 1616 H= 404:00 +CPU= 42.997
  14:56:27 STEP 1617 H= 404:15 +CPU= 42.349
  14:57:10 STEP 1618 H= 404:30 +CPU= 42.428
  14:57:52 STEP 1619 H= 404:45 +CPU= 42.390
  14:58:45 STEP 1620 H= 405:00 +CPU= 52.983
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001620
  14:59:28 STEP 1621 H= 405:15 +CPU= 42.395
  15:00:01 STEP 1622 H= 405:30 +CPU= 33.335
  15:00:20 STEP 1623 H= 405:45 +CPU= 18.667
  15:00:38 STEP 1624 H= 406:00 +CPU= 18.423
  15:00:57 STEP 1625 H= 406:15 +CPU= 19.020
  15:01:15 STEP 1626 H= 406:30 +CPU= 18.035
  15:01:34 STEP 1627 H= 406:45 +CPU= 18.599
  15:01:52 STEP 1628 H= 407:00 +CPU= 18.128
  15:02:11 STEP 1629 H= 407:15 +CPU= 18.952
  15:02:30 STEP 1630 H= 407:30 +CPU= 18.816
  15:02:48 STEP 1631 H= 407:45 +CPU= 18.278
  15:03:15 STEP 1632 H= 408:00 +CPU= 26.845
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a252_2016092300_20_1018_12291101_0_r23095354_16.zip
Uploading the intermediate file: upload_file_16.zip
  15:03:33 STEP 1633 H= 408:15 +CPU= 17.784
Uploading trickle at timestep: 1468800
  15:03:50 STEP 1634 H= 408:30 +CPU= 17.099
  15:04:07 STEP 1635 H= 408:45 +CPU= 17.286
  15:04:26 STEP 1636 H= 409:00 +CPU= 18.682
  15:04:44 STEP 1637 H= 409:15 +CPU= 18.251
  15:05:03 STEP 1638 H= 409:30 +CPU= 18.471
  15:05:22 STEP 1639 H= 409:45 +CPU= 18.831
  15:05:40 STEP 1640 H= 410:00 +CPU= 18.772
  15:05:59 STEP 1641 H= 410:15 +CPU= 18.610
  15:06:19 STEP 1642 H= 410:30 +CPU= 19.628
  15:06:37 STEP 1643 H= 410:45 +CPU= 18.007
  15:07:00 STEP 1644 H= 411:00 +CPU= 23.083
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001644
  15:07:17 STEP 1645 H= 411:15 +CPU= 17.609
  15:07:36 STEP 1646 H= 411:30 +CPU= 18.016
  15:07:54 STEP 1647 H= 411:45 +CPU= 18.869
  15:08:13 STEP 1648 H= 412:00 +CPU= 18.417
  15:08:31 STEP 1649 H= 412:15 +CPU= 17.915
  15:08:49 STEP 1650 H= 412:30 +CPU= 18.189
  15:09:07 STEP 1651 H= 412:45 +CPU= 18.006
  15:09:25 STEP 1652 H= 413:00 +CPU= 18.004
  15:09:44 STEP 1653 H= 413:15 +CPU= 18.638
  15:10:02 STEP 1654 H= 413:30 +CPU= 18.104
  15:10:20 STEP 1655 H= 413:45 +CPU= 18.308
  15:10:42 STEP 1656 H= 414:00 +CPU= 21.294
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001656
  15:10:59 STEP 1657 H= 414:15 +CPU= 17.615
  15:11:17 STEP 1658 H= 414:30 +CPU= 17.424
  15:11:33 STEP 1659 H= 414:45 +CPU= 16.796
  15:11:52 STEP 1660 H= 415:00 +CPU= 18.272
  15:12:10 STEP 1661 H= 415:15 +CPU= 18.137
  15:12:28 STEP 1662 H= 415:30 +CPU= 18.412
  15:12:46 STEP 1663 H= 415:45 +CPU= 17.188
  15:13:03 STEP 1664 H= 416:00 +CPU= 17.832
  15:13:20 STEP 1665 H= 416:15 +CPU= 16.881
  15:13:38 STEP 1666 H= 416:30 +CPU= 17.705
  15:13:56 STEP 1667 H= 416:45 +CPU= 17.998
  15:14:18 STEP 1668 H= 417:00 +CPU= 21.622
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001668
  15:14:35 STEP 1669 H= 417:15 +CPU= 17.369
  15:14:53 STEP 1670 H= 417:30 +CPU= 17.807
  15:15:10 STEP 1671 H= 417:45 +CPU= 17.179
  15:15:28 STEP 1672 H= 418:00 +CPU= 17.936
  15:15:46 STEP 1673 H= 418:15 +CPU= 18.252
  15:16:05 STEP 1674 H= 418:30 +CPU= 18.542
  15:16:23 STEP 1675 H= 418:45 +CPU= 18.110
  15:16:42 STEP 1676 H= 419:00 +CPU= 18.774
  15:17:00 STEP 1677 H= 419:15 +CPU= 17.765
  15:17:17 STEP 1678 H= 419:30 +CPU= 17.631
  15:17:35 STEP 1679 H= 419:45 +CPU= 17.306
  15:18:01 STEP 1680 H= 420:00 +CPU= 26.357
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001680
  15:18:19 STEP 1681 H= 420:15 +CPU= 17.742
  15:18:36 STEP 1682 H= 420:30 +CPU= 16.732
  15:18:53 STEP 1683 H= 420:45 +CPU= 17.565
  15:19:11 STEP 1684 H= 421:00 +CPU= 18.135
  15:19:30 STEP 1685 H= 421:15 +CPU= 18.386
  15:19:48 STEP 1686 H= 421:30 +CPU= 17.864
  15:20:05 STEP 1687 H= 421:45 +CPU= 17.312
  15:20:23 STEP 1688 H= 422:00 +CPU= 18.029
  15:20:41 STEP 1689 H= 422:15 +CPU= 18.023
  15:20:58 STEP 1690 H= 422:30 +CPU= 16.790
  15:21:15 STEP 1691 H= 422:45 +CPU= 17.232
  15:21:37 STEP 1692 H= 423:00 +CPU= 22.219
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001692
  15:21:55 STEP 1693 H= 423:15 +CPU= 17.887
  15:22:13 STEP 1694 H= 423:30 +CPU= 17.618
  15:22:31 STEP 1695 H= 423:45 +CPU= 18.125
  15:22:49 STEP 1696 H= 424:00 +CPU= 18.003
  15:23:07 STEP 1697 H= 424:15 +CPU= 17.783
  15:23:25 STEP 1698 H= 424:30 +CPU= 17.779
  15:23:43 STEP 1699 H= 424:45 +CPU= 17.892
  15:24:01 STEP 1700 H= 425:00 +CPU= 17.840
  15:24:19 STEP 1701 H= 425:15 +CPU= 17.887
  15:24:37 STEP 1702 H= 425:30 +CPU= 17.974
  15:24:55 STEP 1703 H= 425:45 +CPU= 18.792
  15:25:17 STEP 1704 H= 426:00 +CPU= 21.999
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001704
  15:25:35 STEP 1705 H= 426:15 +CPU= 17.145
  15:25:52 STEP 1706 H= 426:30 +CPU= 17.527
  15:26:10 STEP 1707 H= 426:45 +CPU= 18.006
  15:26:28 STEP 1708 H= 427:00 +CPU= 18.008
  15:26:46 STEP 1709 H= 427:15 +CPU= 18.123
  15:27:04 STEP 1710 H= 427:30 +CPU= 17.735
  15:27:21 STEP 1711 H= 427:45 +CPU= 16.713
  15:27:40 STEP 1712 H= 428:00 +CPU= 18.701
  15:27:57 STEP 1713 H= 428:15 +CPU= 17.758
  15:28:15 STEP 1714 H= 428:30 +CPU= 17.468
  15:28:32 STEP 1715 H= 428:45 +CPU= 17.442
  15:28:55 STEP 1716 H= 429:00 +CPU= 22.164
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001716
  15:29:13 STEP 1717 H= 429:15 +CPU= 18.787
  15:29:32 STEP 1718 H= 429:30 +CPU= 18.864
  15:29:50 STEP 1719 H= 429:45 +CPU= 17.525
  15:30:09 STEP 1720 H= 430:00 +CPU= 18.909
  15:30:26 STEP 1721 H= 430:15 +CPU= 17.425
  15:30:45 STEP 1722 H= 430:30 +CPU= 18.495
  15:31:04 STEP 1723 H= 430:45 +CPU= 18.726
  15:31:21 STEP 1724 H= 431:00 +CPU= 17.242
  15:31:40 STEP 1725 H= 431:15 +CPU= 18.770
  15:31:57 STEP 1726 H= 431:30 +CPU= 17.733
  15:32:16 STEP 1727 H= 431:45 +CPU= 18.880
  15:32:42 STEP 1728 H= 432:00 +CPU= 25.789
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a252_2016092300_20_1018_12291101_0_r23095354_17.zip
Uploading the intermediate file: upload_file_17.zip
  15:33:00 STEP 1729 H= 432:15 +CPU= 17.411
  15:33:19 STEP 1730 H= 432:30 +CPU= 18.833
  15:33:37 STEP 1731 H= 432:45 +CPU= 18.349
  15:33:56 STEP 1732 H= 433:00 +CPU= 18.844
  15:34:14 STEP 1733 H= 433:15 +CPU= 17.916
  15:34:32 STEP 1734 H= 433:30 +CPU= 18.703
  15:34:50 STEP 1735 H= 433:45 +CPU= 17.871
  15:35:08 STEP 1736 H= 434:00 +CPU= 17.668
  15:35:25 STEP 1737 H= 434:15 +CPU= 17.308
  15:35:43 STEP 1738 H= 434:30 +CPU= 17.998
  15:36:02 STEP 1739 H= 434:45 +CPU= 18.295
  15:36:24 STEP 1740 H= 435:00 +CPU= 22.482
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001740
  15:36:42 STEP 1741 H= 435:15 +CPU= 17.956
  15:37:00 STEP 1742 H= 435:30 +CPU= 17.408
  15:37:17 STEP 1743 H= 435:45 +CPU= 17.734
  15:37:36 STEP 1744 H= 436:00 +CPU= 18.002
  15:37:53 STEP 1745 H= 436:15 +CPU= 17.140
  15:38:10 STEP 1746 H= 436:30 +CPU= 17.514
  15:38:27 STEP 1747 H= 436:45 +CPU= 17.053
  15:38:45 STEP 1748 H= 437:00 +CPU= 18.085
  15:39:03 STEP 1749 H= 437:15 +CPU= 17.619
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3958MB (heap), 4797MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3958 MB (maxheap), 4797 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.837] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153930:1718404770:34497.838] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153931:1718404771:34498.838] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:Rig-05:1:1:2978:2978] [20240614:153931:1718404771:34498.838] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000121FE73  vdfmain_                  880  vdfmain.F90
oifs_43r3_model.e  0000000001207E29  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  00000000011FDCB2  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000000FAC003  callpar_                  869  callpar.F90
oifs_43r3_model.e  0000000000F5FA6B  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000F4DBC4  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BD7131  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a252
(argv4) batchid: 1018
(argv5) wuid: 12291101
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8bb18b5ef883575f00290458405b97dd to: /var/lib/boinc-client/slots/5/oifs_43r3_bl_a252_2016092300_20_1018_12291101.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_bl_a252_2016092300_20_1018_12291101.zip
ic_ancil_file: ic_ancil_12291101
ifsdata_file: ifsdata_12291101
climate_data_file: clim_data_12291101
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/5/ic_ancil_12291101.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12291101.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_20dac1f5ab0dae594bf5bc3175dfb7bd to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12291101.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12291101.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12291101.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12291101.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12291101.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12291101.xml
-- Model is restarting --
Adjusting last_iter, 1750, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12291101.xml
last_cpu_time: 44619
upload_file_number: 18
last_iter: 1729
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a252_2016092300_20_1018_12291101_0_r23095354
The child process has been launched with process id: 3340
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:3340:3340] [20240614:224617:1718430377:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  22:46:35 STEP 1728 H= 432:00 +CPU= 15.436
  22:46:50 STEP 1729 H= 432:15 +CPU= 14.635
  22:47:05 STEP 1730 H= 432:30 +CPU= 14.890
  22:47:19 STEP 1731 H= 432:45 +CPU= 14.555
  22:47:34 STEP 1732 H= 433:00 +CPU= 14.751
  22:47:48 STEP 1733 H= 433:15 +CPU= 14.301
  22:48:03 STEP 1734 H= 433:30 +CPU= 14.374
  22:48:17 STEP 1735 H= 433:45 +CPU= 14.396
  22:48:32 STEP 1736 H= 434:00 +CPU= 14.613
  22:48:46 STEP 1737 H= 434:15 +CPU= 13.982
  22:49:00 STEP 1738 H= 434:30 +CPU= 13.964
  22:49:14 STEP 1739 H= 434:45 +CPU= 13.974
  22:49:31 STEP 1740 H= 435:00 +CPU= 17.311
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001740
  22:49:45 STEP 1741 H= 435:15 +CPU= 14.232
  22:50:00 STEP 1742 H= 435:30 +CPU= 14.222
  22:50:14 STEP 1743 H= 435:45 +CPU= 14.137
  22:50:28 STEP 1744 H= 436:00 +CPU= 14.324
  22:50:42 STEP 1745 H= 436:15 +CPU= 14.271
  22:50:56 STEP 1746 H= 436:30 +CPU= 14.185
  22:51:11 STEP 1747 H= 436:45 +CPU= 14.071
  22:51:25 STEP 1748 H= 437:00 +CPU= 14.413
  22:51:39 STEP 1749 H= 437:15 +CPU= 14.088
  22:51:53 STEP 1750 H= 437:30 +CPU= 14.191
  22:52:08 STEP 1751 H= 437:45 +CPU= 14.529
  22:52:27 STEP 1752 H= 438:00 +CPU= 19.250
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001752
  22:52:55 STEP 1753 H= 438:15 +CPU= 27.760
  22:53:38 STEP 1754 H= 438:30 +CPU= 43.093
  22:54:21 STEP 1755 H= 438:45 +CPU= 43.122
  22:55:05 STEP 1756 H= 439:00 +CPU= 43.675
  22:55:48 STEP 1757 H= 439:15 +CPU= 43.054
  22:56:32 STEP 1758 H= 439:30 +CPU= 43.204
  22:57:15 STEP 1759 H= 439:45 +CPU= 43.045
  22:57:58 STEP 1760 H= 440:00 +CPU= 43.614
  22:58:42 STEP 1761 H= 440:15 +CPU= 43.015
  22:59:25 STEP 1762 H= 440:30 +CPU= 43.003
  23:00:08 STEP 1763 H= 440:45 +CPU= 42.963
  23:01:01 STEP 1764 H= 441:00 +CPU= 53.583
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001764
  23:01:44 STEP 1765 H= 441:15 +CPU= 42.988
  23:02:28 STEP 1766 H= 441:30 +CPU= 43.029
  23:03:11 STEP 1767 H= 441:45 +CPU= 43.072
  23:03:55 STEP 1768 H= 442:00 +CPU= 43.757
  23:04:38 STEP 1769 H= 442:15 +CPU= 43.005
  23:05:21 STEP 1770 H= 442:30 +CPU= 43.073
  23:06:04 STEP 1771 H= 442:45 +CPU= 43.095
  23:06:48 STEP 1772 H= 443:00 +CPU= 43.681
  23:07:31 STEP 1773 H= 443:15 +CPU= 42.963
  23:08:14 STEP 1774 H= 443:30 +CPU= 42.983
  23:08:57 STEP 1775 H= 443:45 +CPU= 42.898
  23:09:56 STEP 1776 H= 444:00 +CPU= 58.756
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001776
  23:10:39 STEP 1777 H= 444:15 +CPU= 42.760
  23:11:21 STEP 1778 H= 444:30 +CPU= 42.767
  23:12:04 STEP 1779 H= 444:45 +CPU= 42.811
  23:12:48 STEP 1780 H= 445:00 +CPU= 43.352
  23:13:30 STEP 1781 H= 445:15 +CPU= 42.704
  23:14:13 STEP 1782 H= 445:30 +CPU= 42.842
  23:14:56 STEP 1783 H= 445:45 +CPU= 42.842
  23:15:40 STEP 1784 H= 446:00 +CPU= 43.499
  23:16:23 STEP 1785 H= 446:15 +CPU= 42.788
  23:17:06 STEP 1786 H= 446:30 +CPU= 42.783
  23:17:48 STEP 1787 H= 446:45 +CPU= 42.749
  23:18:42 STEP 1788 H= 447:00 +CPU= 53.480
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001788
  23:19:25 STEP 1789 H= 447:15 +CPU= 42.915
  23:20:08 STEP 1790 H= 447:30 +CPU= 43.002
  23:20:51 STEP 1791 H= 447:45 +CPU= 42.915
  23:21:35 STEP 1792 H= 448:00 +CPU= 43.624
  23:22:18 STEP 1793 H= 448:15 +CPU= 42.913
  23:23:01 STEP 1794 H= 448:30 +CPU= 43.007
  23:23:44 STEP 1795 H= 448:45 +CPU= 42.910
  23:24:27 STEP 1796 H= 449:00 +CPU= 43.454
  23:25:10 STEP 1797 H= 449:15 +CPU= 42.783
  23:25:53 STEP 1798 H= 449:30 +CPU= 42.851
  23:26:36 STEP 1799 H= 449:45 +CPU= 42.855
  23:27:30 STEP 1800 H= 450:00 +CPU= 53.619
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001800
  23:28:12 STEP 1801 H= 450:15 +CPU= 42.653
  23:28:55 STEP 1802 H= 450:30 +CPU= 42.688
  23:29:38 STEP 1803 H= 450:45 +CPU= 42.672
  23:30:21 STEP 1804 H= 451:00 +CPU= 43.332
  23:31:04 STEP 1805 H= 451:15 +CPU= 42.586
  23:31:46 STEP 1806 H= 451:30 +CPU= 42.577
  23:32:29 STEP 1807 H= 451:45 +CPU= 42.526
  23:33:12 STEP 1808 H= 452:00 +CPU= 43.271
  23:33:55 STEP 1809 H= 452:15 +CPU= 42.442
  23:34:37 STEP 1810 H= 452:30 +CPU= 42.577
  23:35:20 STEP 1811 H= 452:45 +CPU= 42.602
  23:36:14 STEP 1812 H= 453:00 +CPU= 53.797
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001812
  23:36:57 STEP 1813 H= 453:15 +CPU= 42.851
  23:37:40 STEP 1814 H= 453:30 +CPU= 42.826
  23:38:23 STEP 1815 H= 453:45 +CPU= 42.899
  23:39:06 STEP 1816 H= 454:00 +CPU= 43.534
  23:39:49 STEP 1817 H= 454:15 +CPU= 42.857
  23:40:32 STEP 1818 H= 454:30 +CPU= 42.768
  23:41:15 STEP 1819 H= 454:45 +CPU= 42.879
  23:41:59 STEP 1820 H= 455:00 +CPU= 43.571
  23:42:42 STEP 1821 H= 455:15 +CPU= 42.864
  23:43:25 STEP 1822 H= 455:30 +CPU= 42.847
  23:44:08 STEP 1823 H= 455:45 +CPU= 42.850
  23:45:07 STEP 1824 H= 456:00 +CPU= 59.153
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a252_2016092300_20_1018_12291101_0_r23095354_18.zip
Uploading the intermediate file: upload_file_18.zip
  23:45:50 STEP 1825 H= 456:15 +CPU= 42.899
  23:46:33 STEP 1826 H= 456:30 +CPU= 42.990
  23:47:16 STEP 1827 H= 456:45 +CPU= 43.012
  23:48:00 STEP 1828 H= 457:00 +CPU= 43.589
  23:48:43 STEP 1829 H= 457:15 +CPU= 42.950
  23:49:26 STEP 1830 H= 457:30 +CPU= 42.965
  23:50:09 STEP 1831 H= 457:45 +CPU= 42.947
  23:50:52 STEP 1832 H= 458:00 +CPU= 43.562
  23:51:35 STEP 1833 H= 458:15 +CPU= 42.957
  23:52:18 STEP 1834 H= 458:30 +CPU= 42.961
  23:53:01 STEP 1835 H= 458:45 +CPU= 42.918
  23:53:55 STEP 1836 H= 459:00 +CPU= 53.649
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001836
  23:54:38 STEP 1837 H= 459:15 +CPU= 43.043
  23:55:21 STEP 1838 H= 459:30 +CPU= 43.135
  23:56:04 STEP 1839 H= 459:45 +CPU= 43.037
  23:56:48 STEP 1840 H= 460:00 +CPU= 43.758
  23:57:31 STEP 1841 H= 460:15 +CPU= 43.084
  23:58:14 STEP 1842 H= 460:30 +CPU= 43.023
  23:58:58 STEP 1843 H= 460:45 +CPU= 43.062
  23:59:41 STEP 1844 H= 461:00 +CPU= 43.613
  00:00:24 STEP 1845 H= 461:15 +CPU= 43.104
  00:01:08 STEP 1846 H= 461:30 +CPU= 43.118
  00:01:51 STEP 1847 H= 461:45 +CPU= 43.195
  00:02:45 STEP 1848 H= 462:00 +CPU= 53.783
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001848
  00:03:28 STEP 1849 H= 462:15 +CPU= 42.838
  00:04:10 STEP 1850 H= 462:30 +CPU= 42.780
  00:04:53 STEP 1851 H= 462:45 +CPU= 42.788
  00:05:37 STEP 1852 H= 463:00 +CPU= 43.452
  00:06:20 STEP 1853 H= 463:15 +CPU= 42.833
  00:07:03 STEP 1854 H= 463:30 +CPU= 42.788
  00:07:46 STEP 1855 H= 463:45 +CPU= 42.836
  00:08:29 STEP 1856 H= 464:00 +CPU= 43.518
  00:09:12 STEP 1857 H= 464:15 +CPU= 42.845
  00:09:55 STEP 1858 H= 464:30 +CPU= 42.702
  00:10:38 STEP 1859 H= 464:45 +CPU= 42.839
  00:11:31 STEP 1860 H= 465:00 +CPU= 53.722
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001860
  00:12:14 STEP 1861 H= 465:15 +CPU= 42.919
  00:12:58 STEP 1862 H= 465:30 +CPU= 43.019
  00:13:41 STEP 1863 H= 465:45 +CPU= 43.099
  00:14:24 STEP 1864 H= 466:00 +CPU= 43.527
  00:15:07 STEP 1865 H= 466:15 +CPU= 42.971
  00:15:50 STEP 1866 H= 466:30 +CPU= 42.998
  00:16:33 STEP 1867 H= 466:45 +CPU= 42.966
  00:17:17 STEP 1868 H= 467:00 +CPU= 43.598
  00:18:00 STEP 1869 H= 467:15 +CPU= 42.936
  00:18:43 STEP 1870 H= 467:30 +CPU= 43.037
  00:19:26 STEP 1871 H= 467:45 +CPU= 42.953
  00:20:25 STEP 1872 H= 468:00 +CPU= 59.090
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001872
  00:21:08 STEP 1873 H= 468:15 +CPU= 42.986
  00:21:51 STEP 1874 H= 468:30 +CPU= 42.843
  00:22:34 STEP 1875 H= 468:45 +CPU= 42.804
  00:23:18 STEP 1876 H= 469:00 +CPU= 43.504
  00:24:01 STEP 1877 H= 469:15 +CPU= 42.885
  00:24:44 STEP 1878 H= 469:30 +CPU= 42.854
  00:25:27 STEP 1879 H= 469:45 +CPU= 42.885
  00:26:10 STEP 1880 H= 470:00 +CPU= 43.557
  00:26:53 STEP 1881 H= 470:15 +CPU= 42.838
  00:27:36 STEP 1882 H= 470:30 +CPU= 42.821
  00:28:19 STEP 1883 H= 470:45 +CPU= 42.890
  00:29:13 STEP 1884 H= 471:00 +CPU= 53.642
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001884
  00:29:56 STEP 1885 H= 471:15 +CPU= 43.021
  00:30:39 STEP 1886 H= 471:30 +CPU= 42.975
  00:31:22 STEP 1887 H= 471:45 +CPU= 43.041
  00:32:06 STEP 1888 H= 472:00 +CPU= 43.659
  00:32:49 STEP 1889 H= 472:15 +CPU= 43.034
  00:33:32 STEP 1890 H= 472:30 +CPU= 43.014
  00:34:15 STEP 1891 H= 472:45 +CPU= 43.017
  00:34:58 STEP 1892 H= 473:00 +CPU= 43.490
  00:35:41 STEP 1893 H= 473:15 +CPU= 42.930
  00:36:24 STEP 1894 H= 473:30 +CPU= 43.007
  00:37:08 STEP 1895 H= 473:45 +CPU= 42.997
  00:38:01 STEP 1896 H= 474:00 +CPU= 53.822
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001896
  00:38:45 STEP 1897 H= 474:15 +CPU= 43.035
  00:39:27 STEP 1898 H= 474:30 +CPU= 42.876
  00:40:11 STEP 1899 H= 474:45 +CPU= 43.006
  00:40:54 STEP 1900 H= 475:00 +CPU= 43.623
  00:41:37 STEP 1901 H= 475:15 +CPU= 42.913
  00:42:20 STEP 1902 H= 475:30 +CPU= 42.947
  00:43:03 STEP 1903 H= 475:45 +CPU= 42.963
  00:43:47 STEP 1904 H= 476:00 +CPU= 43.528
  00:44:30 STEP 1905 H= 476:15 +CPU= 42.896
  00:45:13 STEP 1906 H= 476:30 +CPU= 42.943
  00:45:56 STEP 1907 H= 476:45 +CPU= 42.916
  00:46:50 STEP 1908 H= 477:00 +CPU= 53.691
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001908
  00:47:33 STEP 1909 H= 477:15 +CPU= 42.974
  00:48:16 STEP 1910 H= 477:30 +CPU= 42.928
  00:48:59 STEP 1911 H= 477:45 +CPU= 42.878
  00:49:42 STEP 1912 H= 478:00 +CPU= 43.528
  00:50:25 STEP 1913 H= 478:15 +CPU= 42.862
  00:51:08 STEP 1914 H= 478:30 +CPU= 42.877
  00:51:51 STEP 1915 H= 478:45 +CPU= 42.837
  00:52:35 STEP 1916 H= 479:00 +CPU= 43.654
  00:53:18 STEP 1917 H= 479:15 +CPU= 42.942
  00:54:01 STEP 1918 H= 479:30 +CPU= 42.938
  00:54:44 STEP 1919 H= 479:45 +CPU= 42.956
  00:55:38 STEP 1920 H= 480:00 +CPU= 54.698
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9234005224E-22      I       0.2186221357E-06      I
ICloud fractionI      0.0000000000E+00      I       0.3310419922E-01      I
I  Relat. Hum. I      0.2562887547E+00      I       0.4297418658E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.7161322110E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    317137028 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS634274.1 Mbytes/s, TOTAL TIME=    0.0163( 3.1%)
 00:55:38 STEP 1920 H= 480:00 +CPU= 54.698
 END CNT3
 NSTEP =  1920 CNT0   000000000  39.436  39.436  39.504   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         5720/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    103    0       46      1044068     5720 ************    16.8     1.3    15.6     1.7    31.1
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 7761149.9 7761149.9    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 7758688.9 7758688.9     99.97      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  209    6249.5    6249.5     16.83      0.00
   9 SPCM     - SPECTRAL COMP.                     192    1809.1    1809.1      4.48      0.00
  10 SCAN2M - PHYSICS                              193   18958.4   18958.4     47.14      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 16    1335.5    1335.5      0.28      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  9      71.9      71.9      0.01      0.00
  17 GRIDFPOS IN CNT4                               16      37.7      37.7      0.01      0.00
  27 RESTART FILES - WRITING                         4    5341.8    5341.8      0.28      0.00
  28 RESTART FILES - READING                         1    2118.5    2118.5      0.03      0.00
  29 SU4FPOS IN CNT4                                16       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                16    8443.7    8443.7      1.74      0.00
  31 POSDDH IN STEPO                                 1       0.9       0.9      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    193    8183.2    8183.2     20.35      0.00
  39 SU0YOMB                                         1     168.4     168.4      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    193      21.9      21.9      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              192     357.3     357.3      0.88      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              192      63.6      63.6      0.16      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  9       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      420     578.0     578.0      3.13      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       400     325.2     325.2      1.68      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        400     136.9     136.9      0.71      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       420     227.7     227.7      1.23      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      31.8      31.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            420      60.2      60.2      0.33      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            400      34.4      34.4      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            420      90.6      90.6      0.49      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            400      57.6      57.6      0.30      0.00
 400 GSTATS                                      23311       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 21635       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     7761.1 CPU TIME    7749.0 VECTOR TIME     7749.0


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      222.7
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/5/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/5/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12291101/ICMGGh7zg+001836
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a252_2016092300_20_1018_12291101_0_r23095354_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
00:59:14 (3303): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Jun 2024 08:50:16 1541000 22444699 oifs_43r3_bl_a252_2016092300_20_1018_12291101_0 1,727,100 52,368 0.0303
14 Jun 2024 22:32:04 1541000 22444699 oifs_43r3_bl_a252_2016092300_20_1018_12291101_0 1,468,800 42,466 0.0289


©2024 cpdn.org