climateprediction.net home page
Task 22442318

Task 22442318

Name oifs_43r3_bl_a0bv_2016092300_20_1018_12288754_0
Workunit 12288754
Created 12 Jun 2024, 20:35:44 UTC
Sent 13 Jun 2024, 16:36:32 UTC
Report deadline 12 Aug 2024, 16:36:32 UTC
Received 16 Jun 2024, 16:44:09 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1489681
Run time 12 hours 17 min 1 sec
CPU time 11 hours 41 min 14 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 8.68 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,158.78 MB
Peak swap size 5,981.13 MB
Peak disk usage 1,422.48 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
ng to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001656
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001656
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001656
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:55:46 STEP 1657 H= 414:15 +CPU= 21.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:09 STEP 1658 H= 414:30 +CPU= 21.459
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:33 STEP 1659 H= 414:45 +CPU= 21.511
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:59 STEP 1660 H= 415:00 +CPU= 21.845
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:22 STEP 1661 H= 415:15 +CPU= 21.118
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:45 STEP 1662 H= 415:30 +CPU= 21.070
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:08 STEP 1663 H= 415:45 +CPU= 20.974
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:33 STEP 1664 H= 416:00 +CPU= 21.896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:59 STEP 1665 H= 416:15 +CPU= 21.425
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:59:22 STEP 1666 H= 416:30 +CPU= 21.633
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:59:46 STEP 1667 H= 416:45 +CPU= 21.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:00:16 STEP 1668 H= 417:00 +CPU= 27.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001668
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001668
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001668
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:00:41 STEP 1669 H= 417:15 +CPU= 21.326
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:05 STEP 1670 H= 417:30 +CPU= 21.615
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:28 STEP 1671 H= 417:45 +CPU= 21.459
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:53 STEP 1672 H= 418:00 +CPU= 22.398
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:02:18 STEP 1673 H= 418:15 +CPU= 21.496
  16:02:40 STEP 1674 H= 418:30 +CPU= 21.577
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:05 STEP 1675 H= 418:45 +CPU= 21.483
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:30 STEP 1676 H= 419:00 +CPU= 22.124
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:54 STEP 1677 H= 419:15 +CPU= 21.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:20 STEP 1678 H= 419:30 +CPU= 21.577
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:43 STEP 1679 H= 419:45 +CPU= 21.584
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:18 STEP 1680 H= 420:00 +CPU= 30.335
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001680
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001680
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:41 STEP 1681 H= 420:15 +CPU= 21.553
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:05 STEP 1682 H= 420:30 +CPU= 21.490
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:28 STEP 1683 H= 420:45 +CPU= 21.473
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:53 STEP 1684 H= 421:00 +CPU= 22.186
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:07:18 STEP 1685 H= 421:15 +CPU= 21.184
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:07:41 STEP 1686 H= 421:30 +CPU= 21.552
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:05 STEP 1687 H= 421:45 +CPU= 21.421
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:29 STEP 1688 H= 422:00 +CPU= 22.129
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:52 STEP 1689 H= 422:15 +CPU= 21.337
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:16 STEP 1690 H= 422:30 +CPU= 21.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:41 STEP 1691 H= 422:45 +CPU= 21.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:11 STEP 1692 H= 423:00 +CPU= 27.505
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001692
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001692
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001692
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:34 STEP 1693 H= 423:15 +CPU= 21.247
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:59 STEP 1694 H= 423:30 +CPU= 20.960
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:11:22 STEP 1695 H= 423:45 +CPU= 20.960
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:11:46 STEP 1696 H= 424:00 +CPU= 21.681
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:12:09 STEP 1697 H= 424:15 +CPU= 21.104
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:12:32 STEP 1698 H= 424:30 +CPU= 21.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:12:55 STEP 1699 H= 424:45 +CPU= 21.102
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:21 STEP 1700 H= 425:00 +CPU= 21.928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:44 STEP 1701 H= 425:15 +CPU= 21.235
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:14:08 STEP 1702 H= 425:30 +CPU= 21.286
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:14:31 STEP 1703 H= 425:45 +CPU= 21.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:03 STEP 1704 H= 426:00 +CPU= 27.433
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001704
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001704
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:26 STEP 1705 H= 426:15 +CPU= 21.285
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:49 STEP 1706 H= 426:30 +CPU= 21.264
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:16:12 STEP 1707 H= 426:45 +CPU= 21.275
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:16:39 STEP 1708 H= 427:00 +CPU= 22.094
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:17:02 STEP 1709 H= 427:15 +CPU= 21.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:17:26 STEP 1710 H= 427:30 +CPU= 21.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:17:50 STEP 1711 H= 427:45 +CPU= 21.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:18:14 STEP 1712 H= 428:00 +CPU= 22.220
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:18:39 STEP 1713 H= 428:15 +CPU= 21.384
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:19:03 STEP 1714 H= 428:30 +CPU= 21.444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:19:26 STEP 1715 H= 428:45 +CPU= 21.145
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:19:55 STEP 1716 H= 429:00 +CPU= 26.483
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001716
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001716
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001716
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:20:20 STEP 1717 H= 429:15 +CPU= 20.929
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:20:43 STEP 1718 H= 429:30 +CPU= 21.449
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:21:07 STEP 1719 H= 429:45 +CPU= 21.542
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:21:31 STEP 1720 H= 430:00 +CPU= 22.102
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:21:54 STEP 1721 H= 430:15 +CPU= 21.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:22:19 STEP 1722 H= 430:30 +CPU= 21.323
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:22:43 STEP 1723 H= 430:45 +CPU= 21.104
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:23:06 STEP 1724 H= 431:00 +CPU= 21.669
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:23:29 STEP 1725 H= 431:15 +CPU= 20.887
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:23:52 STEP 1726 H= 431:30 +CPU= 21.054
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:24:15 STEP 1727 H= 431:45 +CPU= 21.008
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:24:50 STEP 1728 H= 432:00 +CPU= 30.184
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001728
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001728
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001728
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001632
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001632
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001632
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001644
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001644
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001644
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001656
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001656
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001656
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001668
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001668
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001668
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001680
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001680
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001680
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001692
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001692
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001692
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001704
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001704
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001704
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001716
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001716
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001716
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1018_12288754_0_r853734394_17.zip
Uploading the intermediate file: upload_file_17.zip
  16:25:11 STEP 1729 H= 432:15 +CPU= 21.383
  16:25:34 STEP 1730 H= 432:30 +CPU= 21.565
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:26:00 STEP 1731 H= 432:45 +CPU= 21.483
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:26:24 STEP 1732 H= 433:00 +CPU= 22.203
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:26:48 STEP 1733 H= 433:15 +CPU= 21.415
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:27:11 STEP 1734 H= 433:30 +CPU= 21.467
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:27:34 STEP 1735 H= 433:45 +CPU= 21.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:28:01 STEP 1736 H= 434:00 +CPU= 22.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:28:24 STEP 1737 H= 434:15 +CPU= 21.523
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:28:48 STEP 1738 H= 434:30 +CPU= 21.290
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:29:11 STEP 1739 H= 434:45 +CPU= 21.347
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:29:42 STEP 1740 H= 435:00 +CPU= 26.975
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001740
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001740
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001740
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:30:05 STEP 1741 H= 435:15 +CPU= 21.262
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:30:29 STEP 1742 H= 435:30 +CPU= 21.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:30:52 STEP 1743 H= 435:45 +CPU= 21.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:31:18 STEP 1744 H= 436:00 +CPU= 22.023
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:31:41 STEP 1745 H= 436:15 +CPU= 21.328
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:32:05 STEP 1746 H= 436:30 +CPU= 21.287
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:32:28 STEP 1747 H= 436:45 +CPU= 21.163
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:32:54 STEP 1748 H= 437:00 +CPU= 21.799
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:33:19 STEP 1749 H= 437:15 +CPU= 20.892
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:33:41 STEP 1750 H= 437:30 +CPU= 20.804
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:34:04 STEP 1751 H= 437:45 +CPU= 20.766
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:34:34 STEP 1752 H= 438:00 +CPU= 27.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001752
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001752
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001752
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:34:59 STEP 1753 H= 438:15 +CPU= 21.014
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:35:22 STEP 1754 H= 438:30 +CPU= 21.034
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:35:45 STEP 1755 H= 438:45 +CPU= 21.177
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:36:09 STEP 1756 H= 439:00 +CPU= 21.833
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:36:32 STEP 1757 H= 439:15 +CPU= 21.027
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:36:58 STEP 1758 H= 439:30 +CPU= 20.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:37:21 STEP 1759 H= 439:45 +CPU= 21.333
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:37:45 STEP 1760 H= 440:00 +CPU= 22.155
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:38:09 STEP 1761 H= 440:15 +CPU= 21.281
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:38:32 STEP 1762 H= 440:30 +CPU= 21.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:38:58 STEP 1763 H= 440:45 +CPU= 21.440
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:39:27 STEP 1764 H= 441:00 +CPU= 27.386
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001764
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001764
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001764
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:39:50 STEP 1765 H= 441:15 +CPU= 20.764
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:40:13 STEP 1766 H= 441:30 +CPU= 20.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:40:38 STEP 1767 H= 441:45 +CPU= 20.828
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:41:01 STEP 1768 H= 442:00 +CPU= 21.497
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:41:24 STEP 1769 H= 442:15 +CPU= 20.970
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:41:47 STEP 1770 H= 442:30 +CPU= 20.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:42:11 STEP 1771 H= 442:45 +CPU= 21.445
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:42:38 STEP 1772 H= 443:00 +CPU= 21.965
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:43:01 STEP 1773 H= 443:15 +CPU= 21.022
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:43:24 STEP 1774 H= 443:30 +CPU= 21.025
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:43:47 STEP 1775 H= 443:45 +CPU= 20.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:44:21 STEP 1776 H= 444:00 +CPU= 30.087
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001776
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001776
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:44:45 STEP 1777 H= 444:15 +CPU= 21.553
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:45:08 STEP 1778 H= 444:30 +CPU= 21.496
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:45:32 STEP 1779 H= 444:45 +CPU= 21.683
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:45:58 STEP 1780 H= 445:00 +CPU= 22.360
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:46:22 STEP 1781 H= 445:15 +CPU= 21.525
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:46:45 STEP 1782 H= 445:30 +CPU= 21.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:47:09 STEP 1783 H= 445:45 +CPU= 21.490
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:47:33 STEP 1784 H= 446:00 +CPU= 22.035
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:47:58 STEP 1785 H= 446:15 +CPU= 21.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:48:22 STEP 1786 H= 446:30 +CPU= 21.658
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:48:46 STEP 1787 H= 446:45 +CPU= 21.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:49:18 STEP 1788 H= 447:00 +CPU= 27.794
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001788
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001788
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001788
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:49:41 STEP 1789 H= 447:15 +CPU= 21.560
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:50:05 STEP 1790 H= 447:30 +CPU= 21.418
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:50:28 STEP 1791 H= 447:45 +CPU= 21.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:50:53 STEP 1792 H= 448:00 +CPU= 22.255
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:51:18 STEP 1793 H= 448:15 +CPU= 21.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:51:42 STEP 1794 H= 448:30 +CPU= 21.389
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:52:05 STEP 1795 H= 448:45 +CPU= 21.371
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:52:29 STEP 1796 H= 449:00 +CPU= 22.119
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:52:53 STEP 1797 H= 449:15 +CPU= 21.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:53:18 STEP 1798 H= 449:30 +CPU= 21.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:53:42 STEP 1799 H= 449:45 +CPU= 21.490
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:54:12 STEP 1800 H= 450:00 +CPU= 27.864
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001800
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001800
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:54:37 STEP 1801 H= 450:15 +CPU= 21.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:55:01 STEP 1802 H= 450:30 +CPU= 21.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:55:24 STEP 1803 H= 450:45 +CPU= 21.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:55:48 STEP 1804 H= 451:00 +CPU= 22.377
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:56:12 STEP 1805 H= 451:15 +CPU= 21.549
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:56:38 STEP 1806 H= 451:30 +CPU= 21.523
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:57:01 STEP 1807 H= 451:45 +CPU= 21.545
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:57:26 STEP 1808 H= 452:00 +CPU= 22.231
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:57:49 STEP 1809 H= 452:15 +CPU= 21.454
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:58:13 STEP 1810 H= 452:30 +CPU= 21.533
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:58:38 STEP 1811 H= 452:45 +CPU= 21.534
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:59:08 STEP 1812 H= 453:00 +CPU= 27.785
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001812
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001812
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001812
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:59:32 STEP 1813 H= 453:15 +CPU= 21.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:59:57 STEP 1814 H= 453:30 +CPU= 21.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:00:21 STEP 1815 H= 453:45 +CPU= 21.668
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:00:45 STEP 1816 H= 454:00 +CPU= 22.400
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:01:09 STEP 1817 H= 454:15 +CPU= 21.428
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:01:32 STEP 1818 H= 454:30 +CPU= 21.376
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:01:58 STEP 1819 H= 454:45 +CPU= 21.578
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:02:22 STEP 1820 H= 455:00 +CPU= 22.277
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:02:46 STEP 1821 H= 455:15 +CPU= 21.568
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:03:09 STEP 1822 H= 455:30 +CPU= 21.430
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:03:33 STEP 1823 H= 455:45 +CPU= 21.447
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:04:07 STEP 1824 H= 456:00 +CPU= 30.216
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001824
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001824
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001824
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001728
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001728
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001728
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001740
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001740
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001740
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001752
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001752
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001752
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001764
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001764
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001764
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001776
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001776
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001776
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001788
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001788
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001788
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001800
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001800
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001800
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001812
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001812
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001812
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1018_12288754_0_r853734394_18.zip
Uploading the intermediate file: upload_file_18.zip
  17:04:29 STEP 1825 H= 456:15 +CPU= 21.066
Uploading trickle at timestep: 1641600
  17:04:50 STEP 1826 H= 456:30 +CPU= 21.106
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:05:14 STEP 1827 H= 456:45 +CPU= 21.385
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:05:40 STEP 1828 H= 457:00 +CPU= 22.331
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:06:04 STEP 1829 H= 457:15 +CPU= 21.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:06:27 STEP 1830 H= 457:30 +CPU= 21.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:06:51 STEP 1831 H= 457:45 +CPU= 21.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:07:17 STEP 1832 H= 458:00 +CPU= 22.253
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:07:41 STEP 1833 H= 458:15 +CPU= 21.454
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:08:04 STEP 1834 H= 458:30 +CPU= 21.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:08:28 STEP 1835 H= 458:45 +CPU= 21.419
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:08:59 STEP 1836 H= 459:00 +CPU= 27.505
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001836
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001836
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:09:23 STEP 1837 H= 459:15 +CPU= 21.354
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:09:46 STEP 1838 H= 459:30 +CPU= 21.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:10:10 STEP 1839 H= 459:45 +CPU= 21.481
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:10:34 STEP 1840 H= 460:00 +CPU= 22.081
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:10:59 STEP 1841 H= 460:15 +CPU= 21.077
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:11:24 STEP 1842 H= 460:30 +CPU= 21.337
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:11:47 STEP 1843 H= 460:45 +CPU= 21.182
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:12:11 STEP 1844 H= 461:00 +CPU= 22.209
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:12:37 STEP 1845 H= 461:15 +CPU= 21.174
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:13:00 STEP 1846 H= 461:30 +CPU= 21.327
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:13:23 STEP 1847 H= 461:45 +CPU= 21.410
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:13:53 STEP 1848 H= 462:00 +CPU= 27.288
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001848
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001848
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001848
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:14:18 STEP 1849 H= 462:15 +CPU= 21.062
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:14:41 STEP 1850 H= 462:30 +CPU= 20.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:15:04 STEP 1851 H= 462:45 +CPU= 20.893
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:15:27 STEP 1852 H= 463:00 +CPU= 21.786
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:15:51 STEP 1853 H= 463:15 +CPU= 21.491
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:16:15 STEP 1854 H= 463:30 +CPU= 21.566
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:16:38 STEP 1855 H= 463:45 +CPU= 21.283
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:17:02 STEP 1856 H= 464:00 +CPU= 22.100
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:17:25 STEP 1857 H= 464:15 +CPU= 21.115
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:17:48 STEP 1858 H= 464:30 +CPU= 21.157
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:18:12 STEP 1859 H= 464:45 +CPU= 21.287
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:18:43 STEP 1860 H= 465:00 +CPU= 27.379
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001860
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001860
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:19:06 STEP 1861 H= 465:15 +CPU= 21.076
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:19:29 STEP 1862 H= 465:30 +CPU= 21.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:19:52 STEP 1863 H= 465:45 +CPU= 20.962
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:20:19 STEP 1864 H= 466:00 +CPU= 22.040
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:20:42 STEP 1865 H= 466:15 +CPU= 21.593
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:21:06 STEP 1866 H= 466:30 +CPU= 21.457
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:21:30 STEP 1867 H= 466:45 +CPU= 21.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:21:56 STEP 1868 H= 467:00 +CPU= 22.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:22:19 STEP 1869 H= 467:15 +CPU= 21.511
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:22:43 STEP 1870 H= 467:30 +CPU= 21.504
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:23:07 STEP 1871 H= 467:45 +CPU= 21.497
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:23:41 STEP 1872 H= 468:00 +CPU= 30.528
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001872
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001872
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:24:04 STEP 1873 H= 468:15 +CPU= 20.698
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:24:27 STEP 1874 H= 468:30 +CPU= 20.680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:24:49 STEP 1875 H= 468:45 +CPU= 20.625
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:25:13 STEP 1876 H= 469:00 +CPU= 21.478
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:25:38 STEP 1877 H= 469:15 +CPU= 20.833
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:26:01 STEP 1878 H= 469:30 +CPU= 21.016
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:26:24 STEP 1879 H= 469:45 +CPU= 21.362
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:26:49 STEP 1880 H= 470:00 +CPU= 22.246
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:27:12 STEP 1881 H= 470:15 +CPU= 21.496
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:27:37 STEP 1882 H= 470:30 +CPU= 21.269
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:28:01 STEP 1883 H= 470:45 +CPU= 21.313
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:28:30 STEP 1884 H= 471:00 +CPU= 26.966
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001884
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001884
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:28:53 STEP 1885 H= 471:15 +CPU= 21.194
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:29:19 STEP 1886 H= 471:30 +CPU= 21.613
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:29:42 STEP 1887 H= 471:45 +CPU= 21.672
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:30:07 STEP 1888 H= 472:00 +CPU= 22.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:30:30 STEP 1889 H= 472:15 +CPU= 21.285
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:30:53 STEP 1890 H= 472:30 +CPU= 21.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:31:19 STEP 1891 H= 472:45 +CPU= 21.441
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:31:43 STEP 1892 H= 473:00 +CPU= 22.067
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:32:06 STEP 1893 H= 473:15 +CPU= 20.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:32:29 STEP 1894 H= 473:30 +CPU= 21.078
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:32:53 STEP 1895 H= 473:45 +CPU= 21.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:33:24 STEP 1896 H= 474:00 +CPU= 27.198
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001896
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001896
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:33:47 STEP 1897 H= 474:15 +CPU= 20.975
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:34:10 STEP 1898 H= 474:30 +CPU= 21.193
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:34:34 STEP 1899 H= 474:45 +CPU= 21.296
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:34:59 STEP 1900 H= 475:00 +CPU= 21.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:35:22 STEP 1901 H= 475:15 +CPU= 20.860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:35:45 STEP 1902 H= 475:30 +CPU= 20.699
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:36:08 STEP 1903 H= 475:45 +CPU= 20.667
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:36:31 STEP 1904 H= 476:00 +CPU= 21.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:36:56 STEP 1905 H= 476:15 +CPU= 20.823
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:37:19 STEP 1906 H= 476:30 +CPU= 20.907
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:37:42 STEP 1907 H= 476:45 +CPU= 20.835
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:38:11 STEP 1908 H= 477:00 +CPU= 27.236
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001908
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001908
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:38:36 STEP 1909 H= 477:15 +CPU= 21.095
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:39:00 STEP 1910 H= 477:30 +CPU= 21.281
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:39:23 STEP 1911 H= 477:45 +CPU= 20.893
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:39:47 STEP 1912 H= 478:00 +CPU= 22.241
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:40:10 STEP 1913 H= 478:15 +CPU= 21.226
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:40:33 STEP 1914 H= 478:30 +CPU= 20.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:40:59 STEP 1915 H= 478:45 +CPU= 21.638
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:41:23 STEP 1916 H= 479:00 +CPU= 22.116
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:41:46 STEP 1917 H= 479:15 +CPU= 21.151
  17:42:07 STEP 1918 H= 479:30 +CPU= 21.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:42:31 STEP 1919 H= 479:45 +CPU= 21.213
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:43:05 STEP 1920 H= 480:00 +CPU= 28.661
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9761226304E-22      I      -0.5981926574E-06      I
ICloud fractionI      0.0000000000E+00      I       0.2956969586E-01      I
I  Relat. Hum. I      0.1026337956E-01      I       0.1535474637E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2806507180E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    311382148 BYTES IN      7 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0081( 1.2%)
 17:43:05 STEP 1920 H= 480:00 +CPU= 28.661
 END CNT3
 NSTEP =  1920 CNT0   000000000  20.846  20.846  24.039   0.867               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        31460/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    553    0       46      1044068    31460 ************    50.5     1.1    49.4     1.4    98.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1145    4062.7    4062.7     18.11      0.00
   9 SPCM     - SPECTRAL COMP.                    1056     464.2     464.2      1.91      0.00
  10 SCAN2M - PHYSICS                             1057   11582.7   11582.7     47.66      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 88     762.0     762.0      0.26      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 45      68.4      68.4      0.01      0.00
  17 GRIDFPOS IN CNT4                               88      20.0      20.0      0.01      0.00
  27 RESTART FILES - WRITING                        22    3048.2    3048.2      0.26      0.00
  28 RESTART FILES - READING                         1    1933.0    1933.0      0.01      0.00
  29 SU4FPOS IN CNT4                                88       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                88    5737.3    5737.3      1.97      0.00
  31 POSDDH IN STEPO                                 5       2.6       2.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1057    5412.5    5412.5     22.27      0.00
  39 SU0YOMB                                         1     299.8     299.8      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1057      13.4      13.4      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1056      84.2      84.2      0.35      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1056      44.4      44.4      0.18      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 45       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2292     321.2     321.2      2.87      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      2200     193.3     193.3      1.66      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       2200      76.4      76.4      0.65      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2292      94.5      94.5      0.84      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      39.5      39.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2292      76.1      76.1      0.68      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           2200      29.5      29.5      0.25      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2292      30.0      30.0      0.27      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           2200      18.6      18.6      0.16      0.00
 400 GSTATS                                     123195       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                114571       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    25685.9 CPU TIME   23067.9 VECTOR TIME    23067.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       67.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMGGh7zg+001920
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMSHh7zg+001920
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/1/ICMUAh7zg+001920
Adding to the zip: /mnt/nvme/scratch1/boinc/slots/1/NODE.001_01
Adding to the zip: /mnt/nvme/scratch1/boinc/slots/1/ifs.stat
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001824
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001824
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001824
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001836
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001836
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001836
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001848
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001848
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001848
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001860
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001860
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001860
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001872
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001872
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001872
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001884
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001884
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001884
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001896
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001896
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001896
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001908
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001908
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001908
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMGGh7zg+001920
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMSHh7zg+001920
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12288754/ICMUAh7zg+001920
Zipping up the final file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1018_12288754_0_r853734394_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
17:46:36 (2250961): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Jun 2024 16:44:52 1489681 22442318 oifs_43r3_bl_a0bv_2016092300_20_1018_12288754_0 1,727,100 42,074 0.0244
16 Jun 2024 15:44:21 1489681 22442318 oifs_43r3_bl_a0bv_2016092300_20_1018_12288754_0 1,641,600 39,976 0.0244


©2024 climateprediction.net