climateprediction.net home page
Task 22448028

Task 22448028

Name oifs_43r3_bl_a4p0_2016092300_20_1018_12294411_0
Workunit 12294411
Created 13 Jun 2024, 4:49:13 UTC
Sent 13 Jun 2024, 16:36:32 UTC
Report deadline 12 Aug 2024, 16:36:32 UTC
Received 18 Jun 2024, 16:20:07 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1489681
Run time 11 hours 11 min 41 sec
CPU time 10 hours 37 min 1 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 8.68 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,296.11 MB
Peak swap size 5,981.13 MB
Peak disk usage 2,037.56 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
n.net/oifs_43r3_bl_12294411/ICMUAh7zg+001548
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001560
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001560
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001560
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001572
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001572
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001572
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001584
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001584
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001584
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001596
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001596
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001596
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001608
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001608
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001608
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001620
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001620
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001620
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001632
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001632
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001632
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_a4p0_2016092300_20_1018_12294411_0_r1306239029_16.zip
Uploading the intermediate file: upload_file_16.zip
  15:39:15 STEP 1634 H= 408:30 +CPU= 17.626
  15:39:33 STEP 1635 H= 408:45 +CPU= 17.630
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:39:53 STEP 1636 H= 409:00 +CPU= 18.560
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:40:13 STEP 1637 H= 409:15 +CPU= 17.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:40:33 STEP 1638 H= 409:30 +CPU= 17.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:40:52 STEP 1639 H= 409:45 +CPU= 17.498
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:41:13 STEP 1640 H= 410:00 +CPU= 18.247
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:41:32 STEP 1641 H= 410:15 +CPU= 17.656
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:41:52 STEP 1642 H= 410:30 +CPU= 17.663
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:42:12 STEP 1643 H= 410:45 +CPU= 17.682
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:42:37 STEP 1644 H= 411:00 +CPU= 23.150
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001644
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001644
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001644
  15:42:57 STEP 1645 H= 411:15 +CPU= 17.771
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:43:17 STEP 1646 H= 411:30 +CPU= 17.822
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:43:37 STEP 1647 H= 411:45 +CPU= 17.909
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:43:57 STEP 1648 H= 412:00 +CPU= 18.519
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:44:17 STEP 1649 H= 412:15 +CPU= 17.762
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:44:37 STEP 1650 H= 412:30 +CPU= 17.669
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:44:56 STEP 1651 H= 412:45 +CPU= 17.653
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:17 STEP 1652 H= 413:00 +CPU= 18.355
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:36 STEP 1653 H= 413:15 +CPU= 17.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:56 STEP 1654 H= 413:30 +CPU= 17.682
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:16 STEP 1655 H= 413:45 +CPU= 17.691
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:43 STEP 1656 H= 414:00 +CPU= 23.271
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001656
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001656
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001656
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:47:03 STEP 1657 H= 414:15 +CPU= 17.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:47:22 STEP 1658 H= 414:30 +CPU= 17.603
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:47:42 STEP 1659 H= 414:45 +CPU= 17.585
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:48:02 STEP 1660 H= 415:00 +CPU= 18.372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:48:22 STEP 1661 H= 415:15 +CPU= 17.748
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:48:42 STEP 1662 H= 415:30 +CPU= 17.761
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:02 STEP 1663 H= 415:45 +CPU= 17.713
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:22 STEP 1664 H= 416:00 +CPU= 18.412
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:42 STEP 1665 H= 416:15 +CPU= 17.669
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:02 STEP 1666 H= 416:30 +CPU= 17.658
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:21 STEP 1667 H= 416:45 +CPU= 17.798
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:47 STEP 1668 H= 417:00 +CPU= 23.371
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001668
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001668
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001668
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:06 STEP 1669 H= 417:15 +CPU= 17.739
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:26 STEP 1670 H= 417:30 +CPU= 17.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:46 STEP 1671 H= 417:45 +CPU= 17.661
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:06 STEP 1672 H= 418:00 +CPU= 18.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:26 STEP 1673 H= 418:15 +CPU= 17.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:45 STEP 1674 H= 418:30 +CPU= 17.559
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:53:05 STEP 1675 H= 418:45 +CPU= 17.607
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:53:25 STEP 1676 H= 419:00 +CPU= 18.344
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:53:45 STEP 1677 H= 419:15 +CPU= 17.657
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:54:05 STEP 1678 H= 419:30 +CPU= 17.546
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:54:24 STEP 1679 H= 419:45 +CPU= 17.527
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:54:51 STEP 1680 H= 420:00 +CPU= 24.685
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001680
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001680
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:55:11 STEP 1681 H= 420:15 +CPU= 17.984
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:55:31 STEP 1682 H= 420:30 +CPU= 17.973
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:55:51 STEP 1683 H= 420:45 +CPU= 17.902
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:12 STEP 1684 H= 421:00 +CPU= 18.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:32 STEP 1685 H= 421:15 +CPU= 17.960
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:51 STEP 1686 H= 421:30 +CPU= 17.730
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:11 STEP 1687 H= 421:45 +CPU= 17.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:32 STEP 1688 H= 422:00 +CPU= 18.504
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:52 STEP 1689 H= 422:15 +CPU= 17.805
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:11 STEP 1690 H= 422:30 +CPU= 17.746
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:31 STEP 1691 H= 422:45 +CPU= 17.753
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:57 STEP 1692 H= 423:00 +CPU= 23.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001692
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001692
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001692
  15:59:16 STEP 1693 H= 423:15 +CPU= 17.680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:59:36 STEP 1694 H= 423:30 +CPU= 17.720
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:59:56 STEP 1695 H= 423:45 +CPU= 17.626
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:00:16 STEP 1696 H= 424:00 +CPU= 18.272
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:00:36 STEP 1697 H= 424:15 +CPU= 17.580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:00:55 STEP 1698 H= 424:30 +CPU= 17.579
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:15 STEP 1699 H= 424:45 +CPU= 17.598
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:35 STEP 1700 H= 425:00 +CPU= 18.293
  16:01:53 STEP 1701 H= 425:15 +CPU= 17.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:02:13 STEP 1702 H= 425:30 +CPU= 17.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:02:32 STEP 1703 H= 425:45 +CPU= 17.669
  16:02:56 STEP 1704 H= 426:00 +CPU= 23.325
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001704
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001704
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:15 STEP 1705 H= 426:15 +CPU= 17.720
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:35 STEP 1706 H= 426:30 +CPU= 17.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:55 STEP 1707 H= 426:45 +CPU= 17.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:15 STEP 1708 H= 427:00 +CPU= 18.387
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:35 STEP 1709 H= 427:15 +CPU= 17.566
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:54 STEP 1710 H= 427:30 +CPU= 17.564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:14 STEP 1711 H= 427:45 +CPU= 17.563
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:34 STEP 1712 H= 428:00 +CPU= 18.270
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:54 STEP 1713 H= 428:15 +CPU= 17.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:13 STEP 1714 H= 428:30 +CPU= 17.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:33 STEP 1715 H= 428:45 +CPU= 17.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:58 STEP 1716 H= 429:00 +CPU= 23.026
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001716
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001716
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001716
  16:07:16 STEP 1717 H= 429:15 +CPU= 17.521
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:07:35 STEP 1718 H= 429:30 +CPU= 17.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:07:55 STEP 1719 H= 429:45 +CPU= 17.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:15 STEP 1720 H= 430:00 +CPU= 18.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:34 STEP 1721 H= 430:15 +CPU= 17.500
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:54 STEP 1722 H= 430:30 +CPU= 17.499
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:13 STEP 1723 H= 430:45 +CPU= 17.502
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:34 STEP 1724 H= 431:00 +CPU= 18.196
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:53 STEP 1725 H= 431:15 +CPU= 17.506
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:13 STEP 1726 H= 431:30 +CPU= 17.580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:32 STEP 1727 H= 431:45 +CPU= 17.654
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:11:01 STEP 1728 H= 432:00 +CPU= 24.551
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001728
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001728
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:11:21 STEP 1729 H= 432:15 +CPU= 17.639
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001644
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001644
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001644
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001656
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001656
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001656
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001668
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001668
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001668
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001680
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001680
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001680
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001692
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001692
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001692
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001704
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001704
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001704
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001716
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001716
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001716
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001728
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001728
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001728
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_a4p0_2016092300_20_1018_12294411_0_r1306239029_17.zip
  16:11:39 STEP 1730 H= 432:30 +CPU= 17.664
Uploading the intermediate file: upload_file_17.zip
  16:11:57 STEP 1731 H= 432:45 +CPU= 17.790
  16:12:15 STEP 1732 H= 433:00 +CPU= 18.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:12:35 STEP 1733 H= 433:15 +CPU= 17.712
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:12:55 STEP 1734 H= 433:30 +CPU= 17.616
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:14 STEP 1735 H= 433:45 +CPU= 17.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:35 STEP 1736 H= 434:00 +CPU= 18.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:54 STEP 1737 H= 434:15 +CPU= 17.542
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:14:14 STEP 1738 H= 434:30 +CPU= 17.537
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:14:33 STEP 1739 H= 434:45 +CPU= 17.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:01 STEP 1740 H= 435:00 +CPU= 23.203
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001740
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001740
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001740
  16:15:18 STEP 1741 H= 435:15 +CPU= 17.553
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:38 STEP 1742 H= 435:30 +CPU= 17.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:57 STEP 1743 H= 435:45 +CPU= 17.557
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:16:18 STEP 1744 H= 436:00 +CPU= 18.303
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:16:37 STEP 1745 H= 436:15 +CPU= 17.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:16:57 STEP 1746 H= 436:30 +CPU= 17.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:17:17 STEP 1747 H= 436:45 +CPU= 17.618
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:17:37 STEP 1748 H= 437:00 +CPU= 18.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:17:57 STEP 1749 H= 437:15 +CPU= 17.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:18:16 STEP 1750 H= 437:30 +CPU= 17.591
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:18:36 STEP 1751 H= 437:45 +CPU= 17.570
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:19:03 STEP 1752 H= 438:00 +CPU= 23.117
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001752
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001752
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001752
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:19:23 STEP 1753 H= 438:15 +CPU= 17.566
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:19:42 STEP 1754 H= 438:30 +CPU= 17.555
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:20:02 STEP 1755 H= 438:45 +CPU= 17.566
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:20:22 STEP 1756 H= 439:00 +CPU= 18.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:20:42 STEP 1757 H= 439:15 +CPU= 17.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:21:02 STEP 1758 H= 439:30 +CPU= 17.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:21:21 STEP 1759 H= 439:45 +CPU= 17.560
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:21:41 STEP 1760 H= 440:00 +CPU= 18.220
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:22:01 STEP 1761 H= 440:15 +CPU= 17.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:22:21 STEP 1762 H= 440:30 +CPU= 17.623
  16:22:38 STEP 1763 H= 440:45 +CPU= 17.681
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:23:06 STEP 1764 H= 441:00 +CPU= 23.199
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001764
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001764
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001764
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:23:25 STEP 1765 H= 441:15 +CPU= 17.644
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:23:45 STEP 1766 H= 441:30 +CPU= 17.588
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:24:04 STEP 1767 H= 441:45 +CPU= 17.577
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:24:25 STEP 1768 H= 442:00 +CPU= 18.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:24:44 STEP 1769 H= 442:15 +CPU= 17.559
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:25:04 STEP 1770 H= 442:30 +CPU= 17.541
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:25:24 STEP 1771 H= 442:45 +CPU= 17.621
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:25:44 STEP 1772 H= 443:00 +CPU= 18.370
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:26:04 STEP 1773 H= 443:15 +CPU= 17.691
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:26:23 STEP 1774 H= 443:30 +CPU= 17.670
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:26:43 STEP 1775 H= 443:45 +CPU= 17.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:27:10 STEP 1776 H= 444:00 +CPU= 24.590
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001776
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001776
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:27:29 STEP 1777 H= 444:15 +CPU= 17.641
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:27:49 STEP 1778 H= 444:30 +CPU= 17.693
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:28:09 STEP 1779 H= 444:45 +CPU= 17.815
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:28:29 STEP 1780 H= 445:00 +CPU= 18.486
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:28:49 STEP 1781 H= 445:15 +CPU= 17.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:29:09 STEP 1782 H= 445:30 +CPU= 17.867
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:29:29 STEP 1783 H= 445:45 +CPU= 17.620
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:29:49 STEP 1784 H= 446:00 +CPU= 18.218
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:30:09 STEP 1785 H= 446:15 +CPU= 17.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:30:28 STEP 1786 H= 446:30 +CPU= 17.573
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:30:48 STEP 1787 H= 446:45 +CPU= 17.560
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:31:13 STEP 1788 H= 447:00 +CPU= 23.112
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001788
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001788
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001788
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:31:33 STEP 1789 H= 447:15 +CPU= 17.661
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:31:52 STEP 1790 H= 447:30 +CPU= 17.630
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:32:12 STEP 1791 H= 447:45 +CPU= 17.684
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:32:32 STEP 1792 H= 448:00 +CPU= 18.345
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:32:52 STEP 1793 H= 448:15 +CPU= 17.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:33:12 STEP 1794 H= 448:30 +CPU= 17.587
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:33:31 STEP 1795 H= 448:45 +CPU= 17.669
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:33:52 STEP 1796 H= 449:00 +CPU= 18.365
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:34:11 STEP 1797 H= 449:15 +CPU= 17.660
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:34:31 STEP 1798 H= 449:30 +CPU= 17.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:34:51 STEP 1799 H= 449:45 +CPU= 17.675
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:35:16 STEP 1800 H= 450:00 +CPU= 23.275
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001800
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001800
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001800
  16:35:36 STEP 1801 H= 450:15 +CPU= 17.625
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:35:55 STEP 1802 H= 450:30 +CPU= 17.581
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:36:15 STEP 1803 H= 450:45 +CPU= 17.688
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:36:36 STEP 1804 H= 451:00 +CPU= 18.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:36:56 STEP 1805 H= 451:15 +CPU= 17.896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:37:16 STEP 1806 H= 451:30 +CPU= 17.846
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:37:35 STEP 1807 H= 451:45 +CPU= 17.640
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:37:56 STEP 1808 H= 452:00 +CPU= 18.287
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:38:15 STEP 1809 H= 452:15 +CPU= 17.585
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:38:35 STEP 1810 H= 452:30 +CPU= 17.570
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:38:54 STEP 1811 H= 452:45 +CPU= 17.543
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:39:22 STEP 1812 H= 453:00 +CPU= 23.091
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001812
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001812
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001812
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:39:41 STEP 1813 H= 453:15 +CPU= 17.545
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:40:01 STEP 1814 H= 453:30 +CPU= 17.563
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:40:21 STEP 1815 H= 453:45 +CPU= 17.853
  16:40:39 STEP 1816 H= 454:00 +CPU= 18.385
  16:40:57 STEP 1817 H= 454:15 +CPU= 17.742
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:41:16 STEP 1818 H= 454:30 +CPU= 17.587
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:41:36 STEP 1819 H= 454:45 +CPU= 17.563
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:41:56 STEP 1820 H= 455:00 +CPU= 18.260
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:42:16 STEP 1821 H= 455:15 +CPU= 17.567
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:42:35 STEP 1822 H= 455:30 +CPU= 17.557
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:42:55 STEP 1823 H= 455:45 +CPU= 17.588
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:43:24 STEP 1824 H= 456:00 +CPU= 24.428
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001824
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001824
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:43:43 STEP 1825 H= 456:15 +CPU= 17.622
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001740
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001740
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001740
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001752
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001752
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001752
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001764
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001764
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001764
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001776
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001776
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001776
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001788
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001788
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001788
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001800
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001800
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001800
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001812
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001812
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001812
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001824
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001824
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001824
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_a4p0_2016092300_20_1018_12294411_0_r1306239029_18.zip
  16:44:01 STEP 1826 H= 456:30 +CPU= 17.632
Uploading the intermediate file: upload_file_18.zip
  16:44:19 STEP 1827 H= 456:45 +CPU= 17.575
  16:44:37 STEP 1828 H= 457:00 +CPU= 18.268
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:44:57 STEP 1829 H= 457:15 +CPU= 17.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:45:17 STEP 1830 H= 457:30 +CPU= 17.608
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:45:36 STEP 1831 H= 457:45 +CPU= 17.594
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:45:57 STEP 1832 H= 458:00 +CPU= 18.288
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:46:16 STEP 1833 H= 458:15 +CPU= 17.607
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:46:36 STEP 1834 H= 458:30 +CPU= 17.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:46:56 STEP 1835 H= 458:45 +CPU= 17.624
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:47:23 STEP 1836 H= 459:00 +CPU= 23.119
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001836
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001836
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:47:42 STEP 1837 H= 459:15 +CPU= 17.569
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:48:02 STEP 1838 H= 459:30 +CPU= 17.596
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:48:22 STEP 1839 H= 459:45 +CPU= 17.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:48:42 STEP 1840 H= 460:00 +CPU= 18.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:49:02 STEP 1841 H= 460:15 +CPU= 17.639
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:49:21 STEP 1842 H= 460:30 +CPU= 17.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:49:41 STEP 1843 H= 460:45 +CPU= 17.591
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:50:02 STEP 1844 H= 461:00 +CPU= 18.421
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:50:21 STEP 1845 H= 461:15 +CPU= 17.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:50:41 STEP 1846 H= 461:30 +CPU= 17.697
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:51:01 STEP 1847 H= 461:45 +CPU= 17.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:51:26 STEP 1848 H= 462:00 +CPU= 23.232
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001848
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001848
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001848
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:51:46 STEP 1849 H= 462:15 +CPU= 17.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:52:05 STEP 1850 H= 462:30 +CPU= 17.633
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:52:25 STEP 1851 H= 462:45 +CPU= 17.630
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:52:45 STEP 1852 H= 463:00 +CPU= 18.425
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:53:05 STEP 1853 H= 463:15 +CPU= 17.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:53:25 STEP 1854 H= 463:30 +CPU= 17.753
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:53:45 STEP 1855 H= 463:45 +CPU= 17.636
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:54:05 STEP 1856 H= 464:00 +CPU= 18.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:54:25 STEP 1857 H= 464:15 +CPU= 17.624
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:54:44 STEP 1858 H= 464:30 +CPU= 17.633
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:55:04 STEP 1859 H= 464:45 +CPU= 17.628
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:55:29 STEP 1860 H= 465:00 +CPU= 23.205
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001860
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001860
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:55:49 STEP 1861 H= 465:15 +CPU= 17.641
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:56:08 STEP 1862 H= 465:30 +CPU= 17.694
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:56:28 STEP 1863 H= 465:45 +CPU= 17.667
  16:56:46 STEP 1864 H= 466:00 +CPU= 18.277
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:57:06 STEP 1865 H= 466:15 +CPU= 17.655
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:57:26 STEP 1866 H= 466:30 +CPU= 17.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:57:46 STEP 1867 H= 466:45 +CPU= 17.656
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:58:06 STEP 1868 H= 467:00 +CPU= 18.430
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:58:26 STEP 1869 H= 467:15 +CPU= 17.998
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:58:46 STEP 1870 H= 467:30 +CPU= 18.055
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:59:06 STEP 1871 H= 467:45 +CPU= 17.995
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:59:33 STEP 1872 H= 468:00 +CPU= 24.682
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001872
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001872
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:59:53 STEP 1873 H= 468:15 +CPU= 17.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:00:13 STEP 1874 H= 468:30 +CPU= 17.895
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:00:33 STEP 1875 H= 468:45 +CPU= 17.860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:00:53 STEP 1876 H= 469:00 +CPU= 18.498
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:01:13 STEP 1877 H= 469:15 +CPU= 17.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:01:33 STEP 1878 H= 469:30 +CPU= 17.733
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:01:52 STEP 1879 H= 469:45 +CPU= 17.745
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:02:13 STEP 1880 H= 470:00 +CPU= 18.431
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:02:33 STEP 1881 H= 470:15 +CPU= 17.743
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:02:52 STEP 1882 H= 470:30 +CPU= 17.608
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:03:12 STEP 1883 H= 470:45 +CPU= 17.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:03:37 STEP 1884 H= 471:00 +CPU= 23.359
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001884
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001884
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:03:57 STEP 1885 H= 471:15 +CPU= 17.826
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:04:19 STEP 1886 H= 471:30 +CPU= 17.828
  17:04:37 STEP 1887 H= 471:45 +CPU= 17.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:04:59 STEP 1888 H= 472:00 +CPU= 18.389
  17:05:17 STEP 1889 H= 472:15 +CPU= 17.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:05:36 STEP 1890 H= 472:30 +CPU= 17.816
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:05:56 STEP 1891 H= 472:45 +CPU= 17.739
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:06:17 STEP 1892 H= 473:00 +CPU= 18.370
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:06:36 STEP 1893 H= 473:15 +CPU= 17.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:06:56 STEP 1894 H= 473:30 +CPU= 17.596
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:07:15 STEP 1895 H= 473:45 +CPU= 17.597
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:07:43 STEP 1896 H= 474:00 +CPU= 23.450
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001896
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001896
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:08:03 STEP 1897 H= 474:15 +CPU= 17.825
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:08:23 STEP 1898 H= 474:30 +CPU= 17.913
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:08:43 STEP 1899 H= 474:45 +CPU= 17.883
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:09:03 STEP 1900 H= 475:00 +CPU= 18.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:09:23 STEP 1901 H= 475:15 +CPU= 17.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:09:43 STEP 1902 H= 475:30 +CPU= 17.711
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:10:03 STEP 1903 H= 475:45 +CPU= 17.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:10:23 STEP 1904 H= 476:00 +CPU= 18.389
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:10:43 STEP 1905 H= 476:15 +CPU= 17.666
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:11:03 STEP 1906 H= 476:30 +CPU= 17.742
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:11:22 STEP 1907 H= 476:45 +CPU= 17.766
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:11:48 STEP 1908 H= 477:00 +CPU= 23.298
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001908
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001908
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:12:07 STEP 1909 H= 477:15 +CPU= 17.624
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:12:27 STEP 1910 H= 477:30 +CPU= 17.638
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:12:47 STEP 1911 H= 477:45 +CPU= 17.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:13:07 STEP 1912 H= 478:00 +CPU= 18.500
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:13:27 STEP 1913 H= 478:15 +CPU= 17.760
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:13:47 STEP 1914 H= 478:30 +CPU= 17.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:14:07 STEP 1915 H= 478:45 +CPU= 17.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:14:27 STEP 1916 H= 479:00 +CPU= 18.371
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:14:47 STEP 1917 H= 479:15 +CPU= 17.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:15:06 STEP 1918 H= 479:30 +CPU= 17.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:15:26 STEP 1919 H= 479:45 +CPU= 17.816
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:15:52 STEP 1920 H= 480:00 +CPU= 23.623
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.6708238211E-22      I       0.1289796369E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1286174613E-01      I
I  Relat. Hum. I      0.5510314441E-01      I       0.1330988512E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2603024326E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    321163396 BYTES IN      7 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0082( 1.2%)
 17:15:52 STEP 1920 H= 480:00 +CPU= 23.623
 END CNT3
 NSTEP =  1920 CNT0   000000000  17.443  17.443  19.463   0.896               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        47190/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    828    0       46      1044068    47190 ************    46.2     1.1    45.1     1.4   105.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1717    3073.3    3073.3     15.82      0.00
   9 SPCM     - SPECTRAL COMP.                    1584     395.9     395.9      1.88      0.00
  10 SCAN2M - PHYSICS                             1585   10707.2   10707.2     50.89      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                132     442.4     442.4      0.18      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 67      22.5      22.5      0.00      0.00
  17 GRIDFPOS IN CNT4                              132      18.8      18.8      0.01      0.00
  27 RESTART FILES - WRITING                        33    1769.3    1769.3      0.18      0.00
  28 RESTART FILES - READING                         1    1905.3    1905.3      0.01      0.00
  29 SU4FPOS IN CNT4                               132       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               132    5331.7    5331.7      2.11      0.00
  31 POSDDH IN STEPO                                 7       2.1       2.1      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1585    4537.9    4537.9     21.57      0.00
  39 SU0YOMB                                         1     294.7     294.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1585      10.0      10.0      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1584      67.0      67.0      0.32      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1584      30.2      30.2      0.14      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 67       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3436     274.4     274.4      2.83      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3300     187.2     187.2      1.85      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3300      61.9      61.9      0.61      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3436      91.1      91.1      0.94      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      38.1      38.1      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3436      32.7      32.7      0.34      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3300      15.8      15.8      0.16      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3436      26.2      26.2      0.27      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3300      16.8      16.8      0.17      0.00
 400 GSTATS                                     184233       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                171363       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    33348.5 CPU TIME   30031.5 VECTOR TIME    30031.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       51.8
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGh7zg+001920
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHh7zg+001920
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAh7zg+001920
Adding to the zip: /mnt/nvme/scratch1/boinc/slots/2/NODE.001_01
Adding to the zip: /mnt/nvme/scratch1/boinc/slots/2/ifs.stat
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+000288
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001836
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001836
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001836
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001848
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001848
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001848
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001860
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001860
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001860
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001872
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001872
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001872
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001884
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001884
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001884
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001896
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001896
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001896
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001908
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001908
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001908
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMGGh7zg+001920
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMSHh7zg+001920
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_12294411/ICMUAh7zg+001920
Zipping up the final file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_bl_a4p0_2016092300_20_1018_12294411_0_r1306239029_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
17:19:22 (1525007): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 Jun 2024 15:17:59 1489681 22448028 oifs_43r3_bl_a4p0_2016092300_20_1018_12294411_0 1,727,100 38,221 0.0221
18 Jun 2024 11:50:29 1489681 22448028 oifs_43r3_bl_a4p0_2016092300_20_1018_12294411_0 1,124,100 26,028 0.0232


©2024 climateprediction.net