climateprediction.net home page
Task 22302883

Task 22302883

Name oifs_43r3_ps_0031_1997050100_123_966_12182675_2
Workunit 12182675
Created 24 Jan 2023, 11:23:23 UTC
Sent 24 Jan 2023, 11:38:39 UTC
Report deadline 25 Mar 2023, 11:38:39 UTC
Received 26 Jan 2023, 16:19:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1535032
Run time 11 hours 18 min 21 sec
CPU time 11 hours 12 min 44 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 6.01 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,392.85 MB
Peak swap size 4,974.14 MB
Peak disk usage 2,086.59 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
93:00 +CPU= 15.398
  18:20:02 STEP 1494 H=1494:00 +CPU= 24.221
  18:20:17 STEP 1495 H=1495:00 +CPU= 15.451
  18:20:33 STEP 1496 H=1496:00 +CPU= 15.857
  18:20:57 STEP 1497 H=1497:00 +CPU= 23.720
  18:21:13 STEP 1498 H=1498:00 +CPU= 15.842
  18:21:29 STEP 1499 H=1499:00 +CPU= 15.498
  18:21:55 STEP 1500 H=1500:00 +CPU= 26.171
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001500
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001500
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001500
  18:22:10 STEP 1501 H=1501:00 +CPU= 15.424
  18:22:26 STEP 1502 H=1502:00 +CPU= 15.823
  18:22:50 STEP 1503 H=1503:00 +CPU= 23.724
  18:23:06 STEP 1504 H=1504:00 +CPU= 15.847
  18:23:21 STEP 1505 H=1505:00 +CPU= 15.396
  18:23:46 STEP 1506 H=1506:00 +CPU= 24.222
  18:24:02 STEP 1507 H=1507:00 +CPU= 15.708
  18:24:18 STEP 1508 H=1508:00 +CPU= 16.053
  18:24:42 STEP 1509 H=1509:00 +CPU= 23.892
  18:24:58 STEP 1510 H=1510:00 +CPU= 15.897
  18:25:14 STEP 1511 H=1511:00 +CPU= 15.995
  18:25:43 STEP 1512 H=1512:00 +CPU= 28.170
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001512
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001512
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001512
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001488
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001488
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001488
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001500
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001500
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001500
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_62.zip
Uploading the intermediate file: upload_file_62.zip
  18:25:58 STEP 1513 H=1513:00 +CPU= 15.002
  18:26:14 STEP 1514 H=1514:00 +CPU= 15.930
  18:26:38 STEP 1515 H=1515:00 +CPU= 24.008
  18:26:54 STEP 1516 H=1516:00 +CPU= 15.972
  18:27:10 STEP 1517 H=1517:00 +CPU= 15.439
  18:27:35 STEP 1518 H=1518:00 +CPU= 24.131
  18:27:50 STEP 1519 H=1519:00 +CPU= 15.386
  18:28:06 STEP 1520 H=1520:00 +CPU= 15.761
  18:28:30 STEP 1521 H=1521:00 +CPU= 23.782
  18:28:46 STEP 1522 H=1522:00 +CPU= 15.828
  18:29:02 STEP 1523 H=1523:00 +CPU= 15.365
  18:29:28 STEP 1524 H=1524:00 +CPU= 26.069
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001524
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001524
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001524
  18:29:43 STEP 1525 H=1525:00 +CPU= 15.381
  18:29:59 STEP 1526 H=1526:00 +CPU= 15.813
  18:30:23 STEP 1527 H=1527:00 +CPU= 23.644
  18:30:39 STEP 1528 H=1528:00 +CPU= 15.802
  18:30:54 STEP 1529 H=1529:00 +CPU= 15.349
  18:31:18 STEP 1530 H=1530:00 +CPU= 24.078
  18:31:34 STEP 1531 H=1531:00 +CPU= 15.344
  18:31:50 STEP 1532 H=1532:00 +CPU= 15.745
  18:32:13 STEP 1533 H=1533:00 +CPU= 23.605
  18:32:29 STEP 1534 H=1534:00 +CPU= 15.760
  18:32:45 STEP 1535 H=1535:00 +CPU= 15.836
  18:33:13 STEP 1536 H=1536:00 +CPU= 27.921
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001536
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001536
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001536
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001512
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001512
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001512
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001524
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001524
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001524
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_63.zip
Uploading the intermediate file: upload_file_63.zip
  18:33:29 STEP 1537 H=1537:00 +CPU= 15.629
  18:33:45 STEP 1538 H=1538:00 +CPU= 16.015
  18:34:09 STEP 1539 H=1539:00 +CPU= 23.733
  18:34:25 STEP 1540 H=1540:00 +CPU= 15.820
  18:34:41 STEP 1541 H=1541:00 +CPU= 15.436
  18:35:05 STEP 1542 H=1542:00 +CPU= 24.237
  18:35:21 STEP 1543 H=1543:00 +CPU= 15.441
  18:35:37 STEP 1544 H=1544:00 +CPU= 15.884
  18:36:01 STEP 1545 H=1545:00 +CPU= 23.718
  18:36:17 STEP 1546 H=1546:00 +CPU= 16.014
  18:36:32 STEP 1547 H=1547:00 +CPU= 15.350
  18:36:58 STEP 1548 H=1548:00 +CPU= 25.960
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001548
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001548
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001548
  18:37:14 STEP 1549 H=1549:00 +CPU= 15.473
  18:37:30 STEP 1550 H=1550:00 +CPU= 15.795
  18:37:54 STEP 1551 H=1551:00 +CPU= 23.626
  18:38:09 STEP 1552 H=1552:00 +CPU= 15.754
  18:38:25 STEP 1553 H=1553:00 +CPU= 15.392
  18:38:50 STEP 1554 H=1554:00 +CPU= 24.284
  18:39:05 STEP 1555 H=1555:00 +CPU= 15.367
  18:39:21 STEP 1556 H=1556:00 +CPU= 15.705
  18:39:44 STEP 1557 H=1557:00 +CPU= 23.661
  18:40:00 STEP 1558 H=1558:00 +CPU= 15.743
  18:40:16 STEP 1559 H=1559:00 +CPU= 15.864
  18:40:45 STEP 1560 H=1560:00 +CPU= 28.001
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001560
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001560
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001560
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001536
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001536
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001536
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001548
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001548
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001548
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_64.zip
Uploading the intermediate file: upload_file_64.zip
  18:41:01 STEP 1561 H=1561:00 +CPU= 15.406
  18:41:17 STEP 1562 H=1562:00 +CPU= 15.780
  18:41:40 STEP 1563 H=1563:00 +CPU= 23.619
  18:41:56 STEP 1564 H=1564:00 +CPU= 15.787
  18:42:12 STEP 1565 H=1565:00 +CPU= 15.452
  18:42:37 STEP 1566 H=1566:00 +CPU= 24.095
  18:42:52 STEP 1567 H=1567:00 +CPU= 15.350
  18:43:08 STEP 1568 H=1568:00 +CPU= 15.836
  18:43:32 STEP 1569 H=1569:00 +CPU= 23.712
  18:43:48 STEP 1570 H=1570:00 +CPU= 15.788
  18:44:03 STEP 1571 H=1571:00 +CPU= 15.422
  18:44:30 STEP 1572 H=1572:00 +CPU= 26.131
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001572
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001572
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001572
  18:44:45 STEP 1573 H=1573:00 +CPU= 15.469
  18:45:01 STEP 1574 H=1574:00 +CPU= 15.830
  18:45:25 STEP 1575 H=1575:00 +CPU= 23.741
  18:45:41 STEP 1576 H=1576:00 +CPU= 15.819
  18:45:56 STEP 1577 H=1577:00 +CPU= 15.442
  18:46:21 STEP 1578 H=1578:00 +CPU= 24.107
  18:46:36 STEP 1579 H=1579:00 +CPU= 15.415
  18:46:52 STEP 1580 H=1580:00 +CPU= 15.773
  18:47:16 STEP 1581 H=1581:00 +CPU= 23.685
  18:47:32 STEP 1582 H=1582:00 +CPU= 15.792
  18:47:48 STEP 1583 H=1583:00 +CPU= 15.926
  18:48:16 STEP 1584 H=1584:00 +CPU= 27.912
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001584
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001584
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001584
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001560
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001560
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001560
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001572
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001572
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001572
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_65.zip
Uploading the intermediate file: upload_file_65.zip
  18:48:31 STEP 1585 H=1585:00 +CPU= 15.425
  18:48:48 STEP 1586 H=1586:00 +CPU= 15.817
  18:49:12 STEP 1587 H=1587:00 +CPU= 23.713
  18:49:27 STEP 1588 H=1588:00 +CPU= 15.829
  18:49:43 STEP 1589 H=1589:00 +CPU= 15.407
  18:50:07 STEP 1590 H=1590:00 +CPU= 24.172
  18:50:23 STEP 1591 H=1591:00 +CPU= 15.414
  18:50:38 STEP 1592 H=1592:00 +CPU= 15.792
  18:51:02 STEP 1593 H=1593:00 +CPU= 23.609
  18:51:20 STEP 1594 H=1594:00 +CPU= 15.999
  18:51:36 STEP 1595 H=1595:00 +CPU= 15.438
  18:52:03 STEP 1596 H=1596:00 +CPU= 26.110
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001596
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001596
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001596
  18:52:18 STEP 1597 H=1597:00 +CPU= 15.416
  18:52:35 STEP 1598 H=1598:00 +CPU= 15.946
  18:53:01 STEP 1599 H=1599:00 +CPU= 23.565
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:17:20 STEP 1600 H=1600:00 +CPU= 18.184
  14:17:39 STEP 1601 H=1601:00 +CPU= 15.807
  14:18:05 STEP 1602 H=1602:00 +CPU= 24.180
  14:18:20 STEP 1603 H=1603:00 +CPU= 15.448
  14:18:36 STEP 1604 H=1604:00 +CPU= 15.803
  14:19:00 STEP 1605 H=1605:00 +CPU= 23.785
  14:19:16 STEP 1606 H=1606:00 +CPU= 15.807
  14:19:32 STEP 1607 H=1607:00 +CPU= 15.889
  14:20:01 STEP 1608 H=1608:00 +CPU= 28.013
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001608
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001608
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001608
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001584
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001584
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001584
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001596
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001596
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001596
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_66.zip
Uploading the intermediate file: upload_file_66.zip
  14:20:16 STEP 1609 H=1609:00 +CPU= 15.310
  14:20:32 STEP 1610 H=1610:00 +CPU= 15.782
  14:20:56 STEP 1611 H=1611:00 +CPU= 23.709
  14:21:12 STEP 1612 H=1612:00 +CPU= 15.853
  14:21:27 STEP 1613 H=1613:00 +CPU= 15.401
  14:21:51 STEP 1614 H=1614:00 +CPU= 24.168
  14:22:07 STEP 1615 H=1615:00 +CPU= 15.381
  14:22:23 STEP 1616 H=1616:00 +CPU= 15.799
  14:22:47 STEP 1617 H=1617:00 +CPU= 23.743
  14:23:02 STEP 1618 H=1618:00 +CPU= 15.807
  14:23:18 STEP 1619 H=1619:00 +CPU= 15.443
  14:23:44 STEP 1620 H=1620:00 +CPU= 26.212
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001620
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001620
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001620
  14:24:00 STEP 1621 H=1621:00 +CPU= 15.390
  14:24:15 STEP 1622 H=1622:00 +CPU= 15.805
  14:24:39 STEP 1623 H=1623:00 +CPU= 23.631
  14:24:55 STEP 1624 H=1624:00 +CPU= 15.741
  14:25:11 STEP 1625 H=1625:00 +CPU= 15.412
  14:25:35 STEP 1626 H=1626:00 +CPU= 24.085
  14:25:50 STEP 1627 H=1627:00 +CPU= 15.380
  14:26:06 STEP 1628 H=1628:00 +CPU= 15.757
  14:26:30 STEP 1629 H=1629:00 +CPU= 23.782
  14:26:45 STEP 1630 H=1630:00 +CPU= 15.802
  14:27:01 STEP 1631 H=1631:00 +CPU= 15.780
  14:27:32 STEP 1632 H=1632:00 +CPU= 28.235
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001632
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001632
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001632
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001608
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001608
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001608
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001620
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001620
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001620
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_67.zip
Uploading the intermediate file: upload_file_67.zip
  14:27:48 STEP 1633 H=1633:00 +CPU= 15.455
  14:28:04 STEP 1634 H=1634:00 +CPU= 15.682
  14:28:28 STEP 1635 H=1635:00 +CPU= 23.637
  14:28:44 STEP 1636 H=1636:00 +CPU= 15.723
  14:29:00 STEP 1637 H=1637:00 +CPU= 15.393
  14:29:24 STEP 1638 H=1638:00 +CPU= 24.017
  14:29:39 STEP 1639 H=1639:00 +CPU= 15.305
  14:29:55 STEP 1640 H=1640:00 +CPU= 15.748
  14:30:19 STEP 1641 H=1641:00 +CPU= 23.608
  14:30:35 STEP 1642 H=1642:00 +CPU= 15.777
  14:30:50 STEP 1643 H=1643:00 +CPU= 15.336
  14:31:16 STEP 1644 H=1644:00 +CPU= 26.017
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001644
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001644
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001644
  14:31:32 STEP 1645 H=1645:00 +CPU= 15.355
  14:31:47 STEP 1646 H=1646:00 +CPU= 15.747
  14:32:11 STEP 1647 H=1647:00 +CPU= 23.610
  14:32:27 STEP 1648 H=1648:00 +CPU= 15.758
  14:32:42 STEP 1649 H=1649:00 +CPU= 15.353
  14:33:06 STEP 1650 H=1650:00 +CPU= 24.064
  14:33:22 STEP 1651 H=1651:00 +CPU= 15.372
  14:33:38 STEP 1652 H=1652:00 +CPU= 15.743
  14:34:01 STEP 1653 H=1653:00 +CPU= 23.520
  14:34:17 STEP 1654 H=1654:00 +CPU= 15.704
  14:34:33 STEP 1655 H=1655:00 +CPU= 15.777
  14:35:01 STEP 1656 H=1656:00 +CPU= 28.002
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001656
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001656
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001656
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001632
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001632
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001632
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001644
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001644
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001644
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_68.zip
Uploading the intermediate file: upload_file_68.zip
  14:35:17 STEP 1657 H=1657:00 +CPU= 15.354
  14:35:33 STEP 1658 H=1658:00 +CPU= 15.799
  14:35:56 STEP 1659 H=1659:00 +CPU= 23.569
  14:36:12 STEP 1660 H=1660:00 +CPU= 15.761
  14:36:27 STEP 1661 H=1661:00 +CPU= 15.353
  14:36:51 STEP 1662 H=1662:00 +CPU= 24.037
  14:37:07 STEP 1663 H=1663:00 +CPU= 15.386
  14:37:23 STEP 1664 H=1664:00 +CPU= 15.803
  14:37:47 STEP 1665 H=1665:00 +CPU= 23.636
  14:38:02 STEP 1666 H=1666:00 +CPU= 15.733
  14:38:18 STEP 1667 H=1667:00 +CPU= 15.362
  14:38:44 STEP 1668 H=1668:00 +CPU= 26.084
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001668
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001668
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001668
  14:38:59 STEP 1669 H=1669:00 +CPU= 15.350
  14:39:15 STEP 1670 H=1670:00 +CPU= 15.768
  14:39:39 STEP 1671 H=1671:00 +CPU= 23.585
  14:39:55 STEP 1672 H=1672:00 +CPU= 15.781
  14:40:10 STEP 1673 H=1673:00 +CPU= 15.405
  14:40:34 STEP 1674 H=1674:00 +CPU= 24.077
  14:40:50 STEP 1675 H=1675:00 +CPU= 15.317
  14:41:05 STEP 1676 H=1676:00 +CPU= 15.766
  14:41:29 STEP 1677 H=1677:00 +CPU= 23.656
  14:41:45 STEP 1678 H=1678:00 +CPU= 15.756
  14:42:01 STEP 1679 H=1679:00 +CPU= 15.796
  14:42:30 STEP 1680 H=1680:00 +CPU= 28.023
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001680
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001680
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001680
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001656
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001656
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001656
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001668
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001668
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001668
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_69.zip
Uploading the intermediate file: upload_file_69.zip
  14:42:46 STEP 1681 H=1681:00 +CPU= 15.305
Uploading trickle at timestep: 6048000
  14:43:01 STEP 1682 H=1682:00 +CPU= 15.724
  14:43:25 STEP 1683 H=1683:00 +CPU= 23.636
  14:43:41 STEP 1684 H=1684:00 +CPU= 15.681
  14:43:56 STEP 1685 H=1685:00 +CPU= 15.337
  14:44:20 STEP 1686 H=1686:00 +CPU= 24.080
  14:44:36 STEP 1687 H=1687:00 +CPU= 15.322
  14:44:51 STEP 1688 H=1688:00 +CPU= 15.734
  14:45:15 STEP 1689 H=1689:00 +CPU= 23.586
  14:45:31 STEP 1690 H=1690:00 +CPU= 15.754
  14:45:46 STEP 1691 H=1691:00 +CPU= 15.378
  14:46:13 STEP 1692 H=1692:00 +CPU= 26.030
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001692
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001692
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001692
  14:46:28 STEP 1693 H=1693:00 +CPU= 15.323
  14:46:44 STEP 1694 H=1694:00 +CPU= 15.708
  14:47:07 STEP 1695 H=1695:00 +CPU= 23.562
  14:47:23 STEP 1696 H=1696:00 +CPU= 15.740
  14:47:39 STEP 1697 H=1697:00 +CPU= 15.333
  14:48:03 STEP 1698 H=1698:00 +CPU= 24.028
  14:48:18 STEP 1699 H=1699:00 +CPU= 15.339
  14:48:34 STEP 1700 H=1700:00 +CPU= 15.782
  14:48:58 STEP 1701 H=1701:00 +CPU= 23.609
  14:49:13 STEP 1702 H=1702:00 +CPU= 15.713
  14:49:29 STEP 1703 H=1703:00 +CPU= 15.798
  14:49:57 STEP 1704 H=1704:00 +CPU= 27.936
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001704
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001704
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001704
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001680
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001680
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001680
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001692
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001692
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001692
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_70.zip
Uploading the intermediate file: upload_file_70.zip
  14:50:13 STEP 1705 H=1705:00 +CPU= 15.298
  14:50:29 STEP 1706 H=1706:00 +CPU= 15.774
  14:50:53 STEP 1707 H=1707:00 +CPU= 23.655
  14:51:08 STEP 1708 H=1708:00 +CPU= 15.710
  14:51:24 STEP 1709 H=1709:00 +CPU= 15.312
  14:51:48 STEP 1710 H=1710:00 +CPU= 24.072
  14:52:03 STEP 1711 H=1711:00 +CPU= 15.361
  14:52:19 STEP 1712 H=1712:00 +CPU= 15.754
  14:52:43 STEP 1713 H=1713:00 +CPU= 23.575
  14:52:58 STEP 1714 H=1714:00 +CPU= 15.775
  14:53:14 STEP 1715 H=1715:00 +CPU= 15.392
  14:53:40 STEP 1716 H=1716:00 +CPU= 25.959
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001716
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001716
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001716
  14:53:55 STEP 1717 H=1717:00 +CPU= 15.323
  14:54:11 STEP 1718 H=1718:00 +CPU= 15.800
  14:54:35 STEP 1719 H=1719:00 +CPU= 23.539
  14:54:50 STEP 1720 H=1720:00 +CPU= 15.720
  14:55:06 STEP 1721 H=1721:00 +CPU= 15.381
  14:55:30 STEP 1722 H=1722:00 +CPU= 24.114
  14:55:46 STEP 1723 H=1723:00 +CPU= 15.358
  14:56:01 STEP 1724 H=1724:00 +CPU= 15.734
  14:56:25 STEP 1725 H=1725:00 +CPU= 23.632
  14:56:41 STEP 1726 H=1726:00 +CPU= 15.722
  14:56:57 STEP 1727 H=1727:00 +CPU= 15.825
  14:57:26 STEP 1728 H=1728:00 +CPU= 28.085
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001728
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001728
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001728
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001704
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001704
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001704
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001716
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001716
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001716
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_71.zip
Uploading the intermediate file: upload_file_71.zip
  14:57:42 STEP 1729 H=1729:00 +CPU= 15.414
  14:57:58 STEP 1730 H=1730:00 +CPU= 15.740
  14:58:21 STEP 1731 H=1731:00 +CPU= 23.656
  14:58:37 STEP 1732 H=1732:00 +CPU= 15.781
  14:58:52 STEP 1733 H=1733:00 +CPU= 15.397
  14:59:17 STEP 1734 H=1734:00 +CPU= 24.111
  14:59:32 STEP 1735 H=1735:00 +CPU= 15.416
  14:59:48 STEP 1736 H=1736:00 +CPU= 15.799
  15:00:12 STEP 1737 H=1737:00 +CPU= 23.674
  15:00:28 STEP 1738 H=1738:00 +CPU= 15.820
  15:00:43 STEP 1739 H=1739:00 +CPU= 15.393
  15:01:09 STEP 1740 H=1740:00 +CPU= 26.058
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001740
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001740
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001740
  15:01:25 STEP 1741 H=1741:00 +CPU= 15.378
  15:01:40 STEP 1742 H=1742:00 +CPU= 15.821
  15:02:04 STEP 1743 H=1743:00 +CPU= 23.706
  15:02:20 STEP 1744 H=1744:00 +CPU= 15.787
  15:02:36 STEP 1745 H=1745:00 +CPU= 15.408
  15:03:00 STEP 1746 H=1746:00 +CPU= 24.033
  15:03:15 STEP 1747 H=1747:00 +CPU= 15.371
  15:03:31 STEP 1748 H=1748:00 +CPU= 15.753
  15:03:55 STEP 1749 H=1749:00 +CPU= 23.637
  15:04:11 STEP 1750 H=1750:00 +CPU= 15.794
  15:04:26 STEP 1751 H=1751:00 +CPU= 15.814
  15:04:55 STEP 1752 H=1752:00 +CPU= 28.036
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001752
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001752
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001752
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001728
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001728
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001728
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001740
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001740
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001740
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_72.zip
Uploading the intermediate file: upload_file_72.zip
  15:05:10 STEP 1753 H=1753:00 +CPU= 15.402
  15:05:26 STEP 1754 H=1754:00 +CPU= 15.812
  15:05:50 STEP 1755 H=1755:00 +CPU= 23.714
  15:06:06 STEP 1756 H=1756:00 +CPU= 15.609
  15:06:21 STEP 1757 H=1757:00 +CPU= 14.998
  15:06:45 STEP 1758 H=1758:00 +CPU= 24.116
  15:07:00 STEP 1759 H=1759:00 +CPU= 15.368
  15:07:16 STEP 1760 H=1760:00 +CPU= 15.780
  15:07:40 STEP 1761 H=1761:00 +CPU= 23.643
  15:07:56 STEP 1762 H=1762:00 +CPU= 15.768
  15:08:11 STEP 1763 H=1763:00 +CPU= 15.353
  15:08:37 STEP 1764 H=1764:00 +CPU= 25.994
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001764
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001764
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001764
  15:08:52 STEP 1765 H=1765:00 +CPU= 15.348
  15:09:08 STEP 1766 H=1766:00 +CPU= 15.720
  15:09:32 STEP 1767 H=1767:00 +CPU= 23.575
  15:09:47 STEP 1768 H=1768:00 +CPU= 15.727
  15:10:03 STEP 1769 H=1769:00 +CPU= 15.397
  15:10:27 STEP 1770 H=1770:00 +CPU= 24.093
  15:10:43 STEP 1771 H=1771:00 +CPU= 15.334
  15:10:59 STEP 1772 H=1772:00 +CPU= 15.774
  15:11:22 STEP 1773 H=1773:00 +CPU= 23.783
  15:11:38 STEP 1774 H=1774:00 +CPU= 15.777
  15:11:54 STEP 1775 H=1775:00 +CPU= 15.800
  15:12:23 STEP 1776 H=1776:00 +CPU= 28.062
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001776
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001776
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001776
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001752
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001752
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001752
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001764
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001764
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001764
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_73.zip
Uploading the intermediate file: upload_file_73.zip
  15:12:39 STEP 1777 H=1777:00 +CPU= 15.440
  15:12:55 STEP 1778 H=1778:00 +CPU= 15.793
  15:13:19 STEP 1779 H=1779:00 +CPU= 23.745
  15:13:35 STEP 1780 H=1780:00 +CPU= 15.783
  15:13:50 STEP 1781 H=1781:00 +CPU= 15.367
  15:14:15 STEP 1782 H=1782:00 +CPU= 24.135
  15:14:30 STEP 1783 H=1783:00 +CPU= 15.386
  15:14:46 STEP 1784 H=1784:00 +CPU= 15.812
  15:15:10 STEP 1785 H=1785:00 +CPU= 23.695
  15:15:26 STEP 1786 H=1786:00 +CPU= 15.837
  15:15:41 STEP 1787 H=1787:00 +CPU= 15.523
  15:16:07 STEP 1788 H=1788:00 +CPU= 26.078
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001788
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001788
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001788
  15:16:23 STEP 1789 H=1789:00 +CPU= 15.403
  15:16:39 STEP 1790 H=1790:00 +CPU= 15.855
  15:17:02 STEP 1791 H=1791:00 +CPU= 23.619
  15:17:18 STEP 1792 H=1792:00 +CPU= 15.811
  15:17:34 STEP 1793 H=1793:00 +CPU= 15.409
  15:17:58 STEP 1794 H=1794:00 +CPU= 24.124
  15:18:13 STEP 1795 H=1795:00 +CPU= 15.393
  15:18:29 STEP 1796 H=1796:00 +CPU= 15.761
  15:18:53 STEP 1797 H=1797:00 +CPU= 23.718
  15:19:09 STEP 1798 H=1798:00 +CPU= 15.792
  15:19:25 STEP 1799 H=1799:00 +CPU= 15.889
  15:19:53 STEP 1800 H=1800:00 +CPU= 28.098
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001800
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001800
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001800
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001776
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001776
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001776
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001788
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001788
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001788
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_74.zip
Uploading the intermediate file: upload_file_74.zip
  15:20:09 STEP 1801 H=1801:00 +CPU= 15.397
  15:20:25 STEP 1802 H=1802:00 +CPU= 15.848
  15:20:49 STEP 1803 H=1803:00 +CPU= 23.694
  15:21:05 STEP 1804 H=1804:00 +CPU= 15.768
  15:21:20 STEP 1805 H=1805:00 +CPU= 15.397
  15:21:44 STEP 1806 H=1806:00 +CPU= 24.235
  15:22:00 STEP 1807 H=1807:00 +CPU= 15.430
  15:22:16 STEP 1808 H=1808:00 +CPU= 15.841
  15:22:39 STEP 1809 H=1809:00 +CPU= 23.730
  15:22:55 STEP 1810 H=1810:00 +CPU= 15.845
  15:23:11 STEP 1811 H=1811:00 +CPU= 15.417
  15:23:37 STEP 1812 H=1812:00 +CPU= 26.117
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001812
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001812
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001812
  15:23:52 STEP 1813 H=1813:00 +CPU= 15.426
  15:24:08 STEP 1814 H=1814:00 +CPU= 15.802
  15:24:32 STEP 1815 H=1815:00 +CPU= 23.630
  15:24:48 STEP 1816 H=1816:00 +CPU= 15.831
  15:25:03 STEP 1817 H=1817:00 +CPU= 15.400
  15:25:28 STEP 1818 H=1818:00 +CPU= 24.093
  15:25:43 STEP 1819 H=1819:00 +CPU= 15.388
  15:25:59 STEP 1820 H=1820:00 +CPU= 15.787
  15:26:23 STEP 1821 H=1821:00 +CPU= 23.688
  15:26:38 STEP 1822 H=1822:00 +CPU= 15.763
  15:26:54 STEP 1823 H=1823:00 +CPU= 15.874
  15:27:23 STEP 1824 H=1824:00 +CPU= 28.094
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001824
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001824
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001824
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001800
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001800
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001800
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001812
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001812
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001812
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_75.zip
Uploading the intermediate file: upload_file_75.zip
  15:27:39 STEP 1825 H=1825:00 +CPU= 15.373
  15:27:55 STEP 1826 H=1826:00 +CPU= 15.997
  15:28:19 STEP 1827 H=1827:00 +CPU= 23.690
  15:28:35 STEP 1828 H=1828:00 +CPU= 15.784
  15:28:50 STEP 1829 H=1829:00 +CPU= 15.422
  15:29:14 STEP 1830 H=1830:00 +CPU= 24.208
  15:29:30 STEP 1831 H=1831:00 +CPU= 15.435
  15:29:46 STEP 1832 H=1832:00 +CPU= 15.807
  15:30:09 STEP 1833 H=1833:00 +CPU= 23.691
  15:30:25 STEP 1834 H=1834:00 +CPU= 15.806
  15:30:41 STEP 1835 H=1835:00 +CPU= 15.413
  15:31:07 STEP 1836 H=1836:00 +CPU= 26.170
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001836
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001836
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001836
  15:31:23 STEP 1837 H=1837:00 +CPU= 15.448
  15:31:39 STEP 1838 H=1838:00 +CPU= 15.824
  15:32:02 STEP 1839 H=1839:00 +CPU= 23.717
  15:32:18 STEP 1840 H=1840:00 +CPU= 15.872
  15:32:34 STEP 1841 H=1841:00 +CPU= 15.457
  15:32:58 STEP 1842 H=1842:00 +CPU= 24.129
  15:33:14 STEP 1843 H=1843:00 +CPU= 15.409
  15:33:30 STEP 1844 H=1844:00 +CPU= 15.811
  15:33:53 STEP 1845 H=1845:00 +CPU= 23.704
  15:34:09 STEP 1846 H=1846:00 +CPU= 15.762
  15:34:25 STEP 1847 H=1847:00 +CPU= 15.842
  15:34:53 STEP 1848 H=1848:00 +CPU= 28.022
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001848
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001848
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001848
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001824
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001824
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001824
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001836
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001836
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001836
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_76.zip
Uploading the intermediate file: upload_file_76.zip
  15:35:09 STEP 1849 H=1849:00 +CPU= 15.402
  15:35:25 STEP 1850 H=1850:00 +CPU= 15.881
  15:35:49 STEP 1851 H=1851:00 +CPU= 23.712
  15:36:05 STEP 1852 H=1852:00 +CPU= 15.818
  15:36:20 STEP 1853 H=1853:00 +CPU= 15.526
  15:36:45 STEP 1854 H=1854:00 +CPU= 24.190
  15:37:00 STEP 1855 H=1855:00 +CPU= 15.421
  15:37:16 STEP 1856 H=1856:00 +CPU= 15.849
  15:37:40 STEP 1857 H=1857:00 +CPU= 23.808
  15:37:56 STEP 1858 H=1858:00 +CPU= 15.894
  15:38:11 STEP 1859 H=1859:00 +CPU= 15.503
  15:38:38 STEP 1860 H=1860:00 +CPU= 26.243
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001860
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001860
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001860
  15:38:53 STEP 1861 H=1861:00 +CPU= 15.524
  15:39:09 STEP 1862 H=1862:00 +CPU= 15.778
  15:39:33 STEP 1863 H=1863:00 +CPU= 23.624
  15:39:49 STEP 1864 H=1864:00 +CPU= 15.801
  15:40:04 STEP 1865 H=1865:00 +CPU= 15.433
  15:40:28 STEP 1866 H=1866:00 +CPU= 24.090
  15:40:44 STEP 1867 H=1867:00 +CPU= 15.386
  15:41:00 STEP 1868 H=1868:00 +CPU= 15.808
  15:41:23 STEP 1869 H=1869:00 +CPU= 23.663
  15:41:39 STEP 1870 H=1870:00 +CPU= 15.775
  15:41:55 STEP 1871 H=1871:00 +CPU= 15.848
  15:42:24 STEP 1872 H=1872:00 +CPU= 28.143
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001872
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001872
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001872
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001848
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001848
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001848
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001860
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001860
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001860
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_77.zip
Uploading the intermediate file: upload_file_77.zip
  15:42:39 STEP 1873 H=1873:00 +CPU= 15.359
  15:42:55 STEP 1874 H=1874:00 +CPU= 15.783
  15:43:19 STEP 1875 H=1875:00 +CPU= 23.637
  15:43:35 STEP 1876 H=1876:00 +CPU= 15.782
  15:43:50 STEP 1877 H=1877:00 +CPU= 15.412
  15:44:15 STEP 1878 H=1878:00 +CPU= 24.312
  15:44:30 STEP 1879 H=1879:00 +CPU= 15.454
  15:44:46 STEP 1880 H=1880:00 +CPU= 15.821
  15:45:10 STEP 1881 H=1881:00 +CPU= 23.713
  15:45:26 STEP 1882 H=1882:00 +CPU= 15.811
  15:45:41 STEP 1883 H=1883:00 +CPU= 15.407
  15:46:07 STEP 1884 H=1884:00 +CPU= 26.072
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001884
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001884
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001884
  15:46:23 STEP 1885 H=1885:00 +CPU= 15.461
  15:46:39 STEP 1886 H=1886:00 +CPU= 15.840
  15:47:03 STEP 1887 H=1887:00 +CPU= 23.649
  15:47:18 STEP 1888 H=1888:00 +CPU= 15.769
  15:47:34 STEP 1889 H=1889:00 +CPU= 15.440
  15:47:58 STEP 1890 H=1890:00 +CPU= 24.140
  15:48:14 STEP 1891 H=1891:00 +CPU= 15.395
  15:48:29 STEP 1892 H=1892:00 +CPU= 15.783
  15:48:53 STEP 1893 H=1893:00 +CPU= 23.694
  15:49:09 STEP 1894 H=1894:00 +CPU= 15.748
  15:49:25 STEP 1895 H=1895:00 +CPU= 15.835
  15:49:53 STEP 1896 H=1896:00 +CPU= 27.836
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001896
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001896
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001896
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001872
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001872
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001872
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001884
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001884
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001884
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_78.zip
Uploading the intermediate file: upload_file_78.zip
  15:50:08 STEP 1897 H=1897:00 +CPU= 14.616
  15:50:24 STEP 1898 H=1898:00 +CPU= 15.820
  15:50:48 STEP 1899 H=1899:00 +CPU= 23.795
  15:51:03 STEP 1900 H=1900:00 +CPU= 15.869
  15:51:19 STEP 1901 H=1901:00 +CPU= 15.574
  15:51:43 STEP 1902 H=1902:00 +CPU= 24.234
  15:51:59 STEP 1903 H=1903:00 +CPU= 15.533
  15:52:15 STEP 1904 H=1904:00 +CPU= 15.867
  15:52:39 STEP 1905 H=1905:00 +CPU= 23.768
  15:52:55 STEP 1906 H=1906:00 +CPU= 15.856
  15:53:10 STEP 1907 H=1907:00 +CPU= 15.491
  15:53:37 STEP 1908 H=1908:00 +CPU= 26.297
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001908
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001908
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001908
  15:53:52 STEP 1909 H=1909:00 +CPU= 15.486
  15:54:08 STEP 1910 H=1910:00 +CPU= 15.899
  15:54:32 STEP 1911 H=1911:00 +CPU= 23.799
  15:54:48 STEP 1912 H=1912:00 +CPU= 15.904
  15:55:03 STEP 1913 H=1913:00 +CPU= 15.455
  15:55:28 STEP 1914 H=1914:00 +CPU= 24.232
  15:55:43 STEP 1915 H=1915:00 +CPU= 15.446
  15:55:59 STEP 1916 H=1916:00 +CPU= 15.852
  15:56:23 STEP 1917 H=1917:00 +CPU= 23.698
  15:56:39 STEP 1918 H=1918:00 +CPU= 15.808
  15:56:55 STEP 1919 H=1919:00 +CPU= 15.886
  15:57:24 STEP 1920 H=1920:00 +CPU= 28.279
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001920
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001920
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001920
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001896
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001896
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001896
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001908
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001908
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001908
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_79.zip
Uploading the intermediate file: upload_file_79.zip
  15:57:40 STEP 1921 H=1921:00 +CPU= 15.440
Uploading trickle at timestep: 6912000
  15:57:55 STEP 1922 H=1922:00 +CPU= 15.842
  15:58:20 STEP 1923 H=1923:00 +CPU= 23.812
  15:58:35 STEP 1924 H=1924:00 +CPU= 15.897
  15:58:51 STEP 1925 H=1925:00 +CPU= 15.516
  15:59:15 STEP 1926 H=1926:00 +CPU= 24.285
  15:59:31 STEP 1927 H=1927:00 +CPU= 15.467
  15:59:47 STEP 1928 H=1928:00 +CPU= 15.891
  16:00:11 STEP 1929 H=1929:00 +CPU= 23.797
  16:00:27 STEP 1930 H=1930:00 +CPU= 15.894
  16:00:42 STEP 1931 H=1931:00 +CPU= 15.467
  16:01:09 STEP 1932 H=1932:00 +CPU= 26.219
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001932
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001932
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001932
  16:01:24 STEP 1933 H=1933:00 +CPU= 15.470
  16:01:40 STEP 1934 H=1934:00 +CPU= 15.907
  16:02:04 STEP 1935 H=1935:00 +CPU= 23.723
  16:02:20 STEP 1936 H=1936:00 +CPU= 15.843
  16:02:35 STEP 1937 H=1937:00 +CPU= 15.468
  16:03:00 STEP 1938 H=1938:00 +CPU= 24.219
  16:03:16 STEP 1939 H=1939:00 +CPU= 15.460
  16:03:32 STEP 1940 H=1940:00 +CPU= 15.880
  16:03:55 STEP 1941 H=1941:00 +CPU= 23.823
  16:04:11 STEP 1942 H=1942:00 +CPU= 15.889
  16:04:27 STEP 1943 H=1943:00 +CPU= 15.934
  16:04:56 STEP 1944 H=1944:00 +CPU= 28.197
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001944
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001944
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001944
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001920
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001920
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001920
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001932
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001932
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001932
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_80.zip
Uploading the intermediate file: upload_file_80.zip
  16:05:11 STEP 1945 H=1945:00 +CPU= 15.418
  16:05:27 STEP 1946 H=1946:00 +CPU= 15.825
  16:05:51 STEP 1947 H=1947:00 +CPU= 23.730
  16:06:07 STEP 1948 H=1948:00 +CPU= 15.847
  16:06:22 STEP 1949 H=1949:00 +CPU= 15.497
  16:06:47 STEP 1950 H=1950:00 +CPU= 24.290
  16:07:02 STEP 1951 H=1951:00 +CPU= 15.482
  16:07:18 STEP 1952 H=1952:00 +CPU= 16.019
  16:07:42 STEP 1953 H=1953:00 +CPU= 23.834
  16:07:58 STEP 1954 H=1954:00 +CPU= 15.873
  16:08:14 STEP 1955 H=1955:00 +CPU= 15.487
  16:08:40 STEP 1956 H=1956:00 +CPU= 26.203
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001956
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001956
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001956
  16:08:56 STEP 1957 H=1957:00 +CPU= 15.519
  16:09:12 STEP 1958 H=1958:00 +CPU= 15.877
  16:09:35 STEP 1959 H=1959:00 +CPU= 23.795
  16:09:51 STEP 1960 H=1960:00 +CPU= 15.812
  16:10:07 STEP 1961 H=1961:00 +CPU= 15.443
  16:10:31 STEP 1962 H=1962:00 +CPU= 24.278
  16:10:47 STEP 1963 H=1963:00 +CPU= 15.456
  16:11:03 STEP 1964 H=1964:00 +CPU= 15.839
  16:11:27 STEP 1965 H=1965:00 +CPU= 23.797
  16:11:42 STEP 1966 H=1966:00 +CPU= 15.822
  16:11:58 STEP 1967 H=1967:00 +CPU= 15.892
  16:12:27 STEP 1968 H=1968:00 +CPU= 28.194
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001968
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001968
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001968
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001944
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001944
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001944
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001956
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001956
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001956
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_81.zip
Uploading the intermediate file: upload_file_81.zip
  16:12:43 STEP 1969 H=1969:00 +CPU= 15.423
  16:12:59 STEP 1970 H=1970:00 +CPU= 15.904
  16:13:23 STEP 1971 H=1971:00 +CPU= 23.812
  16:13:39 STEP 1972 H=1972:00 +CPU= 15.819
  16:13:54 STEP 1973 H=1973:00 +CPU= 15.502
  16:14:19 STEP 1974 H=1974:00 +CPU= 24.300
  16:14:34 STEP 1975 H=1975:00 +CPU= 15.454
  16:14:50 STEP 1976 H=1976:00 +CPU= 15.874
  16:15:14 STEP 1977 H=1977:00 +CPU= 23.969
  16:15:30 STEP 1978 H=1978:00 +CPU= 15.946
  16:15:46 STEP 1979 H=1979:00 +CPU= 15.499
  16:16:12 STEP 1980 H=1980:00 +CPU= 26.252
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001980
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001980
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001980
  16:16:28 STEP 1981 H=1981:00 +CPU= 15.455
  16:16:44 STEP 1982 H=1982:00 +CPU= 15.913
  16:17:07 STEP 1983 H=1983:00 +CPU= 23.832
  16:17:23 STEP 1984 H=1984:00 +CPU= 15.826
  16:17:39 STEP 1985 H=1985:00 +CPU= 15.413
  16:18:03 STEP 1986 H=1986:00 +CPU= 24.256
  16:18:19 STEP 1987 H=1987:00 +CPU= 15.484
  16:18:34 STEP 1988 H=1988:00 +CPU= 15.834
  16:18:58 STEP 1989 H=1989:00 +CPU= 23.765
  16:19:14 STEP 1990 H=1990:00 +CPU= 15.877
  16:19:30 STEP 1991 H=1991:00 +CPU= 15.847
  16:19:58 STEP 1992 H=1992:00 +CPU= 28.125
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+001992
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+001992
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+001992
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001968
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001968
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001968
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001980
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001980
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001980
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_82.zip
Uploading the intermediate file: upload_file_82.zip
  16:20:14 STEP 1993 H=1993:00 +CPU= 15.519
  16:20:30 STEP 1994 H=1994:00 +CPU= 15.971
  16:20:54 STEP 1995 H=1995:00 +CPU= 23.792
  16:21:10 STEP 1996 H=1996:00 +CPU= 15.834
  16:21:25 STEP 1997 H=1997:00 +CPU= 15.466
  16:21:50 STEP 1998 H=1998:00 +CPU= 24.271
  16:22:05 STEP 1999 H=1999:00 +CPU= 15.434
  16:22:21 STEP 2000 H=2000:00 +CPU= 15.925
  16:22:45 STEP 2001 H=2001:00 +CPU= 23.789
  16:23:02 STEP 2002 H=2002:00 +CPU= 15.854
  16:23:19 STEP 2003 H=2003:00 +CPU= 15.568
  16:23:45 STEP 2004 H=2004:00 +CPU= 26.241
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002004
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002004
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002004
  16:24:00 STEP 2005 H=2005:00 +CPU= 15.457
  16:24:16 STEP 2006 H=2006:00 +CPU= 15.884
  16:24:40 STEP 2007 H=2007:00 +CPU= 23.800
  16:24:56 STEP 2008 H=2008:00 +CPU= 15.859
  16:25:12 STEP 2009 H=2009:00 +CPU= 15.464
  16:25:36 STEP 2010 H=2010:00 +CPU= 24.307
  16:25:52 STEP 2011 H=2011:00 +CPU= 15.424
  16:26:07 STEP 2012 H=2012:00 +CPU= 15.814
  16:26:31 STEP 2013 H=2013:00 +CPU= 23.728
  16:26:47 STEP 2014 H=2014:00 +CPU= 15.885
  16:27:03 STEP 2015 H=2015:00 +CPU= 15.950
  16:27:32 STEP 2016 H=2016:00 +CPU= 28.247
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002016
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002016
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002016
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+001992
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+001992
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+001992
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002004
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002004
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002004
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_83.zip
Uploading the intermediate file: upload_file_83.zip
  16:27:48 STEP 2017 H=2017:00 +CPU= 15.459
  16:28:04 STEP 2018 H=2018:00 +CPU= 15.855
  16:28:28 STEP 2019 H=2019:00 +CPU= 23.834
  16:28:44 STEP 2020 H=2020:00 +CPU= 15.907
  16:29:00 STEP 2021 H=2021:00 +CPU= 15.509
  16:29:24 STEP 2022 H=2022:00 +CPU= 24.236
  16:29:39 STEP 2023 H=2023:00 +CPU= 15.516
  16:29:55 STEP 2024 H=2024:00 +CPU= 16.000
  16:30:19 STEP 2025 H=2025:00 +CPU= 23.764
  16:30:35 STEP 2026 H=2026:00 +CPU= 15.855
  16:30:51 STEP 2027 H=2027:00 +CPU= 15.597
  16:31:18 STEP 2028 H=2028:00 +CPU= 26.535
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002028
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002028
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002028
  16:31:33 STEP 2029 H=2029:00 +CPU= 15.523
  16:31:49 STEP 2030 H=2030:00 +CPU= 15.877
  16:32:13 STEP 2031 H=2031:00 +CPU= 23.776
  16:32:29 STEP 2032 H=2032:00 +CPU= 15.951
  16:32:45 STEP 2033 H=2033:00 +CPU= 15.491
  16:33:09 STEP 2034 H=2034:00 +CPU= 24.306
  16:33:25 STEP 2035 H=2035:00 +CPU= 15.440
  16:33:41 STEP 2036 H=2036:00 +CPU= 15.820
  16:34:04 STEP 2037 H=2037:00 +CPU= 23.753
  16:34:20 STEP 2038 H=2038:00 +CPU= 15.903
  16:34:36 STEP 2039 H=2039:00 +CPU= 15.984
  16:35:05 STEP 2040 H=2040:00 +CPU= 28.198
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002040
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002040
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002040
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002016
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002016
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002016
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002028
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002028
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002028
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_84.zip
Uploading the intermediate file: upload_file_84.zip
  16:35:20 STEP 2041 H=2041:00 +CPU= 15.456
  16:35:36 STEP 2042 H=2042:00 +CPU= 15.918
  16:36:00 STEP 2043 H=2043:00 +CPU= 23.783
  16:36:16 STEP 2044 H=2044:00 +CPU= 15.893
  16:36:32 STEP 2045 H=2045:00 +CPU= 15.510
  16:36:56 STEP 2046 H=2046:00 +CPU= 24.273
  16:37:12 STEP 2047 H=2047:00 +CPU= 15.506
  16:37:28 STEP 2048 H=2048:00 +CPU= 15.933
  16:37:51 STEP 2049 H=2049:00 +CPU= 23.857
  16:38:07 STEP 2050 H=2050:00 +CPU= 15.921
  16:38:23 STEP 2051 H=2051:00 +CPU= 15.569
  16:38:49 STEP 2052 H=2052:00 +CPU= 26.279
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002052
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002052
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002052
  16:39:05 STEP 2053 H=2053:00 +CPU= 15.459
  16:39:21 STEP 2054 H=2054:00 +CPU= 15.797
  16:39:45 STEP 2055 H=2055:00 +CPU= 23.698
  16:40:00 STEP 2056 H=2056:00 +CPU= 15.891
  16:40:16 STEP 2057 H=2057:00 +CPU= 15.456
  16:40:40 STEP 2058 H=2058:00 +CPU= 24.093
  16:40:56 STEP 2059 H=2059:00 +CPU= 15.376
  16:41:11 STEP 2060 H=2060:00 +CPU= 15.834
  16:41:35 STEP 2061 H=2061:00 +CPU= 23.703
  16:41:51 STEP 2062 H=2062:00 +CPU= 15.797
  16:42:08 STEP 2063 H=2063:00 +CPU= 15.948
  16:42:36 STEP 2064 H=2064:00 +CPU= 28.095
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002064
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002064
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002064
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002040
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002040
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002040
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002052
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002052
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002052
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_85.zip
Uploading the intermediate file: upload_file_85.zip
  16:42:52 STEP 2065 H=2065:00 +CPU= 15.423
  16:43:08 STEP 2066 H=2066:00 +CPU= 15.796
  16:43:32 STEP 2067 H=2067:00 +CPU= 23.778
  16:43:47 STEP 2068 H=2068:00 +CPU= 15.796
  16:44:03 STEP 2069 H=2069:00 +CPU= 15.416
  16:44:27 STEP 2070 H=2070:00 +CPU= 24.178
  16:44:43 STEP 2071 H=2071:00 +CPU= 15.433
  16:44:58 STEP 2072 H=2072:00 +CPU= 15.831
  16:45:22 STEP 2073 H=2073:00 +CPU= 23.747
  16:45:38 STEP 2074 H=2074:00 +CPU= 15.885
  16:45:54 STEP 2075 H=2075:00 +CPU= 15.473
  16:46:20 STEP 2076 H=2076:00 +CPU= 26.058
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002076
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002076
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002076
  16:46:35 STEP 2077 H=2077:00 +CPU= 15.427
  16:46:51 STEP 2078 H=2078:00 +CPU= 15.821
  16:47:15 STEP 2079 H=2079:00 +CPU= 23.624
  16:47:31 STEP 2080 H=2080:00 +CPU= 15.754
  16:47:46 STEP 2081 H=2081:00 +CPU= 15.412
  16:48:10 STEP 2082 H=2082:00 +CPU= 24.108
  16:48:26 STEP 2083 H=2083:00 +CPU= 15.412
  16:48:42 STEP 2084 H=2084:00 +CPU= 15.775
  16:49:06 STEP 2085 H=2085:00 +CPU= 23.740
  16:49:22 STEP 2086 H=2086:00 +CPU= 15.822
  16:49:38 STEP 2087 H=2087:00 +CPU= 15.875
  16:50:06 STEP 2088 H=2088:00 +CPU= 28.106
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002088
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002088
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002088
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002064
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002064
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002064
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002076
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002076
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002076
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_86.zip
Uploading the intermediate file: upload_file_86.zip
  16:50:21 STEP 2089 H=2089:00 +CPU= 15.354
  16:50:37 STEP 2090 H=2090:00 +CPU= 15.911
  16:51:01 STEP 2091 H=2091:00 +CPU= 23.618
  16:51:17 STEP 2092 H=2092:00 +CPU= 15.795
  16:51:32 STEP 2093 H=2093:00 +CPU= 15.378
  16:51:56 STEP 2094 H=2094:00 +CPU= 24.096
  16:52:12 STEP 2095 H=2095:00 +CPU= 15.439
  16:52:28 STEP 2096 H=2096:00 +CPU= 15.778
  16:52:51 STEP 2097 H=2097:00 +CPU= 23.630
  16:53:07 STEP 2098 H=2098:00 +CPU= 15.809
  16:53:23 STEP 2099 H=2099:00 +CPU= 15.435
  16:53:49 STEP 2100 H=2100:00 +CPU= 26.067
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002100
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002100
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002100
  16:54:04 STEP 2101 H=2101:00 +CPU= 15.351
  16:54:20 STEP 2102 H=2102:00 +CPU= 15.771
  16:54:44 STEP 2103 H=2103:00 +CPU= 23.624
  16:55:00 STEP 2104 H=2104:00 +CPU= 15.816
  16:55:15 STEP 2105 H=2105:00 +CPU= 15.411
  16:55:39 STEP 2106 H=2106:00 +CPU= 24.141
  16:55:55 STEP 2107 H=2107:00 +CPU= 15.414
  16:56:11 STEP 2108 H=2108:00 +CPU= 15.787
  16:56:34 STEP 2109 H=2109:00 +CPU= 23.618
  16:56:50 STEP 2110 H=2110:00 +CPU= 15.783
  16:57:07 STEP 2111 H=2111:00 +CPU= 15.892
  16:57:35 STEP 2112 H=2112:00 +CPU= 28.009
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002112
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002112
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002112
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002088
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002088
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002088
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002100
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002100
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002100
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_87.zip
Uploading the intermediate file: upload_file_87.zip
  16:57:50 STEP 2113 H=2113:00 +CPU= 15.330
  16:58:06 STEP 2114 H=2114:00 +CPU= 15.805
  16:58:30 STEP 2115 H=2115:00 +CPU= 23.662
  16:58:46 STEP 2116 H=2116:00 +CPU= 15.747
  16:59:01 STEP 2117 H=2117:00 +CPU= 15.482
  16:59:26 STEP 2118 H=2118:00 +CPU= 24.022
  16:59:41 STEP 2119 H=2119:00 +CPU= 15.437
  16:59:57 STEP 2120 H=2120:00 +CPU= 15.806
  17:00:20 STEP 2121 H=2121:00 +CPU= 23.657
  17:00:36 STEP 2122 H=2122:00 +CPU= 15.776
  17:00:52 STEP 2123 H=2123:00 +CPU= 15.469
  17:01:18 STEP 2124 H=2124:00 +CPU= 26.120
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002124
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002124
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002124
  17:01:34 STEP 2125 H=2125:00 +CPU= 15.452
  17:01:49 STEP 2126 H=2126:00 +CPU= 15.798
  17:02:13 STEP 2127 H=2127:00 +CPU= 23.510
  17:02:28 STEP 2128 H=2128:00 +CPU= 15.444
  17:02:44 STEP 2129 H=2129:00 +CPU= 15.502
  17:03:08 STEP 2130 H=2130:00 +CPU= 24.189
  17:03:24 STEP 2131 H=2131:00 +CPU= 15.523
  17:03:40 STEP 2132 H=2132:00 +CPU= 15.891
  17:04:04 STEP 2133 H=2133:00 +CPU= 23.812
  17:04:20 STEP 2134 H=2134:00 +CPU= 15.824
  17:04:35 STEP 2135 H=2135:00 +CPU= 15.909
  17:05:04 STEP 2136 H=2136:00 +CPU= 28.230
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002136
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002136
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002136
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002112
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002112
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002112
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002124
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002124
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002124
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_88.zip
Uploading the intermediate file: upload_file_88.zip
  17:05:20 STEP 2137 H=2137:00 +CPU= 15.479
  17:05:35 STEP 2138 H=2138:00 +CPU= 15.862
  17:05:59 STEP 2139 H=2139:00 +CPU= 23.850
  17:06:15 STEP 2140 H=2140:00 +CPU= 15.919
  17:06:31 STEP 2141 H=2141:00 +CPU= 15.498
  17:06:55 STEP 2142 H=2142:00 +CPU= 24.247
  17:07:11 STEP 2143 H=2143:00 +CPU= 15.461
  17:07:27 STEP 2144 H=2144:00 +CPU= 15.868
  17:07:50 STEP 2145 H=2145:00 +CPU= 23.812
  17:08:06 STEP 2146 H=2146:00 +CPU= 15.932
  17:08:22 STEP 2147 H=2147:00 +CPU= 15.514
  17:08:49 STEP 2148 H=2148:00 +CPU= 26.252
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002148
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002148
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002148
  17:09:04 STEP 2149 H=2149:00 +CPU= 15.467
  17:09:20 STEP 2150 H=2150:00 +CPU= 15.851
  17:09:44 STEP 2151 H=2151:00 +CPU= 23.742
  17:10:00 STEP 2152 H=2152:00 +CPU= 15.879
  17:10:15 STEP 2153 H=2153:00 +CPU= 15.480
  17:10:39 STEP 2154 H=2154:00 +CPU= 24.107
  17:10:55 STEP 2155 H=2155:00 +CPU= 15.450
  17:11:11 STEP 2156 H=2156:00 +CPU= 15.893
  17:11:35 STEP 2157 H=2157:00 +CPU= 23.819
  17:11:50 STEP 2158 H=2158:00 +CPU= 15.880
  17:12:07 STEP 2159 H=2159:00 +CPU= 15.965
  17:12:36 STEP 2160 H=2160:00 +CPU= 28.200
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhq0f+002160
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhq0f+002160
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhq0f+002160
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002136
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002136
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002136
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMGGhq0f+002148
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMSHhq0f+002148
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_12182675/ICMUAhq0f+002148
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_ps_0031_1997050100_123_966_12182675_2_r1252988761_89.zip
Uploading the intermediate file: upload_file_89.zip
  17:12:51 STEP 2161 H=2161:00 +CPU= 15.451
Uploading trickle at timestep: 7776000
  17:13:07 STEP 2162 H=2162:00 +CPU= 15.852
double free or corruption (out)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:42:16 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 7,776,000 40,315 0.0052
09 May 2023 16:42:13 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 6,912,000 35,832 0.0052
09 May 2023 16:42:10 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 6,048,000 31,358 0.0052
09 May 2023 16:40:59 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 5,184,000 26,885 0.0052
09 May 2023 16:40:55 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 4,320,000 22,410 0.0052
09 May 2023 16:40:51 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 3,456,000 17,924 0.0052
09 May 2023 16:40:51 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 3,456,000 17,924 0.0052
09 May 2023 16:40:48 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 2,592,000 13,457 0.0052
09 May 2023 16:40:43 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 1,728,000 8,980 0.0052
09 May 2023 16:40:43 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 1,728,000 8,980 0.0052
09 May 2023 16:40:31 1535032 22302883 oifs_43r3_ps_0031_1997050100_123_966_12182675_2 864,000 4,500 0.0052


©2024 cpdn.org