climateprediction.net home page
Task 22252571

Task 22252571

Name oifs_43r3_ps_0681_1982050100_123_951_12168325_0
Workunit 12168325
Created 20 Dec 2022, 22:46:46 UTC
Sent 20 Dec 2022, 23:27:19 UTC
Report deadline 19 Jan 2023, 23:27:19 UTC
Received 23 Dec 2022, 18:03:14 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1485804
Run time 10 hours 43 min 36 sec
CPU time 10 hours 42 min 10 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 6.32 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,415.11 MB
Peak swap size 4,974.15 MB
Peak disk usage 1,220.64 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
95:00 +CPU= 14.475
  06:16:44 STEP 1496 H=1496:00 +CPU= 14.844
  06:17:07 STEP 1497 H=1497:00 +CPU= 22.739
  06:17:22 STEP 1498 H=1498:00 +CPU= 14.931
  06:17:36 STEP 1499 H=1499:00 +CPU= 14.581
  06:18:02 STEP 1500 H=1500:00 +CPU= 25.347
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001500
  06:18:16 STEP 1501 H=1501:00 +CPU= 14.537
  06:18:31 STEP 1502 H=1502:00 +CPU= 14.845
  06:18:54 STEP 1503 H=1503:00 +CPU= 22.690
  06:19:09 STEP 1504 H=1504:00 +CPU= 14.931
  06:19:23 STEP 1505 H=1505:00 +CPU= 14.466
  06:19:46 STEP 1506 H=1506:00 +CPU= 23.123
  06:20:01 STEP 1507 H=1507:00 +CPU= 14.446
  06:20:16 STEP 1508 H=1508:00 +CPU= 14.861
  06:20:38 STEP 1509 H=1509:00 +CPU= 22.630
  06:20:53 STEP 1510 H=1510:00 +CPU= 14.944
  06:21:08 STEP 1511 H=1511:00 +CPU= 14.935
  06:21:36 STEP 1512 H=1512:00 +CPU= 27.320
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_62.zip
Uploading the intermediate file: upload_file_62.zip
  06:21:50 STEP 1513 H=1513:00 +CPU= 14.418
  06:22:05 STEP 1514 H=1514:00 +CPU= 14.779
  06:22:28 STEP 1515 H=1515:00 +CPU= 22.667
  06:22:43 STEP 1516 H=1516:00 +CPU= 14.963
  06:22:57 STEP 1517 H=1517:00 +CPU= 14.603
  06:23:21 STEP 1518 H=1518:00 +CPU= 23.100
  06:23:35 STEP 1519 H=1519:00 +CPU= 14.454
  06:23:50 STEP 1520 H=1520:00 +CPU= 15.006
  06:24:13 STEP 1521 H=1521:00 +CPU= 22.788
  06:24:28 STEP 1522 H=1522:00 +CPU= 14.875
  06:24:42 STEP 1523 H=1523:00 +CPU= 14.465
  06:25:08 STEP 1524 H=1524:00 +CPU= 25.296
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001524
  06:25:22 STEP 1525 H=1525:00 +CPU= 14.504
  06:25:37 STEP 1526 H=1526:00 +CPU= 14.819
  06:26:00 STEP 1527 H=1527:00 +CPU= 22.737
  06:26:15 STEP 1528 H=1528:00 +CPU= 14.845
  06:26:29 STEP 1529 H=1529:00 +CPU= 14.398
  06:26:52 STEP 1530 H=1530:00 +CPU= 23.103
  06:27:07 STEP 1531 H=1531:00 +CPU= 14.489
  06:27:22 STEP 1532 H=1532:00 +CPU= 14.821
  06:27:44 STEP 1533 H=1533:00 +CPU= 22.660
  06:27:59 STEP 1534 H=1534:00 +CPU= 14.814
  06:28:14 STEP 1535 H=1535:00 +CPU= 14.903
  06:28:41 STEP 1536 H=1536:00 +CPU= 27.251
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_63.zip
Uploading the intermediate file: upload_file_63.zip
  06:28:56 STEP 1537 H=1537:00 +CPU= 14.390
  06:29:11 STEP 1538 H=1538:00 +CPU= 14.763
  06:29:34 STEP 1539 H=1539:00 +CPU= 22.853
  06:29:49 STEP 1540 H=1540:00 +CPU= 14.879
  06:30:03 STEP 1541 H=1541:00 +CPU= 14.400
  06:30:26 STEP 1542 H=1542:00 +CPU= 23.161
  06:30:41 STEP 1543 H=1543:00 +CPU= 14.534
  06:30:56 STEP 1544 H=1544:00 +CPU= 14.845
  06:31:18 STEP 1545 H=1545:00 +CPU= 22.740
  06:31:33 STEP 1546 H=1546:00 +CPU= 14.849
  06:31:48 STEP 1547 H=1547:00 +CPU= 14.465
  06:32:13 STEP 1548 H=1548:00 +CPU= 25.213
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001548
  06:32:28 STEP 1549 H=1549:00 +CPU= 14.531
  06:32:43 STEP 1550 H=1550:00 +CPU= 14.920
  06:33:05 STEP 1551 H=1551:00 +CPU= 22.739
  06:33:20 STEP 1552 H=1552:00 +CPU= 14.892
  06:33:35 STEP 1553 H=1553:00 +CPU= 14.436
  06:33:58 STEP 1554 H=1554:00 +CPU= 23.162
  06:34:12 STEP 1555 H=1555:00 +CPU= 14.479
  06:34:27 STEP 1556 H=1556:00 +CPU= 14.793
  06:34:50 STEP 1557 H=1557:00 +CPU= 22.734
  06:35:05 STEP 1558 H=1558:00 +CPU= 14.870
  06:35:20 STEP 1559 H=1559:00 +CPU= 14.900
  06:35:47 STEP 1560 H=1560:00 +CPU= 27.428
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_64.zip
Uploading the intermediate file: upload_file_64.zip
  06:36:02 STEP 1561 H=1561:00 +CPU= 14.396
  06:36:17 STEP 1562 H=1562:00 +CPU= 14.813
  06:36:39 STEP 1563 H=1563:00 +CPU= 22.782
  06:36:54 STEP 1564 H=1564:00 +CPU= 14.794
  06:37:09 STEP 1565 H=1565:00 +CPU= 14.401
  06:37:32 STEP 1566 H=1566:00 +CPU= 23.146
  06:37:46 STEP 1567 H=1567:00 +CPU= 14.471
  06:38:01 STEP 1568 H=1568:00 +CPU= 14.798
  06:38:24 STEP 1569 H=1569:00 +CPU= 22.705
  06:38:39 STEP 1570 H=1570:00 +CPU= 14.893
  06:38:53 STEP 1571 H=1571:00 +CPU= 14.416
  06:39:19 STEP 1572 H=1572:00 +CPU= 25.223
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001572
  06:39:33 STEP 1573 H=1573:00 +CPU= 14.473
  06:39:48 STEP 1574 H=1574:00 +CPU= 14.798
  06:40:11 STEP 1575 H=1575:00 +CPU= 22.640
  06:40:25 STEP 1576 H=1576:00 +CPU= 14.855
  06:40:40 STEP 1577 H=1577:00 +CPU= 14.406
  06:41:03 STEP 1578 H=1578:00 +CPU= 23.123
  06:41:18 STEP 1579 H=1579:00 +CPU= 14.530
  06:41:33 STEP 1580 H=1580:00 +CPU= 14.913
  06:41:55 STEP 1581 H=1581:00 +CPU= 22.767
  06:42:10 STEP 1582 H=1582:00 +CPU= 14.824
  06:42:25 STEP 1583 H=1583:00 +CPU= 14.819
  06:42:52 STEP 1584 H=1584:00 +CPU= 27.259
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_65.zip
Uploading the intermediate file: upload_file_65.zip
  06:43:07 STEP 1585 H=1585:00 +CPU= 14.646
  06:43:22 STEP 1586 H=1586:00 +CPU= 14.867
  06:43:45 STEP 1587 H=1587:00 +CPU= 22.742
  06:44:00 STEP 1588 H=1588:00 +CPU= 15.063
  06:44:15 STEP 1589 H=1589:00 +CPU= 14.624
  06:44:38 STEP 1590 H=1590:00 +CPU= 23.190
  06:44:52 STEP 1591 H=1591:00 +CPU= 14.528
  06:45:07 STEP 1592 H=1592:00 +CPU= 14.898
  06:45:30 STEP 1593 H=1593:00 +CPU= 22.844
  06:45:45 STEP 1594 H=1594:00 +CPU= 14.977
  06:46:00 STEP 1595 H=1595:00 +CPU= 14.579
  06:46:25 STEP 1596 H=1596:00 +CPU= 25.338
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001596
  06:46:40 STEP 1597 H=1597:00 +CPU= 14.540
  06:46:55 STEP 1598 H=1598:00 +CPU= 14.995
  06:47:17 STEP 1599 H=1599:00 +CPU= 22.751
  06:47:32 STEP 1600 H=1600:00 +CPU= 14.893
  06:47:47 STEP 1601 H=1601:00 +CPU= 14.571
  06:48:10 STEP 1602 H=1602:00 +CPU= 23.167
  06:48:25 STEP 1603 H=1603:00 +CPU= 14.509
  06:48:40 STEP 1604 H=1604:00 +CPU= 14.941
  06:49:02 STEP 1605 H=1605:00 +CPU= 22.716
  06:49:17 STEP 1606 H=1606:00 +CPU= 14.913
  06:49:32 STEP 1607 H=1607:00 +CPU= 14.838
  06:50:00 STEP 1608 H=1608:00 +CPU= 27.412
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_66.zip
Uploading the intermediate file: upload_file_66.zip
  06:50:14 STEP 1609 H=1609:00 +CPU= 14.500
  06:50:29 STEP 1610 H=1610:00 +CPU= 14.926
  06:50:52 STEP 1611 H=1611:00 +CPU= 22.707
  06:51:07 STEP 1612 H=1612:00 +CPU= 14.979
  06:51:22 STEP 1613 H=1613:00 +CPU= 14.475
  06:51:45 STEP 1614 H=1614:00 +CPU= 23.147
  06:51:59 STEP 1615 H=1615:00 +CPU= 14.731
  06:52:14 STEP 1616 H=1616:00 +CPU= 14.925
  06:52:37 STEP 1617 H=1617:00 +CPU= 22.734
  06:52:52 STEP 1618 H=1618:00 +CPU= 14.997
  06:53:07 STEP 1619 H=1619:00 +CPU= 14.636
  06:53:32 STEP 1620 H=1620:00 +CPU= 25.288
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001620
  06:53:47 STEP 1621 H=1621:00 +CPU= 14.526
  06:54:02 STEP 1622 H=1622:00 +CPU= 14.891
  06:54:24 STEP 1623 H=1623:00 +CPU= 22.702
  06:54:39 STEP 1624 H=1624:00 +CPU= 14.957
  06:54:54 STEP 1625 H=1625:00 +CPU= 14.536
  06:55:17 STEP 1626 H=1626:00 +CPU= 23.157
  06:55:32 STEP 1627 H=1627:00 +CPU= 14.523
  06:55:47 STEP 1628 H=1628:00 +CPU= 14.892
  06:56:09 STEP 1629 H=1629:00 +CPU= 22.700
  06:56:24 STEP 1630 H=1630:00 +CPU= 14.938
  06:56:39 STEP 1631 H=1631:00 +CPU= 14.903
  06:57:07 STEP 1632 H=1632:00 +CPU= 27.353
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_67.zip
Uploading the intermediate file: upload_file_67.zip
  06:57:21 STEP 1633 H=1633:00 +CPU= 14.517
  06:57:37 STEP 1634 H=1634:00 +CPU= 15.146
  06:57:59 STEP 1635 H=1635:00 +CPU= 22.783
  06:58:14 STEP 1636 H=1636:00 +CPU= 14.853
  06:58:29 STEP 1637 H=1637:00 +CPU= 14.523
  06:58:52 STEP 1638 H=1638:00 +CPU= 23.060
  06:59:06 STEP 1639 H=1639:00 +CPU= 14.532
  06:59:21 STEP 1640 H=1640:00 +CPU= 14.907
  06:59:44 STEP 1641 H=1641:00 +CPU= 22.754
  06:59:59 STEP 1642 H=1642:00 +CPU= 14.933
  07:00:14 STEP 1643 H=1643:00 +CPU= 14.555
  07:00:39 STEP 1644 H=1644:00 +CPU= 25.295
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001644
  07:00:54 STEP 1645 H=1645:00 +CPU= 14.554
  07:01:09 STEP 1646 H=1646:00 +CPU= 14.936
  07:01:32 STEP 1647 H=1647:00 +CPU= 22.813
  07:01:46 STEP 1648 H=1648:00 +CPU= 14.966
  07:02:01 STEP 1649 H=1649:00 +CPU= 14.559
  07:02:24 STEP 1650 H=1650:00 +CPU= 23.191
  07:02:39 STEP 1651 H=1651:00 +CPU= 14.511
  07:02:54 STEP 1652 H=1652:00 +CPU= 14.847
  07:03:16 STEP 1653 H=1653:00 +CPU= 22.696
  07:03:31 STEP 1654 H=1654:00 +CPU= 14.939
  07:03:46 STEP 1655 H=1655:00 +CPU= 14.945
  07:04:14 STEP 1656 H=1656:00 +CPU= 27.347
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_68.zip
Uploading the intermediate file: upload_file_68.zip
  07:04:28 STEP 1657 H=1657:00 +CPU= 14.575
  07:04:43 STEP 1658 H=1658:00 +CPU= 14.891
  07:05:06 STEP 1659 H=1659:00 +CPU= 22.716
  07:05:21 STEP 1660 H=1660:00 +CPU= 14.845
  07:05:35 STEP 1661 H=1661:00 +CPU= 14.461
  07:05:59 STEP 1662 H=1662:00 +CPU= 23.345
  07:06:13 STEP 1663 H=1663:00 +CPU= 14.483
  07:06:28 STEP 1664 H=1664:00 +CPU= 14.923
  07:06:51 STEP 1665 H=1665:00 +CPU= 22.749
  07:07:06 STEP 1666 H=1666:00 +CPU= 14.930
  07:07:21 STEP 1667 H=1667:00 +CPU= 14.578
  07:07:46 STEP 1668 H=1668:00 +CPU= 25.411
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001668
  07:08:01 STEP 1669 H=1669:00 +CPU= 14.651
  07:08:16 STEP 1670 H=1670:00 +CPU= 15.035
  07:08:39 STEP 1671 H=1671:00 +CPU= 22.906
  07:08:54 STEP 1672 H=1672:00 +CPU= 14.928
  07:09:08 STEP 1673 H=1673:00 +CPU= 14.483
  07:09:32 STEP 1674 H=1674:00 +CPU= 23.151
  07:09:46 STEP 1675 H=1675:00 +CPU= 14.474
  07:10:01 STEP 1676 H=1676:00 +CPU= 14.827
  07:10:24 STEP 1677 H=1677:00 +CPU= 22.675
  07:10:38 STEP 1678 H=1678:00 +CPU= 14.827
  07:10:53 STEP 1679 H=1679:00 +CPU= 14.858
  07:11:21 STEP 1680 H=1680:00 +CPU= 27.304
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_69.zip
Uploading the intermediate file: upload_file_69.zip
  07:11:35 STEP 1681 H=1681:00 +CPU= 14.472
Uploading trickle at timestep: 6048000
  07:11:50 STEP 1682 H=1682:00 +CPU= 14.941
  07:12:13 STEP 1683 H=1683:00 +CPU= 22.759
  07:12:28 STEP 1684 H=1684:00 +CPU= 14.870
  07:12:42 STEP 1685 H=1685:00 +CPU= 14.550
  07:13:06 STEP 1686 H=1686:00 +CPU= 23.254
  07:13:20 STEP 1687 H=1687:00 +CPU= 14.499
  07:13:35 STEP 1688 H=1688:00 +CPU= 14.862
  07:13:58 STEP 1689 H=1689:00 +CPU= 22.722
  07:14:13 STEP 1690 H=1690:00 +CPU= 14.897
  07:14:27 STEP 1691 H=1691:00 +CPU= 14.525
  07:14:53 STEP 1692 H=1692:00 +CPU= 25.316
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001692
  07:15:07 STEP 1693 H=1693:00 +CPU= 14.502
  07:15:22 STEP 1694 H=1694:00 +CPU= 14.846
  07:15:45 STEP 1695 H=1695:00 +CPU= 22.830
  07:16:00 STEP 1696 H=1696:00 +CPU= 14.939
  07:16:15 STEP 1697 H=1697:00 +CPU= 14.572
  07:16:38 STEP 1698 H=1698:00 +CPU= 23.264
  07:16:52 STEP 1699 H=1699:00 +CPU= 14.522
  07:17:07 STEP 1700 H=1700:00 +CPU= 14.918
  07:17:30 STEP 1701 H=1701:00 +CPU= 22.884
  07:17:45 STEP 1702 H=1702:00 +CPU= 14.940
  07:18:00 STEP 1703 H=1703:00 +CPU= 14.889
  07:18:28 STEP 1704 H=1704:00 +CPU= 27.321
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_70.zip
Uploading the intermediate file: upload_file_70.zip
  07:18:42 STEP 1705 H=1705:00 +CPU= 14.517
  07:18:57 STEP 1706 H=1706:00 +CPU= 14.906
  07:19:20 STEP 1707 H=1707:00 +CPU= 22.737
  07:19:35 STEP 1708 H=1708:00 +CPU= 15.034
  07:19:49 STEP 1709 H=1709:00 +CPU= 14.483
  07:20:13 STEP 1710 H=1710:00 +CPU= 23.119
  07:20:27 STEP 1711 H=1711:00 +CPU= 14.443
  07:20:42 STEP 1712 H=1712:00 +CPU= 14.903
  07:21:05 STEP 1713 H=1713:00 +CPU= 22.763
  07:21:20 STEP 1714 H=1714:00 +CPU= 14.946
  07:21:34 STEP 1715 H=1715:00 +CPU= 14.544
  07:22:00 STEP 1716 H=1716:00 +CPU= 25.334
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001716
  07:22:14 STEP 1717 H=1717:00 +CPU= 14.490
  07:22:29 STEP 1718 H=1718:00 +CPU= 14.878
  07:22:52 STEP 1719 H=1719:00 +CPU= 22.747
  07:23:07 STEP 1720 H=1720:00 +CPU= 14.875
  07:23:21 STEP 1721 H=1721:00 +CPU= 14.437
  07:23:45 STEP 1722 H=1722:00 +CPU= 23.148
  07:23:59 STEP 1723 H=1723:00 +CPU= 14.459
  07:24:14 STEP 1724 H=1724:00 +CPU= 14.838
  07:24:37 STEP 1725 H=1725:00 +CPU= 22.728
  07:24:52 STEP 1726 H=1726:00 +CPU= 14.872
  07:25:06 STEP 1727 H=1727:00 +CPU= 14.894
  07:25:34 STEP 1728 H=1728:00 +CPU= 27.521
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_71.zip
Uploading the intermediate file: upload_file_71.zip
  07:25:49 STEP 1729 H=1729:00 +CPU= 14.475
  07:26:03 STEP 1730 H=1730:00 +CPU= 14.854
  07:26:26 STEP 1731 H=1731:00 +CPU= 22.792
  07:26:41 STEP 1732 H=1732:00 +CPU= 14.821
  07:26:56 STEP 1733 H=1733:00 +CPU= 14.524
  07:27:19 STEP 1734 H=1734:00 +CPU= 23.232
  07:27:33 STEP 1735 H=1735:00 +CPU= 14.438
  07:27:48 STEP 1736 H=1736:00 +CPU= 14.895
  07:28:11 STEP 1737 H=1737:00 +CPU= 22.708
  07:28:26 STEP 1738 H=1738:00 +CPU= 14.843
  07:28:40 STEP 1739 H=1739:00 +CPU= 14.470
  07:29:06 STEP 1740 H=1740:00 +CPU= 25.281
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001740
  07:29:20 STEP 1741 H=1741:00 +CPU= 14.417
  07:29:35 STEP 1742 H=1742:00 +CPU= 14.835
  07:29:58 STEP 1743 H=1743:00 +CPU= 22.634
  07:30:13 STEP 1744 H=1744:00 +CPU= 14.779
  07:30:27 STEP 1745 H=1745:00 +CPU= 14.430
  07:30:50 STEP 1746 H=1746:00 +CPU= 23.069
  07:31:05 STEP 1747 H=1747:00 +CPU= 14.350
  07:31:19 STEP 1748 H=1748:00 +CPU= 14.783
  07:31:42 STEP 1749 H=1749:00 +CPU= 22.647
  07:31:57 STEP 1750 H=1750:00 +CPU= 14.819
  07:32:12 STEP 1751 H=1751:00 +CPU= 14.805
  07:32:39 STEP 1752 H=1752:00 +CPU= 27.201
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_72.zip
Uploading the intermediate file: upload_file_72.zip
  07:32:53 STEP 1753 H=1753:00 +CPU= 14.425
  07:33:08 STEP 1754 H=1754:00 +CPU= 14.837
  07:33:31 STEP 1755 H=1755:00 +CPU= 22.763
  07:33:46 STEP 1756 H=1756:00 +CPU= 14.815
  07:34:00 STEP 1757 H=1757:00 +CPU= 14.469
  07:34:24 STEP 1758 H=1758:00 +CPU= 23.234
  07:34:38 STEP 1759 H=1759:00 +CPU= 14.450
  07:34:53 STEP 1760 H=1760:00 +CPU= 14.910
  07:35:16 STEP 1761 H=1761:00 +CPU= 22.713
  07:35:31 STEP 1762 H=1762:00 +CPU= 14.891
  07:35:45 STEP 1763 H=1763:00 +CPU= 14.499
  07:36:11 STEP 1764 H=1764:00 +CPU= 25.261
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001764
  07:36:25 STEP 1765 H=1765:00 +CPU= 14.461
  07:36:40 STEP 1766 H=1766:00 +CPU= 14.861
  07:37:03 STEP 1767 H=1767:00 +CPU= 22.724
  07:37:18 STEP 1768 H=1768:00 +CPU= 14.826
  07:37:32 STEP 1769 H=1769:00 +CPU= 14.530
  07:37:55 STEP 1770 H=1770:00 +CPU= 23.168
  07:38:10 STEP 1771 H=1771:00 +CPU= 14.463
  07:38:25 STEP 1772 H=1772:00 +CPU= 14.884
  07:38:48 STEP 1773 H=1773:00 +CPU= 22.807
  07:39:03 STEP 1774 H=1774:00 +CPU= 14.886
  07:39:18 STEP 1775 H=1775:00 +CPU= 14.965
  07:39:45 STEP 1776 H=1776:00 +CPU= 27.442
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_73.zip
Uploading the intermediate file: upload_file_73.zip
  07:40:00 STEP 1777 H=1777:00 +CPU= 14.447
  07:40:14 STEP 1778 H=1778:00 +CPU= 14.868
  07:40:37 STEP 1779 H=1779:00 +CPU= 22.795
  07:40:52 STEP 1780 H=1780:00 +CPU= 14.833
  07:41:07 STEP 1781 H=1781:00 +CPU= 14.539
  07:41:30 STEP 1782 H=1782:00 +CPU= 23.232
  07:41:44 STEP 1783 H=1783:00 +CPU= 14.468
  07:41:59 STEP 1784 H=1784:00 +CPU= 14.842
  07:42:22 STEP 1785 H=1785:00 +CPU= 22.812
  07:42:37 STEP 1786 H=1786:00 +CPU= 14.853
  07:42:52 STEP 1787 H=1787:00 +CPU= 14.528
  07:43:17 STEP 1788 H=1788:00 +CPU= 25.348
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001788
  07:43:32 STEP 1789 H=1789:00 +CPU= 14.514
  07:43:47 STEP 1790 H=1790:00 +CPU= 14.932
  07:44:09 STEP 1791 H=1791:00 +CPU= 22.744
  07:44:24 STEP 1792 H=1792:00 +CPU= 14.785
  07:44:39 STEP 1793 H=1793:00 +CPU= 14.510
  07:45:02 STEP 1794 H=1794:00 +CPU= 23.137
  07:45:16 STEP 1795 H=1795:00 +CPU= 14.479
  07:45:31 STEP 1796 H=1796:00 +CPU= 14.916
  07:45:54 STEP 1797 H=1797:00 +CPU= 22.747
  07:46:09 STEP 1798 H=1798:00 +CPU= 14.795
  07:46:24 STEP 1799 H=1799:00 +CPU= 14.805
  07:46:51 STEP 1800 H=1800:00 +CPU= 27.248
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_74.zip
Uploading the intermediate file: upload_file_74.zip
  07:47:06 STEP 1801 H=1801:00 +CPU= 14.455
  07:47:20 STEP 1802 H=1802:00 +CPU= 14.809
  07:47:43 STEP 1803 H=1803:00 +CPU= 22.779
  07:47:58 STEP 1804 H=1804:00 +CPU= 14.969
  07:48:13 STEP 1805 H=1805:00 +CPU= 14.735
  07:48:36 STEP 1806 H=1806:00 +CPU= 23.163
  07:48:51 STEP 1807 H=1807:00 +CPU= 14.503
  07:49:06 STEP 1808 H=1808:00 +CPU= 14.871
  07:49:28 STEP 1809 H=1809:00 +CPU= 22.699
  07:49:43 STEP 1810 H=1810:00 +CPU= 14.878
  07:49:58 STEP 1811 H=1811:00 +CPU= 14.581
  07:50:23 STEP 1812 H=1812:00 +CPU= 25.321
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001812
  07:50:38 STEP 1813 H=1813:00 +CPU= 14.594
  07:50:53 STEP 1814 H=1814:00 +CPU= 14.869
  07:51:15 STEP 1815 H=1815:00 +CPU= 22.631
  07:51:30 STEP 1816 H=1816:00 +CPU= 14.843
  07:51:45 STEP 1817 H=1817:00 +CPU= 14.471
  07:52:08 STEP 1818 H=1818:00 +CPU= 23.077
  07:52:22 STEP 1819 H=1819:00 +CPU= 14.467
  07:52:37 STEP 1820 H=1820:00 +CPU= 14.859
  07:53:00 STEP 1821 H=1821:00 +CPU= 22.694
  07:53:15 STEP 1822 H=1822:00 +CPU= 14.755
  07:53:30 STEP 1823 H=1823:00 +CPU= 14.851
  07:53:57 STEP 1824 H=1824:00 +CPU= 27.199
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_75.zip
Uploading the intermediate file: upload_file_75.zip
  07:54:12 STEP 1825 H=1825:00 +CPU= 14.469
  07:54:26 STEP 1826 H=1826:00 +CPU= 14.863
  07:54:49 STEP 1827 H=1827:00 +CPU= 22.663
  07:55:04 STEP 1828 H=1828:00 +CPU= 14.866
  07:55:19 STEP 1829 H=1829:00 +CPU= 14.506
  07:55:42 STEP 1830 H=1830:00 +CPU= 23.080
  07:55:56 STEP 1831 H=1831:00 +CPU= 14.514
  07:56:11 STEP 1832 H=1832:00 +CPU= 14.880
  07:56:34 STEP 1833 H=1833:00 +CPU= 22.654
  07:56:49 STEP 1834 H=1834:00 +CPU= 14.847
  07:57:03 STEP 1835 H=1835:00 +CPU= 14.561
  07:57:29 STEP 1836 H=1836:00 +CPU= 25.309
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001836
  07:57:43 STEP 1837 H=1837:00 +CPU= 14.560
  07:57:58 STEP 1838 H=1838:00 +CPU= 14.920
  07:58:21 STEP 1839 H=1839:00 +CPU= 22.727
  07:58:36 STEP 1840 H=1840:00 +CPU= 14.929
  07:58:51 STEP 1841 H=1841:00 +CPU= 14.563
  07:59:14 STEP 1842 H=1842:00 +CPU= 23.184
  07:59:28 STEP 1843 H=1843:00 +CPU= 14.569
  07:59:43 STEP 1844 H=1844:00 +CPU= 14.906
  08:00:06 STEP 1845 H=1845:00 +CPU= 22.789
  08:00:21 STEP 1846 H=1846:00 +CPU= 14.834
  08:00:36 STEP 1847 H=1847:00 +CPU= 14.949
  08:01:03 STEP 1848 H=1848:00 +CPU= 27.446
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_76.zip
Uploading the intermediate file: upload_file_76.zip
  08:01:18 STEP 1849 H=1849:00 +CPU= 14.550
  08:01:33 STEP 1850 H=1850:00 +CPU= 14.860
  08:01:56 STEP 1851 H=1851:00 +CPU= 22.728
  08:02:11 STEP 1852 H=1852:00 +CPU= 14.918
  08:02:25 STEP 1853 H=1853:00 +CPU= 14.547
  08:02:49 STEP 1854 H=1854:00 +CPU= 23.357
  08:03:03 STEP 1855 H=1855:00 +CPU= 14.702
  08:03:18 STEP 1856 H=1856:00 +CPU= 15.019
  08:03:41 STEP 1857 H=1857:00 +CPU= 22.710
  08:03:56 STEP 1858 H=1858:00 +CPU= 14.886
  08:04:11 STEP 1859 H=1859:00 +CPU= 14.522
  08:04:36 STEP 1860 H=1860:00 +CPU= 25.220
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001860
  08:04:50 STEP 1861 H=1861:00 +CPU= 14.525
  08:05:05 STEP 1862 H=1862:00 +CPU= 14.839
  08:05:28 STEP 1863 H=1863:00 +CPU= 22.681
  08:05:43 STEP 1864 H=1864:00 +CPU= 14.851
  08:05:57 STEP 1865 H=1865:00 +CPU= 14.436
  08:06:21 STEP 1866 H=1866:00 +CPU= 23.089
  08:06:35 STEP 1867 H=1867:00 +CPU= 14.469
  08:06:50 STEP 1868 H=1868:00 +CPU= 14.805
  08:07:13 STEP 1869 H=1869:00 +CPU= 22.736
  08:07:28 STEP 1870 H=1870:00 +CPU= 15.001
  08:07:43 STEP 1871 H=1871:00 +CPU= 14.898
  08:08:10 STEP 1872 H=1872:00 +CPU= 27.320
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_77.zip
Uploading the intermediate file: upload_file_77.zip
  08:08:24 STEP 1873 H=1873:00 +CPU= 14.448
  08:08:39 STEP 1874 H=1874:00 +CPU= 14.821
  08:09:02 STEP 1875 H=1875:00 +CPU= 22.690
  08:09:17 STEP 1876 H=1876:00 +CPU= 14.844
  08:09:31 STEP 1877 H=1877:00 +CPU= 14.440
  08:09:55 STEP 1878 H=1878:00 +CPU= 23.087
  08:10:09 STEP 1879 H=1879:00 +CPU= 14.478
  08:10:24 STEP 1880 H=1880:00 +CPU= 14.844
  08:10:47 STEP 1881 H=1881:00 +CPU= 22.660
  08:11:02 STEP 1882 H=1882:00 +CPU= 14.875
  08:11:16 STEP 1883 H=1883:00 +CPU= 14.490
  08:11:41 STEP 1884 H=1884:00 +CPU= 25.193
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001884
  08:11:56 STEP 1885 H=1885:00 +CPU= 14.495
  08:12:11 STEP 1886 H=1886:00 +CPU= 14.867
  08:12:33 STEP 1887 H=1887:00 +CPU= 22.666
  08:12:48 STEP 1888 H=1888:00 +CPU= 14.891
  08:13:03 STEP 1889 H=1889:00 +CPU= 14.475
  08:13:26 STEP 1890 H=1890:00 +CPU= 23.088
  08:13:40 STEP 1891 H=1891:00 +CPU= 14.489
  08:13:55 STEP 1892 H=1892:00 +CPU= 14.868
  08:14:18 STEP 1893 H=1893:00 +CPU= 22.700
  08:14:33 STEP 1894 H=1894:00 +CPU= 14.801
  08:14:48 STEP 1895 H=1895:00 +CPU= 14.981
  08:15:15 STEP 1896 H=1896:00 +CPU= 27.395
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_78.zip
Uploading the intermediate file: upload_file_78.zip
  08:15:30 STEP 1897 H=1897:00 +CPU= 14.523
  08:15:45 STEP 1898 H=1898:00 +CPU= 14.804
  08:16:08 STEP 1899 H=1899:00 +CPU= 22.835
  08:16:23 STEP 1900 H=1900:00 +CPU= 15.062
  08:16:37 STEP 1901 H=1901:00 +CPU= 14.512
  08:17:01 STEP 1902 H=1902:00 +CPU= 23.192
  08:17:15 STEP 1903 H=1903:00 +CPU= 14.515
  08:17:30 STEP 1904 H=1904:00 +CPU= 14.819
  08:17:53 STEP 1905 H=1905:00 +CPU= 22.842
  08:18:08 STEP 1906 H=1906:00 +CPU= 14.992
  08:18:22 STEP 1907 H=1907:00 +CPU= 14.598
  08:18:48 STEP 1908 H=1908:00 +CPU= 25.327
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001908
  08:19:02 STEP 1909 H=1909:00 +CPU= 14.520
  08:19:17 STEP 1910 H=1910:00 +CPU= 14.915
  08:19:40 STEP 1911 H=1911:00 +CPU= 22.734
  08:19:55 STEP 1912 H=1912:00 +CPU= 14.904
  08:20:10 STEP 1913 H=1913:00 +CPU= 14.542
  08:20:33 STEP 1914 H=1914:00 +CPU= 23.201
  08:20:47 STEP 1915 H=1915:00 +CPU= 14.493
  08:21:02 STEP 1916 H=1916:00 +CPU= 14.861
  08:21:25 STEP 1917 H=1917:00 +CPU= 22.670
  08:21:40 STEP 1918 H=1918:00 +CPU= 14.802
  08:21:55 STEP 1919 H=1919:00 +CPU= 14.898
  08:22:22 STEP 1920 H=1920:00 +CPU= 27.403
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_79.zip
Uploading the intermediate file: upload_file_79.zip
  08:22:37 STEP 1921 H=1921:00 +CPU= 14.464
Uploading trickle at timestep: 6912000
  08:22:52 STEP 1922 H=1922:00 +CPU= 14.864
  08:23:14 STEP 1923 H=1923:00 +CPU= 22.729
  08:23:29 STEP 1924 H=1924:00 +CPU= 14.837
  08:23:44 STEP 1925 H=1925:00 +CPU= 14.516
  08:24:07 STEP 1926 H=1926:00 +CPU= 23.148
  08:24:21 STEP 1927 H=1927:00 +CPU= 14.443
  08:24:36 STEP 1928 H=1928:00 +CPU= 14.839
  08:24:59 STEP 1929 H=1929:00 +CPU= 22.733
  08:25:14 STEP 1930 H=1930:00 +CPU= 14.912
  08:25:29 STEP 1931 H=1931:00 +CPU= 14.523
  08:25:54 STEP 1932 H=1932:00 +CPU= 25.289
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001932
  08:26:08 STEP 1933 H=1933:00 +CPU= 14.546
  08:26:23 STEP 1934 H=1934:00 +CPU= 14.894
  08:26:46 STEP 1935 H=1935:00 +CPU= 22.745
  08:27:01 STEP 1936 H=1936:00 +CPU= 14.898
  08:27:16 STEP 1937 H=1937:00 +CPU= 14.562
  08:27:39 STEP 1938 H=1938:00 +CPU= 23.196
  08:27:53 STEP 1939 H=1939:00 +CPU= 14.515
  08:28:08 STEP 1940 H=1940:00 +CPU= 14.883
  08:28:31 STEP 1941 H=1941:00 +CPU= 22.710
  08:28:46 STEP 1942 H=1942:00 +CPU= 14.783
  08:29:01 STEP 1943 H=1943:00 +CPU= 14.875
  08:29:28 STEP 1944 H=1944:00 +CPU= 27.310
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_80.zip
Uploading the intermediate file: upload_file_80.zip
  08:29:43 STEP 1945 H=1945:00 +CPU= 14.618
  08:29:58 STEP 1946 H=1946:00 +CPU= 14.910
  08:30:21 STEP 1947 H=1947:00 +CPU= 22.773
  08:30:36 STEP 1948 H=1948:00 +CPU= 14.896
  08:30:50 STEP 1949 H=1949:00 +CPU= 14.437
  08:31:13 STEP 1950 H=1950:00 +CPU= 23.114
  08:31:28 STEP 1951 H=1951:00 +CPU= 14.478
  08:31:43 STEP 1952 H=1952:00 +CPU= 14.850
  08:32:05 STEP 1953 H=1953:00 +CPU= 22.738
  08:32:20 STEP 1954 H=1954:00 +CPU= 14.944
  08:32:35 STEP 1955 H=1955:00 +CPU= 14.573
  08:33:00 STEP 1956 H=1956:00 +CPU= 25.291
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001956
  08:33:15 STEP 1957 H=1957:00 +CPU= 14.520
  08:33:30 STEP 1958 H=1958:00 +CPU= 14.899
  08:33:53 STEP 1959 H=1959:00 +CPU= 22.781
  08:34:08 STEP 1960 H=1960:00 +CPU= 14.940
  08:34:22 STEP 1961 H=1961:00 +CPU= 14.522
  08:34:45 STEP 1962 H=1962:00 +CPU= 23.201
  08:35:00 STEP 1963 H=1963:00 +CPU= 14.507
  08:35:15 STEP 1964 H=1964:00 +CPU= 14.874
  08:35:38 STEP 1965 H=1965:00 +CPU= 22.768
  08:35:53 STEP 1966 H=1966:00 +CPU= 14.845
  08:36:08 STEP 1967 H=1967:00 +CPU= 14.977
  08:36:35 STEP 1968 H=1968:00 +CPU= 27.547
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_81.zip
Uploading the intermediate file: upload_file_81.zip
  08:36:50 STEP 1969 H=1969:00 +CPU= 14.552
  08:37:05 STEP 1970 H=1970:00 +CPU= 14.920
  08:37:27 STEP 1971 H=1971:00 +CPU= 22.775
  08:37:42 STEP 1972 H=1972:00 +CPU= 14.943
  08:37:57 STEP 1973 H=1973:00 +CPU= 14.539
  08:38:20 STEP 1974 H=1974:00 +CPU= 23.277
  08:38:35 STEP 1975 H=1975:00 +CPU= 14.577
  08:38:50 STEP 1976 H=1976:00 +CPU= 14.919
  08:39:13 STEP 1977 H=1977:00 +CPU= 22.822
  08:39:28 STEP 1978 H=1978:00 +CPU= 14.972
  08:39:42 STEP 1979 H=1979:00 +CPU= 14.579
  08:40:08 STEP 1980 H=1980:00 +CPU= 25.415
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001980
  08:40:22 STEP 1981 H=1981:00 +CPU= 14.609
  08:40:37 STEP 1982 H=1982:00 +CPU= 14.917
  08:41:00 STEP 1983 H=1983:00 +CPU= 22.789
  08:41:15 STEP 1984 H=1984:00 +CPU= 14.877
  08:41:30 STEP 1985 H=1985:00 +CPU= 14.505
  08:41:53 STEP 1986 H=1986:00 +CPU= 23.155
  08:42:07 STEP 1987 H=1987:00 +CPU= 14.516
  08:42:22 STEP 1988 H=1988:00 +CPU= 14.882
  08:42:45 STEP 1989 H=1989:00 +CPU= 22.773
  08:43:00 STEP 1990 H=1990:00 +CPU= 14.922
  08:43:15 STEP 1991 H=1991:00 +CPU= 14.969
  08:43:43 STEP 1992 H=1992:00 +CPU= 27.511
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_82.zip
Uploading the intermediate file: upload_file_82.zip
  08:43:57 STEP 1993 H=1993:00 +CPU= 14.597
  08:44:12 STEP 1994 H=1994:00 +CPU= 14.896
  08:44:35 STEP 1995 H=1995:00 +CPU= 22.824
  08:44:50 STEP 1996 H=1996:00 +CPU= 14.852
  08:45:05 STEP 1997 H=1997:00 +CPU= 14.485
  08:45:28 STEP 1998 H=1998:00 +CPU= 23.087
  08:45:42 STEP 1999 H=1999:00 +CPU= 14.456
  08:45:57 STEP 2000 H=2000:00 +CPU= 14.860
  08:46:20 STEP 2001 H=2001:00 +CPU= 22.664
  08:46:35 STEP 2002 H=2002:00 +CPU= 14.830
  08:46:49 STEP 2003 H=2003:00 +CPU= 14.455
  08:47:14 STEP 2004 H=2004:00 +CPU= 25.202
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002004
  08:47:29 STEP 2005 H=2005:00 +CPU= 14.471
  08:47:44 STEP 2006 H=2006:00 +CPU= 14.836
  08:48:06 STEP 2007 H=2007:00 +CPU= 22.637
  08:48:21 STEP 2008 H=2008:00 +CPU= 14.825
  08:48:36 STEP 2009 H=2009:00 +CPU= 14.456
  08:48:59 STEP 2010 H=2010:00 +CPU= 23.017
  08:49:13 STEP 2011 H=2011:00 +CPU= 14.432
  08:49:28 STEP 2012 H=2012:00 +CPU= 14.790
  08:49:51 STEP 2013 H=2013:00 +CPU= 22.593
  08:50:05 STEP 2014 H=2014:00 +CPU= 14.792
  08:50:20 STEP 2015 H=2015:00 +CPU= 14.817
  08:50:48 STEP 2016 H=2016:00 +CPU= 27.319
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_83.zip
Uploading the intermediate file: upload_file_83.zip
  08:51:02 STEP 2017 H=2017:00 +CPU= 14.463
  08:51:17 STEP 2018 H=2018:00 +CPU= 14.817
  08:51:40 STEP 2019 H=2019:00 +CPU= 22.628
  08:51:55 STEP 2020 H=2020:00 +CPU= 14.799
  08:52:09 STEP 2021 H=2021:00 +CPU= 14.435
  08:52:32 STEP 2022 H=2022:00 +CPU= 23.074
  08:52:47 STEP 2023 H=2023:00 +CPU= 14.460
  08:53:01 STEP 2024 H=2024:00 +CPU= 14.838
  08:53:24 STEP 2025 H=2025:00 +CPU= 22.686
  08:53:39 STEP 2026 H=2026:00 +CPU= 14.845
  08:53:54 STEP 2027 H=2027:00 +CPU= 14.560
  08:54:19 STEP 2028 H=2028:00 +CPU= 25.314
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002028
  08:54:34 STEP 2029 H=2029:00 +CPU= 14.578
  08:54:49 STEP 2030 H=2030:00 +CPU= 14.916
  08:55:11 STEP 2031 H=2031:00 +CPU= 22.752
  08:55:26 STEP 2032 H=2032:00 +CPU= 14.930
  08:55:41 STEP 2033 H=2033:00 +CPU= 14.526
  08:56:04 STEP 2034 H=2034:00 +CPU= 23.157
  08:56:19 STEP 2035 H=2035:00 +CPU= 14.486
  08:56:33 STEP 2036 H=2036:00 +CPU= 14.840
  08:56:56 STEP 2037 H=2037:00 +CPU= 22.696
  08:57:11 STEP 2038 H=2038:00 +CPU= 14.842
  08:57:26 STEP 2039 H=2039:00 +CPU= 14.850
  08:57:53 STEP 2040 H=2040:00 +CPU= 27.307
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_84.zip
Uploading the intermediate file: upload_file_84.zip
  08:58:08 STEP 2041 H=2041:00 +CPU= 14.501
  08:58:23 STEP 2042 H=2042:00 +CPU= 14.984
  08:58:46 STEP 2043 H=2043:00 +CPU= 22.995
  08:59:01 STEP 2044 H=2044:00 +CPU= 14.976
  08:59:15 STEP 2045 H=2045:00 +CPU= 14.444
  08:59:39 STEP 2046 H=2046:00 +CPU= 23.156
  08:59:53 STEP 2047 H=2047:00 +CPU= 14.441
  09:00:08 STEP 2048 H=2048:00 +CPU= 14.827
  09:00:31 STEP 2049 H=2049:00 +CPU= 22.701
  09:00:46 STEP 2050 H=2050:00 +CPU= 14.917
  09:01:00 STEP 2051 H=2051:00 +CPU= 14.479
  09:01:26 STEP 2052 H=2052:00 +CPU= 25.287
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002052
  09:01:40 STEP 2053 H=2053:00 +CPU= 14.571
  09:01:55 STEP 2054 H=2054:00 +CPU= 14.912
  09:02:18 STEP 2055 H=2055:00 +CPU= 22.740
  09:02:33 STEP 2056 H=2056:00 +CPU= 14.833
  09:02:47 STEP 2057 H=2057:00 +CPU= 14.453
  09:03:10 STEP 2058 H=2058:00 +CPU= 23.074
  09:03:25 STEP 2059 H=2059:00 +CPU= 14.443
  09:03:40 STEP 2060 H=2060:00 +CPU= 14.869
  09:04:03 STEP 2061 H=2061:00 +CPU= 22.784
  09:04:17 STEP 2062 H=2062:00 +CPU= 14.947
  09:04:32 STEP 2063 H=2063:00 +CPU= 14.969
  09:05:00 STEP 2064 H=2064:00 +CPU= 27.521
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_85.zip
Uploading the intermediate file: upload_file_85.zip
  09:05:15 STEP 2065 H=2065:00 +CPU= 14.489
  09:05:30 STEP 2066 H=2066:00 +CPU= 14.893
  09:05:52 STEP 2067 H=2067:00 +CPU= 22.725
  09:06:07 STEP 2068 H=2068:00 +CPU= 14.873
  09:06:22 STEP 2069 H=2069:00 +CPU= 14.603
  09:06:45 STEP 2070 H=2070:00 +CPU= 23.320
  09:07:00 STEP 2071 H=2071:00 +CPU= 14.553
  09:07:15 STEP 2072 H=2072:00 +CPU= 14.880
  09:07:37 STEP 2073 H=2073:00 +CPU= 22.725
  09:07:52 STEP 2074 H=2074:00 +CPU= 14.938
  09:08:07 STEP 2075 H=2075:00 +CPU= 14.447
  09:08:32 STEP 2076 H=2076:00 +CPU= 25.177
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002076
  09:08:47 STEP 2077 H=2077:00 +CPU= 14.574
  09:09:02 STEP 2078 H=2078:00 +CPU= 14.904
  09:09:25 STEP 2079 H=2079:00 +CPU= 22.786
  09:09:39 STEP 2080 H=2080:00 +CPU= 14.920
  09:09:54 STEP 2081 H=2081:00 +CPU= 14.528
  09:10:17 STEP 2082 H=2082:00 +CPU= 23.229
  09:10:32 STEP 2083 H=2083:00 +CPU= 14.499
  09:10:47 STEP 2084 H=2084:00 +CPU= 14.785
  09:11:09 STEP 2085 H=2085:00 +CPU= 22.636
  09:11:24 STEP 2086 H=2086:00 +CPU= 14.777
  09:11:39 STEP 2087 H=2087:00 +CPU= 14.845
  09:12:06 STEP 2088 H=2088:00 +CPU= 27.201
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_86.zip
Uploading the intermediate file: upload_file_86.zip
  09:12:21 STEP 2089 H=2089:00 +CPU= 14.428
  09:12:36 STEP 2090 H=2090:00 +CPU= 14.911
  09:12:59 STEP 2091 H=2091:00 +CPU= 22.914
  09:13:14 STEP 2092 H=2092:00 +CPU= 15.042
  09:13:28 STEP 2093 H=2093:00 +CPU= 14.548
  09:13:51 STEP 2094 H=2094:00 +CPU= 23.138
  09:14:06 STEP 2095 H=2095:00 +CPU= 14.482
  09:14:21 STEP 2096 H=2096:00 +CPU= 14.862
  09:14:44 STEP 2097 H=2097:00 +CPU= 22.699
  09:14:59 STEP 2098 H=2098:00 +CPU= 14.896
  09:15:13 STEP 2099 H=2099:00 +CPU= 14.544
  09:15:38 STEP 2100 H=2100:00 +CPU= 25.214
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002100
  09:15:53 STEP 2101 H=2101:00 +CPU= 14.449
  09:16:08 STEP 2102 H=2102:00 +CPU= 14.902
  09:16:30 STEP 2103 H=2103:00 +CPU= 22.654
  09:16:45 STEP 2104 H=2104:00 +CPU= 14.832
  09:17:00 STEP 2105 H=2105:00 +CPU= 14.565
  09:17:23 STEP 2106 H=2106:00 +CPU= 23.164
  09:17:38 STEP 2107 H=2107:00 +CPU= 14.516
  09:17:53 STEP 2108 H=2108:00 +CPU= 14.906
  09:18:16 STEP 2109 H=2109:00 +CPU= 22.823
  09:18:31 STEP 2110 H=2110:00 +CPU= 15.027
  09:18:46 STEP 2111 H=2111:00 +CPU= 15.054
  09:19:13 STEP 2112 H=2112:00 +CPU= 27.477
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_87.zip
Uploading the intermediate file: upload_file_87.zip
  09:19:28 STEP 2113 H=2113:00 +CPU= 14.501
  09:19:43 STEP 2114 H=2114:00 +CPU= 14.866
  09:20:05 STEP 2115 H=2115:00 +CPU= 22.784
  09:20:20 STEP 2116 H=2116:00 +CPU= 14.960
  09:20:35 STEP 2117 H=2117:00 +CPU= 14.760
  09:20:59 STEP 2118 H=2118:00 +CPU= 23.382
  09:21:13 STEP 2119 H=2119:00 +CPU= 14.561
  09:21:28 STEP 2120 H=2120:00 +CPU= 14.880
  09:21:51 STEP 2121 H=2121:00 +CPU= 22.663
  09:22:06 STEP 2122 H=2122:00 +CPU= 14.866
  09:22:20 STEP 2123 H=2123:00 +CPU= 14.502
  09:22:46 STEP 2124 H=2124:00 +CPU= 25.225
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002124
  09:23:00 STEP 2125 H=2125:00 +CPU= 14.530
  09:23:15 STEP 2126 H=2126:00 +CPU= 14.937
  09:23:38 STEP 2127 H=2127:00 +CPU= 22.766
  09:23:53 STEP 2128 H=2128:00 +CPU= 14.939
  09:24:07 STEP 2129 H=2129:00 +CPU= 14.501
  09:24:31 STEP 2130 H=2130:00 +CPU= 23.109
  09:24:45 STEP 2131 H=2131:00 +CPU= 14.460
  09:25:00 STEP 2132 H=2132:00 +CPU= 14.868
  09:25:23 STEP 2133 H=2133:00 +CPU= 22.762
  09:25:38 STEP 2134 H=2134:00 +CPU= 14.920
  09:25:53 STEP 2135 H=2135:00 +CPU= 14.925
  09:26:20 STEP 2136 H=2136:00 +CPU= 27.381
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_88.zip
Uploading the intermediate file: upload_file_88.zip
  09:26:35 STEP 2137 H=2137:00 +CPU= 14.448
  09:26:50 STEP 2138 H=2138:00 +CPU= 14.859
  09:27:12 STEP 2139 H=2139:00 +CPU= 22.658
  09:27:27 STEP 2140 H=2140:00 +CPU= 14.790
  09:27:41 STEP 2141 H=2141:00 +CPU= 14.438
  09:28:05 STEP 2142 H=2142:00 +CPU= 23.075
  09:28:19 STEP 2143 H=2143:00 +CPU= 14.455
  09:28:34 STEP 2144 H=2144:00 +CPU= 14.848
  09:28:57 STEP 2145 H=2145:00 +CPU= 22.712
  09:29:12 STEP 2146 H=2146:00 +CPU= 14.830
  09:29:26 STEP 2147 H=2147:00 +CPU= 14.529
  09:29:52 STEP 2148 H=2148:00 +CPU= 25.346
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002148
  09:30:06 STEP 2149 H=2149:00 +CPU= 14.550
  09:30:21 STEP 2150 H=2150:00 +CPU= 14.948
  09:30:44 STEP 2151 H=2151:00 +CPU= 22.726
  09:30:59 STEP 2152 H=2152:00 +CPU= 14.901
  09:31:13 STEP 2153 H=2153:00 +CPU= 14.504
  09:31:36 STEP 2154 H=2154:00 +CPU= 23.063
  09:31:51 STEP 2155 H=2155:00 +CPU= 14.544
  09:32:06 STEP 2156 H=2156:00 +CPU= 14.882
  09:32:29 STEP 2157 H=2157:00 +CPU= 22.765
  09:32:44 STEP 2158 H=2158:00 +CPU= 14.870
  09:32:59 STEP 2159 H=2159:00 +CPU= 14.924
  09:33:26 STEP 2160 H=2160:00 +CPU= 27.304
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12168325/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0681_1982050100_123_951_12168325_0_r263001822_89.zip
Uploading the intermediate file: upload_file_89.zip
  09:33:40 STEP 2161 H=2161:00 +CPU= 14.491
Uploading trickle at timestep: 7776000
  09:33:55 STEP 2162 H=2162:00 +CPU= 14.905
  09:34:18 STEP 2163 H=2163:00 +CPU= 22.755
  09:34:33 STEP 2164 H=2164:00 +CPU= 14.969
  09:34:48 STEP 2165 H=2165:00 +CPU= 14.745
  09:35:12 STEP 2166 H=2166:00 +CPU= 23.433
  09:35:26 STEP 2167 H=2167:00 +CPU= 14.739
double free or corruption (out)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:50:40 1485804 22252571 oifs_43r3_ps_0681_1982050100_123_951_12168325_0 7,776,000 38,411 0.0049
09 May 2023 15:50:35 1485804 22252571 oifs_43r3_ps_0681_1982050100_123_951_12168325_0 6,912,000 34,156 0.0049
09 May 2023 15:50:28 1485804 22252571 oifs_43r3_ps_0681_1982050100_123_951_12168325_0 6,048,000 29,901 0.0049
09 May 2023 15:50:22 1485804 22252571 oifs_43r3_ps_0681_1982050100_123_951_12168325_0 5,184,000 25,647 0.0049
09 May 2023 15:50:10 1485804 22252571 oifs_43r3_ps_0681_1982050100_123_951_12168325_0 4,320,000 21,402 0.0050
09 May 2023 15:50:04 1485804 22252571 oifs_43r3_ps_0681_1982050100_123_951_12168325_0 3,456,000 17,148 0.0050
09 May 2023 15:49:59 1485804 22252571 oifs_43r3_ps_0681_1982050100_123_951_12168325_0 2,592,000 12,894 0.0050
09 May 2023 15:49:53 1485804 22252571 oifs_43r3_ps_0681_1982050100_123_951_12168325_0 1,728,000 8,641 0.0050
09 May 2023 15:49:48 1485804 22252571 oifs_43r3_ps_0681_1982050100_123_951_12168325_0 864,000 4,359 0.0050


©2024 cpdn.org