climateprediction.net home page
Task 22289909

Task 22289909

Name oifs_43r3_ps_0808_2017050100_123_986_12203452_0
Workunit 12203452
Created 24 Dec 2022, 18:58:31 UTC
Sent 2 Jan 2023, 6:59:02 UTC
Report deadline 1 Feb 2023, 6:59:02 UTC
Received 26 Jan 2023, 11:14:01 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1532494
Run time 14 hours 51 min 52 sec
CPU time 14 hours 43 min 56 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 3.87 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,413.83 MB
Peak swap size 4,974.14 MB
Peak disk usage 1,212.78 MB
Stderr 
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
14:00 +CPU= 20.711
  00:39:51 STEP 1515 H=1515:00 +CPU= 31.900
  00:40:12 STEP 1516 H=1516:00 +CPU= 20.530
  00:40:32 STEP 1517 H=1517:00 +CPU= 19.693
  00:41:05 STEP 1518 H=1518:00 +CPU= 32.686
  00:41:25 STEP 1519 H=1519:00 +CPU= 19.793
  00:41:46 STEP 1520 H=1520:00 +CPU= 20.492
  00:42:18 STEP 1521 H=1521:00 +CPU= 31.991
  00:42:39 STEP 1522 H=1522:00 +CPU= 20.489
  00:42:59 STEP 1523 H=1523:00 +CPU= 19.960
  00:43:35 STEP 1524 H=1524:00 +CPU= 35.263
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001524
  00:43:55 STEP 1525 H=1525:00 +CPU= 19.873
  00:44:15 STEP 1526 H=1526:00 +CPU= 20.436
  00:44:48 STEP 1527 H=1527:00 +CPU= 31.994
  00:45:08 STEP 1528 H=1528:00 +CPU= 20.472
  00:45:28 STEP 1529 H=1529:00 +CPU= 19.884
  00:46:02 STEP 1530 H=1530:00 +CPU= 32.857
  00:46:22 STEP 1531 H=1531:00 +CPU= 19.833
  00:46:42 STEP 1532 H=1532:00 +CPU= 20.483
  00:47:15 STEP 1533 H=1533:00 +CPU= 32.065
  00:47:35 STEP 1534 H=1534:00 +CPU= 20.315
  00:47:56 STEP 1535 H=1535:00 +CPU= 20.292
  00:48:34 STEP 1536 H=1536:00 +CPU= 38.013
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_63.zip
Uploading the intermediate file: upload_file_63.zip
  00:48:54 STEP 1537 H=1537:00 +CPU= 20.150
  00:49:15 STEP 1538 H=1538:00 +CPU= 20.707
  00:49:48 STEP 1539 H=1539:00 +CPU= 32.198
  00:50:09 STEP 1540 H=1540:00 +CPU= 20.383
  00:50:29 STEP 1541 H=1541:00 +CPU= 19.928
  00:51:02 STEP 1542 H=1542:00 +CPU= 32.700
  00:51:22 STEP 1543 H=1543:00 +CPU= 19.847
  00:51:42 STEP 1544 H=1544:00 +CPU= 20.315
  00:52:14 STEP 1545 H=1545:00 +CPU= 31.856
  00:52:35 STEP 1546 H=1546:00 +CPU= 20.485
  00:52:55 STEP 1547 H=1547:00 +CPU= 19.898
  00:53:31 STEP 1548 H=1548:00 +CPU= 35.520
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001548
  00:53:51 STEP 1549 H=1549:00 +CPU= 19.855
  00:54:12 STEP 1550 H=1550:00 +CPU= 20.485
  00:54:44 STEP 1551 H=1551:00 +CPU= 32.125
  00:55:05 STEP 1552 H=1552:00 +CPU= 20.197
  00:55:24 STEP 1553 H=1553:00 +CPU= 19.569
  00:55:57 STEP 1554 H=1554:00 +CPU= 32.354
  00:56:17 STEP 1555 H=1555:00 +CPU= 19.554
  00:56:37 STEP 1556 H=1556:00 +CPU= 20.163
  00:57:09 STEP 1557 H=1557:00 +CPU= 31.626
  00:57:29 STEP 1558 H=1558:00 +CPU= 20.170
  00:57:50 STEP 1559 H=1559:00 +CPU= 20.135
  00:58:27 STEP 1560 H=1560:00 +CPU= 37.222
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_64.zip
Uploading the intermediate file: upload_file_64.zip
  00:58:47 STEP 1561 H=1561:00 +CPU= 19.561
  00:59:07 STEP 1562 H=1562:00 +CPU= 20.188
  00:59:40 STEP 1563 H=1563:00 +CPU= 32.358
  01:00:00 STEP 1564 H=1564:00 +CPU= 20.469
  01:00:20 STEP 1565 H=1565:00 +CPU= 19.720
  01:00:53 STEP 1566 H=1566:00 +CPU= 32.236
  01:01:13 STEP 1567 H=1567:00 +CPU= 19.622
  01:01:33 STEP 1568 H=1568:00 +CPU= 20.181
  01:02:05 STEP 1569 H=1569:00 +CPU= 31.596
  01:02:25 STEP 1570 H=1570:00 +CPU= 20.175
  01:02:45 STEP 1571 H=1571:00 +CPU= 19.563
  01:03:20 STEP 1572 H=1572:00 +CPU= 34.810
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001572
  01:03:40 STEP 1573 H=1573:00 +CPU= 19.544
  01:04:00 STEP 1574 H=1574:00 +CPU= 20.227
  01:04:32 STEP 1575 H=1575:00 +CPU= 31.562
  01:04:52 STEP 1576 H=1576:00 +CPU= 20.124
  01:05:12 STEP 1577 H=1577:00 +CPU= 19.519
  01:05:45 STEP 1578 H=1578:00 +CPU= 32.251
  01:06:04 STEP 1579 H=1579:00 +CPU= 19.514
  01:06:25 STEP 1580 H=1580:00 +CPU= 20.117
  01:06:56 STEP 1581 H=1581:00 +CPU= 31.525
  01:07:17 STEP 1582 H=1582:00 +CPU= 20.118
  01:07:37 STEP 1583 H=1583:00 +CPU= 20.035
  01:08:14 STEP 1584 H=1584:00 +CPU= 37.234
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_65.zip
Uploading the intermediate file: upload_file_65.zip
  01:08:34 STEP 1585 H=1585:00 +CPU= 19.599
  01:08:55 STEP 1586 H=1586:00 +CPU= 20.252
  01:09:27 STEP 1587 H=1587:00 +CPU= 31.574
  01:09:47 STEP 1588 H=1588:00 +CPU= 20.174
  01:10:07 STEP 1589 H=1589:00 +CPU= 19.873
  01:10:40 STEP 1590 H=1590:00 +CPU= 32.766
  01:11:00 STEP 1591 H=1591:00 +CPU= 19.869
  01:11:20 STEP 1592 H=1592:00 +CPU= 20.315
  01:11:52 STEP 1593 H=1593:00 +CPU= 31.550
  01:12:13 STEP 1594 H=1594:00 +CPU= 20.181
  01:12:32 STEP 1595 H=1595:00 +CPU= 19.539
  01:13:08 STEP 1596 H=1596:00 +CPU= 34.896
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001596
  01:13:27 STEP 1597 H=1597:00 +CPU= 19.544
  01:13:48 STEP 1598 H=1598:00 +CPU= 20.206
  01:14:20 STEP 1599 H=1599:00 +CPU= 31.571
  01:14:40 STEP 1600 H=1600:00 +CPU= 20.154
  01:15:00 STEP 1601 H=1601:00 +CPU= 19.501
  01:15:32 STEP 1602 H=1602:00 +CPU= 32.232
  01:15:52 STEP 1603 H=1603:00 +CPU= 19.539
  01:16:12 STEP 1604 H=1604:00 +CPU= 20.139
  01:16:44 STEP 1605 H=1605:00 +CPU= 31.546
  01:17:04 STEP 1606 H=1606:00 +CPU= 20.197
  01:17:24 STEP 1607 H=1607:00 +CPU= 20.056
  01:18:02 STEP 1608 H=1608:00 +CPU= 37.153
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_66.zip
Uploading the intermediate file: upload_file_66.zip
  01:18:22 STEP 1609 H=1609:00 +CPU= 19.517
  01:18:42 STEP 1610 H=1610:00 +CPU= 20.106
  01:19:14 STEP 1611 H=1611:00 +CPU= 31.503
  01:19:34 STEP 1612 H=1612:00 +CPU= 20.079
  01:19:55 STEP 1613 H=1613:00 +CPU= 20.548
  01:20:28 STEP 1614 H=1614:00 +CPU= 32.756
  01:20:48 STEP 1615 H=1615:00 +CPU= 19.666
  01:21:08 STEP 1616 H=1616:00 +CPU= 20.108
  01:21:40 STEP 1617 H=1617:00 +CPU= 31.583
  01:22:00 STEP 1618 H=1618:00 +CPU= 20.155
  01:22:20 STEP 1619 H=1619:00 +CPU= 19.580
  01:22:55 STEP 1620 H=1620:00 +CPU= 34.893
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001620
  01:23:15 STEP 1621 H=1621:00 +CPU= 19.518
  01:23:35 STEP 1622 H=1622:00 +CPU= 20.188
  01:24:07 STEP 1623 H=1623:00 +CPU= 31.481
  01:24:27 STEP 1624 H=1624:00 +CPU= 20.111
  01:24:47 STEP 1625 H=1625:00 +CPU= 19.497
  01:25:19 STEP 1626 H=1626:00 +CPU= 32.194
  01:25:39 STEP 1627 H=1627:00 +CPU= 19.509
  01:25:59 STEP 1628 H=1628:00 +CPU= 20.081
  01:26:31 STEP 1629 H=1629:00 +CPU= 31.494
  01:26:51 STEP 1630 H=1630:00 +CPU= 20.098
  01:27:11 STEP 1631 H=1631:00 +CPU= 19.984
  01:27:49 STEP 1632 H=1632:00 +CPU= 37.167
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_67.zip
Uploading the intermediate file: upload_file_67.zip
  01:28:08 STEP 1633 H=1633:00 +CPU= 19.505
  01:28:29 STEP 1634 H=1634:00 +CPU= 20.103
  01:29:01 STEP 1635 H=1635:00 +CPU= 31.530
  01:29:21 STEP 1636 H=1636:00 +CPU= 20.055
  01:29:40 STEP 1637 H=1637:00 +CPU= 19.502
  01:30:14 STEP 1638 H=1638:00 +CPU= 32.824
  01:30:33 STEP 1639 H=1639:00 +CPU= 19.653
  01:30:54 STEP 1640 H=1640:00 +CPU= 20.272
  01:31:26 STEP 1641 H=1641:00 +CPU= 31.489
  01:31:46 STEP 1642 H=1642:00 +CPU= 20.216
  01:32:06 STEP 1643 H=1643:00 +CPU= 19.546
  01:32:41 STEP 1644 H=1644:00 +CPU= 34.886
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001644
  01:33:01 STEP 1645 H=1645:00 +CPU= 19.571
  01:33:21 STEP 1646 H=1646:00 +CPU= 20.117
  01:33:53 STEP 1647 H=1647:00 +CPU= 31.484
  01:34:13 STEP 1648 H=1648:00 +CPU= 20.110
  01:34:33 STEP 1649 H=1649:00 +CPU= 19.559
  01:35:05 STEP 1650 H=1650:00 +CPU= 32.199
  01:35:25 STEP 1651 H=1651:00 +CPU= 19.509
  01:35:45 STEP 1652 H=1652:00 +CPU= 20.113
  01:36:17 STEP 1653 H=1653:00 +CPU= 31.490
  01:36:37 STEP 1654 H=1654:00 +CPU= 20.057
  01:36:57 STEP 1655 H=1655:00 +CPU= 20.006
  01:37:35 STEP 1656 H=1656:00 +CPU= 37.166
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_68.zip
Uploading the intermediate file: upload_file_68.zip
  01:37:54 STEP 1657 H=1657:00 +CPU= 19.544
  01:38:15 STEP 1658 H=1658:00 +CPU= 20.120
  01:38:47 STEP 1659 H=1659:00 +CPU= 31.550
  01:39:07 STEP 1660 H=1660:00 +CPU= 20.062
  01:39:27 STEP 1661 H=1661:00 +CPU= 19.870
  01:40:00 STEP 1662 H=1662:00 +CPU= 32.722
  01:40:20 STEP 1663 H=1663:00 +CPU= 19.833
  01:40:40 STEP 1664 H=1664:00 +CPU= 20.244
  01:41:12 STEP 1665 H=1665:00 +CPU= 31.490
  01:41:32 STEP 1666 H=1666:00 +CPU= 20.287
  01:41:52 STEP 1667 H=1667:00 +CPU= 19.580
  01:42:27 STEP 1668 H=1668:00 +CPU= 34.862
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001668
  01:42:47 STEP 1669 H=1669:00 +CPU= 19.567
  01:43:07 STEP 1670 H=1670:00 +CPU= 20.182
  01:43:39 STEP 1671 H=1671:00 +CPU= 31.513
  01:43:59 STEP 1672 H=1672:00 +CPU= 20.115
  01:44:19 STEP 1673 H=1673:00 +CPU= 19.484
  01:44:52 STEP 1674 H=1674:00 +CPU= 32.234
  01:45:11 STEP 1675 H=1675:00 +CPU= 19.520
  01:45:32 STEP 1676 H=1676:00 +CPU= 20.104
  01:46:03 STEP 1677 H=1677:00 +CPU= 31.473
  01:46:24 STEP 1678 H=1678:00 +CPU= 20.076
  01:46:44 STEP 1679 H=1679:00 +CPU= 20.026
  01:47:21 STEP 1680 H=1680:00 +CPU= 37.143
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_69.zip
Uploading the intermediate file: upload_file_69.zip
  01:47:41 STEP 1681 H=1681:00 +CPU= 19.500
Uploading trickle at timestep: 6048000
  01:48:01 STEP 1682 H=1682:00 +CPU= 20.095
  01:48:33 STEP 1683 H=1683:00 +CPU= 31.449
  01:48:53 STEP 1684 H=1684:00 +CPU= 20.155
  01:49:13 STEP 1685 H=1685:00 +CPU= 19.565
  01:49:46 STEP 1686 H=1686:00 +CPU= 32.695
  01:50:06 STEP 1687 H=1687:00 +CPU= 19.920
  01:50:27 STEP 1688 H=1688:00 +CPU= 20.537
  01:50:59 STEP 1689 H=1689:00 +CPU= 31.756
  01:51:19 STEP 1690 H=1690:00 +CPU= 20.212
  01:51:39 STEP 1691 H=1691:00 +CPU= 19.496
  01:52:14 STEP 1692 H=1692:00 +CPU= 34.800
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001692
  01:52:34 STEP 1693 H=1693:00 +CPU= 19.589
  01:52:54 STEP 1694 H=1694:00 +CPU= 20.146
  01:53:26 STEP 1695 H=1695:00 +CPU= 31.525
  01:53:46 STEP 1696 H=1696:00 +CPU= 20.168
  01:54:06 STEP 1697 H=1697:00 +CPU= 19.571
  01:54:38 STEP 1698 H=1698:00 +CPU= 32.223
  01:54:58 STEP 1699 H=1699:00 +CPU= 19.487
  01:55:18 STEP 1700 H=1700:00 +CPU= 20.153
  01:55:50 STEP 1701 H=1701:00 +CPU= 31.527
  01:56:10 STEP 1702 H=1702:00 +CPU= 20.119
  01:56:31 STEP 1703 H=1703:00 +CPU= 20.037
  01:57:08 STEP 1704 H=1704:00 +CPU= 37.142
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_70.zip
Uploading the intermediate file: upload_file_70.zip
  01:57:28 STEP 1705 H=1705:00 +CPU= 19.522
  01:57:48 STEP 1706 H=1706:00 +CPU= 20.137
  01:58:20 STEP 1707 H=1707:00 +CPU= 31.565
  01:58:40 STEP 1708 H=1708:00 +CPU= 20.137
  01:59:00 STEP 1709 H=1709:00 +CPU= 19.501
  01:59:33 STEP 1710 H=1710:00 +CPU= 32.472
  01:59:53 STEP 1711 H=1711:00 +CPU= 19.974
  02:00:13 STEP 1712 H=1712:00 +CPU= 20.492
  02:00:45 STEP 1713 H=1713:00 +CPU= 31.757
  02:01:06 STEP 1714 H=1714:00 +CPU= 20.199
  02:01:26 STEP 1715 H=1715:00 +CPU= 19.542
  02:02:01 STEP 1716 H=1716:00 +CPU= 34.861
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001716
  02:02:20 STEP 1717 H=1717:00 +CPU= 19.549
  02:02:41 STEP 1718 H=1718:00 +CPU= 20.208
  02:03:13 STEP 1719 H=1719:00 +CPU= 31.575
  02:03:33 STEP 1720 H=1720:00 +CPU= 20.172
  02:03:53 STEP 1721 H=1721:00 +CPU= 19.548
  02:04:25 STEP 1722 H=1722:00 +CPU= 32.331
  02:04:45 STEP 1723 H=1723:00 +CPU= 19.531
  02:05:05 STEP 1724 H=1724:00 +CPU= 20.137
  02:05:37 STEP 1725 H=1725:00 +CPU= 31.557
  02:05:58 STEP 1726 H=1726:00 +CPU= 20.193
  02:06:18 STEP 1727 H=1727:00 +CPU= 20.084
  02:06:56 STEP 1728 H=1728:00 +CPU= 37.215
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_71.zip
Uploading the intermediate file: upload_file_71.zip
  02:07:15 STEP 1729 H=1729:00 +CPU= 19.493
  02:07:35 STEP 1730 H=1730:00 +CPU= 20.075
  02:08:07 STEP 1731 H=1731:00 +CPU= 31.595
  02:08:28 STEP 1732 H=1732:00 +CPU= 20.109
  02:08:47 STEP 1733 H=1733:00 +CPU= 19.518
  02:09:21 STEP 1734 H=1734:00 +CPU= 33.002
  02:09:40 STEP 1735 H=1735:00 +CPU= 19.779
  02:10:01 STEP 1736 H=1736:00 +CPU= 20.302
  02:10:33 STEP 1737 H=1737:00 +CPU= 31.508
  02:10:53 STEP 1738 H=1738:00 +CPU= 20.134
  02:11:13 STEP 1739 H=1739:00 +CPU= 19.542
  02:11:48 STEP 1740 H=1740:00 +CPU= 34.815
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001740
  02:12:08 STEP 1741 H=1741:00 +CPU= 19.536
  02:12:28 STEP 1742 H=1742:00 +CPU= 20.162
  02:13:00 STEP 1743 H=1743:00 +CPU= 31.612
  02:13:20 STEP 1744 H=1744:00 +CPU= 20.135
  02:13:40 STEP 1745 H=1745:00 +CPU= 19.526
  02:14:12 STEP 1746 H=1746:00 +CPU= 32.291
  02:14:32 STEP 1747 H=1747:00 +CPU= 19.497
  02:14:52 STEP 1748 H=1748:00 +CPU= 20.158
  02:15:24 STEP 1749 H=1749:00 +CPU= 31.561
  02:15:45 STEP 1750 H=1750:00 +CPU= 20.086
  02:16:05 STEP 1751 H=1751:00 +CPU= 20.059
  02:16:42 STEP 1752 H=1752:00 +CPU= 37.107
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_72.zip
Uploading the intermediate file: upload_file_72.zip
  02:17:02 STEP 1753 H=1753:00 +CPU= 19.555
  02:17:22 STEP 1754 H=1754:00 +CPU= 20.143
  02:17:54 STEP 1755 H=1755:00 +CPU= 31.613
  02:18:14 STEP 1756 H=1756:00 +CPU= 20.161
  02:18:34 STEP 1757 H=1757:00 +CPU= 19.543
  02:19:08 STEP 1758 H=1758:00 +CPU= 33.465
  02:19:28 STEP 1759 H=1759:00 +CPU= 19.713
  02:19:48 STEP 1760 H=1760:00 +CPU= 20.309
  02:20:20 STEP 1761 H=1761:00 +CPU= 31.617
  02:20:40 STEP 1762 H=1762:00 +CPU= 20.101
  02:21:00 STEP 1763 H=1763:00 +CPU= 19.572
  02:21:35 STEP 1764 H=1764:00 +CPU= 34.926
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001764
  02:21:55 STEP 1765 H=1765:00 +CPU= 19.609
  02:22:16 STEP 1766 H=1766:00 +CPU= 20.216
  02:22:47 STEP 1767 H=1767:00 +CPU= 31.607
  02:23:08 STEP 1768 H=1768:00 +CPU= 20.179
  02:23:27 STEP 1769 H=1769:00 +CPU= 19.535
  02:24:00 STEP 1770 H=1770:00 +CPU= 32.308
  02:24:20 STEP 1771 H=1771:00 +CPU= 19.523
  02:24:40 STEP 1772 H=1772:00 +CPU= 20.099
  02:25:12 STEP 1773 H=1773:00 +CPU= 31.535
  02:25:32 STEP 1774 H=1774:00 +CPU= 20.075
  02:25:52 STEP 1775 H=1775:00 +CPU= 20.054
  02:26:30 STEP 1776 H=1776:00 +CPU= 37.055
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_73.zip
Uploading the intermediate file: upload_file_73.zip
  02:26:49 STEP 1777 H=1777:00 +CPU= 19.482
  02:27:10 STEP 1778 H=1778:00 +CPU= 20.133
  02:27:41 STEP 1779 H=1779:00 +CPU= 31.534
  02:28:02 STEP 1780 H=1780:00 +CPU= 20.160
  02:28:21 STEP 1781 H=1781:00 +CPU= 19.508
  02:28:54 STEP 1782 H=1782:00 +CPU= 32.223
  02:29:14 STEP 1783 H=1783:00 +CPU= 19.549
  02:29:34 STEP 1784 H=1784:00 +CPU= 20.606
  02:30:07 STEP 1785 H=1785:00 +CPU= 32.123
  02:30:27 STEP 1786 H=1786:00 +CPU= 20.419
  02:30:47 STEP 1787 H=1787:00 +CPU= 19.642
  02:31:22 STEP 1788 H=1788:00 +CPU= 34.841
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001788
  02:31:42 STEP 1789 H=1789:00 +CPU= 19.533
  02:32:02 STEP 1790 H=1790:00 +CPU= 20.171
  02:32:34 STEP 1791 H=1791:00 +CPU= 31.516
  02:32:55 STEP 1792 H=1792:00 +CPU= 20.186
  02:33:14 STEP 1793 H=1793:00 +CPU= 19.587
  02:33:47 STEP 1794 H=1794:00 +CPU= 32.237
  02:34:06 STEP 1795 H=1795:00 +CPU= 19.505
  02:34:27 STEP 1796 H=1796:00 +CPU= 20.142
  02:34:59 STEP 1797 H=1797:00 +CPU= 31.582
  02:35:19 STEP 1798 H=1798:00 +CPU= 20.048
  02:35:39 STEP 1799 H=1799:00 +CPU= 20.044
  02:36:17 STEP 1800 H=1800:00 +CPU= 37.104
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_74.zip
Uploading the intermediate file: upload_file_74.zip
  02:36:36 STEP 1801 H=1801:00 +CPU= 19.482
  02:36:56 STEP 1802 H=1802:00 +CPU= 20.109
  02:37:28 STEP 1803 H=1803:00 +CPU= 31.584
  02:37:49 STEP 1804 H=1804:00 +CPU= 20.173
  02:38:08 STEP 1805 H=1805:00 +CPU= 19.509
  02:38:41 STEP 1806 H=1806:00 +CPU= 32.292
  02:39:01 STEP 1807 H=1807:00 +CPU= 19.495
  02:39:21 STEP 1808 H=1808:00 +CPU= 20.135
  02:39:53 STEP 1809 H=1809:00 +CPU= 32.099
  02:40:14 STEP 1810 H=1810:00 +CPU= 20.399
  02:40:34 STEP 1811 H=1811:00 +CPU= 19.751
  02:41:09 STEP 1812 H=1812:00 +CPU= 34.843
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001812
  02:41:29 STEP 1813 H=1813:00 +CPU= 19.570
  02:41:49 STEP 1814 H=1814:00 +CPU= 20.129
  02:42:21 STEP 1815 H=1815:00 +CPU= 31.553
  02:42:41 STEP 1816 H=1816:00 +CPU= 20.143
  02:43:01 STEP 1817 H=1817:00 +CPU= 19.520
  02:43:33 STEP 1818 H=1818:00 +CPU= 32.195
  02:43:53 STEP 1819 H=1819:00 +CPU= 19.475
  02:44:13 STEP 1820 H=1820:00 +CPU= 20.080
  02:44:45 STEP 1821 H=1821:00 +CPU= 31.462
  02:45:05 STEP 1822 H=1822:00 +CPU= 20.110
  02:45:25 STEP 1823 H=1823:00 +CPU= 20.056
  02:46:03 STEP 1824 H=1824:00 +CPU= 37.198
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_75.zip
Uploading the intermediate file: upload_file_75.zip
  02:46:23 STEP 1825 H=1825:00 +CPU= 19.505
  02:46:43 STEP 1826 H=1826:00 +CPU= 20.112
  02:47:15 STEP 1827 H=1827:00 +CPU= 31.564
  02:47:35 STEP 1828 H=1828:00 +CPU= 20.085
  02:47:55 STEP 1829 H=1829:00 +CPU= 19.513
  02:48:27 STEP 1830 H=1830:00 +CPU= 32.277
  02:48:47 STEP 1831 H=1831:00 +CPU= 19.531
  02:49:07 STEP 1832 H=1832:00 +CPU= 20.226
  02:49:39 STEP 1833 H=1833:00 +CPU= 31.442
  02:49:59 STEP 1834 H=1834:00 +CPU= 20.194
  02:50:19 STEP 1835 H=1835:00 +CPU= 19.544
  02:50:54 STEP 1836 H=1836:00 +CPU= 34.870
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001836
  02:51:14 STEP 1837 H=1837:00 +CPU= 19.621
  02:51:35 STEP 1838 H=1838:00 +CPU= 20.491
  02:52:07 STEP 1839 H=1839:00 +CPU= 31.877
  02:52:27 STEP 1840 H=1840:00 +CPU= 20.452
  02:52:47 STEP 1841 H=1841:00 +CPU= 19.508
  02:53:20 STEP 1842 H=1842:00 +CPU= 32.195
  02:53:39 STEP 1843 H=1843:00 +CPU= 19.487
  02:53:59 STEP 1844 H=1844:00 +CPU= 20.093
  02:54:31 STEP 1845 H=1845:00 +CPU= 31.464
  02:54:52 STEP 1846 H=1846:00 +CPU= 20.116
  02:55:12 STEP 1847 H=1847:00 +CPU= 20.027
  02:55:49 STEP 1848 H=1848:00 +CPU= 37.063
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_76.zip
Uploading the intermediate file: upload_file_76.zip
  02:56:09 STEP 1849 H=1849:00 +CPU= 19.504
  02:56:29 STEP 1850 H=1850:00 +CPU= 20.113
  02:57:01 STEP 1851 H=1851:00 +CPU= 31.491
  02:57:21 STEP 1852 H=1852:00 +CPU= 20.101
  02:57:41 STEP 1853 H=1853:00 +CPU= 19.500
  02:58:13 STEP 1854 H=1854:00 +CPU= 32.217
  02:58:33 STEP 1855 H=1855:00 +CPU= 19.541
  02:58:53 STEP 1856 H=1856:00 +CPU= 20.147
  02:59:25 STEP 1857 H=1857:00 +CPU= 31.506
  02:59:45 STEP 1858 H=1858:00 +CPU= 20.179
  03:00:05 STEP 1859 H=1859:00 +CPU= 19.559
  03:00:40 STEP 1860 H=1860:00 +CPU= 34.898
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001860
  03:01:00 STEP 1861 H=1861:00 +CPU= 19.512
  03:01:20 STEP 1862 H=1862:00 +CPU= 20.160
  03:01:52 STEP 1863 H=1863:00 +CPU= 31.478
  03:02:12 STEP 1864 H=1864:00 +CPU= 20.135
  03:02:32 STEP 1865 H=1865:00 +CPU= 19.478
  03:03:05 STEP 1866 H=1866:00 +CPU= 32.694
  03:03:25 STEP 1867 H=1867:00 +CPU= 19.804
  03:03:46 STEP 1868 H=1868:00 +CPU= 20.344
  03:04:17 STEP 1869 H=1869:00 +CPU= 31.512
  03:04:38 STEP 1870 H=1870:00 +CPU= 20.079
  03:04:58 STEP 1871 H=1871:00 +CPU= 20.026
  03:05:35 STEP 1872 H=1872:00 +CPU= 37.080
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_77.zip
Uploading the intermediate file: upload_file_77.zip
  03:05:55 STEP 1873 H=1873:00 +CPU= 19.488
  03:06:15 STEP 1874 H=1874:00 +CPU= 20.084
  03:06:47 STEP 1875 H=1875:00 +CPU= 31.586
  03:07:07 STEP 1876 H=1876:00 +CPU= 20.085
  03:07:27 STEP 1877 H=1877:00 +CPU= 19.501
  03:07:59 STEP 1878 H=1878:00 +CPU= 32.177
  03:08:19 STEP 1879 H=1879:00 +CPU= 19.502
  03:08:39 STEP 1880 H=1880:00 +CPU= 20.213
  03:09:11 STEP 1881 H=1881:00 +CPU= 31.515
  03:09:32 STEP 1882 H=1882:00 +CPU= 20.118
  03:09:51 STEP 1883 H=1883:00 +CPU= 19.527
  03:10:26 STEP 1884 H=1884:00 +CPU= 34.948
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001884
  03:10:46 STEP 1885 H=1885:00 +CPU= 19.523
  03:11:06 STEP 1886 H=1886:00 +CPU= 20.121
  03:11:38 STEP 1887 H=1887:00 +CPU= 31.448
  03:11:59 STEP 1888 H=1888:00 +CPU= 20.219
  03:12:18 STEP 1889 H=1889:00 +CPU= 19.535
  03:12:51 STEP 1890 H=1890:00 +CPU= 32.859
  03:13:11 STEP 1891 H=1891:00 +CPU= 19.753
  03:13:32 STEP 1892 H=1892:00 +CPU= 20.270
  03:14:04 STEP 1893 H=1893:00 +CPU= 31.521
  03:14:24 STEP 1894 H=1894:00 +CPU= 20.084
  03:14:44 STEP 1895 H=1895:00 +CPU= 20.007
  03:15:21 STEP 1896 H=1896:00 +CPU= 37.099
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_78.zip
Uploading the intermediate file: upload_file_78.zip
  03:15:41 STEP 1897 H=1897:00 +CPU= 19.479
  03:16:01 STEP 1898 H=1898:00 +CPU= 20.144
  03:16:33 STEP 1899 H=1899:00 +CPU= 31.530
  03:16:54 STEP 1900 H=1900:00 +CPU= 20.111
  03:17:13 STEP 1901 H=1901:00 +CPU= 19.542
  03:17:46 STEP 1902 H=1902:00 +CPU= 32.215
  03:18:05 STEP 1903 H=1903:00 +CPU= 19.513
  03:18:26 STEP 1904 H=1904:00 +CPU= 20.123
  03:18:57 STEP 1905 H=1905:00 +CPU= 31.495
  03:19:18 STEP 1906 H=1906:00 +CPU= 20.148
  03:19:37 STEP 1907 H=1907:00 +CPU= 19.539
  03:20:13 STEP 1908 H=1908:00 +CPU= 34.854
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001908
  03:20:32 STEP 1909 H=1909:00 +CPU= 19.534
  03:20:53 STEP 1910 H=1910:00 +CPU= 20.163
  03:21:24 STEP 1911 H=1911:00 +CPU= 31.502
  03:21:45 STEP 1912 H=1912:00 +CPU= 20.176
  03:22:04 STEP 1913 H=1913:00 +CPU= 19.498
  03:22:37 STEP 1914 H=1914:00 +CPU= 32.223
  03:22:57 STEP 1915 H=1915:00 +CPU= 19.578
  03:23:17 STEP 1916 H=1916:00 +CPU= 20.087
  03:23:49 STEP 1917 H=1917:00 +CPU= 31.470
  03:24:09 STEP 1918 H=1918:00 +CPU= 20.087
  03:24:29 STEP 1919 H=1919:00 +CPU= 20.018
  03:25:07 STEP 1920 H=1920:00 +CPU= 37.819
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_79.zip
Uploading the intermediate file: upload_file_79.zip
  03:25:27 STEP 1921 H=1921:00 +CPU= 19.819
Uploading trickle at timestep: 6912000
  03:25:48 STEP 1922 H=1922:00 +CPU= 20.407
  03:26:20 STEP 1923 H=1923:00 +CPU= 31.756
  03:26:40 STEP 1924 H=1924:00 +CPU= 20.124
  03:27:00 STEP 1925 H=1925:00 +CPU= 19.546
  03:27:32 STEP 1926 H=1926:00 +CPU= 32.299
  03:27:52 STEP 1927 H=1927:00 +CPU= 19.553
  03:28:12 STEP 1928 H=1928:00 +CPU= 20.124
  03:28:44 STEP 1929 H=1929:00 +CPU= 31.535
  03:29:05 STEP 1930 H=1930:00 +CPU= 20.143
  03:29:24 STEP 1931 H=1931:00 +CPU= 19.537
  03:29:59 STEP 1932 H=1932:00 +CPU= 34.919
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001932
  03:30:19 STEP 1933 H=1933:00 +CPU= 19.563
  03:30:39 STEP 1934 H=1934:00 +CPU= 20.144
  03:31:11 STEP 1935 H=1935:00 +CPU= 31.560
  03:31:32 STEP 1936 H=1936:00 +CPU= 20.219
  03:31:51 STEP 1937 H=1937:00 +CPU= 19.541
  03:32:24 STEP 1938 H=1938:00 +CPU= 32.261
  03:32:44 STEP 1939 H=1939:00 +CPU= 19.487
  03:33:04 STEP 1940 H=1940:00 +CPU= 20.147
  03:33:37 STEP 1941 H=1941:00 +CPU= 32.951
  03:33:58 STEP 1942 H=1942:00 +CPU= 20.090
  03:34:18 STEP 1943 H=1943:00 +CPU= 20.032
  03:34:55 STEP 1944 H=1944:00 +CPU= 37.265
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_80.zip
Uploading the intermediate file: upload_file_80.zip
  03:35:16 STEP 1945 H=1945:00 +CPU= 20.103
  03:35:36 STEP 1946 H=1946:00 +CPU= 20.380
  03:36:08 STEP 1947 H=1947:00 +CPU= 31.839
  03:36:29 STEP 1948 H=1948:00 +CPU= 20.132
  03:36:48 STEP 1949 H=1949:00 +CPU= 19.524
  03:37:21 STEP 1950 H=1950:00 +CPU= 32.226
  03:37:40 STEP 1951 H=1951:00 +CPU= 19.545
  03:38:01 STEP 1952 H=1952:00 +CPU= 20.150
  03:38:33 STEP 1953 H=1953:00 +CPU= 31.594
  03:38:53 STEP 1954 H=1954:00 +CPU= 20.141
  03:39:13 STEP 1955 H=1955:00 +CPU= 19.561
  03:39:48 STEP 1956 H=1956:00 +CPU= 34.874
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001956
  03:40:08 STEP 1957 H=1957:00 +CPU= 19.536
  03:40:28 STEP 1958 H=1958:00 +CPU= 20.177
  03:41:00 STEP 1959 H=1959:00 +CPU= 31.528
  03:41:20 STEP 1960 H=1960:00 +CPU= 20.124
  03:41:40 STEP 1961 H=1961:00 +CPU= 19.530
  03:42:12 STEP 1962 H=1962:00 +CPU= 32.222
  03:42:32 STEP 1963 H=1963:00 +CPU= 19.499
  03:42:52 STEP 1964 H=1964:00 +CPU= 20.133
  03:43:24 STEP 1965 H=1965:00 +CPU= 31.535
  03:43:44 STEP 1966 H=1966:00 +CPU= 20.099
  03:44:04 STEP 1967 H=1967:00 +CPU= 20.069
  03:44:42 STEP 1968 H=1968:00 +CPU= 37.126
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_81.zip
Uploading the intermediate file: upload_file_81.zip
  03:45:01 STEP 1969 H=1969:00 +CPU= 19.520
  03:45:22 STEP 1970 H=1970:00 +CPU= 20.114
  03:45:54 STEP 1971 H=1971:00 +CPU= 31.515
  03:46:14 STEP 1972 H=1972:00 +CPU= 20.527
  03:46:34 STEP 1973 H=1973:00 +CPU= 19.825
  03:47:07 STEP 1974 H=1974:00 +CPU= 32.911
  03:47:27 STEP 1975 H=1975:00 +CPU= 19.624
  03:47:48 STEP 1976 H=1976:00 +CPU= 20.217
  03:48:20 STEP 1977 H=1977:00 +CPU= 31.646
  03:48:40 STEP 1978 H=1978:00 +CPU= 20.175
  03:49:00 STEP 1979 H=1979:00 +CPU= 19.570
  03:49:35 STEP 1980 H=1980:00 +CPU= 34.923
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001980
  03:49:55 STEP 1981 H=1981:00 +CPU= 19.585
  03:50:15 STEP 1982 H=1982:00 +CPU= 20.187
  03:50:47 STEP 1983 H=1983:00 +CPU= 31.561
  03:51:07 STEP 1984 H=1984:00 +CPU= 20.126
  03:51:27 STEP 1985 H=1985:00 +CPU= 19.548
  03:51:59 STEP 1986 H=1986:00 +CPU= 32.218
  03:52:19 STEP 1987 H=1987:00 +CPU= 19.584
  03:52:39 STEP 1988 H=1988:00 +CPU= 20.142
  03:53:11 STEP 1989 H=1989:00 +CPU= 31.533
  03:53:31 STEP 1990 H=1990:00 +CPU= 20.112
  03:53:52 STEP 1991 H=1991:00 +CPU= 20.095
  03:54:29 STEP 1992 H=1992:00 +CPU= 37.156
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_82.zip
Uploading the intermediate file: upload_file_82.zip
  03:54:49 STEP 1993 H=1993:00 +CPU= 19.531
  03:55:09 STEP 1994 H=1994:00 +CPU= 20.114
  03:55:41 STEP 1995 H=1995:00 +CPU= 31.592
  03:56:01 STEP 1996 H=1996:00 +CPU= 20.112
  03:56:22 STEP 1997 H=1997:00 +CPU= 20.117
  03:56:54 STEP 1998 H=1998:00 +CPU= 32.610
  03:57:14 STEP 1999 H=1999:00 +CPU= 19.742
  03:57:35 STEP 2000 H=2000:00 +CPU= 20.203
  03:58:07 STEP 2001 H=2001:00 +CPU= 31.582
  03:58:27 STEP 2002 H=2002:00 +CPU= 20.173
  03:58:47 STEP 2003 H=2003:00 +CPU= 19.545
  03:59:22 STEP 2004 H=2004:00 +CPU= 34.922
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002004
  03:59:42 STEP 2005 H=2005:00 +CPU= 19.595
  04:00:02 STEP 2006 H=2006:00 +CPU= 20.200
  04:00:34 STEP 2007 H=2007:00 +CPU= 31.574
  04:00:54 STEP 2008 H=2008:00 +CPU= 20.140
  04:01:14 STEP 2009 H=2009:00 +CPU= 19.546
  04:01:46 STEP 2010 H=2010:00 +CPU= 32.224
  04:02:06 STEP 2011 H=2011:00 +CPU= 19.589
  04:02:26 STEP 2012 H=2012:00 +CPU= 20.158
  04:02:58 STEP 2013 H=2013:00 +CPU= 31.556
  04:03:19 STEP 2014 H=2014:00 +CPU= 20.129
  04:03:39 STEP 2015 H=2015:00 +CPU= 20.047
  04:04:16 STEP 2016 H=2016:00 +CPU= 37.236
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_83.zip
Uploading the intermediate file: upload_file_83.zip
  04:04:36 STEP 2017 H=2017:00 +CPU= 19.573
  04:04:56 STEP 2018 H=2018:00 +CPU= 20.104
  04:05:29 STEP 2019 H=2019:00 +CPU= 32.224
  04:05:50 STEP 2020 H=2020:00 +CPU= 20.450
  04:06:09 STEP 2021 H=2021:00 +CPU= 19.736
  04:06:42 STEP 2022 H=2022:00 +CPU= 32.203
  04:07:02 STEP 2023 H=2023:00 +CPU= 19.530
  04:07:22 STEP 2024 H=2024:00 +CPU= 20.160
  04:07:54 STEP 2025 H=2025:00 +CPU= 31.596
  04:08:14 STEP 2026 H=2026:00 +CPU= 20.155
  04:08:34 STEP 2027 H=2027:00 +CPU= 19.515
  04:09:09 STEP 2028 H=2028:00 +CPU= 34.915
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002028
  04:09:29 STEP 2029 H=2029:00 +CPU= 19.594
  04:09:49 STEP 2030 H=2030:00 +CPU= 20.159
  04:10:21 STEP 2031 H=2031:00 +CPU= 31.477
  04:10:41 STEP 2032 H=2032:00 +CPU= 20.148
  04:11:01 STEP 2033 H=2033:00 +CPU= 19.521
  04:11:33 STEP 2034 H=2034:00 +CPU= 32.179
  04:11:53 STEP 2035 H=2035:00 +CPU= 19.509
  04:12:13 STEP 2036 H=2036:00 +CPU= 20.184
  04:12:45 STEP 2037 H=2037:00 +CPU= 31.721
  04:13:06 STEP 2038 H=2038:00 +CPU= 20.681
  04:13:26 STEP 2039 H=2039:00 +CPU= 20.046
  04:14:04 STEP 2040 H=2040:00 +CPU= 37.129
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_84.zip
Uploading the intermediate file: upload_file_84.zip
  04:14:24 STEP 2041 H=2041:00 +CPU= 19.490
  04:14:44 STEP 2042 H=2042:00 +CPU= 20.074
  04:15:16 STEP 2043 H=2043:00 +CPU= 31.619
  04:15:37 STEP 2044 H=2044:00 +CPU= 20.690
  04:15:56 STEP 2045 H=2045:00 +CPU= 19.781
  04:16:29 STEP 2046 H=2046:00 +CPU= 32.576
  04:16:49 STEP 2047 H=2047:00 +CPU= 19.532
  04:17:09 STEP 2048 H=2048:00 +CPU= 20.222
  04:17:41 STEP 2049 H=2049:00 +CPU= 31.517
  04:18:02 STEP 2050 H=2050:00 +CPU= 20.130
  04:18:21 STEP 2051 H=2051:00 +CPU= 19.548
  04:18:56 STEP 2052 H=2052:00 +CPU= 34.820
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002052
  04:19:16 STEP 2053 H=2053:00 +CPU= 19.547
  04:19:36 STEP 2054 H=2054:00 +CPU= 20.208
  04:20:08 STEP 2055 H=2055:00 +CPU= 31.473
  04:20:29 STEP 2056 H=2056:00 +CPU= 20.187
  04:20:48 STEP 2057 H=2057:00 +CPU= 19.516
  04:21:21 STEP 2058 H=2058:00 +CPU= 32.123
  04:21:40 STEP 2059 H=2059:00 +CPU= 19.522
  04:22:01 STEP 2060 H=2060:00 +CPU= 20.119
  04:22:32 STEP 2061 H=2061:00 +CPU= 31.472
  04:22:53 STEP 2062 H=2062:00 +CPU= 20.076
  04:23:13 STEP 2063 H=2063:00 +CPU= 20.047
  04:23:50 STEP 2064 H=2064:00 +CPU= 37.097
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_85.zip
Uploading the intermediate file: upload_file_85.zip
  04:24:10 STEP 2065 H=2065:00 +CPU= 19.504
  04:24:30 STEP 2066 H=2066:00 +CPU= 20.066
  04:25:02 STEP 2067 H=2067:00 +CPU= 31.515
  04:25:23 STEP 2068 H=2068:00 +CPU= 20.458
  04:25:43 STEP 2069 H=2069:00 +CPU= 19.803
  04:26:16 STEP 2070 H=2070:00 +CPU= 32.703
  04:26:35 STEP 2071 H=2071:00 +CPU= 19.607
  04:26:56 STEP 2072 H=2072:00 +CPU= 20.115
  04:27:27 STEP 2073 H=2073:00 +CPU= 31.553
  04:27:48 STEP 2074 H=2074:00 +CPU= 20.107
  04:28:07 STEP 2075 H=2075:00 +CPU= 19.511
  04:28:42 STEP 2076 H=2076:00 +CPU= 34.796
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002076
  04:29:02 STEP 2077 H=2077:00 +CPU= 19.482
  04:29:22 STEP 2078 H=2078:00 +CPU= 20.161
  04:29:54 STEP 2079 H=2079:00 +CPU= 31.496
  04:30:14 STEP 2080 H=2080:00 +CPU= 20.131
  04:30:34 STEP 2081 H=2081:00 +CPU= 19.556
  04:31:07 STEP 2082 H=2082:00 +CPU= 32.169
  04:31:26 STEP 2083 H=2083:00 +CPU= 19.476
  04:31:47 STEP 2084 H=2084:00 +CPU= 20.117
  04:32:18 STEP 2085 H=2085:00 +CPU= 31.581
  04:32:39 STEP 2086 H=2086:00 +CPU= 20.112
  04:32:59 STEP 2087 H=2087:00 +CPU= 20.085
  04:33:36 STEP 2088 H=2088:00 +CPU= 37.052
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_86.zip
Uploading the intermediate file: upload_file_86.zip
  04:33:56 STEP 2089 H=2089:00 +CPU= 19.500
  04:34:16 STEP 2090 H=2090:00 +CPU= 20.141
  04:34:48 STEP 2091 H=2091:00 +CPU= 31.656
  04:35:09 STEP 2092 H=2092:00 +CPU= 20.080
  04:35:28 STEP 2093 H=2093:00 +CPU= 19.506
  04:36:01 STEP 2094 H=2094:00 +CPU= 32.175
  04:36:21 STEP 2095 H=2095:00 +CPU= 20.569
  04:36:42 STEP 2096 H=2096:00 +CPU= 20.393
  04:37:14 STEP 2097 H=2097:00 +CPU= 31.867
  04:37:34 STEP 2098 H=2098:00 +CPU= 20.127
  04:37:54 STEP 2099 H=2099:00 +CPU= 19.535
  04:38:29 STEP 2100 H=2100:00 +CPU= 34.890
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002100
  04:38:49 STEP 2101 H=2101:00 +CPU= 19.606
  04:39:10 STEP 2102 H=2102:00 +CPU= 20.216
  04:39:41 STEP 2103 H=2103:00 +CPU= 31.549
  04:40:02 STEP 2104 H=2104:00 +CPU= 20.109
  04:40:21 STEP 2105 H=2105:00 +CPU= 19.543
  04:40:54 STEP 2106 H=2106:00 +CPU= 32.252
  04:41:13 STEP 2107 H=2107:00 +CPU= 19.469
  04:41:34 STEP 2108 H=2108:00 +CPU= 20.172
  04:42:06 STEP 2109 H=2109:00 +CPU= 31.474
  04:42:26 STEP 2110 H=2110:00 +CPU= 20.131
  04:42:46 STEP 2111 H=2111:00 +CPU= 20.040
  04:43:24 STEP 2112 H=2112:00 +CPU= 37.075
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_87.zip
Uploading the intermediate file: upload_file_87.zip
  04:43:43 STEP 2113 H=2113:00 +CPU= 19.548
  04:44:04 STEP 2114 H=2114:00 +CPU= 20.106
  04:44:35 STEP 2115 H=2115:00 +CPU= 31.506
  04:44:56 STEP 2116 H=2116:00 +CPU= 20.081
  04:45:15 STEP 2117 H=2117:00 +CPU= 19.493
  04:45:48 STEP 2118 H=2118:00 +CPU= 32.237
  04:46:07 STEP 2119 H=2119:00 +CPU= 19.538
  04:46:28 STEP 2120 H=2120:00 +CPU= 20.735
  04:47:01 STEP 2121 H=2121:00 +CPU= 32.146
  04:47:21 STEP 2122 H=2122:00 +CPU= 20.355
  04:47:41 STEP 2123 H=2123:00 +CPU= 19.570
  04:48:16 STEP 2124 H=2124:00 +CPU= 34.937
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002124
  04:48:36 STEP 2125 H=2125:00 +CPU= 19.583
  04:48:56 STEP 2126 H=2126:00 +CPU= 20.202
  04:49:28 STEP 2127 H=2127:00 +CPU= 31.527
  04:49:48 STEP 2128 H=2128:00 +CPU= 20.137
  04:50:08 STEP 2129 H=2129:00 +CPU= 19.528
  04:50:41 STEP 2130 H=2130:00 +CPU= 32.209
  04:51:00 STEP 2131 H=2131:00 +CPU= 19.522
  04:51:21 STEP 2132 H=2132:00 +CPU= 20.133
  04:51:52 STEP 2133 H=2133:00 +CPU= 31.499
  04:52:13 STEP 2134 H=2134:00 +CPU= 20.153
  04:52:33 STEP 2135 H=2135:00 +CPU= 20.095
  04:53:10 STEP 2136 H=2136:00 +CPU= 37.200
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_88.zip
Uploading the intermediate file: upload_file_88.zip
  04:53:30 STEP 2137 H=2137:00 +CPU= 19.500
  04:53:50 STEP 2138 H=2138:00 +CPU= 20.096
  04:54:22 STEP 2139 H=2139:00 +CPU= 31.549
  04:54:43 STEP 2140 H=2140:00 +CPU= 20.171
  04:55:02 STEP 2141 H=2141:00 +CPU= 19.565
  04:55:35 STEP 2142 H=2142:00 +CPU= 32.306
  04:55:55 STEP 2143 H=2143:00 +CPU= 19.556
  04:56:15 STEP 2144 H=2144:00 +CPU= 20.159
  04:56:47 STEP 2145 H=2145:00 +CPU= 31.590
  04:57:07 STEP 2146 H=2146:00 +CPU= 20.200
  04:57:27 STEP 2147 H=2147:00 +CPU= 19.585
  04:58:03 STEP 2148 H=2148:00 +CPU= 35.263
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002148
  04:58:23 STEP 2149 H=2149:00 +CPU= 19.835
  04:58:43 STEP 2150 H=2150:00 +CPU= 20.325
  04:59:15 STEP 2151 H=2151:00 +CPU= 31.745
  04:59:35 STEP 2152 H=2152:00 +CPU= 20.162
  04:59:55 STEP 2153 H=2153:00 +CPU= 19.623
  05:00:28 STEP 2154 H=2154:00 +CPU= 32.163
  05:00:47 STEP 2155 H=2155:00 +CPU= 19.497
  05:01:08 STEP 2156 H=2156:00 +CPU= 20.086
  05:01:39 STEP 2157 H=2157:00 +CPU= 31.484
  05:02:00 STEP 2158 H=2158:00 +CPU= 20.081
  05:02:20 STEP 2159 H=2159:00 +CPU= 20.099
  05:02:57 STEP 2160 H=2160:00 +CPU= 37.071
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_89.zip
Uploading the intermediate file: upload_file_89.zip
  05:03:17 STEP 2161 H=2161:00 +CPU= 19.518
Uploading trickle at timestep: 7776000
  05:03:37 STEP 2162 H=2162:00 +CPU= 20.165
  05:04:09 STEP 2163 H=2163:00 +CPU= 31.506
  05:04:29 STEP 2164 H=2164:00 +CPU= 20.164
  05:04:49 STEP 2165 H=2165:00 +CPU= 19.572
  05:05:22 STEP 2166 H=2166:00 +CPU= 32.191
  05:05:41 STEP 2167 H=2167:00 +CPU= 19.519
  05:06:02 STEP 2168 H=2168:00 +CPU= 20.187
  05:06:33 STEP 2169 H=2169:00 +CPU= 31.509
  05:06:54 STEP 2170 H=2170:00 +CPU= 20.170
  05:07:14 STEP 2171 H=2171:00 +CPU= 19.542
  05:07:49 STEP 2172 H=2172:00 +CPU= 34.900
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002172
  05:08:09 STEP 2173 H=2173:00 +CPU= 20.211
  05:08:30 STEP 2174 H=2174:00 +CPU= 20.465
  05:09:02 STEP 2175 H=2175:00 +CPU= 31.877
  05:09:22 STEP 2176 H=2176:00 +CPU= 20.118
  05:09:42 STEP 2177 H=2177:00 +CPU= 19.535
  05:10:14 STEP 2178 H=2178:00 +CPU= 32.234
  05:10:34 STEP 2179 H=2179:00 +CPU= 19.454
  05:10:54 STEP 2180 H=2180:00 +CPU= 20.161
  05:11:26 STEP 2181 H=2181:00 +CPU= 31.474
  05:11:46 STEP 2182 H=2182:00 +CPU= 20.060
  05:12:07 STEP 2183 H=2183:00 +CPU= 20.064
  05:12:44 STEP 2184 H=2184:00 +CPU= 37.146
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12203452/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0808_2017050100_123_986_12203452_0_r413518346_90.zip
Uploading the intermediate file: upload_file_90.zip
  05:13:04 STEP 2185 H=2185:00 +CPU= 19.513
  05:13:24 STEP 2186 H=2186:00 +CPU= 20.134
double free or corruption (out)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:41:58 1532494 22289909 oifs_43r3_ps_0808_2017050100_123_986_12203452_0 7,776,000 52,409 0.0067
09 May 2023 16:41:56 1532494 22289909 oifs_43r3_ps_0808_2017050100_123_986_12203452_0 6,912,000 46,585 0.0067
09 May 2023 16:41:46 1532494 22289909 oifs_43r3_ps_0808_2017050100_123_986_12203452_0 6,048,000 40,770 0.0067
09 May 2023 16:41:39 1532494 22289909 oifs_43r3_ps_0808_2017050100_123_986_12203452_0 5,184,000 34,938 0.0067
09 May 2023 16:41:35 1532494 22289909 oifs_43r3_ps_0808_2017050100_123_986_12203452_0 4,320,000 29,126 0.0067
09 May 2023 16:41:29 1532494 22289909 oifs_43r3_ps_0808_2017050100_123_986_12203452_0 3,456,000 23,314 0.0067
09 May 2023 16:41:24 1532494 22289909 oifs_43r3_ps_0808_2017050100_123_986_12203452_0 2,592,000 17,502 0.0068
09 May 2023 16:41:17 1532494 22289909 oifs_43r3_ps_0808_2017050100_123_986_12203452_0 1,728,000 11,680 0.0068
09 May 2023 16:41:13 1532494 22289909 oifs_43r3_ps_0808_2017050100_123_986_12203452_0 864,000 5,869 0.0068


©2024 cpdn.org