climateprediction.net home page
Task 22287779

Task 22287779

Name oifs_43r3_ps_0823_2015050100_123_984_12201467_0
Workunit 12201467
Created 24 Dec 2022, 13:47:12 UTC
Sent 24 Dec 2022, 14:01:38 UTC
Report deadline 23 Jan 2023, 14:01:38 UTC
Received 25 Dec 2022, 12:35:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1478928
Run time 14 hours 23 min 24 sec
CPU time 12 hours 29 min 46 sec
Validate state Invalid
Credit 10,039.68
Device peak FLOPS 8.02 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,780.37 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,421.74 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
0931] [20221225:055931:1671962371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2250931:2250931] [20221225:055931:1671962371:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  05:59:56 STEP 1752 H=1752:00 +CPU= 22.850
  06:00:09 STEP 1753 H=1753:00 +CPU= 13.291
  06:00:23 STEP 1754 H=1754:00 +CPU= 13.262
  06:00:43 STEP 1755 H=1755:00 +CPU= 20.708
  06:00:56 STEP 1756 H=1756:00 +CPU= 12.926
  06:01:09 STEP 1757 H=1757:00 +CPU= 12.851
  06:01:31 STEP 1758 H=1758:00 +CPU= 21.351
  06:01:43 STEP 1759 H=1759:00 +CPU= 12.738
  06:01:57 STEP 1760 H=1760:00 +CPU= 13.166
  06:02:17 STEP 1761 H=1761:00 +CPU= 20.234
  06:02:30 STEP 1762 H=1762:00 +CPU= 12.985
  06:02:43 STEP 1763 H=1763:00 +CPU= 12.822
  06:03:05 STEP 1764 H=1764:00 +CPU= 22.364
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001764
  06:03:18 STEP 1765 H=1765:00 +CPU= 12.980
  06:03:30 STEP 1766 H=1766:00 +CPU= 12.135
  06:03:49 STEP 1767 H=1767:00 +CPU= 18.503
  06:04:01 STEP 1768 H=1768:00 +CPU= 11.947
  06:04:12 STEP 1769 H=1769:00 +CPU= 11.708
  06:04:33 STEP 1770 H=1770:00 +CPU= 20.255
  06:04:46 STEP 1771 H=1771:00 +CPU= 12.863
  06:04:59 STEP 1772 H=1772:00 +CPU= 13.042
  06:05:19 STEP 1773 H=1773:00 +CPU= 20.233
  06:05:32 STEP 1774 H=1774:00 +CPU= 12.994
  06:05:46 STEP 1775 H=1775:00 +CPU= 13.516
  06:06:09 STEP 1776 H=1776:00 +CPU= 23.506
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_73.zip
Uploading the intermediate file: upload_file_73.zip
  06:06:22 STEP 1777 H=1777:00 +CPU= 12.970
  06:06:35 STEP 1778 H=1778:00 +CPU= 13.331
  06:06:56 STEP 1779 H=1779:00 +CPU= 20.209
  06:07:09 STEP 1780 H=1780:00 +CPU= 13.059
  06:07:22 STEP 1781 H=1781:00 +CPU= 13.014
  06:07:43 STEP 1782 H=1782:00 +CPU= 20.621
  06:07:56 STEP 1783 H=1783:00 +CPU= 12.920
  06:08:09 STEP 1784 H=1784:00 +CPU= 13.354
  06:08:29 STEP 1785 H=1785:00 +CPU= 20.264
  06:08:42 STEP 1786 H=1786:00 +CPU= 13.065
  06:08:55 STEP 1787 H=1787:00 +CPU= 13.002
  06:09:18 STEP 1788 H=1788:00 +CPU= 22.290
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001788
  06:09:31 STEP 1789 H=1789:00 +CPU= 12.893
  06:09:44 STEP 1790 H=1790:00 +CPU= 13.016
  06:10:02 STEP 1791 H=1791:00 +CPU= 18.573
  06:10:14 STEP 1792 H=1792:00 +CPU= 11.806
  06:10:26 STEP 1793 H=1793:00 +CPU= 11.573
  06:10:45 STEP 1794 H=1794:00 +CPU= 19.197
  06:10:58 STEP 1795 H=1795:00 +CPU= 12.539
  06:11:11 STEP 1796 H=1796:00 +CPU= 13.097
  06:11:32 STEP 1797 H=1797:00 +CPU= 21.035
  06:11:45 STEP 1798 H=1798:00 +CPU= 12.978
  06:11:58 STEP 1799 H=1799:00 +CPU= 13.430
  06:12:21 STEP 1800 H=1800:00 +CPU= 22.392
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_74.zip
Uploading the intermediate file: upload_file_74.zip
  06:12:32 STEP 1801 H=1801:00 +CPU= 11.736
  06:12:44 STEP 1802 H=1802:00 +CPU= 11.944
  06:13:03 STEP 1803 H=1803:00 +CPU= 18.684
  06:13:15 STEP 1804 H=1804:00 +CPU= 12.341
  06:13:28 STEP 1805 H=1805:00 +CPU= 12.377
  06:13:49 STEP 1806 H=1806:00 +CPU= 20.793
  06:14:01 STEP 1807 H=1807:00 +CPU= 12.710
  06:14:14 STEP 1808 H=1808:00 +CPU= 12.922
  06:14:35 STEP 1809 H=1809:00 +CPU= 20.470
  06:14:48 STEP 1810 H=1810:00 +CPU= 13.197
  06:15:01 STEP 1811 H=1811:00 +CPU= 12.905
  06:15:23 STEP 1812 H=1812:00 +CPU= 21.596
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001812
  06:15:34 STEP 1813 H=1813:00 +CPU= 11.480
  06:15:46 STEP 1814 H=1814:00 +CPU= 11.835
  06:16:05 STEP 1815 H=1815:00 +CPU= 18.548
  06:16:17 STEP 1816 H=1816:00 +CPU= 12.018
  06:16:29 STEP 1817 H=1817:00 +CPU= 12.506
  06:16:50 STEP 1818 H=1818:00 +CPU= 20.622
  06:17:03 STEP 1819 H=1819:00 +CPU= 13.053
  06:17:16 STEP 1820 H=1820:00 +CPU= 13.043
  06:17:36 STEP 1821 H=1821:00 +CPU= 20.297
  06:17:50 STEP 1822 H=1822:00 +CPU= 13.434
  06:18:03 STEP 1823 H=1823:00 +CPU= 13.143
  06:18:27 STEP 1824 H=1824:00 +CPU= 23.769
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_75.zip
Uploading the intermediate file: upload_file_75.zip
  06:18:39 STEP 1825 H=1825:00 +CPU= 12.602
  06:18:52 STEP 1826 H=1826:00 +CPU= 12.877
  06:19:12 STEP 1827 H=1827:00 +CPU= 19.687
  06:19:24 STEP 1828 H=1828:00 +CPU= 12.114
  06:19:36 STEP 1829 H=1829:00 +CPU= 11.523
  06:19:54 STEP 1830 H=1830:00 +CPU= 18.797
  06:20:06 STEP 1831 H=1831:00 +CPU= 11.839
  06:20:19 STEP 1832 H=1832:00 +CPU= 12.840
  06:20:39 STEP 1833 H=1833:00 +CPU= 20.296
  06:20:53 STEP 1834 H=1834:00 +CPU= 13.516
  06:21:06 STEP 1835 H=1835:00 +CPU= 12.956
  06:21:29 STEP 1836 H=1836:00 +CPU= 22.917
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001836
  06:21:42 STEP 1837 H=1837:00 +CPU= 12.890
  06:21:55 STEP 1838 H=1838:00 +CPU= 12.626
  06:22:13 STEP 1839 H=1839:00 +CPU= 18.587
  06:22:25 STEP 1840 H=1840:00 +CPU= 11.980
  06:22:37 STEP 1841 H=1841:00 +CPU= 11.612
  06:22:56 STEP 1842 H=1842:00 +CPU= 18.872
  06:23:09 STEP 1843 H=1843:00 +CPU= 12.841
  06:23:22 STEP 1844 H=1844:00 +CPU= 13.071
  06:23:42 STEP 1845 H=1845:00 +CPU= 20.470
  06:23:56 STEP 1846 H=1846:00 +CPU= 13.347
  06:24:09 STEP 1847 H=1847:00 +CPU= 13.345
  06:24:33 STEP 1848 H=1848:00 +CPU= 23.972
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_76.zip
Uploading the intermediate file: upload_file_76.zip
  06:24:46 STEP 1849 H=1849:00 +CPU= 12.818
  06:24:59 STEP 1850 H=1850:00 +CPU= 12.931
  06:25:20 STEP 1851 H=1851:00 +CPU= 21.260
  06:25:34 STEP 1852 H=1852:00 +CPU= 13.496
  06:25:46 STEP 1853 H=1853:00 +CPU= 12.666
  06:26:07 STEP 1854 H=1854:00 +CPU= 20.948
  06:26:20 STEP 1855 H=1855:00 +CPU= 12.993
  06:26:33 STEP 1856 H=1856:00 +CPU= 13.112
  06:26:54 STEP 1857 H=1857:00 +CPU= 20.476
  06:27:07 STEP 1858 H=1858:00 +CPU= 13.189
  06:27:20 STEP 1859 H=1859:00 +CPU= 12.852
  06:27:42 STEP 1860 H=1860:00 +CPU= 22.195
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001860
  06:27:55 STEP 1861 H=1861:00 +CPU= 12.816
  06:28:08 STEP 1862 H=1862:00 +CPU= 13.057
  06:28:29 STEP 1863 H=1863:00 +CPU= 20.456
  06:28:42 STEP 1864 H=1864:00 +CPU= 13.197
  06:28:55 STEP 1865 H=1865:00 +CPU= 12.889
  06:29:16 STEP 1866 H=1866:00 +CPU= 20.704
  06:29:30 STEP 1867 H=1867:00 +CPU= 13.374
  06:29:43 STEP 1868 H=1868:00 +CPU= 13.097
  06:30:03 STEP 1869 H=1869:00 +CPU= 20.666
  06:30:17 STEP 1870 H=1870:00 +CPU= 13.174
  06:30:30 STEP 1871 H=1871:00 +CPU= 12.898
  06:30:54 STEP 1872 H=1872:00 +CPU= 24.612
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_77.zip
Uploading the intermediate file: upload_file_77.zip
  06:31:07 STEP 1873 H=1873:00 +CPU= 12.811
  06:31:20 STEP 1874 H=1874:00 +CPU= 13.016
  06:31:41 STEP 1875 H=1875:00 +CPU= 20.493
  06:31:54 STEP 1876 H=1876:00 +CPU= 13.276
  06:32:07 STEP 1877 H=1877:00 +CPU= 12.993
  06:32:28 STEP 1878 H=1878:00 +CPU= 21.358
  06:32:41 STEP 1879 H=1879:00 +CPU= 12.684
  06:32:53 STEP 1880 H=1880:00 +CPU= 12.340
  06:33:12 STEP 1881 H=1881:00 +CPU= 18.658
  06:33:24 STEP 1882 H=1882:00 +CPU= 11.947
  06:33:36 STEP 1883 H=1883:00 +CPU= 11.456
  06:33:56 STEP 1884 H=1884:00 +CPU= 20.771
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001884
  06:34:09 STEP 1885 H=1885:00 +CPU= 12.887
  06:34:23 STEP 1886 H=1886:00 +CPU= 13.433
  06:34:43 STEP 1887 H=1887:00 +CPU= 20.627
  06:34:57 STEP 1888 H=1888:00 +CPU= 13.453
  06:35:10 STEP 1889 H=1889:00 +CPU= 12.926
  06:35:31 STEP 1890 H=1890:00 +CPU= 20.814
  06:35:43 STEP 1891 H=1891:00 +CPU= 12.659
  06:35:56 STEP 1892 H=1892:00 +CPU= 13.065
  06:36:17 STEP 1893 H=1893:00 +CPU= 20.844
  06:36:30 STEP 1894 H=1894:00 +CPU= 12.564
  06:36:42 STEP 1895 H=1895:00 +CPU= 11.867
  06:37:03 STEP 1896 H=1896:00 +CPU= 21.689
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_78.zip
Uploading the intermediate file: upload_file_78.zip
  06:37:15 STEP 1897 H=1897:00 +CPU= 11.466
  06:37:27 STEP 1898 H=1898:00 +CPU= 12.177
  06:37:48 STEP 1899 H=1899:00 +CPU= 20.651
  06:38:01 STEP 1900 H=1900:00 +CPU= 13.127
  06:38:13 STEP 1901 H=1901:00 +CPU= 12.412
  06:38:35 STEP 1902 H=1902:00 +CPU= 21.038
  06:38:47 STEP 1903 H=1903:00 +CPU= 12.842
  06:39:00 STEP 1904 H=1904:00 +CPU= 12.718
  06:39:21 STEP 1905 H=1905:00 +CPU= 20.583
  06:39:34 STEP 1906 H=1906:00 +CPU= 13.278
  06:39:47 STEP 1907 H=1907:00 +CPU= 12.649
  06:40:09 STEP 1908 H=1908:00 +CPU= 22.494
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001908
  06:40:22 STEP 1909 H=1909:00 +CPU= 13.029
  06:40:35 STEP 1910 H=1910:00 +CPU= 12.862
  06:40:54 STEP 1911 H=1911:00 +CPU= 18.682
  06:41:06 STEP 1912 H=1912:00 +CPU= 12.428
  06:41:18 STEP 1913 H=1913:00 +CPU= 11.409
  06:41:37 STEP 1914 H=1914:00 +CPU= 19.133
  06:41:50 STEP 1915 H=1915:00 +CPU= 13.245
  06:42:03 STEP 1916 H=1916:00 +CPU= 12.758
  06:42:23 STEP 1917 H=1917:00 +CPU= 20.352
  06:42:36 STEP 1918 H=1918:00 +CPU= 12.208
  06:42:48 STEP 1919 H=1919:00 +CPU= 11.829
  06:43:09 STEP 1920 H=1920:00 +CPU= 21.689
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_79.zip
Uploading the intermediate file: upload_file_79.zip
  06:43:21 STEP 1921 H=1921:00 +CPU= 11.520
  06:43:34 STEP 1922 H=1922:00 +CPU= 12.917
  06:43:54 STEP 1923 H=1923:00 +CPU= 20.533
  06:44:08 STEP 1924 H=1924:00 +CPU= 13.560
  06:44:20 STEP 1925 H=1925:00 +CPU= 12.498
  06:44:41 STEP 1926 H=1926:00 +CPU= 20.819
  06:44:54 STEP 1927 H=1927:00 +CPU= 13.042
  06:45:08 STEP 1928 H=1928:00 +CPU= 13.249
  06:45:28 STEP 1929 H=1929:00 +CPU= 20.752
  06:45:42 STEP 1930 H=1930:00 +CPU= 13.433
  06:45:55 STEP 1931 H=1931:00 +CPU= 12.790
  06:46:16 STEP 1932 H=1932:00 +CPU= 21.245
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001932
  06:46:28 STEP 1933 H=1933:00 +CPU= 11.540
  06:46:39 STEP 1934 H=1934:00 +CPU= 11.836
  06:46:58 STEP 1935 H=1935:00 +CPU= 18.672
  06:47:12 STEP 1936 H=1936:00 +CPU= 12.742
  06:47:24 STEP 1937 H=1937:00 +CPU= 12.279
  06:47:46 STEP 1938 H=1938:00 +CPU= 21.130
  06:47:59 STEP 1939 H=1939:00 +CPU= 12.950
  06:48:11 STEP 1940 H=1940:00 +CPU= 12.460
  06:48:32 STEP 1941 H=1941:00 +CPU= 20.790
  06:48:45 STEP 1942 H=1942:00 +CPU= 13.341
  06:48:58 STEP 1943 H=1943:00 +CPU= 12.776
  06:49:23 STEP 1944 H=1944:00 +CPU= 24.476
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_80.zip
Uploading the intermediate file: upload_file_80.zip
  06:49:35 STEP 1945 H=1945:00 +CPU= 12.742
  06:49:49 STEP 1946 H=1946:00 +CPU= 13.149
  06:50:09 STEP 1947 H=1947:00 +CPU= 20.810
  06:50:23 STEP 1948 H=1948:00 +CPU= 13.125
  06:50:35 STEP 1949 H=1949:00 +CPU= 12.267
  06:50:56 STEP 1950 H=1950:00 +CPU= 21.022
  06:51:09 STEP 1951 H=1951:00 +CPU= 12.898
  06:51:21 STEP 1952 H=1952:00 +CPU= 12.573
  06:51:42 STEP 1953 H=1953:00 +CPU= 20.757
  06:51:55 STEP 1954 H=1954:00 +CPU= 13.160
  06:52:08 STEP 1955 H=1955:00 +CPU= 12.541
  06:52:31 STEP 1956 H=1956:00 +CPU= 22.933
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001956
  06:52:44 STEP 1957 H=1957:00 +CPU= 12.806
  06:52:57 STEP 1958 H=1958:00 +CPU= 13.171
  06:53:16 STEP 1959 H=1959:00 +CPU= 19.410
  06:53:28 STEP 1960 H=1960:00 +CPU= 12.080
  06:53:40 STEP 1961 H=1961:00 +CPU= 11.474
  06:53:59 STEP 1962 H=1962:00 +CPU= 19.049
  06:54:11 STEP 1963 H=1963:00 +CPU= 12.405
  06:54:24 STEP 1964 H=1964:00 +CPU= 12.666
  06:54:45 STEP 1965 H=1965:00 +CPU= 20.908
  06:54:58 STEP 1966 H=1966:00 +CPU= 13.260
  06:55:11 STEP 1967 H=1967:00 +CPU= 12.835
  06:55:36 STEP 1968 H=1968:00 +CPU= 24.246
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_81.zip
Uploading the intermediate file: upload_file_81.zip
  06:55:48 STEP 1969 H=1969:00 +CPU= 12.814
  06:56:00 STEP 1970 H=1970:00 +CPU= 11.913
  06:56:19 STEP 1971 H=1971:00 +CPU= 18.692
  06:56:31 STEP 1972 H=1972:00 +CPU= 11.783
  06:56:42 STEP 1973 H=1973:00 +CPU= 11.515
  06:57:02 STEP 1974 H=1974:00 +CPU= 19.904
  06:57:15 STEP 1975 H=1975:00 +CPU= 12.559
  06:57:28 STEP 1976 H=1976:00 +CPU= 12.978
  06:57:49 STEP 1977 H=1977:00 +CPU= 20.904
  06:58:02 STEP 1978 H=1978:00 +CPU= 12.922
  06:58:15 STEP 1979 H=1979:00 +CPU= 12.746
  06:58:38 STEP 1980 H=1980:00 +CPU= 22.792
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001980
  06:58:51 STEP 1981 H=1981:00 +CPU= 12.959
  06:59:04 STEP 1982 H=1982:00 +CPU= 13.123
  06:59:24 STEP 1983 H=1983:00 +CPU= 20.663
  06:59:38 STEP 1984 H=1984:00 +CPU= 13.253
  06:59:50 STEP 1985 H=1985:00 +CPU= 11.944
  07:00:09 STEP 1986 H=1986:00 +CPU= 19.420
  07:00:21 STEP 1987 H=1987:00 +CPU= 11.730
  07:00:32 STEP 1988 H=1988:00 +CPU= 11.515
  07:00:52 STEP 1989 H=1989:00 +CPU= 19.794
  07:01:05 STEP 1990 H=1990:00 +CPU= 12.911
  07:01:18 STEP 1991 H=1991:00 +CPU= 12.941
  07:01:43 STEP 1992 H=1992:00 +CPU= 24.271
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_82.zip
Uploading the intermediate file: upload_file_82.zip
  07:01:55 STEP 1993 H=1993:00 +CPU= 12.651
Uploading trickle at timestep: 7171200
  07:02:09 STEP 1994 H=1994:00 +CPU= 13.075
  07:02:29 STEP 1995 H=1995:00 +CPU= 20.741
  07:02:42 STEP 1996 H=1996:00 +CPU= 12.888
  07:02:55 STEP 1997 H=1997:00 +CPU= 12.741
  07:03:16 STEP 1998 H=1998:00 +CPU= 21.187
  07:03:29 STEP 1999 H=1999:00 +CPU= 12.595
  07:03:42 STEP 2000 H=2000:00 +CPU= 13.291
  07:04:03 STEP 2001 H=2001:00 +CPU= 21.034
  07:04:17 STEP 2002 H=2002:00 +CPU= 13.228
  07:04:29 STEP 2003 H=2003:00 +CPU= 12.801
  07:04:52 STEP 2004 H=2004:00 +CPU= 23.039
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002004
  07:05:05 STEP 2005 H=2005:00 +CPU= 12.610
  07:05:19 STEP 2006 H=2006:00 +CPU= 13.434
  07:05:39 STEP 2007 H=2007:00 +CPU= 20.612
  07:05:52 STEP 2008 H=2008:00 +CPU= 13.107
  07:06:05 STEP 2009 H=2009:00 +CPU= 12.613
  07:06:25 STEP 2010 H=2010:00 +CPU= 20.074
  07:06:37 STEP 2011 H=2011:00 +CPU= 11.640
  07:06:49 STEP 2012 H=2012:00 +CPU= 11.745
  07:07:08 STEP 2013 H=2013:00 +CPU= 18.914
  07:07:20 STEP 2014 H=2014:00 +CPU= 12.471
  07:07:32 STEP 2015 H=2015:00 +CPU= 12.451
  07:07:57 STEP 2016 H=2016:00 +CPU= 24.458
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_83.zip
Uploading the intermediate file: upload_file_83.zip
  07:08:10 STEP 2017 H=2017:00 +CPU= 13.199
  07:08:23 STEP 2018 H=2018:00 +CPU= 13.039
  07:08:44 STEP 2019 H=2019:00 +CPU= 20.542
  07:08:57 STEP 2020 H=2020:00 +CPU= 13.348
  07:09:10 STEP 2021 H=2021:00 +CPU= 12.328
  07:09:31 STEP 2022 H=2022:00 +CPU= 21.068
  07:09:44 STEP 2023 H=2023:00 +CPU= 12.874
  07:09:56 STEP 2024 H=2024:00 +CPU= 12.612
  07:10:17 STEP 2025 H=2025:00 +CPU= 20.831
  07:10:30 STEP 2026 H=2026:00 +CPU= 13.315
  07:10:42 STEP 2027 H=2027:00 +CPU= 11.977
  07:11:05 STEP 2028 H=2028:00 +CPU= 22.672
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002028
  07:11:17 STEP 2029 H=2029:00 +CPU= 11.700
  07:11:28 STEP 2030 H=2030:00 +CPU= 11.443
  07:11:47 STEP 2031 H=2031:00 +CPU= 18.869
  07:11:59 STEP 2032 H=2032:00 +CPU= 11.954
  07:12:11 STEP 2033 H=2033:00 +CPU= 11.195
  07:12:32 STEP 2034 H=2034:00 +CPU= 20.875
  07:12:45 STEP 2035 H=2035:00 +CPU= 13.087
  07:12:58 STEP 2036 H=2036:00 +CPU= 12.483
  07:13:18 STEP 2037 H=2037:00 +CPU= 20.249
  07:13:31 STEP 2038 H=2038:00 +CPU= 13.308
  07:13:44 STEP 2039 H=2039:00 +CPU= 12.514
  07:14:08 STEP 2040 H=2040:00 +CPU= 24.020
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_84.zip
Uploading the intermediate file: upload_file_84.zip
  07:14:21 STEP 2041 H=2041:00 +CPU= 12.962
  07:14:33 STEP 2042 H=2042:00 +CPU= 12.360
  07:14:54 STEP 2043 H=2043:00 +CPU= 20.690
  07:15:08 STEP 2044 H=2044:00 +CPU= 13.444
  07:15:20 STEP 2045 H=2045:00 +CPU= 12.337
  07:15:41 STEP 2046 H=2046:00 +CPU= 20.731
  07:15:54 STEP 2047 H=2047:00 +CPU= 13.185
  07:16:07 STEP 2048 H=2048:00 +CPU= 12.809
  07:16:27 STEP 2049 H=2049:00 +CPU= 19.742
  07:16:39 STEP 2050 H=2050:00 +CPU= 12.417
  07:16:50 STEP 2051 H=2051:00 +CPU= 11.273
  07:17:11 STEP 2052 H=2052:00 +CPU= 20.643
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002052
  07:17:23 STEP 2053 H=2053:00 +CPU= 12.109
  07:17:36 STEP 2054 H=2054:00 +CPU= 12.438
  07:17:56 STEP 2055 H=2055:00 +CPU= 20.527
  07:18:10 STEP 2056 H=2056:00 +CPU= 13.459
  07:18:22 STEP 2057 H=2057:00 +CPU= 12.716
  07:18:43 STEP 2058 H=2058:00 +CPU= 20.807
  07:18:57 STEP 2059 H=2059:00 +CPU= 13.254
  07:19:10 STEP 2060 H=2060:00 +CPU= 13.143
  07:19:30 STEP 2061 H=2061:00 +CPU= 20.546
  07:19:44 STEP 2062 H=2062:00 +CPU= 13.586
  07:19:57 STEP 2063 H=2063:00 +CPU= 13.066
  07:20:21 STEP 2064 H=2064:00 +CPU= 23.850
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_85.zip
Uploading the intermediate file: upload_file_85.zip
  07:20:34 STEP 2065 H=2065:00 +CPU= 12.898
  07:20:46 STEP 2066 H=2066:00 +CPU= 12.104
  07:21:05 STEP 2067 H=2067:00 +CPU= 18.715
  07:21:17 STEP 2068 H=2068:00 +CPU= 12.049
  07:21:29 STEP 2069 H=2069:00 +CPU= 11.742
  07:21:48 STEP 2070 H=2070:00 +CPU= 19.659
  07:22:01 STEP 2071 H=2071:00 +CPU= 12.973
  07:22:17 STEP 2072 H=2072:00 +CPU= 13.288
  07:22:38 STEP 2073 H=2073:00 +CPU= 20.887
  07:22:51 STEP 2074 H=2074:00 +CPU= 13.282
  07:23:03 STEP 2075 H=2075:00 +CPU= 12.430
  07:23:26 STEP 2076 H=2076:00 +CPU= 22.835
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002076
  07:23:39 STEP 2077 H=2077:00 +CPU= 12.814
  07:23:52 STEP 2078 H=2078:00 +CPU= 12.619
  07:24:13 STEP 2079 H=2079:00 +CPU= 20.868
  07:24:26 STEP 2080 H=2080:00 +CPU= 12.869
  07:24:38 STEP 2081 H=2081:00 +CPU= 12.730
  07:24:59 STEP 2082 H=2082:00 +CPU= 20.922
  07:25:12 STEP 2083 H=2083:00 +CPU= 12.564
  07:25:25 STEP 2084 H=2084:00 +CPU= 13.230
  07:25:46 STEP 2085 H=2085:00 +CPU= 20.604
  07:25:59 STEP 2086 H=2086:00 +CPU= 13.186
  07:26:12 STEP 2087 H=2087:00 +CPU= 13.127
  07:26:36 STEP 2088 H=2088:00 +CPU= 23.612
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_86.zip
Uploading the intermediate file: upload_file_86.zip
  07:26:49 STEP 2089 H=2089:00 +CPU= 12.815
  07:27:01 STEP 2090 H=2090:00 +CPU= 12.156
  07:27:20 STEP 2091 H=2091:00 +CPU= 18.590
  07:27:32 STEP 2092 H=2092:00 +CPU= 12.128
  07:27:43 STEP 2093 H=2093:00 +CPU= 11.787
  07:28:03 STEP 2094 H=2094:00 +CPU= 19.418
  07:28:16 STEP 2095 H=2095:00 +CPU= 12.745
  07:28:32 STEP 2096 H=2096:00 +CPU= 13.458
  07:28:53 STEP 2097 H=2097:00 +CPU= 20.630
  07:29:06 STEP 2098 H=2098:00 +CPU= 13.328
  07:29:19 STEP 2099 H=2099:00 +CPU= 12.786
  07:29:41 STEP 2100 H=2100:00 +CPU= 22.622
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002100
  07:29:55 STEP 2101 H=2101:00 +CPU= 13.293
  07:30:08 STEP 2102 H=2102:00 +CPU= 12.835
  07:30:27 STEP 2103 H=2103:00 +CPU= 19.151
  07:30:39 STEP 2104 H=2104:00 +CPU= 12.073
  07:30:51 STEP 2105 H=2105:00 +CPU= 11.632
  07:31:10 STEP 2106 H=2106:00 +CPU= 18.979
  07:31:22 STEP 2107 H=2107:00 +CPU= 12.601
  07:31:35 STEP 2108 H=2108:00 +CPU= 12.919
  07:31:56 STEP 2109 H=2109:00 +CPU= 20.668
  07:32:09 STEP 2110 H=2110:00 +CPU= 13.511
  07:32:22 STEP 2111 H=2111:00 +CPU= 12.957
  07:32:45 STEP 2112 H=2112:00 +CPU= 22.541
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_87.zip
Uploading the intermediate file: upload_file_87.zip
  07:32:57 STEP 2113 H=2113:00 +CPU= 11.616
  07:33:08 STEP 2114 H=2114:00 +CPU= 11.537
  07:33:27 STEP 2115 H=2115:00 +CPU= 18.415
  07:33:39 STEP 2116 H=2116:00 +CPU= 12.745
  07:33:52 STEP 2117 H=2117:00 +CPU= 12.762
  07:34:13 STEP 2118 H=2118:00 +CPU= 20.949
  07:34:26 STEP 2119 H=2119:00 +CPU= 13.081
  07:34:39 STEP 2120 H=2120:00 +CPU= 13.170
  07:34:59 STEP 2121 H=2121:00 +CPU= 19.288
  07:35:11 STEP 2122 H=2122:00 +CPU= 12.268
  07:35:23 STEP 2123 H=2123:00 +CPU= 11.810
  07:35:43 STEP 2124 H=2124:00 +CPU= 20.510
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002124
  07:35:56 STEP 2125 H=2125:00 +CPU= 12.660
  07:36:09 STEP 2126 H=2126:00 +CPU= 12.783
  07:36:29 STEP 2127 H=2127:00 +CPU= 20.444
  07:36:44 STEP 2128 H=2128:00 +CPU= 13.373
  07:36:57 STEP 2129 H=2129:00 +CPU= 12.579
  07:37:18 STEP 2130 H=2130:00 +CPU= 21.146
  07:37:31 STEP 2131 H=2131:00 +CPU= 13.067
  07:37:44 STEP 2132 H=2132:00 +CPU= 12.676
  07:38:05 STEP 2133 H=2133:00 +CPU= 20.488
  07:38:18 STEP 2134 H=2134:00 +CPU= 13.188
  07:38:31 STEP 2135 H=2135:00 +CPU= 12.908
  07:39:05 STEP 2136 H=2136:00 +CPU= 24.532
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_88.zip
Uploading the intermediate file: upload_file_88.zip
  07:39:17 STEP 2137 H=2137:00 +CPU= 12.719
  07:39:30 STEP 2138 H=2138:00 +CPU= 12.773
  07:39:50 STEP 2139 H=2139:00 +CPU= 19.481
  07:40:02 STEP 2140 H=2140:00 +CPU= 11.844
  07:40:13 STEP 2141 H=2141:00 +CPU= 11.343
  07:40:32 STEP 2142 H=2142:00 +CPU= 18.932
  07:40:44 STEP 2143 H=2143:00 +CPU= 12.118
  07:40:57 STEP 2144 H=2144:00 +CPU= 12.495
  07:41:18 STEP 2145 H=2145:00 +CPU= 20.209
  07:41:31 STEP 2146 H=2146:00 +CPU= 13.418
  07:41:43 STEP 2147 H=2147:00 +CPU= 12.228
  07:42:05 STEP 2148 H=2148:00 +CPU= 21.715
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002148
  07:42:17 STEP 2149 H=2149:00 +CPU= 11.601
  07:42:28 STEP 2150 H=2150:00 +CPU= 11.513
  07:42:47 STEP 2151 H=2151:00 +CPU= 18.774
  07:42:59 STEP 2152 H=2152:00 +CPU= 12.142
  07:43:12 STEP 2153 H=2153:00 +CPU= 12.452
  07:43:33 STEP 2154 H=2154:00 +CPU= 20.573
  07:43:46 STEP 2155 H=2155:00 +CPU= 12.952
  07:43:59 STEP 2156 H=2156:00 +CPU= 12.879
  07:44:19 STEP 2157 H=2157:00 +CPU= 20.312
  07:44:33 STEP 2158 H=2158:00 +CPU= 13.415
  07:44:46 STEP 2159 H=2159:00 +CPU= 13.329
  07:45:09 STEP 2160 H=2160:00 +CPU= 22.437
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_89.zip
Uploading the intermediate file: upload_file_89.zip
  07:45:20 STEP 2161 H=2161:00 +CPU= 11.708
  07:45:32 STEP 2162 H=2162:00 +CPU= 11.628
  07:45:51 STEP 2163 H=2163:00 +CPU= 18.565
  07:46:03 STEP 2164 H=2164:00 +CPU= 12.692
  07:46:16 STEP 2165 H=2165:00 +CPU= 12.439
  07:46:37 STEP 2166 H=2166:00 +CPU= 21.009
  07:46:50 STEP 2167 H=2167:00 +CPU= 13.025
  07:47:03 STEP 2168 H=2168:00 +CPU= 13.121
  07:47:23 STEP 2169 H=2169:00 +CPU= 20.484
  07:47:37 STEP 2170 H=2170:00 +CPU= 13.545
  07:47:50 STEP 2171 H=2171:00 +CPU= 12.814
  07:48:12 STEP 2172 H=2172:00 +CPU= 22.494
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002172
  07:48:26 STEP 2173 H=2173:00 +CPU= 13.140
  07:48:38 STEP 2174 H=2174:00 +CPU= 12.059
  07:48:56 STEP 2175 H=2175:00 +CPU= 18.724
  07:49:09 STEP 2176 H=2176:00 +CPU= 12.402
  07:49:20 STEP 2177 H=2177:00 +CPU= 11.276
  07:49:39 STEP 2178 H=2178:00 +CPU= 18.988
  07:49:52 STEP 2179 H=2179:00 +CPU= 13.099
  07:50:05 STEP 2180 H=2180:00 +CPU= 12.959
  07:50:26 STEP 2181 H=2181:00 +CPU= 20.563
  07:50:39 STEP 2182 H=2182:00 +CPU= 13.305
  07:50:52 STEP 2183 H=2183:00 +CPU= 12.998
  07:51:17 STEP 2184 H=2184:00 +CPU= 24.180
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_90.zip
Uploading the intermediate file: upload_file_90.zip
  07:51:30 STEP 2185 H=2185:00 +CPU= 13.149
  07:51:43 STEP 2186 H=2186:00 +CPU= 13.018
  07:52:03 STEP 2187 H=2187:00 +CPU= 20.275
  07:52:15 STEP 2188 H=2188:00 +CPU= 12.213
  07:52:27 STEP 2189 H=2189:00 +CPU= 11.292
  07:52:46 STEP 2190 H=2190:00 +CPU= 18.998
  07:52:57 STEP 2191 H=2191:00 +CPU= 11.625
  07:53:10 STEP 2192 H=2192:00 +CPU= 12.355
  07:53:30 STEP 2193 H=2193:00 +CPU= 20.360
  07:53:43 STEP 2194 H=2194:00 +CPU= 13.375
  07:53:56 STEP 2195 H=2195:00 +CPU= 12.740
  07:54:19 STEP 2196 H=2196:00 +CPU= 22.512
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002196
  07:54:31 STEP 2197 H=2197:00 +CPU= 11.937
  07:54:43 STEP 2198 H=2198:00 +CPU= 11.846
  07:55:01 STEP 2199 H=2199:00 +CPU= 18.647
  07:55:13 STEP 2200 H=2200:00 +CPU= 12.141
  07:55:26 STEP 2201 H=2201:00 +CPU= 12.536
  07:55:47 STEP 2202 H=2202:00 +CPU= 20.697
  07:56:00 STEP 2203 H=2203:00 +CPU= 13.155
  07:56:13 STEP 2204 H=2204:00 +CPU= 13.027
  07:56:33 STEP 2205 H=2205:00 +CPU= 20.063
  07:56:45 STEP 2206 H=2206:00 +CPU= 11.911
  07:56:57 STEP 2207 H=2207:00 +CPU= 11.881
  07:57:19 STEP 2208 H=2208:00 +CPU= 21.686
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_91.zip
Uploading the intermediate file: upload_file_91.zip
  07:57:31 STEP 2209 H=2209:00 +CPU= 11.637
  07:57:43 STEP 2210 H=2210:00 +CPU= 12.267
  07:58:04 STEP 2211 H=2211:00 +CPU= 20.710
  07:58:17 STEP 2212 H=2212:00 +CPU= 13.269
  07:58:29 STEP 2213 H=2213:00 +CPU= 12.297
  07:58:50 STEP 2214 H=2214:00 +CPU= 20.902
  07:59:04 STEP 2215 H=2215:00 +CPU= 13.441
  07:59:16 STEP 2216 H=2216:00 +CPU= 12.895
  07:59:37 STEP 2217 H=2217:00 +CPU= 20.351
  07:59:50 STEP 2218 H=2218:00 +CPU= 13.522
  08:00:03 STEP 2219 H=2219:00 +CPU= 12.538
  08:00:26 STEP 2220 H=2220:00 +CPU= 23.145
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002220
  08:00:39 STEP 2221 H=2221:00 +CPU= 13.075
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2015050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0823
(argv4) batchid: 984
(argv5) wuid: 12201467
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_7a9522aceb455a99465aa035a2a8ca71 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0823_2015050100_123_984_12201467.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0823_2015050100_123_984_12201467.zip
ic_ancil_file: ic_ancil_12201467
ifsdata_file: ifsdata_12201467
climate_data_file: clim_data_12201467
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b282c1bc7cd4c4972e3aca84d2006d0e to: /var/lib/boinc-client/slots/5/ic_ancil_12201467.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12201467.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_459f5892876a6b9fb8fb04c0f93d4129 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12201467.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12201467.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12201467.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12201467.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12201467.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12201467.xml
-- Model is restarting --
Adjusting last_iter, 2221, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12201467.xml
last_cpu_time: 44413
upload_file_number: 92
last_iter: 2207
last_upload: 7948800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392
The child process has been launched with process id: 2406400
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:saint-marie:1:1:2406400:2406400] [20221225:080147:1671969707:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  08:02:13 STEP 2208 H=2208:00 +CPU= 23.153
  08:02:26 STEP 2209 H=2209:00 +CPU= 12.856
  08:02:39 STEP 2210 H=2210:00 +CPU= 13.094
  08:03:00 STEP 2211 H=2211:00 +CPU= 20.628
  08:03:12 STEP 2212 H=2212:00 +CPU= 12.091
  08:03:24 STEP 2213 H=2213:00 +CPU= 11.723
  08:03:43 STEP 2214 H=2214:00 +CPU= 19.006
  08:03:54 STEP 2215 H=2215:00 +CPU= 11.538
  08:04:07 STEP 2216 H=2216:00 +CPU= 12.283
  08:04:30 STEP 2217 H=2217:00 +CPU= 20.403
  08:04:44 STEP 2218 H=2218:00 +CPU= 13.615
  08:04:57 STEP 2219 H=2219:00 +CPU= 13.453
  08:05:20 STEP 2220 H=2220:00 +CPU= 22.215
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002220
  08:05:32 STEP 2221 H=2221:00 +CPU= 12.723
  08:05:46 STEP 2222 H=2222:00 +CPU= 13.858
  08:06:06 STEP 2223 H=2223:00 +CPU= 20.111
  08:06:19 STEP 2224 H=2224:00 +CPU= 12.602
  08:06:31 STEP 2225 H=2225:00 +CPU= 11.956
  08:06:50 STEP 2226 H=2226:00 +CPU= 18.730
  08:07:01 STEP 2227 H=2227:00 +CPU= 11.784
  08:07:14 STEP 2228 H=2228:00 +CPU= 12.262
  08:07:33 STEP 2229 H=2229:00 +CPU= 19.734
  08:07:47 STEP 2230 H=2230:00 +CPU= 13.247
  08:08:01 STEP 2231 H=2231:00 +CPU= 13.747
  08:08:22 STEP 2232 H=2232:00 +CPU= 21.303
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201467/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0823_2015050100_123_984_12201467_0_r1363538392_92.zip
Uploading the intermediate file: upload_file_92.zip
  08:08:34 STEP 2233 H=2233:00 +CPU= 12.604
  08:08:48 STEP 2234 H=2234:00 +CPU= 13.342
  08:09:08 STEP 2235 H=2235:00 +CPU= 20.462
  08:09:21 STEP 2236 H=2236:00 +CPU= 12.995
  08:09:35 STEP 2237 H=2237:00 +CPU= 13.260
  08:09:55 STEP 2238 H=2238:00 +CPU= 20.740
  08:10:08 STEP 2239 H=2239:00 +CPU= 12.746
  08:10:22 STEP 2240 H=2240:00 +CPU= 13.642
  08:10:42 STEP 2241 H=2241:00 +CPU= 20.260
  08:10:55 STEP 2242 H=2242:00 +CPU= 13.115
  08:11:09 STEP 2243 H=2243:00 +CPU= 13.214
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:54:47 1478928 22287779 oifs_43r3_ps_0823_2015050100_123_984_12201467_0 7,171,200 40,906 0.0057
09 May 2023 15:54:41 1478928 22287779 oifs_43r3_ps_0823_2015050100_123_984_12201467_0 6,307,200 37,092 0.0059
09 May 2023 15:54:34 1478928 22287779 oifs_43r3_ps_0823_2015050100_123_984_12201467_0 5,443,200 33,414 0.0061
09 May 2023 15:54:23 1478928 22287779 oifs_43r3_ps_0823_2015050100_123_984_12201467_0 3,801,600 26,179 0.0069
09 May 2023 15:54:10 1478928 22287779 oifs_43r3_ps_0823_2015050100_123_984_12201467_0 2,505,600 20,187 0.0081
09 May 2023 15:53:56 1478928 22287779 oifs_43r3_ps_0823_2015050100_123_984_12201467_0 950,400 13,067 0.0137


©2024 cpdn.org