climateprediction.net home page
Task 22435925

Task 22435925

Name oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0
Workunit 12284339
Created 7 Jun 2024, 14:28:41 UTC
Sent 7 Jun 2024, 14:33:11 UTC
Report deadline 6 Aug 2024, 14:33:11 UTC
Received 11 Jun 2024, 17:02:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1496581
Run time 15 hours 25 min 16 sec
CPU time 14 hours 52 min 21 sec
Validate state Invalid
Credit 1,979.07
Device peak FLOPS 4.08 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.46 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,285.85 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<stderr_txt>
58:30 +CPU= 37.075
  13:24:09 STEP 1035 H= 258:45 +CPU= 37.168
  13:24:48 STEP 1036 H= 259:00 +CPU= 37.930
  13:25:28 STEP 1037 H= 259:15 +CPU= 37.147
  13:26:06 STEP 1038 H= 259:30 +CPU= 37.102
  13:26:44 STEP 1039 H= 259:45 +CPU= 37.140
  13:27:23 STEP 1040 H= 260:00 +CPU= 38.013
  13:28:01 STEP 1041 H= 260:15 +CPU= 37.157
  13:28:39 STEP 1042 H= 260:30 +CPU= 37.026
  13:29:17 STEP 1043 H= 260:45 +CPU= 37.156
  13:30:07 STEP 1044 H= 261:00 +CPU= 46.794
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001044
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001044
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001044
  13:30:46 STEP 1045 H= 261:15 +CPU= 37.233
  13:31:24 STEP 1046 H= 261:30 +CPU= 37.248
  13:32:02 STEP 1047 H= 261:45 +CPU= 37.196
  13:32:41 STEP 1048 H= 262:00 +CPU= 37.971
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:33:41 STEP 1049 H= 262:15 +CPU= 36.668
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:34:40 STEP 1050 H= 262:30 +CPU= 36.417
  13:35:24 STEP 1051 H= 262:45 +CPU= 37.612
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:36:27 STEP 1052 H= 263:00 +CPU= 37.870
  13:37:06 STEP 1053 H= 263:15 +CPU= 37.301
  13:37:45 STEP 1054 H= 263:30 +CPU= 37.284
  13:38:24 STEP 1055 H= 263:45 +CPU= 37.324
  13:39:13 STEP 1056 H= 264:00 +CPU= 47.048
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001056
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001056
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001056
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+000960
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+000960
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+000960
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+000972
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+000972
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+000972
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+000984
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+000984
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+000984
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+000996
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+000996
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+000996
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001008
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001008
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001008
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001020
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001020
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001020
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001032
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001032
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001032
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001044
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001044
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001044
Zipping up the intermediate file: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_10.zip
Uploading the intermediate file: upload_file_10.zip
  13:39:47 STEP 1057 H= 264:15 +CPU= 31.832
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:40:21 STEP 1058 H= 264:30 +CPU= 30.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:41:11 STEP 1059 H= 264:45 +CPU= 28.340
  13:41:40 STEP 1060 H= 265:00 +CPU= 28.590
  13:42:11 STEP 1061 H= 265:15 +CPU= 29.203
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:43:05 STEP 1062 H= 265:30 +CPU= 30.557
  13:43:35 STEP 1063 H= 265:45 +CPU= 28.772
  13:44:04 STEP 1064 H= 266:00 +CPU= 28.839
  13:44:33 STEP 1065 H= 266:15 +CPU= 28.007
  13:45:02 STEP 1066 H= 266:30 +CPU= 28.227
  13:45:34 STEP 1067 H= 266:45 +CPU= 30.242
  13:46:12 STEP 1068 H= 267:00 +CPU= 36.519
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001068
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001068
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001068
  13:46:43 STEP 1069 H= 267:15 +CPU= 29.579
  13:47:13 STEP 1070 H= 267:30 +CPU= 29.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:48:07 STEP 1071 H= 267:45 +CPU= 30.629
  13:48:38 STEP 1072 H= 268:00 +CPU= 29.948
  13:49:08 STEP 1073 H= 268:15 +CPU= 28.995
  13:49:38 STEP 1074 H= 268:30 +CPU= 28.850
  13:50:09 STEP 1075 H= 268:45 +CPU= 29.461
  13:50:39 STEP 1076 H= 269:00 +CPU= 29.471
  13:51:11 STEP 1077 H= 269:15 +CPU= 29.810
  13:51:41 STEP 1078 H= 269:30 +CPU= 29.035
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:52:35 STEP 1079 H= 269:45 +CPU= 29.918
  13:53:14 STEP 1080 H= 270:00 +CPU= 37.016
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001080
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001080
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001080
  13:53:45 STEP 1081 H= 270:15 +CPU= 29.087
  13:54:14 STEP 1082 H= 270:30 +CPU= 28.272
  13:54:42 STEP 1083 H= 270:45 +CPU= 27.518
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:55:35 STEP 1084 H= 271:00 +CPU= 29.009
  13:56:03 STEP 1085 H= 271:15 +CPU= 27.514
  13:56:30 STEP 1086 H= 271:30 +CPU= 27.404
  13:56:58 STEP 1087 H= 271:45 +CPU= 27.033
  13:57:27 STEP 1088 H= 272:00 +CPU= 28.521
  13:57:54 STEP 1089 H= 272:15 +CPU= 27.247
  13:58:22 STEP 1090 H= 272:30 +CPU= 27.653
  13:58:54 STEP 1091 H= 272:45 +CPU= 31.257
  13:59:44 STEP 1092 H= 273:00 +CPU= 47.112
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001092
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001092
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001092
  14:00:25 STEP 1093 H= 273:15 +CPU= 37.480
  14:01:05 STEP 1094 H= 273:30 +CPU= 37.475
  14:01:44 STEP 1095 H= 273:45 +CPU= 37.384
  14:02:24 STEP 1096 H= 274:00 +CPU= 38.181
  14:03:04 STEP 1097 H= 274:15 +CPU= 37.327
  14:03:42 STEP 1098 H= 274:30 +CPU= 37.267
  14:04:20 STEP 1099 H= 274:45 +CPU= 37.291
  14:04:56 STEP 1100 H= 275:00 +CPU= 34.630
  14:05:25 STEP 1101 H= 275:15 +CPU= 28.422
  14:05:55 STEP 1102 H= 275:30 +CPU= 28.820
  14:06:24 STEP 1103 H= 275:45 +CPU= 28.537
  14:07:04 STEP 1104 H= 276:00 +CPU= 38.486
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001104
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001104
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001104
  14:07:33 STEP 1105 H= 276:15 +CPU= 28.592
  14:08:02 STEP 1106 H= 276:30 +CPU= 28.155
  14:08:31 STEP 1107 H= 276:45 +CPU= 28.535
  14:09:02 STEP 1108 H= 277:00 +CPU= 29.542
  14:09:33 STEP 1109 H= 277:15 +CPU= 29.282
  14:10:01 STEP 1110 H= 277:30 +CPU= 27.782
  14:10:30 STEP 1111 H= 277:45 +CPU= 28.852
  14:11:00 STEP 1112 H= 278:00 +CPU= 29.071
  14:11:29 STEP 1113 H= 278:15 +CPU= 28.144
  14:11:57 STEP 1114 H= 278:30 +CPU= 27.944
  14:12:27 STEP 1115 H= 278:45 +CPU= 29.475
  14:13:16 STEP 1116 H= 279:00 +CPU= 47.303
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001116
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001116
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001116
  14:13:56 STEP 1117 H= 279:15 +CPU= 37.640
  14:14:36 STEP 1118 H= 279:30 +CPU= 37.611
  14:15:15 STEP 1119 H= 279:45 +CPU= 37.422
  14:15:46 STEP 1120 H= 280:00 +CPU= 29.948
  14:16:17 STEP 1121 H= 280:15 +CPU= 29.248
  14:16:48 STEP 1122 H= 280:30 +CPU= 29.529
  14:17:19 STEP 1123 H= 280:45 +CPU= 29.322
  14:17:50 STEP 1124 H= 281:00 +CPU= 30.103
  14:18:19 STEP 1125 H= 281:15 +CPU= 28.106
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:19:54 STEP 1126 H= 281:30 +CPU= 30.833
  14:20:23 STEP 1127 H= 281:45 +CPU= 28.655
  14:21:00 STEP 1128 H= 282:00 +CPU= 35.196
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001128
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001128
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001128
  14:21:29 STEP 1129 H= 282:15 +CPU= 28.573
  14:21:57 STEP 1130 H= 282:30 +CPU= 27.590
  14:22:25 STEP 1131 H= 282:45 +CPU= 27.716
  14:22:54 STEP 1132 H= 283:00 +CPU= 28.795
  14:23:23 STEP 1133 H= 283:15 +CPU= 27.915
  14:23:53 STEP 1134 H= 283:30 +CPU= 28.695
  14:24:23 STEP 1135 H= 283:45 +CPU= 28.513
  14:24:52 STEP 1136 H= 284:00 +CPU= 28.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:26:08 STEP 1137 H= 284:15 +CPU= 30.837
  14:26:36 STEP 1138 H= 284:30 +CPU= 27.823
  14:27:05 STEP 1139 H= 284:45 +CPU= 27.879
  14:27:40 STEP 1140 H= 285:00 +CPU= 34.611
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001140
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001140
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001140
  14:28:11 STEP 1141 H= 285:15 +CPU= 30.317
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:29:22 STEP 1142 H= 285:30 +CPU= 28.480
  14:29:51 STEP 1143 H= 285:45 +CPU= 28.039
  14:30:22 STEP 1144 H= 286:00 +CPU= 29.526
  14:30:51 STEP 1145 H= 286:15 +CPU= 28.130
  14:31:20 STEP 1146 H= 286:30 +CPU= 28.288
  14:31:49 STEP 1147 H= 286:45 +CPU= 28.288
  14:32:26 STEP 1148 H= 287:00 +CPU= 36.068
  14:33:07 STEP 1149 H= 287:15 +CPU= 37.692
  14:33:46 STEP 1150 H= 287:30 +CPU= 37.650
  14:34:27 STEP 1151 H= 287:45 +CPU= 37.570
  14:35:17 STEP 1152 H= 288:00 +CPU= 46.038
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001152
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001152
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001152
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001056
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001056
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001056
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001068
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001068
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001068
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001080
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001080
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001080
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001092
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001092
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001092
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001104
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001104
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001104
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001116
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001116
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001116
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001128
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001128
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001128
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001140
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001140
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001140
Zipping up the intermediate file: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_11.zip
Uploading the intermediate file: upload_file_11.zip
  14:35:50 STEP 1153 H= 288:15 +CPU= 30.720
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:36:28 STEP 1154 H= 288:30 +CPU= 28.116
  14:36:57 STEP 1155 H= 288:45 +CPU= 28.414
  14:37:27 STEP 1156 H= 289:00 +CPU= 29.194
  14:37:58 STEP 1157 H= 289:15 +CPU= 29.455
  14:38:29 STEP 1158 H= 289:30 +CPU= 29.487
  14:38:59 STEP 1159 H= 289:45 +CPU= 29.438
  14:39:29 STEP 1160 H= 290:00 +CPU= 28.673
  14:39:58 STEP 1161 H= 290:15 +CPU= 28.455
  14:40:28 STEP 1162 H= 290:30 +CPU= 29.424
  14:40:57 STEP 1163 H= 290:45 +CPU= 28.172
  14:41:33 STEP 1164 H= 291:00 +CPU= 35.468
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001164
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001164
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001164
  14:42:03 STEP 1165 H= 291:15 +CPU= 28.751
  14:42:33 STEP 1166 H= 291:30 +CPU= 29.206
  14:43:02 STEP 1167 H= 291:45 +CPU= 28.868
  14:43:33 STEP 1168 H= 292:00 +CPU= 29.950
  14:44:03 STEP 1169 H= 292:15 +CPU= 28.693
  14:44:33 STEP 1170 H= 292:30 +CPU= 29.069
  14:45:03 STEP 1171 H= 292:45 +CPU= 29.447
  14:45:33 STEP 1172 H= 293:00 +CPU= 28.857
  14:46:01 STEP 1173 H= 293:15 +CPU= 27.993
  14:46:29 STEP 1174 H= 293:30 +CPU= 27.805
  14:46:57 STEP 1175 H= 293:45 +CPU= 27.799
  14:47:33 STEP 1176 H= 294:00 +CPU= 34.655
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001176
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001176
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001176
  14:48:01 STEP 1177 H= 294:15 +CPU= 27.778
  14:48:39 STEP 1178 H= 294:30 +CPU= 37.361
  14:49:19 STEP 1179 H= 294:45 +CPU= 37.582
  14:49:56 STEP 1180 H= 295:00 +CPU= 35.667
  14:50:25 STEP 1181 H= 295:15 +CPU= 28.781
  14:50:53 STEP 1182 H= 295:30 +CPU= 27.595
  14:51:22 STEP 1183 H= 295:45 +CPU= 28.227
  14:51:51 STEP 1184 H= 296:00 +CPU= 28.548
  14:52:19 STEP 1185 H= 296:15 +CPU= 28.100
  14:52:48 STEP 1186 H= 296:30 +CPU= 27.894
  14:53:22 STEP 1187 H= 296:45 +CPU= 33.014
  14:54:11 STEP 1188 H= 297:00 +CPU= 47.239
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001188
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001188
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001188
  14:54:51 STEP 1189 H= 297:15 +CPU= 37.632
  14:55:32 STEP 1190 H= 297:30 +CPU= 37.542
  14:56:10 STEP 1191 H= 297:45 +CPU= 37.371
  14:56:50 STEP 1192 H= 298:00 +CPU= 38.107
  14:57:29 STEP 1193 H= 298:15 +CPU= 37.393
  14:58:07 STEP 1194 H= 298:30 +CPU= 37.350
  14:58:42 STEP 1195 H= 298:45 +CPU= 33.381
  14:59:12 STEP 1196 H= 299:00 +CPU= 28.905
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:00:28 STEP 1197 H= 299:15 +CPU= 31.079
  15:00:58 STEP 1198 H= 299:30 +CPU= 28.585
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:01:51 STEP 1199 H= 299:45 +CPU= 29.637
  15:02:31 STEP 1200 H= 300:00 +CPU= 38.783
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001200
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001200
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001200
  15:03:00 STEP 1201 H= 300:15 +CPU= 28.521
  15:03:29 STEP 1202 H= 300:30 +CPU= 28.863
  15:04:00 STEP 1203 H= 300:45 +CPU= 29.640
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:04:51 STEP 1204 H= 301:00 +CPU= 28.999
  15:05:21 STEP 1205 H= 301:15 +CPU= 28.991
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:06:12 STEP 1206 H= 301:30 +CPU= 28.938
  15:06:41 STEP 1207 H= 301:45 +CPU= 28.247
  15:07:11 STEP 1208 H= 302:00 +CPU= 29.082
  15:07:40 STEP 1209 H= 302:15 +CPU= 28.253
  15:08:10 STEP 1210 H= 302:30 +CPU= 28.613
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:09:24 STEP 1211 H= 302:45 +CPU= 29.138
  15:10:01 STEP 1212 H= 303:00 +CPU= 35.230
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001212
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001212
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001212
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:10:52 STEP 1213 H= 303:15 +CPU= 28.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:12:09 STEP 1214 H= 303:30 +CPU= 31.247
  15:12:38 STEP 1215 H= 303:45 +CPU= 28.769
  15:13:08 STEP 1216 H= 304:00 +CPU= 29.164
  15:13:39 STEP 1217 H= 304:15 +CPU= 29.084
  15:14:06 STEP 1218 H= 304:30 +CPU= 27.565
  15:14:34 STEP 1219 H= 304:45 +CPU= 27.605
  15:15:03 STEP 1220 H= 305:00 +CPU= 28.352
  15:15:32 STEP 1221 H= 305:15 +CPU= 28.055
  15:15:59 STEP 1222 H= 305:30 +CPU= 27.339
  15:16:30 STEP 1223 H= 305:45 +CPU= 30.047
  15:17:20 STEP 1224 H= 306:00 +CPU= 47.373
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001224
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001224
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001224
  15:17:59 STEP 1225 H= 306:15 +CPU= 37.626
  15:18:39 STEP 1226 H= 306:30 +CPU= 37.639
  15:19:17 STEP 1227 H= 306:45 +CPU= 37.340
  15:19:57 STEP 1228 H= 307:00 +CPU= 38.078
  15:20:37 STEP 1229 H= 307:15 +CPU= 37.402
  15:21:15 STEP 1230 H= 307:30 +CPU= 37.348
  15:21:54 STEP 1231 H= 307:45 +CPU= 37.391
  15:22:33 STEP 1232 H= 308:00 +CPU= 38.114
  15:23:11 STEP 1233 H= 308:15 +CPU= 37.277
  15:23:50 STEP 1234 H= 308:30 +CPU= 37.304
  15:24:28 STEP 1235 H= 308:45 +CPU= 37.305
  15:25:17 STEP 1236 H= 309:00 +CPU= 46.948
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001236
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001236
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001236
  15:25:56 STEP 1237 H= 309:15 +CPU= 37.321
  15:26:34 STEP 1238 H= 309:30 +CPU= 37.350
  15:27:13 STEP 1239 H= 309:45 +CPU= 37.326
  15:27:52 STEP 1240 H= 310:00 +CPU= 38.087
  15:28:30 STEP 1241 H= 310:15 +CPU= 37.282
  15:29:08 STEP 1242 H= 310:30 +CPU= 37.262
  15:29:47 STEP 1243 H= 310:45 +CPU= 37.262
  15:30:27 STEP 1244 H= 311:00 +CPU= 38.249
  15:31:06 STEP 1245 H= 311:15 +CPU= 37.341
  15:31:44 STEP 1246 H= 311:30 +CPU= 37.290
  15:32:22 STEP 1247 H= 311:45 +CPU= 37.243
  15:33:15 STEP 1248 H= 312:00 +CPU= 50.845
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001248
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001248
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001248
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001152
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001152
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001152
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001164
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001164
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001164
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001176
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001176
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001176
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001188
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001188
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001188
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001200
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001200
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001200
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001212
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001212
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001212
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001224
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001224
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001224
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001236
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001236
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001236
Zipping up the intermediate file: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_12.zip
Uploading the intermediate file: upload_file_12.zip
  15:33:56 STEP 1249 H= 312:15 +CPU= 37.283
  15:34:35 STEP 1250 H= 312:30 +CPU= 37.546
  15:35:18 STEP 1251 H= 312:45 +CPU= 37.634
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:36:21 STEP 1252 H= 313:00 +CPU= 37.931
  15:37:00 STEP 1253 H= 313:15 +CPU= 37.311
  15:37:38 STEP 1254 H= 313:30 +CPU= 37.351
  15:38:17 STEP 1255 H= 313:45 +CPU= 37.435
  15:38:56 STEP 1256 H= 314:00 +CPU= 38.085
  15:39:35 STEP 1257 H= 314:15 +CPU= 37.303
  15:40:14 STEP 1258 H= 314:30 +CPU= 37.432
  15:40:53 STEP 1259 H= 314:45 +CPU= 37.303
  15:41:41 STEP 1260 H= 315:00 +CPU= 46.900
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001260
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001260
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001260
  15:42:19 STEP 1261 H= 315:15 +CPU= 37.275
  15:42:58 STEP 1262 H= 315:30 +CPU= 37.274
  15:43:36 STEP 1263 H= 315:45 +CPU= 37.282
  15:44:15 STEP 1264 H= 316:00 +CPU= 38.039
  15:44:53 STEP 1265 H= 316:15 +CPU= 37.244
  15:45:33 STEP 1266 H= 316:30 +CPU= 37.341
  15:46:11 STEP 1267 H= 316:45 +CPU= 37.272
  15:46:50 STEP 1268 H= 317:00 +CPU= 37.960
  15:47:28 STEP 1269 H= 317:15 +CPU= 37.256
  15:48:06 STEP 1270 H= 317:30 +CPU= 37.215
  15:48:44 STEP 1271 H= 317:45 +CPU= 37.258
  15:49:32 STEP 1272 H= 318:00 +CPU= 46.711
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001272
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001272
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001272
  15:50:34 STEP 1273 H= 318:15 +CPU= 37.281
  15:51:12 STEP 1274 H= 318:30 +CPU= 37.215
  15:51:50 STEP 1275 H= 318:45 +CPU= 37.239
  15:52:29 STEP 1276 H= 319:00 +CPU= 38.021
  15:53:07 STEP 1277 H= 319:15 +CPU= 37.219
  15:53:46 STEP 1278 H= 319:30 +CPU= 37.232
  15:54:25 STEP 1279 H= 319:45 +CPU= 37.265
  15:55:05 STEP 1280 H= 320:00 +CPU= 38.068
  15:55:43 STEP 1281 H= 320:15 +CPU= 37.264
  15:56:21 STEP 1282 H= 320:30 +CPU= 37.215
  15:56:59 STEP 1283 H= 320:45 +CPU= 37.217
  15:57:47 STEP 1284 H= 321:00 +CPU= 46.828
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001284
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001284
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001284
  15:58:25 STEP 1285 H= 321:15 +CPU= 37.240
  15:59:04 STEP 1286 H= 321:30 +CPU= 37.246
  15:59:42 STEP 1287 H= 321:45 +CPU= 37.272
  16:00:23 STEP 1288 H= 322:00 +CPU= 38.109
  16:01:02 STEP 1289 H= 322:15 +CPU= 37.276
  16:01:40 STEP 1290 H= 322:30 +CPU= 37.282
  16:02:18 STEP 1291 H= 322:45 +CPU= 37.303
  16:02:57 STEP 1292 H= 323:00 +CPU= 38.017
  16:03:36 STEP 1293 H= 323:15 +CPU= 37.205
  16:04:14 STEP 1294 H= 323:30 +CPU= 37.206
  16:04:52 STEP 1295 H= 323:45 +CPU= 37.220
  16:05:46 STEP 1296 H= 324:00 +CPU= 51.346
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001296
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001296
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001296
  16:06:25 STEP 1297 H= 324:15 +CPU= 37.587
  16:07:03 STEP 1298 H= 324:30 +CPU= 37.236
  16:07:41 STEP 1299 H= 324:45 +CPU= 37.230
  16:08:20 STEP 1300 H= 325:00 +CPU= 38.074
  16:08:59 STEP 1301 H= 325:15 +CPU= 37.268
  16:09:37 STEP 1302 H= 325:30 +CPU= 37.249
  16:10:17 STEP 1303 H= 325:45 +CPU= 37.370
  16:10:56 STEP 1304 H= 326:00 +CPU= 38.052
  16:11:34 STEP 1305 H= 326:15 +CPU= 37.295
  16:12:12 STEP 1306 H= 326:30 +CPU= 37.214
  16:12:50 STEP 1307 H= 326:45 +CPU= 37.316
  16:13:39 STEP 1308 H= 327:00 +CPU= 46.838
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001308
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001308
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001308
  16:14:17 STEP 1309 H= 327:15 +CPU= 37.201
  16:14:55 STEP 1310 H= 327:30 +CPU= 37.152
  16:15:34 STEP 1311 H= 327:45 +CPU= 37.227
  16:16:13 STEP 1312 H= 328:00 +CPU= 37.968
  16:16:51 STEP 1313 H= 328:15 +CPU= 37.239
  16:17:30 STEP 1314 H= 328:30 +CPU= 37.215
  16:18:08 STEP 1315 H= 328:45 +CPU= 37.191
  16:18:47 STEP 1316 H= 329:00 +CPU= 38.001
  16:19:25 STEP 1317 H= 329:15 +CPU= 37.185
  16:20:03 STEP 1318 H= 329:30 +CPU= 37.194
  16:20:42 STEP 1319 H= 329:45 +CPU= 37.200
  16:21:30 STEP 1320 H= 330:00 +CPU= 46.863
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001320
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001320
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001320
  16:22:08 STEP 1321 H= 330:15 +CPU= 37.212
  16:22:47 STEP 1322 H= 330:30 +CPU= 37.301
  16:23:25 STEP 1323 H= 330:45 +CPU= 37.270
  16:24:04 STEP 1324 H= 331:00 +CPU= 38.005
  16:24:42 STEP 1325 H= 331:15 +CPU= 37.254
  16:25:21 STEP 1326 H= 331:30 +CPU= 37.369
  16:26:00 STEP 1327 H= 331:45 +CPU= 37.206
  16:26:39 STEP 1328 H= 332:00 +CPU= 38.105
  16:27:17 STEP 1329 H= 332:15 +CPU= 37.274
  16:27:55 STEP 1330 H= 332:30 +CPU= 37.278
  16:28:33 STEP 1331 H= 332:45 +CPU= 37.402
  16:29:22 STEP 1332 H= 333:00 +CPU= 47.055
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001332
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001332
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001332
  16:30:00 STEP 1333 H= 333:15 +CPU= 37.301
  16:30:40 STEP 1334 H= 333:30 +CPU= 37.282
  16:31:19 STEP 1335 H= 333:45 +CPU= 37.427
  16:31:58 STEP 1336 H= 334:00 +CPU= 38.192
  16:32:36 STEP 1337 H= 334:15 +CPU= 37.339
  16:33:15 STEP 1338 H= 334:30 +CPU= 37.417
  16:33:53 STEP 1339 H= 334:45 +CPU= 37.324
  16:34:33 STEP 1340 H= 335:00 +CPU= 38.157
  16:35:16 STEP 1341 H= 335:15 +CPU= 37.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:36:18 STEP 1342 H= 335:30 +CPU= 37.128
  16:36:57 STEP 1343 H= 335:45 +CPU= 37.273
  16:37:49 STEP 1344 H= 336:00 +CPU= 50.906
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001344
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001344
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001344
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001248
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001248
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001248
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001260
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001260
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001260
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001272
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001272
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001272
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001284
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001284
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001284
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001296
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001296
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001296
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001308
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001308
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001308
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001320
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001320
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001320
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001332
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001332
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001332
Zipping up the intermediate file: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_13.zip
Uploading the intermediate file: upload_file_13.zip
  16:38:31 STEP 1345 H= 336:15 +CPU= 37.264
  16:39:09 STEP 1346 H= 336:30 +CPU= 37.625
  16:39:48 STEP 1347 H= 336:45 +CPU= 37.374
  16:40:28 STEP 1348 H= 337:00 +CPU= 38.290
  16:41:07 STEP 1349 H= 337:15 +CPU= 37.342
  16:41:45 STEP 1350 H= 337:30 +CPU= 37.333
  16:42:24 STEP 1351 H= 337:45 +CPU= 37.348
  16:43:04 STEP 1352 H= 338:00 +CPU= 38.111
  16:43:42 STEP 1353 H= 338:15 +CPU= 37.332
  16:44:20 STEP 1354 H= 338:30 +CPU= 37.287
  16:44:58 STEP 1355 H= 338:45 +CPU= 37.228
  16:45:48 STEP 1356 H= 339:00 +CPU= 46.896
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001356
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001356
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001356
  16:46:26 STEP 1357 H= 339:15 +CPU= 37.220
  16:47:04 STEP 1358 H= 339:30 +CPU= 37.272
  16:47:45 STEP 1359 H= 339:45 +CPU= 37.318
  16:48:24 STEP 1360 H= 340:00 +CPU= 38.080
  16:49:02 STEP 1361 H= 340:15 +CPU= 37.227
  16:49:40 STEP 1362 H= 340:30 +CPU= 37.274
  16:50:20 STEP 1363 H= 340:45 +CPU= 37.366
  16:50:59 STEP 1364 H= 341:00 +CPU= 38.078
  16:51:37 STEP 1365 H= 341:15 +CPU= 37.267
  16:52:15 STEP 1366 H= 341:30 +CPU= 37.306
  16:52:53 STEP 1367 H= 341:45 +CPU= 37.330
  16:53:42 STEP 1368 H= 342:00 +CPU= 47.030
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001368
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001368
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001368
  16:54:20 STEP 1369 H= 342:15 +CPU= 37.382
  16:54:59 STEP 1370 H= 342:30 +CPU= 37.338
  16:55:38 STEP 1371 H= 342:45 +CPU= 37.447
  16:56:17 STEP 1372 H= 343:00 +CPU= 38.115
  16:56:56 STEP 1373 H= 343:15 +CPU= 37.386
  16:57:34 STEP 1374 H= 343:30 +CPU= 37.443
  16:58:13 STEP 1375 H= 343:45 +CPU= 37.346
  16:58:52 STEP 1376 H= 344:00 +CPU= 38.100
  16:59:30 STEP 1377 H= 344:15 +CPU= 37.236
  17:00:11 STEP 1378 H= 344:30 +CPU= 37.387
  17:00:50 STEP 1379 H= 344:45 +CPU= 37.230
  17:01:38 STEP 1380 H= 345:00 +CPU= 46.856
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001380
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001380
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001380
  17:02:16 STEP 1381 H= 345:15 +CPU= 37.334
  17:02:55 STEP 1382 H= 345:30 +CPU= 37.326
  17:03:34 STEP 1383 H= 345:45 +CPU= 37.362
  17:04:13 STEP 1384 H= 346:00 +CPU= 38.088
  17:04:51 STEP 1385 H= 346:15 +CPU= 37.346
  17:05:31 STEP 1386 H= 346:30 +CPU= 37.322
  17:06:09 STEP 1387 H= 346:45 +CPU= 37.198
  17:06:48 STEP 1388 H= 347:00 +CPU= 38.034
  17:07:26 STEP 1389 H= 347:15 +CPU= 37.298
  17:08:05 STEP 1390 H= 347:30 +CPU= 37.312
  17:08:43 STEP 1391 H= 347:45 +CPU= 37.215
  17:09:35 STEP 1392 H= 348:00 +CPU= 50.867
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001392
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001392
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001392
  17:10:15 STEP 1393 H= 348:15 +CPU= 37.436
  17:10:53 STEP 1394 H= 348:30 +CPU= 37.248
  17:11:31 STEP 1395 H= 348:45 +CPU= 37.254
  17:12:10 STEP 1396 H= 349:00 +CPU= 38.101
  17:12:49 STEP 1397 H= 349:15 +CPU= 37.238
  17:13:27 STEP 1398 H= 349:30 +CPU= 37.278
  17:14:05 STEP 1399 H= 349:45 +CPU= 37.291
  17:14:44 STEP 1400 H= 350:00 +CPU= 37.737
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:15:43 STEP 1401 H= 350:15 +CPU= 36.855
  17:16:21 STEP 1402 H= 350:30 +CPU= 37.250
  17:16:59 STEP 1403 H= 350:45 +CPU= 37.283
  17:17:47 STEP 1404 H= 351:00 +CPU= 46.909
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001404
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001404
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001404
  17:18:25 STEP 1405 H= 351:15 +CPU= 37.279
  17:19:04 STEP 1406 H= 351:30 +CPU= 37.295
  17:19:42 STEP 1407 H= 351:45 +CPU= 37.287
  17:20:22 STEP 1408 H= 352:00 +CPU= 38.223
  17:21:01 STEP 1409 H= 352:15 +CPU= 37.299
  17:21:39 STEP 1410 H= 352:30 +CPU= 37.321
  17:22:17 STEP 1411 H= 352:45 +CPU= 37.272
  17:22:56 STEP 1412 H= 353:00 +CPU= 38.084
  17:23:35 STEP 1413 H= 353:15 +CPU= 37.334
  17:24:13 STEP 1414 H= 353:30 +CPU= 37.291
  17:24:51 STEP 1415 H= 353:45 +CPU= 37.311
  17:25:40 STEP 1416 H= 354:00 +CPU= 46.959
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001416
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001416
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001416
  17:26:19 STEP 1417 H= 354:15 +CPU= 37.287
  17:26:57 STEP 1418 H= 354:30 +CPU= 37.294
  17:27:35 STEP 1419 H= 354:45 +CPU= 37.314
  17:28:14 STEP 1420 H= 355:00 +CPU= 38.106
  17:28:53 STEP 1421 H= 355:15 +CPU= 37.345
  17:29:31 STEP 1422 H= 355:30 +CPU= 37.283
  17:30:11 STEP 1423 H= 355:45 +CPU= 37.412
  17:30:51 STEP 1424 H= 356:00 +CPU= 38.163
  17:31:29 STEP 1425 H= 356:15 +CPU= 37.274
  17:32:07 STEP 1426 H= 356:30 +CPU= 37.295
  17:32:46 STEP 1427 H= 356:45 +CPU= 37.329
  17:33:34 STEP 1428 H= 357:00 +CPU= 47.411
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001428
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001428
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001428
  17:34:13 STEP 1429 H= 357:15 +CPU= 37.756
  17:34:52 STEP 1430 H= 357:30 +CPU= 37.682
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:36:01 STEP 1431 H= 357:45 +CPU= 38.190
  17:36:41 STEP 1432 H= 358:00 +CPU= 38.517
  17:37:20 STEP 1433 H= 358:15 +CPU= 37.916
  17:37:59 STEP 1434 H= 358:30 +CPU= 37.625
  17:38:37 STEP 1435 H= 358:45 +CPU= 37.320
  17:39:16 STEP 1436 H= 359:00 +CPU= 38.083
  17:39:54 STEP 1437 H= 359:15 +CPU= 37.291
  17:40:34 STEP 1438 H= 359:30 +CPU= 37.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:56:56 STEP 1439 H= 359:45 +CPU= 37.389
  17:57:47 STEP 1440 H= 360:00 +CPU= 48.318
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.2683490319E-21      I       0.2838194404E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1429691045E-01      I
I  Relat. Hum. I      0.2530320137E+00      I       0.2952134119E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2569690453E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    313366724 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS522277.9 Mbytes/s, TOTAL TIME=    0.0223( 2.7%)
 17:57:47 STEP 1440 H= 360:00 +CPU= 48.318
 END CNT3
 NSTEP =  1440 CNT0   000000000  35.815  35.815  37.331   0.959               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    85.3     0.0    85.3     0.0   201.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.95      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    5636.5    5636.5     13.86      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1081.0    1081.0      2.45      0.00
  10 SCAN2M - PHYSICS                             1441   22089.8   22089.8     50.10      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1173.0    1173.0      0.22      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      72.4      72.4      0.01      0.00
  14 SUINIF                                          1   29813.9   29813.9      0.05      0.00
  17 GRIDFPOS IN CNT4                              121      43.8      43.8      0.01      0.00
  18 SUSPECG                                         1   24795.8   24795.8      0.04      0.00
  19 SUSPEC                                          1   24805.0   24805.0      0.04      0.00
  24 SUGRIDU                                         1    4006.0    4006.0      0.01      0.00
  25 SPECRT                                          1     394.3     394.3      0.00      0.00
  26 SUGRIDF                                         1     608.6     608.6      0.00      0.00
  27 RESTART FILES - WRITING                        30    4731.1    4731.1      0.22      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    8466.6    8466.6      1.61      0.00
  31 POSDDH IN STEPO                                 7       1.0       1.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    8441.3    8441.3     19.14      0.00
  39 SU0YOMB                                         1     416.4     416.4      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      31.5      31.5      0.07      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     376.7     376.7      0.85      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      57.5      57.5      0.13      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125    1350.8    1350.8      6.64      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     381.9     381.9      1.81      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     166.4     166.4      0.79      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     252.2     252.2      1.24      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      41.5      41.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      61.6      61.6      0.30      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      32.8      32.8      0.16      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     131.8     131.8      0.65      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      39.9      39.9      0.19      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    63541.5 CPU TIME   53518.5 VECTOR TIME    53518.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       20.4
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMGGh7zg+001440
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMSHh7zg+001440
Moving to projects directory: /mnt/WDred/boinc/slots/1/ICMUAh7zg+001440
Adding to the zip: /mnt/WDred/boinc/slots/1/NODE.001_01
Adding to the zip: /mnt/WDred/boinc/slots/1/ifs.stat
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001368
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001356
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001380
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001392
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001428
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001416
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001392
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001368
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001344
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001344
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001416
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001368
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001440
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001392
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001440
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001356
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001380
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001404
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001440
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001428
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001356
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001428
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001380
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001404
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMSHh7zg+001344
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMGGh7zg+001416
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339/ICMUAh7zg+001404
Zipping up the final file: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1xs
(argv4) batchid: 1017
(argv5) wuid: 12284339
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /mnt/WDred/boinc/slots/1
Project directory is: /mnt/WDred/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12284339
Copying: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /mnt/WDred/boinc/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/WDred/boinc/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_867b77e8056f66e0b6df38b92dee0521 to: /mnt/WDred/boinc/slots/1/oifs_43r3_bl_a1xs_2016092300_20_1017_12284339.zip
Unzipping the namelist zip file: /mnt/WDred/boinc/slots/1/oifs_43r3_bl_a1xs_2016092300_20_1017_12284339.zip
ic_ancil_file: ic_ancil_12284339
ifsdata_file: ifsdata_12284339
climate_data_file: clim_data_12284339
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /mnt/WDred/boinc/slots/1/ic_ancil_12284339.zip
Unzipping the IC ancils zip file: /mnt/WDred/boinc/slots/1/ic_ancil_12284339.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d652cab3ecf9858d1a19bb355dec6208 to: /mnt/WDred/boinc/slots/1/ifsdata/ifsdata_12284339.zip
Unzipping the ifsdata_zip file: /mnt/WDred/boinc/slots/1/ifsdata/ifsdata_12284339.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/WDred/boinc/slots/1/159l_2/clim_data_12284339.zip
Unzipping the climate data zip file: /mnt/WDred/boinc/slots/1/159l_2/clim_data_12284339.zip
Checking for progress XML file: /mnt/WDred/boinc/slots/1/progress_file_12284339.xml
Opened progress file ok : /mnt/WDred/boinc/slots/1/progress_file_12284339.xml
-- Model is restarting --
Adjusting last_iter, 1440, to previous model restart step.
Creating progress file: /mnt/WDred/boinc/slots/1/progress_file_12284339.xml
last_cpu_time: 53511
upload_file_number: 14
last_iter: 1441
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946
Executing the command: /mnt/WDred/boinc/slots/1/oifs_43r3_model.exe
The child process has been launched with process id: 8056
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:8056:8056] [20240611:180201:1718121721:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:04:57 STEP 1440 H= 360:00 +CPU= 26.431
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I      I Hor. Flux of PEII     -0.00000 I              I              I              I               I
I      I Vert.Flux of PEII      0.00000 I              I              I              I               I
I      I Work Pres.G.F  II              I      0.16423 I              I              I               I
I      I Conv. Ad.-Int. II     -0.16424 I              I              I              I               I
DDH--------------------------------------------------------------------------------------------------I
I DYN- Horizont. Flux   II      0.01422 I      0.00280 I      0.18972 I      0.00036 I      0.00012  I
I    I Vertical Flux    II      0.00000 I      0.00000 I      0.00000 I      0.00000 I      0.00000  I
DDH--------------------------------------------------------------------------------------------------I
  
DDH----------------------------------------------------------------------------------------------------------------------------------
  I   - Mass balance    (10**(-6)  KG/M**2) 
  
  I INITIAL      I HORIZ. FLUX  I DYN. FLUX    I DYN. FLUX    I PHYS. FLUX   I PHYS. FLUX   I CURRENT      I I I RESIDUAL     I
  I MASS         I              I TOA          I SURFACE      I TOA          I SURFACE      I MASS         I I I              I
  ---------------------------------------------------------------------------------------------------------- I ----------------
  -              -              -              -              -              -              -              - I -              -
  - 10341776742. I          -0. .           0. .           0. .           0. .           0. I 10341939748. - I -      163006. -
  -              -              -              -              -              -              -              - I -              -
  ---------------------------------------------------------------------------------------------------------- I ----------------
 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.2683490319E-21      I       0.2838194404E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1429691045E-01      I
I  Relat. Hum. I      0.2530320137E+00      I       0.2952134119E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2569690453E+03      I
DDH------------------------------------------------------------------------
  
 18:04:57 STEP 1440 H= 360:00 +CPU= 26.431
 END CNT3
 NSTEP =  1440 CNT0   000000000  26.257  26.257  26.905   0.976               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN            0/           0
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1      3    0       46      1044068        0            0    94.7    94.7     0.0    95.5     0.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1  175863.4  175863.4    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1   27090.8   27090.8     15.40      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                    1    4024.0    4024.0      2.29      0.00
  10 SCAN2M - PHYSICS                                1   15574.6   15574.6      8.86      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  1      51.8      51.8      0.03      0.00
  28 RESTART FILES - READING                         1   97476.2   97476.2     55.43      0.00
  31 POSDDH IN STEPO                                 1       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                      1    5710.1    5710.1      3.25      0.00
  39 SU0YOMB                                         1   50834.7   50834.7     28.91      0.00
  51 SCAN2M   - SL COMM. PART 1                      1      27.8      27.8      0.02      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  1       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM        4     211.0     211.0      0.48      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM         4      77.9      77.9      0.18      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1     103.0     103.0      0.06      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION              4      23.0      23.0      0.05      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION              4      60.9      60.9      0.14      0.00
 400 GSTATS                                       1119       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                   987       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME      175.9 CPU TIME      30.3 VECTOR TIME       30.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY    47839.1
  *** END CNT0 *** 
------------------------------------------------
Adding to the zip: /mnt/WDred/boinc/slots/1/NODE.001_01
Adding to the zip: /mnt/WDred/boinc/slots/1/ifs.stat
Zipping up the final file: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_15.zip
Uploading the final file: upload_file_15.zip
Uploading trickle at timestep: 1296900
18:08:18 (6731): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0_r1656174946_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Jun 2024 17:04:07 1496581 22435925 oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0 1,296,900 53,541 0.0413
11 Jun 2024 15:59:37 1496581 22435925 oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0 1,295,100 53,518 0.0413
11 Jun 2024 10:13:58 1496581 22435925 oifs_43r3_bl_a1xs_2016092300_20_1017_12284339_0 864,000 36,361 0.0421


©2024 cpdn.org