climateprediction.net home page
Task 22250312

Task 22250312

Name oifs_43r3_bl_a00a_2016092300_15_949_12166404_0
Workunit 12166404
Created 14 Dec 2022, 13:58:56 UTC
Sent 14 Dec 2022, 14:02:13 UTC
Report deadline 13 Jan 2023, 14:02:13 UTC
Received 17 Dec 2022, 1:36:09 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1507869
Run time 1 days 0 hours 21 min 55 sec
CPU time 16 hours 34 min 35 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 3.97 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.07
x86_64-pc-linux-gnu
Peak working set size 5,056.38 MB
Peak swap size 5,930.80 MB
Peak disk usage 5,430.24 MB
Stderr 
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
g to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+000984
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+000984
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+000984
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+000996
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+000996
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+000996
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001008
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001008
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001008
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001020
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001020
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001020
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001032
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001032
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001032
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001044
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001044
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001044
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00a_2016092300_15_949_12166404_0_r1248171781_10.zip
Uploading the intermediate file: upload_file_10.zip
  15:52:50 STEP 1057 H= 264:15 +CPU= 36.677
  15:53:40 STEP 1058 H= 264:30 +CPU= 36.397
  15:54:31 STEP 1059 H= 264:45 +CPU= 36.578
  15:55:26 STEP 1060 H= 265:00 +CPU= 37.287
  15:56:16 STEP 1061 H= 265:15 +CPU= 36.299
  15:57:06 STEP 1062 H= 265:30 +CPU= 35.808
  15:57:57 STEP 1063 H= 265:45 +CPU= 36.800
  15:58:48 STEP 1064 H= 266:00 +CPU= 37.655
  15:59:38 STEP 1065 H= 266:15 +CPU= 36.578
  16:00:30 STEP 1066 H= 266:30 +CPU= 36.552
  16:01:24 STEP 1067 H= 266:45 +CPU= 36.802
  16:02:29 STEP 1068 H= 267:00 +CPU= 46.014
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001068
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001068
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001068
  16:03:19 STEP 1069 H= 267:15 +CPU= 36.473
  16:04:10 STEP 1070 H= 267:30 +CPU= 36.411
  16:05:02 STEP 1071 H= 267:45 +CPU= 36.295
  16:05:53 STEP 1072 H= 268:00 +CPU= 36.947
  16:06:43 STEP 1073 H= 268:15 +CPU= 36.675
  16:07:34 STEP 1074 H= 268:30 +CPU= 36.444
  16:08:24 STEP 1075 H= 268:45 +CPU= 36.305
  16:09:16 STEP 1076 H= 269:00 +CPU= 37.714
  16:10:08 STEP 1077 H= 269:15 +CPU= 37.234
  16:11:00 STEP 1078 H= 269:30 +CPU= 36.891
  16:11:49 STEP 1079 H= 269:45 +CPU= 36.350
  16:12:56 STEP 1080 H= 270:00 +CPU= 46.331
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001080
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001080
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001080
  16:13:46 STEP 1081 H= 270:15 +CPU= 36.141
  16:14:36 STEP 1082 H= 270:30 +CPU= 36.387
  16:15:26 STEP 1083 H= 270:45 +CPU= 36.261
  16:16:19 STEP 1084 H= 271:00 +CPU= 36.896
  16:17:09 STEP 1085 H= 271:15 +CPU= 35.620
  16:18:02 STEP 1086 H= 271:30 +CPU= 36.926
  16:18:55 STEP 1087 H= 271:45 +CPU= 36.612
  16:19:46 STEP 1088 H= 272:00 +CPU= 36.609
  16:20:38 STEP 1089 H= 272:15 +CPU= 36.523
  16:21:30 STEP 1090 H= 272:30 +CPU= 36.227
  16:22:21 STEP 1091 H= 272:45 +CPU= 36.713
  16:23:24 STEP 1092 H= 273:00 +CPU= 45.707
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001092
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001092
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001092
  16:24:15 STEP 1093 H= 273:15 +CPU= 36.530
  16:25:06 STEP 1094 H= 273:30 +CPU= 36.819
  16:25:55 STEP 1095 H= 273:45 +CPU= 35.896
  16:26:46 STEP 1096 H= 274:00 +CPU= 37.486
  16:27:37 STEP 1097 H= 274:15 +CPU= 36.465
  16:28:27 STEP 1098 H= 274:30 +CPU= 36.504
  16:29:17 STEP 1099 H= 274:45 +CPU= 36.647
  16:30:06 STEP 1100 H= 275:00 +CPU= 37.595
  16:30:54 STEP 1101 H= 275:15 +CPU= 36.304
  16:31:41 STEP 1102 H= 275:30 +CPU= 35.785
  16:32:29 STEP 1103 H= 275:45 +CPU= 36.190
  16:33:43 STEP 1104 H= 276:00 +CPU= 50.031
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001104
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001104
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001104
  16:34:32 STEP 1105 H= 276:15 +CPU= 36.113
  16:35:21 STEP 1106 H= 276:30 +CPU= 36.948
  16:36:08 STEP 1107 H= 276:45 +CPU= 36.715
  16:36:56 STEP 1108 H= 277:00 +CPU= 36.689
  16:37:44 STEP 1109 H= 277:15 +CPU= 36.704
  16:38:32 STEP 1110 H= 277:30 +CPU= 36.847
  16:39:19 STEP 1111 H= 277:45 +CPU= 36.245
  16:40:04 STEP 1112 H= 278:00 +CPU= 37.909
  16:40:47 STEP 1113 H= 278:15 +CPU= 37.804
  16:41:28 STEP 1114 H= 278:30 +CPU= 35.205
  16:42:09 STEP 1115 H= 278:45 +CPU= 35.722
  16:43:04 STEP 1116 H= 279:00 +CPU= 46.991
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001116
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001116
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001116
  16:43:48 STEP 1117 H= 279:15 +CPU= 37.716
  16:44:31 STEP 1118 H= 279:30 +CPU= 37.206
  16:45:15 STEP 1119 H= 279:45 +CPU= 37.346
  16:46:00 STEP 1120 H= 280:00 +CPU= 38.437
  16:46:44 STEP 1121 H= 280:15 +CPU= 37.935
  16:47:28 STEP 1122 H= 280:30 +CPU= 37.233
  16:48:14 STEP 1123 H= 280:45 +CPU= 36.840
  16:49:00 STEP 1124 H= 281:00 +CPU= 37.774
  16:49:45 STEP 1125 H= 281:15 +CPU= 37.517
  16:50:28 STEP 1126 H= 281:30 +CPU= 37.698
  16:51:12 STEP 1127 H= 281:45 +CPU= 37.252
  16:52:05 STEP 1128 H= 282:00 +CPU= 46.562
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001128
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001128
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001128
  16:52:49 STEP 1129 H= 282:15 +CPU= 37.388
  16:53:31 STEP 1130 H= 282:30 +CPU= 37.207
  16:54:14 STEP 1131 H= 282:45 +CPU= 37.587
  16:54:59 STEP 1132 H= 283:00 +CPU= 38.001
  16:55:42 STEP 1133 H= 283:15 +CPU= 37.328
  16:56:25 STEP 1134 H= 283:30 +CPU= 37.729
  16:57:06 STEP 1135 H= 283:45 +CPU= 36.680
  16:57:49 STEP 1136 H= 284:00 +CPU= 38.074
  16:58:31 STEP 1137 H= 284:15 +CPU= 37.597
  16:59:12 STEP 1138 H= 284:30 +CPU= 36.902
  16:59:55 STEP 1139 H= 284:45 +CPU= 37.688
  17:00:50 STEP 1140 H= 285:00 +CPU= 47.479
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001140
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001140
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001140
  17:01:30 STEP 1141 H= 285:15 +CPU= 35.021
  17:02:12 STEP 1142 H= 285:30 +CPU= 36.284
  17:02:55 STEP 1143 H= 285:45 +CPU= 37.439
  17:03:38 STEP 1144 H= 286:00 +CPU= 38.306
  17:04:19 STEP 1145 H= 286:15 +CPU= 37.118
  17:05:01 STEP 1146 H= 286:30 +CPU= 37.073
  17:05:43 STEP 1147 H= 286:45 +CPU= 37.932
  17:06:26 STEP 1148 H= 287:00 +CPU= 38.146
  17:07:07 STEP 1149 H= 287:15 +CPU= 37.262
  17:07:50 STEP 1150 H= 287:30 +CPU= 37.776
  17:08:32 STEP 1151 H= 287:45 +CPU= 37.334
  17:09:48 STEP 1152 H= 288:00 +CPU= 50.397
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001152
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001152
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001152
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001056
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001056
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001056
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001068
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001068
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001068
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001080
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001080
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001080
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001092
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001092
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001092
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001104
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001104
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001104
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001116
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001116
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001116
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001128
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001128
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001128
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001140
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001140
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001140
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00a_2016092300_15_949_12166404_0_r1248171781_11.zip
Uploading the intermediate file: upload_file_11.zip
  17:10:38 STEP 1153 H= 288:15 +CPU= 36.388
  17:11:24 STEP 1154 H= 288:30 +CPU= 35.636
  17:12:09 STEP 1155 H= 288:45 +CPU= 35.685
  17:12:58 STEP 1156 H= 289:00 +CPU= 37.189
  17:13:44 STEP 1157 H= 289:15 +CPU= 36.095
  17:14:29 STEP 1158 H= 289:30 +CPU= 36.408
  17:15:16 STEP 1159 H= 289:45 +CPU= 36.815
  17:16:02 STEP 1160 H= 290:00 +CPU= 37.179
  17:16:48 STEP 1161 H= 290:15 +CPU= 36.485
  17:17:34 STEP 1162 H= 290:30 +CPU= 36.656
  17:18:23 STEP 1163 H= 290:45 +CPU= 37.194
  17:19:22 STEP 1164 H= 291:00 +CPU= 46.575
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001164
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001164
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001164
  17:20:07 STEP 1165 H= 291:15 +CPU= 36.198
  17:20:53 STEP 1166 H= 291:30 +CPU= 36.156
  17:21:40 STEP 1167 H= 291:45 +CPU= 36.985
  17:22:31 STEP 1168 H= 292:00 +CPU= 37.362
  17:23:20 STEP 1169 H= 292:15 +CPU= 36.227
  17:24:16 STEP 1170 H= 292:30 +CPU= 37.067
  17:25:09 STEP 1171 H= 292:45 +CPU= 37.122
  17:26:03 STEP 1172 H= 293:00 +CPU= 37.671
  17:26:59 STEP 1173 H= 293:15 +CPU= 37.030
  17:27:51 STEP 1174 H= 293:30 +CPU= 36.458
  17:28:42 STEP 1175 H= 293:45 +CPU= 36.430
  17:30:06 STEP 1176 H= 294:00 +CPU= 46.976
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001176
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001176
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001176
  17:31:08 STEP 1177 H= 294:15 +CPU= 36.601
  17:32:19 STEP 1178 H= 294:30 +CPU= 36.367
  17:33:10 STEP 1179 H= 294:45 +CPU= 36.833
  17:34:01 STEP 1180 H= 295:00 +CPU= 38.256
  17:34:52 STEP 1181 H= 295:15 +CPU= 37.837
  17:35:41 STEP 1182 H= 295:30 +CPU= 36.932
  17:36:31 STEP 1183 H= 295:45 +CPU= 37.082
  17:37:21 STEP 1184 H= 296:00 +CPU= 37.336
  17:38:10 STEP 1185 H= 296:15 +CPU= 37.027
  17:39:01 STEP 1186 H= 296:30 +CPU= 37.241
  17:39:51 STEP 1187 H= 296:45 +CPU= 36.833
  17:40:57 STEP 1188 H= 297:00 +CPU= 46.321
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001188
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001188
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001188
  17:41:51 STEP 1189 H= 297:15 +CPU= 37.008
  17:42:44 STEP 1190 H= 297:30 +CPU= 36.926
  17:43:34 STEP 1191 H= 297:45 +CPU= 36.408
  17:44:26 STEP 1192 H= 298:00 +CPU= 37.430
  17:45:17 STEP 1193 H= 298:15 +CPU= 36.355
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.07_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a00a
(argv4) batchid: 949
(argv5) wuid: 12166404
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /mnt/Cache/Linux/boinc-client/slots/3
Project directory is: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.07
Location of temp folder: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404
..mkdir for temp folder for results failed
Copying: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip to: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_55fd36f842e21daf47bb94fe4fd66b7d to: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_bl_a00a_2016092300_15_949_12166404.zip
Unzipping the namelist zip file: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_bl_a00a_2016092300_15_949_12166404.zip
ic_ancil_file: ic_ancil_12166404
ifsdata_file: ifsdata_12166404
climate_data_file: clim_data_12166404
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /mnt/Cache/Linux/boinc-client/slots/3/ic_ancil_12166404.zip
Unzipping the IC ancils zip file: /mnt/Cache/Linux/boinc-client/slots/3/ic_ancil_12166404.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dbf288ac3a836d2c10c99990ff49f93b to: /mnt/Cache/Linux/boinc-client/slots/3/ifsdata/ifsdata_12166404.zip
Unzipping the ifsdata_zip file: /mnt/Cache/Linux/boinc-client/slots/3/ifsdata/ifsdata_12166404.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/Cache/Linux/boinc-client/slots/3/159l_2/clim_data_12166404.zip
Unzipping the climate data zip file: /mnt/Cache/Linux/boinc-client/slots/3/159l_2/clim_data_12166404.zip
Checking for progress XML file: /mnt/Cache/Linux/boinc-client/slots/3/progress_file_12166404.xml
Opened progress file ok : /mnt/Cache/Linux/boinc-client/slots/3/progress_file_12166404.xml
-- Model is restarting --
Adjusting last_iter, 1194, to previous model restart step.
Creating progress file: /mnt/Cache/Linux/boinc-client/slots/3/progress_file_12166404.xml
last_cpu_time: 49579
upload_file_number: 12
last_iter: 1151
last_upload: 1036800
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a00a_2016092300_15_949_12166404_0_r1248171781
The child process has been launched with process id: 203302
Executing the command: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x30eaa80
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:203302:203302] [20221216:053443:1671190483:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  05:35:45 STEP 1152 H= 288:00 +CPU= 33.161
  05:36:37 STEP 1153 H= 288:15 +CPU= 32.788
  05:37:25 STEP 1154 H= 288:30 +CPU= 32.302
  05:38:14 STEP 1155 H= 288:45 +CPU= 32.708
  05:39:03 STEP 1156 H= 289:00 +CPU= 33.087
  05:39:52 STEP 1157 H= 289:15 +CPU= 32.579
  05:40:42 STEP 1158 H= 289:30 +CPU= 32.379
  05:41:32 STEP 1159 H= 289:45 +CPU= 32.339
  05:42:37 STEP 1160 H= 290:00 +CPU= 32.479
  05:43:32 STEP 1161 H= 290:15 +CPU= 31.948
  05:44:27 STEP 1162 H= 290:30 +CPU= 32.134
  05:45:21 STEP 1163 H= 290:45 +CPU= 32.044
  05:46:29 STEP 1164 H= 291:00 +CPU= 40.520
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001164
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001164
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001164
  05:47:24 STEP 1165 H= 291:15 +CPU= 32.223
  05:48:27 STEP 1166 H= 291:30 +CPU= 32.684
  05:49:27 STEP 1167 H= 291:45 +CPU= 32.671
  05:50:30 STEP 1168 H= 292:00 +CPU= 33.314
  05:51:28 STEP 1169 H= 292:15 +CPU= 32.477
  05:52:30 STEP 1170 H= 292:30 +CPU= 32.688
  05:53:29 STEP 1171 H= 292:45 +CPU= 32.483
  05:54:40 STEP 1172 H= 293:00 +CPU= 33.494
  05:55:49 STEP 1173 H= 293:15 +CPU= 32.589
  05:56:58 STEP 1174 H= 293:30 +CPU= 32.692
  05:58:03 STEP 1175 H= 293:45 +CPU= 32.635
  05:59:30 STEP 1176 H= 294:00 +CPU= 41.722
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001176
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001176
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001176
  06:00:35 STEP 1177 H= 294:15 +CPU= 32.564
  06:01:38 STEP 1178 H= 294:30 +CPU= 32.425
  06:02:47 STEP 1179 H= 294:45 +CPU= 32.670
  06:04:02 STEP 1180 H= 295:00 +CPU= 33.641
  06:05:14 STEP 1181 H= 295:15 +CPU= 32.932
  06:06:23 STEP 1182 H= 295:30 +CPU= 32.587
  06:07:30 STEP 1183 H= 295:45 +CPU= 32.761
  06:08:43 STEP 1184 H= 296:00 +CPU= 33.479
  06:10:06 STEP 1185 H= 296:15 +CPU= 33.259
  06:11:30 STEP 1186 H= 296:30 +CPU= 33.535
  06:12:46 STEP 1187 H= 296:45 +CPU= 33.456
  06:13:58 STEP 1188 H= 297:00 +CPU= 41.467
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001188
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001188
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001188
  06:14:56 STEP 1189 H= 297:15 +CPU= 33.051
  06:15:53 STEP 1190 H= 297:30 +CPU= 32.949
  06:16:50 STEP 1191 H= 297:45 +CPU= 32.757
  06:17:50 STEP 1192 H= 298:00 +CPU= 33.690
  06:18:56 STEP 1193 H= 298:15 +CPU= 33.161
  06:20:00 STEP 1194 H= 298:30 +CPU= 33.222
  06:21:07 STEP 1195 H= 298:45 +CPU= 33.000
  06:22:13 STEP 1196 H= 299:00 +CPU= 33.660
  06:23:25 STEP 1197 H= 299:15 +CPU= 33.273
  06:24:42 STEP 1198 H= 299:30 +CPU= 33.265
  06:25:43 STEP 1199 H= 299:45 +CPU= 32.622
  06:27:27 STEP 1200 H= 300:00 +CPU= 45.403
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001200
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001200
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001200
  06:28:27 STEP 1201 H= 300:15 +CPU= 32.178
  06:29:31 STEP 1202 H= 300:30 +CPU= 32.422
  06:30:37 STEP 1203 H= 300:45 +CPU= 32.470
  06:31:42 STEP 1204 H= 301:00 +CPU= 33.022
  06:32:45 STEP 1205 H= 301:15 +CPU= 32.439
  06:33:59 STEP 1206 H= 301:30 +CPU= 32.652
  06:35:08 STEP 1207 H= 301:45 +CPU= 32.564
  06:36:11 STEP 1208 H= 302:00 +CPU= 32.979
  06:37:26 STEP 1209 H= 302:15 +CPU= 32.601
  06:38:38 STEP 1210 H= 302:30 +CPU= 32.483
  06:39:45 STEP 1211 H= 302:45 +CPU= 32.526
  06:41:02 STEP 1212 H= 303:00 +CPU= 40.910
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001212
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001212
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001212
  06:42:09 STEP 1213 H= 303:15 +CPU= 32.436
  06:43:21 STEP 1214 H= 303:30 +CPU= 32.391
  06:44:35 STEP 1215 H= 303:45 +CPU= 32.628
  06:46:08 STEP 1216 H= 304:00 +CPU= 33.911
  06:47:29 STEP 1217 H= 304:15 +CPU= 32.885
  06:48:38 STEP 1218 H= 304:30 +CPU= 32.270
  06:49:56 STEP 1219 H= 304:45 +CPU= 32.647
  06:51:05 STEP 1220 H= 305:00 +CPU= 33.073
  06:52:17 STEP 1221 H= 305:15 +CPU= 32.254
  06:53:36 STEP 1222 H= 305:30 +CPU= 32.092
  06:54:51 STEP 1223 H= 305:45 +CPU= 32.284
  06:56:26 STEP 1224 H= 306:00 +CPU= 40.842
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001224
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001224
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001224
  06:57:55 STEP 1225 H= 306:15 +CPU= 32.262
  06:59:08 STEP 1226 H= 306:30 +CPU= 31.947
  07:00:22 STEP 1227 H= 306:45 +CPU= 32.059
  07:01:54 STEP 1228 H= 307:00 +CPU= 32.994
  07:03:07 STEP 1229 H= 307:15 +CPU= 32.262
  07:04:20 STEP 1230 H= 307:30 +CPU= 32.237
  07:05:36 STEP 1231 H= 307:45 +CPU= 32.124
  07:06:50 STEP 1232 H= 308:00 +CPU= 32.687
  07:08:09 STEP 1233 H= 308:15 +CPU= 32.120
  07:09:28 STEP 1234 H= 308:30 +CPU= 32.104
  07:10:51 STEP 1235 H= 308:45 +CPU= 32.381
  07:12:30 STEP 1236 H= 309:00 +CPU= 40.799
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001236
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001236
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001236
  07:13:45 STEP 1237 H= 309:15 +CPU= 31.983
  07:14:59 STEP 1238 H= 309:30 +CPU= 32.026
  07:16:10 STEP 1239 H= 309:45 +CPU= 31.843
  07:17:18 STEP 1240 H= 310:00 +CPU= 32.478
  07:18:28 STEP 1241 H= 310:15 +CPU= 31.874
  07:19:35 STEP 1242 H= 310:30 +CPU= 32.063
  07:20:41 STEP 1243 H= 310:45 +CPU= 32.104
  07:21:49 STEP 1244 H= 311:00 +CPU= 32.686
  07:22:44 STEP 1245 H= 311:15 +CPU= 32.605
  07:23:37 STEP 1246 H= 311:30 +CPU= 33.012
  07:24:35 STEP 1247 H= 311:45 +CPU= 33.286
  07:26:20 STEP 1248 H= 312:00 +CPU= 46.761
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001248
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001248
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001248
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001152
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001152
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001152
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001164
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001164
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001164
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001176
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001176
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001176
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001188
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001188
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001188
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001200
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001200
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001200
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001212
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001212
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001212
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001224
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001224
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001224
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001236
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001236
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001236
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00a_2016092300_15_949_12166404_0_r1248171781_12.zip
Uploading the intermediate file: upload_file_12.zip
  07:27:23 STEP 1249 H= 312:15 +CPU= 33.179
  07:28:22 STEP 1250 H= 312:30 +CPU= 33.160
  07:29:21 STEP 1251 H= 312:45 +CPU= 33.181
  07:30:16 STEP 1252 H= 313:00 +CPU= 34.029
  07:31:09 STEP 1253 H= 313:15 +CPU= 33.233
  07:32:00 STEP 1254 H= 313:30 +CPU= 32.882
  07:32:50 STEP 1255 H= 313:45 +CPU= 33.019
  07:33:45 STEP 1256 H= 314:00 +CPU= 34.137
  07:34:37 STEP 1257 H= 314:15 +CPU= 33.472
  07:35:37 STEP 1258 H= 314:30 +CPU= 33.537
  07:36:31 STEP 1259 H= 314:45 +CPU= 33.080
  07:37:48 STEP 1260 H= 315:00 +CPU= 42.144
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001260
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001260
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001260
  07:38:51 STEP 1261 H= 315:15 +CPU= 33.529
  07:39:55 STEP 1262 H= 315:30 +CPU= 33.393
  07:40:56 STEP 1263 H= 315:45 +CPU= 32.995
  07:41:57 STEP 1264 H= 316:00 +CPU= 33.691
  07:42:54 STEP 1265 H= 316:15 +CPU= 32.777
  07:43:56 STEP 1266 H= 316:30 +CPU= 33.103
  07:44:50 STEP 1267 H= 316:45 +CPU= 32.922
  07:45:45 STEP 1268 H= 317:00 +CPU= 33.330
  07:46:39 STEP 1269 H= 317:15 +CPU= 33.172
  07:47:33 STEP 1270 H= 317:30 +CPU= 32.705
  07:48:29 STEP 1271 H= 317:45 +CPU= 32.719
  07:49:54 STEP 1272 H= 318:00 +CPU= 41.966
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001272
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001272
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001272
  07:50:47 STEP 1273 H= 318:15 +CPU= 32.714
  07:51:45 STEP 1274 H= 318:30 +CPU= 33.003
  07:52:46 STEP 1275 H= 318:45 +CPU= 33.146
  07:53:50 STEP 1276 H= 319:00 +CPU= 33.607
  07:55:00 STEP 1277 H= 319:15 +CPU= 33.191
  07:56:00 STEP 1278 H= 319:30 +CPU= 32.632
  07:57:01 STEP 1279 H= 319:45 +CPU= 32.952
  07:58:11 STEP 1280 H= 320:00 +CPU= 33.953
  07:59:12 STEP 1281 H= 320:15 +CPU= 32.961
  08:00:10 STEP 1282 H= 320:30 +CPU= 32.857
  08:01:10 STEP 1283 H= 320:45 +CPU= 33.044
  08:02:24 STEP 1284 H= 321:00 +CPU= 41.361
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001284
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001284
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001284
  08:03:36 STEP 1285 H= 321:15 +CPU= 32.649
  08:04:42 STEP 1286 H= 321:30 +CPU= 32.650
  08:05:43 STEP 1287 H= 321:45 +CPU= 32.385
  08:06:47 STEP 1288 H= 322:00 +CPU= 32.834
  08:07:47 STEP 1289 H= 322:15 +CPU= 32.583
  08:08:40 STEP 1290 H= 322:30 +CPU= 32.712
  08:09:34 STEP 1291 H= 322:45 +CPU= 32.845
  08:10:48 STEP 1292 H= 323:00 +CPU= 33.975
  08:12:11 STEP 1293 H= 323:15 +CPU= 33.213
  08:13:48 STEP 1294 H= 323:30 +CPU= 33.340
  08:15:10 STEP 1295 H= 323:45 +CPU= 33.056
  08:18:16 STEP 1296 H= 324:00 +CPU= 47.438
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001296
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001296
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001296
  08:19:46 STEP 1297 H= 324:15 +CPU= 33.352
  08:21:08 STEP 1298 H= 324:30 +CPU= 33.093
  08:22:21 STEP 1299 H= 324:45 +CPU= 33.109
  08:23:24 STEP 1300 H= 325:00 +CPU= 33.714
  08:24:35 STEP 1301 H= 325:15 +CPU= 33.032
  08:25:52 STEP 1302 H= 325:30 +CPU= 32.886
  08:27:19 STEP 1303 H= 325:45 +CPU= 32.753
  08:28:45 STEP 1304 H= 326:00 +CPU= 33.508
  08:30:08 STEP 1305 H= 326:15 +CPU= 32.679
  08:31:30 STEP 1306 H= 326:30 +CPU= 32.771
  08:32:46 STEP 1307 H= 326:45 +CPU= 32.634
  08:34:31 STEP 1308 H= 327:00 +CPU= 41.440
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001308
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001308
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001308
  08:35:54 STEP 1309 H= 327:15 +CPU= 32.769
  08:37:11 STEP 1310 H= 327:30 +CPU= 32.564
  08:38:31 STEP 1311 H= 327:45 +CPU= 32.811
  08:39:54 STEP 1312 H= 328:00 +CPU= 33.282
  08:41:15 STEP 1313 H= 328:15 +CPU= 32.708
  08:42:37 STEP 1314 H= 328:30 +CPU= 32.641
  08:44:00 STEP 1315 H= 328:45 +CPU= 32.666
  08:45:21 STEP 1316 H= 329:00 +CPU= 33.268
  08:46:48 STEP 1317 H= 329:15 +CPU= 32.712
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.07_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a00a
(argv4) batchid: 949
(argv5) wuid: 12166404
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /mnt/Cache/Linux/boinc-client/slots/3
Project directory is: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.07
Location of temp folder: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404
..mkdir for temp folder for results failed
Copying: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip to: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_55fd36f842e21daf47bb94fe4fd66b7d to: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_bl_a00a_2016092300_15_949_12166404.zip
Unzipping the namelist zip file: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_bl_a00a_2016092300_15_949_12166404.zip
ic_ancil_file: ic_ancil_12166404
ifsdata_file: ifsdata_12166404
climate_data_file: clim_data_12166404
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /mnt/Cache/Linux/boinc-client/slots/3/ic_ancil_12166404.zip
Unzipping the IC ancils zip file: /mnt/Cache/Linux/boinc-client/slots/3/ic_ancil_12166404.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dbf288ac3a836d2c10c99990ff49f93b to: /mnt/Cache/Linux/boinc-client/slots/3/ifsdata/ifsdata_12166404.zip
Unzipping the ifsdata_zip file: /mnt/Cache/Linux/boinc-client/slots/3/ifsdata/ifsdata_12166404.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/Cache/Linux/boinc-client/slots/3/159l_2/clim_data_12166404.zip
Unzipping the climate data zip file: /mnt/Cache/Linux/boinc-client/slots/3/159l_2/clim_data_12166404.zip
Checking for progress XML file: /mnt/Cache/Linux/boinc-client/slots/3/progress_file_12166404.xml
Opened progress file ok : /mnt/Cache/Linux/boinc-client/slots/3/progress_file_12166404.xml
-- Model is restarting --
Adjusting last_iter, 1318, to previous model restart step.
Creating progress file: /mnt/Cache/Linux/boinc-client/slots/3/progress_file_12166404.xml
last_cpu_time: 55164
upload_file_number: 13
last_iter: 1295
last_upload: 1123200
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a00a_2016092300_15_949_12166404_0_r1248171781
The child process has been launched with process id: 3626
Executing the command: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x30eaa80
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.002] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:3626:3626] [20221216:170628:1671231988:0.002] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  17:07:16 STEP 1296 H= 324:00 +CPU= 31.277
  17:07:53 STEP 1297 H= 324:15 +CPU= 30.299
  17:08:29 STEP 1298 H= 324:30 +CPU= 30.156
  17:09:05 STEP 1299 H= 324:45 +CPU= 30.317
  17:09:42 STEP 1300 H= 325:00 +CPU= 30.867
  17:10:18 STEP 1301 H= 325:15 +CPU= 30.116
  17:10:54 STEP 1302 H= 325:30 +CPU= 30.235
  17:11:38 STEP 1303 H= 325:45 +CPU= 30.566
  17:12:28 STEP 1304 H= 326:00 +CPU= 31.453
  17:13:17 STEP 1305 H= 326:15 +CPU= 30.532
  17:14:07 STEP 1306 H= 326:30 +CPU= 30.557
  17:14:51 STEP 1307 H= 326:45 +CPU= 30.508
  17:15:43 STEP 1308 H= 327:00 +CPU= 38.956
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001308
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001308
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001308
  17:16:21 STEP 1309 H= 327:15 +CPU= 30.512
  17:16:59 STEP 1310 H= 327:30 +CPU= 30.546
  17:17:36 STEP 1311 H= 327:45 +CPU= 30.583
  17:18:13 STEP 1312 H= 328:00 +CPU= 31.071
  17:18:48 STEP 1313 H= 328:15 +CPU= 30.382
  17:19:25 STEP 1314 H= 328:30 +CPU= 30.515
  17:20:01 STEP 1315 H= 328:45 +CPU= 30.539
  17:20:38 STEP 1316 H= 329:00 +CPU= 31.097
  17:21:13 STEP 1317 H= 329:15 +CPU= 30.756
  17:21:49 STEP 1318 H= 329:30 +CPU= 30.836
  17:22:24 STEP 1319 H= 329:45 +CPU= 30.651
  17:23:09 STEP 1320 H= 330:00 +CPU= 38.754
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001320
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001320
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001320
  17:23:44 STEP 1321 H= 330:15 +CPU= 30.662
  17:24:19 STEP 1322 H= 330:30 +CPU= 30.806
  17:24:55 STEP 1323 H= 330:45 +CPU= 31.224
  17:25:31 STEP 1324 H= 331:00 +CPU= 31.501
  17:26:05 STEP 1325 H= 331:15 +CPU= 30.584
  17:26:39 STEP 1326 H= 331:30 +CPU= 30.623
  17:27:13 STEP 1327 H= 331:45 +CPU= 30.548
  17:27:46 STEP 1328 H= 332:00 +CPU= 31.262
  17:28:20 STEP 1329 H= 332:15 +CPU= 30.561
  17:28:52 STEP 1330 H= 332:30 +CPU= 29.983
  17:29:26 STEP 1331 H= 332:45 +CPU= 30.253
  17:30:08 STEP 1332 H= 333:00 +CPU= 38.405
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001332
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001332
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001332
  17:30:42 STEP 1333 H= 333:15 +CPU= 30.253
  17:31:16 STEP 1334 H= 333:30 +CPU= 30.569
  17:31:48 STEP 1335 H= 333:45 +CPU= 30.525
  17:32:22 STEP 1336 H= 334:00 +CPU= 31.035
  17:32:54 STEP 1337 H= 334:15 +CPU= 30.426
  17:33:28 STEP 1338 H= 334:30 +CPU= 30.111
  17:34:02 STEP 1339 H= 334:45 +CPU= 30.375
  17:34:36 STEP 1340 H= 335:00 +CPU= 30.809
  17:35:09 STEP 1341 H= 335:15 +CPU= 30.106
  17:35:43 STEP 1342 H= 335:30 +CPU= 30.117
  17:36:17 STEP 1343 H= 335:45 +CPU= 30.187
  17:37:20 STEP 1344 H= 336:00 +CPU= 42.070
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001344
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001344
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001344
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001248
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001248
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001248
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001260
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001260
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001260
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001272
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001272
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001272
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001284
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001284
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001284
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001296
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001296
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001296
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001308
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001308
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001308
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001320
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001320
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001320
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001332
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001332
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001332
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00a_2016092300_15_949_12166404_0_r1248171781_13.zip
Uploading the intermediate file: upload_file_13.zip
  17:37:58 STEP 1345 H= 336:15 +CPU= 30.238
  17:38:33 STEP 1346 H= 336:30 +CPU= 30.109
  17:39:06 STEP 1347 H= 336:45 +CPU= 29.976
  17:39:40 STEP 1348 H= 337:00 +CPU= 30.742
  17:40:14 STEP 1349 H= 337:15 +CPU= 30.161
  17:40:48 STEP 1350 H= 337:30 +CPU= 30.129
  17:41:22 STEP 1351 H= 337:45 +CPU= 30.154
  17:41:57 STEP 1352 H= 338:00 +CPU= 30.763
  17:42:31 STEP 1353 H= 338:15 +CPU= 30.083
  17:43:04 STEP 1354 H= 338:30 +CPU= 30.091
  17:43:38 STEP 1355 H= 338:45 +CPU= 30.062
  17:44:20 STEP 1356 H= 339:00 +CPU= 38.068
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001356
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001356
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001356
  17:44:54 STEP 1357 H= 339:15 +CPU= 30.194
  17:45:28 STEP 1358 H= 339:30 +CPU= 30.038
  17:46:01 STEP 1359 H= 339:45 +CPU= 30.158
  17:46:36 STEP 1360 H= 340:00 +CPU= 30.889
  17:47:10 STEP 1361 H= 340:15 +CPU= 30.226
  17:47:44 STEP 1362 H= 340:30 +CPU= 30.133
  17:48:17 STEP 1363 H= 340:45 +CPU= 30.119
  17:48:51 STEP 1364 H= 341:00 +CPU= 30.781
  17:49:25 STEP 1365 H= 341:15 +CPU= 30.066
  17:49:59 STEP 1366 H= 341:30 +CPU= 30.160
  17:50:33 STEP 1367 H= 341:45 +CPU= 30.088
  17:51:16 STEP 1368 H= 342:00 +CPU= 38.102
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001368
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001368
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001368
  17:51:51 STEP 1369 H= 342:15 +CPU= 30.233
  17:52:24 STEP 1370 H= 342:30 +CPU= 30.118
  17:52:57 STEP 1371 H= 342:45 +CPU= 30.073
  17:53:32 STEP 1372 H= 343:00 +CPU= 30.808
  17:54:06 STEP 1373 H= 343:15 +CPU= 30.114
  17:54:39 STEP 1374 H= 343:30 +CPU= 30.133
  17:55:13 STEP 1375 H= 343:45 +CPU= 30.173
  17:55:47 STEP 1376 H= 344:00 +CPU= 30.764
  17:56:22 STEP 1377 H= 344:15 +CPU= 30.090
  17:56:57 STEP 1378 H= 344:30 +CPU= 30.209
  17:57:30 STEP 1379 H= 344:45 +CPU= 30.061
  17:58:12 STEP 1380 H= 345:00 +CPU= 38.017
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001380
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001380
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001380
  17:58:45 STEP 1381 H= 345:15 +CPU= 29.966
  17:59:20 STEP 1382 H= 345:30 +CPU= 30.081
  17:59:54 STEP 1383 H= 345:45 +CPU= 30.147
  18:00:29 STEP 1384 H= 346:00 +CPU= 30.855
  18:01:03 STEP 1385 H= 346:15 +CPU= 30.123
  18:01:38 STEP 1386 H= 346:30 +CPU= 30.103
  18:02:11 STEP 1387 H= 346:45 +CPU= 30.081
  18:02:46 STEP 1388 H= 347:00 +CPU= 30.713
  18:03:20 STEP 1389 H= 347:15 +CPU= 30.040
  18:03:55 STEP 1390 H= 347:30 +CPU= 30.112
  18:04:28 STEP 1391 H= 347:45 +CPU= 30.039
  18:05:29 STEP 1392 H= 348:00 +CPU= 42.067
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001392
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001392
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001392
  18:06:03 STEP 1393 H= 348:15 +CPU= 30.071
  18:06:37 STEP 1394 H= 348:30 +CPU= 30.022
  18:07:11 STEP 1395 H= 348:45 +CPU= 30.103
  18:07:45 STEP 1396 H= 349:00 +CPU= 30.704
  18:08:19 STEP 1397 H= 349:15 +CPU= 30.040
  18:08:53 STEP 1398 H= 349:30 +CPU= 30.007
  18:09:27 STEP 1399 H= 349:45 +CPU= 30.082
  18:10:02 STEP 1400 H= 350:00 +CPU= 30.831
  18:10:36 STEP 1401 H= 350:15 +CPU= 30.245
  18:11:09 STEP 1402 H= 350:30 +CPU= 30.003
  18:11:43 STEP 1403 H= 350:45 +CPU= 30.177
  18:12:26 STEP 1404 H= 351:00 +CPU= 38.336
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001404
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001404
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001404
  18:12:59 STEP 1405 H= 351:15 +CPU= 30.142
  18:13:33 STEP 1406 H= 351:30 +CPU= 30.163
  18:14:07 STEP 1407 H= 351:45 +CPU= 30.176
  18:14:40 STEP 1408 H= 352:00 +CPU= 30.818
  18:15:14 STEP 1409 H= 352:15 +CPU= 30.186
  18:15:48 STEP 1410 H= 352:30 +CPU= 30.183
  18:16:22 STEP 1411 H= 352:45 +CPU= 30.379
  18:16:57 STEP 1412 H= 353:00 +CPU= 30.898
  18:17:30 STEP 1413 H= 353:15 +CPU= 30.261
  18:18:04 STEP 1414 H= 353:30 +CPU= 30.222
  18:18:38 STEP 1415 H= 353:45 +CPU= 30.082
  18:19:21 STEP 1416 H= 354:00 +CPU= 38.036
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001416
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001416
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001416
  18:19:54 STEP 1417 H= 354:15 +CPU= 30.025
  18:20:28 STEP 1418 H= 354:30 +CPU= 30.110
  18:21:01 STEP 1419 H= 354:45 +CPU= 30.112
  18:21:36 STEP 1420 H= 355:00 +CPU= 30.837
  18:22:10 STEP 1421 H= 355:15 +CPU= 30.139
  18:22:44 STEP 1422 H= 355:30 +CPU= 30.161
  18:23:17 STEP 1423 H= 355:45 +CPU= 30.168
  18:23:53 STEP 1424 H= 356:00 +CPU= 30.890
  18:24:26 STEP 1425 H= 356:15 +CPU= 30.184
  18:25:00 STEP 1426 H= 356:30 +CPU= 30.206
  18:25:33 STEP 1427 H= 356:45 +CPU= 30.150
  18:26:16 STEP 1428 H= 357:00 +CPU= 37.986
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001428
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001428
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001428
  18:26:50 STEP 1429 H= 357:15 +CPU= 30.052
  18:27:24 STEP 1430 H= 357:30 +CPU= 30.131
  18:27:58 STEP 1431 H= 357:45 +CPU= 30.097
  18:28:33 STEP 1432 H= 358:00 +CPU= 30.825
  18:29:07 STEP 1433 H= 358:15 +CPU= 30.218
  18:29:42 STEP 1434 H= 358:30 +CPU= 30.068
  18:30:16 STEP 1435 H= 358:45 +CPU= 30.105
  18:30:52 STEP 1436 H= 359:00 +CPU= 30.845
  18:31:26 STEP 1437 H= 359:15 +CPU= 30.143
  18:32:00 STEP 1438 H= 359:30 +CPU= 30.118
  18:32:34 STEP 1439 H= 359:45 +CPU= 30.149
  18:33:34 STEP 1440 H= 360:00 +CPU= 39.862
The child process terminated with status: 0
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGh7zg+001440
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHh7zg+001440
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAh7zg+001440
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001344
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001356
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001368
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001380
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001392
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001404
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001416
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001428
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMGGh7zg+001440
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001344
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001356
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001368
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001380
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001392
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001404
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001416
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001428
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMSHh7zg+001440
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001344
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001356
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001368
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001380
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001392
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001404
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001416
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001428
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166404/ICMUAh7zg+001440
Zipping up the final file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00a_2016092300_15_949_12166404_0_r1248171781_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
18:37:09 (3433): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:43:46 1507869 22250312 oifs_43r3_bl_a00a_2016092300_15_949_12166404_0 1,295,100 59,675 0.0461


©2024 cpdn.org