climateprediction.net home page
Task 22445513

Task 22445513

Name oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0
Workunit 12291910
Created 13 Jun 2024, 1:13:15 UTC
Sent 14 Jun 2024, 1:01:24 UTC
Report deadline 13 Aug 2024, 1:01:24 UTC
Received 19 Jun 2024, 15:44:46 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1542649
Run time 19 hours 22 min 43 sec
CPU time 11 hours 43 min 23 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 4.95 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.17 MB
Peak swap size 5,981.08 MB
Peak disk usage 1,788.15 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
 20.414
  20:27:32 STEP 1253 H= 313:15 +CPU= 20.141
  20:28:05 STEP 1254 H= 313:30 +CPU= 20.144
  20:28:39 STEP 1255 H= 313:45 +CPU= 20.038
  20:29:13 STEP 1256 H= 314:00 +CPU= 20.568
  20:29:47 STEP 1257 H= 314:15 +CPU= 20.098
  20:30:20 STEP 1258 H= 314:30 +CPU= 20.109
  20:30:54 STEP 1259 H= 314:45 +CPU= 20.122
  20:31:38 STEP 1260 H= 315:00 +CPU= 25.258
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001260
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001260
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001260
  20:32:11 STEP 1261 H= 315:15 +CPU= 20.234
  20:32:45 STEP 1262 H= 315:30 +CPU= 20.121
  20:33:19 STEP 1263 H= 315:45 +CPU= 20.255
  20:33:54 STEP 1264 H= 316:00 +CPU= 20.527
  20:34:28 STEP 1265 H= 316:15 +CPU= 20.208
  20:35:00 STEP 1266 H= 316:30 +CPU= 20.169
  20:35:34 STEP 1267 H= 316:45 +CPU= 20.137
  20:36:09 STEP 1268 H= 317:00 +CPU= 20.597
  20:36:42 STEP 1269 H= 317:15 +CPU= 20.096
  20:37:16 STEP 1270 H= 317:30 +CPU= 20.144
  20:37:49 STEP 1271 H= 317:45 +CPU= 20.063
  20:38:31 STEP 1272 H= 318:00 +CPU= 25.112
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001272
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001272
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001272
  20:39:05 STEP 1273 H= 318:15 +CPU= 20.122
  20:39:38 STEP 1274 H= 318:30 +CPU= 20.010
  20:40:11 STEP 1275 H= 318:45 +CPU= 20.095
  20:40:46 STEP 1276 H= 319:00 +CPU= 20.440
  20:41:20 STEP 1277 H= 319:15 +CPU= 20.116
  20:41:53 STEP 1278 H= 319:30 +CPU= 20.021
  20:42:26 STEP 1279 H= 319:45 +CPU= 20.087
  20:42:59 STEP 1280 H= 320:00 +CPU= 20.390
  20:43:32 STEP 1281 H= 320:15 +CPU= 20.100
  20:44:05 STEP 1282 H= 320:30 +CPU= 20.094
  20:44:38 STEP 1283 H= 320:45 +CPU= 20.050
  20:45:21 STEP 1284 H= 321:00 +CPU= 25.154
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001284
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001284
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001284
  20:45:54 STEP 1285 H= 321:15 +CPU= 20.170
  20:46:28 STEP 1286 H= 321:30 +CPU= 20.146
  20:47:02 STEP 1287 H= 321:45 +CPU= 20.144
  20:47:36 STEP 1288 H= 322:00 +CPU= 20.452
  20:48:08 STEP 1289 H= 322:15 +CPU= 20.117
  20:48:41 STEP 1290 H= 322:30 +CPU= 20.053
  20:49:15 STEP 1291 H= 322:45 +CPU= 20.169
  20:49:47 STEP 1292 H= 323:00 +CPU= 20.396
  20:50:21 STEP 1293 H= 323:15 +CPU= 20.125
  20:50:54 STEP 1294 H= 323:30 +CPU= 20.148
  20:51:28 STEP 1295 H= 323:45 +CPU= 20.177
  20:52:15 STEP 1296 H= 324:00 +CPU= 27.834
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001296
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001296
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001296
  20:52:48 STEP 1297 H= 324:15 +CPU= 20.022
  20:53:21 STEP 1298 H= 324:30 +CPU= 20.112
  20:53:53 STEP 1299 H= 324:45 +CPU= 20.058
  20:54:27 STEP 1300 H= 325:00 +CPU= 20.440
  20:55:01 STEP 1301 H= 325:15 +CPU= 20.107
  20:55:34 STEP 1302 H= 325:30 +CPU= 20.045
  20:56:09 STEP 1303 H= 325:45 +CPU= 20.444
  20:56:43 STEP 1304 H= 326:00 +CPU= 20.485
  20:57:17 STEP 1305 H= 326:15 +CPU= 20.208
  20:57:50 STEP 1306 H= 326:30 +CPU= 20.064
  20:58:24 STEP 1307 H= 326:45 +CPU= 20.145
  20:59:05 STEP 1308 H= 327:00 +CPU= 25.160
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001308
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001308
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001308
  20:59:40 STEP 1309 H= 327:15 +CPU= 20.041
  21:00:14 STEP 1310 H= 327:30 +CPU= 20.179
  21:00:46 STEP 1311 H= 327:45 +CPU= 20.060
  21:01:20 STEP 1312 H= 328:00 +CPU= 20.531
  21:01:53 STEP 1313 H= 328:15 +CPU= 20.008
  21:02:26 STEP 1314 H= 328:30 +CPU= 20.115
  21:03:00 STEP 1315 H= 328:45 +CPU= 20.047
  21:03:34 STEP 1316 H= 329:00 +CPU= 20.478
  21:04:07 STEP 1317 H= 329:15 +CPU= 20.146
  21:04:39 STEP 1318 H= 329:30 +CPU= 20.029
  21:05:12 STEP 1319 H= 329:45 +CPU= 20.103
  21:05:55 STEP 1320 H= 330:00 +CPU= 25.136
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001320
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001320
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001320
  21:06:29 STEP 1321 H= 330:15 +CPU= 20.157
  21:07:03 STEP 1322 H= 330:30 +CPU= 20.147
  21:07:35 STEP 1323 H= 330:45 +CPU= 20.041
  21:08:08 STEP 1324 H= 331:00 +CPU= 20.464
  21:08:41 STEP 1325 H= 331:15 +CPU= 20.061
  21:09:15 STEP 1326 H= 331:30 +CPU= 20.158
  21:09:48 STEP 1327 H= 331:45 +CPU= 20.055
  21:10:23 STEP 1328 H= 332:00 +CPU= 20.706
  21:10:57 STEP 1329 H= 332:15 +CPU= 20.298
  21:11:31 STEP 1330 H= 332:30 +CPU= 20.207
  21:12:03 STEP 1331 H= 332:45 +CPU= 20.161
  21:12:45 STEP 1332 H= 333:00 +CPU= 25.028
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001332
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001332
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001332
  21:13:18 STEP 1333 H= 333:15 +CPU= 20.151
  21:13:51 STEP 1334 H= 333:30 +CPU= 20.056
  21:14:24 STEP 1335 H= 333:45 +CPU= 20.126
  21:14:56 STEP 1336 H= 334:00 +CPU= 20.413
  21:15:31 STEP 1337 H= 334:15 +CPU= 20.222
  21:16:05 STEP 1338 H= 334:30 +CPU= 20.236
  21:16:38 STEP 1339 H= 334:45 +CPU= 20.073
  21:17:12 STEP 1340 H= 335:00 +CPU= 20.555
  21:17:46 STEP 1341 H= 335:15 +CPU= 20.093
  21:18:18 STEP 1342 H= 335:30 +CPU= 20.145
  21:18:51 STEP 1343 H= 335:45 +CPU= 20.121
  21:19:38 STEP 1344 H= 336:00 +CPU= 27.965
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001344
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001344
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001344
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001248
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001248
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001248
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001260
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001260
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001260
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001272
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001272
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001272
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001284
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001284
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001284
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001296
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001296
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001296
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001308
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001308
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001308
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001320
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001320
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001320
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001332
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001332
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001332
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0_r892480466_13.zip
Uploading the intermediate file: upload_file_13.zip
  21:20:16 STEP 1345 H= 336:15 +CPU= 20.581
  21:20:50 STEP 1346 H= 336:30 +CPU= 20.328
  21:21:25 STEP 1347 H= 336:45 +CPU= 20.237
  21:21:58 STEP 1348 H= 337:00 +CPU= 20.433
  21:22:31 STEP 1349 H= 337:15 +CPU= 20.134
  21:23:03 STEP 1350 H= 337:30 +CPU= 20.119
  21:23:37 STEP 1351 H= 337:45 +CPU= 20.119
  21:24:11 STEP 1352 H= 338:00 +CPU= 20.541
  21:24:44 STEP 1353 H= 338:15 +CPU= 20.053
  21:25:18 STEP 1354 H= 338:30 +CPU= 20.168
  21:25:51 STEP 1355 H= 338:45 +CPU= 20.169
  21:26:34 STEP 1356 H= 339:00 +CPU= 25.194
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001356
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001356
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001356
  21:27:07 STEP 1357 H= 339:15 +CPU= 20.181
  21:27:41 STEP 1358 H= 339:30 +CPU= 20.102
  21:28:14 STEP 1359 H= 339:45 +CPU= 20.168
  21:28:47 STEP 1360 H= 340:00 +CPU= 20.463
  21:29:20 STEP 1361 H= 340:15 +CPU= 20.212
  21:29:53 STEP 1362 H= 340:30 +CPU= 20.090
  21:30:26 STEP 1363 H= 340:45 +CPU= 20.126
  21:31:00 STEP 1364 H= 341:00 +CPU= 20.500
  21:31:34 STEP 1365 H= 341:15 +CPU= 20.245
  21:32:07 STEP 1366 H= 341:30 +CPU= 20.172
  21:32:40 STEP 1367 H= 341:45 +CPU= 20.122
  21:33:22 STEP 1368 H= 342:00 +CPU= 25.084
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001368
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001368
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001368
  21:33:55 STEP 1369 H= 342:15 +CPU= 20.087
  21:34:28 STEP 1370 H= 342:30 +CPU= 20.177
  21:35:01 STEP 1371 H= 342:45 +CPU= 20.114
  21:35:35 STEP 1372 H= 343:00 +CPU= 20.493
  21:36:09 STEP 1373 H= 343:15 +CPU= 20.263
  21:36:41 STEP 1374 H= 343:30 +CPU= 20.090
  21:37:15 STEP 1375 H= 343:45 +CPU= 20.187
  21:37:48 STEP 1376 H= 344:00 +CPU= 20.460
  21:38:21 STEP 1377 H= 344:15 +CPU= 20.145
  21:38:54 STEP 1378 H= 344:30 +CPU= 20.058
  21:39:28 STEP 1379 H= 344:45 +CPU= 20.184
  21:40:09 STEP 1380 H= 345:00 +CPU= 25.158
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001380
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001380
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001380
  21:40:42 STEP 1381 H= 345:15 +CPU= 20.041
  21:41:16 STEP 1382 H= 345:30 +CPU= 20.271
  21:41:49 STEP 1383 H= 345:45 +CPU= 20.152
  21:42:22 STEP 1384 H= 346:00 +CPU= 20.494
  21:42:55 STEP 1385 H= 346:15 +CPU= 20.062
  21:43:30 STEP 1386 H= 346:30 +CPU= 20.197
  21:44:02 STEP 1387 H= 346:45 +CPU= 20.162
  21:44:36 STEP 1388 H= 347:00 +CPU= 20.471
  21:45:08 STEP 1389 H= 347:15 +CPU= 20.161
  21:45:41 STEP 1390 H= 347:30 +CPU= 20.050
  21:46:15 STEP 1391 H= 347:45 +CPU= 20.292
  21:47:01 STEP 1392 H= 348:00 +CPU= 27.933
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001392
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001392
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001392
  21:47:33 STEP 1393 H= 348:15 +CPU= 20.070
  21:48:06 STEP 1394 H= 348:30 +CPU= 20.155
  21:48:38 STEP 1395 H= 348:45 +CPU= 20.046
  21:49:12 STEP 1396 H= 349:00 +CPU= 20.542
  21:49:45 STEP 1397 H= 349:15 +CPU= 20.033
  21:50:18 STEP 1398 H= 349:30 +CPU= 20.133
  21:50:52 STEP 1399 H= 349:45 +CPU= 20.090
  21:51:26 STEP 1400 H= 350:00 +CPU= 20.643
  21:52:00 STEP 1401 H= 350:15 +CPU= 20.109
  21:52:33 STEP 1402 H= 350:30 +CPU= 20.145
  21:53:06 STEP 1403 H= 350:45 +CPU= 20.130
  21:53:47 STEP 1404 H= 351:00 +CPU= 25.047
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001404
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001404
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001404
  21:54:21 STEP 1405 H= 351:15 +CPU= 20.173
  21:54:53 STEP 1406 H= 351:30 +CPU= 20.029
  21:55:26 STEP 1407 H= 351:45 +CPU= 20.107
  21:55:59 STEP 1408 H= 352:00 +CPU= 20.426
  21:56:32 STEP 1409 H= 352:15 +CPU= 20.095
  21:57:05 STEP 1410 H= 352:30 +CPU= 20.108
  21:57:38 STEP 1411 H= 352:45 +CPU= 20.063
  21:58:11 STEP 1412 H= 353:00 +CPU= 20.447
  21:58:43 STEP 1413 H= 353:15 +CPU= 20.004
  21:59:17 STEP 1414 H= 353:30 +CPU= 20.136
  21:59:49 STEP 1415 H= 353:45 +CPU= 20.023
  22:00:32 STEP 1416 H= 354:00 +CPU= 25.171
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001416
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001416
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001416
  22:01:05 STEP 1417 H= 354:15 +CPU= 20.180
  22:01:38 STEP 1418 H= 354:30 +CPU= 20.036
  22:02:12 STEP 1419 H= 354:45 +CPU= 20.096
  22:02:45 STEP 1420 H= 355:00 +CPU= 20.417
  22:03:18 STEP 1421 H= 355:15 +CPU= 20.085
  22:03:51 STEP 1422 H= 355:30 +CPU= 20.003
  22:04:24 STEP 1423 H= 355:45 +CPU= 20.057
  22:04:58 STEP 1424 H= 356:00 +CPU= 20.394
  22:05:31 STEP 1425 H= 356:15 +CPU= 20.243
  22:06:06 STEP 1426 H= 356:30 +CPU= 20.372
  22:06:40 STEP 1427 H= 356:45 +CPU= 20.048
  22:07:23 STEP 1428 H= 357:00 +CPU= 25.211
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001428
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001428
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001428
  22:07:56 STEP 1429 H= 357:15 +CPU= 20.120
  22:08:30 STEP 1430 H= 357:30 +CPU= 20.260
  22:09:02 STEP 1431 H= 357:45 +CPU= 20.121
  22:09:36 STEP 1432 H= 358:00 +CPU= 20.487
  22:10:08 STEP 1433 H= 358:15 +CPU= 20.176
  22:10:41 STEP 1434 H= 358:30 +CPU= 20.121
  22:11:14 STEP 1435 H= 358:45 +CPU= 20.277
  22:11:48 STEP 1436 H= 359:00 +CPU= 20.444
  22:12:22 STEP 1437 H= 359:15 +CPU= 20.150
  22:12:54 STEP 1438 H= 359:30 +CPU= 20.097
  22:13:27 STEP 1439 H= 359:45 +CPU= 20.184
  22:14:13 STEP 1440 H= 360:00 +CPU= 28.008
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001440
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001440
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001440
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001344
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001344
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001344
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001356
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001356
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001356
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001368
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001368
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001368
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001380
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001380
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001380
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001392
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001392
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001392
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001404
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001404
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001404
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001416
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001416
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001416
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001428
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001428
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001428
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0_r892480466_14.zip
Uploading the intermediate file: upload_file_14.zip
  22:14:44 STEP 1441 H= 360:15 +CPU= 21.022
  22:15:20 STEP 1442 H= 360:30 +CPU= 20.328
  22:15:53 STEP 1443 H= 360:45 +CPU= 20.131
  22:16:28 STEP 1444 H= 361:00 +CPU= 20.695
  22:17:00 STEP 1445 H= 361:15 +CPU= 20.148
  22:17:34 STEP 1446 H= 361:30 +CPU= 20.215
  22:18:07 STEP 1447 H= 361:45 +CPU= 20.262
  22:18:41 STEP 1448 H= 362:00 +CPU= 20.521
  22:19:15 STEP 1449 H= 362:15 +CPU= 20.219
  22:19:48 STEP 1450 H= 362:30 +CPU= 20.142
  22:20:21 STEP 1451 H= 362:45 +CPU= 20.185
  22:21:02 STEP 1452 H= 363:00 +CPU= 25.201
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001452
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001452
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001452
  22:21:36 STEP 1453 H= 363:15 +CPU= 20.166
  22:22:10 STEP 1454 H= 363:30 +CPU= 20.091
  22:22:42 STEP 1455 H= 363:45 +CPU= 20.036
  22:23:15 STEP 1456 H= 364:00 +CPU= 20.492
  22:23:48 STEP 1457 H= 364:15 +CPU= 20.079
  22:24:21 STEP 1458 H= 364:30 +CPU= 20.114
  22:24:54 STEP 1459 H= 364:45 +CPU= 20.088
  22:25:26 STEP 1460 H= 365:00 +CPU= 20.451
  22:25:59 STEP 1461 H= 365:15 +CPU= 20.060
  22:26:33 STEP 1462 H= 365:30 +CPU= 20.237
  22:27:07 STEP 1463 H= 365:45 +CPU= 20.134
  22:27:48 STEP 1464 H= 366:00 +CPU= 25.175
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001464
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001464
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001464
  22:28:22 STEP 1465 H= 366:15 +CPU= 20.110
  22:28:54 STEP 1466 H= 366:30 +CPU= 20.099
  22:29:26 STEP 1467 H= 366:45 +CPU= 20.299
  22:30:00 STEP 1468 H= 367:00 +CPU= 20.472
  22:30:32 STEP 1469 H= 367:15 +CPU= 20.166
  22:31:05 STEP 1470 H= 367:30 +CPU= 20.272
  22:31:39 STEP 1471 H= 367:45 +CPU= 20.231
  22:32:13 STEP 1472 H= 368:00 +CPU= 20.552
  22:32:45 STEP 1473 H= 368:15 +CPU= 20.187
  22:33:19 STEP 1474 H= 368:30 +CPU= 20.196
  22:33:51 STEP 1475 H= 368:45 +CPU= 20.098
  22:34:33 STEP 1476 H= 369:00 +CPU= 25.221
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001476
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001476
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001476
  22:35:07 STEP 1477 H= 369:15 +CPU= 20.133
  22:35:40 STEP 1478 H= 369:30 +CPU= 20.102
  22:36:13 STEP 1479 H= 369:45 +CPU= 20.263
  22:36:47 STEP 1480 H= 370:00 +CPU= 20.442
  22:37:19 STEP 1481 H= 370:15 +CPU= 20.160
  22:37:51 STEP 1482 H= 370:30 +CPU= 20.093
  22:38:24 STEP 1483 H= 370:45 +CPU= 20.167
  22:38:58 STEP 1484 H= 371:00 +CPU= 20.495
  22:39:33 STEP 1485 H= 371:15 +CPU= 20.266
  22:40:07 STEP 1486 H= 371:30 +CPU= 20.220
  22:40:40 STEP 1487 H= 371:45 +CPU= 20.129
  22:41:27 STEP 1488 H= 372:00 +CPU= 27.937
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001488
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001488
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001488
  22:41:58 STEP 1489 H= 372:15 +CPU= 20.036
  22:42:34 STEP 1490 H= 372:30 +CPU= 20.218
  22:43:07 STEP 1491 H= 372:45 +CPU= 20.154
  22:43:40 STEP 1492 H= 373:00 +CPU= 20.458
  22:44:13 STEP 1493 H= 373:15 +CPU= 20.144
  22:44:47 STEP 1494 H= 373:30 +CPU= 20.160
  22:45:20 STEP 1495 H= 373:45 +CPU= 20.187
  22:45:53 STEP 1496 H= 374:00 +CPU= 20.430
  22:46:27 STEP 1497 H= 374:15 +CPU= 20.305
  22:46:59 STEP 1498 H= 374:30 +CPU= 20.084
  22:47:32 STEP 1499 H= 374:45 +CPU= 20.170
  22:48:14 STEP 1500 H= 375:00 +CPU= 25.139
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001500
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001500
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001500
  22:48:46 STEP 1501 H= 375:15 +CPU= 20.061
  22:49:19 STEP 1502 H= 375:30 +CPU= 20.105
  22:49:53 STEP 1503 H= 375:45 +CPU= 20.066
  22:50:27 STEP 1504 H= 376:00 +CPU= 20.530
  22:50:59 STEP 1505 H= 376:15 +CPU= 20.029
  22:51:33 STEP 1506 H= 376:30 +CPU= 20.221
  22:52:06 STEP 1507 H= 376:45 +CPU= 20.113
  22:52:40 STEP 1508 H= 377:00 +CPU= 20.473
  22:53:13 STEP 1509 H= 377:15 +CPU= 20.136
  22:53:45 STEP 1510 H= 377:30 +CPU= 20.047
  22:54:18 STEP 1511 H= 377:45 +CPU= 20.187
  22:55:00 STEP 1512 H= 378:00 +CPU= 25.154
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001512
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001512
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001512
  22:55:33 STEP 1513 H= 378:15 +CPU= 20.167
  22:56:06 STEP 1514 H= 378:30 +CPU= 20.132
  22:56:39 STEP 1515 H= 378:45 +CPU= 20.253
  22:57:13 STEP 1516 H= 379:00 +CPU= 20.612
  22:57:46 STEP 1517 H= 379:15 +CPU= 20.083
  22:58:20 STEP 1518 H= 379:30 +CPU= 20.204
  22:58:52 STEP 1519 H= 379:45 +CPU= 20.039
  22:59:29 STEP 1520 H= 380:00 +CPU= 20.587
  23:00:01 STEP 1521 H= 380:15 +CPU= 20.163
  23:00:35 STEP 1522 H= 380:30 +CPU= 20.159
  23:01:09 STEP 1523 H= 380:45 +CPU= 20.210
  23:01:50 STEP 1524 H= 381:00 +CPU= 25.187
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001524
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001524
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001524
  23:02:25 STEP 1525 H= 381:15 +CPU= 20.182
  23:02:57 STEP 1526 H= 381:30 +CPU= 20.122
  23:03:30 STEP 1527 H= 381:45 +CPU= 20.166
  23:04:04 STEP 1528 H= 382:00 +CPU= 20.535
  23:04:36 STEP 1529 H= 382:15 +CPU= 20.104
  23:05:08 STEP 1530 H= 382:30 +CPU= 20.173
  23:05:42 STEP 1531 H= 382:45 +CPU= 20.179
  23:06:18 STEP 1532 H= 383:00 +CPU= 20.723
  23:06:51 STEP 1533 H= 383:15 +CPU= 20.270
  23:07:24 STEP 1534 H= 383:30 +CPU= 20.216
  23:07:57 STEP 1535 H= 383:45 +CPU= 20.180
  23:08:43 STEP 1536 H= 384:00 +CPU= 27.912
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001536
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001536
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001536
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001440
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001440
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001440
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001452
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001452
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001452
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001464
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001464
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001464
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001476
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001476
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001476
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001488
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001488
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001488
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001500
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001500
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001500
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001512
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001512
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001512
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001524
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001524
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001524
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0_r892480466_15.zip
Uploading the intermediate file: upload_file_15.zip
  23:09:16 STEP 1537 H= 384:15 +CPU= 21.097
  23:09:49 STEP 1538 H= 384:30 +CPU= 20.208
  23:10:23 STEP 1539 H= 384:45 +CPU= 20.259
  23:10:57 STEP 1540 H= 385:00 +CPU= 20.505
  23:11:31 STEP 1541 H= 385:15 +CPU= 20.354
  23:12:04 STEP 1542 H= 385:30 +CPU= 20.251
  23:12:37 STEP 1543 H= 385:45 +CPU= 20.185
  23:13:12 STEP 1544 H= 386:00 +CPU= 20.588
  23:13:45 STEP 1545 H= 386:15 +CPU= 20.181
  23:14:16 STEP 1546 H= 386:30 +CPU= 20.189
  23:14:51 STEP 1547 H= 386:45 +CPU= 20.157
  23:15:35 STEP 1548 H= 387:00 +CPU= 25.382
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001548
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001548
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001548
  23:16:08 STEP 1549 H= 387:15 +CPU= 20.267
  23:16:43 STEP 1550 H= 387:30 +CPU= 20.280
  23:17:17 STEP 1551 H= 387:45 +CPU= 20.188
  23:17:51 STEP 1552 H= 388:00 +CPU= 20.529
  23:18:25 STEP 1553 H= 388:15 +CPU= 20.298
  23:18:58 STEP 1554 H= 388:30 +CPU= 20.100
  23:19:32 STEP 1555 H= 388:45 +CPU= 20.302
  23:20:06 STEP 1556 H= 389:00 +CPU= 20.580
  23:20:40 STEP 1557 H= 389:15 +CPU= 20.226
  23:21:12 STEP 1558 H= 389:30 +CPU= 20.174
  23:21:47 STEP 1559 H= 389:45 +CPU= 20.333
  23:22:29 STEP 1560 H= 390:00 +CPU= 25.143
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001560
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001560
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001560
  23:23:02 STEP 1561 H= 390:15 +CPU= 20.178
  23:23:34 STEP 1562 H= 390:30 +CPU= 20.064
  23:24:08 STEP 1563 H= 390:45 +CPU= 20.139
  23:24:43 STEP 1564 H= 391:00 +CPU= 20.479
  23:25:15 STEP 1565 H= 391:15 +CPU= 20.159
  23:25:49 STEP 1566 H= 391:30 +CPU= 20.100
  23:26:23 STEP 1567 H= 391:45 +CPU= 20.218
  23:26:56 STEP 1568 H= 392:00 +CPU= 20.495
  23:27:30 STEP 1569 H= 392:15 +CPU= 20.227
  23:28:03 STEP 1570 H= 392:30 +CPU= 20.137
  23:28:37 STEP 1571 H= 392:45 +CPU= 20.121
  23:29:18 STEP 1572 H= 393:00 +CPU= 25.151
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001572
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001572
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001572
  23:29:51 STEP 1573 H= 393:15 +CPU= 20.207
  23:30:24 STEP 1574 H= 393:30 +CPU= 20.133
  23:30:57 STEP 1575 H= 393:45 +CPU= 20.069
  23:31:32 STEP 1576 H= 394:00 +CPU= 20.680
  23:32:05 STEP 1577 H= 394:15 +CPU= 20.235
  23:32:39 STEP 1578 H= 394:30 +CPU= 20.118
  23:33:13 STEP 1579 H= 394:45 +CPU= 20.129
  23:33:47 STEP 1580 H= 395:00 +CPU= 20.510
  23:34:19 STEP 1581 H= 395:15 +CPU= 20.146
  23:34:53 STEP 1582 H= 395:30 +CPU= 20.095
  23:35:26 STEP 1583 H= 395:45 +CPU= 20.143
  23:36:13 STEP 1584 H= 396:00 +CPU= 27.900
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001584
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001584
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001584
  23:36:46 STEP 1585 H= 396:15 +CPU= 20.217
  23:37:20 STEP 1586 H= 396:30 +CPU= 20.206
  23:37:53 STEP 1587 H= 396:45 +CPU= 20.131
  23:38:27 STEP 1588 H= 397:00 +CPU= 20.510
  23:39:00 STEP 1589 H= 397:15 +CPU= 20.105
  23:39:33 STEP 1590 H= 397:30 +CPU= 20.193
  23:40:06 STEP 1591 H= 397:45 +CPU= 20.156
  23:40:40 STEP 1592 H= 398:00 +CPU= 20.446
  23:41:13 STEP 1593 H= 398:15 +CPU= 20.168
  23:41:46 STEP 1594 H= 398:30 +CPU= 20.182
  23:42:20 STEP 1595 H= 398:45 +CPU= 20.206
  23:43:01 STEP 1596 H= 399:00 +CPU= 25.201
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001596
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001596
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001596
  23:43:35 STEP 1597 H= 399:15 +CPU= 20.143
  23:44:08 STEP 1598 H= 399:30 +CPU= 20.167
  23:44:41 STEP 1599 H= 399:45 +CPU= 20.157
  23:45:14 STEP 1600 H= 400:00 +CPU= 20.567
  23:45:47 STEP 1601 H= 400:15 +CPU= 20.113
  23:46:20 STEP 1602 H= 400:30 +CPU= 20.204
  23:46:53 STEP 1603 H= 400:45 +CPU= 20.215
  23:47:27 STEP 1604 H= 401:00 +CPU= 20.591
  23:47:59 STEP 1605 H= 401:15 +CPU= 20.126
  23:48:32 STEP 1606 H= 401:30 +CPU= 20.187
  23:49:05 STEP 1607 H= 401:45 +CPU= 20.150
  23:49:45 STEP 1608 H= 402:00 +CPU= 25.132
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001608
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001608
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001608
  23:50:18 STEP 1609 H= 402:15 +CPU= 20.133
  23:50:51 STEP 1610 H= 402:30 +CPU= 20.087
  23:51:24 STEP 1611 H= 402:45 +CPU= 20.219
  23:51:58 STEP 1612 H= 403:00 +CPU= 20.426
  23:52:31 STEP 1613 H= 403:15 +CPU= 20.152
  23:53:04 STEP 1614 H= 403:30 +CPU= 20.275
  23:53:37 STEP 1615 H= 403:45 +CPU= 20.088
  23:54:11 STEP 1616 H= 404:00 +CPU= 20.496
  23:54:45 STEP 1617 H= 404:15 +CPU= 20.086
  23:55:19 STEP 1618 H= 404:30 +CPU= 20.227
  23:55:52 STEP 1619 H= 404:45 +CPU= 20.191
  23:56:34 STEP 1620 H= 405:00 +CPU= 25.311
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001620
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001620
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001620
  23:57:07 STEP 1621 H= 405:15 +CPU= 20.182
  23:57:41 STEP 1622 H= 405:30 +CPU= 20.101
  23:58:14 STEP 1623 H= 405:45 +CPU= 20.191
  23:58:47 STEP 1624 H= 406:00 +CPU= 20.440
  23:59:20 STEP 1625 H= 406:15 +CPU= 20.135
  23:59:53 STEP 1626 H= 406:30 +CPU= 20.149
  00:00:27 STEP 1627 H= 406:45 +CPU= 20.253
  00:01:01 STEP 1628 H= 407:00 +CPU= 20.514
  00:01:35 STEP 1629 H= 407:15 +CPU= 20.228
  00:02:07 STEP 1630 H= 407:30 +CPU= 20.139
  00:02:40 STEP 1631 H= 407:45 +CPU= 20.080
  00:03:26 STEP 1632 H= 408:00 +CPU= 27.946
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001632
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001632
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001632
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001536
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001536
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001536
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001548
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001548
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001548
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001560
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001560
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001560
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001572
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001572
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001572
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001584
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001584
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001584
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001596
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001596
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001596
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001608
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001608
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001608
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001620
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001620
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001620
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0_r892480466_16.zip
Uploading the intermediate file: upload_file_16.zip
  00:04:05 STEP 1633 H= 408:15 +CPU= 20.830
  00:04:40 STEP 1634 H= 408:30 +CPU= 20.241
  00:05:13 STEP 1635 H= 408:45 +CPU= 20.207
  00:05:47 STEP 1636 H= 409:00 +CPU= 20.536
  00:06:20 STEP 1637 H= 409:15 +CPU= 20.162
  00:06:53 STEP 1638 H= 409:30 +CPU= 20.261
  00:07:26 STEP 1639 H= 409:45 +CPU= 20.179
  00:08:00 STEP 1640 H= 410:00 +CPU= 20.533
  00:08:33 STEP 1641 H= 410:15 +CPU= 20.219
  00:09:07 STEP 1642 H= 410:30 +CPU= 20.236
  00:09:40 STEP 1643 H= 410:45 +CPU= 20.174
  00:10:21 STEP 1644 H= 411:00 +CPU= 25.141
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001644
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001644
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001644
  00:10:55 STEP 1645 H= 411:15 +CPU= 20.082
  00:11:28 STEP 1646 H= 411:30 +CPU= 20.237
  00:12:00 STEP 1647 H= 411:45 +CPU= 20.087
  00:12:34 STEP 1648 H= 412:00 +CPU= 20.481
  00:13:07 STEP 1649 H= 412:15 +CPU= 20.167
  00:13:39 STEP 1650 H= 412:30 +CPU= 20.029
  00:14:12 STEP 1651 H= 412:45 +CPU= 20.173
  00:14:46 STEP 1652 H= 413:00 +CPU= 20.439
  00:15:19 STEP 1653 H= 413:15 +CPU= 20.143
  00:15:52 STEP 1654 H= 413:30 +CPU= 20.069
  00:16:25 STEP 1655 H= 413:45 +CPU= 20.151
  00:17:08 STEP 1656 H= 414:00 +CPU= 25.319
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001656
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001656
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001656
  00:17:41 STEP 1657 H= 414:15 +CPU= 20.092
  00:18:14 STEP 1658 H= 414:30 +CPU= 20.184
  00:18:46 STEP 1659 H= 414:45 +CPU= 20.047
  00:19:20 STEP 1660 H= 415:00 +CPU= 20.520
  00:19:53 STEP 1661 H= 415:15 +CPU= 20.098
  00:20:26 STEP 1662 H= 415:30 +CPU= 20.184
  00:20:58 STEP 1663 H= 415:45 +CPU= 20.081
  00:21:32 STEP 1664 H= 416:00 +CPU= 20.611
  00:22:05 STEP 1665 H= 416:15 +CPU= 20.173
  00:22:39 STEP 1666 H= 416:30 +CPU= 20.098
  00:23:12 STEP 1667 H= 416:45 +CPU= 20.160
  00:23:53 STEP 1668 H= 417:00 +CPU= 25.152
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001668
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001668
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001668
  00:24:27 STEP 1669 H= 417:15 +CPU= 20.160
  00:25:00 STEP 1670 H= 417:30 +CPU= 20.139
  00:25:33 STEP 1671 H= 417:45 +CPU= 20.139
  00:26:06 STEP 1672 H= 418:00 +CPU= 20.540
  00:26:41 STEP 1673 H= 418:15 +CPU= 20.205
  00:27:13 STEP 1674 H= 418:30 +CPU= 20.168
  00:27:46 STEP 1675 H= 418:45 +CPU= 20.086
  00:28:20 STEP 1676 H= 419:00 +CPU= 20.492
  00:28:53 STEP 1677 H= 419:15 +CPU= 20.153
  00:29:26 STEP 1678 H= 419:30 +CPU= 20.273
  00:29:59 STEP 1679 H= 419:45 +CPU= 20.120
  00:30:46 STEP 1680 H= 420:00 +CPU= 28.021
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001680
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001680
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001680
  00:31:20 STEP 1681 H= 420:15 +CPU= 20.168
  00:31:54 STEP 1682 H= 420:30 +CPU= 20.283
  00:32:27 STEP 1683 H= 420:45 +CPU= 20.163
  00:33:01 STEP 1684 H= 421:00 +CPU= 20.499
  00:33:34 STEP 1685 H= 421:15 +CPU= 20.143
  00:34:07 STEP 1686 H= 421:30 +CPU= 20.241
  00:34:40 STEP 1687 H= 421:45 +CPU= 20.111
  00:35:15 STEP 1688 H= 422:00 +CPU= 20.601
  00:35:48 STEP 1689 H= 422:15 +CPU= 20.110
  00:36:22 STEP 1690 H= 422:30 +CPU= 20.154
  00:36:55 STEP 1691 H= 422:45 +CPU= 20.246
  00:37:37 STEP 1692 H= 423:00 +CPU= 25.290
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001692
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001692
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001692
  00:38:10 STEP 1693 H= 423:15 +CPU= 20.258
  00:38:43 STEP 1694 H= 423:30 +CPU= 20.153
  00:39:17 STEP 1695 H= 423:45 +CPU= 20.226
  00:39:51 STEP 1696 H= 424:00 +CPU= 20.512
  00:40:24 STEP 1697 H= 424:15 +CPU= 20.218
  00:40:56 STEP 1698 H= 424:30 +CPU= 20.081
  00:41:29 STEP 1699 H= 424:45 +CPU= 20.224
  00:42:04 STEP 1700 H= 425:00 +CPU= 20.619
  00:42:37 STEP 1701 H= 425:15 +CPU= 20.107
  00:43:11 STEP 1702 H= 425:30 +CPU= 20.258
  00:43:43 STEP 1703 H= 425:45 +CPU= 20.121
  00:44:26 STEP 1704 H= 426:00 +CPU= 25.280
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001704
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001704
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001704
  00:44:59 STEP 1705 H= 426:15 +CPU= 20.208
  00:45:32 STEP 1706 H= 426:30 +CPU= 20.261
  00:46:06 STEP 1707 H= 426:45 +CPU= 20.247
  00:46:39 STEP 1708 H= 427:00 +CPU= 20.645
  00:47:13 STEP 1709 H= 427:15 +CPU= 20.295
  00:47:47 STEP 1710 H= 427:30 +CPU= 20.212
  00:48:20 STEP 1711 H= 427:45 +CPU= 20.244
  00:48:54 STEP 1712 H= 428:00 +CPU= 20.556
  00:49:27 STEP 1713 H= 428:15 +CPU= 20.218
  00:49:59 STEP 1714 H= 428:30 +CPU= 20.191
  00:50:33 STEP 1715 H= 428:45 +CPU= 20.272
  00:51:14 STEP 1716 H= 429:00 +CPU= 25.181
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001716
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001716
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001716
  00:51:47 STEP 1717 H= 429:15 +CPU= 20.272
  00:52:20 STEP 1718 H= 429:30 +CPU= 20.220
  00:52:53 STEP 1719 H= 429:45 +CPU= 20.167
  00:53:27 STEP 1720 H= 430:00 +CPU= 20.598
  00:54:01 STEP 1721 H= 430:15 +CPU= 20.186
  00:54:34 STEP 1722 H= 430:30 +CPU= 20.154
  00:55:07 STEP 1723 H= 430:45 +CPU= 20.249
  00:55:40 STEP 1724 H= 431:00 +CPU= 20.465
  00:56:14 STEP 1725 H= 431:15 +CPU= 20.174
  00:56:48 STEP 1726 H= 431:30 +CPU= 20.245
  00:57:21 STEP 1727 H= 431:45 +CPU= 20.160
  00:58:09 STEP 1728 H= 432:00 +CPU= 27.990
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001728
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001728
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001728
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001632
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001632
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001632
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001644
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001644
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001644
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001656
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001656
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001656
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001668
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001668
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001668
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001680
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001680
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001680
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001692
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001692
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001692
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001704
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001704
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001704
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001716
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001716
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001716
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0_r892480466_17.zip
Uploading the intermediate file: upload_file_17.zip
  00:58:47 STEP 1729 H= 432:15 +CPU= 20.755
  00:59:21 STEP 1730 H= 432:30 +CPU= 20.215
  00:59:54 STEP 1731 H= 432:45 +CPU= 20.162
  01:00:28 STEP 1732 H= 433:00 +CPU= 20.522
  01:01:02 STEP 1733 H= 433:15 +CPU= 20.197
  01:01:36 STEP 1734 H= 433:30 +CPU= 20.127
  01:02:10 STEP 1735 H= 433:45 +CPU= 20.227
  01:02:43 STEP 1736 H= 434:00 +CPU= 20.477
  01:03:16 STEP 1737 H= 434:15 +CPU= 20.182
  01:03:49 STEP 1738 H= 434:30 +CPU= 20.024
  01:04:23 STEP 1739 H= 434:45 +CPU= 20.178
  01:05:04 STEP 1740 H= 435:00 +CPU= 25.184
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001740
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001740
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001740
  01:05:37 STEP 1741 H= 435:15 +CPU= 20.208
  01:06:10 STEP 1742 H= 435:30 +CPU= 20.193
  01:06:43 STEP 1743 H= 435:45 +CPU= 20.258
  01:07:17 STEP 1744 H= 436:00 +CPU= 20.648
  01:07:52 STEP 1745 H= 436:15 +CPU= 20.208
  01:08:23 STEP 1746 H= 436:30 +CPU= 20.120
  01:08:57 STEP 1747 H= 436:45 +CPU= 20.190
  01:09:32 STEP 1748 H= 437:00 +CPU= 20.598
  01:10:05 STEP 1749 H= 437:15 +CPU= 20.260
  01:10:38 STEP 1750 H= 437:30 +CPU= 20.201
  01:11:13 STEP 1751 H= 437:45 +CPU= 20.269
  01:11:55 STEP 1752 H= 438:00 +CPU= 25.229
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001752
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001752
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001752
  01:12:28 STEP 1753 H= 438:15 +CPU= 20.205
  01:13:02 STEP 1754 H= 438:30 +CPU= 20.179
  01:13:35 STEP 1755 H= 438:45 +CPU= 20.089
  01:14:10 STEP 1756 H= 439:00 +CPU= 20.520
  01:14:42 STEP 1757 H= 439:15 +CPU= 20.060
  01:15:15 STEP 1758 H= 439:30 +CPU= 20.174
  01:15:48 STEP 1759 H= 439:45 +CPU= 20.178
  01:16:22 STEP 1760 H= 440:00 +CPU= 20.477
  01:16:55 STEP 1761 H= 440:15 +CPU= 20.244
  01:17:29 STEP 1762 H= 440:30 +CPU= 20.176
  01:18:02 STEP 1763 H= 440:45 +CPU= 20.198
  01:18:44 STEP 1764 H= 441:00 +CPU= 25.075
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001764
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001764
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001764
  01:19:17 STEP 1765 H= 441:15 +CPU= 20.315
  01:19:50 STEP 1766 H= 441:30 +CPU= 20.107
  01:20:25 STEP 1767 H= 441:45 +CPU= 20.282
  01:20:59 STEP 1768 H= 442:00 +CPU= 20.556
  01:21:32 STEP 1769 H= 442:15 +CPU= 20.219
  01:22:07 STEP 1770 H= 442:30 +CPU= 20.403
  01:22:40 STEP 1771 H= 442:45 +CPU= 20.161
  01:23:15 STEP 1772 H= 443:00 +CPU= 20.692
  01:23:48 STEP 1773 H= 443:15 +CPU= 20.209
  01:24:22 STEP 1774 H= 443:30 +CPU= 20.270
  01:24:56 STEP 1775 H= 443:45 +CPU= 20.244
  01:25:42 STEP 1776 H= 444:00 +CPU= 28.014
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001776
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001776
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001776
  01:26:16 STEP 1777 H= 444:15 +CPU= 20.335
  01:26:49 STEP 1778 H= 444:30 +CPU= 20.340
  01:27:24 STEP 1779 H= 444:45 +CPU= 20.270
  01:27:57 STEP 1780 H= 445:00 +CPU= 20.624
  01:28:30 STEP 1781 H= 445:15 +CPU= 20.287
  01:29:04 STEP 1782 H= 445:30 +CPU= 20.305
  01:29:38 STEP 1783 H= 445:45 +CPU= 20.157
  01:30:13 STEP 1784 H= 446:00 +CPU= 20.679
  01:30:46 STEP 1785 H= 446:15 +CPU= 20.188
  01:31:19 STEP 1786 H= 446:30 +CPU= 20.295
  01:31:53 STEP 1787 H= 446:45 +CPU= 20.319
  01:32:35 STEP 1788 H= 447:00 +CPU= 25.322
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001788
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001788
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001788
  01:33:07 STEP 1789 H= 447:15 +CPU= 20.231
  01:33:41 STEP 1790 H= 447:30 +CPU= 20.206
  01:34:15 STEP 1791 H= 447:45 +CPU= 20.256
  01:34:49 STEP 1792 H= 448:00 +CPU= 20.577
  01:35:22 STEP 1793 H= 448:15 +CPU= 20.249
  01:35:56 STEP 1794 H= 448:30 +CPU= 20.206
  01:36:29 STEP 1795 H= 448:45 +CPU= 20.273
  01:37:05 STEP 1796 H= 449:00 +CPU= 20.724
  01:37:38 STEP 1797 H= 449:15 +CPU= 20.175
  01:38:11 STEP 1798 H= 449:30 +CPU= 20.310
  01:38:44 STEP 1799 H= 449:45 +CPU= 20.180
  01:39:26 STEP 1800 H= 450:00 +CPU= 25.264
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001800
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001800
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001800
  01:40:00 STEP 1801 H= 450:15 +CPU= 20.241
  01:40:34 STEP 1802 H= 450:30 +CPU= 20.210
  01:41:07 STEP 1803 H= 450:45 +CPU= 20.301
  01:41:41 STEP 1804 H= 451:00 +CPU= 20.503
  01:42:16 STEP 1805 H= 451:15 +CPU= 20.395
  01:42:49 STEP 1806 H= 451:30 +CPU= 20.145
  01:43:24 STEP 1807 H= 451:45 +CPU= 20.353
  01:43:57 STEP 1808 H= 452:00 +CPU= 20.520
  01:44:31 STEP 1809 H= 452:15 +CPU= 20.273
  01:45:06 STEP 1810 H= 452:30 +CPU= 20.409
  01:45:39 STEP 1811 H= 452:45 +CPU= 20.144
  01:46:22 STEP 1812 H= 453:00 +CPU= 25.359
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001812
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001812
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001812
  01:46:56 STEP 1813 H= 453:15 +CPU= 20.357
  01:47:29 STEP 1814 H= 453:30 +CPU= 20.232
  01:48:03 STEP 1815 H= 453:45 +CPU= 20.288
  01:48:36 STEP 1816 H= 454:00 +CPU= 20.579
  01:49:10 STEP 1817 H= 454:15 +CPU= 20.254
  01:49:44 STEP 1818 H= 454:30 +CPU= 20.189
  01:50:18 STEP 1819 H= 454:45 +CPU= 20.271
  01:50:52 STEP 1820 H= 455:00 +CPU= 20.517
  01:51:24 STEP 1821 H= 455:15 +CPU= 20.183
  01:51:58 STEP 1822 H= 455:30 +CPU= 20.338
  01:52:32 STEP 1823 H= 455:45 +CPU= 20.230
  01:53:20 STEP 1824 H= 456:00 +CPU= 28.024
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001824
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001824
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001824
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001728
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001728
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001728
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001740
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001740
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001740
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001752
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001752
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001752
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001764
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001764
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001764
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001776
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001776
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001776
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001788
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001788
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001788
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001800
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001800
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001800
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001812
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001812
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001812
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0_r892480466_18.zip
Uploading the intermediate file: upload_file_18.zip
  01:53:51 STEP 1825 H= 456:15 +CPU= 20.963
  01:54:28 STEP 1826 H= 456:30 +CPU= 20.389
  01:55:02 STEP 1827 H= 456:45 +CPU= 20.242
  01:55:36 STEP 1828 H= 457:00 +CPU= 20.515
  01:56:09 STEP 1829 H= 457:15 +CPU= 20.232
  01:56:44 STEP 1830 H= 457:30 +CPU= 20.191
  01:57:17 STEP 1831 H= 457:45 +CPU= 20.372
  01:57:52 STEP 1832 H= 458:00 +CPU= 20.579
  01:58:26 STEP 1833 H= 458:15 +CPU= 20.335
  01:59:00 STEP 1834 H= 458:30 +CPU= 20.181
  01:59:35 STEP 1835 H= 458:45 +CPU= 20.295
  02:00:18 STEP 1836 H= 459:00 +CPU= 25.343
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001836
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001836
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001836
  02:00:50 STEP 1837 H= 459:15 +CPU= 20.188
  02:01:24 STEP 1838 H= 459:30 +CPU= 20.318
  02:01:57 STEP 1839 H= 459:45 +CPU= 20.300
  02:02:31 STEP 1840 H= 460:00 +CPU= 20.599
  02:03:04 STEP 1841 H= 460:15 +CPU= 20.345
  02:03:38 STEP 1842 H= 460:30 +CPU= 20.246
  02:04:12 STEP 1843 H= 460:45 +CPU= 20.263
  02:04:45 STEP 1844 H= 461:00 +CPU= 20.594
  02:05:19 STEP 1845 H= 461:15 +CPU= 20.399
  02:05:52 STEP 1846 H= 461:30 +CPU= 20.216
  02:06:26 STEP 1847 H= 461:45 +CPU= 20.298
  02:07:08 STEP 1848 H= 462:00 +CPU= 25.379
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001848
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001848
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001848
  02:07:42 STEP 1849 H= 462:15 +CPU= 20.259
  02:08:16 STEP 1850 H= 462:30 +CPU= 20.264
  02:08:50 STEP 1851 H= 462:45 +CPU= 20.184
  02:09:24 STEP 1852 H= 463:00 +CPU= 20.616
  02:09:56 STEP 1853 H= 463:15 +CPU= 20.205
  02:10:30 STEP 1854 H= 463:30 +CPU= 20.242
  02:11:04 STEP 1855 H= 463:45 +CPU= 20.234
  02:11:37 STEP 1856 H= 464:00 +CPU= 20.552
  02:12:12 STEP 1857 H= 464:15 +CPU= 20.396
  02:12:46 STEP 1858 H= 464:30 +CPU= 20.273
  02:13:20 STEP 1859 H= 464:45 +CPU= 20.248
  02:14:03 STEP 1860 H= 465:00 +CPU= 25.315
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001860
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001860
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001860
  02:14:36 STEP 1861 H= 465:15 +CPU= 20.237
  02:15:10 STEP 1862 H= 465:30 +CPU= 20.262
  02:15:44 STEP 1863 H= 465:45 +CPU= 20.231
  02:16:19 STEP 1864 H= 466:00 +CPU= 20.662
  02:16:52 STEP 1865 H= 466:15 +CPU= 20.281
  02:17:25 STEP 1866 H= 466:30 +CPU= 20.273
  02:17:58 STEP 1867 H= 466:45 +CPU= 20.248
  02:18:33 STEP 1868 H= 467:00 +CPU= 20.661
  02:19:06 STEP 1869 H= 467:15 +CPU= 20.343
  02:19:40 STEP 1870 H= 467:30 +CPU= 20.264
  02:20:14 STEP 1871 H= 467:45 +CPU= 20.395
  02:20:58 STEP 1872 H= 468:00 +CPU= 27.944
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001872
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001872
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001872
  02:21:31 STEP 1873 H= 468:15 +CPU= 20.228
  02:22:06 STEP 1874 H= 468:30 +CPU= 20.379
  02:22:40 STEP 1875 H= 468:45 +CPU= 20.250
  02:23:15 STEP 1876 H= 469:00 +CPU= 20.695
  02:23:50 STEP 1877 H= 469:15 +CPU= 20.277
  02:24:22 STEP 1878 H= 469:30 +CPU= 20.246
  02:24:54 STEP 1879 H= 469:45 +CPU= 20.232
  02:25:29 STEP 1880 H= 470:00 +CPU= 20.726
  02:26:02 STEP 1881 H= 470:15 +CPU= 20.279
  02:26:36 STEP 1882 H= 470:30 +CPU= 20.298
  02:27:11 STEP 1883 H= 470:45 +CPU= 20.400
  02:27:54 STEP 1884 H= 471:00 +CPU= 25.261
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001884
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001884
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001884
  02:28:28 STEP 1885 H= 471:15 +CPU= 20.395
  02:29:01 STEP 1886 H= 471:30 +CPU= 20.308
  02:29:34 STEP 1887 H= 471:45 +CPU= 20.206
  02:30:09 STEP 1888 H= 472:00 +CPU= 20.642
  02:30:41 STEP 1889 H= 472:15 +CPU= 20.184
  02:31:16 STEP 1890 H= 472:30 +CPU= 20.299
  02:31:50 STEP 1891 H= 472:45 +CPU= 20.281
  02:32:23 STEP 1892 H= 473:00 +CPU= 20.683
  02:32:57 STEP 1893 H= 473:15 +CPU= 20.303
  02:33:31 STEP 1894 H= 473:30 +CPU= 20.255
  02:34:05 STEP 1895 H= 473:45 +CPU= 20.328
  02:34:46 STEP 1896 H= 474:00 +CPU= 25.282
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001896
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001896
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001896
  02:35:21 STEP 1897 H= 474:15 +CPU= 20.342
  02:35:54 STEP 1898 H= 474:30 +CPU= 20.197
  02:36:27 STEP 1899 H= 474:45 +CPU= 20.302
  02:37:01 STEP 1900 H= 475:00 +CPU= 20.701
  02:37:35 STEP 1901 H= 475:15 +CPU= 20.188
  02:38:09 STEP 1902 H= 475:30 +CPU= 20.290
  02:38:43 STEP 1903 H= 475:45 +CPU= 20.213
  02:39:18 STEP 1904 H= 476:00 +CPU= 20.638
  02:39:51 STEP 1905 H= 476:15 +CPU= 20.183
  02:40:25 STEP 1906 H= 476:30 +CPU= 20.224
  02:41:00 STEP 1907 H= 476:45 +CPU= 20.246
  02:41:42 STEP 1908 H= 477:00 +CPU= 25.293
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001908
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001908
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001908
  02:42:17 STEP 1909 H= 477:15 +CPU= 20.416
  02:42:52 STEP 1910 H= 477:30 +CPU= 20.295
  02:43:26 STEP 1911 H= 477:45 +CPU= 20.315
  02:43:59 STEP 1912 H= 478:00 +CPU= 20.568
  02:44:33 STEP 1913 H= 478:15 +CPU= 20.379
  02:45:07 STEP 1914 H= 478:30 +CPU= 20.344
  02:45:40 STEP 1915 H= 478:45 +CPU= 20.268
  02:46:14 STEP 1916 H= 479:00 +CPU= 20.687
  02:46:47 STEP 1917 H= 479:15 +CPU= 20.278
  02:47:22 STEP 1918 H= 479:30 +CPU= 20.430
  02:47:56 STEP 1919 H= 479:45 +CPU= 20.273
  02:48:40 STEP 1920 H= 480:00 +CPU= 26.109
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.2793505145E-21      I       0.3342976985E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1194599535E-01      I
I  Relat. Hum. I      0.3281243835E+00      I       0.3571001856E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1030457861E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    303259396 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS505432.3 Mbytes/s, TOTAL TIME=    0.0089( 6.7%)
 02:48:40 STEP 1920 H= 480:00 +CPU= 26.109
 END CNT3
 NSTEP =  1920 CNT0   000000000  18.880  18.880  31.854   0.593               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        57546/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1008    0        0            0    57546 ************   126.6     0.1   126.5     0.1   268.6
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.94      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 2082    6008.8    6008.8     17.35      0.00
   9 SPCM     - SPECTRAL COMP.                    1920    1144.8    1144.8      3.05      0.00
  10 SCAN2M - PHYSICS                             1921   17005.7   17005.7     45.32      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                161    1080.3    1080.3      0.24      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 83      43.6      43.6      0.01      0.00
  14 SUINIF                                          1   40984.2   40984.2      0.06      0.00
  17 GRIDFPOS IN CNT4                              161      30.6      30.6      0.01      0.00
  18 SUSPECG                                         1   32899.4   32899.4      0.05      0.00
  19 SUSPEC                                          1   32910.1   32910.1      0.05      0.00
  24 SUGRIDU                                         1    6345.7    6345.7      0.01      0.00
  25 SPECRT                                          1     914.3     914.3      0.00      0.00
  26 SUGRIDF                                         1     814.1     814.1      0.00      0.00
  27 RESTART FILES - WRITING                        40    4348.1    4348.1      0.24      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               161       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               161    8732.5    8732.5      1.95      0.00
  31 POSDDH IN STEPO                                 9       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1921    8005.7    8005.7     21.33      0.00
  39 SU0YOMB                                         1    1421.1    1421.1      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1921      39.5      39.5      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1920     688.7     688.7      1.83      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1920     172.0     172.0      0.46      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 83       0.5       0.5      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     4165     556.3     556.3      3.21      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      4006     342.1     342.1      1.90      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       4006     142.6     142.6      0.79      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      4165     209.6     209.6      1.21      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1     166.2     166.2      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           4165      80.1      80.1      0.46      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           4006      47.0      47.0      0.26      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           4165      82.6      82.6      0.48      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           4006      32.8      32.8      0.18      0.00
 400 GSTATS                                     223224       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                207696       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    72085.1 CPU TIME   42203.9 VECTOR TIME    42203.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       24.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/amar/slots/0/ICMGGh7zg+001920
Moving to projects directory: /home/amar/slots/0/ICMSHh7zg+001920
Moving to projects directory: /home/amar/slots/0/ICMUAh7zg+001920
Adding to the zip: /home/amar/slots/0/NODE.001_01
Adding to the zip: /home/amar/slots/0/ifs.stat
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001872
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001872
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001860
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001872
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001908
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001860
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001884
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001836
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001896
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001848
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001824
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001824
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001908
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001848
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001920
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001824
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001848
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001884
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001884
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001920
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001836
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001896
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001896
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMGGh7zg+001860
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMSHh7zg+001908
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001920
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12291910/ICMUAh7zg+001836
Zipping up the final file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0_r892480466_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
02:52:11 (101260): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 Jun 2024 13:44:24 1542649 22445513 oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0 1,727,100 42,203 0.0244
18 Jun 2024 22:47:21 1542649 22445513 oifs_43r3_bl_a2rj_2016092300_20_1018_12291910_0 864,000 22,250 0.0258


©2024 cpdn.org