climateprediction.net home page
Task 22446863

Task 22446863

Name oifs_43r3_bl_a3ss_2016092300_20_1018_12293251_0
Workunit 12293251
Created 13 Jun 2024, 3:09:02 UTC
Sent 13 Jun 2024, 11:22:59 UTC
Report deadline 12 Aug 2024, 11:22:59 UTC
Received 15 Jun 2024, 16:54:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1549573
Run time 21 hours 14 min 37 sec
CPU time 21 hours 14 min 37 sec
Validate state Invalid
Credit 1,318.46
Device peak FLOPS 8.07 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.22 MB
Peak swap size 5,981.08 MB
Peak disk usage 1,825.03 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Process still present 5 min after writing finish file; aborting</message>
<stderr_txt>
H= 328:45 +CPU= 40.736
  12:21:27 STEP 1316 H= 329:00 +CPU= 40.116
  12:22:06 STEP 1317 H= 329:15 +CPU= 38.630
  12:22:44 STEP 1318 H= 329:30 +CPU= 38.060
  12:23:22 STEP 1319 H= 329:45 +CPU= 37.426
  12:24:10 STEP 1320 H= 330:00 +CPU= 47.486
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001320
  12:24:48 STEP 1321 H= 330:15 +CPU= 38.377
  12:25:27 STEP 1322 H= 330:30 +CPU= 38.693
  12:26:06 STEP 1323 H= 330:45 +CPU= 38.257
  12:26:45 STEP 1324 H= 331:00 +CPU= 39.095
  12:27:24 STEP 1325 H= 331:15 +CPU= 38.189
  12:28:02 STEP 1326 H= 331:30 +CPU= 38.118
  12:28:43 STEP 1327 H= 331:45 +CPU= 40.230
  12:29:23 STEP 1328 H= 332:00 +CPU= 40.190
  12:30:03 STEP 1329 H= 332:15 +CPU= 39.297
  12:30:42 STEP 1330 H= 332:30 +CPU= 38.932
  12:31:22 STEP 1331 H= 332:45 +CPU= 40.275
  12:32:11 STEP 1332 H= 333:00 +CPU= 48.099
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001332
  12:32:50 STEP 1333 H= 333:15 +CPU= 39.292
  12:33:31 STEP 1334 H= 333:30 +CPU= 40.062
  12:34:11 STEP 1335 H= 333:45 +CPU= 40.365
  12:34:50 STEP 1336 H= 334:00 +CPU= 38.595
  12:35:29 STEP 1337 H= 334:15 +CPU= 38.538
  12:36:09 STEP 1338 H= 334:30 +CPU= 40.001
  12:36:48 STEP 1339 H= 334:45 +CPU= 38.454
  12:37:28 STEP 1340 H= 335:00 +CPU= 39.817
  12:38:08 STEP 1341 H= 335:15 +CPU= 39.649
  12:38:47 STEP 1342 H= 335:30 +CPU= 38.827
  12:39:26 STEP 1343 H= 335:45 +CPU= 38.864
  12:40:22 STEP 1344 H= 336:00 +CPU= 55.273
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ss_2016092300_20_1018_12293251_0_r1020315351_13.zip
Uploading the intermediate file: upload_file_13.zip
  12:41:02 STEP 1345 H= 336:15 +CPU= 39.620
  12:41:43 STEP 1346 H= 336:30 +CPU= 40.752
  12:42:23 STEP 1347 H= 336:45 +CPU= 39.477
  12:43:03 STEP 1348 H= 337:00 +CPU= 40.199
  12:43:44 STEP 1349 H= 337:15 +CPU= 40.120
  12:44:24 STEP 1350 H= 337:30 +CPU= 40.626
  12:45:03 STEP 1351 H= 337:45 +CPU= 38.762
  12:45:45 STEP 1352 H= 338:00 +CPU= 41.059
  12:46:23 STEP 1353 H= 338:15 +CPU= 37.999
  12:47:04 STEP 1354 H= 338:30 +CPU= 40.513
  12:47:43 STEP 1355 H= 338:45 +CPU= 38.848
  12:48:29 STEP 1356 H= 339:00 +CPU= 45.524
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001356
  12:49:09 STEP 1357 H= 339:15 +CPU= 40.348
  12:49:48 STEP 1358 H= 339:30 +CPU= 38.455
  12:50:28 STEP 1359 H= 339:45 +CPU= 39.399
  12:51:07 STEP 1360 H= 340:00 +CPU= 39.324
  12:51:46 STEP 1361 H= 340:15 +CPU= 38.898
  12:52:25 STEP 1362 H= 340:30 +CPU= 37.804
  12:53:04 STEP 1363 H= 340:45 +CPU= 38.981
  12:53:45 STEP 1364 H= 341:00 +CPU= 40.883
  12:54:24 STEP 1365 H= 341:15 +CPU= 39.209
  12:55:04 STEP 1366 H= 341:30 +CPU= 39.641
  12:55:43 STEP 1367 H= 341:45 +CPU= 38.809
  12:56:31 STEP 1368 H= 342:00 +CPU= 47.364
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001368
  12:57:09 STEP 1369 H= 342:15 +CPU= 38.222
  12:57:50 STEP 1370 H= 342:30 +CPU= 40.379
  12:58:30 STEP 1371 H= 342:45 +CPU= 40.045
  12:59:10 STEP 1372 H= 343:00 +CPU= 38.932
  12:59:50 STEP 1373 H= 343:15 +CPU= 39.697
  13:00:29 STEP 1374 H= 343:30 +CPU= 39.303
  13:01:08 STEP 1375 H= 343:45 +CPU= 38.733
  13:01:49 STEP 1376 H= 344:00 +CPU= 40.272
  13:02:29 STEP 1377 H= 344:15 +CPU= 39.870
  13:03:08 STEP 1378 H= 344:30 +CPU= 39.228
  13:03:47 STEP 1379 H= 344:45 +CPU= 38.892
  13:04:34 STEP 1380 H= 345:00 +CPU= 46.768
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001380
  13:05:14 STEP 1381 H= 345:15 +CPU= 39.324
  13:05:53 STEP 1382 H= 345:30 +CPU= 38.404
  13:06:33 STEP 1383 H= 345:45 +CPU= 39.740
  13:07:13 STEP 1384 H= 346:00 +CPU= 39.717
  13:07:51 STEP 1385 H= 346:15 +CPU= 37.845
  13:08:30 STEP 1386 H= 346:30 +CPU= 39.212
  13:09:10 STEP 1387 H= 346:45 +CPU= 39.204
  13:09:50 STEP 1388 H= 347:00 +CPU= 39.738
  13:10:30 STEP 1389 H= 347:15 +CPU= 39.452
  13:11:08 STEP 1390 H= 347:30 +CPU= 37.805
  13:11:49 STEP 1391 H= 347:45 +CPU= 41.166
  13:12:44 STEP 1392 H= 348:00 +CPU= 54.216
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001392
  13:13:24 STEP 1393 H= 348:15 +CPU= 39.898
  13:14:06 STEP 1394 H= 348:30 +CPU= 41.965
  13:14:45 STEP 1395 H= 348:45 +CPU= 39.029
  13:15:25 STEP 1396 H= 349:00 +CPU= 38.971
  13:16:04 STEP 1397 H= 349:15 +CPU= 39.330
  13:16:44 STEP 1398 H= 349:30 +CPU= 39.290
  13:17:24 STEP 1399 H= 349:45 +CPU= 39.354
  13:18:04 STEP 1400 H= 350:00 +CPU= 40.510
  13:18:43 STEP 1401 H= 350:15 +CPU= 38.302
  13:19:22 STEP 1402 H= 350:30 +CPU= 38.835
  13:20:03 STEP 1403 H= 350:45 +CPU= 40.806
  13:20:51 STEP 1404 H= 351:00 +CPU= 47.944
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001404
  13:21:31 STEP 1405 H= 351:15 +CPU= 39.719
  13:22:10 STEP 1406 H= 351:30 +CPU= 38.522
  13:22:47 STEP 1407 H= 351:45 +CPU= 37.020
  13:23:27 STEP 1408 H= 352:00 +CPU= 39.001
  13:24:05 STEP 1409 H= 352:15 +CPU= 38.461
  13:24:45 STEP 1410 H= 352:30 +CPU= 39.234
  13:25:25 STEP 1411 H= 352:45 +CPU= 39.348
  13:26:05 STEP 1412 H= 353:00 +CPU= 40.039
  13:26:45 STEP 1413 H= 353:15 +CPU= 39.652
  13:27:24 STEP 1414 H= 353:30 +CPU= 39.111
  13:28:04 STEP 1415 H= 353:45 +CPU= 39.595
  13:28:53 STEP 1416 H= 354:00 +CPU= 48.491
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001416
  13:29:33 STEP 1417 H= 354:15 +CPU= 39.356
  13:30:11 STEP 1418 H= 354:30 +CPU= 38.311
  13:30:51 STEP 1419 H= 354:45 +CPU= 39.548
  13:31:30 STEP 1420 H= 355:00 +CPU= 38.505
  13:32:10 STEP 1421 H= 355:15 +CPU= 40.432
  13:32:52 STEP 1422 H= 355:30 +CPU= 41.463
  13:33:32 STEP 1423 H= 355:45 +CPU= 39.780
  13:34:11 STEP 1424 H= 356:00 +CPU= 38.560
  13:34:51 STEP 1425 H= 356:15 +CPU= 39.801
  13:35:31 STEP 1426 H= 356:30 +CPU= 39.632
  13:36:11 STEP 1427 H= 356:45 +CPU= 39.414
  13:36:58 STEP 1428 H= 357:00 +CPU= 47.338
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001428
  13:37:39 STEP 1429 H= 357:15 +CPU= 40.198
  13:38:18 STEP 1430 H= 357:30 +CPU= 38.608
  13:38:58 STEP 1431 H= 357:45 +CPU= 40.495
  13:39:38 STEP 1432 H= 358:00 +CPU= 39.831
  13:40:18 STEP 1433 H= 358:15 +CPU= 39.255
  13:40:58 STEP 1434 H= 358:30 +CPU= 39.909
  13:41:38 STEP 1435 H= 358:45 +CPU= 39.757
  13:42:18 STEP 1436 H= 359:00 +CPU= 39.523
  13:42:57 STEP 1437 H= 359:15 +CPU= 38.852
  13:43:36 STEP 1438 H= 359:30 +CPU= 38.432
  13:44:18 STEP 1439 H= 359:45 +CPU= 42.020
  13:45:13 STEP 1440 H= 360:00 +CPU= 54.083
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ss_2016092300_20_1018_12293251_0_r1020315351_14.zip
Uploading the intermediate file: upload_file_14.zip
  13:45:53 STEP 1441 H= 360:15 +CPU= 40.339
  13:46:33 STEP 1442 H= 360:30 +CPU= 39.358
  13:47:12 STEP 1443 H= 360:45 +CPU= 39.183
  13:47:55 STEP 1444 H= 361:00 +CPU= 41.937
  13:48:34 STEP 1445 H= 361:15 +CPU= 39.091
  13:49:13 STEP 1446 H= 361:30 +CPU= 39.342
  13:49:52 STEP 1447 H= 361:45 +CPU= 38.771
  13:50:33 STEP 1448 H= 362:00 +CPU= 40.622
  13:51:13 STEP 1449 H= 362:15 +CPU= 39.311
  13:51:52 STEP 1450 H= 362:30 +CPU= 39.222
  13:52:31 STEP 1451 H= 362:45 +CPU= 38.149
  13:53:18 STEP 1452 H= 363:00 +CPU= 46.791
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001452
  13:53:58 STEP 1453 H= 363:15 +CPU= 39.777
  13:54:38 STEP 1454 H= 363:30 +CPU= 39.519
  13:55:17 STEP 1455 H= 363:45 +CPU= 39.341
  13:55:59 STEP 1456 H= 364:00 +CPU= 41.005
  13:56:38 STEP 1457 H= 364:15 +CPU= 38.829
  13:57:17 STEP 1458 H= 364:30 +CPU= 39.426
  13:57:57 STEP 1459 H= 364:45 +CPU= 39.111
  13:58:36 STEP 1460 H= 365:00 +CPU= 39.426
  13:59:17 STEP 1461 H= 365:15 +CPU= 40.567
  13:59:57 STEP 1462 H= 365:30 +CPU= 39.838
  14:00:37 STEP 1463 H= 365:45 +CPU= 39.725
  14:01:25 STEP 1464 H= 366:00 +CPU= 47.553
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001464
  14:02:05 STEP 1465 H= 366:15 +CPU= 39.666
  14:02:45 STEP 1466 H= 366:30 +CPU= 39.843
  14:03:24 STEP 1467 H= 366:45 +CPU= 38.028
  14:04:05 STEP 1468 H= 367:00 +CPU= 40.556
  14:04:44 STEP 1469 H= 367:15 +CPU= 39.493
  14:05:24 STEP 1470 H= 367:30 +CPU= 39.916
  14:06:05 STEP 1471 H= 367:45 +CPU= 40.059
  14:06:45 STEP 1472 H= 368:00 +CPU= 39.626
  14:07:25 STEP 1473 H= 368:15 +CPU= 39.600
  14:08:04 STEP 1474 H= 368:30 +CPU= 39.099
  14:08:44 STEP 1475 H= 368:45 +CPU= 39.312
  14:09:32 STEP 1476 H= 369:00 +CPU= 47.656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001476
  14:10:12 STEP 1477 H= 369:15 +CPU= 40.380
  14:10:52 STEP 1478 H= 369:30 +CPU= 39.841
  14:11:33 STEP 1479 H= 369:45 +CPU= 40.119
  14:12:13 STEP 1480 H= 370:00 +CPU= 40.433
  14:12:54 STEP 1481 H= 370:15 +CPU= 40.611
  14:13:34 STEP 1482 H= 370:30 +CPU= 39.367
  14:14:14 STEP 1483 H= 370:45 +CPU= 40.076
  14:14:54 STEP 1484 H= 371:00 +CPU= 38.964
  14:15:33 STEP 1485 H= 371:15 +CPU= 38.641
  14:16:13 STEP 1486 H= 371:30 +CPU= 40.189
  14:16:53 STEP 1487 H= 371:45 +CPU= 39.907
  14:17:49 STEP 1488 H= 372:00 +CPU= 54.891
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001488
  14:18:30 STEP 1489 H= 372:15 +CPU= 40.904
  14:19:10 STEP 1490 H= 372:30 +CPU= 40.346
  14:19:50 STEP 1491 H= 372:45 +CPU= 39.205
  14:20:30 STEP 1492 H= 373:00 +CPU= 40.009
  14:21:10 STEP 1493 H= 373:15 +CPU= 39.973
  14:21:51 STEP 1494 H= 373:30 +CPU= 40.470
  14:22:32 STEP 1495 H= 373:45 +CPU= 40.818
  14:23:11 STEP 1496 H= 374:00 +CPU= 39.013
  14:23:51 STEP 1497 H= 374:15 +CPU= 39.636
  14:24:29 STEP 1498 H= 374:30 +CPU= 37.705
  14:25:08 STEP 1499 H= 374:45 +CPU= 38.040
  14:25:54 STEP 1500 H= 375:00 +CPU= 46.313
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001500
  14:26:33 STEP 1501 H= 375:15 +CPU= 38.325
  14:27:12 STEP 1502 H= 375:30 +CPU= 38.497
  14:27:51 STEP 1503 H= 375:45 +CPU= 39.217
  14:28:31 STEP 1504 H= 376:00 +CPU= 39.726
  14:29:10 STEP 1505 H= 376:15 +CPU= 38.952
  14:29:50 STEP 1506 H= 376:30 +CPU= 39.126
  14:30:28 STEP 1507 H= 376:45 +CPU= 38.471
  14:31:08 STEP 1508 H= 377:00 +CPU= 39.497
  14:31:46 STEP 1509 H= 377:15 +CPU= 38.031
  14:32:27 STEP 1510 H= 377:30 +CPU= 40.278
  14:33:07 STEP 1511 H= 377:45 +CPU= 39.517
  14:33:57 STEP 1512 H= 378:00 +CPU= 49.956
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001512
  14:34:38 STEP 1513 H= 378:15 +CPU= 40.531
  14:35:18 STEP 1514 H= 378:30 +CPU= 39.729
  14:35:57 STEP 1515 H= 378:45 +CPU= 39.324
  14:36:38 STEP 1516 H= 379:00 +CPU= 40.699
  14:37:18 STEP 1517 H= 379:15 +CPU= 39.218
  14:37:58 STEP 1518 H= 379:30 +CPU= 40.444
  14:38:38 STEP 1519 H= 379:45 +CPU= 39.611
  14:39:18 STEP 1520 H= 380:00 +CPU= 38.920
  14:39:58 STEP 1521 H= 380:15 +CPU= 39.651
  14:40:38 STEP 1522 H= 380:30 +CPU= 40.358
  14:41:19 STEP 1523 H= 380:45 +CPU= 40.025
  14:42:07 STEP 1524 H= 381:00 +CPU= 48.675
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001524
  14:42:48 STEP 1525 H= 381:15 +CPU= 40.686
  14:43:28 STEP 1526 H= 381:30 +CPU= 39.273
  14:44:08 STEP 1527 H= 381:45 +CPU= 39.647
  14:44:47 STEP 1528 H= 382:00 +CPU= 39.189
  14:45:27 STEP 1529 H= 382:15 +CPU= 39.007
  14:46:07 STEP 1530 H= 382:30 +CPU= 40.252
  14:46:47 STEP 1531 H= 382:45 +CPU= 39.554
  14:47:27 STEP 1532 H= 383:00 +CPU= 39.986
  14:48:07 STEP 1533 H= 383:15 +CPU= 39.246
  14:48:47 STEP 1534 H= 383:30 +CPU= 39.798
  14:49:26 STEP 1535 H= 383:45 +CPU= 38.784
  14:50:22 STEP 1536 H= 384:00 +CPU= 56.188
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ss_2016092300_20_1018_12293251_0_r1020315351_15.zip
Uploading the intermediate file: upload_file_15.zip
  14:51:02 STEP 1537 H= 384:15 +CPU= 39.384
double free or corruption (!prev)
  14:51:42 STEP 1538 H= 384:30 +CPU= 39.629
  14:52:22 STEP 1539 H= 384:45 +CPU= 39.311
  14:53:02 STEP 1540 H= 385:00 +CPU= 40.093
  14:53:41 STEP 1541 H= 385:15 +CPU= 39.214
  14:54:21 STEP 1542 H= 385:30 +CPU= 39.101
  14:55:01 STEP 1543 H= 385:45 +CPU= 39.809
  14:55:41 STEP 1544 H= 386:00 +CPU= 40.244
  14:56:21 STEP 1545 H= 386:15 +CPU= 39.486
  14:57:01 STEP 1546 H= 386:30 +CPU= 40.012
  14:57:40 STEP 1547 H= 386:45 +CPU= 38.528
  14:58:29 STEP 1548 H= 387:00 +CPU= 48.087
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001548
  14:59:09 STEP 1549 H= 387:15 +CPU= 40.094
  14:59:48 STEP 1550 H= 387:30 +CPU= 38.813
  15:00:28 STEP 1551 H= 387:45 +CPU= 39.516
  15:01:09 STEP 1552 H= 388:00 +CPU= 41.090
  15:01:49 STEP 1553 H= 388:15 +CPU= 39.834
  15:02:30 STEP 1554 H= 388:30 +CPU= 40.284
  15:03:09 STEP 1555 H= 388:45 +CPU= 38.775
  15:03:50 STEP 1556 H= 389:00 +CPU= 40.501
  15:04:30 STEP 1557 H= 389:15 +CPU= 40.083
  15:05:10 STEP 1558 H= 389:30 +CPU= 39.822
  15:05:49 STEP 1559 H= 389:45 +CPU= 39.036
  15:06:38 STEP 1560 H= 390:00 +CPU= 48.217
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001560
  15:07:18 STEP 1561 H= 390:15 +CPU= 40.305
  15:07:58 STEP 1562 H= 390:30 +CPU= 39.361
  15:08:37 STEP 1563 H= 390:45 +CPU= 38.910
  15:09:18 STEP 1564 H= 391:00 +CPU= 40.845
  15:09:58 STEP 1565 H= 391:15 +CPU= 38.979
  15:10:37 STEP 1566 H= 391:30 +CPU= 38.803
  15:11:17 STEP 1567 H= 391:45 +CPU= 40.355
  15:11:58 STEP 1568 H= 392:00 +CPU= 40.166
  15:12:39 STEP 1569 H= 392:15 +CPU= 40.778
  15:13:18 STEP 1570 H= 392:30 +CPU= 39.533
  15:13:58 STEP 1571 H= 392:45 +CPU= 39.398
  15:14:46 STEP 1572 H= 393:00 +CPU= 47.379
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001572
  15:15:24 STEP 1573 H= 393:15 +CPU= 38.185
  15:16:03 STEP 1574 H= 393:30 +CPU= 38.833
  15:16:42 STEP 1575 H= 393:45 +CPU= 38.252
  15:17:23 STEP 1576 H= 394:00 +CPU= 41.188
  15:18:03 STEP 1577 H= 394:15 +CPU= 39.361
  15:18:43 STEP 1578 H= 394:30 +CPU= 39.785
  15:19:24 STEP 1579 H= 394:45 +CPU= 40.463
  15:20:04 STEP 1580 H= 395:00 +CPU= 40.354
  15:20:43 STEP 1581 H= 395:15 +CPU= 38.995
  15:21:23 STEP 1582 H= 395:30 +CPU= 39.243
  15:22:02 STEP 1583 H= 395:45 +CPU= 38.648
  15:22:57 STEP 1584 H= 396:00 +CPU= 54.573
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001584
  15:23:35 STEP 1585 H= 396:15 +CPU= 37.511
  15:24:15 STEP 1586 H= 396:30 +CPU= 39.662
  15:24:55 STEP 1587 H= 396:45 +CPU= 39.683
  15:25:36 STEP 1588 H= 397:00 +CPU= 41.432
  15:26:17 STEP 1589 H= 397:15 +CPU= 40.292
  15:26:57 STEP 1590 H= 397:30 +CPU= 39.604
  15:27:37 STEP 1591 H= 397:45 +CPU= 39.798
  15:28:18 STEP 1592 H= 398:00 +CPU= 41.066
  15:28:58 STEP 1593 H= 398:15 +CPU= 39.624
  15:29:38 STEP 1594 H= 398:30 +CPU= 39.287
  15:30:17 STEP 1595 H= 398:45 +CPU= 39.130
  15:31:05 STEP 1596 H= 399:00 +CPU= 47.957
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001596
  15:31:45 STEP 1597 H= 399:15 +CPU= 39.884
  15:32:25 STEP 1598 H= 399:30 +CPU= 38.890
  15:33:05 STEP 1599 H= 399:45 +CPU= 39.721
  15:33:39 STEP 1600 H= 400:00 +CPU= 33.901
  15:34:13 STEP 1601 H= 400:15 +CPU= 34.039
  15:34:52 STEP 1602 H= 400:30 +CPU= 38.726
  15:35:33 STEP 1603 H= 400:45 +CPU= 40.419
  15:36:13 STEP 1604 H= 401:00 +CPU= 40.308
  15:36:54 STEP 1605 H= 401:15 +CPU= 40.283
  15:37:34 STEP 1606 H= 401:30 +CPU= 40.331
  15:38:14 STEP 1607 H= 401:45 +CPU= 39.405
  15:39:02 STEP 1608 H= 402:00 +CPU= 48.033
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001608
  15:39:43 STEP 1609 H= 402:15 +CPU= 40.467
  15:40:24 STEP 1610 H= 402:30 +CPU= 40.032
  15:41:02 STEP 1611 H= 402:45 +CPU= 38.561
  15:41:43 STEP 1612 H= 403:00 +CPU= 39.941
  15:42:23 STEP 1613 H= 403:15 +CPU= 39.756
  15:43:02 STEP 1614 H= 403:30 +CPU= 39.547
  15:43:42 STEP 1615 H= 403:45 +CPU= 39.609
  15:44:23 STEP 1616 H= 404:00 +CPU= 40.067
  15:45:03 STEP 1617 H= 404:15 +CPU= 39.554
  15:45:42 STEP 1618 H= 404:30 +CPU= 39.427
  15:46:22 STEP 1619 H= 404:45 +CPU= 39.388
  15:47:10 STEP 1620 H= 405:00 +CPU= 47.607
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001620
  15:47:48 STEP 1621 H= 405:15 +CPU= 38.394
  15:48:29 STEP 1622 H= 405:30 +CPU= 40.187
  15:49:10 STEP 1623 H= 405:45 +CPU= 40.878
  15:49:50 STEP 1624 H= 406:00 +CPU= 39.900
  15:50:29 STEP 1625 H= 406:15 +CPU= 38.424
  15:51:08 STEP 1626 H= 406:30 +CPU= 39.025
  15:51:47 STEP 1627 H= 406:45 +CPU= 38.832
  15:52:27 STEP 1628 H= 407:00 +CPU= 39.344
  15:53:08 STEP 1629 H= 407:15 +CPU= 41.276
  15:53:48 STEP 1630 H= 407:30 +CPU= 39.442
  15:54:28 STEP 1631 H= 407:45 +CPU= 39.304
  15:55:23 STEP 1632 H= 408:00 +CPU= 54.508
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ss_2016092300_20_1018_12293251_0_r1020315351_16.zip
Uploading the intermediate file: upload_file_16.zip
  15:56:02 STEP 1633 H= 408:15 +CPU= 39.087
  15:56:41 STEP 1634 H= 408:30 +CPU= 39.225
  15:57:21 STEP 1635 H= 408:45 +CPU= 39.211
  15:58:02 STEP 1636 H= 409:00 +CPU= 40.628
  15:58:41 STEP 1637 H= 409:15 +CPU= 38.744
  15:59:22 STEP 1638 H= 409:30 +CPU= 40.398
  16:00:02 STEP 1639 H= 409:45 +CPU= 39.651
  16:00:43 STEP 1640 H= 410:00 +CPU= 40.979
  16:01:22 STEP 1641 H= 410:15 +CPU= 39.371
  16:02:02 STEP 1642 H= 410:30 +CPU= 39.343
  16:02:41 STEP 1643 H= 410:45 +CPU= 38.579
  16:03:31 STEP 1644 H= 411:00 +CPU= 50.119
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001644
  16:04:10 STEP 1645 H= 411:15 +CPU= 38.888
  16:04:49 STEP 1646 H= 411:30 +CPU= 37.944
  16:05:26 STEP 1647 H= 411:45 +CPU= 37.501
  16:06:06 STEP 1648 H= 412:00 +CPU= 39.647
  16:06:45 STEP 1649 H= 412:15 +CPU= 38.437
  16:07:25 STEP 1650 H= 412:30 +CPU= 39.188
  16:08:04 STEP 1651 H= 412:45 +CPU= 39.499
  16:08:44 STEP 1652 H= 413:00 +CPU= 39.555
  16:09:23 STEP 1653 H= 413:15 +CPU= 38.071
  16:10:01 STEP 1654 H= 413:30 +CPU= 38.455
  16:10:42 STEP 1655 H= 413:45 +CPU= 40.792
  16:11:32 STEP 1656 H= 414:00 +CPU= 48.966
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001656
  16:12:12 STEP 1657 H= 414:15 +CPU= 40.035
  16:12:52 STEP 1658 H= 414:30 +CPU= 39.983
  16:13:34 STEP 1659 H= 414:45 +CPU= 41.476
  16:14:16 STEP 1660 H= 415:00 +CPU= 41.240
  16:14:56 STEP 1661 H= 415:15 +CPU= 39.932
  16:15:34 STEP 1662 H= 415:30 +CPU= 37.730
  16:16:14 STEP 1663 H= 415:45 +CPU= 39.766
  16:16:55 STEP 1664 H= 416:00 +CPU= 40.571
  16:17:34 STEP 1665 H= 416:15 +CPU= 38.865
  16:18:14 STEP 1666 H= 416:30 +CPU= 39.803
  16:18:53 STEP 1667 H= 416:45 +CPU= 39.205
  16:19:42 STEP 1668 H= 417:00 +CPU= 48.551
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001668
  16:20:22 STEP 1669 H= 417:15 +CPU= 39.405
  16:21:02 STEP 1670 H= 417:30 +CPU= 39.715
  16:21:41 STEP 1671 H= 417:45 +CPU= 38.910
  16:22:21 STEP 1672 H= 418:00 +CPU= 39.556
  16:23:01 STEP 1673 H= 418:15 +CPU= 39.573
  16:23:40 STEP 1674 H= 418:30 +CPU= 38.772
  16:24:19 STEP 1675 H= 418:45 +CPU= 39.064
  16:24:59 STEP 1676 H= 419:00 +CPU= 39.129
  16:25:39 STEP 1677 H= 419:15 +CPU= 40.573
  16:26:20 STEP 1678 H= 419:30 +CPU= 39.784
  16:26:59 STEP 1679 H= 419:45 +CPU= 39.189
  16:27:53 STEP 1680 H= 420:00 +CPU= 53.580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001680
  16:28:32 STEP 1681 H= 420:15 +CPU= 38.969
  16:29:12 STEP 1682 H= 420:30 +CPU= 39.273
  16:29:52 STEP 1683 H= 420:45 +CPU= 40.149
  16:30:34 STEP 1684 H= 421:00 +CPU= 41.315
  16:31:14 STEP 1685 H= 421:15 +CPU= 39.876
  16:31:54 STEP 1686 H= 421:30 +CPU= 39.422
  16:32:33 STEP 1687 H= 421:45 +CPU= 39.453
  16:33:13 STEP 1688 H= 422:00 +CPU= 39.788
  16:33:53 STEP 1689 H= 422:15 +CPU= 39.847
  16:34:34 STEP 1690 H= 422:30 +CPU= 40.228
  16:35:14 STEP 1691 H= 422:45 +CPU= 39.389
  16:36:02 STEP 1692 H= 423:00 +CPU= 48.282
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001692
  16:36:42 STEP 1693 H= 423:15 +CPU= 39.073
  16:37:22 STEP 1694 H= 423:30 +CPU= 39.915
  16:38:02 STEP 1695 H= 423:45 +CPU= 40.496
  16:38:42 STEP 1696 H= 424:00 +CPU= 39.495
  16:39:22 STEP 1697 H= 424:15 +CPU= 39.908
  16:40:03 STEP 1698 H= 424:30 +CPU= 40.689
  16:40:43 STEP 1699 H= 424:45 +CPU= 39.073
  16:41:24 STEP 1700 H= 425:00 +CPU= 41.114
  16:42:03 STEP 1701 H= 425:15 +CPU= 38.798
  16:42:42 STEP 1702 H= 425:30 +CPU= 38.534
  16:43:22 STEP 1703 H= 425:45 +CPU= 40.416
  16:44:09 STEP 1704 H= 426:00 +CPU= 46.619
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001704
  16:44:47 STEP 1705 H= 426:15 +CPU= 37.580
  16:45:27 STEP 1706 H= 426:30 +CPU= 39.324
  16:46:06 STEP 1707 H= 426:45 +CPU= 39.448
  16:46:47 STEP 1708 H= 427:00 +CPU= 40.218
  16:47:28 STEP 1709 H= 427:15 +CPU= 40.525
  16:48:06 STEP 1710 H= 427:30 +CPU= 38.197
  16:48:47 STEP 1711 H= 427:45 +CPU= 40.557
  16:49:28 STEP 1712 H= 428:00 +CPU= 40.242
  16:50:08 STEP 1713 H= 428:15 +CPU= 40.184
  16:50:49 STEP 1714 H= 428:30 +CPU= 40.474
  16:51:27 STEP 1715 H= 428:45 +CPU= 38.281
  16:52:14 STEP 1716 H= 429:00 +CPU= 46.862
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001716
  16:52:54 STEP 1717 H= 429:15 +CPU= 38.859
  16:53:33 STEP 1718 H= 429:30 +CPU= 39.438
  16:54:11 STEP 1719 H= 429:45 +CPU= 37.809
  16:54:52 STEP 1720 H= 430:00 +CPU= 40.693
  16:55:32 STEP 1721 H= 430:15 +CPU= 39.682
  16:56:13 STEP 1722 H= 430:30 +CPU= 40.328
  16:56:54 STEP 1723 H= 430:45 +CPU= 40.713
  16:57:35 STEP 1724 H= 431:00 +CPU= 40.949
  16:58:14 STEP 1725 H= 431:15 +CPU= 38.987
  16:58:55 STEP 1726 H= 431:30 +CPU= 40.109
  16:59:35 STEP 1727 H= 431:45 +CPU= 39.624
  17:00:30 STEP 1728 H= 432:00 +CPU= 54.892
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ss_2016092300_20_1018_12293251_0_r1020315351_17.zip
Uploading the intermediate file: upload_file_17.zip
  17:01:09 STEP 1729 H= 432:15 +CPU= 38.932
  17:01:51 STEP 1730 H= 432:30 +CPU= 41.361
  17:02:31 STEP 1731 H= 432:45 +CPU= 39.593
  17:03:09 STEP 1732 H= 433:00 +CPU= 38.602
  17:03:49 STEP 1733 H= 433:15 +CPU= 39.202
  17:04:27 STEP 1734 H= 433:30 +CPU= 37.728
  17:05:06 STEP 1735 H= 433:45 +CPU= 39.272
  17:05:47 STEP 1736 H= 434:00 +CPU= 39.880
  17:06:26 STEP 1737 H= 434:15 +CPU= 38.793
  17:07:06 STEP 1738 H= 434:30 +CPU= 40.170
  17:07:45 STEP 1739 H= 434:45 +CPU= 38.737
  17:08:33 STEP 1740 H= 435:00 +CPU= 47.536
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001740
  17:09:13 STEP 1741 H= 435:15 +CPU= 39.773
  17:09:52 STEP 1742 H= 435:30 +CPU= 38.982
  17:10:32 STEP 1743 H= 435:45 +CPU= 39.184
  17:11:12 STEP 1744 H= 436:00 +CPU= 40.180
  17:11:53 STEP 1745 H= 436:15 +CPU= 40.477
  17:12:34 STEP 1746 H= 436:30 +CPU= 40.464
  17:13:14 STEP 1747 H= 436:45 +CPU= 40.424
  17:13:55 STEP 1748 H= 437:00 +CPU= 40.581
  17:14:35 STEP 1749 H= 437:15 +CPU= 39.596
  17:15:15 STEP 1750 H= 437:30 +CPU= 39.826
  17:15:55 STEP 1751 H= 437:45 +CPU= 39.606
  17:16:41 STEP 1752 H= 438:00 +CPU= 46.052
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001752
  17:17:22 STEP 1753 H= 438:15 +CPU= 40.371
  17:18:03 STEP 1754 H= 438:30 +CPU= 40.494
  17:18:44 STEP 1755 H= 438:45 +CPU= 40.980
  17:19:23 STEP 1756 H= 439:00 +CPU= 38.877
  17:20:02 STEP 1757 H= 439:15 +CPU= 39.090
  17:20:42 STEP 1758 H= 439:30 +CPU= 39.704
  17:21:23 STEP 1759 H= 439:45 +CPU= 40.563
  17:22:03 STEP 1760 H= 440:00 +CPU= 39.477
  17:22:42 STEP 1761 H= 440:15 +CPU= 38.328
  17:23:21 STEP 1762 H= 440:30 +CPU= 39.519
  17:24:01 STEP 1763 H= 440:45 +CPU= 39.031
  17:24:50 STEP 1764 H= 441:00 +CPU= 48.729
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001764
  17:25:30 STEP 1765 H= 441:15 +CPU= 39.751
  17:26:09 STEP 1766 H= 441:30 +CPU= 38.606
  17:26:48 STEP 1767 H= 441:45 +CPU= 39.601
  17:27:25 STEP 1768 H= 442:00 +CPU= 36.671
  17:28:02 STEP 1769 H= 442:15 +CPU= 36.595
  17:28:40 STEP 1770 H= 442:30 +CPU= 37.216
  17:29:16 STEP 1771 H= 442:45 +CPU= 35.908
  17:29:53 STEP 1772 H= 443:00 +CPU= 37.114
  17:30:29 STEP 1773 H= 443:15 +CPU= 36.082
  17:31:08 STEP 1774 H= 443:30 +CPU= 37.986
  17:31:46 STEP 1775 H= 443:45 +CPU= 38.584
  17:32:40 STEP 1776 H= 444:00 +CPU= 53.457
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001776
  17:33:19 STEP 1777 H= 444:15 +CPU= 38.230
  17:33:59 STEP 1778 H= 444:30 +CPU= 39.668
  17:34:36 STEP 1779 H= 444:45 +CPU= 37.310
  17:35:16 STEP 1780 H= 445:00 +CPU= 39.641
  17:35:56 STEP 1781 H= 445:15 +CPU= 39.579
  17:36:36 STEP 1782 H= 445:30 +CPU= 39.518
  17:37:16 STEP 1783 H= 445:45 +CPU= 39.636
  17:37:55 STEP 1784 H= 446:00 +CPU= 38.911
  17:38:36 STEP 1785 H= 446:15 +CPU= 40.875
  17:39:16 STEP 1786 H= 446:30 +CPU= 39.688
  17:39:55 STEP 1787 H= 446:45 +CPU= 38.484
  17:40:42 STEP 1788 H= 447:00 +CPU= 47.402
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001788
  17:41:23 STEP 1789 H= 447:15 +CPU= 40.139
  17:42:02 STEP 1790 H= 447:30 +CPU= 38.542
  17:42:38 STEP 1791 H= 447:45 +CPU= 36.602
  17:43:15 STEP 1792 H= 448:00 +CPU= 36.673
  17:43:53 STEP 1793 H= 448:15 +CPU= 37.602
  17:44:30 STEP 1794 H= 448:30 +CPU= 36.130
  17:45:03 STEP 1795 H= 448:45 +CPU= 33.740
  17:45:38 STEP 1796 H= 449:00 +CPU= 34.814
  17:46:13 STEP 1797 H= 449:15 +CPU= 34.538
  17:46:49 STEP 1798 H= 449:30 +CPU= 35.541
  17:47:26 STEP 1799 H= 449:45 +CPU= 37.198
  17:48:12 STEP 1800 H= 450:00 +CPU= 45.262
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001800
  17:48:51 STEP 1801 H= 450:15 +CPU= 38.896
  17:49:32 STEP 1802 H= 450:30 +CPU= 40.318
  17:50:12 STEP 1803 H= 450:45 +CPU= 40.111
  17:50:48 STEP 1804 H= 451:00 +CPU= 35.335
  17:51:22 STEP 1805 H= 451:15 +CPU= 34.005
  17:51:56 STEP 1806 H= 451:30 +CPU= 34.320
  17:52:31 STEP 1807 H= 451:45 +CPU= 34.176
  17:53:06 STEP 1808 H= 452:00 +CPU= 34.857
  17:53:39 STEP 1809 H= 452:15 +CPU= 33.309
  17:54:16 STEP 1810 H= 452:30 +CPU= 36.509
  17:54:56 STEP 1811 H= 452:45 +CPU= 40.078
  17:55:43 STEP 1812 H= 453:00 +CPU= 45.771
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001812
  17:56:23 STEP 1813 H= 453:15 +CPU= 40.404
  17:57:04 STEP 1814 H= 453:30 +CPU= 40.174
  17:57:41 STEP 1815 H= 453:45 +CPU= 37.184
  17:58:19 STEP 1816 H= 454:00 +CPU= 37.692
  17:58:57 STEP 1817 H= 454:15 +CPU= 37.368
  17:59:35 STEP 1818 H= 454:30 +CPU= 37.829
  18:00:11 STEP 1819 H= 454:45 +CPU= 36.478
  18:00:51 STEP 1820 H= 455:00 +CPU= 39.299
  18:01:30 STEP 1821 H= 455:15 +CPU= 39.275
  18:02:10 STEP 1822 H= 455:30 +CPU= 39.382
  18:02:50 STEP 1823 H= 455:45 +CPU= 40.169
  18:03:44 STEP 1824 H= 456:00 +CPU= 53.043
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ss_2016092300_20_1018_12293251_0_r1020315351_18.zip
Uploading the intermediate file: upload_file_18.zip
  18:04:23 STEP 1825 H= 456:15 +CPU= 38.684
  18:05:04 STEP 1826 H= 456:30 +CPU= 41.283
  18:05:44 STEP 1827 H= 456:45 +CPU= 39.530
  18:06:25 STEP 1828 H= 457:00 +CPU= 40.117
  18:07:06 STEP 1829 H= 457:15 +CPU= 40.501
  18:07:46 STEP 1830 H= 457:30 +CPU= 40.313
  18:08:26 STEP 1831 H= 457:45 +CPU= 40.004
  18:09:05 STEP 1832 H= 458:00 +CPU= 38.766
  18:09:44 STEP 1833 H= 458:15 +CPU= 37.995
  18:10:23 STEP 1834 H= 458:30 +CPU= 39.242
  18:11:03 STEP 1835 H= 458:45 +CPU= 39.292
  18:11:52 STEP 1836 H= 459:00 +CPU= 49.089
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001836
  18:12:25 STEP 1837 H= 459:15 +CPU= 32.050
  18:13:05 STEP 1838 H= 459:30 +CPU= 30.880
  18:13:35 STEP 1839 H= 459:45 +CPU= 25.486
  18:14:00 STEP 1840 H= 460:00 +CPU= 22.863
  18:14:23 STEP 1841 H= 460:15 +CPU= 21.887
  18:14:46 STEP 1842 H= 460:30 +CPU= 22.299
  18:15:09 STEP 1843 H= 460:45 +CPU= 22.089
  18:15:32 STEP 1844 H= 461:00 +CPU= 22.843
  18:15:56 STEP 1845 H= 461:15 +CPU= 22.364
  18:16:19 STEP 1846 H= 461:30 +CPU= 22.305
  18:16:42 STEP 1847 H= 461:45 +CPU= 22.175
  18:17:11 STEP 1848 H= 462:00 +CPU= 27.993
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001848
  18:17:30 STEP 1849 H= 462:15 +CPU= 18.754
  18:17:44 STEP 1850 H= 462:30 +CPU= 14.623
  18:17:56 STEP 1851 H= 462:45 +CPU= 11.369
  18:18:06 STEP 1852 H= 463:00 +CPU= 10.594
  18:18:25 STEP 1853 H= 463:15 +CPU= 17.760
  18:18:48 STEP 1854 H= 463:30 +CPU= 22.424
  18:19:12 STEP 1855 H= 463:45 +CPU= 22.400
  18:19:35 STEP 1856 H= 464:00 +CPU= 22.820
  18:19:59 STEP 1857 H= 464:15 +CPU= 22.166
  18:20:22 STEP 1858 H= 464:30 +CPU= 22.232
  18:20:45 STEP 1859 H= 464:45 +CPU= 21.995
  18:21:14 STEP 1860 H= 465:00 +CPU= 28.260
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001860
  18:21:37 STEP 1861 H= 465:15 +CPU= 22.195
  18:22:00 STEP 1862 H= 465:30 +CPU= 21.973
  18:22:22 STEP 1863 H= 465:45 +CPU= 21.692
  18:22:44 STEP 1864 H= 466:00 +CPU= 21.148
  18:23:01 STEP 1865 H= 466:15 +CPU= 17.651
  18:23:16 STEP 1866 H= 466:30 +CPU= 14.177
  18:23:27 STEP 1867 H= 466:45 +CPU= 11.150
  18:23:38 STEP 1868 H= 467:00 +CPU= 10.878
  18:23:59 STEP 1869 H= 467:15 +CPU= 20.427
  18:24:22 STEP 1870 H= 467:30 +CPU= 22.369
  18:24:45 STEP 1871 H= 467:45 +CPU= 22.278
  18:25:20 STEP 1872 H= 468:00 +CPU= 32.844
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001872
  18:25:42 STEP 1873 H= 468:15 +CPU= 22.126
  18:26:06 STEP 1874 H= 468:30 +CPU= 22.571
  18:26:30 STEP 1875 H= 468:45 +CPU= 22.171
  18:26:54 STEP 1876 H= 469:00 +CPU= 23.045
  18:27:17 STEP 1877 H= 469:15 +CPU= 22.123
  18:27:41 STEP 1878 H= 469:30 +CPU= 22.373
  18:28:03 STEP 1879 H= 469:45 +CPU= 21.786
  18:28:25 STEP 1880 H= 470:00 +CPU= 21.641
  18:28:41 STEP 1881 H= 470:15 +CPU= 16.474
  18:28:53 STEP 1882 H= 470:30 +CPU= 11.611
  18:29:04 STEP 1883 H= 470:45 +CPU= 10.643
  18:29:17 STEP 1884 H= 471:00 +CPU= 13.239
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001884
  18:29:37 STEP 1885 H= 471:15 +CPU= 18.912
  18:30:00 STEP 1886 H= 471:30 +CPU= 22.407
  18:30:23 STEP 1887 H= 471:45 +CPU= 22.306
  18:30:47 STEP 1888 H= 472:00 +CPU= 22.745
  18:31:10 STEP 1889 H= 472:15 +CPU= 22.052
  18:31:34 STEP 1890 H= 472:30 +CPU= 22.282
  18:31:57 STEP 1891 H= 472:45 +CPU= 22.370
  18:32:21 STEP 1892 H= 473:00 +CPU= 22.995
  18:32:44 STEP 1893 H= 473:15 +CPU= 22.481
  18:33:07 STEP 1894 H= 473:30 +CPU= 22.205
  18:33:31 STEP 1895 H= 473:45 +CPU= 22.254
  18:33:59 STEP 1896 H= 474:00 +CPU= 27.966
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001896
  18:34:16 STEP 1897 H= 474:15 +CPU= 17.264
  18:34:28 STEP 1898 H= 474:30 +CPU= 12.027
  18:34:39 STEP 1899 H= 474:45 +CPU= 10.889
  18:34:51 STEP 1900 H= 475:00 +CPU= 11.339
  18:35:12 STEP 1901 H= 475:15 +CPU= 20.337
  18:35:35 STEP 1902 H= 475:30 +CPU= 22.186
  18:35:58 STEP 1903 H= 475:45 +CPU= 22.282
  18:36:22 STEP 1904 H= 476:00 +CPU= 22.648
  18:36:45 STEP 1905 H= 476:15 +CPU= 22.196
  18:37:08 STEP 1906 H= 476:30 +CPU= 22.119
  18:37:31 STEP 1907 H= 476:45 +CPU= 22.188
  18:38:00 STEP 1908 H= 477:00 +CPU= 28.455
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001908
  18:38:23 STEP 1909 H= 477:15 +CPU= 22.187
  18:38:47 STEP 1910 H= 477:30 +CPU= 22.304
  18:39:10 STEP 1911 H= 477:45 +CPU= 22.279
  18:39:32 STEP 1912 H= 478:00 +CPU= 21.589
  18:39:49 STEP 1913 H= 478:15 +CPU= 17.114
  18:40:04 STEP 1914 H= 478:30 +CPU= 14.405
  18:40:15 STEP 1915 H= 478:45 +CPU= 11.154
  18:40:26 STEP 1916 H= 479:00 +CPU= 11.278
  18:40:48 STEP 1917 H= 479:15 +CPU= 20.465
  18:41:11 STEP 1918 H= 479:30 +CPU= 22.185
  18:41:34 STEP 1919 H= 479:45 +CPU= 22.212
  18:42:06 STEP 1920 H= 480:00 +CPU= 30.667
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.8005117489E-21      I       0.3411844994E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1141097294E-01      I
I  Relat. Hum. I      0.1956219961E+00      I       0.2511458017E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.9550028541E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    321791588 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS459702.3 Mbytes/s, TOTAL TIME=    0.0105( 6.7%)
 18:42:06 STEP 1920 H= 480:00 +CPU= 30.667
 END CNT3
 NSTEP =  1920 CNT0   000000000  21.035  21.035  21.974   0.957               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        57546/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1008    0        0            0    57546 ************   175.7     0.0   175.7     0.0   321.6
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 *********       0.0    100.00   -100.00
   1 CNT4     - FORWARD INTEGRATION                  1 *********       0.0    100.01   -100.01
   8 SCAN2M - GRID-POINT DYNAMICS                 2082    8073.8    8073.8      0.00      0.00
   9 SPCM     - SPECTRAL COMP.                    1920 -110081.7       0.0    153.53   -153.53
  10 SCAN2M - PHYSICS                             1921   16024.0   16024.0      0.00      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                161    1695.2    1695.2      0.00      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 83     110.4     110.4      0.00      0.00
  14 SUINIF                                          1    9251.4    9251.4      0.00      0.00
  17 GRIDFPOS IN CNT4                              161      43.1      43.1      0.00      0.00
  18 SUSPECG                                         1    4591.3    4591.3      0.00      0.00
  19 SUSPEC                                          1    4603.2    4603.2      0.00      0.00
  24 SUGRIDU                                         1    3394.4    3394.4      0.00      0.00
  25 SPECRT                                          1     465.1     465.1      0.00      0.00
  26 SUGRIDF                                         1     788.7     788.7      0.00      0.00
  27 RESTART FILES - WRITING                        40    6823.0    6823.0      0.00      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               161       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               161    7282.5    7282.5      0.00      0.00
  31 POSDDH IN STEPO                                 9       1.2       1.2      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1921    8284.1    8284.1      0.00      0.00
  39 SU0YOMB                                         1     695.2     695.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1921      38.8      38.8      0.00      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1920     899.0     899.0      0.00      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1920     111.5     111.5      0.00      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 83       0.7       0.7      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     4165     546.6     546.6      0.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      4006     303.3     303.3      0.00      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       4006     140.4     140.4      0.00      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      4165     172.9     172.9      0.00      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      51.3      51.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           4165     131.9     131.9      0.00      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           4006      76.1      76.1      0.00      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           4165     170.2     170.2      0.00      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           4006      76.3      76.3      0.00      0.00
 400 GSTATS                                     223224       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                207696       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME  -137668.0 CPU TIME   76477.2 VECTOR TIME    76477.2


===-=== END   OF TIMING STATISTICS ===-===
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/3/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/3/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293251/ICMGGh7zg+001860
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ss_2016092300_20_1018_12293251_0_r1020315351_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
18:45:36 (487820): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Jun 2024 06:48:04 1549573 22446863 oifs_43r3_bl_a3ss_2016092300_20_1018_12293251_0 864,000 39,509 0.0457


©2024 climateprediction.net