climateprediction.net home page
Task 22314790

Task 22314790

Name oifs_43r3_0006_2019110100_123_993_12213444_0
Workunit 12213444
Created 24 Feb 2023, 11:30:08 UTC
Sent 24 Feb 2023, 11:40:56 UTC
Report deadline 25 Apr 2023, 11:40:56 UTC
Received 25 Feb 2023, 2:56:52 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1513725
Run time 12 hours 47 min 18 sec
CPU time 12 hours 37 min 42 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 8.33 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,415.98 MB
Peak swap size 4,983.34 MB
Peak disk usage 1,283.56 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
 /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_98.zip
Uploading the intermediate file: upload_file_98.zip
  00:58:12 STEP 2377 H=2377:00 +CPU= 12.173
  00:58:25 STEP 2378 H=2378:00 +CPU= 13.077
  00:58:44 STEP 2379 H=2379:00 +CPU= 19.577
  00:58:57 STEP 2380 H=2380:00 +CPU= 13.138
  00:59:10 STEP 2381 H=2381:00 +CPU= 12.507
  00:59:31 STEP 2382 H=2382:00 +CPU= 20.626
  00:59:43 STEP 2383 H=2383:00 +CPU= 12.225
  00:59:55 STEP 2384 H=2384:00 +CPU= 12.407
  01:00:16 STEP 2385 H=2385:00 +CPU= 20.338
  01:00:29 STEP 2386 H=2386:00 +CPU= 13.514
  01:00:41 STEP 2387 H=2387:00 +CPU= 12.190
  01:01:04 STEP 2388 H=2388:00 +CPU= 22.305
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002388
  01:01:17 STEP 2389 H=2389:00 +CPU= 13.115
  01:01:30 STEP 2390 H=2390:00 +CPU= 12.748
  01:01:50 STEP 2391 H=2391:00 +CPU= 20.452
  01:02:03 STEP 2392 H=2392:00 +CPU= 12.992
  01:02:16 STEP 2393 H=2393:00 +CPU= 12.627
  01:02:36 STEP 2394 H=2394:00 +CPU= 20.255
  01:02:49 STEP 2395 H=2395:00 +CPU= 12.860
  01:03:02 STEP 2396 H=2396:00 +CPU= 12.862
  01:03:23 STEP 2397 H=2397:00 +CPU= 20.440
  01:03:35 STEP 2398 H=2398:00 +CPU= 12.629
  01:03:48 STEP 2399 H=2399:00 +CPU= 12.634
  01:04:11 STEP 2400 H=2400:00 +CPU= 23.336
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_99.zip
Uploading the intermediate file: upload_file_99.zip
  01:04:24 STEP 2401 H=2401:00 +CPU= 12.662
Uploading trickle at timestep: 8640000
  01:04:37 STEP 2402 H=2402:00 +CPU= 13.029
  01:04:57 STEP 2403 H=2403:00 +CPU= 19.974
  01:05:10 STEP 2404 H=2404:00 +CPU= 12.880
  01:05:23 STEP 2405 H=2405:00 +CPU= 12.831
  01:05:44 STEP 2406 H=2406:00 +CPU= 20.764
  01:05:57 STEP 2407 H=2407:00 +CPU= 13.029
  01:06:10 STEP 2408 H=2408:00 +CPU= 13.360
  01:06:31 STEP 2409 H=2409:00 +CPU= 20.743
  01:06:44 STEP 2410 H=2410:00 +CPU= 12.668
  01:06:57 STEP 2411 H=2411:00 +CPU= 12.988
  01:07:19 STEP 2412 H=2412:00 +CPU= 22.255
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002412
  01:07:32 STEP 2413 H=2413:00 +CPU= 12.736
  01:07:45 STEP 2414 H=2414:00 +CPU= 12.749
  01:08:06 STEP 2415 H=2415:00 +CPU= 20.796
  01:08:19 STEP 2416 H=2416:00 +CPU= 13.023
  01:08:31 STEP 2417 H=2417:00 +CPU= 12.488
  01:08:51 STEP 2418 H=2418:00 +CPU= 19.565
  01:09:04 STEP 2419 H=2419:00 +CPU= 12.497
  01:09:16 STEP 2420 H=2420:00 +CPU= 12.668
  01:09:36 STEP 2421 H=2421:00 +CPU= 19.704
  01:09:49 STEP 2422 H=2422:00 +CPU= 12.810
  01:10:01 STEP 2423 H=2423:00 +CPU= 12.239
  01:10:25 STEP 2424 H=2424:00 +CPU= 23.512
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_100.zip
Uploading the intermediate file: upload_file_100.zip
  01:10:37 STEP 2425 H=2425:00 +CPU= 12.172
  01:10:50 STEP 2426 H=2426:00 +CPU= 12.756
  01:11:09 STEP 2427 H=2427:00 +CPU= 19.778
  01:11:22 STEP 2428 H=2428:00 +CPU= 13.102
  01:11:35 STEP 2429 H=2429:00 +CPU= 12.614
  01:11:56 STEP 2430 H=2430:00 +CPU= 20.543
  01:12:08 STEP 2431 H=2431:00 +CPU= 12.453
  01:12:21 STEP 2432 H=2432:00 +CPU= 12.850
  01:12:40 STEP 2433 H=2433:00 +CPU= 19.255
  01:12:53 STEP 2434 H=2434:00 +CPU= 12.584
  01:13:06 STEP 2435 H=2435:00 +CPU= 12.852
  01:13:28 STEP 2436 H=2436:00 +CPU= 22.135
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002436
  01:13:41 STEP 2437 H=2437:00 +CPU= 12.977
  01:13:54 STEP 2438 H=2438:00 +CPU= 12.740
  01:14:14 STEP 2439 H=2439:00 +CPU= 20.067
  01:14:27 STEP 2440 H=2440:00 +CPU= 13.121
  01:14:40 STEP 2441 H=2441:00 +CPU= 12.486
  01:15:00 STEP 2442 H=2442:00 +CPU= 19.992
  01:15:12 STEP 2443 H=2443:00 +CPU= 12.263
  01:15:25 STEP 2444 H=2444:00 +CPU= 12.774
  01:15:45 STEP 2445 H=2445:00 +CPU= 20.229
  01:15:57 STEP 2446 H=2446:00 +CPU= 12.271
  01:16:10 STEP 2447 H=2447:00 +CPU= 12.859
  01:16:33 STEP 2448 H=2448:00 +CPU= 22.579
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_101.zip
Uploading the intermediate file: upload_file_101.zip
  01:16:45 STEP 2449 H=2449:00 +CPU= 12.451
  01:16:58 STEP 2450 H=2450:00 +CPU= 12.555
  01:17:18 STEP 2451 H=2451:00 +CPU= 19.945
  01:17:31 STEP 2452 H=2452:00 +CPU= 12.629
  01:17:43 STEP 2453 H=2453:00 +CPU= 12.603
  01:18:03 STEP 2454 H=2454:00 +CPU= 19.912
  01:18:16 STEP 2455 H=2455:00 +CPU= 12.631
  01:18:30 STEP 2456 H=2456:00 +CPU= 13.775
  01:18:49 STEP 2457 H=2457:00 +CPU= 19.756
  01:19:02 STEP 2458 H=2458:00 +CPU= 12.842
  01:19:15 STEP 2459 H=2459:00 +CPU= 13.100
  01:19:37 STEP 2460 H=2460:00 +CPU= 21.770
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002460
  01:19:50 STEP 2461 H=2461:00 +CPU= 12.646
  01:20:03 STEP 2462 H=2462:00 +CPU= 13.481
  01:20:25 STEP 2463 H=2463:00 +CPU= 21.281
  01:20:38 STEP 2464 H=2464:00 +CPU= 12.974
  01:20:50 STEP 2465 H=2465:00 +CPU= 11.928
  01:21:11 STEP 2466 H=2466:00 +CPU= 20.511
  01:21:24 STEP 2467 H=2467:00 +CPU= 12.794
  01:21:36 STEP 2468 H=2468:00 +CPU= 12.636
  01:21:57 STEP 2469 H=2469:00 +CPU= 20.318
  01:22:09 STEP 2470 H=2470:00 +CPU= 12.603
  01:22:22 STEP 2471 H=2471:00 +CPU= 12.356
  01:22:45 STEP 2472 H=2472:00 +CPU= 23.142
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_102.zip
Uploading the intermediate file: upload_file_102.zip
  01:22:57 STEP 2473 H=2473:00 +CPU= 11.753
  01:23:09 STEP 2474 H=2474:00 +CPU= 12.725
  01:23:29 STEP 2475 H=2475:00 +CPU= 19.676
  01:23:41 STEP 2476 H=2476:00 +CPU= 12.399
  01:23:53 STEP 2477 H=2477:00 +CPU= 11.621
  01:24:13 STEP 2478 H=2478:00 +CPU= 20.093
  01:24:26 STEP 2479 H=2479:00 +CPU= 12.378
  01:24:37 STEP 2480 H=2480:00 +CPU= 11.746
  01:24:56 STEP 2481 H=2481:00 +CPU= 19.097
  01:25:10 STEP 2482 H=2482:00 +CPU= 13.621
  01:25:23 STEP 2483 H=2483:00 +CPU= 12.304
  01:25:44 STEP 2484 H=2484:00 +CPU= 21.733
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002484
  01:25:57 STEP 2485 H=2485:00 +CPU= 12.640
  01:26:10 STEP 2486 H=2486:00 +CPU= 12.679
  01:26:28 STEP 2487 H=2487:00 +CPU= 18.600
  01:26:42 STEP 2488 H=2488:00 +CPU= 13.114
  01:26:54 STEP 2489 H=2489:00 +CPU= 12.855
  01:27:15 STEP 2490 H=2490:00 +CPU= 20.288
  01:27:27 STEP 2491 H=2491:00 +CPU= 12.377
  01:27:40 STEP 2492 H=2492:00 +CPU= 12.938
  01:28:01 STEP 2493 H=2493:00 +CPU= 20.667
  01:28:14 STEP 2494 H=2494:00 +CPU= 12.765
  01:28:26 STEP 2495 H=2495:00 +CPU= 12.737
  01:28:49 STEP 2496 H=2496:00 +CPU= 22.793
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_103.zip
Uploading the intermediate file: upload_file_103.zip
  01:29:02 STEP 2497 H=2497:00 +CPU= 12.320
  01:29:15 STEP 2498 H=2498:00 +CPU= 12.903
  01:29:35 STEP 2499 H=2499:00 +CPU= 20.233
  01:29:47 STEP 2500 H=2500:00 +CPU= 12.366
  01:30:00 STEP 2501 H=2501:00 +CPU= 12.635
  01:30:20 STEP 2502 H=2502:00 +CPU= 19.804
  01:30:32 STEP 2503 H=2503:00 +CPU= 12.040
  01:30:45 STEP 2504 H=2504:00 +CPU= 12.814
  01:31:05 STEP 2505 H=2505:00 +CPU= 20.140
  01:31:17 STEP 2506 H=2506:00 +CPU= 12.625
  01:31:30 STEP 2507 H=2507:00 +CPU= 12.201
  01:31:52 STEP 2508 H=2508:00 +CPU= 22.122
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002508
  01:32:04 STEP 2509 H=2509:00 +CPU= 12.453
  01:32:17 STEP 2510 H=2510:00 +CPU= 12.299
  01:32:37 STEP 2511 H=2511:00 +CPU= 19.945
  01:32:49 STEP 2512 H=2512:00 +CPU= 12.499
  01:33:01 STEP 2513 H=2513:00 +CPU= 11.523
  01:33:21 STEP 2514 H=2514:00 +CPU= 19.764
  01:33:34 STEP 2515 H=2515:00 +CPU= 13.276
  01:33:47 STEP 2516 H=2516:00 +CPU= 12.966
  01:34:07 STEP 2517 H=2517:00 +CPU= 19.749
  01:34:20 STEP 2518 H=2518:00 +CPU= 13.243
  01:34:33 STEP 2519 H=2519:00 +CPU= 12.439
  01:34:56 STEP 2520 H=2520:00 +CPU= 23.337
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_104.zip
Uploading the intermediate file: upload_file_104.zip
  01:35:08 STEP 2521 H=2521:00 +CPU= 12.028
  01:35:21 STEP 2522 H=2522:00 +CPU= 12.675
  01:35:41 STEP 2523 H=2523:00 +CPU= 20.432
  01:35:54 STEP 2524 H=2524:00 +CPU= 13.016
  01:36:07 STEP 2525 H=2525:00 +CPU= 12.931
  01:36:28 STEP 2526 H=2526:00 +CPU= 20.818
  01:36:41 STEP 2527 H=2527:00 +CPU= 12.614
  01:36:54 STEP 2528 H=2528:00 +CPU= 13.192
  01:37:14 STEP 2529 H=2529:00 +CPU= 20.057
  01:37:27 STEP 2530 H=2530:00 +CPU= 13.278
  01:37:40 STEP 2531 H=2531:00 +CPU= 12.865
  01:38:01 STEP 2532 H=2532:00 +CPU= 20.611
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002532
  01:38:14 STEP 2533 H=2533:00 +CPU= 13.299
  01:38:27 STEP 2534 H=2534:00 +CPU= 12.740
  01:38:46 STEP 2535 H=2535:00 +CPU= 19.308
  01:39:00 STEP 2536 H=2536:00 +CPU= 13.144
  01:39:12 STEP 2537 H=2537:00 +CPU= 11.908
  01:39:32 STEP 2538 H=2538:00 +CPU= 20.482
  01:39:45 STEP 2539 H=2539:00 +CPU= 12.345
  01:39:57 STEP 2540 H=2540:00 +CPU= 12.739
  01:40:18 STEP 2541 H=2541:00 +CPU= 20.807
  01:40:31 STEP 2542 H=2542:00 +CPU= 13.222
  01:40:44 STEP 2543 H=2543:00 +CPU= 12.162
  01:41:06 STEP 2544 H=2544:00 +CPU= 22.451
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_105.zip
Uploading the intermediate file: upload_file_105.zip
  01:41:18 STEP 2545 H=2545:00 +CPU= 11.430
  01:41:30 STEP 2546 H=2546:00 +CPU= 12.655
  01:41:50 STEP 2547 H=2547:00 +CPU= 20.004
  01:42:03 STEP 2548 H=2548:00 +CPU= 12.538
  01:42:15 STEP 2549 H=2549:00 +CPU= 12.400
  01:42:35 STEP 2550 H=2550:00 +CPU= 19.679
  01:42:47 STEP 2551 H=2551:00 +CPU= 12.288
  01:43:00 STEP 2552 H=2552:00 +CPU= 12.535
  01:43:20 STEP 2553 H=2553:00 +CPU= 20.477
  01:43:33 STEP 2554 H=2554:00 +CPU= 13.038
  01:43:47 STEP 2555 H=2555:00 +CPU= 13.113
  01:44:08 STEP 2556 H=2556:00 +CPU= 21.636
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002556
  01:44:20 STEP 2557 H=2557:00 +CPU= 12.130
  01:44:33 STEP 2558 H=2558:00 +CPU= 12.447
  01:44:53 STEP 2559 H=2559:00 +CPU= 19.430
  01:45:05 STEP 2560 H=2560:00 +CPU= 12.810
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           18  MAX ETADOT VERTICAL VEL.=   1.443203761900025E-007
  LON  =    47.8125000000000       degrees
  LAT  =    44.2987941306940       degrees
  01:45:18 STEP 2561 H=2561:00 +CPU= 12.376
  01:45:39 STEP 2562 H=2562:00 +CPU= 20.540
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           20  MAX ETADOT VERTICAL VEL.=   1.594907071081851E-007
  LON  =    45.0000000000000       degrees
  LAT  =    45.4202786265483       degrees
  01:45:50 STEP 2563 H=2563:00 +CPU= 11.936
  01:46:04 STEP 2564 H=2564:00 +CPU= 13.044
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           23  MAX ETADOT VERTICAL VEL.=   2.167872938368826E-007
  LON  =    43.5000000000000       degrees
  LAT  =    46.5417626834057       degrees
  01:46:23 STEP 2565 H=2565:00 +CPU= 19.402
  01:46:35 STEP 2566 H=2566:00 +CPU= 12.270
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            8  MAX ETADOT VERTICAL VEL.=   1.817980887951601E-007
  LON  =    42.0000000000000       degrees
  LAT  =    47.6632462648426       degrees
  01:46:48 STEP 2567 H=2567:00 +CPU= 12.882
  01:47:13 STEP 2568 H=2568:00 +CPU= 24.414
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           25  MAX ETADOT VERTICAL VEL.=   7.818683750925737E-008
  LON  =    40.5000000000000       degrees
  LAT  =    48.7847293305350       degrees
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_106.zip
Uploading the intermediate file: upload_file_106.zip
  01:47:25 STEP 2569 H=2569:00 +CPU= 12.520
  01:47:39 STEP 2570 H=2570:00 +CPU= 13.484
  01:48:00 STEP 2571 H=2571:00 +CPU= 20.935
  01:48:12 STEP 2572 H=2572:00 +CPU= 12.802
  01:48:25 STEP 2573 H=2573:00 +CPU= 12.547
  01:48:46 STEP 2574 H=2574:00 +CPU= 20.513
  01:48:58 STEP 2575 H=2575:00 +CPU= 12.541
  01:49:11 STEP 2576 H=2576:00 +CPU= 13.012
  01:49:32 STEP 2577 H=2577:00 +CPU= 20.431
  01:49:44 STEP 2578 H=2578:00 +CPU= 12.873
  01:49:57 STEP 2579 H=2579:00 +CPU= 12.161
  01:50:19 STEP 2580 H=2580:00 +CPU= 22.355
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002580
  01:50:32 STEP 2581 H=2581:00 +CPU= 12.791
  01:50:44 STEP 2582 H=2582:00 +CPU= 12.521
  01:51:04 STEP 2583 H=2583:00 +CPU= 19.971
  01:51:17 STEP 2584 H=2584:00 +CPU= 12.769
  01:51:30 STEP 2585 H=2585:00 +CPU= 12.324
  01:51:51 STEP 2586 H=2586:00 +CPU= 20.806
  01:52:03 STEP 2587 H=2587:00 +CPU= 12.459
  01:52:15 STEP 2588 H=2588:00 +CPU= 12.230
  01:52:35 STEP 2589 H=2589:00 +CPU= 19.806
  01:52:48 STEP 2590 H=2590:00 +CPU= 12.476
  01:53:00 STEP 2591 H=2591:00 +CPU= 12.524
  01:53:24 STEP 2592 H=2592:00 +CPU= 24.091
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_107.zip
Uploading the intermediate file: upload_file_107.zip
  01:53:37 STEP 2593 H=2593:00 +CPU= 12.642
  01:53:50 STEP 2594 H=2594:00 +CPU= 12.925
  01:54:11 STEP 2595 H=2595:00 +CPU= 20.653
  01:54:24 STEP 2596 H=2596:00 +CPU= 13.202
  01:54:37 STEP 2597 H=2597:00 +CPU= 12.819
  01:54:57 STEP 2598 H=2598:00 +CPU= 20.558
  01:55:11 STEP 2599 H=2599:00 +CPU= 13.226
  01:55:24 STEP 2600 H=2600:00 +CPU= 13.306
  01:55:45 STEP 2601 H=2601:00 +CPU= 20.704
  01:55:57 STEP 2602 H=2602:00 +CPU= 12.238
  01:56:09 STEP 2603 H=2603:00 +CPU= 12.138
  01:56:31 STEP 2604 H=2604:00 +CPU= 22.038
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002604
  01:56:44 STEP 2605 H=2605:00 +CPU= 12.539
  01:56:57 STEP 2606 H=2606:00 +CPU= 12.601
  01:57:17 STEP 2607 H=2607:00 +CPU= 19.965
  01:57:29 STEP 2608 H=2608:00 +CPU= 12.410
  01:57:42 STEP 2609 H=2609:00 +CPU= 12.653
  01:58:04 STEP 2610 H=2610:00 +CPU= 21.509
  01:58:17 STEP 2611 H=2611:00 +CPU= 12.911
  01:58:30 STEP 2612 H=2612:00 +CPU= 13.175
  01:58:50 STEP 2613 H=2613:00 +CPU= 20.402
  01:59:03 STEP 2614 H=2614:00 +CPU= 12.421
  01:59:16 STEP 2615 H=2615:00 +CPU= 13.049
  01:59:38 STEP 2616 H=2616:00 +CPU= 22.706
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_108.zip
Uploading the intermediate file: upload_file_108.zip
  01:59:51 STEP 2617 H=2617:00 +CPU= 12.249
  02:00:03 STEP 2618 H=2618:00 +CPU= 12.660
  02:00:23 STEP 2619 H=2619:00 +CPU= 19.931
  02:00:37 STEP 2620 H=2620:00 +CPU= 13.252
  02:00:49 STEP 2621 H=2621:00 +CPU= 11.941
  02:01:09 STEP 2622 H=2622:00 +CPU= 20.268
  02:01:21 STEP 2623 H=2623:00 +CPU= 12.422
  02:01:34 STEP 2624 H=2624:00 +CPU= 12.701
  02:01:54 STEP 2625 H=2625:00 +CPU= 20.387
  02:02:08 STEP 2626 H=2626:00 +CPU= 13.353
  02:02:20 STEP 2627 H=2627:00 +CPU= 12.049
  02:02:42 STEP 2628 H=2628:00 +CPU= 21.684
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002628
  02:02:54 STEP 2629 H=2629:00 +CPU= 12.315
  02:03:07 STEP 2630 H=2630:00 +CPU= 12.921
  02:03:27 STEP 2631 H=2631:00 +CPU= 19.667
  02:03:40 STEP 2632 H=2632:00 +CPU= 13.284
  02:03:53 STEP 2633 H=2633:00 +CPU= 12.578
  02:04:13 STEP 2634 H=2634:00 +CPU= 19.946
  02:04:25 STEP 2635 H=2635:00 +CPU= 12.619
  02:04:38 STEP 2636 H=2636:00 +CPU= 12.449
  02:04:58 STEP 2637 H=2637:00 +CPU= 19.980
  02:05:10 STEP 2638 H=2638:00 +CPU= 12.269
  02:05:23 STEP 2639 H=2639:00 +CPU= 12.610
  02:05:45 STEP 2640 H=2640:00 +CPU= 22.461
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_109.zip
Uploading the intermediate file: upload_file_109.zip
  02:05:57 STEP 2641 H=2641:00 +CPU= 11.593
  02:06:10 STEP 2642 H=2642:00 +CPU= 13.042
Uploading trickle at timestep: 9504000
  02:06:30 STEP 2643 H=2643:00 +CPU= 20.322
  02:06:43 STEP 2644 H=2644:00 +CPU= 12.562
  02:06:55 STEP 2645 H=2645:00 +CPU= 12.318
  02:07:16 STEP 2646 H=2646:00 +CPU= 21.062
  02:07:29 STEP 2647 H=2647:00 +CPU= 12.354
  02:07:42 STEP 2648 H=2648:00 +CPU= 12.964
  02:08:03 STEP 2649 H=2649:00 +CPU= 20.836
  02:08:16 STEP 2650 H=2650:00 +CPU= 13.218
  02:08:28 STEP 2651 H=2651:00 +CPU= 12.208
  02:08:50 STEP 2652 H=2652:00 +CPU= 21.505
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002652
  02:09:02 STEP 2653 H=2653:00 +CPU= 12.661
  02:09:14 STEP 2654 H=2654:00 +CPU= 11.993
  02:09:35 STEP 2655 H=2655:00 +CPU= 20.130
  02:09:48 STEP 2656 H=2656:00 +CPU= 13.439
  02:10:01 STEP 2657 H=2657:00 +CPU= 12.746
  02:10:22 STEP 2658 H=2658:00 +CPU= 20.847
  02:10:35 STEP 2659 H=2659:00 +CPU= 12.994
  02:10:48 STEP 2660 H=2660:00 +CPU= 13.227
  02:11:08 STEP 2661 H=2661:00 +CPU= 19.657
  02:11:21 STEP 2662 H=2662:00 +CPU= 12.629
  02:11:34 STEP 2663 H=2663:00 +CPU= 13.599
  02:11:58 STEP 2664 H=2664:00 +CPU= 23.461
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_110.zip
Uploading the intermediate file: upload_file_110.zip
  02:12:10 STEP 2665 H=2665:00 +CPU= 12.562
  02:12:24 STEP 2666 H=2666:00 +CPU= 12.989
  02:12:44 STEP 2667 H=2667:00 +CPU= 20.135
  02:12:56 STEP 2668 H=2668:00 +CPU= 12.539
  02:13:08 STEP 2669 H=2669:00 +CPU= 11.905
  02:13:29 STEP 2670 H=2670:00 +CPU= 20.553
  02:13:41 STEP 2671 H=2671:00 +CPU= 12.030
  02:13:54 STEP 2672 H=2672:00 +CPU= 12.964
  02:14:14 STEP 2673 H=2673:00 +CPU= 20.729
  02:14:27 STEP 2674 H=2674:00 +CPU= 12.688
  02:14:41 STEP 2675 H=2675:00 +CPU= 13.331
  02:15:02 STEP 2676 H=2676:00 +CPU= 21.747
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002676
  02:15:15 STEP 2677 H=2677:00 +CPU= 12.265
  02:15:27 STEP 2678 H=2678:00 +CPU= 12.496
  02:15:46 STEP 2679 H=2679:00 +CPU= 18.777
  02:15:58 STEP 2680 H=2680:00 +CPU= 12.110
  02:16:11 STEP 2681 H=2681:00 +CPU= 12.407
  02:16:31 STEP 2682 H=2682:00 +CPU= 20.171
  02:16:44 STEP 2683 H=2683:00 +CPU= 12.231
  02:16:57 STEP 2684 H=2684:00 +CPU= 13.051
  02:17:16 STEP 2685 H=2685:00 +CPU= 19.343
  02:17:29 STEP 2686 H=2686:00 +CPU= 12.734
  02:17:42 STEP 2687 H=2687:00 +CPU= 12.851
  02:18:05 STEP 2688 H=2688:00 +CPU= 23.659
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_111.zip
Uploading the intermediate file: upload_file_111.zip
  02:18:17 STEP 2689 H=2689:00 +CPU= 11.986
  02:18:30 STEP 2690 H=2690:00 +CPU= 12.420
  02:18:50 STEP 2691 H=2691:00 +CPU= 19.702
  02:19:02 STEP 2692 H=2692:00 +CPU= 12.805
  02:19:15 STEP 2693 H=2693:00 +CPU= 12.727
  02:19:35 STEP 2694 H=2694:00 +CPU= 19.451
  02:19:47 STEP 2695 H=2695:00 +CPU= 12.101
  02:20:00 STEP 2696 H=2696:00 +CPU= 13.174
  02:20:19 STEP 2697 H=2697:00 +CPU= 19.356
  02:20:32 STEP 2698 H=2698:00 +CPU= 12.915
  02:20:45 STEP 2699 H=2699:00 +CPU= 12.646
  02:21:07 STEP 2700 H=2700:00 +CPU= 21.588
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002700
  02:21:19 STEP 2701 H=2701:00 +CPU= 12.696
  02:21:33 STEP 2702 H=2702:00 +CPU= 13.154
  02:21:53 STEP 2703 H=2703:00 +CPU= 19.892
  02:22:05 STEP 2704 H=2704:00 +CPU= 12.578
  02:22:18 STEP 2705 H=2705:00 +CPU= 12.795
  02:22:39 STEP 2706 H=2706:00 +CPU= 20.793
  02:22:51 STEP 2707 H=2707:00 +CPU= 12.137
  02:23:04 STEP 2708 H=2708:00 +CPU= 13.182
  02:23:25 STEP 2709 H=2709:00 +CPU= 20.153
  02:23:38 STEP 2710 H=2710:00 +CPU= 13.603
  02:23:50 STEP 2711 H=2711:00 +CPU= 12.252
  02:24:14 STEP 2712 H=2712:00 +CPU= 23.598
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_112.zip
Uploading the intermediate file: upload_file_112.zip
  02:24:27 STEP 2713 H=2713:00 +CPU= 13.028
  02:24:41 STEP 2714 H=2714:00 +CPU= 13.340
  02:25:00 STEP 2715 H=2715:00 +CPU= 19.661
  02:25:13 STEP 2716 H=2716:00 +CPU= 13.129
  02:25:26 STEP 2717 H=2717:00 +CPU= 12.619
  02:25:46 STEP 2718 H=2718:00 +CPU= 20.135
  02:25:58 STEP 2719 H=2719:00 +CPU= 12.055
  02:26:11 STEP 2720 H=2720:00 +CPU= 12.846
  02:26:31 STEP 2721 H=2721:00 +CPU= 19.781
  02:26:44 STEP 2722 H=2722:00 +CPU= 12.762
  02:26:57 STEP 2723 H=2723:00 +CPU= 12.739
  02:27:19 STEP 2724 H=2724:00 +CPU= 21.956
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002724
  02:27:31 STEP 2725 H=2725:00 +CPU= 12.389
  02:27:44 STEP 2726 H=2726:00 +CPU= 12.576
  02:28:05 STEP 2727 H=2727:00 +CPU= 20.850
  02:28:17 STEP 2728 H=2728:00 +CPU= 12.734
  02:28:30 STEP 2729 H=2729:00 +CPU= 12.187
  02:28:51 STEP 2730 H=2730:00 +CPU= 20.784
  02:29:03 STEP 2731 H=2731:00 +CPU= 12.054
  02:29:16 STEP 2732 H=2732:00 +CPU= 12.840
  02:29:36 STEP 2733 H=2733:00 +CPU= 19.948
  02:29:48 STEP 2734 H=2734:00 +CPU= 12.589
  02:30:01 STEP 2735 H=2735:00 +CPU= 12.335
  02:30:24 STEP 2736 H=2736:00 +CPU= 23.156
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_113.zip
Uploading the intermediate file: upload_file_113.zip
  02:30:36 STEP 2737 H=2737:00 +CPU= 12.019
  02:30:48 STEP 2738 H=2738:00 +CPU= 12.187
  02:31:08 STEP 2739 H=2739:00 +CPU= 19.671
  02:31:21 STEP 2740 H=2740:00 +CPU= 12.641
  02:31:33 STEP 2741 H=2741:00 +CPU= 11.914
  02:31:52 STEP 2742 H=2742:00 +CPU= 19.556
  02:32:05 STEP 2743 H=2743:00 +CPU= 12.551
  02:32:17 STEP 2744 H=2744:00 +CPU= 12.546
  02:32:38 STEP 2745 H=2745:00 +CPU= 20.225
  02:32:51 STEP 2746 H=2746:00 +CPU= 13.171
  02:33:04 STEP 2747 H=2747:00 +CPU= 12.653
  02:33:26 STEP 2748 H=2748:00 +CPU= 22.037
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002748
  02:33:39 STEP 2749 H=2749:00 +CPU= 12.982
  02:33:52 STEP 2750 H=2750:00 +CPU= 12.859
  02:34:12 STEP 2751 H=2751:00 +CPU= 20.059
  02:34:25 STEP 2752 H=2752:00 +CPU= 12.633
  02:34:37 STEP 2753 H=2753:00 +CPU= 11.997
  02:34:57 STEP 2754 H=2754:00 +CPU= 20.139
  02:35:10 STEP 2755 H=2755:00 +CPU= 12.886
  02:35:23 STEP 2756 H=2756:00 +CPU= 12.888
  02:35:42 STEP 2757 H=2757:00 +CPU= 19.168
  02:35:55 STEP 2758 H=2758:00 +CPU= 12.970
  02:36:08 STEP 2759 H=2759:00 +CPU= 13.296
  02:36:32 STEP 2760 H=2760:00 +CPU= 23.596
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_114.zip
Uploading the intermediate file: upload_file_114.zip
  02:36:44 STEP 2761 H=2761:00 +CPU= 12.456
  02:36:57 STEP 2762 H=2762:00 +CPU= 12.890
  02:37:17 STEP 2763 H=2763:00 +CPU= 20.049
  02:37:30 STEP 2764 H=2764:00 +CPU= 12.642
  02:37:42 STEP 2765 H=2765:00 +CPU= 12.315
  02:38:03 STEP 2766 H=2766:00 +CPU= 20.301
  02:38:15 STEP 2767 H=2767:00 +CPU= 12.585
  02:38:28 STEP 2768 H=2768:00 +CPU= 12.990
  02:38:47 STEP 2769 H=2769:00 +CPU= 19.252
  02:39:00 STEP 2770 H=2770:00 +CPU= 12.375
  02:39:13 STEP 2771 H=2771:00 +CPU= 12.644
  02:39:34 STEP 2772 H=2772:00 +CPU= 21.821
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002772
  02:39:47 STEP 2773 H=2773:00 +CPU= 12.100
  02:40:00 STEP 2774 H=2774:00 +CPU= 13.546
  02:40:20 STEP 2775 H=2775:00 +CPU= 19.561
  02:40:33 STEP 2776 H=2776:00 +CPU= 12.748
  02:40:45 STEP 2777 H=2777:00 +CPU= 12.367
  02:41:04 STEP 2778 H=2778:00 +CPU= 19.051
  02:41:17 STEP 2779 H=2779:00 +CPU= 12.378
  02:41:30 STEP 2780 H=2780:00 +CPU= 13.205
  02:41:49 STEP 2781 H=2781:00 +CPU= 19.624
  02:42:02 STEP 2782 H=2782:00 +CPU= 12.741
  02:42:14 STEP 2783 H=2783:00 +CPU= 12.074
  02:42:36 STEP 2784 H=2784:00 +CPU= 21.813
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_115.zip
Uploading the intermediate file: upload_file_115.zip
  02:42:49 STEP 2785 H=2785:00 +CPU= 12.651
  02:43:01 STEP 2786 H=2786:00 +CPU= 12.419
  02:43:21 STEP 2787 H=2787:00 +CPU= 20.076
  02:43:35 STEP 2788 H=2788:00 +CPU= 13.353
  02:43:47 STEP 2789 H=2789:00 +CPU= 12.220
  02:44:07 STEP 2790 H=2790:00 +CPU= 19.590
  02:44:19 STEP 2791 H=2791:00 +CPU= 12.648
  02:44:33 STEP 2792 H=2792:00 +CPU= 13.346
  02:44:53 STEP 2793 H=2793:00 +CPU= 20.130
  02:45:06 STEP 2794 H=2794:00 +CPU= 12.809
  02:45:18 STEP 2795 H=2795:00 +CPU= 12.517
  02:45:40 STEP 2796 H=2796:00 +CPU= 21.720
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002796
  02:45:52 STEP 2797 H=2797:00 +CPU= 12.150
  02:46:05 STEP 2798 H=2798:00 +CPU= 13.078
  02:46:25 STEP 2799 H=2799:00 +CPU= 19.786
  02:46:38 STEP 2800 H=2800:00 +CPU= 12.811
  02:46:51 STEP 2801 H=2801:00 +CPU= 12.237
  02:47:12 STEP 2802 H=2802:00 +CPU= 20.978
  02:47:24 STEP 2803 H=2803:00 +CPU= 12.095
  02:47:36 STEP 2804 H=2804:00 +CPU= 12.542
  02:47:56 STEP 2805 H=2805:00 +CPU= 20.046
  02:48:09 STEP 2806 H=2806:00 +CPU= 12.745
  02:48:22 STEP 2807 H=2807:00 +CPU= 12.747
  02:48:46 STEP 2808 H=2808:00 +CPU= 23.512
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_116.zip
Uploading the intermediate file: upload_file_116.zip
  02:48:58 STEP 2809 H=2809:00 +CPU= 12.503
  02:49:11 STEP 2810 H=2810:00 +CPU= 12.496
  02:49:31 STEP 2811 H=2811:00 +CPU= 20.328
  02:49:44 STEP 2812 H=2812:00 +CPU= 12.788
  02:49:56 STEP 2813 H=2813:00 +CPU= 12.246
  02:50:16 STEP 2814 H=2814:00 +CPU= 19.971
  02:50:28 STEP 2815 H=2815:00 +CPU= 11.692
  02:50:40 STEP 2816 H=2816:00 +CPU= 12.313
  02:51:00 STEP 2817 H=2817:00 +CPU= 19.847
  02:51:12 STEP 2818 H=2818:00 +CPU= 12.382
  02:51:24 STEP 2819 H=2819:00 +CPU= 11.477
  02:51:46 STEP 2820 H=2820:00 +CPU= 22.398
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002820
  02:51:59 STEP 2821 H=2821:00 +CPU= 12.435
  02:52:12 STEP 2822 H=2822:00 +CPU= 12.680
  02:52:32 STEP 2823 H=2823:00 +CPU= 20.131
  02:52:45 STEP 2824 H=2824:00 +CPU= 13.057
  02:52:58 STEP 2825 H=2825:00 +CPU= 12.595
  02:53:18 STEP 2826 H=2826:00 +CPU= 20.666
  02:53:31 STEP 2827 H=2827:00 +CPU= 12.595
  02:53:44 STEP 2828 H=2828:00 +CPU= 12.786
  02:54:04 STEP 2829 H=2829:00 +CPU= 20.169
  02:54:17 STEP 2830 H=2830:00 +CPU= 13.068
  02:54:30 STEP 2831 H=2831:00 +CPU= 13.187
  02:54:54 STEP 2832 H=2832:00 +CPU= 23.325
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_117.zip
Uploading the intermediate file: upload_file_117.zip
  02:55:05 STEP 2833 H=2833:00 +CPU= 11.177
  02:55:18 STEP 2834 H=2834:00 +CPU= 12.970
  02:55:37 STEP 2835 H=2835:00 +CPU= 18.966
  02:55:50 STEP 2836 H=2836:00 +CPU= 12.646
  02:56:02 STEP 2837 H=2837:00 +CPU= 12.121
  02:56:22 STEP 2838 H=2838:00 +CPU= 20.089
  02:56:34 STEP 2839 H=2839:00 +CPU= 12.319
  02:56:47 STEP 2840 H=2840:00 +CPU= 13.192
  02:57:08 STEP 2841 H=2841:00 +CPU= 20.203
  02:57:21 STEP 2842 H=2842:00 +CPU= 12.909
  02:57:33 STEP 2843 H=2843:00 +CPU= 12.705
  02:57:56 STEP 2844 H=2844:00 +CPU= 22.331
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002844
  02:58:09 STEP 2845 H=2845:00 +CPU= 12.617
  02:58:21 STEP 2846 H=2846:00 +CPU= 12.634
  02:58:41 STEP 2847 H=2847:00 +CPU= 20.265
  02:58:54 STEP 2848 H=2848:00 +CPU= 12.825
  02:59:07 STEP 2849 H=2849:00 +CPU= 12.501
  02:59:28 STEP 2850 H=2850:00 +CPU= 21.070
  02:59:42 STEP 2851 H=2851:00 +CPU= 13.266
  02:59:54 STEP 2852 H=2852:00 +CPU= 12.790
  03:00:14 STEP 2853 H=2853:00 +CPU= 19.468
  03:00:27 STEP 2854 H=2854:00 +CPU= 12.740
  03:00:40 STEP 2855 H=2855:00 +CPU= 12.950
  03:01:03 STEP 2856 H=2856:00 +CPU= 23.685
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_118.zip
Uploading the intermediate file: upload_file_118.zip
  03:01:16 STEP 2857 H=2857:00 +CPU= 12.549
  03:01:29 STEP 2858 H=2858:00 +CPU= 12.929
  03:01:49 STEP 2859 H=2859:00 +CPU= 19.973
  03:02:02 STEP 2860 H=2860:00 +CPU= 12.765
  03:02:15 STEP 2861 H=2861:00 +CPU= 13.001
  03:02:35 STEP 2862 H=2862:00 +CPU= 20.081
  03:02:47 STEP 2863 H=2863:00 +CPU= 12.078
  03:02:59 STEP 2864 H=2864:00 +CPU= 12.639
  03:03:18 STEP 2865 H=2865:00 +CPU= 18.337
  03:03:31 STEP 2866 H=2866:00 +CPU= 12.977
  03:03:43 STEP 2867 H=2867:00 +CPU= 12.314
  03:04:05 STEP 2868 H=2868:00 +CPU= 21.672
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002868
  03:04:18 STEP 2869 H=2869:00 +CPU= 12.917
  03:04:31 STEP 2870 H=2870:00 +CPU= 12.794
  03:04:51 STEP 2871 H=2871:00 +CPU= 20.438
  03:05:05 STEP 2872 H=2872:00 +CPU= 13.601
  03:05:18 STEP 2873 H=2873:00 +CPU= 12.983
  03:05:39 STEP 2874 H=2874:00 +CPU= 21.138
  03:05:52 STEP 2875 H=2875:00 +CPU= 12.621
  03:06:04 STEP 2876 H=2876:00 +CPU= 11.995
  03:06:25 STEP 2877 H=2877:00 +CPU= 20.478
  03:06:38 STEP 2878 H=2878:00 +CPU= 12.988
  03:06:50 STEP 2879 H=2879:00 +CPU= 12.588
  03:07:14 STEP 2880 H=2880:00 +CPU= 23.873
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_119.zip
Uploading the intermediate file: upload_file_119.zip
  03:07:27 STEP 2881 H=2881:00 +CPU= 12.984
Uploading trickle at timestep: 10368000
  03:07:40 STEP 2882 H=2882:00 +CPU= 13.037
  03:08:00 STEP 2883 H=2883:00 +CPU= 19.617
  03:08:13 STEP 2884 H=2884:00 +CPU= 12.893
  03:08:25 STEP 2885 H=2885:00 +CPU= 12.253
  03:08:45 STEP 2886 H=2886:00 +CPU= 20.127
  03:08:58 STEP 2887 H=2887:00 +CPU= 12.387
  03:09:10 STEP 2888 H=2888:00 +CPU= 12.738
  03:09:30 STEP 2889 H=2889:00 +CPU= 20.014
  03:09:43 STEP 2890 H=2890:00 +CPU= 12.496
  03:09:55 STEP 2891 H=2891:00 +CPU= 12.436
  03:10:18 STEP 2892 H=2892:00 +CPU= 22.309
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002892
  03:10:31 STEP 2893 H=2893:00 +CPU= 12.640
  03:10:43 STEP 2894 H=2894:00 +CPU= 12.907
  03:11:04 STEP 2895 H=2895:00 +CPU= 19.872
  03:11:17 STEP 2896 H=2896:00 +CPU= 13.188
  03:11:29 STEP 2897 H=2897:00 +CPU= 12.390
  03:11:50 STEP 2898 H=2898:00 +CPU= 20.354
  03:12:02 STEP 2899 H=2899:00 +CPU= 12.055
  03:12:15 STEP 2900 H=2900:00 +CPU= 12.902
  03:12:35 STEP 2901 H=2901:00 +CPU= 20.127
  03:12:48 STEP 2902 H=2902:00 +CPU= 12.768
  03:13:02 STEP 2903 H=2903:00 +CPU= 13.725
  03:13:25 STEP 2904 H=2904:00 +CPU= 23.189
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_120.zip
Uploading the intermediate file: upload_file_120.zip
  03:13:38 STEP 2905 H=2905:00 +CPU= 12.301
  03:13:50 STEP 2906 H=2906:00 +CPU= 12.351
  03:14:10 STEP 2907 H=2907:00 +CPU= 20.279
  03:14:24 STEP 2908 H=2908:00 +CPU= 13.449
  03:14:36 STEP 2909 H=2909:00 +CPU= 12.441
  03:14:56 STEP 2910 H=2910:00 +CPU= 20.098
  03:15:09 STEP 2911 H=2911:00 +CPU= 12.890
  03:15:22 STEP 2912 H=2912:00 +CPU= 12.806
  03:15:42 STEP 2913 H=2913:00 +CPU= 19.410
  03:15:54 STEP 2914 H=2914:00 +CPU= 12.518
  03:16:06 STEP 2915 H=2915:00 +CPU= 12.270
  03:16:28 STEP 2916 H=2916:00 +CPU= 21.664
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002916
  03:16:40 STEP 2917 H=2917:00 +CPU= 12.273
  03:16:53 STEP 2918 H=2918:00 +CPU= 12.657
  03:17:14 STEP 2919 H=2919:00 +CPU= 20.677
  03:17:29 STEP 2920 H=2920:00 +CPU= 13.096
  03:17:42 STEP 2921 H=2921:00 +CPU= 12.809
  03:18:03 STEP 2922 H=2922:00 +CPU= 21.263
  03:18:16 STEP 2923 H=2923:00 +CPU= 12.418
  03:18:29 STEP 2924 H=2924:00 +CPU= 13.154
  03:18:50 STEP 2925 H=2925:00 +CPU= 20.609
  03:19:03 STEP 2926 H=2926:00 +CPU= 12.784
  03:19:15 STEP 2927 H=2927:00 +CPU= 12.370
  03:19:38 STEP 2928 H=2928:00 +CPU= 22.523
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_121.zip
Uploading the intermediate file: upload_file_121.zip
  03:19:50 STEP 2929 H=2929:00 +CPU= 12.209
  03:20:03 STEP 2930 H=2930:00 +CPU= 12.585
  03:20:23 STEP 2931 H=2931:00 +CPU= 20.182
  03:20:35 STEP 2932 H=2932:00 +CPU= 12.664
  03:20:48 STEP 2933 H=2933:00 +CPU= 12.374
  03:21:08 STEP 2934 H=2934:00 +CPU= 19.903
  03:21:20 STEP 2935 H=2935:00 +CPU= 11.752
  03:21:33 STEP 2936 H=2936:00 +CPU= 13.136
  03:21:52 STEP 2937 H=2937:00 +CPU= 19.040
  03:22:04 STEP 2938 H=2938:00 +CPU= 12.114
  03:22:16 STEP 2939 H=2939:00 +CPU= 11.858
  03:22:38 STEP 2940 H=2940:00 +CPU= 21.987
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002940
  03:22:50 STEP 2941 H=2941:00 +CPU= 12.455
  03:23:03 STEP 2942 H=2942:00 +CPU= 12.969
  03:23:24 STEP 2943 H=2943:00 +CPU= 20.287
  03:23:37 STEP 2944 H=2944:00 +CPU= 12.786
  03:23:49 STEP 2945 H=2945:00 +CPU= 11.998
  03:24:09 STEP 2946 H=2946:00 +CPU= 20.229
  03:24:22 STEP 2947 H=2947:00 +CPU= 12.416
  03:24:34 STEP 2948 H=2948:00 +CPU= 12.860
  03:24:55 STEP 2949 H=2949:00 +CPU= 20.772
  03:25:08 STEP 2950 H=2950:00 +CPU= 12.330
  03:25:20 STEP 2951 H=2951:00 +CPU= 12.453
  03:25:43 STEP 2952 H=2952:00 +CPU= 23.159
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.14111680895585     
  MAXGPFV : MAX. VALUE =   0.741262999098351     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    306703178 BYTES IN      8 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0053( 5.7%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 03:25:43 STEP 2952 H=2952:00 +CPU= 23.159
 END CNT3
 NSTEP =  2952 CNT0   000000000  20.443  20.443  20.473   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   120.4     0.0   120.4     0.6   181.5
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1108.2    1108.2      6.68      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     162.3     162.3      0.90      0.00
  10 SCAN2M - PHYSICS                             2953    9587.6    9587.6     53.36      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     690.8     690.8      0.32      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      12.2      12.2      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    7538.0    7538.0     13.99      0.00
  14 SUINIF                                          1    1095.3    1095.3      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      27.2      27.2      0.01      0.00
  18 SUSPECG                                         1     163.5     163.5      0.00      0.00
  19 SUSPEC                                          1     167.7     167.7      0.00      0.00
  24 SUGRIDU                                         1     691.4     691.4      0.00      0.00
  25 SPECRT                                          1     131.5     131.5      0.00      0.00
  26 SUGRIDF                                         1     104.7     104.7      0.00      0.00
  27 RESTART FILES - WRITING                       123    1387.1    1387.1      0.32      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1316.1    1316.1      0.61      0.00
  31 POSDDH IN STEPO                                13       0.5       0.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    1841.3    1841.3     10.25      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    1651.4    1651.4      9.19      0.00
  39 SU0YOMB                                         1     182.1     182.1      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953       8.2       8.2      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952      69.3      69.3      0.39      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      13.3      13.3      0.07      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094      80.1      80.1      1.52      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152      79.7      79.7      0.92      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      33.2      33.2      0.38      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      29.3      29.3      0.56      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      12.7      12.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      10.4      10.4      0.20      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152       9.2       9.2      0.11      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      15.7      15.7      0.30      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      12.6      12.6      0.15      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    53061.3 CPU TIME   45462.3 VECTOR TIME    45462.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      200.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/19/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/19/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213444/ICMGGhnw4+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0006_2019110100_123_993_12213444_0_r939316324_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
03:29:06 (1116421): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:06 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 10,623,600 45,462 0.0043
09 May 2023 16:53:06 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 10,368,000 44,362 0.0043
09 May 2023 16:53:03 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 9,504,000 40,686 0.0043
09 May 2023 16:53:00 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 8,640,000 36,999 0.0043
09 May 2023 16:52:57 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 7,776,000 33,313 0.0043
09 May 2023 16:52:54 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 6,912,000 29,632 0.0043
09 May 2023 16:52:52 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 6,048,000 25,958 0.0043
09 May 2023 16:52:49 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 5,184,000 22,263 0.0043
09 May 2023 16:52:47 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 4,320,000 18,560 0.0043
09 May 2023 16:52:45 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 3,456,000 14,867 0.0043
09 May 2023 16:52:43 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 2,592,000 11,173 0.0043
09 May 2023 16:52:41 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 1,728,000 7,489 0.0043
09 May 2023 16:52:38 1513725 22314790 oifs_43r3_0006_2019110100_123_993_12213444_0 864,000 3,737 0.0043


©2024 climateprediction.net