climateprediction.net home page
Task 22301751

Task 22301751

Name oifs_43r3_ps_0831_2005050100_123_974_12191475_1
Workunit 12191475
Created 22 Jan 2023, 11:59:42 UTC
Sent 22 Jan 2023, 12:08:16 UTC
Report deadline 23 Mar 2023, 12:08:16 UTC
Received 27 Jan 2023, 7:33:16 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1495420
Run time 20 hours 33 min 43 sec
CPU time 19 hours 55 min 58 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.91 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,779.76 MB
Peak swap size 4,978.00 MB
Peak disk usage 3,768.28 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002412
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002412
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_100.zip
Uploading the intermediate file: upload_file_100.zip
  08:06:20 STEP 2425 H=2425:00 +CPU= 20.641
  08:06:42 STEP 2426 H=2426:00 +CPU= 22.009
  08:07:15 STEP 2427 H=2427:00 +CPU= 32.981
  08:07:36 STEP 2428 H=2428:00 +CPU= 21.597
  08:07:57 STEP 2429 H=2429:00 +CPU= 20.621
  08:08:31 STEP 2430 H=2430:00 +CPU= 34.312
  08:08:52 STEP 2431 H=2431:00 +CPU= 20.855
  08:09:14 STEP 2432 H=2432:00 +CPU= 21.512
  08:09:47 STEP 2433 H=2433:00 +CPU= 33.328
  08:10:09 STEP 2434 H=2434:00 +CPU= 21.597
  08:10:29 STEP 2435 H=2435:00 +CPU= 20.567
  08:11:08 STEP 2436 H=2436:00 +CPU= 38.235
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002436
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002436
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002436
  08:11:28 STEP 2437 H=2437:00 +CPU= 20.323
  08:11:49 STEP 2438 H=2438:00 +CPU= 21.174
  08:12:23 STEP 2439 H=2439:00 +CPU= 34.132
  08:12:46 STEP 2440 H=2440:00 +CPU= 22.854
  08:13:07 STEP 2441 H=2441:00 +CPU= 20.976
  08:13:41 STEP 2442 H=2442:00 +CPU= 33.379
  08:14:01 STEP 2443 H=2443:00 +CPU= 20.180
  08:14:23 STEP 2444 H=2444:00 +CPU= 21.889
  08:14:57 STEP 2445 H=2445:00 +CPU= 33.364
  08:15:18 STEP 2446 H=2446:00 +CPU= 21.518
  08:15:40 STEP 2447 H=2447:00 +CPU= 21.313
  08:16:20 STEP 2448 H=2448:00 +CPU= 39.854
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002448
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002448
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002448
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002424
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002424
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002424
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002436
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002436
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002436
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_101.zip
Uploading the intermediate file: upload_file_101.zip
  08:16:41 STEP 2449 H=2449:00 +CPU= 20.945
  08:17:01 STEP 2450 H=2450:00 +CPU= 20.115
  08:17:35 STEP 2451 H=2451:00 +CPU= 33.469
  08:17:56 STEP 2452 H=2452:00 +CPU= 21.505
  08:18:16 STEP 2453 H=2453:00 +CPU= 19.416
  08:18:49 STEP 2454 H=2454:00 +CPU= 33.578
  08:19:10 STEP 2455 H=2455:00 +CPU= 20.951
  08:19:31 STEP 2456 H=2456:00 +CPU= 21.127
  08:20:03 STEP 2457 H=2457:00 +CPU= 31.651
  08:20:23 STEP 2458 H=2458:00 +CPU= 19.825
  08:20:42 STEP 2459 H=2459:00 +CPU= 18.989
  08:21:19 STEP 2460 H=2460:00 +CPU= 37.185
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002460
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002460
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002460
  08:21:40 STEP 2461 H=2461:00 +CPU= 20.458
  08:22:01 STEP 2462 H=2462:00 +CPU= 20.835
  08:22:34 STEP 2463 H=2463:00 +CPU= 33.721
  08:22:55 STEP 2464 H=2464:00 +CPU= 20.875
  08:23:16 STEP 2465 H=2465:00 +CPU= 20.191
  08:23:51 STEP 2466 H=2466:00 +CPU= 34.838
  08:24:12 STEP 2467 H=2467:00 +CPU= 21.663
  08:24:35 STEP 2468 H=2468:00 +CPU= 21.854
  08:25:08 STEP 2469 H=2469:00 +CPU= 33.292
  08:25:30 STEP 2470 H=2470:00 +CPU= 21.823
  08:25:52 STEP 2471 H=2471:00 +CPU= 21.848
  08:26:32 STEP 2472 H=2472:00 +CPU= 40.247
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002472
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002472
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002472
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002448
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002448
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002448
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002460
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002460
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002460
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_102.zip
Uploading the intermediate file: upload_file_102.zip
  08:26:53 STEP 2473 H=2473:00 +CPU= 20.802
  08:27:15 STEP 2474 H=2474:00 +CPU= 21.647
  08:27:48 STEP 2475 H=2475:00 +CPU= 33.480
  08:28:10 STEP 2476 H=2476:00 +CPU= 21.665
  08:28:30 STEP 2477 H=2477:00 +CPU= 19.341
  08:29:03 STEP 2478 H=2478:00 +CPU= 32.632
  08:29:24 STEP 2479 H=2479:00 +CPU= 21.307
  08:29:45 STEP 2480 H=2480:00 +CPU= 21.093
  08:30:18 STEP 2481 H=2481:00 +CPU= 32.703
  08:30:38 STEP 2482 H=2482:00 +CPU= 20.669
  08:30:59 STEP 2483 H=2483:00 +CPU= 20.284
  08:31:36 STEP 2484 H=2484:00 +CPU= 37.294
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002484
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002484
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002484
  08:31:57 STEP 2485 H=2485:00 +CPU= 20.750
  08:32:18 STEP 2486 H=2486:00 +CPU= 20.843
  08:32:51 STEP 2487 H=2487:00 +CPU= 33.134
  08:33:14 STEP 2488 H=2488:00 +CPU= 22.364
  08:33:35 STEP 2489 H=2489:00 +CPU= 20.707
  08:34:10 STEP 2490 H=2490:00 +CPU= 35.240
  08:34:31 STEP 2491 H=2491:00 +CPU= 21.120
  08:34:53 STEP 2492 H=2492:00 +CPU= 21.574
  08:35:27 STEP 2493 H=2493:00 +CPU= 34.069
  08:35:48 STEP 2494 H=2494:00 +CPU= 21.314
  08:36:10 STEP 2495 H=2495:00 +CPU= 21.299
  08:36:50 STEP 2496 H=2496:00 +CPU= 40.353
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002496
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002496
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002496
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002472
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002472
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002472
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002484
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002484
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002484
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_103.zip
Uploading the intermediate file: upload_file_103.zip
  08:37:10 STEP 2497 H=2497:00 +CPU= 19.972
  08:37:31 STEP 2498 H=2498:00 +CPU= 21.032
  08:38:05 STEP 2499 H=2499:00 +CPU= 33.209
  08:38:26 STEP 2500 H=2500:00 +CPU= 21.575
  08:38:47 STEP 2501 H=2501:00 +CPU= 20.533
  08:39:21 STEP 2502 H=2502:00 +CPU= 34.105
  08:39:42 STEP 2503 H=2503:00 +CPU= 20.747
  08:40:04 STEP 2504 H=2504:00 +CPU= 22.074
  08:40:39 STEP 2505 H=2505:00 +CPU= 34.175
  08:41:00 STEP 2506 H=2506:00 +CPU= 21.724
  08:41:22 STEP 2507 H=2507:00 +CPU= 21.099
  08:41:58 STEP 2508 H=2508:00 +CPU= 36.120
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002508
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002508
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002508
  08:42:19 STEP 2509 H=2509:00 +CPU= 20.931
  08:42:41 STEP 2510 H=2510:00 +CPU= 22.756
  08:43:14 STEP 2511 H=2511:00 +CPU= 32.367
  08:43:35 STEP 2512 H=2512:00 +CPU= 21.126
  08:43:56 STEP 2513 H=2513:00 +CPU= 21.070
  08:44:32 STEP 2514 H=2514:00 +CPU= 35.121
  08:44:52 STEP 2515 H=2515:00 +CPU= 20.585
  08:45:12 STEP 2516 H=2516:00 +CPU= 19.894
  08:45:45 STEP 2517 H=2517:00 +CPU= 32.618
  08:46:06 STEP 2518 H=2518:00 +CPU= 20.966
  08:46:26 STEP 2519 H=2519:00 +CPU= 20.049
  08:47:04 STEP 2520 H=2520:00 +CPU= 38.216
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002520
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002520
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002520
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002496
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002496
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002496
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002508
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002508
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002508
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_104.zip
Uploading the intermediate file: upload_file_104.zip
  08:47:25 STEP 2521 H=2521:00 +CPU= 20.614
  08:47:46 STEP 2522 H=2522:00 +CPU= 21.208
  08:48:17 STEP 2523 H=2523:00 +CPU= 30.627
  08:48:38 STEP 2524 H=2524:00 +CPU= 20.979
  08:48:59 STEP 2525 H=2525:00 +CPU= 20.511
  08:49:32 STEP 2526 H=2526:00 +CPU= 33.483
  08:49:52 STEP 2527 H=2527:00 +CPU= 20.175
  08:50:12 STEP 2528 H=2528:00 +CPU= 19.746
  08:50:45 STEP 2529 H=2529:00 +CPU= 33.146
  08:51:07 STEP 2530 H=2530:00 +CPU= 21.579
  08:51:28 STEP 2531 H=2531:00 +CPU= 20.887
  08:52:06 STEP 2532 H=2532:00 +CPU= 37.378
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002532
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002532
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002532
  08:52:25 STEP 2533 H=2533:00 +CPU= 19.747
  08:52:48 STEP 2534 H=2534:00 +CPU= 22.079
  08:53:21 STEP 2535 H=2535:00 +CPU= 32.785
  08:53:43 STEP 2536 H=2536:00 +CPU= 21.710
  08:54:03 STEP 2537 H=2537:00 +CPU= 20.482
  08:54:37 STEP 2538 H=2538:00 +CPU= 33.624
  08:54:58 STEP 2539 H=2539:00 +CPU= 20.747
  08:55:19 STEP 2540 H=2540:00 +CPU= 21.418
  08:55:53 STEP 2541 H=2541:00 +CPU= 33.679
  08:56:15 STEP 2542 H=2542:00 +CPU= 21.849
  08:56:36 STEP 2543 H=2543:00 +CPU= 21.226
  08:57:16 STEP 2544 H=2544:00 +CPU= 39.943
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002544
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002544
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002544
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002520
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002520
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002520
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002532
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002532
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002532
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_105.zip
Uploading the intermediate file: upload_file_105.zip
  08:57:36 STEP 2545 H=2545:00 +CPU= 20.166
  08:57:57 STEP 2546 H=2546:00 +CPU= 20.849
  08:58:30 STEP 2547 H=2547:00 +CPU= 32.401
  08:58:52 STEP 2548 H=2548:00 +CPU= 21.791
  08:59:12 STEP 2549 H=2549:00 +CPU= 20.128
  08:59:45 STEP 2550 H=2550:00 +CPU= 33.465
  09:00:07 STEP 2551 H=2551:00 +CPU= 21.474
  09:00:29 STEP 2552 H=2552:00 +CPU= 21.709
  09:01:03 STEP 2553 H=2553:00 +CPU= 33.939
  09:01:24 STEP 2554 H=2554:00 +CPU= 20.777
  09:01:44 STEP 2555 H=2555:00 +CPU= 20.416
  09:02:21 STEP 2556 H=2556:00 +CPU= 36.605
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002556
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002556
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002556
  09:02:42 STEP 2557 H=2557:00 +CPU= 21.426
  09:03:03 STEP 2558 H=2558:00 +CPU= 20.928
  09:03:36 STEP 2559 H=2559:00 +CPU= 32.519
  09:03:57 STEP 2560 H=2560:00 +CPU= 20.758
  09:04:18 STEP 2561 H=2561:00 +CPU= 20.448
  09:04:52 STEP 2562 H=2562:00 +CPU= 33.820
  09:05:13 STEP 2563 H=2563:00 +CPU= 21.153
  09:05:35 STEP 2564 H=2564:00 +CPU= 22.235
  09:06:08 STEP 2565 H=2565:00 +CPU= 32.957
  09:06:30 STEP 2566 H=2566:00 +CPU= 21.885
  09:06:51 STEP 2567 H=2567:00 +CPU= 21.137
  09:07:31 STEP 2568 H=2568:00 +CPU= 39.105
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002568
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002568
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002568
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002544
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002544
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002544
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002556
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002556
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002556
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_106.zip
Uploading the intermediate file: upload_file_106.zip
  09:07:52 STEP 2569 H=2569:00 +CPU= 21.078
  09:08:13 STEP 2570 H=2570:00 +CPU= 21.425
  09:08:46 STEP 2571 H=2571:00 +CPU= 32.732
  09:09:08 STEP 2572 H=2572:00 +CPU= 21.372
  09:09:28 STEP 2573 H=2573:00 +CPU= 20.794
  09:10:02 STEP 2574 H=2574:00 +CPU= 33.652
  09:10:22 STEP 2575 H=2575:00 +CPU= 20.272
  09:10:42 STEP 2576 H=2576:00 +CPU= 19.895
  09:11:15 STEP 2577 H=2577:00 +CPU= 32.530
  09:11:35 STEP 2578 H=2578:00 +CPU= 19.653
  09:11:55 STEP 2579 H=2579:00 +CPU= 20.008
  09:12:31 STEP 2580 H=2580:00 +CPU= 36.001
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002580
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002580
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002580
  09:12:51 STEP 2581 H=2581:00 +CPU= 19.565
  09:13:12 STEP 2582 H=2582:00 +CPU= 20.712
  09:13:44 STEP 2583 H=2583:00 +CPU= 32.420
  09:14:05 STEP 2584 H=2584:00 +CPU= 20.079
  09:14:23 STEP 2585 H=2585:00 +CPU= 18.762
  09:14:55 STEP 2586 H=2586:00 +CPU= 31.861
  09:15:15 STEP 2587 H=2587:00 +CPU= 19.985
  09:15:36 STEP 2588 H=2588:00 +CPU= 20.476
  09:16:06 STEP 2589 H=2589:00 +CPU= 30.140
  09:16:27 STEP 2590 H=2590:00 +CPU= 20.922
  09:16:46 STEP 2591 H=2591:00 +CPU= 19.302
  09:17:26 STEP 2592 H=2592:00 +CPU= 39.163
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002592
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002592
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002592
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002568
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002568
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002568
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002580
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002580
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002580
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_107.zip
Uploading the intermediate file: upload_file_107.zip
  09:17:46 STEP 2593 H=2593:00 +CPU= 20.258
  09:18:07 STEP 2594 H=2594:00 +CPU= 20.897
  09:18:39 STEP 2595 H=2595:00 +CPU= 31.614
  09:19:00 STEP 2596 H=2596:00 +CPU= 21.186
  09:19:20 STEP 2597 H=2597:00 +CPU= 20.168
  09:19:54 STEP 2598 H=2598:00 +CPU= 33.882
  09:20:14 STEP 2599 H=2599:00 +CPU= 18.978
  09:20:33 STEP 2600 H=2600:00 +CPU= 18.899
  09:21:05 STEP 2601 H=2601:00 +CPU= 32.337
  09:21:24 STEP 2602 H=2602:00 +CPU= 19.297
  09:21:43 STEP 2603 H=2603:00 +CPU= 19.007
  09:22:20 STEP 2604 H=2604:00 +CPU= 36.164
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002604
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002604
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002604
  09:22:40 STEP 2605 H=2605:00 +CPU= 20.448
  09:23:01 STEP 2606 H=2606:00 +CPU= 20.403
  09:23:32 STEP 2607 H=2607:00 +CPU= 30.751
  09:23:52 STEP 2608 H=2608:00 +CPU= 19.473
  09:24:11 STEP 2609 H=2609:00 +CPU= 19.066
  09:24:44 STEP 2610 H=2610:00 +CPU= 33.359
  09:25:04 STEP 2611 H=2611:00 +CPU= 19.721
  09:25:23 STEP 2612 H=2612:00 +CPU= 19.153
  09:25:55 STEP 2613 H=2613:00 +CPU= 31.059
  09:26:14 STEP 2614 H=2614:00 +CPU= 19.220
  09:26:34 STEP 2615 H=2615:00 +CPU= 20.070
  09:27:12 STEP 2616 H=2616:00 +CPU= 37.840
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002616
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002616
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002616
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002592
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002592
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002592
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002604
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002604
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002604
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_108.zip
Uploading the intermediate file: upload_file_108.zip
  09:27:33 STEP 2617 H=2617:00 +CPU= 20.944
  09:27:54 STEP 2618 H=2618:00 +CPU= 20.701
  09:28:25 STEP 2619 H=2619:00 +CPU= 30.583
  09:28:44 STEP 2620 H=2620:00 +CPU= 18.760
  09:29:01 STEP 2621 H=2621:00 +CPU= 17.795
  09:29:33 STEP 2622 H=2622:00 +CPU= 30.892
  09:29:52 STEP 2623 H=2623:00 +CPU= 18.841
  09:30:12 STEP 2624 H=2624:00 +CPU= 20.174
  09:30:42 STEP 2625 H=2625:00 +CPU= 30.654
  09:31:02 STEP 2626 H=2626:00 +CPU= 19.410
  09:31:21 STEP 2627 H=2627:00 +CPU= 19.008
  09:31:57 STEP 2628 H=2628:00 +CPU= 35.252
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002628
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002628
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002628
  09:32:17 STEP 2629 H=2629:00 +CPU= 19.641
  09:32:35 STEP 2630 H=2630:00 +CPU= 18.748
  09:33:04 STEP 2631 H=2631:00 +CPU= 29.085
  09:33:23 STEP 2632 H=2632:00 +CPU= 18.771
  09:33:42 STEP 2633 H=2633:00 +CPU= 18.448
  09:34:14 STEP 2634 H=2634:00 +CPU= 31.405
  09:34:33 STEP 2635 H=2635:00 +CPU= 19.203
  09:34:53 STEP 2636 H=2636:00 +CPU= 20.177
  09:35:24 STEP 2637 H=2637:00 +CPU= 30.623
  09:35:44 STEP 2638 H=2638:00 +CPU= 19.620
  09:36:04 STEP 2639 H=2639:00 +CPU= 20.007
  09:36:39 STEP 2640 H=2640:00 +CPU= 34.973
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002640
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002640
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002640
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002616
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002616
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002616
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002628
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002628
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002628
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_109.zip
Uploading the intermediate file: upload_file_109.zip
  09:36:59 STEP 2641 H=2641:00 +CPU= 19.961
Uploading trickle at timestep: 9504000
  09:37:19 STEP 2642 H=2642:00 +CPU= 20.241
  09:37:50 STEP 2643 H=2643:00 +CPU= 30.647
  09:38:09 STEP 2644 H=2644:00 +CPU= 19.063
  09:38:27 STEP 2645 H=2645:00 +CPU= 17.942
  09:38:58 STEP 2646 H=2646:00 +CPU= 31.525
  09:39:16 STEP 2647 H=2647:00 +CPU= 17.981
  09:39:36 STEP 2648 H=2648:00 +CPU= 19.144
  09:40:07 STEP 2649 H=2649:00 +CPU= 30.812
  09:40:26 STEP 2650 H=2650:00 +CPU= 19.274
  09:40:45 STEP 2651 H=2651:00 +CPU= 18.769
  09:41:20 STEP 2652 H=2652:00 +CPU= 34.819
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002652
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002652
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002652
  09:41:38 STEP 2653 H=2653:00 +CPU= 18.136
  09:41:57 STEP 2654 H=2654:00 +CPU= 18.461
  09:42:26 STEP 2655 H=2655:00 +CPU= 29.611
  09:42:46 STEP 2656 H=2656:00 +CPU= 19.386
  09:43:04 STEP 2657 H=2657:00 +CPU= 18.041
  09:43:34 STEP 2658 H=2658:00 +CPU= 30.376
  09:43:53 STEP 2659 H=2659:00 +CPU= 18.724
  09:44:12 STEP 2660 H=2660:00 +CPU= 18.976
  09:44:42 STEP 2661 H=2661:00 +CPU= 29.365
  09:45:00 STEP 2662 H=2662:00 +CPU= 18.247
  09:45:19 STEP 2663 H=2663:00 +CPU= 18.607
  09:45:54 STEP 2664 H=2664:00 +CPU= 35.452
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002664
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002664
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002664
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002640
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002640
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002640
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002652
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002652
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002652
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_110.zip
Uploading the intermediate file: upload_file_110.zip
  09:46:13 STEP 2665 H=2665:00 +CPU= 18.557
  09:46:32 STEP 2666 H=2666:00 +CPU= 18.428
  09:47:02 STEP 2667 H=2667:00 +CPU= 29.850
  09:47:20 STEP 2668 H=2668:00 +CPU= 18.354
  09:47:39 STEP 2669 H=2669:00 +CPU= 19.106
  09:48:10 STEP 2670 H=2670:00 +CPU= 30.631
  09:48:29 STEP 2671 H=2671:00 +CPU= 18.382
  09:48:48 STEP 2672 H=2672:00 +CPU= 19.270
  09:49:19 STEP 2673 H=2673:00 +CPU= 31.009
  09:49:39 STEP 2674 H=2674:00 +CPU= 19.799
  09:49:58 STEP 2675 H=2675:00 +CPU= 18.454
  09:50:31 STEP 2676 H=2676:00 +CPU= 33.025
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002676
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002676
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002676
  09:50:50 STEP 2677 H=2677:00 +CPU= 18.905
  09:51:10 STEP 2678 H=2678:00 +CPU= 19.324
  09:51:40 STEP 2679 H=2679:00 +CPU= 29.793
  09:51:59 STEP 2680 H=2680:00 +CPU= 19.033
  09:52:17 STEP 2681 H=2681:00 +CPU= 18.392
  09:52:48 STEP 2682 H=2682:00 +CPU= 30.950
  09:53:07 STEP 2683 H=2683:00 +CPU= 18.443
  09:53:26 STEP 2684 H=2684:00 +CPU= 19.246
  09:53:56 STEP 2685 H=2685:00 +CPU= 29.807
  09:54:15 STEP 2686 H=2686:00 +CPU= 19.190
  09:54:34 STEP 2687 H=2687:00 +CPU= 18.846
  09:55:10 STEP 2688 H=2688:00 +CPU= 35.192
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002688
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002688
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002688
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002664
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002664
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002664
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002676
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002676
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002676
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_111.zip
Uploading the intermediate file: upload_file_111.zip
  09:55:27 STEP 2689 H=2689:00 +CPU= 17.695
  09:55:46 STEP 2690 H=2690:00 +CPU= 19.041
  09:56:16 STEP 2691 H=2691:00 +CPU= 29.350
  09:56:35 STEP 2692 H=2692:00 +CPU= 19.193
  09:56:53 STEP 2693 H=2693:00 +CPU= 17.883
  09:57:23 STEP 2694 H=2694:00 +CPU= 29.862
  09:57:42 STEP 2695 H=2695:00 +CPU= 18.535
  09:58:01 STEP 2696 H=2696:00 +CPU= 18.829
  09:58:30 STEP 2697 H=2697:00 +CPU= 29.111
  09:58:48 STEP 2698 H=2698:00 +CPU= 17.867
  09:59:05 STEP 2699 H=2699:00 +CPU= 17.373
  09:59:38 STEP 2700 H=2700:00 +CPU= 32.506
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002700
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002700
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002700
  09:59:56 STEP 2701 H=2701:00 +CPU= 18.654
  10:00:16 STEP 2702 H=2702:00 +CPU= 19.055
  10:00:45 STEP 2703 H=2703:00 +CPU= 29.357
  10:01:04 STEP 2704 H=2704:00 +CPU= 18.913
  10:01:22 STEP 2705 H=2705:00 +CPU= 17.800
  10:01:52 STEP 2706 H=2706:00 +CPU= 30.053
  10:02:11 STEP 2707 H=2707:00 +CPU= 18.989
  10:02:31 STEP 2708 H=2708:00 +CPU= 19.504
  10:03:01 STEP 2709 H=2709:00 +CPU= 29.545
  10:03:19 STEP 2710 H=2710:00 +CPU= 18.416
  10:03:37 STEP 2711 H=2711:00 +CPU= 18.181
  10:04:13 STEP 2712 H=2712:00 +CPU= 35.117
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002712
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002712
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002712
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002688
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002688
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002688
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002700
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002700
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002700
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_112.zip
Uploading the intermediate file: upload_file_112.zip
  10:04:30 STEP 2713 H=2713:00 +CPU= 17.818
  10:04:49 STEP 2714 H=2714:00 +CPU= 18.371
  10:05:19 STEP 2715 H=2715:00 +CPU= 30.134
  10:05:39 STEP 2716 H=2716:00 +CPU= 19.901
  10:05:58 STEP 2717 H=2717:00 +CPU= 18.970
  10:06:30 STEP 2718 H=2718:00 +CPU= 31.147
  10:06:48 STEP 2719 H=2719:00 +CPU= 18.316
  10:07:09 STEP 2720 H=2720:00 +CPU= 20.605
  10:07:40 STEP 2721 H=2721:00 +CPU= 31.050
  10:08:00 STEP 2722 H=2722:00 +CPU= 18.959
  10:08:19 STEP 2723 H=2723:00 +CPU= 19.490
  10:08:55 STEP 2724 H=2724:00 +CPU= 35.345
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002724
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002724
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002724
  10:09:13 STEP 2725 H=2725:00 +CPU= 18.359
  10:09:32 STEP 2726 H=2726:00 +CPU= 18.880
  10:10:02 STEP 2727 H=2727:00 +CPU= 29.979
  10:10:22 STEP 2728 H=2728:00 +CPU= 19.572
  10:10:41 STEP 2729 H=2729:00 +CPU= 19.075
  10:11:12 STEP 2730 H=2730:00 +CPU= 30.792
  10:11:30 STEP 2731 H=2731:00 +CPU= 18.381
  10:11:49 STEP 2732 H=2732:00 +CPU= 18.499
  10:12:19 STEP 2733 H=2733:00 +CPU= 30.251
  10:12:38 STEP 2734 H=2734:00 +CPU= 18.605
  10:12:57 STEP 2735 H=2735:00 +CPU= 18.915
  10:13:32 STEP 2736 H=2736:00 +CPU= 35.273
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002736
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002736
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002736
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002712
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002712
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002712
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002724
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002724
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002724
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_113.zip
Uploading the intermediate file: upload_file_113.zip
  10:13:52 STEP 2737 H=2737:00 +CPU= 18.945
  10:14:11 STEP 2738 H=2738:00 +CPU= 19.932
  10:14:42 STEP 2739 H=2739:00 +CPU= 29.948
  10:15:01 STEP 2740 H=2740:00 +CPU= 19.654
  10:15:20 STEP 2741 H=2741:00 +CPU= 18.372
  10:15:50 STEP 2742 H=2742:00 +CPU= 30.331
  10:16:10 STEP 2743 H=2743:00 +CPU= 19.578
  10:16:30 STEP 2744 H=2744:00 +CPU= 19.859
  10:17:02 STEP 2745 H=2745:00 +CPU= 31.775
  10:17:21 STEP 2746 H=2746:00 +CPU= 19.677
  10:17:40 STEP 2747 H=2747:00 +CPU= 17.875
  10:18:13 STEP 2748 H=2748:00 +CPU= 33.308
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002748
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002748
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002748
  10:18:32 STEP 2749 H=2749:00 +CPU= 18.968
  10:18:53 STEP 2750 H=2750:00 +CPU= 20.093
  10:19:23 STEP 2751 H=2751:00 +CPU= 30.787
  10:19:43 STEP 2752 H=2752:00 +CPU= 19.272
  10:20:00 STEP 2753 H=2753:00 +CPU= 17.528
  10:20:31 STEP 2754 H=2754:00 +CPU= 30.522
  10:20:50 STEP 2755 H=2755:00 +CPU= 18.829
  10:21:09 STEP 2756 H=2756:00 +CPU= 19.268
  10:21:40 STEP 2757 H=2757:00 +CPU= 30.737
  10:22:00 STEP 2758 H=2758:00 +CPU= 19.647
  10:22:20 STEP 2759 H=2759:00 +CPU= 19.795
  10:22:55 STEP 2760 H=2760:00 +CPU= 35.425
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002760
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002760
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002760
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002736
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002736
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002736
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002748
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002748
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002748
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_114.zip
Uploading the intermediate file: upload_file_114.zip
  10:23:13 STEP 2761 H=2761:00 +CPU= 17.844
  10:23:32 STEP 2762 H=2762:00 +CPU= 18.873
  10:24:02 STEP 2763 H=2763:00 +CPU= 30.284
  10:24:22 STEP 2764 H=2764:00 +CPU= 19.855
  10:24:41 STEP 2765 H=2765:00 +CPU= 18.476
  10:25:12 STEP 2766 H=2766:00 +CPU= 30.795
  10:25:31 STEP 2767 H=2767:00 +CPU= 18.838
  10:25:52 STEP 2768 H=2768:00 +CPU= 20.673
  10:26:24 STEP 2769 H=2769:00 +CPU= 31.985
  10:26:44 STEP 2770 H=2770:00 +CPU= 19.556
  10:27:03 STEP 2771 H=2771:00 +CPU= 18.875
  10:27:37 STEP 2772 H=2772:00 +CPU= 34.399
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002772
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002772
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002772
  10:27:56 STEP 2773 H=2773:00 +CPU= 18.942
  10:28:16 STEP 2774 H=2774:00 +CPU= 19.485
  10:28:48 STEP 2775 H=2775:00 +CPU= 31.726
  10:29:08 STEP 2776 H=2776:00 +CPU= 20.575
  10:29:28 STEP 2777 H=2777:00 +CPU= 19.979
  10:30:02 STEP 2778 H=2778:00 +CPU= 33.381
  10:30:22 STEP 2779 H=2779:00 +CPU= 19.529
  10:30:43 STEP 2780 H=2780:00 +CPU= 21.197
  10:31:14 STEP 2781 H=2781:00 +CPU= 30.952
  10:31:34 STEP 2782 H=2782:00 +CPU= 19.865
  10:31:55 STEP 2783 H=2783:00 +CPU= 20.166
  10:32:32 STEP 2784 H=2784:00 +CPU= 37.401
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002784
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002784
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002784
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002760
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002760
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002760
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002772
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002772
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002772
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_115.zip
Uploading the intermediate file: upload_file_115.zip
  10:32:52 STEP 2785 H=2785:00 +CPU= 19.933
  10:33:13 STEP 2786 H=2786:00 +CPU= 20.578
  10:33:46 STEP 2787 H=2787:00 +CPU= 33.295
  10:34:08 STEP 2788 H=2788:00 +CPU= 21.883
  10:34:27 STEP 2789 H=2789:00 +CPU= 19.115
  10:34:59 STEP 2790 H=2790:00 +CPU= 31.833
  10:35:19 STEP 2791 H=2791:00 +CPU= 19.576
  10:35:40 STEP 2792 H=2792:00 +CPU= 21.289
  10:36:12 STEP 2793 H=2793:00 +CPU= 31.247
  10:36:33 STEP 2794 H=2794:00 +CPU= 20.955
  10:36:53 STEP 2795 H=2795:00 +CPU= 19.780
  10:37:28 STEP 2796 H=2796:00 +CPU= 35.482
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002796
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002796
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002796
  10:37:47 STEP 2797 H=2797:00 +CPU= 19.128
  10:38:07 STEP 2798 H=2798:00 +CPU= 19.958
  10:38:40 STEP 2799 H=2799:00 +CPU= 32.485
  10:39:01 STEP 2800 H=2800:00 +CPU= 21.253
  10:39:21 STEP 2801 H=2801:00 +CPU= 18.984
  10:39:54 STEP 2802 H=2802:00 +CPU= 33.722
  10:40:13 STEP 2803 H=2803:00 +CPU= 18.348
  10:40:33 STEP 2804 H=2804:00 +CPU= 19.719
  10:41:06 STEP 2805 H=2805:00 +CPU= 33.847
  10:41:28 STEP 2806 H=2806:00 +CPU= 21.063
  10:41:49 STEP 2807 H=2807:00 +CPU= 21.080
  10:42:24 STEP 2808 H=2808:00 +CPU= 35.450
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002808
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002808
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002808
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002784
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002784
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002784
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002796
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002796
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002796
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_116.zip
Uploading the intermediate file: upload_file_116.zip
  10:42:44 STEP 2809 H=2809:00 +CPU= 20.099
  10:43:05 STEP 2810 H=2810:00 +CPU= 20.660
  10:43:37 STEP 2811 H=2811:00 +CPU= 31.784
  10:43:56 STEP 2812 H=2812:00 +CPU= 19.241
  10:44:16 STEP 2813 H=2813:00 +CPU= 19.351
  10:44:48 STEP 2814 H=2814:00 +CPU= 31.877
  10:45:06 STEP 2815 H=2815:00 +CPU= 18.509
  10:45:25 STEP 2816 H=2816:00 +CPU= 19.004
  10:45:57 STEP 2817 H=2817:00 +CPU= 31.639
  10:46:18 STEP 2818 H=2818:00 +CPU= 20.418
  10:46:38 STEP 2819 H=2819:00 +CPU= 19.513
  10:47:15 STEP 2820 H=2820:00 +CPU= 37.006
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002820
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002820
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002820
  10:47:36 STEP 2821 H=2821:00 +CPU= 20.672
  10:47:55 STEP 2822 H=2822:00 +CPU= 19.387
  10:48:27 STEP 2823 H=2823:00 +CPU= 31.620
  10:48:48 STEP 2824 H=2824:00 +CPU= 21.589
  10:49:09 STEP 2825 H=2825:00 +CPU= 20.477
  10:49:42 STEP 2826 H=2826:00 +CPU= 32.999
  10:50:03 STEP 2827 H=2827:00 +CPU= 20.764
  10:50:25 STEP 2828 H=2828:00 +CPU= 21.784
  10:50:57 STEP 2829 H=2829:00 +CPU= 31.683
  10:51:17 STEP 2830 H=2830:00 +CPU= 20.345
  10:51:37 STEP 2831 H=2831:00 +CPU= 20.303
  10:52:16 STEP 2832 H=2832:00 +CPU= 37.980
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002832
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002832
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002832
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002808
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002808
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002808
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002820
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002820
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002820
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_117.zip
Uploading the intermediate file: upload_file_117.zip
  10:52:36 STEP 2833 H=2833:00 +CPU= 20.370
  10:52:58 STEP 2834 H=2834:00 +CPU= 21.651
  10:53:32 STEP 2835 H=2835:00 +CPU= 33.764
  10:53:52 STEP 2836 H=2836:00 +CPU= 20.722
  10:54:13 STEP 2837 H=2837:00 +CPU= 21.085
  10:54:48 STEP 2838 H=2838:00 +CPU= 34.168
  10:55:09 STEP 2839 H=2839:00 +CPU= 20.852
  10:55:31 STEP 2840 H=2840:00 +CPU= 21.661
  10:56:02 STEP 2841 H=2841:00 +CPU= 31.502
  10:56:23 STEP 2842 H=2842:00 +CPU= 20.917
  10:56:44 STEP 2843 H=2843:00 +CPU= 20.799
  10:57:20 STEP 2844 H=2844:00 +CPU= 35.544
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002844
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002844
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002844
  10:57:39 STEP 2845 H=2845:00 +CPU= 19.160
  10:57:59 STEP 2846 H=2846:00 +CPU= 19.820
  10:58:31 STEP 2847 H=2847:00 +CPU= 32.067
  10:58:53 STEP 2848 H=2848:00 +CPU= 21.683
  10:59:13 STEP 2849 H=2849:00 +CPU= 20.226
  10:59:47 STEP 2850 H=2850:00 +CPU= 33.196
  11:00:07 STEP 2851 H=2851:00 +CPU= 19.664
  11:00:28 STEP 2852 H=2852:00 +CPU= 20.887
  11:00:59 STEP 2853 H=2853:00 +CPU= 31.341
  11:01:19 STEP 2854 H=2854:00 +CPU= 19.738
  11:01:41 STEP 2855 H=2855:00 +CPU= 21.665
  11:02:20 STEP 2856 H=2856:00 +CPU= 39.146
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002856
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002856
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002856
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002832
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002832
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002832
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002844
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002844
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002844
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_118.zip
Uploading the intermediate file: upload_file_118.zip
  11:02:40 STEP 2857 H=2857:00 +CPU= 19.774
  11:03:01 STEP 2858 H=2858:00 +CPU= 21.121
  11:03:35 STEP 2859 H=2859:00 +CPU= 33.563
  11:03:56 STEP 2860 H=2860:00 +CPU= 21.024
  11:04:15 STEP 2861 H=2861:00 +CPU= 19.104
  11:04:49 STEP 2862 H=2862:00 +CPU= 33.091
  11:05:09 STEP 2863 H=2863:00 +CPU= 20.362
  11:05:30 STEP 2864 H=2864:00 +CPU= 21.080
  11:06:04 STEP 2865 H=2865:00 +CPU= 33.321
  11:06:25 STEP 2866 H=2866:00 +CPU= 20.723
  11:06:44 STEP 2867 H=2867:00 +CPU= 19.238
  11:07:21 STEP 2868 H=2868:00 +CPU= 36.856
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002868
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002868
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002868
  11:07:42 STEP 2869 H=2869:00 +CPU= 20.292
  11:08:03 STEP 2870 H=2870:00 +CPU= 20.708
  11:08:36 STEP 2871 H=2871:00 +CPU= 32.811
  11:08:57 STEP 2872 H=2872:00 +CPU= 20.661
  11:09:18 STEP 2873 H=2873:00 +CPU= 20.568
  11:09:52 STEP 2874 H=2874:00 +CPU= 33.127
  11:10:12 STEP 2875 H=2875:00 +CPU= 20.302
  11:10:34 STEP 2876 H=2876:00 +CPU= 21.215
  11:11:07 STEP 2877 H=2877:00 +CPU= 33.548
  11:11:29 STEP 2878 H=2878:00 +CPU= 21.486
  11:11:49 STEP 2879 H=2879:00 +CPU= 19.875
  11:12:27 STEP 2880 H=2880:00 +CPU= 37.421
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002880
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002880
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002880
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002856
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002856
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002856
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002868
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002868
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002868
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_119.zip
Uploading the intermediate file: upload_file_119.zip
  11:12:47 STEP 2881 H=2881:00 +CPU= 20.147
Uploading trickle at timestep: 10368000
  11:13:08 STEP 2882 H=2882:00 +CPU= 21.209
  11:13:40 STEP 2883 H=2883:00 +CPU= 31.449
  11:13:59 STEP 2884 H=2884:00 +CPU= 19.658
  11:14:20 STEP 2885 H=2885:00 +CPU= 20.375
  11:14:53 STEP 2886 H=2886:00 +CPU= 32.865
  11:15:13 STEP 2887 H=2887:00 +CPU= 19.909
  11:15:34 STEP 2888 H=2888:00 +CPU= 21.109
  11:16:07 STEP 2889 H=2889:00 +CPU= 33.159
  11:16:29 STEP 2890 H=2890:00 +CPU= 21.062
  11:16:49 STEP 2891 H=2891:00 +CPU= 20.009
  11:17:25 STEP 2892 H=2892:00 +CPU= 36.026
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002892
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002892
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002892
  11:17:45 STEP 2893 H=2893:00 +CPU= 19.271
  11:18:05 STEP 2894 H=2894:00 +CPU= 20.563
  11:18:39 STEP 2895 H=2895:00 +CPU= 33.476
  11:19:00 STEP 2896 H=2896:00 +CPU= 20.531
  11:19:19 STEP 2897 H=2897:00 +CPU= 19.380
  11:19:50 STEP 2898 H=2898:00 +CPU= 31.034
  11:20:10 STEP 2899 H=2899:00 +CPU= 19.939
  11:20:31 STEP 2900 H=2900:00 +CPU= 21.022
  11:21:04 STEP 2901 H=2901:00 +CPU= 32.119
  11:21:24 STEP 2902 H=2902:00 +CPU= 19.938
  11:21:45 STEP 2903 H=2903:00 +CPU= 21.660
  11:22:25 STEP 2904 H=2904:00 +CPU= 39.174
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002904
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002904
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002904
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002880
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002880
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002880
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002892
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002892
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002892
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_120.zip
Uploading the intermediate file: upload_file_120.zip
  11:22:44 STEP 2905 H=2905:00 +CPU= 19.208
  11:23:06 STEP 2906 H=2906:00 +CPU= 21.590
  11:23:38 STEP 2907 H=2907:00 +CPU= 32.383
  11:23:59 STEP 2908 H=2908:00 +CPU= 20.543
  11:24:19 STEP 2909 H=2909:00 +CPU= 20.432
  11:24:54 STEP 2910 H=2910:00 +CPU= 34.061
  11:25:14 STEP 2911 H=2911:00 +CPU= 19.987
  11:25:35 STEP 2912 H=2912:00 +CPU= 21.270
  11:26:07 STEP 2913 H=2913:00 +CPU= 31.374
  11:26:28 STEP 2914 H=2914:00 +CPU= 21.575
  11:26:49 STEP 2915 H=2915:00 +CPU= 20.966
  11:27:27 STEP 2916 H=2916:00 +CPU= 37.375
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002916
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002916
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002916
  11:27:47 STEP 2917 H=2917:00 +CPU= 19.917
  11:28:09 STEP 2918 H=2918:00 +CPU= 21.243
  11:28:42 STEP 2919 H=2919:00 +CPU= 33.261
  11:29:04 STEP 2920 H=2920:00 +CPU= 22.088
  11:29:26 STEP 2921 H=2921:00 +CPU= 21.248
  11:30:00 STEP 2922 H=2922:00 +CPU= 33.992
  11:30:19 STEP 2923 H=2923:00 +CPU= 19.140
  11:30:41 STEP 2924 H=2924:00 +CPU= 21.427
  11:31:15 STEP 2925 H=2925:00 +CPU= 34.347
  11:31:37 STEP 2926 H=2926:00 +CPU= 21.809
  11:31:58 STEP 2927 H=2927:00 +CPU= 21.180
  11:32:38 STEP 2928 H=2928:00 +CPU= 39.478
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002928
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002928
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002928
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002904
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002904
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002904
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002916
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002916
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002916
Zipping up the intermediate file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_121.zip
Uploading the intermediate file: upload_file_121.zip
  11:33:00 STEP 2929 H=2929:00 +CPU= 21.512
  11:33:20 STEP 2930 H=2930:00 +CPU= 20.571
  11:33:54 STEP 2931 H=2931:00 +CPU= 33.211
  11:34:15 STEP 2932 H=2932:00 +CPU= 21.629
  11:34:37 STEP 2933 H=2933:00 +CPU= 21.237
  11:35:10 STEP 2934 H=2934:00 +CPU= 32.760
  11:35:29 STEP 2935 H=2935:00 +CPU= 19.512
  11:35:51 STEP 2936 H=2936:00 +CPU= 22.078
  11:36:25 STEP 2937 H=2937:00 +CPU= 33.849
  11:36:47 STEP 2938 H=2938:00 +CPU= 21.527
  11:37:09 STEP 2939 H=2939:00 +CPU= 21.661
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2005050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0831
(argv4) batchid: 974
(argv5) wuid: 12191475
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /mnt/sn770/boinc-client/slots/19
Project directory is: /mnt/sn770/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475
..mkdir for temp folder for results failed
Copying: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /mnt/sn770/boinc-client/slots/19/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/sn770/boinc-client/slots/19/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d22c3f530eafb74caffa0f3f547a388b to: /mnt/sn770/boinc-client/slots/19/oifs_43r3_ps_0831_2005050100_123_974_12191475.zip
Unzipping the namelist zip file: /mnt/sn770/boinc-client/slots/19/oifs_43r3_ps_0831_2005050100_123_974_12191475.zip
ic_ancil_file: ic_ancil_12191475
ifsdata_file: ifsdata_12191475
climate_data_file: clim_data_12191475
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_ca417744e42b7dae45aab4d8ad39f288 to: /mnt/sn770/boinc-client/slots/19/ic_ancil_12191475.zip
Unzipping the IC ancils zip file: /mnt/sn770/boinc-client/slots/19/ic_ancil_12191475.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_61d89661b73f8af9bb4447f0b88f5b65 to: /mnt/sn770/boinc-client/slots/19/ifsdata/ifsdata_12191475.zip
Unzipping the ifsdata_zip file: /mnt/sn770/boinc-client/slots/19/ifsdata/ifsdata_12191475.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/sn770/boinc-client/slots/19/159l_2/clim_data_12191475.zip
Unzipping the climate data zip file: /mnt/sn770/boinc-client/slots/19/159l_2/clim_data_12191475.zip
Checking for progress XML file: /mnt/sn770/boinc-client/slots/19/progress_file_12191475.xml
Opened progress file ok : /mnt/sn770/boinc-client/slots/19/progress_file_12191475.xml
-- Model is restarting --
Adjusting last_iter, 2940, to previous model restart step.
Creating progress file: /mnt/sn770/boinc-client/slots/19/progress_file_12191475.xml
last_cpu_time: 71186
upload_file_number: 122
last_iter: 2927
last_upload: 10540800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508
The child process has been launched with process id: 1128037
Executing the command: /mnt/sn770/boinc-client/slots/19/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:S8026:1:1:1128037:1128037] [20230123:114355:1674503035:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  11:44:30 STEP 2928 H=2928:00 +CPU= 32.508
  11:44:45 STEP 2929 H=2929:00 +CPU= 15.020
  11:45:01 STEP 2930 H=2930:00 +CPU= 15.860
  11:45:32 STEP 2931 H=2931:00 +CPU= 31.170
  11:45:51 STEP 2932 H=2932:00 +CPU= 19.057
  11:46:08 STEP 2933 H=2933:00 +CPU= 17.371
  11:46:42 STEP 2934 H=2934:00 +CPU= 33.272
  11:47:02 STEP 2935 H=2935:00 +CPU= 20.304
  11:47:22 STEP 2936 H=2936:00 +CPU= 20.504
  11:47:48 STEP 2937 H=2937:00 +CPU= 25.742
  11:48:02 STEP 2938 H=2938:00 +CPU= 14.157
  11:48:18 STEP 2939 H=2939:00 +CPU= 16.081
  11:48:51 STEP 2940 H=2940:00 +CPU= 32.351
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002940
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002940
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002940
  11:49:09 STEP 2941 H=2941:00 +CPU= 18.481
  11:49:30 STEP 2942 H=2942:00 +CPU= 20.624
  11:49:55 STEP 2943 H=2943:00 +CPU= 25.559
  11:50:14 STEP 2944 H=2944:00 +CPU= 18.431
  11:50:32 STEP 2945 H=2945:00 +CPU= 18.109
  11:51:03 STEP 2946 H=2946:00 +CPU= 31.010
  11:51:22 STEP 2947 H=2947:00 +CPU= 19.404
  11:51:41 STEP 2948 H=2948:00 +CPU= 18.299
  11:52:12 STEP 2949 H=2949:00 +CPU= 31.325
  11:52:32 STEP 2950 H=2950:00 +CPU= 19.984
  11:52:52 STEP 2951 H=2951:00 +CPU= 19.627
  11:53:28 STEP 2952 H=2952:00 +CPU= 36.577
The child process terminated with status: 0
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMGGhq0f+002952
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMSHhq0f+002952
Moving to projects directory: /mnt/sn770/boinc-client/slots/19/ICMUAhq0f+002952
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002940
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002928
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002952
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002928
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002928
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMGGhq0f+002952
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMSHhq0f+002940
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002952
Adding to the zip: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12191475/ICMUAhq0f+002940
Zipping up the final file: /mnt/sn770/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0831_2005050100_123_974_12191475_1_r8093508_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
11:56:52 (1128017): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:38:16 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 10,623,600 71,758 0.0068
09 May 2023 16:38:16 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 10,623,600 71,758 0.0068
09 May 2023 16:38:11 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 10,368,000 69,695 0.0067
09 May 2023 16:38:11 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 10,368,000 69,695 0.0067
09 May 2023 16:38:07 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 9,504,000 63,972 0.0067
09 May 2023 16:37:56 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 8,640,000 57,938 0.0067
09 May 2023 16:37:56 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 8,640,000 57,938 0.0067
09 May 2023 16:37:46 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 7,776,000 52,162 0.0067
09 May 2023 16:37:46 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 7,776,000 52,162 0.0067
09 May 2023 16:37:41 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 6,912,000 46,581 0.0067
09 May 2023 16:37:31 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 6,048,000 40,632 0.0067
09 May 2023 16:37:31 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 6,048,000 40,632 0.0067
09 May 2023 16:37:27 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 5,184,000 35,007 0.0068
09 May 2023 16:37:27 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 5,184,000 35,007 0.0068
09 May 2023 16:37:16 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 4,320,000 29,389 0.0068
09 May 2023 16:37:16 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 4,320,000 29,389 0.0068
09 May 2023 16:37:06 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 3,456,000 23,324 0.0067
09 May 2023 16:37:06 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 3,456,000 23,324 0.0067
09 May 2023 16:37:00 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 2,592,000 17,464 0.0067
09 May 2023 16:37:00 1495420 22301751 oifs_43r3_ps_0831_2005050100_123_974_12191475_1 2,592,000 17,464 0.0067


©2024 climateprediction.net