climateprediction.net home page
Task 22271285

Task 22271285

Name oifs_43r3_ps_0293_2000050100_123_969_12185937_0
Workunit 12185937
Created 22 Dec 2022, 21:04:05 UTC
Sent 22 Dec 2022, 21:13:00 UTC
Report deadline 21 Jan 2023, 21:13:00 UTC
Received 23 Dec 2022, 21:05:50 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1523867
Run time 22 hours 34 min 31 sec
CPU time 22 hours 34 min 31 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.17 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,415.64 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,813.77 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
2421:00 +CPU= 31.145
  18:11:25 STEP 2422 H=2422:00 +CPU= 20.162
  18:11:46 STEP 2423 H=2423:00 +CPU= 19.985
  18:12:23 STEP 2424 H=2424:00 +CPU= 36.333
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_100.zip
Uploading the intermediate file: upload_file_100.zip
  18:12:43 STEP 2425 H=2425:00 +CPU= 19.550
  18:13:03 STEP 2426 H=2426:00 +CPU= 19.961
  18:13:35 STEP 2427 H=2427:00 +CPU= 31.517
  18:13:55 STEP 2428 H=2428:00 +CPU= 20.194
  18:14:15 STEP 2429 H=2429:00 +CPU= 19.706
  18:14:48 STEP 2430 H=2430:00 +CPU= 31.870
  18:15:08 STEP 2431 H=2431:00 +CPU= 19.654
  18:15:28 STEP 2432 H=2432:00 +CPU= 20.186
  18:16:00 STEP 2433 H=2433:00 +CPU= 30.860
  18:16:21 STEP 2434 H=2434:00 +CPU= 20.832
  18:16:41 STEP 2435 H=2435:00 +CPU= 19.525
  18:17:15 STEP 2436 H=2436:00 +CPU= 33.656
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002436
  18:17:34 STEP 2437 H=2437:00 +CPU= 19.496
  18:17:55 STEP 2438 H=2438:00 +CPU= 20.434
  18:18:26 STEP 2439 H=2439:00 +CPU= 30.982
  18:18:48 STEP 2440 H=2440:00 +CPU= 21.108
  18:19:07 STEP 2441 H=2441:00 +CPU= 19.155
  18:19:40 STEP 2442 H=2442:00 +CPU= 32.373
  18:20:00 STEP 2443 H=2443:00 +CPU= 19.690
  18:20:23 STEP 2444 H=2444:00 +CPU= 21.799
  18:20:55 STEP 2445 H=2445:00 +CPU= 30.721
  18:21:15 STEP 2446 H=2446:00 +CPU= 20.508
  18:21:36 STEP 2447 H=2447:00 +CPU= 20.514
  18:22:12 STEP 2448 H=2448:00 +CPU= 35.877
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_101.zip
Uploading the intermediate file: upload_file_101.zip
  18:22:33 STEP 2449 H=2449:00 +CPU= 19.871
  18:22:53 STEP 2450 H=2450:00 +CPU= 19.799
  18:23:24 STEP 2451 H=2451:00 +CPU= 31.249
  18:23:45 STEP 2452 H=2452:00 +CPU= 20.492
  18:24:06 STEP 2453 H=2453:00 +CPU= 20.133
  18:24:38 STEP 2454 H=2454:00 +CPU= 31.503
  18:24:57 STEP 2455 H=2455:00 +CPU= 19.166
  18:25:19 STEP 2456 H=2456:00 +CPU= 20.879
  18:25:49 STEP 2457 H=2457:00 +CPU= 30.624
  18:26:10 STEP 2458 H=2458:00 +CPU= 20.185
  18:26:29 STEP 2459 H=2459:00 +CPU= 19.316
  18:27:05 STEP 2460 H=2460:00 +CPU= 35.086
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002460
  18:27:28 STEP 2461 H=2461:00 +CPU= 21.766
  18:27:52 STEP 2462 H=2462:00 +CPU= 22.724
  18:28:28 STEP 2463 H=2463:00 +CPU= 34.507
  18:28:52 STEP 2464 H=2464:00 +CPU= 22.929
  18:29:16 STEP 2465 H=2465:00 +CPU= 22.435
  18:29:54 STEP 2466 H=2466:00 +CPU= 35.694
  18:30:17 STEP 2467 H=2467:00 +CPU= 22.299
  18:30:41 STEP 2468 H=2468:00 +CPU= 23.025
  18:31:18 STEP 2469 H=2469:00 +CPU= 35.028
  18:31:43 STEP 2470 H=2470:00 +CPU= 23.189
  18:32:08 STEP 2471 H=2471:00 +CPU= 23.960
  18:32:52 STEP 2472 H=2472:00 +CPU= 41.625
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_102.zip
Uploading the intermediate file: upload_file_102.zip
  18:33:17 STEP 2473 H=2473:00 +CPU= 23.299
  18:33:44 STEP 2474 H=2474:00 +CPU= 24.254
  18:34:24 STEP 2475 H=2475:00 +CPU= 37.126
  18:34:50 STEP 2476 H=2476:00 +CPU= 24.266
  18:35:16 STEP 2477 H=2477:00 +CPU= 23.726
  18:35:57 STEP 2478 H=2478:00 +CPU= 37.522
  18:36:22 STEP 2479 H=2479:00 +CPU= 23.476
  18:36:48 STEP 2480 H=2480:00 +CPU= 24.082
  18:37:27 STEP 2481 H=2481:00 +CPU= 35.695
  18:37:52 STEP 2482 H=2482:00 +CPU= 23.503
  18:38:16 STEP 2483 H=2483:00 +CPU= 22.547
  18:38:58 STEP 2484 H=2484:00 +CPU= 39.369
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002484
  18:39:23 STEP 2485 H=2485:00 +CPU= 22.525
  18:39:48 STEP 2486 H=2486:00 +CPU= 23.498
  18:40:26 STEP 2487 H=2487:00 +CPU= 35.561
  18:40:51 STEP 2488 H=2488:00 +CPU= 23.318
  18:41:16 STEP 2489 H=2489:00 +CPU= 22.557
  18:41:55 STEP 2490 H=2490:00 +CPU= 36.542
  18:42:21 STEP 2491 H=2491:00 +CPU= 23.250
  18:42:47 STEP 2492 H=2492:00 +CPU= 23.931
  18:43:28 STEP 2493 H=2493:00 +CPU= 36.940
  18:43:54 STEP 2494 H=2494:00 +CPU= 24.057
  18:44:21 STEP 2495 H=2495:00 +CPU= 23.873
  18:45:07 STEP 2496 H=2496:00 +CPU= 42.738
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_103.zip
Uploading the intermediate file: upload_file_103.zip
  18:45:32 STEP 2497 H=2497:00 +CPU= 22.885
  18:45:57 STEP 2498 H=2498:00 +CPU= 23.314
  18:46:36 STEP 2499 H=2499:00 +CPU= 35.973
  18:47:03 STEP 2500 H=2500:00 +CPU= 24.485
  18:47:28 STEP 2501 H=2501:00 +CPU= 23.074
  18:48:08 STEP 2502 H=2502:00 +CPU= 36.804
  18:48:32 STEP 2503 H=2503:00 +CPU= 22.684
  18:48:58 STEP 2504 H=2504:00 +CPU= 23.566
  18:49:36 STEP 2505 H=2505:00 +CPU= 35.469
  18:50:01 STEP 2506 H=2506:00 +CPU= 23.450
  18:50:27 STEP 2507 H=2507:00 +CPU= 23.393
  18:51:10 STEP 2508 H=2508:00 +CPU= 39.682
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002508
  18:51:34 STEP 2509 H=2509:00 +CPU= 22.760
  18:51:59 STEP 2510 H=2510:00 +CPU= 23.379
  18:52:38 STEP 2511 H=2511:00 +CPU= 35.563
  18:53:03 STEP 2512 H=2512:00 +CPU= 23.582
  18:53:28 STEP 2513 H=2513:00 +CPU= 22.799
  18:54:07 STEP 2514 H=2514:00 +CPU= 36.355
  18:54:31 STEP 2515 H=2515:00 +CPU= 22.853
  18:54:56 STEP 2516 H=2516:00 +CPU= 23.253
  18:55:35 STEP 2517 H=2517:00 +CPU= 35.755
  18:56:00 STEP 2518 H=2518:00 +CPU= 23.349
  18:56:25 STEP 2519 H=2519:00 +CPU= 23.540
  18:57:10 STEP 2520 H=2520:00 +CPU= 41.782
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_104.zip
Uploading the intermediate file: upload_file_104.zip
  18:57:35 STEP 2521 H=2521:00 +CPU= 22.682
  18:58:00 STEP 2522 H=2522:00 +CPU= 23.460
  18:58:38 STEP 2523 H=2523:00 +CPU= 35.768
  18:59:03 STEP 2524 H=2524:00 +CPU= 23.358
  18:59:28 STEP 2525 H=2525:00 +CPU= 22.848
  19:00:08 STEP 2526 H=2526:00 +CPU= 36.652
  19:00:32 STEP 2527 H=2527:00 +CPU= 22.668
  19:00:57 STEP 2528 H=2528:00 +CPU= 23.522
  19:01:35 STEP 2529 H=2529:00 +CPU= 35.508
  19:02:01 STEP 2530 H=2530:00 +CPU= 23.375
  19:02:25 STEP 2531 H=2531:00 +CPU= 22.815
  19:03:08 STEP 2532 H=2532:00 +CPU= 39.487
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002532
  19:03:32 STEP 2533 H=2533:00 +CPU= 22.696
  19:03:57 STEP 2534 H=2534:00 +CPU= 23.450
  19:04:35 STEP 2535 H=2535:00 +CPU= 35.312
  19:05:00 STEP 2536 H=2536:00 +CPU= 23.353
  19:05:24 STEP 2537 H=2537:00 +CPU= 22.638
  19:06:03 STEP 2538 H=2538:00 +CPU= 36.240
  19:06:28 STEP 2539 H=2539:00 +CPU= 22.789
  19:06:53 STEP 2540 H=2540:00 +CPU= 23.392
  19:07:31 STEP 2541 H=2541:00 +CPU= 35.541
  19:07:56 STEP 2542 H=2542:00 +CPU= 23.389
  19:08:22 STEP 2543 H=2543:00 +CPU= 23.361
  19:09:06 STEP 2544 H=2544:00 +CPU= 41.520
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_105.zip
Uploading the intermediate file: upload_file_105.zip
  19:09:31 STEP 2545 H=2545:00 +CPU= 22.797
  19:09:56 STEP 2546 H=2546:00 +CPU= 23.336
  19:10:34 STEP 2547 H=2547:00 +CPU= 35.468
  19:10:59 STEP 2548 H=2548:00 +CPU= 23.410
  19:11:24 STEP 2549 H=2549:00 +CPU= 22.902
  19:12:00 STEP 2550 H=2550:00 +CPU= 34.052
  19:12:19 STEP 2551 H=2551:00 +CPU= 18.985
  19:12:39 STEP 2552 H=2552:00 +CPU= 19.650
  19:13:09 STEP 2553 H=2553:00 +CPU= 30.085
  19:13:29 STEP 2554 H=2554:00 +CPU= 19.675
  19:13:48 STEP 2555 H=2555:00 +CPU= 19.374
  19:14:22 STEP 2556 H=2556:00 +CPU= 33.224
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002556
  19:14:45 STEP 2557 H=2557:00 +CPU= 21.718
  19:15:11 STEP 2558 H=2558:00 +CPU= 23.884
  19:15:51 STEP 2559 H=2559:00 +CPU= 36.393
  19:16:17 STEP 2560 H=2560:00 +CPU= 23.729
  19:16:42 STEP 2561 H=2561:00 +CPU= 22.756
  19:17:21 STEP 2562 H=2562:00 +CPU= 36.566
  19:17:45 STEP 2563 H=2563:00 +CPU= 22.592
  19:18:10 STEP 2564 H=2564:00 +CPU= 23.316
  19:18:49 STEP 2565 H=2565:00 +CPU= 35.817
  19:19:14 STEP 2566 H=2566:00 +CPU= 23.296
  19:19:39 STEP 2567 H=2567:00 +CPU= 23.318
  19:20:23 STEP 2568 H=2568:00 +CPU= 41.426
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_106.zip
Uploading the intermediate file: upload_file_106.zip
  19:20:48 STEP 2569 H=2569:00 +CPU= 22.713
  19:21:12 STEP 2570 H=2570:00 +CPU= 23.129
  19:21:50 STEP 2571 H=2571:00 +CPU= 34.862
  19:22:13 STEP 2572 H=2572:00 +CPU= 22.010
  19:22:32 STEP 2573 H=2573:00 +CPU= 19.031
  19:23:03 STEP 2574 H=2574:00 +CPU= 30.698
  19:23:22 STEP 2575 H=2575:00 +CPU= 19.096
  19:23:42 STEP 2576 H=2576:00 +CPU= 19.518
  19:24:13 STEP 2577 H=2577:00 +CPU= 30.469
  19:24:32 STEP 2578 H=2578:00 +CPU= 19.643
  19:24:52 STEP 2579 H=2579:00 +CPU= 19.125
  19:25:26 STEP 2580 H=2580:00 +CPU= 33.912
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002580
  19:25:45 STEP 2581 H=2581:00 +CPU= 19.213
  19:26:06 STEP 2582 H=2582:00 +CPU= 20.587
  19:26:39 STEP 2583 H=2583:00 +CPU= 31.342
  19:26:59 STEP 2584 H=2584:00 +CPU= 19.846
  19:27:18 STEP 2585 H=2585:00 +CPU= 19.562
  19:27:51 STEP 2586 H=2586:00 +CPU= 31.841
  19:28:11 STEP 2587 H=2587:00 +CPU= 19.265
  19:28:31 STEP 2588 H=2588:00 +CPU= 19.702
  19:29:04 STEP 2589 H=2589:00 +CPU= 31.929
  19:29:26 STEP 2590 H=2590:00 +CPU= 21.640
  19:29:49 STEP 2591 H=2591:00 +CPU= 21.645
  19:30:29 STEP 2592 H=2592:00 +CPU= 38.059
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_107.zip
Uploading the intermediate file: upload_file_107.zip
  19:30:50 STEP 2593 H=2593:00 +CPU= 20.835
Uploading trickle at timestep: 9331200
  19:31:13 STEP 2594 H=2594:00 +CPU= 21.362
  19:31:47 STEP 2595 H=2595:00 +CPU= 32.811
  19:32:10 STEP 2596 H=2596:00 +CPU= 21.591
  19:32:31 STEP 2597 H=2597:00 +CPU= 20.730
  19:33:06 STEP 2598 H=2598:00 +CPU= 33.303
  19:33:27 STEP 2599 H=2599:00 +CPU= 20.761
  19:33:50 STEP 2600 H=2600:00 +CPU= 21.495
  19:34:24 STEP 2601 H=2601:00 +CPU= 32.382
  19:34:46 STEP 2602 H=2602:00 +CPU= 21.280
  19:35:07 STEP 2603 H=2603:00 +CPU= 20.818
  19:35:45 STEP 2604 H=2604:00 +CPU= 36.150
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002604
  19:36:07 STEP 2605 H=2605:00 +CPU= 20.574
  19:36:29 STEP 2606 H=2606:00 +CPU= 21.315
  19:37:03 STEP 2607 H=2607:00 +CPU= 32.635
  19:37:25 STEP 2608 H=2608:00 +CPU= 21.341
  19:37:46 STEP 2609 H=2609:00 +CPU= 20.511
  19:38:21 STEP 2610 H=2610:00 +CPU= 33.246
  19:38:43 STEP 2611 H=2611:00 +CPU= 20.750
  19:39:05 STEP 2612 H=2612:00 +CPU= 21.345
  19:39:39 STEP 2613 H=2613:00 +CPU= 32.579
  19:40:01 STEP 2614 H=2614:00 +CPU= 21.199
  19:40:23 STEP 2615 H=2615:00 +CPU= 21.195
  19:41:02 STEP 2616 H=2616:00 +CPU= 37.857
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_108.zip
Uploading the intermediate file: upload_file_108.zip
  19:41:24 STEP 2617 H=2617:00 +CPU= 20.695
  19:41:46 STEP 2618 H=2618:00 +CPU= 21.400
  19:42:21 STEP 2619 H=2619:00 +CPU= 32.866
  19:42:43 STEP 2620 H=2620:00 +CPU= 21.230
  19:43:04 STEP 2621 H=2621:00 +CPU= 20.707
  19:43:39 STEP 2622 H=2622:00 +CPU= 33.310
  19:44:00 STEP 2623 H=2623:00 +CPU= 20.610
  19:44:23 STEP 2624 H=2624:00 +CPU= 21.400
  19:44:57 STEP 2625 H=2625:00 +CPU= 32.488
  19:45:19 STEP 2626 H=2626:00 +CPU= 21.458
  19:45:41 STEP 2627 H=2627:00 +CPU= 20.893
  19:46:18 STEP 2628 H=2628:00 +CPU= 35.940
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002628
  19:46:40 STEP 2629 H=2629:00 +CPU= 20.945
  19:47:02 STEP 2630 H=2630:00 +CPU= 21.309
  19:47:36 STEP 2631 H=2631:00 +CPU= 32.550
  19:47:58 STEP 2632 H=2632:00 +CPU= 21.443
  19:48:20 STEP 2633 H=2633:00 +CPU= 20.716
  19:48:53 STEP 2634 H=2634:00 +CPU= 31.991
  19:49:12 STEP 2635 H=2635:00 +CPU= 18.998
  19:49:32 STEP 2636 H=2636:00 +CPU= 19.586
  19:50:02 STEP 2637 H=2637:00 +CPU= 30.145
  19:50:22 STEP 2638 H=2638:00 +CPU= 19.692
  19:50:42 STEP 2639 H=2639:00 +CPU= 19.752
  19:51:18 STEP 2640 H=2640:00 +CPU= 35.335
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_109.zip
Uploading the intermediate file: upload_file_109.zip
  19:51:37 STEP 2641 H=2641:00 +CPU= 18.999
  19:51:57 STEP 2642 H=2642:00 +CPU= 19.506
  19:52:27 STEP 2643 H=2643:00 +CPU= 30.174
  19:52:47 STEP 2644 H=2644:00 +CPU= 19.560
  19:53:06 STEP 2645 H=2645:00 +CPU= 18.993
  19:53:37 STEP 2646 H=2646:00 +CPU= 30.696
  19:53:56 STEP 2647 H=2647:00 +CPU= 19.007
  19:54:16 STEP 2648 H=2648:00 +CPU= 19.630
  19:54:46 STEP 2649 H=2649:00 +CPU= 29.967
  19:55:06 STEP 2650 H=2650:00 +CPU= 19.565
  19:55:25 STEP 2651 H=2651:00 +CPU= 19.103
  19:55:59 STEP 2652 H=2652:00 +CPU= 32.962
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002652
  19:56:18 STEP 2653 H=2653:00 +CPU= 19.305
  19:56:37 STEP 2654 H=2654:00 +CPU= 19.204
  19:57:08 STEP 2655 H=2655:00 +CPU= 29.858
  19:57:27 STEP 2656 H=2656:00 +CPU= 19.558
  19:57:47 STEP 2657 H=2657:00 +CPU= 19.196
  19:58:17 STEP 2658 H=2658:00 +CPU= 30.432
  19:58:37 STEP 2659 H=2659:00 +CPU= 18.980
  19:58:56 STEP 2660 H=2660:00 +CPU= 19.329
  19:59:27 STEP 2661 H=2661:00 +CPU= 30.072
  19:59:46 STEP 2662 H=2662:00 +CPU= 19.564
  20:00:06 STEP 2663 H=2663:00 +CPU= 19.522
  20:00:41 STEP 2664 H=2664:00 +CPU= 34.861
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_110.zip
Uploading the intermediate file: upload_file_110.zip
  20:01:00 STEP 2665 H=2665:00 +CPU= 18.896
  20:01:20 STEP 2666 H=2666:00 +CPU= 19.643
  20:01:50 STEP 2667 H=2667:00 +CPU= 29.902
  20:02:10 STEP 2668 H=2668:00 +CPU= 19.491
  20:02:30 STEP 2669 H=2669:00 +CPU= 19.401
  20:03:01 STEP 2670 H=2670:00 +CPU= 30.861
  20:03:20 STEP 2671 H=2671:00 +CPU= 19.011
  20:03:40 STEP 2672 H=2672:00 +CPU= 19.748
  20:04:10 STEP 2673 H=2673:00 +CPU= 30.159
  20:04:30 STEP 2674 H=2674:00 +CPU= 19.475
  20:04:49 STEP 2675 H=2675:00 +CPU= 18.862
  20:05:22 STEP 2676 H=2676:00 +CPU= 33.032
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002676
  20:05:42 STEP 2677 H=2677:00 +CPU= 19.063
  20:06:01 STEP 2678 H=2678:00 +CPU= 19.635
  20:06:32 STEP 2679 H=2679:00 +CPU= 30.023
  20:06:51 STEP 2680 H=2680:00 +CPU= 19.445
  20:07:10 STEP 2681 H=2681:00 +CPU= 18.919
  20:07:41 STEP 2682 H=2682:00 +CPU= 30.466
  20:08:00 STEP 2683 H=2683:00 +CPU= 18.708
  20:08:20 STEP 2684 H=2684:00 +CPU= 19.783
  20:08:50 STEP 2685 H=2685:00 +CPU= 29.557
  20:09:09 STEP 2686 H=2686:00 +CPU= 19.302
  20:09:29 STEP 2687 H=2687:00 +CPU= 19.589
  20:10:04 STEP 2688 H=2688:00 +CPU= 34.939
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_111.zip
Uploading the intermediate file: upload_file_111.zip
  20:10:24 STEP 2689 H=2689:00 +CPU= 19.226
  20:10:43 STEP 2690 H=2690:00 +CPU= 19.345
  20:11:13 STEP 2691 H=2691:00 +CPU= 29.982
  20:11:33 STEP 2692 H=2692:00 +CPU= 19.341
  20:11:52 STEP 2693 H=2693:00 +CPU= 19.035
  20:12:23 STEP 2694 H=2694:00 +CPU= 30.652
  20:12:42 STEP 2695 H=2695:00 +CPU= 18.840
  20:13:02 STEP 2696 H=2696:00 +CPU= 19.516
  20:13:32 STEP 2697 H=2697:00 +CPU= 29.877
  20:13:52 STEP 2698 H=2698:00 +CPU= 19.686
  20:14:11 STEP 2699 H=2699:00 +CPU= 19.182
  20:14:45 STEP 2700 H=2700:00 +CPU= 33.275
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002700
  20:15:04 STEP 2701 H=2701:00 +CPU= 19.333
  20:15:24 STEP 2702 H=2702:00 +CPU= 19.766
  20:15:54 STEP 2703 H=2703:00 +CPU= 29.885
  20:16:14 STEP 2704 H=2704:00 +CPU= 19.506
  20:16:33 STEP 2705 H=2705:00 +CPU= 18.871
  20:17:04 STEP 2706 H=2706:00 +CPU= 30.653
  20:17:23 STEP 2707 H=2707:00 +CPU= 19.011
  20:17:43 STEP 2708 H=2708:00 +CPU= 19.647
  20:18:14 STEP 2709 H=2709:00 +CPU= 30.143
  20:18:33 STEP 2710 H=2710:00 +CPU= 19.421
  20:18:53 STEP 2711 H=2711:00 +CPU= 19.807
  20:19:29 STEP 2712 H=2712:00 +CPU= 35.064
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_112.zip
Uploading the intermediate file: upload_file_112.zip
  20:19:48 STEP 2713 H=2713:00 +CPU= 18.928
  20:20:08 STEP 2714 H=2714:00 +CPU= 19.636
  20:20:38 STEP 2715 H=2715:00 +CPU= 29.928
  20:20:58 STEP 2716 H=2716:00 +CPU= 19.449
  20:21:17 STEP 2717 H=2717:00 +CPU= 18.974
  20:21:48 STEP 2718 H=2718:00 +CPU= 30.433
  20:22:07 STEP 2719 H=2719:00 +CPU= 18.977
  20:22:27 STEP 2720 H=2720:00 +CPU= 19.519
  20:22:57 STEP 2721 H=2721:00 +CPU= 30.128
  20:23:17 STEP 2722 H=2722:00 +CPU= 19.552
  20:23:36 STEP 2723 H=2723:00 +CPU= 18.756
  20:24:09 STEP 2724 H=2724:00 +CPU= 32.916
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002724
  20:24:29 STEP 2725 H=2725:00 +CPU= 18.994
  20:24:48 STEP 2726 H=2726:00 +CPU= 19.442
  20:25:18 STEP 2727 H=2727:00 +CPU= 29.819
  20:25:38 STEP 2728 H=2728:00 +CPU= 19.701
  20:25:58 STEP 2729 H=2729:00 +CPU= 19.075
  20:26:28 STEP 2730 H=2730:00 +CPU= 30.238
  20:26:48 STEP 2731 H=2731:00 +CPU= 19.061
  20:27:07 STEP 2732 H=2732:00 +CPU= 19.423
  20:27:38 STEP 2733 H=2733:00 +CPU= 30.348
  20:27:58 STEP 2734 H=2734:00 +CPU= 19.586
  20:28:17 STEP 2735 H=2735:00 +CPU= 19.562
  20:28:53 STEP 2736 H=2736:00 +CPU= 35.082
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_113.zip
Uploading the intermediate file: upload_file_113.zip
  20:29:12 STEP 2737 H=2737:00 +CPU= 18.966
  20:29:32 STEP 2738 H=2738:00 +CPU= 19.653
  20:30:02 STEP 2739 H=2739:00 +CPU= 29.789
  20:30:22 STEP 2740 H=2740:00 +CPU= 19.408
  20:30:41 STEP 2741 H=2741:00 +CPU= 19.025
  20:31:12 STEP 2742 H=2742:00 +CPU= 30.552
  20:31:31 STEP 2743 H=2743:00 +CPU= 18.949
  20:31:51 STEP 2744 H=2744:00 +CPU= 19.460
  20:32:21 STEP 2745 H=2745:00 +CPU= 29.988
  20:32:41 STEP 2746 H=2746:00 +CPU= 19.411
  20:33:00 STEP 2747 H=2747:00 +CPU= 19.013
  20:33:34 STEP 2748 H=2748:00 +CPU= 33.035
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002748
  20:33:53 STEP 2749 H=2749:00 +CPU= 19.050
  20:34:13 STEP 2750 H=2750:00 +CPU= 19.524
  20:34:43 STEP 2751 H=2751:00 +CPU= 29.750
  20:35:02 STEP 2752 H=2752:00 +CPU= 19.500
  20:35:22 STEP 2753 H=2753:00 +CPU= 19.124
  20:35:53 STEP 2754 H=2754:00 +CPU= 30.459
  20:36:12 STEP 2755 H=2755:00 +CPU= 19.022
  20:36:32 STEP 2756 H=2756:00 +CPU= 19.700
  20:37:02 STEP 2757 H=2757:00 +CPU= 29.843
  20:37:22 STEP 2758 H=2758:00 +CPU= 19.387
  20:37:41 STEP 2759 H=2759:00 +CPU= 19.532
  20:38:17 STEP 2760 H=2760:00 +CPU= 34.900
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_114.zip
Uploading the intermediate file: upload_file_114.zip
  20:38:36 STEP 2761 H=2761:00 +CPU= 19.015
  20:38:56 STEP 2762 H=2762:00 +CPU= 19.658
  20:39:26 STEP 2763 H=2763:00 +CPU= 30.210
  20:39:46 STEP 2764 H=2764:00 +CPU= 19.417
  20:40:05 STEP 2765 H=2765:00 +CPU= 19.157
  20:40:36 STEP 2766 H=2766:00 +CPU= 30.701
  20:40:56 STEP 2767 H=2767:00 +CPU= 19.173
  20:41:16 STEP 2768 H=2768:00 +CPU= 19.620
  20:41:46 STEP 2769 H=2769:00 +CPU= 30.137
  20:42:06 STEP 2770 H=2770:00 +CPU= 19.521
  20:42:25 STEP 2771 H=2771:00 +CPU= 19.021
  20:42:59 STEP 2772 H=2772:00 +CPU= 33.508
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002772
  20:43:18 STEP 2773 H=2773:00 +CPU= 19.029
  20:43:38 STEP 2774 H=2774:00 +CPU= 19.492
  20:44:08 STEP 2775 H=2775:00 +CPU= 30.005
  20:44:28 STEP 2776 H=2776:00 +CPU= 19.526
  20:44:47 STEP 2777 H=2777:00 +CPU= 19.012
  20:45:18 STEP 2778 H=2778:00 +CPU= 30.769
  20:45:38 STEP 2779 H=2779:00 +CPU= 18.893
  20:45:58 STEP 2780 H=2780:00 +CPU= 19.715
  20:46:28 STEP 2781 H=2781:00 +CPU= 29.967
  20:46:48 STEP 2782 H=2782:00 +CPU= 19.612
  20:47:07 STEP 2783 H=2783:00 +CPU= 19.384
  20:47:43 STEP 2784 H=2784:00 +CPU= 35.005
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_115.zip
Uploading the intermediate file: upload_file_115.zip
  20:48:02 STEP 2785 H=2785:00 +CPU= 19.112
  20:48:22 STEP 2786 H=2786:00 +CPU= 19.517
  20:48:52 STEP 2787 H=2787:00 +CPU= 29.783
  20:49:12 STEP 2788 H=2788:00 +CPU= 19.563
  20:49:31 STEP 2789 H=2789:00 +CPU= 18.815
  20:50:01 STEP 2790 H=2790:00 +CPU= 30.324
  20:50:21 STEP 2791 H=2791:00 +CPU= 18.894
  20:50:40 STEP 2792 H=2792:00 +CPU= 19.379
  20:51:11 STEP 2793 H=2793:00 +CPU= 30.215
  20:51:30 STEP 2794 H=2794:00 +CPU= 19.534
  20:51:50 STEP 2795 H=2795:00 +CPU= 19.119
  20:52:23 STEP 2796 H=2796:00 +CPU= 33.218
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002796
  20:52:43 STEP 2797 H=2797:00 +CPU= 18.938
  20:53:03 STEP 2798 H=2798:00 +CPU= 20.010
  20:53:33 STEP 2799 H=2799:00 +CPU= 30.215
  20:53:53 STEP 2800 H=2800:00 +CPU= 19.534
  20:54:12 STEP 2801 H=2801:00 +CPU= 18.997
  20:54:43 STEP 2802 H=2802:00 +CPU= 30.670
  20:55:03 STEP 2803 H=2803:00 +CPU= 19.140
  20:55:23 STEP 2804 H=2804:00 +CPU= 19.672
  20:55:53 STEP 2805 H=2805:00 +CPU= 29.850
  20:56:12 STEP 2806 H=2806:00 +CPU= 19.385
  20:56:32 STEP 2807 H=2807:00 +CPU= 19.556
  20:57:08 STEP 2808 H=2808:00 +CPU= 34.994
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_116.zip
Uploading the intermediate file: upload_file_116.zip
  20:57:27 STEP 2809 H=2809:00 +CPU= 19.034
  20:57:47 STEP 2810 H=2810:00 +CPU= 19.630
  20:58:17 STEP 2811 H=2811:00 +CPU= 30.344
  20:58:37 STEP 2812 H=2812:00 +CPU= 19.710
  20:58:56 STEP 2813 H=2813:00 +CPU= 18.854
  20:59:28 STEP 2814 H=2814:00 +CPU= 30.752
  20:59:47 STEP 2815 H=2815:00 +CPU= 18.963
  21:00:06 STEP 2816 H=2816:00 +CPU= 19.420
  21:00:37 STEP 2817 H=2817:00 +CPU= 30.312
  21:00:57 STEP 2818 H=2818:00 +CPU= 19.534
  21:01:16 STEP 2819 H=2819:00 +CPU= 19.109
  21:01:50 STEP 2820 H=2820:00 +CPU= 33.488
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002820
  21:02:09 STEP 2821 H=2821:00 +CPU= 19.150
  21:02:29 STEP 2822 H=2822:00 +CPU= 19.714
  21:03:00 STEP 2823 H=2823:00 +CPU= 30.246
  21:03:20 STEP 2824 H=2824:00 +CPU= 19.482
  21:03:39 STEP 2825 H=2825:00 +CPU= 18.977
  21:04:10 STEP 2826 H=2826:00 +CPU= 30.511
  21:04:29 STEP 2827 H=2827:00 +CPU= 19.027
  21:04:49 STEP 2828 H=2828:00 +CPU= 19.469
  21:05:20 STEP 2829 H=2829:00 +CPU= 30.396
  21:05:40 STEP 2830 H=2830:00 +CPU= 19.704
  21:05:57 STEP 2831 H=2831:00 +CPU= 17.742
  21:06:30 STEP 2832 H=2832:00 +CPU= 32.174
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_117.zip
Uploading the intermediate file: upload_file_117.zip
  21:06:47 STEP 2833 H=2833:00 +CPU= 17.318
Uploading trickle at timestep: 10195200
  21:07:05 STEP 2834 H=2834:00 +CPU= 17.838
  21:07:33 STEP 2835 H=2835:00 +CPU= 27.534
  21:07:51 STEP 2836 H=2836:00 +CPU= 17.911
  21:08:09 STEP 2837 H=2837:00 +CPU= 17.339
  21:08:37 STEP 2838 H=2838:00 +CPU= 28.269
  21:08:55 STEP 2839 H=2839:00 +CPU= 17.926
  21:09:14 STEP 2840 H=2840:00 +CPU= 18.890
  21:09:44 STEP 2841 H=2841:00 +CPU= 29.404
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0293
(argv4) batchid: 969
(argv5) wuid: 12185937
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bb83556f302c2bcf68c79dd498da8298 to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0293_2000050100_123_969_12185937.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0293_2000050100_123_969_12185937.zip
ic_ancil_file: ic_ancil_12185937
ifsdata_file: ifsdata_12185937
climate_data_file: clim_data_12185937
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c10f3a4e79ffcfc8236038873a46ebe1 to: /var/lib/boinc-client/slots/7/ic_ancil_12185937.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12185937.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_aa6a696d6192fd498dc686d1889399b4 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12185937.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12185937.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12185937.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12185937.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12185937.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12185937.xml
-- Model is restarting --
Adjusting last_iter, 2841, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12185937.xml
last_cpu_time: 78312
upload_file_number: 118
last_iter: 2831
last_upload: 10195200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390
The child process has been launched with process id: 12725
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:12725:12725] [20221223:211054:1671826254:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  21:11:35 STEP 2832 H=2832:00 +CPU= 35.326
  21:11:55 STEP 2833 H=2833:00 +CPU= 19.530
  21:12:16 STEP 2834 H=2834:00 +CPU= 20.590
  21:12:48 STEP 2835 H=2835:00 +CPU= 31.119
  21:13:07 STEP 2836 H=2836:00 +CPU= 19.463
  21:13:26 STEP 2837 H=2837:00 +CPU= 18.379
  21:13:55 STEP 2838 H=2838:00 +CPU= 29.155
  21:14:15 STEP 2839 H=2839:00 +CPU= 19.193
  21:14:35 STEP 2840 H=2840:00 +CPU= 20.209
  21:15:07 STEP 2841 H=2841:00 +CPU= 31.538
  21:15:28 STEP 2842 H=2842:00 +CPU= 20.179
  21:15:48 STEP 2843 H=2843:00 +CPU= 19.783
  21:16:23 STEP 2844 H=2844:00 +CPU= 34.513
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002844
  21:16:43 STEP 2845 H=2845:00 +CPU= 19.560
  21:17:03 STEP 2846 H=2846:00 +CPU= 20.211
  21:17:35 STEP 2847 H=2847:00 +CPU= 31.482
  21:17:56 STEP 2848 H=2848:00 +CPU= 20.506
  21:18:16 STEP 2849 H=2849:00 +CPU= 19.697
  21:18:48 STEP 2850 H=2850:00 +CPU= 31.540
  21:19:08 STEP 2851 H=2851:00 +CPU= 19.932
  21:19:28 STEP 2852 H=2852:00 +CPU= 20.296
  21:20:00 STEP 2853 H=2853:00 +CPU= 31.245
  21:20:21 STEP 2854 H=2854:00 +CPU= 20.131
  21:20:41 STEP 2855 H=2855:00 +CPU= 20.299
  21:21:19 STEP 2856 H=2856:00 +CPU= 36.718
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_118.zip
Uploading the intermediate file: upload_file_118.zip
  21:21:39 STEP 2857 H=2857:00 +CPU= 19.871
  21:21:59 STEP 2858 H=2858:00 +CPU= 20.251
  21:22:32 STEP 2859 H=2859:00 +CPU= 31.980
  21:22:53 STEP 2860 H=2860:00 +CPU= 20.367
  21:23:13 STEP 2861 H=2861:00 +CPU= 19.914
  21:23:45 STEP 2862 H=2862:00 +CPU= 32.318
  21:24:05 STEP 2863 H=2863:00 +CPU= 19.665
  21:24:26 STEP 2864 H=2864:00 +CPU= 20.442
  21:24:58 STEP 2865 H=2865:00 +CPU= 31.767
  21:25:19 STEP 2866 H=2866:00 +CPU= 20.585
  21:25:39 STEP 2867 H=2867:00 +CPU= 19.585
  21:26:15 STEP 2868 H=2868:00 +CPU= 35.056
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002868
  21:26:35 STEP 2869 H=2869:00 +CPU= 20.041
  21:26:55 STEP 2870 H=2870:00 +CPU= 20.326
  21:27:27 STEP 2871 H=2871:00 +CPU= 31.591
  21:27:48 STEP 2872 H=2872:00 +CPU= 20.110
  21:28:08 STEP 2873 H=2873:00 +CPU= 19.761
  21:28:40 STEP 2874 H=2874:00 +CPU= 32.030
  21:29:00 STEP 2875 H=2875:00 +CPU= 19.691
  21:29:21 STEP 2876 H=2876:00 +CPU= 20.471
  21:29:56 STEP 2877 H=2877:00 +CPU= 33.510
  21:30:19 STEP 2878 H=2878:00 +CPU= 22.239
  21:30:42 STEP 2879 H=2879:00 +CPU= 22.133
  21:31:24 STEP 2880 H=2880:00 +CPU= 39.474
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_119.zip
Uploading the intermediate file: upload_file_119.zip
  21:31:47 STEP 2881 H=2881:00 +CPU= 21.496
  21:32:11 STEP 2882 H=2882:00 +CPU= 22.747
  21:32:46 STEP 2883 H=2883:00 +CPU= 33.989
  21:33:10 STEP 2884 H=2884:00 +CPU= 22.286
  21:33:32 STEP 2885 H=2885:00 +CPU= 21.117
  21:34:09 STEP 2886 H=2886:00 +CPU= 34.955
  21:34:31 STEP 2887 H=2887:00 +CPU= 21.364
  21:34:52 STEP 2888 H=2888:00 +CPU= 20.582
  21:35:23 STEP 2889 H=2889:00 +CPU= 31.253
  21:35:44 STEP 2890 H=2890:00 +CPU= 20.198
  21:36:04 STEP 2891 H=2891:00 +CPU= 19.721
  21:36:39 STEP 2892 H=2892:00 +CPU= 34.315
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002892
  21:36:59 STEP 2893 H=2893:00 +CPU= 20.011
  21:37:20 STEP 2894 H=2894:00 +CPU= 20.297
  21:37:52 STEP 2895 H=2895:00 +CPU= 31.442
  21:38:12 STEP 2896 H=2896:00 +CPU= 20.294
  21:38:32 STEP 2897 H=2897:00 +CPU= 19.722
  21:39:05 STEP 2898 H=2898:00 +CPU= 32.177
  21:39:25 STEP 2899 H=2899:00 +CPU= 19.766
  21:39:45 STEP 2900 H=2900:00 +CPU= 20.161
  21:40:15 STEP 2901 H=2901:00 +CPU= 29.598
  21:40:35 STEP 2902 H=2902:00 +CPU= 19.585
  21:40:54 STEP 2903 H=2903:00 +CPU= 19.102
  21:41:30 STEP 2904 H=2904:00 +CPU= 34.548
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_120.zip
Uploading the intermediate file: upload_file_120.zip
  21:41:50 STEP 2905 H=2905:00 +CPU= 19.891
  21:42:11 STEP 2906 H=2906:00 +CPU= 20.624
  21:42:42 STEP 2907 H=2907:00 +CPU= 31.116
  21:43:03 STEP 2908 H=2908:00 +CPU= 20.550
  21:43:23 STEP 2909 H=2909:00 +CPU= 20.148
  21:43:56 STEP 2910 H=2910:00 +CPU= 32.141
  21:44:16 STEP 2911 H=2911:00 +CPU= 19.567
  21:44:37 STEP 2912 H=2912:00 +CPU= 20.609
  21:45:09 STEP 2913 H=2913:00 +CPU= 31.331
  21:45:29 STEP 2914 H=2914:00 +CPU= 20.580
  21:45:48 STEP 2915 H=2915:00 +CPU= 18.699
  21:46:22 STEP 2916 H=2916:00 +CPU= 33.402
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002916
  21:46:42 STEP 2917 H=2917:00 +CPU= 19.899
  21:47:03 STEP 2918 H=2918:00 +CPU= 20.545
  21:47:35 STEP 2919 H=2919:00 +CPU= 31.320
  21:47:56 STEP 2920 H=2920:00 +CPU= 20.584
  21:48:16 STEP 2921 H=2921:00 +CPU= 19.930
  21:48:48 STEP 2922 H=2922:00 +CPU= 31.418
  21:49:08 STEP 2923 H=2923:00 +CPU= 20.112
  21:49:30 STEP 2924 H=2924:00 +CPU= 21.273
  21:50:02 STEP 2925 H=2925:00 +CPU= 31.343
  21:50:23 STEP 2926 H=2926:00 +CPU= 20.510
  21:50:43 STEP 2927 H=2927:00 +CPU= 20.508
  21:51:21 STEP 2928 H=2928:00 +CPU= 36.214
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_121.zip
Uploading the intermediate file: upload_file_121.zip
  21:51:41 STEP 2929 H=2929:00 +CPU= 19.945
  21:52:02 STEP 2930 H=2930:00 +CPU= 21.148
  21:52:34 STEP 2931 H=2931:00 +CPU= 31.101
  21:52:55 STEP 2932 H=2932:00 +CPU= 20.291
  21:53:15 STEP 2933 H=2933:00 +CPU= 20.251
  21:53:47 STEP 2934 H=2934:00 +CPU= 31.923
  21:54:08 STEP 2935 H=2935:00 +CPU= 19.979
  21:54:29 STEP 2936 H=2936:00 +CPU= 20.705
  21:55:01 STEP 2937 H=2937:00 +CPU= 31.556
  21:55:21 STEP 2938 H=2938:00 +CPU= 20.246
  21:55:42 STEP 2939 H=2939:00 +CPU= 20.224
  21:56:16 STEP 2940 H=2940:00 +CPU= 34.111
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002940
  21:56:37 STEP 2941 H=2941:00 +CPU= 19.973
  21:56:57 STEP 2942 H=2942:00 +CPU= 20.544
  21:57:29 STEP 2943 H=2943:00 +CPU= 31.383
  21:57:50 STEP 2944 H=2944:00 +CPU= 20.338
  21:58:09 STEP 2945 H=2945:00 +CPU= 18.693
  21:58:41 STEP 2946 H=2946:00 +CPU= 31.670
  21:59:00 STEP 2947 H=2947:00 +CPU= 18.643
  21:59:20 STEP 2948 H=2948:00 +CPU= 20.276
  21:59:52 STEP 2949 H=2949:00 +CPU= 31.286
  22:00:13 STEP 2950 H=2950:00 +CPU= 20.473
  22:00:33 STEP 2951 H=2951:00 +CPU= 20.396
  22:01:10 STEP 2952 H=2952:00 +CPU= 35.423
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185937/ICMGGhq0f+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0293_2000050100_123_969_12185937_0_r80077390_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
22:04:33 (12721): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:50:57 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 10,623,600 81,271 0.0077
09 May 2023 15:50:57 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 10,195,200 78,133 0.0077
09 May 2023 15:50:43 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 9,331,200 72,460 0.0078
09 May 2023 15:50:32 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 8,467,200 66,016 0.0078
09 May 2023 15:50:13 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 6,912,000 54,833 0.0079
09 May 2023 15:50:02 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 6,048,000 47,905 0.0079
09 May 2023 15:49:49 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 5,184,000 40,856 0.0079
09 May 2023 15:49:38 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 4,320,000 33,583 0.0078
09 May 2023 15:49:28 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 3,456,000 27,188 0.0079
09 May 2023 15:49:18 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 2,592,000 20,547 0.0079
09 May 2023 15:49:07 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 1,728,000 13,429 0.0078
09 May 2023 15:49:01 1523867 22271285 oifs_43r3_ps_0293_2000050100_123_969_12185937_0 864,000 6,543 0.0076


©2024 cpdn.org