climateprediction.net home page
Task 22271301

Task 22271301

Name oifs_43r3_ps_0308_2000050100_123_969_12185952_0
Workunit 12185952
Created 22 Dec 2022, 21:06:26 UTC
Sent 17 Jan 2023, 8:07:45 UTC
Report deadline 18 Mar 2023, 8:07:45 UTC
Received 18 Jan 2023, 14:46:04 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1536928
Run time 22 hours 15 min 35 sec
CPU time 21 hours 38 min 30 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 4.93 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,407.87 MB
Peak swap size 4,978.06 MB
Peak disk usage 2,024.13 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
zip
  21:48:58 STEP 2497 H=2497:00 +CPU= 17.075
  21:49:19 STEP 2498 H=2498:00 +CPU= 19.968
  21:49:48 STEP 2499 H=2499:00 +CPU= 29.192
  21:50:07 STEP 2500 H=2500:00 +CPU= 18.444
  21:50:28 STEP 2501 H=2501:00 +CPU= 19.561
  21:51:02 STEP 2502 H=2502:00 +CPU= 34.327
  21:51:22 STEP 2503 H=2503:00 +CPU= 19.049
  21:51:43 STEP 2504 H=2504:00 +CPU= 19.849
  21:52:13 STEP 2505 H=2505:00 +CPU= 29.550
  21:52:32 STEP 2506 H=2506:00 +CPU= 17.975
  21:52:50 STEP 2507 H=2507:00 +CPU= 18.394
  21:53:23 STEP 2508 H=2508:00 +CPU= 32.225
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002508
  21:53:42 STEP 2509 H=2509:00 +CPU= 17.485
  21:54:01 STEP 2510 H=2510:00 +CPU= 19.431
  21:54:32 STEP 2511 H=2511:00 +CPU= 29.947
  21:54:50 STEP 2512 H=2512:00 +CPU= 17.543
  21:55:10 STEP 2513 H=2513:00 +CPU= 20.611
  21:55:42 STEP 2514 H=2514:00 +CPU= 30.976
  21:56:00 STEP 2515 H=2515:00 +CPU= 17.846
  21:56:19 STEP 2516 H=2516:00 +CPU= 18.835
  21:56:50 STEP 2517 H=2517:00 +CPU= 30.526
  21:57:10 STEP 2518 H=2518:00 +CPU= 18.625
  21:57:29 STEP 2519 H=2519:00 +CPU= 19.238
  21:58:06 STEP 2520 H=2520:00 +CPU= 35.959
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_104.zip
Uploading the intermediate file: upload_file_104.zip
  21:58:24 STEP 2521 H=2521:00 +CPU= 17.948
  21:58:45 STEP 2522 H=2522:00 +CPU= 19.687
  21:59:15 STEP 2523 H=2523:00 +CPU= 29.383
  21:59:34 STEP 2524 H=2524:00 +CPU= 19.122
  21:59:55 STEP 2525 H=2525:00 +CPU= 20.044
  22:00:29 STEP 2526 H=2526:00 +CPU= 32.504
  22:00:50 STEP 2527 H=2527:00 +CPU= 20.859
  22:01:12 STEP 2528 H=2528:00 +CPU= 21.572
  22:01:44 STEP 2529 H=2529:00 +CPU= 30.451
  22:02:04 STEP 2530 H=2530:00 +CPU= 19.885
  22:02:25 STEP 2531 H=2531:00 +CPU= 21.274
  22:03:04 STEP 2532 H=2532:00 +CPU= 37.408
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002532
  22:03:23 STEP 2533 H=2533:00 +CPU= 19.363
  22:03:44 STEP 2534 H=2534:00 +CPU= 19.942
  22:04:14 STEP 2535 H=2535:00 +CPU= 29.576
  22:04:33 STEP 2536 H=2536:00 +CPU= 18.540
  22:04:53 STEP 2537 H=2537:00 +CPU= 19.514
  22:05:25 STEP 2538 H=2538:00 +CPU= 31.594
  22:05:44 STEP 2539 H=2539:00 +CPU= 18.906
  22:06:04 STEP 2540 H=2540:00 +CPU= 19.585
  22:06:35 STEP 2541 H=2541:00 +CPU= 30.378
  22:06:55 STEP 2542 H=2542:00 +CPU= 19.245
  22:07:15 STEP 2543 H=2543:00 +CPU= 19.258
  22:07:52 STEP 2544 H=2544:00 +CPU= 36.195
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_105.zip
Uploading the intermediate file: upload_file_105.zip
  22:08:11 STEP 2545 H=2545:00 +CPU= 18.497
  22:08:30 STEP 2546 H=2546:00 +CPU= 19.170
  22:09:01 STEP 2547 H=2547:00 +CPU= 30.065
  22:09:21 STEP 2548 H=2548:00 +CPU= 19.661
  22:09:41 STEP 2549 H=2549:00 +CPU= 19.090
  22:10:12 STEP 2550 H=2550:00 +CPU= 30.596
  22:10:32 STEP 2551 H=2551:00 +CPU= 19.104
  22:10:53 STEP 2552 H=2552:00 +CPU= 20.065
  22:11:23 STEP 2553 H=2553:00 +CPU= 29.979
  22:11:44 STEP 2554 H=2554:00 +CPU= 20.367
  22:12:03 STEP 2555 H=2555:00 +CPU= 18.655
  22:12:37 STEP 2556 H=2556:00 +CPU= 32.870
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002556
  22:12:56 STEP 2557 H=2557:00 +CPU= 18.847
  22:13:16 STEP 2558 H=2558:00 +CPU= 19.547
  22:13:45 STEP 2559 H=2559:00 +CPU= 29.006
  22:14:04 STEP 2560 H=2560:00 +CPU= 18.926
  22:14:23 STEP 2561 H=2561:00 +CPU= 18.382
  22:14:53 STEP 2562 H=2562:00 +CPU= 29.295
  22:15:12 STEP 2563 H=2563:00 +CPU= 18.415
  22:15:31 STEP 2564 H=2564:00 +CPU= 18.542
  22:16:00 STEP 2565 H=2565:00 +CPU= 28.721
  22:16:18 STEP 2566 H=2566:00 +CPU= 17.726
  22:16:37 STEP 2567 H=2567:00 +CPU= 19.120
  22:17:14 STEP 2568 H=2568:00 +CPU= 35.304
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_106.zip
Uploading the intermediate file: upload_file_106.zip
  22:17:33 STEP 2569 H=2569:00 +CPU= 18.547
  22:17:53 STEP 2570 H=2570:00 +CPU= 18.933
  22:18:23 STEP 2571 H=2571:00 +CPU= 29.572
  22:18:41 STEP 2572 H=2572:00 +CPU= 17.925
  22:19:00 STEP 2573 H=2573:00 +CPU= 18.662
  22:19:31 STEP 2574 H=2574:00 +CPU= 30.395
  22:19:49 STEP 2575 H=2575:00 +CPU= 17.850
  22:20:08 STEP 2576 H=2576:00 +CPU= 19.206
  22:20:40 STEP 2577 H=2577:00 +CPU= 31.020
  22:20:59 STEP 2578 H=2578:00 +CPU= 18.560
  22:21:17 STEP 2579 H=2579:00 +CPU= 17.770
  22:21:51 STEP 2580 H=2580:00 +CPU= 32.849
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002580
  22:22:08 STEP 2581 H=2581:00 +CPU= 17.266
  22:22:28 STEP 2582 H=2582:00 +CPU= 19.269
  22:22:59 STEP 2583 H=2583:00 +CPU= 30.145
  22:23:16 STEP 2584 H=2584:00 +CPU= 17.327
  22:23:35 STEP 2585 H=2585:00 +CPU= 17.931
  22:24:05 STEP 2586 H=2586:00 +CPU= 29.490
  22:24:23 STEP 2587 H=2587:00 +CPU= 17.586
  22:24:41 STEP 2588 H=2588:00 +CPU= 18.404
  22:25:11 STEP 2589 H=2589:00 +CPU= 29.097
  22:25:30 STEP 2590 H=2590:00 +CPU= 18.773
  22:25:50 STEP 2591 H=2591:00 +CPU= 19.310
  22:26:26 STEP 2592 H=2592:00 +CPU= 35.307
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_107.zip
Uploading the intermediate file: upload_file_107.zip
  22:26:44 STEP 2593 H=2593:00 +CPU= 17.328
  22:27:04 STEP 2594 H=2594:00 +CPU= 19.087
  22:27:35 STEP 2595 H=2595:00 +CPU= 29.545
  22:27:53 STEP 2596 H=2596:00 +CPU= 18.258
  22:28:12 STEP 2597 H=2597:00 +CPU= 18.049
  22:28:42 STEP 2598 H=2598:00 +CPU= 29.820
  22:29:01 STEP 2599 H=2599:00 +CPU= 18.274
  22:29:21 STEP 2600 H=2600:00 +CPU= 19.546
  22:29:50 STEP 2601 H=2601:00 +CPU= 28.438
  22:30:10 STEP 2602 H=2602:00 +CPU= 19.594
  22:30:29 STEP 2603 H=2603:00 +CPU= 18.778
  22:31:01 STEP 2604 H=2604:00 +CPU= 31.557
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002604
  22:31:20 STEP 2605 H=2605:00 +CPU= 19.095
  22:31:41 STEP 2606 H=2606:00 +CPU= 19.796
  22:32:10 STEP 2607 H=2607:00 +CPU= 28.798
  22:32:29 STEP 2608 H=2608:00 +CPU= 18.913
  22:32:48 STEP 2609 H=2609:00 +CPU= 19.014
  22:33:18 STEP 2610 H=2610:00 +CPU= 29.107
  22:33:38 STEP 2611 H=2611:00 +CPU= 18.991
  22:33:57 STEP 2612 H=2612:00 +CPU= 18.885
  22:34:25 STEP 2613 H=2613:00 +CPU= 27.662
  22:34:43 STEP 2614 H=2614:00 +CPU= 18.289
  22:35:02 STEP 2615 H=2615:00 +CPU= 18.476
  22:35:37 STEP 2616 H=2616:00 +CPU= 33.311
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_108.zip
Uploading the intermediate file: upload_file_108.zip
  22:35:55 STEP 2617 H=2617:00 +CPU= 17.742
  22:36:14 STEP 2618 H=2618:00 +CPU= 18.805
  22:36:43 STEP 2619 H=2619:00 +CPU= 28.070
  22:37:02 STEP 2620 H=2620:00 +CPU= 18.369
  22:37:20 STEP 2621 H=2621:00 +CPU= 17.916
  22:37:49 STEP 2622 H=2622:00 +CPU= 27.948
  22:38:07 STEP 2623 H=2623:00 +CPU= 17.657
  22:38:25 STEP 2624 H=2624:00 +CPU= 18.315
  22:38:54 STEP 2625 H=2625:00 +CPU= 28.127
  22:39:12 STEP 2626 H=2626:00 +CPU= 18.121
  22:39:31 STEP 2627 H=2627:00 +CPU= 18.056
  22:40:03 STEP 2628 H=2628:00 +CPU= 31.229
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002628
  22:40:22 STEP 2629 H=2629:00 +CPU= 18.179
  22:40:40 STEP 2630 H=2630:00 +CPU= 17.904
  22:41:10 STEP 2631 H=2631:00 +CPU= 29.630
  22:41:30 STEP 2632 H=2632:00 +CPU= 19.193
  22:41:48 STEP 2633 H=2633:00 +CPU= 17.527
  22:42:19 STEP 2634 H=2634:00 +CPU= 30.152
  22:42:37 STEP 2635 H=2635:00 +CPU= 17.888
  22:42:54 STEP 2636 H=2636:00 +CPU= 16.988
  22:43:23 STEP 2637 H=2637:00 +CPU= 28.587
  22:43:42 STEP 2638 H=2638:00 +CPU= 18.421
  22:44:00 STEP 2639 H=2639:00 +CPU= 17.935
  22:44:36 STEP 2640 H=2640:00 +CPU= 34.784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_109.zip
Uploading the intermediate file: upload_file_109.zip
  22:44:55 STEP 2641 H=2641:00 +CPU= 18.256
Uploading trickle at timestep: 9504000
  22:45:14 STEP 2642 H=2642:00 +CPU= 18.563
  22:45:44 STEP 2643 H=2643:00 +CPU= 29.176
  22:46:03 STEP 2644 H=2644:00 +CPU= 18.493
  22:46:20 STEP 2645 H=2645:00 +CPU= 17.037
  22:46:51 STEP 2646 H=2646:00 +CPU= 29.727
  22:47:10 STEP 2647 H=2647:00 +CPU= 18.081
  22:47:28 STEP 2648 H=2648:00 +CPU= 18.353
  22:47:57 STEP 2649 H=2649:00 +CPU= 28.629
  22:48:17 STEP 2650 H=2650:00 +CPU= 18.893
  22:48:36 STEP 2651 H=2651:00 +CPU= 18.411
  22:49:08 STEP 2652 H=2652:00 +CPU= 31.176
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002652
  22:49:27 STEP 2653 H=2653:00 +CPU= 18.473
  22:49:46 STEP 2654 H=2654:00 +CPU= 18.832
  22:50:16 STEP 2655 H=2655:00 +CPU= 28.649
  22:50:36 STEP 2656 H=2656:00 +CPU= 18.900
  22:50:54 STEP 2657 H=2657:00 +CPU= 17.572
  22:51:22 STEP 2658 H=2658:00 +CPU= 28.021
  22:51:41 STEP 2659 H=2659:00 +CPU= 18.409
  22:52:01 STEP 2660 H=2660:00 +CPU= 19.136
  22:52:29 STEP 2661 H=2661:00 +CPU= 28.274
  22:52:49 STEP 2662 H=2662:00 +CPU= 18.908
  22:53:09 STEP 2663 H=2663:00 +CPU= 19.063
  22:53:45 STEP 2664 H=2664:00 +CPU= 35.137
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_110.zip
Uploading the intermediate file: upload_file_110.zip
  22:54:03 STEP 2665 H=2665:00 +CPU= 18.225
  22:54:23 STEP 2666 H=2666:00 +CPU= 18.783
  22:54:53 STEP 2667 H=2667:00 +CPU= 28.538
  22:55:13 STEP 2668 H=2668:00 +CPU= 19.326
  22:55:33 STEP 2669 H=2669:00 +CPU= 19.469
  22:56:03 STEP 2670 H=2670:00 +CPU= 28.930
  22:56:22 STEP 2671 H=2671:00 +CPU= 18.747
  22:56:41 STEP 2672 H=2672:00 +CPU= 18.683
  22:57:11 STEP 2673 H=2673:00 +CPU= 28.908
  22:57:30 STEP 2674 H=2674:00 +CPU= 19.545
  22:57:49 STEP 2675 H=2675:00 +CPU= 18.647
  22:58:21 STEP 2676 H=2676:00 +CPU= 31.264
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002676
  22:58:40 STEP 2677 H=2677:00 +CPU= 18.900
  22:59:00 STEP 2678 H=2678:00 +CPU= 19.158
  22:59:29 STEP 2679 H=2679:00 +CPU= 28.291
  22:59:48 STEP 2680 H=2680:00 +CPU= 18.961
  23:00:06 STEP 2681 H=2681:00 +CPU= 17.506
  23:00:34 STEP 2682 H=2682:00 +CPU= 28.309
  23:00:53 STEP 2683 H=2683:00 +CPU= 18.475
  23:01:12 STEP 2684 H=2684:00 +CPU= 18.514
  23:01:41 STEP 2685 H=2685:00 +CPU= 28.495
  23:01:59 STEP 2686 H=2686:00 +CPU= 18.586
  23:02:18 STEP 2687 H=2687:00 +CPU= 18.602
  23:02:53 STEP 2688 H=2688:00 +CPU= 33.586
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_111.zip
Uploading the intermediate file: upload_file_111.zip
  23:03:11 STEP 2689 H=2689:00 +CPU= 17.918
  23:03:30 STEP 2690 H=2690:00 +CPU= 18.472
  23:03:59 STEP 2691 H=2691:00 +CPU= 27.951
  23:04:18 STEP 2692 H=2692:00 +CPU= 18.612
  23:04:36 STEP 2693 H=2693:00 +CPU= 18.060
  23:05:05 STEP 2694 H=2694:00 +CPU= 27.986
  23:05:23 STEP 2695 H=2695:00 +CPU= 18.120
  23:05:43 STEP 2696 H=2696:00 +CPU= 18.962
  23:06:11 STEP 2697 H=2697:00 +CPU= 28.248
  23:06:30 STEP 2698 H=2698:00 +CPU= 18.509
  23:06:50 STEP 2699 H=2699:00 +CPU= 19.524
  23:07:22 STEP 2700 H=2700:00 +CPU= 31.094
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002700
  23:07:40 STEP 2701 H=2701:00 +CPU= 18.176
  23:07:59 STEP 2702 H=2702:00 +CPU= 18.596
  23:08:28 STEP 2703 H=2703:00 +CPU= 28.620
  23:08:47 STEP 2704 H=2704:00 +CPU= 18.505
  23:09:06 STEP 2705 H=2705:00 +CPU= 18.763
  23:09:38 STEP 2706 H=2706:00 +CPU= 31.405
  23:09:56 STEP 2707 H=2707:00 +CPU= 17.696
  23:10:16 STEP 2708 H=2708:00 +CPU= 20.117
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231533:1674015333:72361.878] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4031MB (heap), 4415MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231533:1674015333:72362.071] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231533:1674015333:72362.071] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231533:1674015333:72362.071] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231533:1674015333:72362.071] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231533:1674015333:72362.071] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4031 MB (maxheap), 4415 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231533:1674015333:72362.071] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.143] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.155] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.155] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            RADDRV 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             RADINTG 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-RADINTG-RADLSW       (1210) 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               RADIATION_SCHEME 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                radiation_interface:radiation 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 radiation_ifs_rrtm:gas_optics 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                  SRTM_GAS_OPTICAL_DEPTH 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231534:1674015334:72362.169] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                   SRTM_TAUMOL28 
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231535:1674015335:72363.256] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:4621:4621] [20230117:231535:1674015335:72363.256] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000192CF4E  srtm_taumol28_            108  srtm_taumol28.F90
oifs_43r3_model.e  00000000019201C8  srtm_gas_optical_         283  srtm_gas_optical_depth.F90
oifs_43r3_model.e  00000000018BC1E2  radiation_ifs_rrt         432  radiation_ifs_rrtm.F90
oifs_43r3_model.e  0000000001862293  radiation_interfa         311  radiation_interface.F90
oifs_43r3_model.e  00000000012D30E5  radiation_scheme_         484  radiation_scheme.F90
oifs_43r3_model.e  000000000129A415  radintg_                 1455  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0308
(argv4) batchid: 969
(argv5) wuid: 12185952
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_c1adf43f0673e47d19402ba4cc77a94d to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0308_2000050100_123_969_12185952.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0308_2000050100_123_969_12185952.zip
ic_ancil_file: ic_ancil_12185952
ifsdata_file: ifsdata_12185952
climate_data_file: clim_data_12185952
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_18a18520938e454c4cff651854c96296 to: /var/lib/boinc-client/slots/1/ic_ancil_12185952.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12185952.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a24a2d5d08eb372935f9fffe732adf7f to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185952.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185952.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185952.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185952.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12185952.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12185952.xml
-- Model is restarting --
Adjusting last_iter, 2709, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12185952.xml
last_cpu_time: 70421
upload_file_number: 112
last_iter: 2687
last_upload: 9676800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277
The child process has been launched with process id: 3074
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ubuntu-VirtualBox:1:1:3074:3074] [20230118:071000:1674043800:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  07:13:15 STEP 2688 H=2688:00 +CPU= 34.174
  07:13:38 STEP 2689 H=2689:00 +CPU= 21.912
  07:14:03 STEP 2690 H=2690:00 +CPU= 24.039
  07:14:40 STEP 2691 H=2691:00 +CPU= 33.415
  07:15:05 STEP 2692 H=2692:00 +CPU= 23.750
  07:15:32 STEP 2693 H=2693:00 +CPU= 25.920
  07:16:10 STEP 2694 H=2694:00 +CPU= 34.462
  07:16:34 STEP 2695 H=2695:00 +CPU= 24.054
  07:16:58 STEP 2696 H=2696:00 +CPU= 23.555
  07:17:33 STEP 2697 H=2697:00 +CPU= 34.287
  07:17:57 STEP 2698 H=2698:00 +CPU= 23.757
  07:18:20 STEP 2699 H=2699:00 +CPU= 22.835
  07:18:57 STEP 2700 H=2700:00 +CPU= 36.962
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002700
  07:19:21 STEP 2701 H=2701:00 +CPU= 23.416
  07:19:45 STEP 2702 H=2702:00 +CPU= 23.613
  07:20:20 STEP 2703 H=2703:00 +CPU= 34.601
  07:20:42 STEP 2704 H=2704:00 +CPU= 22.499
  07:21:06 STEP 2705 H=2705:00 +CPU= 23.767
  07:21:42 STEP 2706 H=2706:00 +CPU= 35.668
  07:22:09 STEP 2707 H=2707:00 +CPU= 25.733
  07:22:36 STEP 2708 H=2708:00 +CPU= 26.244
  07:23:10 STEP 2709 H=2709:00 +CPU= 34.125
  07:23:40 STEP 2710 H=2710:00 +CPU= 29.650
  07:24:10 STEP 2711 H=2711:00 +CPU= 28.622
  07:24:50 STEP 2712 H=2712:00 +CPU= 39.093
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_112.zip
Uploading the intermediate file: upload_file_112.zip
  07:25:15 STEP 2713 H=2713:00 +CPU= 25.007
  07:25:43 STEP 2714 H=2714:00 +CPU= 26.424
  07:26:21 STEP 2715 H=2715:00 +CPU= 37.064
  07:26:48 STEP 2716 H=2716:00 +CPU= 26.211
  07:27:12 STEP 2717 H=2717:00 +CPU= 23.467
  07:27:50 STEP 2718 H=2718:00 +CPU= 37.253
  07:28:15 STEP 2719 H=2719:00 +CPU= 24.655
  07:28:41 STEP 2720 H=2720:00 +CPU= 24.675
  07:29:20 STEP 2721 H=2721:00 +CPU= 38.090
  07:29:48 STEP 2722 H=2722:00 +CPU= 27.029
  07:30:15 STEP 2723 H=2723:00 +CPU= 26.612
  07:30:58 STEP 2724 H=2724:00 +CPU= 41.892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002724
  07:31:21 STEP 2725 H=2725:00 +CPU= 22.640
  07:31:47 STEP 2726 H=2726:00 +CPU= 24.404
  07:32:22 STEP 2727 H=2727:00 +CPU= 35.161
  07:32:47 STEP 2728 H=2728:00 +CPU= 24.585
  07:33:10 STEP 2729 H=2729:00 +CPU= 22.700
  07:33:47 STEP 2730 H=2730:00 +CPU= 36.064
  07:34:11 STEP 2731 H=2731:00 +CPU= 23.416
  07:34:35 STEP 2732 H=2732:00 +CPU= 23.729
  07:35:12 STEP 2733 H=2733:00 +CPU= 36.250
  07:35:35 STEP 2734 H=2734:00 +CPU= 22.873
  07:36:00 STEP 2735 H=2735:00 +CPU= 24.053
  07:36:54 STEP 2736 H=2736:00 +CPU= 38.376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_113.zip
Uploading the intermediate file: upload_file_113.zip
  07:37:18 STEP 2737 H=2737:00 +CPU= 22.921
  07:37:42 STEP 2738 H=2738:00 +CPU= 23.175
  07:38:19 STEP 2739 H=2739:00 +CPU= 35.941
  07:38:42 STEP 2740 H=2740:00 +CPU= 23.169
  07:39:06 STEP 2741 H=2741:00 +CPU= 23.445
  07:39:44 STEP 2742 H=2742:00 +CPU= 37.223
  07:40:08 STEP 2743 H=2743:00 +CPU= 23.324
  07:40:33 STEP 2744 H=2744:00 +CPU= 24.171
  07:41:10 STEP 2745 H=2745:00 +CPU= 35.982
  07:41:35 STEP 2746 H=2746:00 +CPU= 25.233
  07:41:59 STEP 2747 H=2747:00 +CPU= 23.046
  07:42:41 STEP 2748 H=2748:00 +CPU= 41.607
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002748
  07:43:07 STEP 2749 H=2749:00 +CPU= 24.740
  07:43:31 STEP 2750 H=2750:00 +CPU= 23.750
  07:44:08 STEP 2751 H=2751:00 +CPU= 35.819
  07:44:32 STEP 2752 H=2752:00 +CPU= 24.346
  07:44:56 STEP 2753 H=2753:00 +CPU= 23.072
  07:45:33 STEP 2754 H=2754:00 +CPU= 36.109
  07:45:56 STEP 2755 H=2755:00 +CPU= 22.356
  07:46:19 STEP 2756 H=2756:00 +CPU= 22.505
  07:47:05 STEP 2757 H=2757:00 +CPU= 44.439
  07:47:31 STEP 2758 H=2758:00 +CPU= 25.760
  07:47:58 STEP 2759 H=2759:00 +CPU= 26.043
  07:48:43 STEP 2760 H=2760:00 +CPU= 43.704
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_114.zip
Uploading the intermediate file: upload_file_114.zip
  07:49:10 STEP 2761 H=2761:00 +CPU= 24.643
  07:49:34 STEP 2762 H=2762:00 +CPU= 23.542
  07:50:12 STEP 2763 H=2763:00 +CPU= 36.943
  07:50:37 STEP 2764 H=2764:00 +CPU= 24.590
  07:51:01 STEP 2765 H=2765:00 +CPU= 23.836
  07:51:43 STEP 2766 H=2766:00 +CPU= 40.099
  07:52:08 STEP 2767 H=2767:00 +CPU= 24.824
  07:52:33 STEP 2768 H=2768:00 +CPU= 24.224
  07:53:12 STEP 2769 H=2769:00 +CPU= 37.897
  07:53:36 STEP 2770 H=2770:00 +CPU= 23.888
  07:54:00 STEP 2771 H=2771:00 +CPU= 23.509
  07:54:43 STEP 2772 H=2772:00 +CPU= 41.010
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002772
  07:55:07 STEP 2773 H=2773:00 +CPU= 23.646
  07:55:31 STEP 2774 H=2774:00 +CPU= 24.001
  07:56:09 STEP 2775 H=2775:00 +CPU= 37.235
  07:56:36 STEP 2776 H=2776:00 +CPU= 25.979
  07:57:00 STEP 2777 H=2777:00 +CPU= 24.054
  07:57:40 STEP 2778 H=2778:00 +CPU= 39.476
  07:58:05 STEP 2779 H=2779:00 +CPU= 24.157
  07:58:30 STEP 2780 H=2780:00 +CPU= 24.089
  07:59:07 STEP 2781 H=2781:00 +CPU= 36.894
  07:59:33 STEP 2782 H=2782:00 +CPU= 24.707
  07:59:58 STEP 2783 H=2783:00 +CPU= 24.637
  08:00:43 STEP 2784 H=2784:00 +CPU= 43.660
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_115.zip
Uploading the intermediate file: upload_file_115.zip
  08:01:08 STEP 2785 H=2785:00 +CPU= 23.440
  08:01:33 STEP 2786 H=2786:00 +CPU= 24.320
  08:02:13 STEP 2787 H=2787:00 +CPU= 37.987
  08:02:37 STEP 2788 H=2788:00 +CPU= 24.188
  08:03:01 STEP 2789 H=2789:00 +CPU= 22.827
  08:03:40 STEP 2790 H=2790:00 +CPU= 37.971
  08:04:05 STEP 2791 H=2791:00 +CPU= 24.693
  08:04:31 STEP 2792 H=2792:00 +CPU= 25.435
  08:05:10 STEP 2793 H=2793:00 +CPU= 37.587
  08:05:36 STEP 2794 H=2794:00 +CPU= 24.849
  08:06:00 STEP 2795 H=2795:00 +CPU= 23.486
  08:06:44 STEP 2796 H=2796:00 +CPU= 43.277
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002796
  08:07:08 STEP 2797 H=2797:00 +CPU= 23.315
  08:07:32 STEP 2798 H=2798:00 +CPU= 23.858
  08:08:11 STEP 2799 H=2799:00 +CPU= 37.763
  08:08:35 STEP 2800 H=2800:00 +CPU= 23.697
  08:08:58 STEP 2801 H=2801:00 +CPU= 23.005
  08:09:37 STEP 2802 H=2802:00 +CPU= 38.301
  08:10:00 STEP 2803 H=2803:00 +CPU= 22.877
  08:10:24 STEP 2804 H=2804:00 +CPU= 23.503
  08:11:03 STEP 2805 H=2805:00 +CPU= 38.649
  08:11:28 STEP 2806 H=2806:00 +CPU= 24.000
  08:11:52 STEP 2807 H=2807:00 +CPU= 23.363
  08:12:38 STEP 2808 H=2808:00 +CPU= 44.297
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_116.zip
Uploading the intermediate file: upload_file_116.zip
  08:13:02 STEP 2809 H=2809:00 +CPU= 23.379
  08:13:26 STEP 2810 H=2810:00 +CPU= 22.824
  08:14:05 STEP 2811 H=2811:00 +CPU= 38.670
  08:14:30 STEP 2812 H=2812:00 +CPU= 24.459
  08:14:54 STEP 2813 H=2813:00 +CPU= 22.774
  08:15:34 STEP 2814 H=2814:00 +CPU= 39.751
  08:15:59 STEP 2815 H=2815:00 +CPU= 24.353
  08:16:25 STEP 2816 H=2816:00 +CPU= 25.405
  08:17:05 STEP 2817 H=2817:00 +CPU= 39.373
  08:17:29 STEP 2818 H=2818:00 +CPU= 23.866
  08:17:53 STEP 2819 H=2819:00 +CPU= 23.024
  08:18:34 STEP 2820 H=2820:00 +CPU= 40.526
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002820
  08:18:56 STEP 2821 H=2821:00 +CPU= 22.090
  08:19:20 STEP 2822 H=2822:00 +CPU= 23.513
  08:19:58 STEP 2823 H=2823:00 +CPU= 37.374
  08:20:22 STEP 2824 H=2824:00 +CPU= 23.327
  08:20:45 STEP 2825 H=2825:00 +CPU= 22.415
  08:21:23 STEP 2826 H=2826:00 +CPU= 37.497
  08:21:45 STEP 2827 H=2827:00 +CPU= 21.870
  08:22:08 STEP 2828 H=2828:00 +CPU= 22.843
  08:22:46 STEP 2829 H=2829:00 +CPU= 37.748
  08:23:11 STEP 2830 H=2830:00 +CPU= 24.007
  08:23:33 STEP 2831 H=2831:00 +CPU= 21.374
  08:24:19 STEP 2832 H=2832:00 +CPU= 43.365
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_117.zip
Uploading the intermediate file: upload_file_117.zip
  08:24:42 STEP 2833 H=2833:00 +CPU= 22.062
  08:25:07 STEP 2834 H=2834:00 +CPU= 24.027
  08:25:44 STEP 2835 H=2835:00 +CPU= 36.939
  08:26:09 STEP 2836 H=2836:00 +CPU= 24.630
  08:26:34 STEP 2837 H=2837:00 +CPU= 23.885
  08:27:13 STEP 2838 H=2838:00 +CPU= 38.194
  08:27:36 STEP 2839 H=2839:00 +CPU= 23.305
  08:28:01 STEP 2840 H=2840:00 +CPU= 23.856
  08:28:39 STEP 2841 H=2841:00 +CPU= 37.437
  08:29:04 STEP 2842 H=2842:00 +CPU= 23.834
  08:29:28 STEP 2843 H=2843:00 +CPU= 23.551
  08:30:07 STEP 2844 H=2844:00 +CPU= 39.035
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002844
  08:30:30 STEP 2845 H=2845:00 +CPU= 22.418
  08:30:54 STEP 2846 H=2846:00 +CPU= 23.327
  08:31:29 STEP 2847 H=2847:00 +CPU= 34.858
  08:31:52 STEP 2848 H=2848:00 +CPU= 23.023
  08:32:14 STEP 2849 H=2849:00 +CPU= 21.869
  08:32:50 STEP 2850 H=2850:00 +CPU= 34.870
  08:33:12 STEP 2851 H=2851:00 +CPU= 22.453
  08:33:35 STEP 2852 H=2852:00 +CPU= 22.296
  08:34:10 STEP 2853 H=2853:00 +CPU= 34.108
  08:34:34 STEP 2854 H=2854:00 +CPU= 23.546
  08:34:57 STEP 2855 H=2855:00 +CPU= 22.730
  08:35:42 STEP 2856 H=2856:00 +CPU= 42.337
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_118.zip
Uploading the intermediate file: upload_file_118.zip
  08:36:09 STEP 2857 H=2857:00 +CPU= 25.546
  08:36:35 STEP 2858 H=2858:00 +CPU= 25.022
  08:37:11 STEP 2859 H=2859:00 +CPU= 35.405
  08:37:36 STEP 2860 H=2860:00 +CPU= 24.182
  08:38:01 STEP 2861 H=2861:00 +CPU= 24.183
  08:38:39 STEP 2862 H=2862:00 +CPU= 37.721
  08:39:03 STEP 2863 H=2863:00 +CPU= 23.169
  08:39:26 STEP 2864 H=2864:00 +CPU= 22.552
  08:40:02 STEP 2865 H=2865:00 +CPU= 35.242
  08:40:25 STEP 2866 H=2866:00 +CPU= 23.084
  08:40:49 STEP 2867 H=2867:00 +CPU= 22.808
  08:41:27 STEP 2868 H=2868:00 +CPU= 37.299
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002868
  08:41:50 STEP 2869 H=2869:00 +CPU= 22.747
  08:42:14 STEP 2870 H=2870:00 +CPU= 24.137
  08:42:49 STEP 2871 H=2871:00 +CPU= 34.829
  08:43:11 STEP 2872 H=2872:00 +CPU= 21.511
  08:43:33 STEP 2873 H=2873:00 +CPU= 21.304
  08:44:08 STEP 2874 H=2874:00 +CPU= 33.978
  08:44:29 STEP 2875 H=2875:00 +CPU= 20.611
  08:44:54 STEP 2876 H=2876:00 +CPU= 24.964
  08:45:33 STEP 2877 H=2877:00 +CPU= 38.263
  08:46:00 STEP 2878 H=2878:00 +CPU= 25.739
  08:46:28 STEP 2879 H=2879:00 +CPU= 26.675
  08:47:11 STEP 2880 H=2880:00 +CPU= 41.003
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_119.zip
Uploading the intermediate file: upload_file_119.zip
  08:47:34 STEP 2881 H=2881:00 +CPU= 22.091
  08:47:59 STEP 2882 H=2882:00 +CPU= 24.338
  08:48:35 STEP 2883 H=2883:00 +CPU= 35.267
  08:48:59 STEP 2884 H=2884:00 +CPU= 23.709
  08:49:23 STEP 2885 H=2885:00 +CPU= 23.043
  08:49:59 STEP 2886 H=2886:00 +CPU= 35.360
  08:50:22 STEP 2887 H=2887:00 +CPU= 22.111
  08:50:47 STEP 2888 H=2888:00 +CPU= 23.733
  08:51:22 STEP 2889 H=2889:00 +CPU= 34.428
  08:51:46 STEP 2890 H=2890:00 +CPU= 23.118
  08:52:11 STEP 2891 H=2891:00 +CPU= 24.540
  08:52:52 STEP 2892 H=2892:00 +CPU= 39.761
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002892
  08:53:14 STEP 2893 H=2893:00 +CPU= 21.916
  08:53:37 STEP 2894 H=2894:00 +CPU= 22.937
  08:54:11 STEP 2895 H=2895:00 +CPU= 33.237
  08:54:34 STEP 2896 H=2896:00 +CPU= 22.491
  08:54:56 STEP 2897 H=2897:00 +CPU= 21.780
  08:55:31 STEP 2898 H=2898:00 +CPU= 34.537
  08:55:54 STEP 2899 H=2899:00 +CPU= 22.516
  08:56:17 STEP 2900 H=2900:00 +CPU= 22.703
  08:56:52 STEP 2901 H=2901:00 +CPU= 33.819
  08:57:16 STEP 2902 H=2902:00 +CPU= 23.354
  08:57:40 STEP 2903 H=2903:00 +CPU= 23.678
  08:58:21 STEP 2904 H=2904:00 +CPU= 39.430
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_120.zip
Uploading the intermediate file: upload_file_120.zip
  08:58:44 STEP 2905 H=2905:00 +CPU= 21.873
  08:59:08 STEP 2906 H=2906:00 +CPU= 23.417
  08:59:43 STEP 2907 H=2907:00 +CPU= 34.650
  09:00:07 STEP 2908 H=2908:00 +CPU= 23.093
  09:00:31 STEP 2909 H=2909:00 +CPU= 23.556
  09:01:07 STEP 2910 H=2910:00 +CPU= 35.326
  09:01:31 STEP 2911 H=2911:00 +CPU= 23.133
  09:01:57 STEP 2912 H=2912:00 +CPU= 25.811
  09:02:34 STEP 2913 H=2913:00 +CPU= 35.387
  09:02:58 STEP 2914 H=2914:00 +CPU= 23.416
  09:03:21 STEP 2915 H=2915:00 +CPU= 23.036
  09:03:59 STEP 2916 H=2916:00 +CPU= 37.662
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002916
  09:04:22 STEP 2917 H=2917:00 +CPU= 22.362
  09:04:45 STEP 2918 H=2918:00 +CPU= 23.100
  09:05:20 STEP 2919 H=2919:00 +CPU= 33.819
  09:05:43 STEP 2920 H=2920:00 +CPU= 22.689
  09:06:05 STEP 2921 H=2921:00 +CPU= 22.274
  09:06:41 STEP 2922 H=2922:00 +CPU= 35.195
  09:07:03 STEP 2923 H=2923:00 +CPU= 21.975
  09:07:26 STEP 2924 H=2924:00 +CPU= 22.342
  09:08:02 STEP 2925 H=2925:00 +CPU= 34.871
  09:08:25 STEP 2926 H=2926:00 +CPU= 22.954
  09:08:50 STEP 2927 H=2927:00 +CPU= 24.138
  09:09:32 STEP 2928 H=2928:00 +CPU= 40.179
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_121.zip
Uploading the intermediate file: upload_file_121.zip
  09:09:55 STEP 2929 H=2929:00 +CPU= 22.470
Uploading trickle at timestep: 10540800
  09:10:20 STEP 2930 H=2930:00 +CPU= 23.634
  09:10:56 STEP 2931 H=2931:00 +CPU= 35.077
  09:11:19 STEP 2932 H=2932:00 +CPU= 23.279
  09:11:44 STEP 2933 H=2933:00 +CPU= 24.361
  09:12:21 STEP 2934 H=2934:00 +CPU= 36.448
  09:12:45 STEP 2935 H=2935:00 +CPU= 22.880
  09:13:09 STEP 2936 H=2936:00 +CPU= 24.155
  09:13:46 STEP 2937 H=2937:00 +CPU= 35.552
  09:14:09 STEP 2938 H=2938:00 +CPU= 22.592
  09:14:33 STEP 2939 H=2939:00 +CPU= 23.580
  09:15:11 STEP 2940 H=2940:00 +CPU= 37.885
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002940
  09:15:35 STEP 2941 H=2941:00 +CPU= 22.909
  09:15:58 STEP 2942 H=2942:00 +CPU= 23.305
  09:16:33 STEP 2943 H=2943:00 +CPU= 34.062
  09:16:56 STEP 2944 H=2944:00 +CPU= 22.962
  09:17:20 STEP 2945 H=2945:00 +CPU= 22.450
  09:17:56 STEP 2946 H=2946:00 +CPU= 35.616
  09:18:19 STEP 2947 H=2947:00 +CPU= 22.529
  09:18:42 STEP 2948 H=2948:00 +CPU= 23.255
  09:19:19 STEP 2949 H=2949:00 +CPU= 35.463
  09:19:43 STEP 2950 H=2950:00 +CPU= 23.249
  09:20:06 STEP 2951 H=2951:00 +CPU= 23.172
  09:20:42 STEP 2952 H=2952:00 +CPU= 35.755
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185952/ICMSHhq0f+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0308_2000050100_123_969_12185952_0_r572270277_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
09:24:06 (2408): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:26:32 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 10,623,600 77,910 0.0073
09 May 2023 16:26:32 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 10,540,800 77,258 0.0073
09 May 2023 16:26:17 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 9,504,000 68,913 0.0073
09 May 2023 16:25:21 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 8,640,000 63,603 0.0074
09 May 2023 16:25:10 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 7,776,000 55,343 0.0071
09 May 2023 16:24:59 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 6,912,000 48,135 0.0070
09 May 2023 16:24:48 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 6,048,000 41,260 0.0068
09 May 2023 16:24:38 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 5,184,000 34,184 0.0066
09 May 2023 16:24:29 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 4,320,000 27,161 0.0063
09 May 2023 16:24:19 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 3,456,000 20,446 0.0059
09 May 2023 16:24:11 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 2,592,000 13,859 0.0053
09 May 2023 16:24:06 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 1,728,000 9,245 0.0054
09 May 2023 16:24:01 1536928 22271301 oifs_43r3_ps_0308_2000050100_123_969_12185952_0 864,000 4,635 0.0054


©2024 cpdn.org