climateprediction.net home page
Task 22266243

Task 22266243

Name oifs_43r3_ps_0576_1995050100_123_964_12181220_0
Workunit 12181220
Created 22 Dec 2022, 8:43:13 UTC
Sent 19 Jan 2023, 2:16:40 UTC
Report deadline 20 Mar 2023, 2:16:40 UTC
Received 19 Jan 2023, 19:55:02 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537718
Run time 15 hours 48 min 43 sec
CPU time 15 hours 38 min 33 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.64 MB
Peak swap size 4,978.08 MB
Peak disk usage 6,879.68 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_100.zip
Uploading the intermediate file: upload_file_100.zip
  05:08:43 STEP 2425 H=2425:00 +CPU= 14.787
  05:08:59 STEP 2426 H=2426:00 +CPU= 15.280
  05:09:22 STEP 2427 H=2427:00 +CPU= 23.497
  05:09:38 STEP 2428 H=2428:00 +CPU= 15.287
  05:09:53 STEP 2429 H=2429:00 +CPU= 15.177
  05:10:17 STEP 2430 H=2430:00 +CPU= 24.423
  05:10:32 STEP 2431 H=2431:00 +CPU= 14.943
  05:10:48 STEP 2432 H=2432:00 +CPU= 15.492
  05:11:11 STEP 2433 H=2433:00 +CPU= 23.463
  05:11:27 STEP 2434 H=2434:00 +CPU= 15.392
  05:11:42 STEP 2435 H=2435:00 +CPU= 15.135
  05:12:09 STEP 2436 H=2436:00 +CPU= 26.609
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002436
  05:12:24 STEP 2437 H=2437:00 +CPU= 15.616
  05:12:40 STEP 2438 H=2438:00 +CPU= 15.819
  05:13:05 STEP 2439 H=2439:00 +CPU= 24.624
  05:13:21 STEP 2440 H=2440:00 +CPU= 15.499
  05:13:35 STEP 2441 H=2441:00 +CPU= 14.791
  05:13:59 STEP 2442 H=2442:00 +CPU= 24.003
  05:14:15 STEP 2443 H=2443:00 +CPU= 15.389
  05:14:30 STEP 2444 H=2444:00 +CPU= 15.380
  05:14:54 STEP 2445 H=2445:00 +CPU= 23.518
  05:15:09 STEP 2446 H=2446:00 +CPU= 15.305
  05:15:25 STEP 2447 H=2447:00 +CPU= 15.358
  05:15:53 STEP 2448 H=2448:00 +CPU= 28.233
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_101.zip
Uploading the intermediate file: upload_file_101.zip
  05:16:08 STEP 2449 H=2449:00 +CPU= 14.839
  05:16:23 STEP 2450 H=2450:00 +CPU= 15.104
  05:16:47 STEP 2451 H=2451:00 +CPU= 23.466
  05:17:02 STEP 2452 H=2452:00 +CPU= 15.278
  05:17:17 STEP 2453 H=2453:00 +CPU= 14.640
  05:17:41 STEP 2454 H=2454:00 +CPU= 24.211
  05:17:56 STEP 2455 H=2455:00 +CPU= 15.032
  05:18:11 STEP 2456 H=2456:00 +CPU= 15.264
  05:18:35 STEP 2457 H=2457:00 +CPU= 23.339
  05:18:50 STEP 2458 H=2458:00 +CPU= 15.093
  05:19:05 STEP 2459 H=2459:00 +CPU= 15.061
  05:19:32 STEP 2460 H=2460:00 +CPU= 26.871
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002460
  05:19:48 STEP 2461 H=2461:00 +CPU= 15.762
  05:20:03 STEP 2462 H=2462:00 +CPU= 15.619
  05:20:28 STEP 2463 H=2463:00 +CPU= 24.281
  05:20:43 STEP 2464 H=2464:00 +CPU= 15.747
  05:20:58 STEP 2465 H=2465:00 +CPU= 14.862
  05:21:22 STEP 2466 H=2466:00 +CPU= 23.688
  05:21:37 STEP 2467 H=2467:00 +CPU= 14.922
  05:21:52 STEP 2468 H=2468:00 +CPU= 15.201
  05:22:16 STEP 2469 H=2469:00 +CPU= 23.956
  05:22:32 STEP 2470 H=2470:00 +CPU= 15.282
  05:22:47 STEP 2471 H=2471:00 +CPU= 15.660
  05:23:15 STEP 2472 H=2472:00 +CPU= 28.002
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_102.zip
Uploading the intermediate file: upload_file_102.zip
  05:23:30 STEP 2473 H=2473:00 +CPU= 14.844
  05:23:46 STEP 2474 H=2474:00 +CPU= 15.332
  05:24:09 STEP 2475 H=2475:00 +CPU= 23.486
  05:24:25 STEP 2476 H=2476:00 +CPU= 15.467
  05:24:40 STEP 2477 H=2477:00 +CPU= 14.966
  05:25:04 STEP 2478 H=2478:00 +CPU= 24.200
  05:25:19 STEP 2479 H=2479:00 +CPU= 14.896
  05:25:34 STEP 2480 H=2480:00 +CPU= 15.277
  05:25:58 STEP 2481 H=2481:00 +CPU= 23.615
  05:26:13 STEP 2482 H=2482:00 +CPU= 15.202
  05:26:28 STEP 2483 H=2483:00 +CPU= 14.879
  05:26:54 STEP 2484 H=2484:00 +CPU= 26.148
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002484
  05:27:09 STEP 2485 H=2485:00 +CPU= 14.866
  05:27:24 STEP 2486 H=2486:00 +CPU= 15.225
  05:27:48 STEP 2487 H=2487:00 +CPU= 23.448
  05:28:03 STEP 2488 H=2488:00 +CPU= 15.103
  05:28:18 STEP 2489 H=2489:00 +CPU= 15.250
  05:28:43 STEP 2490 H=2490:00 +CPU= 24.421
  05:28:58 STEP 2491 H=2491:00 +CPU= 15.224
  05:29:14 STEP 2492 H=2492:00 +CPU= 15.655
  05:29:37 STEP 2493 H=2493:00 +CPU= 23.146
  05:29:52 STEP 2494 H=2494:00 +CPU= 15.163
  05:30:08 STEP 2495 H=2495:00 +CPU= 15.264
  05:30:35 STEP 2496 H=2496:00 +CPU= 27.649
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_103.zip
Uploading the intermediate file: upload_file_103.zip
  05:30:51 STEP 2497 H=2497:00 +CPU= 15.107
  05:31:06 STEP 2498 H=2498:00 +CPU= 15.011
  05:31:29 STEP 2499 H=2499:00 +CPU= 23.260
  05:31:44 STEP 2500 H=2500:00 +CPU= 15.409
  05:31:59 STEP 2501 H=2501:00 +CPU= 14.972
  05:32:23 STEP 2502 H=2502:00 +CPU= 23.954
  05:32:38 STEP 2503 H=2503:00 +CPU= 15.035
  05:32:53 STEP 2504 H=2504:00 +CPU= 15.018
  05:33:16 STEP 2505 H=2505:00 +CPU= 22.823
  05:33:32 STEP 2506 H=2506:00 +CPU= 15.410
  05:33:47 STEP 2507 H=2507:00 +CPU= 14.977
  05:34:13 STEP 2508 H=2508:00 +CPU= 26.464
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002508
  05:34:28 STEP 2509 H=2509:00 +CPU= 14.839
  05:34:43 STEP 2510 H=2510:00 +CPU= 15.127
  05:35:07 STEP 2511 H=2511:00 +CPU= 23.586
  05:35:22 STEP 2512 H=2512:00 +CPU= 15.246
  05:35:37 STEP 2513 H=2513:00 +CPU= 14.770
  05:36:01 STEP 2514 H=2514:00 +CPU= 24.178
  05:36:16 STEP 2515 H=2515:00 +CPU= 14.740
  05:36:32 STEP 2516 H=2516:00 +CPU= 15.559
  05:36:55 STEP 2517 H=2517:00 +CPU= 23.186
  05:37:10 STEP 2518 H=2518:00 +CPU= 14.927
  05:37:25 STEP 2519 H=2519:00 +CPU= 15.127
  05:37:53 STEP 2520 H=2520:00 +CPU= 27.847
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_104.zip
Uploading the intermediate file: upload_file_104.zip
  05:38:08 STEP 2521 H=2521:00 +CPU= 15.090
  05:38:24 STEP 2522 H=2522:00 +CPU= 15.327
  05:38:47 STEP 2523 H=2523:00 +CPU= 23.477
  05:39:03 STEP 2524 H=2524:00 +CPU= 15.478
  05:39:18 STEP 2525 H=2525:00 +CPU= 14.975
  05:39:42 STEP 2526 H=2526:00 +CPU= 23.880
  05:39:57 STEP 2527 H=2527:00 +CPU= 15.432
  05:40:12 STEP 2528 H=2528:00 +CPU= 15.378
  05:40:36 STEP 2529 H=2529:00 +CPU= 23.907
  05:40:52 STEP 2530 H=2530:00 +CPU= 15.183
  05:41:07 STEP 2531 H=2531:00 +CPU= 15.227
  05:41:33 STEP 2532 H=2532:00 +CPU= 26.101
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002532
  05:41:48 STEP 2533 H=2533:00 +CPU= 14.973
  05:42:04 STEP 2534 H=2534:00 +CPU= 15.571
  05:42:27 STEP 2535 H=2535:00 +CPU= 23.583
  05:42:43 STEP 2536 H=2536:00 +CPU= 15.436
  05:42:58 STEP 2537 H=2537:00 +CPU= 14.913
  05:43:21 STEP 2538 H=2538:00 +CPU= 23.682
  05:43:36 STEP 2539 H=2539:00 +CPU= 14.923
  05:43:52 STEP 2540 H=2540:00 +CPU= 15.490
  05:44:16 STEP 2541 H=2541:00 +CPU= 23.587
  05:44:31 STEP 2542 H=2542:00 +CPU= 15.676
  05:44:47 STEP 2543 H=2543:00 +CPU= 15.795
  05:45:16 STEP 2544 H=2544:00 +CPU= 28.713
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_105.zip
Uploading the intermediate file: upload_file_105.zip
  05:45:31 STEP 2545 H=2545:00 +CPU= 14.978
  05:45:46 STEP 2546 H=2546:00 +CPU= 15.065
  05:46:10 STEP 2547 H=2547:00 +CPU= 23.702
  05:46:25 STEP 2548 H=2548:00 +CPU= 15.455
  05:46:40 STEP 2549 H=2549:00 +CPU= 14.643
  05:47:04 STEP 2550 H=2550:00 +CPU= 23.693
  05:47:19 STEP 2551 H=2551:00 +CPU= 14.788
  05:47:34 STEP 2552 H=2552:00 +CPU= 15.241
  05:47:57 STEP 2553 H=2553:00 +CPU= 23.407
  05:48:13 STEP 2554 H=2554:00 +CPU= 15.228
  05:48:27 STEP 2555 H=2555:00 +CPU= 14.746
  05:48:54 STEP 2556 H=2556:00 +CPU= 26.516
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002556
  05:49:09 STEP 2557 H=2557:00 +CPU= 14.929
  05:49:24 STEP 2558 H=2558:00 +CPU= 15.314
  05:49:48 STEP 2559 H=2559:00 +CPU= 23.635
  05:50:03 STEP 2560 H=2560:00 +CPU= 15.397
  05:50:18 STEP 2561 H=2561:00 +CPU= 14.814
  05:50:42 STEP 2562 H=2562:00 +CPU= 24.160
  05:50:57 STEP 2563 H=2563:00 +CPU= 14.797
  05:51:12 STEP 2564 H=2564:00 +CPU= 14.985
  05:51:36 STEP 2565 H=2565:00 +CPU= 23.567
  05:51:51 STEP 2566 H=2566:00 +CPU= 15.217
  05:52:07 STEP 2567 H=2567:00 +CPU= 15.356
  05:52:35 STEP 2568 H=2568:00 +CPU= 28.013
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_106.zip
Uploading the intermediate file: upload_file_106.zip
  05:52:50 STEP 2569 H=2569:00 +CPU= 14.859
Uploading trickle at timestep: 9244800
  05:53:05 STEP 2570 H=2570:00 +CPU= 15.295
  05:53:28 STEP 2571 H=2571:00 +CPU= 23.199
  05:53:43 STEP 2572 H=2572:00 +CPU= 15.283
  05:53:58 STEP 2573 H=2573:00 +CPU= 14.889
  05:54:22 STEP 2574 H=2574:00 +CPU= 23.994
  05:54:37 STEP 2575 H=2575:00 +CPU= 14.928
  05:54:53 STEP 2576 H=2576:00 +CPU= 15.337
  05:55:16 STEP 2577 H=2577:00 +CPU= 23.363
  05:55:31 STEP 2578 H=2578:00 +CPU= 15.151
  05:55:46 STEP 2579 H=2579:00 +CPU= 14.929
  05:56:13 STEP 2580 H=2580:00 +CPU= 26.124
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002580
  05:56:27 STEP 2581 H=2581:00 +CPU= 14.761
  05:56:43 STEP 2582 H=2582:00 +CPU= 15.319
  05:57:06 STEP 2583 H=2583:00 +CPU= 23.756
  05:57:22 STEP 2584 H=2584:00 +CPU= 15.271
  05:57:37 STEP 2585 H=2585:00 +CPU= 14.802
  05:58:01 STEP 2586 H=2586:00 +CPU= 23.862
  05:58:15 STEP 2587 H=2587:00 +CPU= 14.891
  05:58:31 STEP 2588 H=2588:00 +CPU= 15.225
  05:58:54 STEP 2589 H=2589:00 +CPU= 23.248
  05:59:09 STEP 2590 H=2590:00 +CPU= 15.161
  05:59:24 STEP 2591 H=2591:00 +CPU= 15.206
  05:59:53 STEP 2592 H=2592:00 +CPU= 27.927
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_107.zip
Uploading the intermediate file: upload_file_107.zip
  06:00:07 STEP 2593 H=2593:00 +CPU= 14.891
  06:00:23 STEP 2594 H=2594:00 +CPU= 15.266
  06:00:47 STEP 2595 H=2595:00 +CPU= 23.930
  06:01:02 STEP 2596 H=2596:00 +CPU= 15.600
  06:01:18 STEP 2597 H=2597:00 +CPU= 15.388
  06:01:42 STEP 2598 H=2598:00 +CPU= 23.845
  06:01:57 STEP 2599 H=2599:00 +CPU= 15.093
  06:02:12 STEP 2600 H=2600:00 +CPU= 15.142
  06:02:36 STEP 2601 H=2601:00 +CPU= 23.598
  06:02:51 STEP 2602 H=2602:00 +CPU= 15.342
  06:03:06 STEP 2603 H=2603:00 +CPU= 14.944
  06:03:32 STEP 2604 H=2604:00 +CPU= 26.265
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002604
  06:03:47 STEP 2605 H=2605:00 +CPU= 14.825
  06:04:03 STEP 2606 H=2606:00 +CPU= 15.348
  06:04:26 STEP 2607 H=2607:00 +CPU= 23.212
  06:04:41 STEP 2608 H=2608:00 +CPU= 15.224
  06:04:56 STEP 2609 H=2609:00 +CPU= 14.722
  06:05:20 STEP 2610 H=2610:00 +CPU= 24.285
  06:05:35 STEP 2611 H=2611:00 +CPU= 14.886
  06:05:50 STEP 2612 H=2612:00 +CPU= 14.942
  06:06:13 STEP 2613 H=2613:00 +CPU= 23.298
  06:06:28 STEP 2614 H=2614:00 +CPU= 15.014
  06:06:44 STEP 2615 H=2615:00 +CPU= 15.026
  06:07:12 STEP 2616 H=2616:00 +CPU= 27.989
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_108.zip
Uploading the intermediate file: upload_file_108.zip
  06:07:27 STEP 2617 H=2617:00 +CPU= 14.934
  06:07:42 STEP 2618 H=2618:00 +CPU= 15.212
  06:08:05 STEP 2619 H=2619:00 +CPU= 23.211
  06:08:20 STEP 2620 H=2620:00 +CPU= 15.240
  06:08:35 STEP 2621 H=2621:00 +CPU= 14.898
  06:08:59 STEP 2622 H=2622:00 +CPU= 23.883
  06:09:14 STEP 2623 H=2623:00 +CPU= 14.877
  06:09:30 STEP 2624 H=2624:00 +CPU= 15.490
  06:09:53 STEP 2625 H=2625:00 +CPU= 23.446
  06:10:09 STEP 2626 H=2626:00 +CPU= 15.493
  06:10:24 STEP 2627 H=2627:00 +CPU= 15.032
  06:10:50 STEP 2628 H=2628:00 +CPU= 26.087
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002628
  06:11:05 STEP 2629 H=2629:00 +CPU= 14.991
  06:11:20 STEP 2630 H=2630:00 +CPU= 15.228
  06:11:44 STEP 2631 H=2631:00 +CPU= 23.616
  06:11:59 STEP 2632 H=2632:00 +CPU= 15.190
  06:12:14 STEP 2633 H=2633:00 +CPU= 14.977
  06:12:38 STEP 2634 H=2634:00 +CPU= 23.658
  06:12:53 STEP 2635 H=2635:00 +CPU= 14.850
  06:13:08 STEP 2636 H=2636:00 +CPU= 15.004
  06:13:31 STEP 2637 H=2637:00 +CPU= 23.483
  06:13:46 STEP 2638 H=2638:00 +CPU= 15.038
  06:14:02 STEP 2639 H=2639:00 +CPU= 15.178
  06:14:30 STEP 2640 H=2640:00 +CPU= 28.159
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_109.zip
Uploading the intermediate file: upload_file_109.zip
  06:14:45 STEP 2641 H=2641:00 +CPU= 14.915
  06:15:00 STEP 2642 H=2642:00 +CPU= 15.543
  06:15:24 STEP 2643 H=2643:00 +CPU= 23.773
  06:15:40 STEP 2644 H=2644:00 +CPU= 15.304
  06:15:54 STEP 2645 H=2645:00 +CPU= 14.732
  06:16:18 STEP 2646 H=2646:00 +CPU= 24.073
  06:16:34 STEP 2647 H=2647:00 +CPU= 15.189
  06:16:49 STEP 2648 H=2648:00 +CPU= 15.642
  06:17:13 STEP 2649 H=2649:00 +CPU= 23.994
  06:17:29 STEP 2650 H=2650:00 +CPU= 15.766
  06:17:44 STEP 2651 H=2651:00 +CPU= 15.028
  06:18:10 STEP 2652 H=2652:00 +CPU= 26.025
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002652
  06:18:25 STEP 2653 H=2653:00 +CPU= 14.724
  06:18:41 STEP 2654 H=2654:00 +CPU= 15.365
  06:19:04 STEP 2655 H=2655:00 +CPU= 23.717
  06:19:20 STEP 2656 H=2656:00 +CPU= 15.446
  06:19:35 STEP 2657 H=2657:00 +CPU= 14.924
  06:19:59 STEP 2658 H=2658:00 +CPU= 23.921
  06:20:14 STEP 2659 H=2659:00 +CPU= 14.922
  06:20:29 STEP 2660 H=2660:00 +CPU= 15.377
  06:20:53 STEP 2661 H=2661:00 +CPU= 23.349
  06:21:08 STEP 2662 H=2662:00 +CPU= 15.350
  06:21:23 STEP 2663 H=2663:00 +CPU= 15.082
  06:21:51 STEP 2664 H=2664:00 +CPU= 27.743
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_110.zip
Uploading the intermediate file: upload_file_110.zip
  06:22:06 STEP 2665 H=2665:00 +CPU= 15.252
  06:22:21 STEP 2666 H=2666:00 +CPU= 15.051
  06:22:45 STEP 2667 H=2667:00 +CPU= 23.655
  06:23:01 STEP 2668 H=2668:00 +CPU= 15.424
  06:23:16 STEP 2669 H=2669:00 +CPU= 15.060
  06:23:40 STEP 2670 H=2670:00 +CPU= 23.823
  06:23:54 STEP 2671 H=2671:00 +CPU= 14.784
  06:24:10 STEP 2672 H=2672:00 +CPU= 15.249
  06:24:33 STEP 2673 H=2673:00 +CPU= 23.274
  06:24:48 STEP 2674 H=2674:00 +CPU= 15.287
  06:25:03 STEP 2675 H=2675:00 +CPU= 15.090
  06:25:30 STEP 2676 H=2676:00 +CPU= 26.211
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002676
  06:25:44 STEP 2677 H=2677:00 +CPU= 14.432
  06:26:00 STEP 2678 H=2678:00 +CPU= 15.433
  06:26:23 STEP 2679 H=2679:00 +CPU= 23.393
  06:26:39 STEP 2680 H=2680:00 +CPU= 15.439
  06:26:53 STEP 2681 H=2681:00 +CPU= 14.864
  06:27:17 STEP 2682 H=2682:00 +CPU= 23.932
  06:27:32 STEP 2683 H=2683:00 +CPU= 14.789
  06:27:47 STEP 2684 H=2684:00 +CPU= 15.004
  06:28:10 STEP 2685 H=2685:00 +CPU= 23.096
  06:28:26 STEP 2686 H=2686:00 +CPU= 15.241
  06:28:41 STEP 2687 H=2687:00 +CPU= 15.299
  06:29:09 STEP 2688 H=2688:00 +CPU= 27.620
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_111.zip
Uploading the intermediate file: upload_file_111.zip
  06:29:23 STEP 2689 H=2689:00 +CPU= 14.633
  06:29:38 STEP 2690 H=2690:00 +CPU= 14.965
  06:30:02 STEP 2691 H=2691:00 +CPU= 23.332
  06:30:17 STEP 2692 H=2692:00 +CPU= 15.113
  06:30:32 STEP 2693 H=2693:00 +CPU= 14.842
  06:30:56 STEP 2694 H=2694:00 +CPU= 23.921
  06:31:11 STEP 2695 H=2695:00 +CPU= 14.892
  06:31:26 STEP 2696 H=2696:00 +CPU= 15.273
  06:31:49 STEP 2697 H=2697:00 +CPU= 23.327
  06:32:05 STEP 2698 H=2698:00 +CPU= 15.369
  06:32:20 STEP 2699 H=2699:00 +CPU= 15.044
  06:32:47 STEP 2700 H=2700:00 +CPU= 26.465
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002700
  06:33:02 STEP 2701 H=2701:00 +CPU= 15.594
  06:33:18 STEP 2702 H=2702:00 +CPU= 15.649
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0576
(argv4) batchid: 964
(argv5) wuid: 12181220
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_84af50c87c21450e76267790af997d08 to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0576_1995050100_123_964_12181220.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0576_1995050100_123_964_12181220.zip
ic_ancil_file: ic_ancil_12181220
ifsdata_file: ifsdata_12181220
climate_data_file: clim_data_12181220
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_61b609298965c3bd9cf4a4689217aed7 to: /var/lib/boinc-client/slots/3/ic_ancil_12181220.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12181220.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_9d9b8d27e0761aa6a4ae28bc5144a632 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12181220.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12181220.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12181220.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12181220.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12181220.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12181220.xml
-- Model is restarting --
Adjusting last_iter, 2702, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12181220.xml
last_cpu_time: 51461
upload_file_number: 112
last_iter: 2687
last_upload: 9676800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050
The child process has been launched with process id: 3027295
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:r2700:1:1:3027295:3027295] [20230120:063956:1674149996:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:40:25 STEP 2688 H=2688:00 +CPU= 26.736
  06:40:40 STEP 2689 H=2689:00 +CPU= 14.639
  06:40:55 STEP 2690 H=2690:00 +CPU= 14.886
  06:41:18 STEP 2691 H=2691:00 +CPU= 23.312
  06:41:33 STEP 2692 H=2692:00 +CPU= 14.987
  06:41:48 STEP 2693 H=2693:00 +CPU= 14.731
  06:42:12 STEP 2694 H=2694:00 +CPU= 23.760
  06:42:26 STEP 2695 H=2695:00 +CPU= 14.800
  06:42:42 STEP 2696 H=2696:00 +CPU= 15.275
  06:43:05 STEP 2697 H=2697:00 +CPU= 23.208
  06:43:20 STEP 2698 H=2698:00 +CPU= 15.249
  06:43:35 STEP 2699 H=2699:00 +CPU= 14.712
  06:44:01 STEP 2700 H=2700:00 +CPU= 25.742
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002700
  06:44:15 STEP 2701 H=2701:00 +CPU= 14.462
  06:44:31 STEP 2702 H=2702:00 +CPU= 15.291
  06:44:54 STEP 2703 H=2703:00 +CPU= 23.209
  06:45:09 STEP 2704 H=2704:00 +CPU= 15.265
  06:45:24 STEP 2705 H=2705:00 +CPU= 14.699
  06:45:48 STEP 2706 H=2706:00 +CPU= 23.754
  06:46:03 STEP 2707 H=2707:00 +CPU= 14.836
  06:46:18 STEP 2708 H=2708:00 +CPU= 15.084
  06:46:41 STEP 2709 H=2709:00 +CPU= 23.236
  06:46:56 STEP 2710 H=2710:00 +CPU= 14.939
  06:47:11 STEP 2711 H=2711:00 +CPU= 15.289
  06:47:39 STEP 2712 H=2712:00 +CPU= 27.526
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_112.zip
Uploading the intermediate file: upload_file_112.zip
  06:47:54 STEP 2713 H=2713:00 +CPU= 14.666
  06:48:09 STEP 2714 H=2714:00 +CPU= 15.023
  06:48:32 STEP 2715 H=2715:00 +CPU= 23.371
  06:48:48 STEP 2716 H=2716:00 +CPU= 15.640
  06:49:03 STEP 2717 H=2717:00 +CPU= 15.075
  06:49:27 STEP 2718 H=2718:00 +CPU= 24.256
  06:49:42 STEP 2719 H=2719:00 +CPU= 14.979
  06:49:58 STEP 2720 H=2720:00 +CPU= 15.197
  06:50:21 STEP 2721 H=2721:00 +CPU= 23.257
  06:50:36 STEP 2722 H=2722:00 +CPU= 15.187
  06:50:51 STEP 2723 H=2723:00 +CPU= 14.790
  06:51:17 STEP 2724 H=2724:00 +CPU= 25.950
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002724
  06:51:32 STEP 2725 H=2725:00 +CPU= 14.716
  06:51:47 STEP 2726 H=2726:00 +CPU= 15.334
  06:52:10 STEP 2727 H=2727:00 +CPU= 23.219
  06:52:26 STEP 2728 H=2728:00 +CPU= 15.313
  06:52:41 STEP 2729 H=2729:00 +CPU= 14.995
  06:53:05 STEP 2730 H=2730:00 +CPU= 23.688
  06:53:19 STEP 2731 H=2731:00 +CPU= 14.642
  06:53:34 STEP 2732 H=2732:00 +CPU= 15.170
  06:53:58 STEP 2733 H=2733:00 +CPU= 23.297
  06:54:13 STEP 2734 H=2734:00 +CPU= 15.073
  06:54:28 STEP 2735 H=2735:00 +CPU= 15.039
  06:54:56 STEP 2736 H=2736:00 +CPU= 27.568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_113.zip
Uploading the intermediate file: upload_file_113.zip
  06:55:11 STEP 2737 H=2737:00 +CPU= 15.004
  06:55:26 STEP 2738 H=2738:00 +CPU= 15.091
  06:55:49 STEP 2739 H=2739:00 +CPU= 23.511
  06:56:05 STEP 2740 H=2740:00 +CPU= 15.176
  06:56:19 STEP 2741 H=2741:00 +CPU= 14.749
  06:56:43 STEP 2742 H=2742:00 +CPU= 23.374
  06:56:58 STEP 2743 H=2743:00 +CPU= 14.904
  06:57:13 STEP 2744 H=2744:00 +CPU= 15.420
  06:57:37 STEP 2745 H=2745:00 +CPU= 23.415
  06:57:52 STEP 2746 H=2746:00 +CPU= 15.260
  06:58:07 STEP 2747 H=2747:00 +CPU= 14.873
  06:58:33 STEP 2748 H=2748:00 +CPU= 26.170
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002748
  06:58:48 STEP 2749 H=2749:00 +CPU= 14.740
  06:59:03 STEP 2750 H=2750:00 +CPU= 15.291
  06:59:27 STEP 2751 H=2751:00 +CPU= 23.444
  06:59:42 STEP 2752 H=2752:00 +CPU= 15.078
  06:59:57 STEP 2753 H=2753:00 +CPU= 14.777
  07:00:20 STEP 2754 H=2754:00 +CPU= 23.667
  07:00:35 STEP 2755 H=2755:00 +CPU= 14.962
  07:00:50 STEP 2756 H=2756:00 +CPU= 15.082
  07:01:14 STEP 2757 H=2757:00 +CPU= 23.248
  07:01:29 STEP 2758 H=2758:00 +CPU= 15.102
  07:01:44 STEP 2759 H=2759:00 +CPU= 15.150
  07:02:12 STEP 2760 H=2760:00 +CPU= 27.939
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_114.zip
Uploading the intermediate file: upload_file_114.zip
  07:02:27 STEP 2761 H=2761:00 +CPU= 14.742
  07:02:42 STEP 2762 H=2762:00 +CPU= 15.227
  07:03:06 STEP 2763 H=2763:00 +CPU= 23.603
  07:03:21 STEP 2764 H=2764:00 +CPU= 15.117
  07:03:36 STEP 2765 H=2765:00 +CPU= 14.577
  07:03:59 STEP 2766 H=2766:00 +CPU= 23.684
  07:04:14 STEP 2767 H=2767:00 +CPU= 14.739
  07:04:29 STEP 2768 H=2768:00 +CPU= 15.192
  07:04:53 STEP 2769 H=2769:00 +CPU= 23.772
  07:05:09 STEP 2770 H=2770:00 +CPU= 15.544
  07:05:24 STEP 2771 H=2771:00 +CPU= 15.192
  07:05:50 STEP 2772 H=2772:00 +CPU= 26.159
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002772
  07:06:05 STEP 2773 H=2773:00 +CPU= 14.867
  07:06:20 STEP 2774 H=2774:00 +CPU= 15.260
  07:06:44 STEP 2775 H=2775:00 +CPU= 23.468
  07:06:59 STEP 2776 H=2776:00 +CPU= 15.044
  07:07:14 STEP 2777 H=2777:00 +CPU= 14.731
  07:07:38 STEP 2778 H=2778:00 +CPU= 23.819
  07:07:53 STEP 2779 H=2779:00 +CPU= 14.826
  07:08:08 STEP 2780 H=2780:00 +CPU= 15.011
  07:08:31 STEP 2781 H=2781:00 +CPU= 23.409
  07:08:46 STEP 2782 H=2782:00 +CPU= 15.296
  07:09:02 STEP 2783 H=2783:00 +CPU= 15.281
  07:09:30 STEP 2784 H=2784:00 +CPU= 27.884
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_115.zip
Uploading the intermediate file: upload_file_115.zip
  07:09:45 STEP 2785 H=2785:00 +CPU= 14.844
  07:10:00 STEP 2786 H=2786:00 +CPU= 15.136
  07:10:23 STEP 2787 H=2787:00 +CPU= 23.246
  07:10:38 STEP 2788 H=2788:00 +CPU= 15.179
  07:10:53 STEP 2789 H=2789:00 +CPU= 14.870
  07:11:17 STEP 2790 H=2790:00 +CPU= 23.821
  07:11:32 STEP 2791 H=2791:00 +CPU= 14.716
  07:11:47 STEP 2792 H=2792:00 +CPU= 15.370
  07:12:11 STEP 2793 H=2793:00 +CPU= 23.216
  07:12:26 STEP 2794 H=2794:00 +CPU= 15.149
  07:12:41 STEP 2795 H=2795:00 +CPU= 14.867
  07:13:06 STEP 2796 H=2796:00 +CPU= 25.779
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002796
  07:13:21 STEP 2797 H=2797:00 +CPU= 14.816
  07:13:37 STEP 2798 H=2798:00 +CPU= 15.157
  07:14:00 STEP 2799 H=2799:00 +CPU= 23.432
  07:14:15 STEP 2800 H=2800:00 +CPU= 15.298
  07:14:30 STEP 2801 H=2801:00 +CPU= 14.994
  07:14:54 STEP 2802 H=2802:00 +CPU= 23.934
  07:15:09 STEP 2803 H=2803:00 +CPU= 14.760
  07:15:24 STEP 2804 H=2804:00 +CPU= 15.266
  07:15:48 STEP 2805 H=2805:00 +CPU= 23.627
  07:16:03 STEP 2806 H=2806:00 +CPU= 15.280
  07:16:19 STEP 2807 H=2807:00 +CPU= 15.461
  07:16:47 STEP 2808 H=2808:00 +CPU= 27.729
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_116.zip
Uploading the intermediate file: upload_file_116.zip
  07:17:02 STEP 2809 H=2809:00 +CPU= 14.889
  07:17:17 STEP 2810 H=2810:00 +CPU= 15.144
  07:17:40 STEP 2811 H=2811:00 +CPU= 23.424
  07:17:55 STEP 2812 H=2812:00 +CPU= 15.110
  07:18:10 STEP 2813 H=2813:00 +CPU= 14.792
  07:18:34 STEP 2814 H=2814:00 +CPU= 23.614
  07:18:49 STEP 2815 H=2815:00 +CPU= 14.817
  07:19:04 STEP 2816 H=2816:00 +CPU= 15.110
  07:19:27 STEP 2817 H=2817:00 +CPU= 23.283
  07:19:42 STEP 2818 H=2818:00 +CPU= 15.137
  07:19:57 STEP 2819 H=2819:00 +CPU= 14.677
  07:20:23 STEP 2820 H=2820:00 +CPU= 25.849
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002820
  07:20:38 STEP 2821 H=2821:00 +CPU= 14.802
  07:20:54 STEP 2822 H=2822:00 +CPU= 15.537
  07:21:17 STEP 2823 H=2823:00 +CPU= 23.710
  07:21:33 STEP 2824 H=2824:00 +CPU= 15.540
  07:21:48 STEP 2825 H=2825:00 +CPU= 14.930
  07:22:12 STEP 2826 H=2826:00 +CPU= 23.719
  07:22:26 STEP 2827 H=2827:00 +CPU= 14.707
  07:22:42 STEP 2828 H=2828:00 +CPU= 15.075
  07:23:06 STEP 2829 H=2829:00 +CPU= 23.854
  07:23:21 STEP 2830 H=2830:00 +CPU= 15.208
  07:23:36 STEP 2831 H=2831:00 +CPU= 15.294
  07:24:04 STEP 2832 H=2832:00 +CPU= 28.154
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_117.zip
Uploading the intermediate file: upload_file_117.zip
  07:24:19 STEP 2833 H=2833:00 +CPU= 14.903
  07:24:34 STEP 2834 H=2834:00 +CPU= 15.179
  07:24:58 STEP 2835 H=2835:00 +CPU= 23.432
  07:25:13 STEP 2836 H=2836:00 +CPU= 15.203
  07:25:28 STEP 2837 H=2837:00 +CPU= 15.073
  07:25:52 STEP 2838 H=2838:00 +CPU= 23.420
  07:26:07 STEP 2839 H=2839:00 +CPU= 15.100
  07:26:22 STEP 2840 H=2840:00 +CPU= 15.374
  07:26:46 STEP 2841 H=2841:00 +CPU= 23.663
  07:27:01 STEP 2842 H=2842:00 +CPU= 15.259
  07:27:16 STEP 2843 H=2843:00 +CPU= 15.052
  07:27:43 STEP 2844 H=2844:00 +CPU= 26.117
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002844
  07:27:57 STEP 2845 H=2845:00 +CPU= 14.685
  07:28:12 STEP 2846 H=2846:00 +CPU= 15.060
  07:28:36 STEP 2847 H=2847:00 +CPU= 23.177
  07:28:51 STEP 2848 H=2848:00 +CPU= 15.220
  07:29:06 STEP 2849 H=2849:00 +CPU= 14.844
  07:29:30 STEP 2850 H=2850:00 +CPU= 24.018
  07:29:45 STEP 2851 H=2851:00 +CPU= 14.816
  07:30:00 STEP 2852 H=2852:00 +CPU= 15.512
  07:30:24 STEP 2853 H=2853:00 +CPU= 23.389
  07:30:40 STEP 2854 H=2854:00 +CPU= 15.745
  07:30:55 STEP 2855 H=2855:00 +CPU= 15.266
  07:31:23 STEP 2856 H=2856:00 +CPU= 28.541
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_118.zip
Uploading the intermediate file: upload_file_118.zip
  07:31:40 STEP 2857 H=2857:00 +CPU= 16.309
  07:31:56 STEP 2858 H=2858:00 +CPU= 16.249
  07:32:21 STEP 2859 H=2859:00 +CPU= 24.696
  07:32:37 STEP 2860 H=2860:00 +CPU= 16.185
  07:32:53 STEP 2861 H=2861:00 +CPU= 15.174
  07:33:18 STEP 2862 H=2862:00 +CPU= 25.529
  07:33:34 STEP 2863 H=2863:00 +CPU= 15.268
  07:33:49 STEP 2864 H=2864:00 +CPU= 15.261
  07:34:15 STEP 2865 H=2865:00 +CPU= 25.280
  07:34:30 STEP 2866 H=2866:00 +CPU= 15.630
  07:34:46 STEP 2867 H=2867:00 +CPU= 15.241
  07:35:12 STEP 2868 H=2868:00 +CPU= 26.494
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002868
  07:35:27 STEP 2869 H=2869:00 +CPU= 15.195
  07:35:43 STEP 2870 H=2870:00 +CPU= 15.499
  07:36:07 STEP 2871 H=2871:00 +CPU= 23.697
  07:36:22 STEP 2872 H=2872:00 +CPU= 15.617
  07:36:37 STEP 2873 H=2873:00 +CPU= 15.033
  07:37:02 STEP 2874 H=2874:00 +CPU= 24.060
  07:37:17 STEP 2875 H=2875:00 +CPU= 15.180
  07:37:32 STEP 2876 H=2876:00 +CPU= 15.304
  07:37:56 STEP 2877 H=2877:00 +CPU= 23.520
  07:38:11 STEP 2878 H=2878:00 +CPU= 15.452
  07:38:27 STEP 2879 H=2879:00 +CPU= 15.518
  07:38:55 STEP 2880 H=2880:00 +CPU= 28.234
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_119.zip
Uploading the intermediate file: upload_file_119.zip
  07:39:10 STEP 2881 H=2881:00 +CPU= 15.033
  07:39:26 STEP 2882 H=2882:00 +CPU= 15.273
  07:39:49 STEP 2883 H=2883:00 +CPU= 23.790
  07:40:05 STEP 2884 H=2884:00 +CPU= 15.336
  07:40:20 STEP 2885 H=2885:00 +CPU= 15.293
  07:40:44 STEP 2886 H=2886:00 +CPU= 24.166
  07:41:00 STEP 2887 H=2887:00 +CPU= 15.393
  07:41:15 STEP 2888 H=2888:00 +CPU= 15.409
  07:41:39 STEP 2889 H=2889:00 +CPU= 23.756
  07:41:55 STEP 2890 H=2890:00 +CPU= 15.524
  07:42:10 STEP 2891 H=2891:00 +CPU= 15.043
  07:42:36 STEP 2892 H=2892:00 +CPU= 26.286
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002892
  07:42:51 STEP 2893 H=2893:00 +CPU= 15.224
  07:43:07 STEP 2894 H=2894:00 +CPU= 15.327
  07:43:30 STEP 2895 H=2895:00 +CPU= 23.717
  07:43:46 STEP 2896 H=2896:00 +CPU= 15.576
  07:44:01 STEP 2897 H=2897:00 +CPU= 14.921
  07:44:25 STEP 2898 H=2898:00 +CPU= 23.851
  07:44:40 STEP 2899 H=2899:00 +CPU= 15.029
  07:44:55 STEP 2900 H=2900:00 +CPU= 15.388
  07:45:19 STEP 2901 H=2901:00 +CPU= 23.532
  07:45:35 STEP 2902 H=2902:00 +CPU= 15.502
  07:45:50 STEP 2903 H=2903:00 +CPU= 15.620
  07:46:19 STEP 2904 H=2904:00 +CPU= 28.611
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_120.zip
Uploading the intermediate file: upload_file_120.zip
  07:46:34 STEP 2905 H=2905:00 +CPU= 14.884
  07:46:49 STEP 2906 H=2906:00 +CPU= 15.352
  07:47:13 STEP 2907 H=2907:00 +CPU= 23.781
  07:47:28 STEP 2908 H=2908:00 +CPU= 15.274
  07:47:44 STEP 2909 H=2909:00 +CPU= 15.012
  07:48:08 STEP 2910 H=2910:00 +CPU= 24.150
  07:48:23 STEP 2911 H=2911:00 +CPU= 15.281
  07:48:39 STEP 2912 H=2912:00 +CPU= 15.655
  07:49:03 STEP 2913 H=2913:00 +CPU= 23.705
  07:49:18 STEP 2914 H=2914:00 +CPU= 15.399
  07:49:33 STEP 2915 H=2915:00 +CPU= 15.109
  07:50:00 STEP 2916 H=2916:00 +CPU= 26.429
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002916
  07:50:15 STEP 2917 H=2917:00 +CPU= 15.005
  07:50:30 STEP 2918 H=2918:00 +CPU= 15.151
  07:50:54 STEP 2919 H=2919:00 +CPU= 23.571
  07:51:09 STEP 2920 H=2920:00 +CPU= 15.265
  07:51:24 STEP 2921 H=2921:00 +CPU= 15.007
  07:51:48 STEP 2922 H=2922:00 +CPU= 24.135
  07:52:03 STEP 2923 H=2923:00 +CPU= 14.662
  07:52:18 STEP 2924 H=2924:00 +CPU= 15.468
  07:52:42 STEP 2925 H=2925:00 +CPU= 23.509
  07:52:57 STEP 2926 H=2926:00 +CPU= 15.481
  07:53:13 STEP 2927 H=2927:00 +CPU= 15.282
  07:53:41 STEP 2928 H=2928:00 +CPU= 28.087
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_121.zip
Uploading the intermediate file: upload_file_121.zip
  07:53:56 STEP 2929 H=2929:00 +CPU= 15.135
Uploading trickle at timestep: 10540800
  07:54:11 STEP 2930 H=2930:00 +CPU= 15.283
  07:54:35 STEP 2931 H=2931:00 +CPU= 23.727
  07:54:51 STEP 2932 H=2932:00 +CPU= 15.458
  07:55:06 STEP 2933 H=2933:00 +CPU= 14.858
  07:55:30 STEP 2934 H=2934:00 +CPU= 24.032
  07:55:45 STEP 2935 H=2935:00 +CPU= 14.920
  07:56:00 STEP 2936 H=2936:00 +CPU= 15.498
  07:56:24 STEP 2937 H=2937:00 +CPU= 23.590
  07:56:39 STEP 2938 H=2938:00 +CPU= 15.557
  07:56:55 STEP 2939 H=2939:00 +CPU= 15.222
  07:57:21 STEP 2940 H=2940:00 +CPU= 26.492
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002940
  07:57:36 STEP 2941 H=2941:00 +CPU= 14.973
  07:57:52 STEP 2942 H=2942:00 +CPU= 15.570
  07:58:16 STEP 2943 H=2943:00 +CPU= 23.677
  07:58:31 STEP 2944 H=2944:00 +CPU= 15.666
  07:58:46 STEP 2945 H=2945:00 +CPU= 14.858
  07:59:10 STEP 2946 H=2946:00 +CPU= 23.910
  07:59:25 STEP 2947 H=2947:00 +CPU= 14.881
  07:59:41 STEP 2948 H=2948:00 +CPU= 15.435
  08:00:04 STEP 2949 H=2949:00 +CPU= 23.321
  08:00:19 STEP 2950 H=2950:00 +CPU= 15.277
  08:00:35 STEP 2951 H=2951:00 +CPU= 15.246
  08:01:02 STEP 2952 H=2952:00 +CPU= 27.296
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181220/ICMUAhq0f+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0576_1995050100_123_964_12181220_0_r1317603050_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
08:04:25 (3027292): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:29:13 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 10,623,600 56,313 0.0053
09 May 2023 16:29:07 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 10,540,800 55,880 0.0053
09 May 2023 16:28:55 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 9,244,800 49,030 0.0053
09 May 2023 16:28:44 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 7,948,800 42,393 0.0053
09 May 2023 16:28:33 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 6,652,800 35,619 0.0054
09 May 2023 16:28:25 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 5,788,800 31,144 0.0054
09 May 2023 16:28:18 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 4,924,800 26,482 0.0054
09 May 2023 16:28:11 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 4,060,800 21,874 0.0054
09 May 2023 16:28:00 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 2,764,800 14,894 0.0054
09 May 2023 16:27:48 1537718 22266243 oifs_43r3_ps_0576_1995050100_123_964_12181220_0 1,555,200 8,422 0.0054


©2024 climateprediction.net