climateprediction.net home page
Task 22254425

Task 22254425

Name oifs_43r3_ps_0470_1984050100_123_953_12170114_0
Workunit 12170114
Created 21 Dec 2022, 3:29:04 UTC
Sent 5 Jan 2023, 1:51:17 UTC
Report deadline 4 Feb 2023, 1:51:17 UTC
Received 11 Jan 2023, 18:56:01 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1510721
Run time 1 days 1 hours 53 min 56 sec
CPU time 20 hours 54 min 18 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.32 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,415.26 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,636.91 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
+CPU= 21.292
  00:12:47 STEP 2423 H=2423:00 +CPU= 21.442
  00:13:35 STEP 2424 H=2424:00 +CPU= 39.730
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_100.zip
Uploading the intermediate file: upload_file_100.zip
  00:14:00 STEP 2425 H=2425:00 +CPU= 21.124
  00:14:24 STEP 2426 H=2426:00 +CPU= 21.173
  00:15:07 STEP 2427 H=2427:00 +CPU= 33.707
  00:15:32 STEP 2428 H=2428:00 +CPU= 21.936
  00:15:58 STEP 2429 H=2429:00 +CPU= 21.075
  00:16:41 STEP 2430 H=2430:00 +CPU= 34.302
  00:17:05 STEP 2431 H=2431:00 +CPU= 20.669
  00:17:33 STEP 2432 H=2432:00 +CPU= 21.778
  00:18:15 STEP 2433 H=2433:00 +CPU= 32.763
  00:18:41 STEP 2434 H=2434:00 +CPU= 21.193
  00:19:06 STEP 2435 H=2435:00 +CPU= 20.460
  00:19:50 STEP 2436 H=2436:00 +CPU= 37.441
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002436
  00:20:16 STEP 2437 H=2437:00 +CPU= 20.947
  00:20:47 STEP 2438 H=2438:00 +CPU= 21.483
  00:21:23 STEP 2439 H=2439:00 +CPU= 32.938
  00:21:50 STEP 2440 H=2440:00 +CPU= 21.340
  00:22:19 STEP 2441 H=2441:00 +CPU= 21.182
  00:22:58 STEP 2442 H=2442:00 +CPU= 33.351
  00:23:27 STEP 2443 H=2443:00 +CPU= 20.570
  00:23:52 STEP 2444 H=2444:00 +CPU= 21.387
  00:24:36 STEP 2445 H=2445:00 +CPU= 33.119
  00:25:02 STEP 2446 H=2446:00 +CPU= 21.163
  00:25:26 STEP 2447 H=2447:00 +CPU= 21.582
  00:26:10 STEP 2448 H=2448:00 +CPU= 39.524
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_101.zip
Uploading the intermediate file: upload_file_101.zip
  00:26:37 STEP 2449 H=2449:00 +CPU= 21.361
  00:27:05 STEP 2450 H=2450:00 +CPU= 21.730
  00:27:45 STEP 2451 H=2451:00 +CPU= 33.444
  00:28:09 STEP 2452 H=2452:00 +CPU= 21.117
  00:28:34 STEP 2453 H=2453:00 +CPU= 20.842
  00:29:14 STEP 2454 H=2454:00 +CPU= 34.188
  00:29:38 STEP 2455 H=2455:00 +CPU= 20.737
  00:30:02 STEP 2456 H=2456:00 +CPU= 21.259
  00:30:45 STEP 2457 H=2457:00 +CPU= 33.139
  00:31:12 STEP 2458 H=2458:00 +CPU= 21.350
  00:31:38 STEP 2459 H=2459:00 +CPU= 20.702
  00:32:22 STEP 2460 H=2460:00 +CPU= 37.711
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002460
  00:32:45 STEP 2461 H=2461:00 +CPU= 20.758
  00:33:12 STEP 2462 H=2462:00 +CPU= 21.429
  00:33:55 STEP 2463 H=2463:00 +CPU= 33.385
  00:34:22 STEP 2464 H=2464:00 +CPU= 22.226
  00:34:47 STEP 2465 H=2465:00 +CPU= 20.968
  00:35:32 STEP 2466 H=2466:00 +CPU= 33.562
  00:35:59 STEP 2467 H=2467:00 +CPU= 20.614
  00:36:27 STEP 2468 H=2468:00 +CPU= 21.875
  00:37:05 STEP 2469 H=2469:00 +CPU= 33.137
  00:37:32 STEP 2470 H=2470:00 +CPU= 21.535
  00:37:57 STEP 2471 H=2471:00 +CPU= 21.415
  00:38:45 STEP 2472 H=2472:00 +CPU= 38.309
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_102.zip
Uploading the intermediate file: upload_file_102.zip
  00:39:12 STEP 2473 H=2473:00 +CPU= 20.335
  00:39:41 STEP 2474 H=2474:00 +CPU= 22.102
  00:40:24 STEP 2475 H=2475:00 +CPU= 33.833
  00:40:50 STEP 2476 H=2476:00 +CPU= 21.546
  00:41:18 STEP 2477 H=2477:00 +CPU= 20.760
  00:42:00 STEP 2478 H=2478:00 +CPU= 33.729
  00:42:27 STEP 2479 H=2479:00 +CPU= 20.545
  00:42:54 STEP 2480 H=2480:00 +CPU= 21.287
  00:43:36 STEP 2481 H=2481:00 +CPU= 33.306
  00:44:02 STEP 2482 H=2482:00 +CPU= 21.465
  00:44:26 STEP 2483 H=2483:00 +CPU= 21.396
  00:45:11 STEP 2484 H=2484:00 +CPU= 37.022
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002484
  00:45:36 STEP 2485 H=2485:00 +CPU= 21.292
  00:46:08 STEP 2486 H=2486:00 +CPU= 22.345
  00:46:53 STEP 2487 H=2487:00 +CPU= 33.424
  00:47:17 STEP 2488 H=2488:00 +CPU= 21.431
  00:47:45 STEP 2489 H=2489:00 +CPU= 20.568
  00:48:27 STEP 2490 H=2490:00 +CPU= 33.817
  00:48:55 STEP 2491 H=2491:00 +CPU= 21.031
  00:49:26 STEP 2492 H=2492:00 +CPU= 21.454
  00:50:04 STEP 2493 H=2493:00 +CPU= 33.157
  00:50:30 STEP 2494 H=2494:00 +CPU= 21.260
  00:50:56 STEP 2495 H=2495:00 +CPU= 21.472
  00:51:48 STEP 2496 H=2496:00 +CPU= 38.898
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_103.zip
Uploading the intermediate file: upload_file_103.zip
  00:52:13 STEP 2497 H=2497:00 +CPU= 20.253
  00:52:40 STEP 2498 H=2498:00 +CPU= 21.635
  00:53:22 STEP 2499 H=2499:00 +CPU= 32.531
  00:53:51 STEP 2500 H=2500:00 +CPU= 21.123
  00:54:15 STEP 2501 H=2501:00 +CPU= 20.684
  00:54:56 STEP 2502 H=2502:00 +CPU= 33.064
  00:55:22 STEP 2503 H=2503:00 +CPU= 20.901
  00:55:53 STEP 2504 H=2504:00 +CPU= 21.212
  00:56:36 STEP 2505 H=2505:00 +CPU= 33.346
  00:57:06 STEP 2506 H=2506:00 +CPU= 22.147
  00:57:29 STEP 2507 H=2507:00 +CPU= 20.689
  00:58:15 STEP 2508 H=2508:00 +CPU= 36.406
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002508
  00:58:41 STEP 2509 H=2509:00 +CPU= 20.000
  00:59:07 STEP 2510 H=2510:00 +CPU= 21.417
  00:59:45 STEP 2511 H=2511:00 +CPU= 32.328
  01:00:12 STEP 2512 H=2512:00 +CPU= 21.291
  01:00:38 STEP 2513 H=2513:00 +CPU= 20.194
  01:01:18 STEP 2514 H=2514:00 +CPU= 33.496
  01:01:45 STEP 2515 H=2515:00 +CPU= 20.898
  01:02:13 STEP 2516 H=2516:00 +CPU= 22.031
  01:02:54 STEP 2517 H=2517:00 +CPU= 33.543
  01:03:19 STEP 2518 H=2518:00 +CPU= 21.505
  01:03:48 STEP 2519 H=2519:00 +CPU= 21.248
  01:04:36 STEP 2520 H=2520:00 +CPU= 38.891
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_104.zip
Uploading the intermediate file: upload_file_104.zip
  01:05:01 STEP 2521 H=2521:00 +CPU= 21.016
  01:05:27 STEP 2522 H=2522:00 +CPU= 21.615
  01:06:07 STEP 2523 H=2523:00 +CPU= 33.129
  01:06:36 STEP 2524 H=2524:00 +CPU= 21.970
  01:07:02 STEP 2525 H=2525:00 +CPU= 21.312
  01:07:50 STEP 2526 H=2526:00 +CPU= 33.822
  01:08:17 STEP 2527 H=2527:00 +CPU= 21.567
  01:08:44 STEP 2528 H=2528:00 +CPU= 22.048
  01:09:25 STEP 2529 H=2529:00 +CPU= 32.783
  01:09:51 STEP 2530 H=2530:00 +CPU= 21.293
  01:10:14 STEP 2531 H=2531:00 +CPU= 20.434
  01:10:56 STEP 2532 H=2532:00 +CPU= 35.784
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002532
  01:11:24 STEP 2533 H=2533:00 +CPU= 20.704
  01:11:50 STEP 2534 H=2534:00 +CPU= 21.746
  01:12:35 STEP 2535 H=2535:00 +CPU= 33.242
  01:13:11 STEP 2536 H=2536:00 +CPU= 22.088
  01:13:39 STEP 2537 H=2537:00 +CPU= 21.308
  01:14:21 STEP 2538 H=2538:00 +CPU= 33.329
  01:14:43 STEP 2539 H=2539:00 +CPU= 20.122
  01:15:12 STEP 2540 H=2540:00 +CPU= 21.585
  01:15:48 STEP 2541 H=2541:00 +CPU= 32.134
  01:16:14 STEP 2542 H=2542:00 +CPU= 21.402
  01:16:43 STEP 2543 H=2543:00 +CPU= 21.611
  01:17:35 STEP 2544 H=2544:00 +CPU= 39.421
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_105.zip
Uploading the intermediate file: upload_file_105.zip
  01:18:04 STEP 2545 H=2545:00 +CPU= 21.600
  01:18:27 STEP 2546 H=2546:00 +CPU= 21.836
  01:19:08 STEP 2547 H=2547:00 +CPU= 33.014
  01:19:36 STEP 2548 H=2548:00 +CPU= 21.794
  01:20:04 STEP 2549 H=2549:00 +CPU= 20.783
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1984050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0470
(argv4) batchid: 953
(argv5) wuid: 12170114
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/12
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/12/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_057e69ad0cccd96f2bde0a2216b38dcd to: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0470_1984050100_123_953_12170114.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0470_1984050100_123_953_12170114.zip
ic_ancil_file: ic_ancil_12170114
ifsdata_file: ifsdata_12170114
climate_data_file: clim_data_12170114
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b524a11e82f8059caea7ce3fedafd34a to: /var/lib/boinc-client/slots/12/ic_ancil_12170114.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/12/ic_ancil_12170114.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_301483c291105b0b63acb8215b1509ec to: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12170114.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12170114.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/12/159l_2/clim_data_12170114.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/12/159l_2/clim_data_12170114.zip
Checking for progress XML file: /var/lib/boinc-client/slots/12/progress_file_12170114.xml
Opened progress file ok : /var/lib/boinc-client/slots/12/progress_file_12170114.xml
-- Model is restarting --
Adjusting last_iter, 2549, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/12/progress_file_12170114.xml
last_cpu_time: 64929
upload_file_number: 106
last_iter: 2543
last_upload: 9158400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012
The child process has been launched with process id: 2068014
Executing the command: /var/lib/boinc-client/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:bakemono:1:1:2068014:2068014] [20230106:024629:1672969589:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  02:47:16 STEP 2544 H=2544:00 +CPU= 36.369
  02:47:40 STEP 2545 H=2545:00 +CPU= 20.098
  02:48:04 STEP 2546 H=2546:00 +CPU= 21.144
  02:48:48 STEP 2547 H=2547:00 +CPU= 32.479
  02:49:15 STEP 2548 H=2548:00 +CPU= 21.719
  02:49:38 STEP 2549 H=2549:00 +CPU= 20.120
  02:50:15 STEP 2550 H=2550:00 +CPU= 33.825
  02:50:43 STEP 2551 H=2551:00 +CPU= 20.915
  02:51:08 STEP 2552 H=2552:00 +CPU= 21.078
  02:51:46 STEP 2553 H=2553:00 +CPU= 32.550
  02:52:09 STEP 2554 H=2554:00 +CPU= 21.173
  02:52:34 STEP 2555 H=2555:00 +CPU= 20.748
  02:53:20 STEP 2556 H=2556:00 +CPU= 36.751
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002556
  02:53:44 STEP 2557 H=2557:00 +CPU= 20.616
  02:54:09 STEP 2558 H=2558:00 +CPU= 21.409
  02:54:48 STEP 2559 H=2559:00 +CPU= 32.824
  02:55:13 STEP 2560 H=2560:00 +CPU= 21.451
  02:55:42 STEP 2561 H=2561:00 +CPU= 20.879
  02:56:27 STEP 2562 H=2562:00 +CPU= 33.961
  02:56:50 STEP 2563 H=2563:00 +CPU= 20.846
  02:57:12 STEP 2564 H=2564:00 +CPU= 20.741
  02:57:52 STEP 2565 H=2565:00 +CPU= 32.536
  02:58:18 STEP 2566 H=2566:00 +CPU= 21.430
  02:58:42 STEP 2567 H=2567:00 +CPU= 21.314
  02:59:31 STEP 2568 H=2568:00 +CPU= 37.997
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_106.zip
Uploading the intermediate file: upload_file_106.zip
  03:00:00 STEP 2569 H=2569:00 +CPU= 21.040
  03:00:27 STEP 2570 H=2570:00 +CPU= 21.379
  03:01:06 STEP 2571 H=2571:00 +CPU= 33.258
  03:01:32 STEP 2572 H=2572:00 +CPU= 21.546
  03:01:56 STEP 2573 H=2573:00 +CPU= 21.227
  03:02:36 STEP 2574 H=2574:00 +CPU= 33.919
  03:02:59 STEP 2575 H=2575:00 +CPU= 20.517
  03:03:25 STEP 2576 H=2576:00 +CPU= 21.468
  03:04:05 STEP 2577 H=2577:00 +CPU= 32.754
  03:04:32 STEP 2578 H=2578:00 +CPU= 21.423
  03:04:55 STEP 2579 H=2579:00 +CPU= 21.065
  03:05:42 STEP 2580 H=2580:00 +CPU= 36.721
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002580
  03:06:07 STEP 2581 H=2581:00 +CPU= 21.031
  03:06:37 STEP 2582 H=2582:00 +CPU= 21.567
  03:07:18 STEP 2583 H=2583:00 +CPU= 32.996
  03:07:49 STEP 2584 H=2584:00 +CPU= 21.767
  03:08:12 STEP 2585 H=2585:00 +CPU= 20.710
  03:08:55 STEP 2586 H=2586:00 +CPU= 33.471
  03:09:22 STEP 2587 H=2587:00 +CPU= 20.598
  03:09:47 STEP 2588 H=2588:00 +CPU= 21.343
  03:10:26 STEP 2589 H=2589:00 +CPU= 32.912
  03:10:50 STEP 2590 H=2590:00 +CPU= 21.132
  03:11:15 STEP 2591 H=2591:00 +CPU= 21.257
  03:12:04 STEP 2592 H=2592:00 +CPU= 38.823
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_107.zip
Uploading the intermediate file: upload_file_107.zip
  03:12:29 STEP 2593 H=2593:00 +CPU= 20.257
  03:12:52 STEP 2594 H=2594:00 +CPU= 21.213
  03:13:34 STEP 2595 H=2595:00 +CPU= 32.846
  03:13:59 STEP 2596 H=2596:00 +CPU= 21.206
  03:14:27 STEP 2597 H=2597:00 +CPU= 20.637
  03:15:10 STEP 2598 H=2598:00 +CPU= 33.028
  03:15:40 STEP 2599 H=2599:00 +CPU= 20.368
  03:16:03 STEP 2600 H=2600:00 +CPU= 21.191
  03:16:40 STEP 2601 H=2601:00 +CPU= 32.380
  03:17:06 STEP 2602 H=2602:00 +CPU= 20.972
  03:17:30 STEP 2603 H=2603:00 +CPU= 20.537
  03:18:19 STEP 2604 H=2604:00 +CPU= 36.590
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002604
  03:18:45 STEP 2605 H=2605:00 +CPU= 21.079
  03:19:14 STEP 2606 H=2606:00 +CPU= 21.636
  03:19:55 STEP 2607 H=2607:00 +CPU= 32.672
  03:20:21 STEP 2608 H=2608:00 +CPU= 21.224
  03:20:43 STEP 2609 H=2609:00 +CPU= 20.446
  03:21:20 STEP 2610 H=2610:00 +CPU= 32.921
  03:21:44 STEP 2611 H=2611:00 +CPU= 21.412
  03:22:08 STEP 2612 H=2612:00 +CPU= 22.104
  03:22:48 STEP 2613 H=2613:00 +CPU= 32.502
  03:23:16 STEP 2614 H=2614:00 +CPU= 21.060
  03:23:40 STEP 2615 H=2615:00 +CPU= 20.414
  03:24:27 STEP 2616 H=2616:00 +CPU= 38.976
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_108.zip
Uploading the intermediate file: upload_file_108.zip
  03:24:54 STEP 2617 H=2617:00 +CPU= 20.727
  03:25:19 STEP 2618 H=2618:00 +CPU= 21.228
  03:25:59 STEP 2619 H=2619:00 +CPU= 32.779
  03:26:30 STEP 2620 H=2620:00 +CPU= 21.558
  03:26:55 STEP 2621 H=2621:00 +CPU= 20.574
  03:27:37 STEP 2622 H=2622:00 +CPU= 33.200
  03:28:01 STEP 2623 H=2623:00 +CPU= 20.466
  03:28:30 STEP 2624 H=2624:00 +CPU= 21.414
  03:29:04 STEP 2625 H=2625:00 +CPU= 32.550
  03:29:27 STEP 2626 H=2626:00 +CPU= 21.348
  03:29:53 STEP 2627 H=2627:00 +CPU= 20.776
  03:30:37 STEP 2628 H=2628:00 +CPU= 36.563
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002628
  03:31:03 STEP 2629 H=2629:00 +CPU= 20.653
  03:31:27 STEP 2630 H=2630:00 +CPU= 21.259
  03:32:02 STEP 2631 H=2631:00 +CPU= 32.027
  03:32:28 STEP 2632 H=2632:00 +CPU= 21.436
  03:32:52 STEP 2633 H=2633:00 +CPU= 20.586
  03:33:35 STEP 2634 H=2634:00 +CPU= 33.594
  03:34:00 STEP 2635 H=2635:00 +CPU= 20.881
  03:34:34 STEP 2636 H=2636:00 +CPU= 22.270
  03:35:18 STEP 2637 H=2637:00 +CPU= 33.380
  03:35:46 STEP 2638 H=2638:00 +CPU= 21.400
  03:36:13 STEP 2639 H=2639:00 +CPU= 21.215
  03:37:00 STEP 2640 H=2640:00 +CPU= 38.820
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_109.zip
Uploading the intermediate file: upload_file_109.zip
  03:37:26 STEP 2641 H=2641:00 +CPU= 20.058
  03:37:52 STEP 2642 H=2642:00 +CPU= 21.229
  03:38:33 STEP 2643 H=2643:00 +CPU= 32.906
  03:38:59 STEP 2644 H=2644:00 +CPU= 21.290
  03:39:25 STEP 2645 H=2645:00 +CPU= 20.925
  03:40:06 STEP 2646 H=2646:00 +CPU= 34.060
  03:40:32 STEP 2647 H=2647:00 +CPU= 20.296
  03:40:58 STEP 2648 H=2648:00 +CPU= 21.744
  03:41:38 STEP 2649 H=2649:00 +CPU= 32.614
  03:42:05 STEP 2650 H=2650:00 +CPU= 21.085
  03:42:31 STEP 2651 H=2651:00 +CPU= 20.923
  03:43:19 STEP 2652 H=2652:00 +CPU= 37.048
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002652
  03:43:45 STEP 2653 H=2653:00 +CPU= 20.861
  03:44:09 STEP 2654 H=2654:00 +CPU= 21.088
  03:44:51 STEP 2655 H=2655:00 +CPU= 33.004
  03:45:23 STEP 2656 H=2656:00 +CPU= 21.406
  03:45:47 STEP 2657 H=2657:00 +CPU= 20.804
  03:46:29 STEP 2658 H=2658:00 +CPU= 33.754
  03:46:53 STEP 2659 H=2659:00 +CPU= 20.271
  03:47:21 STEP 2660 H=2660:00 +CPU= 20.918
  03:48:01 STEP 2661 H=2661:00 +CPU= 32.861
  03:48:29 STEP 2662 H=2662:00 +CPU= 21.543
  03:48:54 STEP 2663 H=2663:00 +CPU= 21.365
  03:49:39 STEP 2664 H=2664:00 +CPU= 38.830
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_110.zip
Uploading the intermediate file: upload_file_110.zip
  03:50:04 STEP 2665 H=2665:00 +CPU= 20.620
  03:50:27 STEP 2666 H=2666:00 +CPU= 20.356
  03:51:04 STEP 2667 H=2667:00 +CPU= 33.058
  03:51:28 STEP 2668 H=2668:00 +CPU= 21.190
  03:51:56 STEP 2669 H=2669:00 +CPU= 20.695
  03:52:32 STEP 2670 H=2670:00 +CPU= 33.460
  03:52:56 STEP 2671 H=2671:00 +CPU= 20.156
  03:53:18 STEP 2672 H=2672:00 +CPU= 20.459
  03:53:56 STEP 2673 H=2673:00 +CPU= 32.288
  03:54:22 STEP 2674 H=2674:00 +CPU= 21.068
  03:54:44 STEP 2675 H=2675:00 +CPU= 20.802
  03:55:26 STEP 2676 H=2676:00 +CPU= 36.495
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002676
  03:55:51 STEP 2677 H=2677:00 +CPU= 20.833
  03:56:16 STEP 2678 H=2678:00 +CPU= 21.335
  03:56:56 STEP 2679 H=2679:00 +CPU= 32.778
  03:57:22 STEP 2680 H=2680:00 +CPU= 21.429
  03:57:47 STEP 2681 H=2681:00 +CPU= 20.633
  03:58:29 STEP 2682 H=2682:00 +CPU= 33.079
  03:58:55 STEP 2683 H=2683:00 +CPU= 20.521
  03:59:19 STEP 2684 H=2684:00 +CPU= 20.656
  03:59:58 STEP 2685 H=2685:00 +CPU= 32.776
  04:00:28 STEP 2686 H=2686:00 +CPU= 22.062
  04:00:52 STEP 2687 H=2687:00 +CPU= 21.339
  04:01:36 STEP 2688 H=2688:00 +CPU= 38.731
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_111.zip
Uploading the intermediate file: upload_file_111.zip
  04:01:58 STEP 2689 H=2689:00 +CPU= 20.537
  04:02:24 STEP 2690 H=2690:00 +CPU= 20.988
  04:03:08 STEP 2691 H=2691:00 +CPU= 33.151
  04:03:33 STEP 2692 H=2692:00 +CPU= 21.447
  04:03:56 STEP 2693 H=2693:00 +CPU= 20.535
  04:04:38 STEP 2694 H=2694:00 +CPU= 33.510
  04:05:02 STEP 2695 H=2695:00 +CPU= 20.475
  04:05:25 STEP 2696 H=2696:00 +CPU= 20.726
  04:06:06 STEP 2697 H=2697:00 +CPU= 33.308
  04:06:33 STEP 2698 H=2698:00 +CPU= 21.752
  04:06:58 STEP 2699 H=2699:00 +CPU= 20.817
  04:07:41 STEP 2700 H=2700:00 +CPU= 36.833
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002700
  04:08:06 STEP 2701 H=2701:00 +CPU= 20.811
  04:08:30 STEP 2702 H=2702:00 +CPU= 21.622
  04:09:09 STEP 2703 H=2703:00 +CPU= 33.450
  04:09:33 STEP 2704 H=2704:00 +CPU= 21.251
  04:09:57 STEP 2705 H=2705:00 +CPU= 20.407
  04:10:35 STEP 2706 H=2706:00 +CPU= 33.681
  04:11:00 STEP 2707 H=2707:00 +CPU= 20.199
  04:11:25 STEP 2708 H=2708:00 +CPU= 21.711
  04:12:07 STEP 2709 H=2709:00 +CPU= 32.816
  04:12:30 STEP 2710 H=2710:00 +CPU= 20.764
  04:12:54 STEP 2711 H=2711:00 +CPU= 20.830
  04:13:42 STEP 2712 H=2712:00 +CPU= 38.460
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_112.zip
Uploading the intermediate file: upload_file_112.zip
  04:14:10 STEP 2713 H=2713:00 +CPU= 20.840
  04:14:33 STEP 2714 H=2714:00 +CPU= 21.055
  04:15:10 STEP 2715 H=2715:00 +CPU= 31.785
  04:15:37 STEP 2716 H=2716:00 +CPU= 21.436
  04:16:07 STEP 2717 H=2717:00 +CPU= 20.488
  04:16:49 STEP 2718 H=2718:00 +CPU= 33.949
  04:17:11 STEP 2719 H=2719:00 +CPU= 20.616
  04:17:36 STEP 2720 H=2720:00 +CPU= 21.206
  04:18:17 STEP 2721 H=2721:00 +CPU= 32.727
  04:18:45 STEP 2722 H=2722:00 +CPU= 21.279
  04:19:08 STEP 2723 H=2723:00 +CPU= 20.724
  04:19:53 STEP 2724 H=2724:00 +CPU= 35.854
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002724
  04:20:16 STEP 2725 H=2725:00 +CPU= 20.301
  04:20:45 STEP 2726 H=2726:00 +CPU= 21.052
  04:21:24 STEP 2727 H=2727:00 +CPU= 32.844
  04:21:50 STEP 2728 H=2728:00 +CPU= 21.631
  04:22:16 STEP 2729 H=2729:00 +CPU= 20.784
  04:22:52 STEP 2730 H=2730:00 +CPU= 32.847
  04:23:16 STEP 2731 H=2731:00 +CPU= 19.884
  04:23:38 STEP 2732 H=2732:00 +CPU= 20.745
  04:24:18 STEP 2733 H=2733:00 +CPU= 33.586
  04:24:44 STEP 2734 H=2734:00 +CPU= 21.800
  04:25:06 STEP 2735 H=2735:00 +CPU= 20.564
  04:25:51 STEP 2736 H=2736:00 +CPU= 38.427
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_113.zip
Uploading the intermediate file: upload_file_113.zip
  04:26:16 STEP 2737 H=2737:00 +CPU= 20.475
  04:26:39 STEP 2738 H=2738:00 +CPU= 20.917
  04:27:20 STEP 2739 H=2739:00 +CPU= 32.889
  04:27:44 STEP 2740 H=2740:00 +CPU= 20.691
  04:28:10 STEP 2741 H=2741:00 +CPU= 20.443
  04:28:53 STEP 2742 H=2742:00 +CPU= 33.773
  04:29:21 STEP 2743 H=2743:00 +CPU= 20.952
  04:29:47 STEP 2744 H=2744:00 +CPU= 21.515
  04:30:29 STEP 2745 H=2745:00 +CPU= 32.884
  04:30:54 STEP 2746 H=2746:00 +CPU= 21.703
  04:31:19 STEP 2747 H=2747:00 +CPU= 20.595
  04:32:05 STEP 2748 H=2748:00 +CPU= 36.635
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002748
  04:32:30 STEP 2749 H=2749:00 +CPU= 21.099
  04:32:54 STEP 2750 H=2750:00 +CPU= 21.509
  04:33:32 STEP 2751 H=2751:00 +CPU= 32.608
  04:33:57 STEP 2752 H=2752:00 +CPU= 20.929
  04:34:21 STEP 2753 H=2753:00 +CPU= 20.586
  04:34:58 STEP 2754 H=2754:00 +CPU= 33.686
  04:35:24 STEP 2755 H=2755:00 +CPU= 20.229
  04:35:49 STEP 2756 H=2756:00 +CPU= 21.181
  04:36:24 STEP 2757 H=2757:00 +CPU= 32.491
  04:36:50 STEP 2758 H=2758:00 +CPU= 21.576
  04:37:13 STEP 2759 H=2759:00 +CPU= 21.049
  04:37:58 STEP 2760 H=2760:00 +CPU= 38.319
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_114.zip
Uploading the intermediate file: upload_file_114.zip
  04:38:23 STEP 2761 H=2761:00 +CPU= 20.761
  04:38:51 STEP 2762 H=2762:00 +CPU= 20.871
  04:39:27 STEP 2763 H=2763:00 +CPU= 32.058
  04:39:52 STEP 2764 H=2764:00 +CPU= 20.540
  04:40:14 STEP 2765 H=2765:00 +CPU= 20.055
  04:40:52 STEP 2766 H=2766:00 +CPU= 33.263
  04:41:16 STEP 2767 H=2767:00 +CPU= 19.909
  04:41:41 STEP 2768 H=2768:00 +CPU= 21.154
  04:42:18 STEP 2769 H=2769:00 +CPU= 32.775
  04:42:42 STEP 2770 H=2770:00 +CPU= 20.951
  04:43:06 STEP 2771 H=2771:00 +CPU= 20.078
  04:43:49 STEP 2772 H=2772:00 +CPU= 36.258
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002772
  04:44:14 STEP 2773 H=2773:00 +CPU= 19.980
  04:44:38 STEP 2774 H=2774:00 +CPU= 20.576
  04:45:13 STEP 2775 H=2775:00 +CPU= 31.742
  04:45:36 STEP 2776 H=2776:00 +CPU= 21.356
  04:46:02 STEP 2777 H=2777:00 +CPU= 20.515
  04:46:49 STEP 2778 H=2778:00 +CPU= 33.225
  04:47:10 STEP 2779 H=2779:00 +CPU= 20.623
  04:47:38 STEP 2780 H=2780:00 +CPU= 20.923
  04:48:15 STEP 2781 H=2781:00 +CPU= 31.456
  04:48:39 STEP 2782 H=2782:00 +CPU= 20.988
  04:49:01 STEP 2783 H=2783:00 +CPU= 20.697
  04:49:42 STEP 2784 H=2784:00 +CPU= 39.009
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_115.zip
Uploading the intermediate file: upload_file_115.zip
Uploading trickle at timestep: 10022400
  04:50:06 STEP 2785 H=2785:00 +CPU= 20.523
  04:50:31 STEP 2786 H=2786:00 +CPU= 21.300
  04:51:10 STEP 2787 H=2787:00 +CPU= 32.842
  04:51:34 STEP 2788 H=2788:00 +CPU= 21.035
  04:52:00 STEP 2789 H=2789:00 +CPU= 20.562
  04:52:38 STEP 2790 H=2790:00 +CPU= 32.956
  04:52:59 STEP 2791 H=2791:00 +CPU= 19.672
  04:53:23 STEP 2792 H=2792:00 +CPU= 21.889
  04:54:01 STEP 2793 H=2793:00 +CPU= 31.908
  04:54:26 STEP 2794 H=2794:00 +CPU= 20.511
  04:54:47 STEP 2795 H=2795:00 +CPU= 19.578
  04:55:28 STEP 2796 H=2796:00 +CPU= 35.641
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002796
  04:55:53 STEP 2797 H=2797:00 +CPU= 20.495
  04:56:19 STEP 2798 H=2798:00 +CPU= 21.020
  04:57:02 STEP 2799 H=2799:00 +CPU= 32.418
  04:57:29 STEP 2800 H=2800:00 +CPU= 21.079
  04:57:54 STEP 2801 H=2801:00 +CPU= 20.192
  04:58:33 STEP 2802 H=2802:00 +CPU= 32.946
  04:58:56 STEP 2803 H=2803:00 +CPU= 20.321
  04:59:20 STEP 2804 H=2804:00 +CPU= 21.040
  05:00:01 STEP 2805 H=2805:00 +CPU= 33.116
  05:00:27 STEP 2806 H=2806:00 +CPU= 21.494
  05:00:57 STEP 2807 H=2807:00 +CPU= 21.135
  05:01:42 STEP 2808 H=2808:00 +CPU= 37.913
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_116.zip
Uploading the intermediate file: upload_file_116.zip
  05:02:07 STEP 2809 H=2809:00 +CPU= 20.373
  05:02:31 STEP 2810 H=2810:00 +CPU= 20.930
  05:03:10 STEP 2811 H=2811:00 +CPU= 31.190
  05:03:33 STEP 2812 H=2812:00 +CPU= 20.804
  05:03:56 STEP 2813 H=2813:00 +CPU= 20.404
  05:04:33 STEP 2814 H=2814:00 +CPU= 33.470
  05:04:58 STEP 2815 H=2815:00 +CPU= 20.478
  05:05:26 STEP 2816 H=2816:00 +CPU= 20.758
  05:06:05 STEP 2817 H=2817:00 +CPU= 31.897
  05:06:27 STEP 2818 H=2818:00 +CPU= 20.347
  05:06:49 STEP 2819 H=2819:00 +CPU= 20.368
  05:07:35 STEP 2820 H=2820:00 +CPU= 36.238
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002820
  05:07:58 STEP 2821 H=2821:00 +CPU= 20.494
  05:08:22 STEP 2822 H=2822:00 +CPU= 20.900
  05:08:59 STEP 2823 H=2823:00 +CPU= 32.533
  05:09:24 STEP 2824 H=2824:00 +CPU= 20.778
  05:09:47 STEP 2825 H=2825:00 +CPU= 20.411
  05:10:24 STEP 2826 H=2826:00 +CPU= 32.813
  05:10:47 STEP 2827 H=2827:00 +CPU= 20.084
  05:11:14 STEP 2828 H=2828:00 +CPU= 21.094
  05:11:52 STEP 2829 H=2829:00 +CPU= 32.591
  05:12:17 STEP 2830 H=2830:00 +CPU= 20.793
  05:12:41 STEP 2831 H=2831:00 +CPU= 21.468
  05:13:28 STEP 2832 H=2832:00 +CPU= 38.405
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_117.zip
Uploading the intermediate file: upload_file_117.zip
  05:13:53 STEP 2833 H=2833:00 +CPU= 20.562
  05:14:23 STEP 2834 H=2834:00 +CPU= 21.164
  05:14:59 STEP 2835 H=2835:00 +CPU= 31.961
  05:15:25 STEP 2836 H=2836:00 +CPU= 21.044
  05:15:53 STEP 2837 H=2837:00 +CPU= 20.379
  05:16:35 STEP 2838 H=2838:00 +CPU= 33.247
  05:17:00 STEP 2839 H=2839:00 +CPU= 20.179
  05:17:28 STEP 2840 H=2840:00 +CPU= 21.578
  05:18:10 STEP 2841 H=2841:00 +CPU= 32.259
  05:18:36 STEP 2842 H=2842:00 +CPU= 21.517
  05:18:59 STEP 2843 H=2843:00 +CPU= 20.191
  05:19:44 STEP 2844 H=2844:00 +CPU= 36.079
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002844
  05:20:13 STEP 2845 H=2845:00 +CPU= 20.074
  05:20:34 STEP 2846 H=2846:00 +CPU= 20.199
  05:21:13 STEP 2847 H=2847:00 +CPU= 32.411
  05:21:40 STEP 2848 H=2848:00 +CPU= 21.593
  05:22:06 STEP 2849 H=2849:00 +CPU= 20.449
  05:22:46 STEP 2850 H=2850:00 +CPU= 33.527
  05:23:11 STEP 2851 H=2851:00 +CPU= 20.227
  05:23:38 STEP 2852 H=2852:00 +CPU= 20.605
  05:24:12 STEP 2853 H=2853:00 +CPU= 30.968
  05:24:35 STEP 2854 H=2854:00 +CPU= 20.300
  05:24:59 STEP 2855 H=2855:00 +CPU= 20.532
  05:25:45 STEP 2856 H=2856:00 +CPU= 38.857
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_118.zip
Uploading the intermediate file: upload_file_118.zip
  05:26:12 STEP 2857 H=2857:00 +CPU= 20.438
  05:26:39 STEP 2858 H=2858:00 +CPU= 21.174
  05:27:17 STEP 2859 H=2859:00 +CPU= 31.909
  05:27:40 STEP 2860 H=2860:00 +CPU= 20.915
  05:28:09 STEP 2861 H=2861:00 +CPU= 20.348
  05:28:47 STEP 2862 H=2862:00 +CPU= 32.687
  05:29:09 STEP 2863 H=2863:00 +CPU= 19.669
  05:29:33 STEP 2864 H=2864:00 +CPU= 21.346
  05:30:12 STEP 2865 H=2865:00 +CPU= 32.689
  05:30:35 STEP 2866 H=2866:00 +CPU= 20.764
  05:31:01 STEP 2867 H=2867:00 +CPU= 20.617
  05:31:48 STEP 2868 H=2868:00 +CPU= 36.296
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002868
  05:32:12 STEP 2869 H=2869:00 +CPU= 19.851
  05:32:38 STEP 2870 H=2870:00 +CPU= 21.198
  05:33:16 STEP 2871 H=2871:00 +CPU= 32.618
  05:33:43 STEP 2872 H=2872:00 +CPU= 21.620
  05:34:04 STEP 2873 H=2873:00 +CPU= 19.597
  05:34:45 STEP 2874 H=2874:00 +CPU= 33.003
  05:35:10 STEP 2875 H=2875:00 +CPU= 20.344
  05:35:33 STEP 2876 H=2876:00 +CPU= 22.060
  05:36:13 STEP 2877 H=2877:00 +CPU= 32.495
  05:36:37 STEP 2878 H=2878:00 +CPU= 20.306
  05:37:06 STEP 2879 H=2879:00 +CPU= 20.644
  05:37:51 STEP 2880 H=2880:00 +CPU= 37.688
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_119.zip
Uploading the intermediate file: upload_file_119.zip
  05:38:15 STEP 2881 H=2881:00 +CPU= 21.086
  05:38:41 STEP 2882 H=2882:00 +CPU= 21.640
  05:39:19 STEP 2883 H=2883:00 +CPU= 32.187
  05:39:44 STEP 2884 H=2884:00 +CPU= 20.909
  05:40:10 STEP 2885 H=2885:00 +CPU= 20.594
  05:40:48 STEP 2886 H=2886:00 +CPU= 33.267
  05:41:12 STEP 2887 H=2887:00 +CPU= 20.831
  05:41:37 STEP 2888 H=2888:00 +CPU= 21.426
  05:42:14 STEP 2889 H=2889:00 +CPU= 31.952
  05:42:39 STEP 2890 H=2890:00 +CPU= 20.504
  05:43:00 STEP 2891 H=2891:00 +CPU= 19.697
  05:43:52 STEP 2892 H=2892:00 +CPU= 36.089
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002892
  05:44:17 STEP 2893 H=2893:00 +CPU= 20.504
  05:44:44 STEP 2894 H=2894:00 +CPU= 20.955
  05:45:24 STEP 2895 H=2895:00 +CPU= 32.362
  05:45:50 STEP 2896 H=2896:00 +CPU= 21.705
  05:46:11 STEP 2897 H=2897:00 +CPU= 19.728
  05:46:52 STEP 2898 H=2898:00 +CPU= 33.114
  05:47:14 STEP 2899 H=2899:00 +CPU= 20.167
  05:47:38 STEP 2900 H=2900:00 +CPU= 21.039
  05:48:17 STEP 2901 H=2901:00 +CPU= 32.146
  05:48:46 STEP 2902 H=2902:00 +CPU= 21.370
  05:49:14 STEP 2903 H=2903:00 +CPU= 20.928
  05:49:59 STEP 2904 H=2904:00 +CPU= 38.201
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_120.zip
Uploading the intermediate file: upload_file_120.zip
  05:50:23 STEP 2905 H=2905:00 +CPU= 20.633
  05:50:49 STEP 2906 H=2906:00 +CPU= 20.984
  05:51:25 STEP 2907 H=2907:00 +CPU= 32.162
  05:51:49 STEP 2908 H=2908:00 +CPU= 20.890
  05:52:14 STEP 2909 H=2909:00 +CPU= 20.147
  05:52:52 STEP 2910 H=2910:00 +CPU= 32.665
  05:53:16 STEP 2911 H=2911:00 +CPU= 20.182
  05:53:41 STEP 2912 H=2912:00 +CPU= 21.448
  05:54:19 STEP 2913 H=2913:00 +CPU= 32.433
  05:54:41 STEP 2914 H=2914:00 +CPU= 20.948
  05:55:02 STEP 2915 H=2915:00 +CPU= 19.705
  05:55:44 STEP 2916 H=2916:00 +CPU= 36.158
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002916
  05:56:10 STEP 2917 H=2917:00 +CPU= 20.488
  05:56:33 STEP 2918 H=2918:00 +CPU= 21.201
  05:57:10 STEP 2919 H=2919:00 +CPU= 32.231
  05:57:36 STEP 2920 H=2920:00 +CPU= 20.716
  05:57:58 STEP 2921 H=2921:00 +CPU= 20.406
  05:58:35 STEP 2922 H=2922:00 +CPU= 33.324
  05:58:59 STEP 2923 H=2923:00 +CPU= 20.545
  05:59:23 STEP 2924 H=2924:00 +CPU= 21.190
  06:00:03 STEP 2925 H=2925:00 +CPU= 32.572
  06:00:26 STEP 2926 H=2926:00 +CPU= 20.951
  06:00:50 STEP 2927 H=2927:00 +CPU= 20.807
  06:01:32 STEP 2928 H=2928:00 +CPU= 38.440
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_121.zip
Uploading the intermediate file: upload_file_121.zip
  06:01:58 STEP 2929 H=2929:00 +CPU= 20.193
  06:02:22 STEP 2930 H=2930:00 +CPU= 21.161
  06:03:02 STEP 2931 H=2931:00 +CPU= 33.055
  06:03:27 STEP 2932 H=2932:00 +CPU= 21.059
  06:03:51 STEP 2933 H=2933:00 +CPU= 20.362
  06:04:34 STEP 2934 H=2934:00 +CPU= 33.115
  06:05:03 STEP 2935 H=2935:00 +CPU= 20.757
  06:05:30 STEP 2936 H=2936:00 +CPU= 20.997
  06:06:10 STEP 2937 H=2937:00 +CPU= 31.946
  06:06:35 STEP 2938 H=2938:00 +CPU= 20.475
  06:06:57 STEP 2939 H=2939:00 +CPU= 20.548
  06:07:41 STEP 2940 H=2940:00 +CPU= 36.176
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002940
  06:08:02 STEP 2941 H=2941:00 +CPU= 20.414
  06:08:26 STEP 2942 H=2942:00 +CPU= 20.750
  06:09:05 STEP 2943 H=2943:00 +CPU= 32.779
  06:09:31 STEP 2944 H=2944:00 +CPU= 21.373
  06:09:56 STEP 2945 H=2945:00 +CPU= 20.606
  06:10:38 STEP 2946 H=2946:00 +CPU= 33.750
  06:11:02 STEP 2947 H=2947:00 +CPU= 20.641
  06:11:28 STEP 2948 H=2948:00 +CPU= 20.707
  06:12:05 STEP 2949 H=2949:00 +CPU= 32.571
  06:12:31 STEP 2950 H=2950:00 +CPU= 20.820
  06:12:56 STEP 2951 H=2951:00 +CPU= 20.508
  06:13:39 STEP 2952 H=2952:00 +CPU= 37.289
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170114/ICMGGhq0f+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0470_1984050100_123_953_12170114_0_r438522012_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
06:17:03 (2067999): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:09:59 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 10,623,600 75,258 0.0071
09 May 2023 16:09:55 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 10,022,400 71,051 0.0071
09 May 2023 16:09:55 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 10,022,400 71,051 0.0071
09 May 2023 16:09:38 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 8,640,000 61,121 0.0071
09 May 2023 16:09:31 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 7,776,000 55,055 0.0071
09 May 2023 16:09:23 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 6,912,000 48,902 0.0071
09 May 2023 16:09:15 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 6,048,000 42,822 0.0071
09 May 2023 16:09:08 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 5,184,000 36,771 0.0071
09 May 2023 16:09:01 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 4,320,000 30,622 0.0071
09 May 2023 16:08:53 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 3,456,000 24,501 0.0071
09 May 2023 16:08:46 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 2,592,000 18,367 0.0071
09 May 2023 16:08:39 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 1,728,000 12,211 0.0071
09 May 2023 16:08:32 1510721 22254425 oifs_43r3_ps_0470_1984050100_123_953_12170114_0 864,000 6,085 0.0070


©2024 cpdn.org