climateprediction.net home page
Task 22314844

Task 22314844

Name oifs_43r3_001o_2019110100_123_993_12213498_0
Workunit 12213498
Created 24 Feb 2023, 11:41:29 UTC
Sent 24 Feb 2023, 12:00:05 UTC
Report deadline 25 Apr 2023, 12:00:05 UTC
Received 25 Feb 2023, 14:31:19 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1527784
Run time 15 hours 50 min 35 sec
CPU time 15 hours 21 min 30 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 6.66 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,416.70 MB
Peak swap size 4,983.14 MB
Peak disk usage 1,541.60 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
Ahnw4+002364
  10:39:19 STEP 2365 H=2365:00 +CPU= 15.892
  10:39:35 STEP 2366 H=2366:00 +CPU= 16.396
  10:40:00 STEP 2367 H=2367:00 +CPU= 24.017
  10:40:16 STEP 2368 H=2368:00 +CPU= 16.354
  10:40:33 STEP 2369 H=2369:00 +CPU= 15.868
  10:40:58 STEP 2370 H=2370:00 +CPU= 24.485
  10:41:14 STEP 2371 H=2371:00 +CPU= 15.946
  10:41:31 STEP 2372 H=2372:00 +CPU= 16.230
  10:41:57 STEP 2373 H=2373:00 +CPU= 24.380
  10:42:13 STEP 2374 H=2374:00 +CPU= 16.172
  10:42:32 STEP 2375 H=2375:00 +CPU= 16.720
  10:43:02 STEP 2376 H=2376:00 +CPU= 28.446
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_98.zip
Uploading the intermediate file: upload_file_98.zip
  10:43:18 STEP 2377 H=2377:00 +CPU= 15.635
  10:43:35 STEP 2378 H=2378:00 +CPU= 16.491
  10:44:00 STEP 2379 H=2379:00 +CPU= 24.045
  10:44:17 STEP 2380 H=2380:00 +CPU= 16.372
  10:44:35 STEP 2381 H=2381:00 +CPU= 16.183
  10:45:00 STEP 2382 H=2382:00 +CPU= 24.680
  10:45:18 STEP 2383 H=2383:00 +CPU= 16.136
  10:45:35 STEP 2384 H=2384:00 +CPU= 16.140
  10:46:00 STEP 2385 H=2385:00 +CPU= 24.267
  10:46:18 STEP 2386 H=2386:00 +CPU= 16.669
  10:46:35 STEP 2387 H=2387:00 +CPU= 16.185
  10:47:04 STEP 2388 H=2388:00 +CPU= 26.587
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002388
  10:47:21 STEP 2389 H=2389:00 +CPU= 16.297
  10:47:39 STEP 2390 H=2390:00 +CPU= 16.497
  10:48:07 STEP 2391 H=2391:00 +CPU= 24.609
  10:48:26 STEP 2392 H=2392:00 +CPU= 16.751
  10:48:43 STEP 2393 H=2393:00 +CPU= 16.192
  10:49:10 STEP 2394 H=2394:00 +CPU= 24.944
  10:49:27 STEP 2395 H=2395:00 +CPU= 16.300
  10:49:44 STEP 2396 H=2396:00 +CPU= 16.231
  10:50:08 STEP 2397 H=2397:00 +CPU= 23.949
  10:50:26 STEP 2398 H=2398:00 +CPU= 16.533
  10:50:43 STEP 2399 H=2399:00 +CPU= 16.304
  10:51:13 STEP 2400 H=2400:00 +CPU= 28.549
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_99.zip
Uploading the intermediate file: upload_file_99.zip
  10:51:29 STEP 2401 H=2401:00 +CPU= 15.724
  10:51:46 STEP 2402 H=2402:00 +CPU= 16.180
  10:52:10 STEP 2403 H=2403:00 +CPU= 23.858
  10:52:27 STEP 2404 H=2404:00 +CPU= 16.341
  10:52:43 STEP 2405 H=2405:00 +CPU= 15.798
  10:53:09 STEP 2406 H=2406:00 +CPU= 24.196
  10:53:28 STEP 2407 H=2407:00 +CPU= 15.742
  10:53:47 STEP 2408 H=2408:00 +CPU= 15.716
  10:54:17 STEP 2409 H=2409:00 +CPU= 23.960
  10:54:36 STEP 2410 H=2410:00 +CPU= 15.856
  10:54:52 STEP 2411 H=2411:00 +CPU= 15.859
  10:55:21 STEP 2412 H=2412:00 +CPU= 25.962
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002412
  10:55:40 STEP 2413 H=2413:00 +CPU= 15.661
  10:56:00 STEP 2414 H=2414:00 +CPU= 15.837
  10:56:31 STEP 2415 H=2415:00 +CPU= 24.140
  10:56:49 STEP 2416 H=2416:00 +CPU= 16.267
  10:57:05 STEP 2417 H=2417:00 +CPU= 15.845
  10:57:31 STEP 2418 H=2418:00 +CPU= 24.756
  10:57:47 STEP 2419 H=2419:00 +CPU= 16.128
  10:58:04 STEP 2420 H=2420:00 +CPU= 16.285
  10:58:30 STEP 2421 H=2421:00 +CPU= 24.424
  10:58:47 STEP 2422 H=2422:00 +CPU= 16.481
  10:59:04 STEP 2423 H=2423:00 +CPU= 16.360
  10:59:36 STEP 2424 H=2424:00 +CPU= 28.781
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_100.zip
Uploading the intermediate file: upload_file_100.zip
  10:59:53 STEP 2425 H=2425:00 +CPU= 15.895
  11:00:11 STEP 2426 H=2426:00 +CPU= 16.115
  11:00:37 STEP 2427 H=2427:00 +CPU= 24.471
  11:00:54 STEP 2428 H=2428:00 +CPU= 16.525
  11:01:11 STEP 2429 H=2429:00 +CPU= 15.907
  11:01:36 STEP 2430 H=2430:00 +CPU= 24.588
  11:01:53 STEP 2431 H=2431:00 +CPU= 16.379
  11:02:10 STEP 2432 H=2432:00 +CPU= 16.121
  11:02:35 STEP 2433 H=2433:00 +CPU= 24.200
  11:02:51 STEP 2434 H=2434:00 +CPU= 16.402
  11:03:07 STEP 2435 H=2435:00 +CPU= 15.757
  11:03:34 STEP 2436 H=2436:00 +CPU= 26.454
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002436
  11:03:51 STEP 2437 H=2437:00 +CPU= 16.093
  11:04:07 STEP 2438 H=2438:00 +CPU= 16.109
  11:04:32 STEP 2439 H=2439:00 +CPU= 24.128
  11:04:49 STEP 2440 H=2440:00 +CPU= 16.430
  11:05:05 STEP 2441 H=2441:00 +CPU= 15.643
  11:05:30 STEP 2442 H=2442:00 +CPU= 24.535
  11:05:47 STEP 2443 H=2443:00 +CPU= 16.143
  11:06:03 STEP 2444 H=2444:00 +CPU= 16.011
  11:06:28 STEP 2445 H=2445:00 +CPU= 24.142
  11:06:44 STEP 2446 H=2446:00 +CPU= 16.342
  11:07:01 STEP 2447 H=2447:00 +CPU= 16.110
  11:07:32 STEP 2448 H=2448:00 +CPU= 28.631
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_101.zip
Uploading the intermediate file: upload_file_101.zip
  11:07:49 STEP 2449 H=2449:00 +CPU= 15.998
  11:08:06 STEP 2450 H=2450:00 +CPU= 15.896
  11:08:31 STEP 2451 H=2451:00 +CPU= 24.229
  11:08:49 STEP 2452 H=2452:00 +CPU= 16.590
  11:09:05 STEP 2453 H=2453:00 +CPU= 15.622
  11:09:30 STEP 2454 H=2454:00 +CPU= 24.640
  11:09:46 STEP 2455 H=2455:00 +CPU= 16.114
  11:10:03 STEP 2456 H=2456:00 +CPU= 16.044
  11:10:30 STEP 2457 H=2457:00 +CPU= 24.725
  11:10:46 STEP 2458 H=2458:00 +CPU= 16.419
  11:11:03 STEP 2459 H=2459:00 +CPU= 15.651
  11:11:30 STEP 2460 H=2460:00 +CPU= 26.432
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002460
  11:11:46 STEP 2461 H=2461:00 +CPU= 16.092
  11:12:02 STEP 2462 H=2462:00 +CPU= 15.852
  11:12:28 STEP 2463 H=2463:00 +CPU= 24.473
  11:12:45 STEP 2464 H=2464:00 +CPU= 16.562
  11:13:00 STEP 2465 H=2465:00 +CPU= 15.460
  11:13:25 STEP 2466 H=2466:00 +CPU= 24.617
  11:13:42 STEP 2467 H=2467:00 +CPU= 15.894
  11:13:58 STEP 2468 H=2468:00 +CPU= 16.004
  11:14:23 STEP 2469 H=2469:00 +CPU= 24.245
  11:14:40 STEP 2470 H=2470:00 +CPU= 16.438
  11:14:56 STEP 2471 H=2471:00 +CPU= 16.149
  11:15:26 STEP 2472 H=2472:00 +CPU= 28.483
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_102.zip
Uploading the intermediate file: upload_file_102.zip
  11:15:42 STEP 2473 H=2473:00 +CPU= 15.821
  11:15:59 STEP 2474 H=2474:00 +CPU= 16.233
  11:16:24 STEP 2475 H=2475:00 +CPU= 24.290
  11:16:41 STEP 2476 H=2476:00 +CPU= 16.577
  11:16:57 STEP 2477 H=2477:00 +CPU= 15.734
  11:17:22 STEP 2478 H=2478:00 +CPU= 24.619
  11:17:38 STEP 2479 H=2479:00 +CPU= 16.160
  11:17:55 STEP 2480 H=2480:00 +CPU= 16.234
  11:18:20 STEP 2481 H=2481:00 +CPU= 24.142
  11:18:37 STEP 2482 H=2482:00 +CPU= 16.626
  11:18:53 STEP 2483 H=2483:00 +CPU= 15.718
  11:19:20 STEP 2484 H=2484:00 +CPU= 26.510
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002484
  11:19:37 STEP 2485 H=2485:00 +CPU= 16.199
  11:19:53 STEP 2486 H=2486:00 +CPU= 16.156
  11:20:18 STEP 2487 H=2487:00 +CPU= 24.088
  11:20:35 STEP 2488 H=2488:00 +CPU= 16.521
  11:20:51 STEP 2489 H=2489:00 +CPU= 15.680
  11:21:16 STEP 2490 H=2490:00 +CPU= 24.593
  11:21:32 STEP 2491 H=2491:00 +CPU= 16.079
  11:21:49 STEP 2492 H=2492:00 +CPU= 16.128
  11:22:14 STEP 2493 H=2493:00 +CPU= 24.165
  11:22:31 STEP 2494 H=2494:00 +CPU= 16.407
  11:22:47 STEP 2495 H=2495:00 +CPU= 16.321
  11:23:17 STEP 2496 H=2496:00 +CPU= 28.327
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_103.zip
Uploading the intermediate file: upload_file_103.zip
  11:23:33 STEP 2497 H=2497:00 +CPU= 15.568
  11:23:50 STEP 2498 H=2498:00 +CPU= 16.076
  11:24:15 STEP 2499 H=2499:00 +CPU= 24.118
  11:24:34 STEP 2500 H=2500:00 +CPU= 16.621
  11:24:50 STEP 2501 H=2501:00 +CPU= 15.717
  11:25:16 STEP 2502 H=2502:00 +CPU= 24.835
  11:25:35 STEP 2503 H=2503:00 +CPU= 16.296
  11:25:52 STEP 2504 H=2504:00 +CPU= 16.067
  11:26:18 STEP 2505 H=2505:00 +CPU= 24.171
  11:26:35 STEP 2506 H=2506:00 +CPU= 16.615
  11:26:51 STEP 2507 H=2507:00 +CPU= 15.550
  11:27:18 STEP 2508 H=2508:00 +CPU= 26.420
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002508
  11:27:36 STEP 2509 H=2509:00 +CPU= 16.369
  11:27:52 STEP 2510 H=2510:00 +CPU= 16.158
  11:28:17 STEP 2511 H=2511:00 +CPU= 24.123
  11:28:34 STEP 2512 H=2512:00 +CPU= 16.388
  11:28:52 STEP 2513 H=2513:00 +CPU= 15.899
  11:29:19 STEP 2514 H=2514:00 +CPU= 24.649
  11:29:36 STEP 2515 H=2515:00 +CPU= 16.107
  11:29:53 STEP 2516 H=2516:00 +CPU= 16.221
  11:30:18 STEP 2517 H=2517:00 +CPU= 24.035
  11:30:35 STEP 2518 H=2518:00 +CPU= 16.400
  11:30:51 STEP 2519 H=2519:00 +CPU= 15.943
  11:31:21 STEP 2520 H=2520:00 +CPU= 28.671
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_104.zip
Uploading the intermediate file: upload_file_104.zip
  11:31:38 STEP 2521 H=2521:00 +CPU= 15.742
  11:31:54 STEP 2522 H=2522:00 +CPU= 15.953
  11:32:19 STEP 2523 H=2523:00 +CPU= 24.167
  11:32:37 STEP 2524 H=2524:00 +CPU= 16.579
  11:32:53 STEP 2525 H=2525:00 +CPU= 15.719
  11:33:19 STEP 2526 H=2526:00 +CPU= 24.473
  11:33:36 STEP 2527 H=2527:00 +CPU= 16.411
  11:33:52 STEP 2528 H=2528:00 +CPU= 16.066
  11:34:17 STEP 2529 H=2529:00 +CPU= 24.053
  11:34:33 STEP 2530 H=2530:00 +CPU= 16.394
  11:34:49 STEP 2531 H=2531:00 +CPU= 15.439
  11:35:16 STEP 2532 H=2532:00 +CPU= 26.343
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002532
  11:35:32 STEP 2533 H=2533:00 +CPU= 16.130
  11:35:48 STEP 2534 H=2534:00 +CPU= 16.001
  11:36:13 STEP 2535 H=2535:00 +CPU= 24.327
  11:36:31 STEP 2536 H=2536:00 +CPU= 16.818
  11:36:48 STEP 2537 H=2537:00 +CPU= 15.895
  11:37:14 STEP 2538 H=2538:00 +CPU= 24.892
  11:37:30 STEP 2539 H=2539:00 +CPU= 16.115
  11:37:47 STEP 2540 H=2540:00 +CPU= 16.031
  11:38:11 STEP 2541 H=2541:00 +CPU= 24.121
  11:38:28 STEP 2542 H=2542:00 +CPU= 16.476
  11:38:44 STEP 2543 H=2543:00 +CPU= 16.052
  11:39:14 STEP 2544 H=2544:00 +CPU= 28.364
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_105.zip
Uploading the intermediate file: upload_file_105.zip
  11:39:30 STEP 2545 H=2545:00 +CPU= 15.829
  11:39:47 STEP 2546 H=2546:00 +CPU= 15.981
  11:40:12 STEP 2547 H=2547:00 +CPU= 24.139
  11:40:29 STEP 2548 H=2548:00 +CPU= 16.587
  11:40:45 STEP 2549 H=2549:00 +CPU= 15.784
  11:41:11 STEP 2550 H=2550:00 +CPU= 24.707
  11:41:27 STEP 2551 H=2551:00 +CPU= 16.075
  11:41:44 STEP 2552 H=2552:00 +CPU= 16.028
  11:42:08 STEP 2553 H=2553:00 +CPU= 24.034
  11:42:25 STEP 2554 H=2554:00 +CPU= 16.453
  11:42:43 STEP 2555 H=2555:00 +CPU= 15.843
  11:43:10 STEP 2556 H=2556:00 +CPU= 26.121
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002556
  11:43:26 STEP 2557 H=2557:00 +CPU= 15.846
  11:43:42 STEP 2558 H=2558:00 +CPU= 15.959
  11:44:07 STEP 2559 H=2559:00 +CPU= 23.977
  11:44:24 STEP 2560 H=2560:00 +CPU= 16.324
  11:44:40 STEP 2561 H=2561:00 +CPU= 15.518
  11:45:06 STEP 2562 H=2562:00 +CPU= 24.443
  11:45:22 STEP 2563 H=2563:00 +CPU= 15.846
  11:45:39 STEP 2564 H=2564:00 +CPU= 15.921
  11:46:04 STEP 2565 H=2565:00 +CPU= 24.132
  11:46:21 STEP 2566 H=2566:00 +CPU= 16.580
  11:46:38 STEP 2567 H=2567:00 +CPU= 16.281
  11:47:07 STEP 2568 H=2568:00 +CPU= 28.177
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_106.zip
Uploading the intermediate file: upload_file_106.zip
  11:47:23 STEP 2569 H=2569:00 +CPU= 15.812
  11:47:40 STEP 2570 H=2570:00 +CPU= 16.144
  11:48:05 STEP 2571 H=2571:00 +CPU= 24.168
  11:48:22 STEP 2572 H=2572:00 +CPU= 16.511
  11:48:38 STEP 2573 H=2573:00 +CPU= 15.625
  11:49:02 STEP 2574 H=2574:00 +CPU= 24.332
  11:49:19 STEP 2575 H=2575:00 +CPU= 16.041
  11:49:35 STEP 2576 H=2576:00 +CPU= 16.156
  11:50:00 STEP 2577 H=2577:00 +CPU= 24.032
  11:50:17 STEP 2578 H=2578:00 +CPU= 16.593
  11:50:33 STEP 2579 H=2579:00 +CPU= 15.809
  11:50:59 STEP 2580 H=2580:00 +CPU= 26.093
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002580
  11:51:16 STEP 2581 H=2581:00 +CPU= 16.190
  11:51:32 STEP 2582 H=2582:00 +CPU= 16.251
  11:51:57 STEP 2583 H=2583:00 +CPU= 23.915
  11:52:13 STEP 2584 H=2584:00 +CPU= 16.436
  11:52:29 STEP 2585 H=2585:00 +CPU= 15.798
  11:52:54 STEP 2586 H=2586:00 +CPU= 24.306
  11:53:10 STEP 2587 H=2587:00 +CPU= 16.073
  11:53:27 STEP 2588 H=2588:00 +CPU= 16.082
  11:53:51 STEP 2589 H=2589:00 +CPU= 24.081
  11:54:09 STEP 2590 H=2590:00 +CPU= 16.719
  11:54:26 STEP 2591 H=2591:00 +CPU= 16.289
  11:54:56 STEP 2592 H=2592:00 +CPU= 28.298
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_107.zip
Uploading the intermediate file: upload_file_107.zip
  11:55:13 STEP 2593 H=2593:00 +CPU= 15.846
Uploading trickle at timestep: 9331200
  11:55:29 STEP 2594 H=2594:00 +CPU= 15.829
  11:55:53 STEP 2595 H=2595:00 +CPU= 23.759
  11:56:10 STEP 2596 H=2596:00 +CPU= 16.281
  11:56:27 STEP 2597 H=2597:00 +CPU= 15.938
  11:56:52 STEP 2598 H=2598:00 +CPU= 24.295
  11:57:08 STEP 2599 H=2599:00 +CPU= 15.892
  11:57:24 STEP 2600 H=2600:00 +CPU= 16.102
  11:57:48 STEP 2601 H=2601:00 +CPU= 23.830
  11:58:05 STEP 2602 H=2602:00 +CPU= 16.382
  11:58:21 STEP 2603 H=2603:00 +CPU= 15.739
  11:58:48 STEP 2604 H=2604:00 +CPU= 25.984
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002604
  11:59:04 STEP 2605 H=2605:00 +CPU= 15.906
  11:59:20 STEP 2606 H=2606:00 +CPU= 16.043
  11:59:44 STEP 2607 H=2607:00 +CPU= 23.841
  12:00:01 STEP 2608 H=2608:00 +CPU= 16.336
  12:00:20 STEP 2609 H=2609:00 +CPU= 15.189
  12:00:48 STEP 2610 H=2610:00 +CPU= 23.960
  12:01:07 STEP 2611 H=2611:00 +CPU= 15.579
  12:01:27 STEP 2612 H=2612:00 +CPU= 15.816
  12:01:56 STEP 2613 H=2613:00 +CPU= 23.500
  12:02:17 STEP 2614 H=2614:00 +CPU= 16.125
  12:02:36 STEP 2615 H=2615:00 +CPU= 15.904
  12:03:13 STEP 2616 H=2616:00 +CPU= 27.891
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_108.zip
Uploading the intermediate file: upload_file_108.zip
  12:03:36 STEP 2617 H=2617:00 +CPU= 16.243
  12:03:56 STEP 2618 H=2618:00 +CPU= 16.311
  12:04:25 STEP 2619 H=2619:00 +CPU= 24.235
  12:04:45 STEP 2620 H=2620:00 +CPU= 16.528
  12:05:04 STEP 2621 H=2621:00 +CPU= 16.012
  12:05:33 STEP 2622 H=2622:00 +CPU= 24.497
  12:05:53 STEP 2623 H=2623:00 +CPU= 16.076
  12:06:13 STEP 2624 H=2624:00 +CPU= 16.578
  12:06:42 STEP 2625 H=2625:00 +CPU= 24.062
  12:07:02 STEP 2626 H=2626:00 +CPU= 16.504
  12:07:21 STEP 2627 H=2627:00 +CPU= 16.101
  12:07:53 STEP 2628 H=2628:00 +CPU= 26.157
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002628
  12:08:12 STEP 2629 H=2629:00 +CPU= 16.017
  12:08:32 STEP 2630 H=2630:00 +CPU= 16.855
  12:09:02 STEP 2631 H=2631:00 +CPU= 23.797
  12:09:22 STEP 2632 H=2632:00 +CPU= 16.627
  12:09:42 STEP 2633 H=2633:00 +CPU= 16.135
  12:10:11 STEP 2634 H=2634:00 +CPU= 24.441
  12:10:31 STEP 2635 H=2635:00 +CPU= 16.232
  12:10:51 STEP 2636 H=2636:00 +CPU= 16.672
  12:11:20 STEP 2637 H=2637:00 +CPU= 24.275
  12:11:39 STEP 2638 H=2638:00 +CPU= 16.487
  12:11:59 STEP 2639 H=2639:00 +CPU= 16.307
  12:12:33 STEP 2640 H=2640:00 +CPU= 28.049
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_109.zip
Uploading the intermediate file: upload_file_109.zip
  12:12:55 STEP 2641 H=2641:00 +CPU= 15.882
  12:13:16 STEP 2642 H=2642:00 +CPU= 16.498
  12:13:48 STEP 2643 H=2643:00 +CPU= 24.033
  12:14:09 STEP 2644 H=2644:00 +CPU= 16.429
  12:14:29 STEP 2645 H=2645:00 +CPU= 15.983
  12:14:59 STEP 2646 H=2646:00 +CPU= 24.391
  12:15:20 STEP 2647 H=2647:00 +CPU= 16.047
  12:15:41 STEP 2648 H=2648:00 +CPU= 16.586
  12:16:12 STEP 2649 H=2649:00 +CPU= 23.960
  12:16:34 STEP 2650 H=2650:00 +CPU= 16.476
  12:16:55 STEP 2651 H=2651:00 +CPU= 16.214
  12:17:28 STEP 2652 H=2652:00 +CPU= 26.208
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002652
  12:17:49 STEP 2653 H=2653:00 +CPU= 16.110
  12:18:10 STEP 2654 H=2654:00 +CPU= 16.436
  12:18:41 STEP 2655 H=2655:00 +CPU= 24.023
  12:19:01 STEP 2656 H=2656:00 +CPU= 16.498
  12:19:21 STEP 2657 H=2657:00 +CPU= 16.007
  12:19:53 STEP 2658 H=2658:00 +CPU= 24.451
  12:20:13 STEP 2659 H=2659:00 +CPU= 16.027
  12:20:33 STEP 2660 H=2660:00 +CPU= 16.390
  12:21:03 STEP 2661 H=2661:00 +CPU= 23.916
  12:21:24 STEP 2662 H=2662:00 +CPU= 16.315
  12:21:44 STEP 2663 H=2663:00 +CPU= 16.386
  12:22:16 STEP 2664 H=2664:00 +CPU= 28.611
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_110.zip
Uploading the intermediate file: upload_file_110.zip
  12:22:33 STEP 2665 H=2665:00 +CPU= 16.239
  12:22:51 STEP 2666 H=2666:00 +CPU= 16.607
  12:23:16 STEP 2667 H=2667:00 +CPU= 24.234
  12:23:34 STEP 2668 H=2668:00 +CPU= 16.907
  12:23:51 STEP 2669 H=2669:00 +CPU= 16.370
  12:24:17 STEP 2670 H=2670:00 +CPU= 24.837
  12:24:35 STEP 2671 H=2671:00 +CPU= 16.483
  12:24:52 STEP 2672 H=2672:00 +CPU= 16.826
  12:25:18 STEP 2673 H=2673:00 +CPU= 24.408
  12:25:35 STEP 2674 H=2674:00 +CPU= 16.982
  12:25:52 STEP 2675 H=2675:00 +CPU= 16.358
  12:26:20 STEP 2676 H=2676:00 +CPU= 26.713
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002676
  12:26:38 STEP 2677 H=2677:00 +CPU= 16.401
  12:26:55 STEP 2678 H=2678:00 +CPU= 16.748
  12:27:21 STEP 2679 H=2679:00 +CPU= 24.340
  12:27:39 STEP 2680 H=2680:00 +CPU= 16.942
  12:27:56 STEP 2681 H=2681:00 +CPU= 16.348
  12:28:22 STEP 2682 H=2682:00 +CPU= 24.936
  12:28:39 STEP 2683 H=2683:00 +CPU= 16.384
  12:28:56 STEP 2684 H=2684:00 +CPU= 16.774
  12:29:22 STEP 2685 H=2685:00 +CPU= 24.373
  12:29:40 STEP 2686 H=2686:00 +CPU= 16.814
  12:29:57 STEP 2687 H=2687:00 +CPU= 16.812
  12:30:28 STEP 2688 H=2688:00 +CPU= 28.957
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_111.zip
Uploading the intermediate file: upload_file_111.zip
  12:30:45 STEP 2689 H=2689:00 +CPU= 16.284
  12:31:03 STEP 2690 H=2690:00 +CPU= 16.830
  12:31:29 STEP 2691 H=2691:00 +CPU= 24.263
  12:31:46 STEP 2692 H=2692:00 +CPU= 16.897
  12:32:03 STEP 2693 H=2693:00 +CPU= 16.220
  12:32:30 STEP 2694 H=2694:00 +CPU= 24.977
  12:32:47 STEP 2695 H=2695:00 +CPU= 16.478
  12:33:04 STEP 2696 H=2696:00 +CPU= 16.886
  12:33:30 STEP 2697 H=2697:00 +CPU= 24.639
  12:33:48 STEP 2698 H=2698:00 +CPU= 16.943
  12:34:05 STEP 2699 H=2699:00 +CPU= 16.522
  12:34:33 STEP 2700 H=2700:00 +CPU= 27.011
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002700
  12:34:51 STEP 2701 H=2701:00 +CPU= 16.555
  12:35:08 STEP 2702 H=2702:00 +CPU= 16.963
  12:35:34 STEP 2703 H=2703:00 +CPU= 24.647
  12:35:52 STEP 2704 H=2704:00 +CPU= 16.976
  12:36:09 STEP 2705 H=2705:00 +CPU= 16.511
  12:36:35 STEP 2706 H=2706:00 +CPU= 25.164
  12:36:53 STEP 2707 H=2707:00 +CPU= 16.504
  12:37:10 STEP 2708 H=2708:00 +CPU= 16.878
  12:37:36 STEP 2709 H=2709:00 +CPU= 24.676
  12:37:54 STEP 2710 H=2710:00 +CPU= 16.950
  12:38:11 STEP 2711 H=2711:00 +CPU= 17.031
  12:38:42 STEP 2712 H=2712:00 +CPU= 29.193
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_112.zip
Uploading the intermediate file: upload_file_112.zip
  12:39:00 STEP 2713 H=2713:00 +CPU= 16.460
  12:39:17 STEP 2714 H=2714:00 +CPU= 16.710
  12:39:43 STEP 2715 H=2715:00 +CPU= 24.510
  12:40:01 STEP 2716 H=2716:00 +CPU= 16.926
  12:40:18 STEP 2717 H=2717:00 +CPU= 16.375
  12:40:45 STEP 2718 H=2718:00 +CPU= 25.251
  12:41:02 STEP 2719 H=2719:00 +CPU= 16.477
  12:41:20 STEP 2720 H=2720:00 +CPU= 16.857
  12:41:46 STEP 2721 H=2721:00 +CPU= 24.667
  12:42:03 STEP 2722 H=2722:00 +CPU= 16.902
  12:42:20 STEP 2723 H=2723:00 +CPU= 16.364
  12:42:49 STEP 2724 H=2724:00 +CPU= 26.998
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002724
  12:43:06 STEP 2725 H=2725:00 +CPU= 16.461
  12:43:24 STEP 2726 H=2726:00 +CPU= 16.779
  12:43:50 STEP 2727 H=2727:00 +CPU= 24.656
  12:44:08 STEP 2728 H=2728:00 +CPU= 17.117
  12:44:26 STEP 2729 H=2729:00 +CPU= 16.202
  12:44:51 STEP 2730 H=2730:00 +CPU= 24.636
  12:45:08 STEP 2731 H=2731:00 +CPU= 15.999
  12:45:26 STEP 2732 H=2732:00 +CPU= 16.496
  12:45:51 STEP 2733 H=2733:00 +CPU= 24.260
  12:46:09 STEP 2734 H=2734:00 +CPU= 16.510
  12:46:26 STEP 2735 H=2735:00 +CPU= 16.376
  12:46:56 STEP 2736 H=2736:00 +CPU= 28.538
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_113.zip
Uploading the intermediate file: upload_file_113.zip
  12:47:13 STEP 2737 H=2737:00 +CPU= 15.842
  12:47:32 STEP 2738 H=2738:00 +CPU= 16.914
  12:47:59 STEP 2739 H=2739:00 +CPU= 24.603
  12:48:17 STEP 2740 H=2740:00 +CPU= 17.026
  12:48:34 STEP 2741 H=2741:00 +CPU= 16.466
  12:49:02 STEP 2742 H=2742:00 +CPU= 25.386
  12:49:20 STEP 2743 H=2743:00 +CPU= 16.492
  12:49:37 STEP 2744 H=2744:00 +CPU= 16.442
  12:50:02 STEP 2745 H=2745:00 +CPU= 24.186
  12:50:19 STEP 2746 H=2746:00 +CPU= 16.684
  12:50:36 STEP 2747 H=2747:00 +CPU= 16.103
  12:51:04 STEP 2748 H=2748:00 +CPU= 26.354
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002748
  12:51:21 STEP 2749 H=2749:00 +CPU= 16.140
  12:51:38 STEP 2750 H=2750:00 +CPU= 16.425
  12:52:03 STEP 2751 H=2751:00 +CPU= 24.114
  12:52:21 STEP 2752 H=2752:00 +CPU= 16.711
  12:52:38 STEP 2753 H=2753:00 +CPU= 16.285
  12:53:05 STEP 2754 H=2754:00 +CPU= 25.208
  12:53:23 STEP 2755 H=2755:00 +CPU= 16.705
  12:53:41 STEP 2756 H=2756:00 +CPU= 16.988
  12:54:07 STEP 2757 H=2757:00 +CPU= 24.611
  12:54:25 STEP 2758 H=2758:00 +CPU= 17.061
  12:54:43 STEP 2759 H=2759:00 +CPU= 17.000
  12:55:14 STEP 2760 H=2760:00 +CPU= 28.264
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_114.zip
Uploading the intermediate file: upload_file_114.zip
  12:55:30 STEP 2761 H=2761:00 +CPU= 15.940
  12:55:48 STEP 2762 H=2762:00 +CPU= 16.459
  12:56:12 STEP 2763 H=2763:00 +CPU= 23.962
  12:56:32 STEP 2764 H=2764:00 +CPU= 17.116
  12:56:50 STEP 2765 H=2765:00 +CPU= 16.634
  12:57:17 STEP 2766 H=2766:00 +CPU= 25.361
  12:57:35 STEP 2767 H=2767:00 +CPU= 16.861
  12:57:53 STEP 2768 H=2768:00 +CPU= 16.964
  12:58:20 STEP 2769 H=2769:00 +CPU= 24.936
  12:58:38 STEP 2770 H=2770:00 +CPU= 17.143
  12:58:56 STEP 2771 H=2771:00 +CPU= 16.554
  12:59:25 STEP 2772 H=2772:00 +CPU= 27.241
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002772
  12:59:43 STEP 2773 H=2773:00 +CPU= 16.698
  13:00:01 STEP 2774 H=2774:00 +CPU= 16.939
  13:00:27 STEP 2775 H=2775:00 +CPU= 24.900
  13:00:46 STEP 2776 H=2776:00 +CPU= 17.121
  13:01:04 STEP 2777 H=2777:00 +CPU= 16.358
  13:01:31 STEP 2778 H=2778:00 +CPU= 25.368
  13:01:48 STEP 2779 H=2779:00 +CPU= 16.568
  13:02:07 STEP 2780 H=2780:00 +CPU= 16.995
  13:02:33 STEP 2781 H=2781:00 +CPU= 24.899
  13:02:51 STEP 2782 H=2782:00 +CPU= 17.069
  13:03:10 STEP 2783 H=2783:00 +CPU= 17.170
  13:03:42 STEP 2784 H=2784:00 +CPU= 29.360
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:03:59 STEP 2785 H=2785:00 +CPU= 16.404
  13:04:18 STEP 2786 H=2786:00 +CPU= 16.990
  13:04:44 STEP 2787 H=2787:00 +CPU= 24.974
  13:05:03 STEP 2788 H=2788:00 +CPU= 17.096
  13:05:20 STEP 2789 H=2789:00 +CPU= 16.501
  13:05:48 STEP 2790 H=2790:00 +CPU= 25.502
  13:06:05 STEP 2791 H=2791:00 +CPU= 16.629
  13:06:24 STEP 2792 H=2792:00 +CPU= 17.055
  13:06:51 STEP 2793 H=2793:00 +CPU= 25.101
  13:07:09 STEP 2794 H=2794:00 +CPU= 17.065
  13:07:26 STEP 2795 H=2795:00 +CPU= 16.650
  13:07:56 STEP 2796 H=2796:00 +CPU= 27.283
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002796
  13:08:13 STEP 2797 H=2797:00 +CPU= 16.602
  13:08:32 STEP 2798 H=2798:00 +CPU= 17.139
  13:08:58 STEP 2799 H=2799:00 +CPU= 25.060
  13:09:16 STEP 2800 H=2800:00 +CPU= 17.109
  13:09:34 STEP 2801 H=2801:00 +CPU= 16.638
  13:10:01 STEP 2802 H=2802:00 +CPU= 25.515
  13:10:19 STEP 2803 H=2803:00 +CPU= 16.701
  13:10:37 STEP 2804 H=2804:00 +CPU= 17.017
  13:11:04 STEP 2805 H=2805:00 +CPU= 25.082
  13:11:22 STEP 2806 H=2806:00 +CPU= 17.097
  13:11:41 STEP 2807 H=2807:00 +CPU= 17.201
  13:12:13 STEP 2808 H=2808:00 +CPU= 29.197
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:12:31 STEP 2809 H=2809:00 +CPU= 16.445
  13:12:49 STEP 2810 H=2810:00 +CPU= 16.990
  13:13:16 STEP 2811 H=2811:00 +CPU= 25.043
  13:13:34 STEP 2812 H=2812:00 +CPU= 17.098
  13:13:52 STEP 2813 H=2813:00 +CPU= 16.626
  13:14:20 STEP 2814 H=2814:00 +CPU= 25.475
  13:14:38 STEP 2815 H=2815:00 +CPU= 16.638
  13:14:56 STEP 2816 H=2816:00 +CPU= 16.996
  13:15:23 STEP 2817 H=2817:00 +CPU= 25.106
  13:15:42 STEP 2818 H=2818:00 +CPU= 17.082
  13:15:59 STEP 2819 H=2819:00 +CPU= 16.573
  13:16:28 STEP 2820 H=2820:00 +CPU= 27.287
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002820
  13:16:46 STEP 2821 H=2821:00 +CPU= 16.641
  13:17:04 STEP 2822 H=2822:00 +CPU= 17.006
  13:17:31 STEP 2823 H=2823:00 +CPU= 25.078
  13:17:50 STEP 2824 H=2824:00 +CPU= 17.020
  13:18:07 STEP 2825 H=2825:00 +CPU= 16.452
  13:18:35 STEP 2826 H=2826:00 +CPU= 25.503
  13:18:52 STEP 2827 H=2827:00 +CPU= 16.499
  13:19:10 STEP 2828 H=2828:00 +CPU= 16.815
  13:19:37 STEP 2829 H=2829:00 +CPU= 24.923
  13:19:55 STEP 2830 H=2830:00 +CPU= 16.959
  13:20:13 STEP 2831 H=2831:00 +CPU= 17.044
  13:20:43 STEP 2832 H=2832:00 +CPU= 28.442
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:21:00 STEP 2833 H=2833:00 +CPU= 15.991
Uploading trickle at timestep: 10195200
  13:21:18 STEP 2834 H=2834:00 +CPU= 16.568
  13:21:45 STEP 2835 H=2835:00 +CPU= 24.658
  13:22:03 STEP 2836 H=2836:00 +CPU= 16.540
  13:22:19 STEP 2837 H=2837:00 +CPU= 15.752
  13:22:44 STEP 2838 H=2838:00 +CPU= 24.387
  13:22:59 STEP 2839 H=2839:00 +CPU= 15.714
  13:23:16 STEP 2840 H=2840:00 +CPU= 16.325
  13:23:40 STEP 2841 H=2841:00 +CPU= 23.946
  13:23:57 STEP 2842 H=2842:00 +CPU= 16.187
  13:24:13 STEP 2843 H=2843:00 +CPU= 15.806
  13:24:42 STEP 2844 H=2844:00 +CPU= 26.533
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002844
  13:24:58 STEP 2845 H=2845:00 +CPU= 15.794
  13:25:15 STEP 2846 H=2846:00 +CPU= 16.346
  13:25:43 STEP 2847 H=2847:00 +CPU= 24.793
  13:26:02 STEP 2848 H=2848:00 +CPU= 17.197
  13:26:21 STEP 2849 H=2849:00 +CPU= 17.069
  13:26:49 STEP 2850 H=2850:00 +CPU= 26.312
  13:27:07 STEP 2851 H=2851:00 +CPU= 16.832
  13:27:26 STEP 2852 H=2852:00 +CPU= 17.582
  13:27:54 STEP 2853 H=2853:00 +CPU= 25.812
  13:28:12 STEP 2854 H=2854:00 +CPU= 17.242
  13:28:31 STEP 2855 H=2855:00 +CPU= 17.721
  13:29:04 STEP 2856 H=2856:00 +CPU= 30.085
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:29:23 STEP 2857 H=2857:00 +CPU= 16.731
  13:29:42 STEP 2858 H=2858:00 +CPU= 17.446
  13:30:09 STEP 2859 H=2859:00 +CPU= 25.726
  13:30:28 STEP 2860 H=2860:00 +CPU= 17.239
  13:30:47 STEP 2861 H=2861:00 +CPU= 17.089
  13:31:15 STEP 2862 H=2862:00 +CPU= 26.183
  13:31:33 STEP 2863 H=2863:00 +CPU= 16.808
  13:31:52 STEP 2864 H=2864:00 +CPU= 17.465
  13:32:19 STEP 2865 H=2865:00 +CPU= 25.725
  13:32:38 STEP 2866 H=2866:00 +CPU= 17.319
  13:32:56 STEP 2867 H=2867:00 +CPU= 17.008
  13:33:26 STEP 2868 H=2868:00 +CPU= 28.045
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002868
  13:33:44 STEP 2869 H=2869:00 +CPU= 16.860
  13:34:03 STEP 2870 H=2870:00 +CPU= 17.395
  13:34:30 STEP 2871 H=2871:00 +CPU= 25.706
  13:34:49 STEP 2872 H=2872:00 +CPU= 17.229
  13:35:07 STEP 2873 H=2873:00 +CPU= 16.948
  13:35:35 STEP 2874 H=2874:00 +CPU= 26.297
  13:35:53 STEP 2875 H=2875:00 +CPU= 16.687
  13:36:11 STEP 2876 H=2876:00 +CPU= 17.424
  13:36:39 STEP 2877 H=2877:00 +CPU= 25.804
  13:36:58 STEP 2878 H=2878:00 +CPU= 17.221
  13:37:17 STEP 2879 H=2879:00 +CPU= 17.658
  13:37:50 STEP 2880 H=2880:00 +CPU= 30.112
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:38:08 STEP 2881 H=2881:00 +CPU= 16.739
  13:38:27 STEP 2882 H=2882:00 +CPU= 17.284
  13:38:55 STEP 2883 H=2883:00 +CPU= 25.864
  13:39:13 STEP 2884 H=2884:00 +CPU= 17.132
  13:39:31 STEP 2885 H=2885:00 +CPU= 16.966
  13:40:00 STEP 2886 H=2886:00 +CPU= 26.221
  13:40:18 STEP 2887 H=2887:00 +CPU= 16.783
  13:40:37 STEP 2888 H=2888:00 +CPU= 17.358
  13:41:05 STEP 2889 H=2889:00 +CPU= 25.679
  13:41:24 STEP 2890 H=2890:00 +CPU= 17.345
  13:41:41 STEP 2891 H=2891:00 +CPU= 16.805
  13:42:12 STEP 2892 H=2892:00 +CPU= 28.089
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002892
  13:42:30 STEP 2893 H=2893:00 +CPU= 16.969
  13:42:48 STEP 2894 H=2894:00 +CPU= 17.377
  13:43:16 STEP 2895 H=2895:00 +CPU= 25.718
  13:43:35 STEP 2896 H=2896:00 +CPU= 17.332
  13:43:53 STEP 2897 H=2897:00 +CPU= 16.898
  13:44:21 STEP 2898 H=2898:00 +CPU= 26.047
  13:44:40 STEP 2899 H=2899:00 +CPU= 16.917
  13:44:58 STEP 2900 H=2900:00 +CPU= 17.412
  13:45:26 STEP 2901 H=2901:00 +CPU= 25.711
  13:45:45 STEP 2902 H=2902:00 +CPU= 17.378
  13:46:03 STEP 2903 H=2903:00 +CPU= 17.381
  13:46:36 STEP 2904 H=2904:00 +CPU= 29.971
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_120.zip
Uploading the intermediate file: upload_file_120.zip
  13:46:54 STEP 2905 H=2905:00 +CPU= 16.902
  13:47:13 STEP 2906 H=2906:00 +CPU= 17.411
  13:47:41 STEP 2907 H=2907:00 +CPU= 25.652
  13:48:00 STEP 2908 H=2908:00 +CPU= 17.357
  13:48:18 STEP 2909 H=2909:00 +CPU= 16.756
  13:48:46 STEP 2910 H=2910:00 +CPU= 26.008
  13:49:04 STEP 2911 H=2911:00 +CPU= 16.857
  13:49:22 STEP 2912 H=2912:00 +CPU= 17.229
  13:49:50 STEP 2913 H=2913:00 +CPU= 25.575
  13:50:09 STEP 2914 H=2914:00 +CPU= 17.255
  13:50:26 STEP 2915 H=2915:00 +CPU= 16.844
  13:50:57 STEP 2916 H=2916:00 +CPU= 27.959
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002916
  13:51:15 STEP 2917 H=2917:00 +CPU= 16.976
  13:51:33 STEP 2918 H=2918:00 +CPU= 17.308
  13:52:01 STEP 2919 H=2919:00 +CPU= 25.623
  13:52:19 STEP 2920 H=2920:00 +CPU= 17.229
  13:52:37 STEP 2921 H=2921:00 +CPU= 16.772
  13:53:06 STEP 2922 H=2922:00 +CPU= 26.119
  13:53:23 STEP 2923 H=2923:00 +CPU= 16.721
  13:53:42 STEP 2924 H=2924:00 +CPU= 17.254
  13:54:10 STEP 2925 H=2925:00 +CPU= 25.633
  13:54:28 STEP 2926 H=2926:00 +CPU= 17.105
  13:54:47 STEP 2927 H=2927:00 +CPU= 17.500
  13:55:19 STEP 2928 H=2928:00 +CPU= 29.995
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_121.zip
Uploading the intermediate file: upload_file_121.zip
  13:55:37 STEP 2929 H=2929:00 +CPU= 16.610
  13:55:56 STEP 2930 H=2930:00 +CPU= 17.312
  13:56:23 STEP 2931 H=2931:00 +CPU= 25.637
  13:56:41 STEP 2932 H=2932:00 +CPU= 17.126
  13:57:00 STEP 2933 H=2933:00 +CPU= 16.900
  13:57:28 STEP 2934 H=2934:00 +CPU= 26.163
  13:57:46 STEP 2935 H=2935:00 +CPU= 16.710
  13:58:05 STEP 2936 H=2936:00 +CPU= 17.266
  13:58:32 STEP 2937 H=2937:00 +CPU= 25.676
  13:58:51 STEP 2938 H=2938:00 +CPU= 17.122
  13:59:09 STEP 2939 H=2939:00 +CPU= 16.830
  13:59:39 STEP 2940 H=2940:00 +CPU= 28.090
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002940
  13:59:57 STEP 2941 H=2941:00 +CPU= 16.654
  14:00:16 STEP 2942 H=2942:00 +CPU= 17.340
  14:00:43 STEP 2943 H=2943:00 +CPU= 25.771
  14:01:02 STEP 2944 H=2944:00 +CPU= 17.127
  14:01:20 STEP 2945 H=2945:00 +CPU= 16.785
  14:01:48 STEP 2946 H=2946:00 +CPU= 26.166
  14:02:06 STEP 2947 H=2947:00 +CPU= 16.631
  14:02:24 STEP 2948 H=2948:00 +CPU= 17.161
  14:02:52 STEP 2949 H=2949:00 +CPU= 25.611
  14:03:11 STEP 2950 H=2950:00 +CPU= 17.183
  14:03:29 STEP 2951 H=2951:00 +CPU= 17.335
  14:03:59 STEP 2952 H=2952:00 +CPU= 27.685
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.260318722649E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.48989191816039E-02 -1.72994898449055E+00  1.89761310057317E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.19100742094750     
  MAXGPFV : MAX. VALUE =   0.749284613184142     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    343761050 BYTES IN      8 RECORDS TRANSFERRED IN    0.0004 SECONDS859402.6 Mbytes/s, TOTAL TIME=    0.0075( 5.3%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 14:03:59 STEP 2952 H=2952:00 +CPU= 27.685
 END CNT3
 NSTEP =  2952 CNT0   000000000  23.562  23.562  25.038   0.941               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           35/   804992476 WRITTEN        13055/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    318    0       35       786125    13055 ************    55.2     3.0    52.2     3.5    82.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  911    2084.3    2084.3     10.99      0.00
   9 SPCM     - SPECTRAL COMP.                     840     333.4     333.4      1.62      0.00
  10 SCAN2M - PHYSICS                              841    8272.9    8272.9     40.25      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 70    1158.6    1158.6      0.47      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 36      12.4      12.4      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      281    8710.8    8710.8     14.16      0.00
  17 GRIDFPOS IN CNT4                               70      35.0      35.0      0.01      0.00
  27 RESTART FILES - WRITING                        35    2317.2    2317.2      0.47      0.00
  28 RESTART FILES - READING                         1    3848.0    3848.0      0.02      0.00
  29 SU4FPOS IN CNT4                                70       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                70    1672.2    1672.2      0.68      0.00
  31 POSDDH IN STEPO                                 4       1.5       1.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    841    3002.3    3002.3     14.61      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL           841    2089.9    2089.9     10.17      0.00
  39 SU0YOMB                                         1     206.3     206.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    841      19.7      19.7      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              840     293.4     293.4      1.43      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              840      54.8      54.8      0.27      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 36       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2876     115.9     115.9      1.93      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1750     110.9     110.9      1.12      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1750      46.3      46.3      0.47      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2876      38.8      38.8      0.65      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      12.6      12.6      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2876      21.1      21.1      0.35      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1750      18.2      18.2      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2876      18.8      18.8      0.31      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1750      12.4      12.4      0.13      0.00
 400 GSTATS                                     168230       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                161072       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    17284.6 CPU TIME   16295.1 VECTOR TIME    16295.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      615.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/0/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/0/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213498/ICMUAhnw4+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_001o_2019110100_123_993_12213498_0_r2117752193_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
14:07:22 (4573): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:42 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 10,623,600 55,290 0.0052
09 May 2023 16:53:39 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 10,195,200 52,876 0.0052
09 May 2023 16:53:36 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 9,331,200 48,204 0.0052
09 May 2023 16:53:34 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 8,467,200 43,613 0.0052
09 May 2023 16:52:54 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 6,912,000 35,040 0.0051
09 May 2023 16:52:52 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 6,048,000 30,683 0.0051
09 May 2023 16:52:49 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 5,184,000 26,330 0.0051
09 May 2023 16:52:45 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 4,320,000 21,915 0.0051
09 May 2023 16:52:43 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 3,456,000 17,428 0.0050
09 May 2023 16:52:41 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 2,592,000 12,979 0.0050
09 May 2023 16:52:39 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 1,728,000 8,546 0.0049
09 May 2023 16:52:38 1527784 22314844 oifs_43r3_001o_2019110100_123_993_12213498_0 864,000 4,250 0.0049


©2024 climateprediction.net