climateprediction.net home page
Task 22315046

Task 22315046

Name oifs_43r3_007a_2019110100_123_993_12213700_0
Workunit 12213700
Created 24 Feb 2023, 12:24:04 UTC
Sent 24 Feb 2023, 21:02:08 UTC
Report deadline 25 Apr 2023, 21:02:08 UTC
Received 26 Feb 2023, 2:53:16 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1469580
Run time 18 hours 18 min 11 sec
CPU time 18 hours 18 min 11 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.30 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,420.32 MB
Peak swap size 4,984.18 MB
Peak disk usage 1,752.45 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
7
  00:21:57 STEP 2373 H=2373:00 +CPU= 25.177
  00:22:14 STEP 2374 H=2374:00 +CPU= 16.668
  00:22:31 STEP 2375 H=2375:00 +CPU= 16.944
  00:23:01 STEP 2376 H=2376:00 +CPU= 29.765
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002376
  00:23:17 STEP 2377 H=2377:00 +CPU= 15.998
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002376
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_98.zip
Uploading the intermediate file: upload_file_98.zip
  00:23:33 STEP 2378 H=2378:00 +CPU= 16.648
  00:23:58 STEP 2379 H=2379:00 +CPU= 25.237
  00:24:15 STEP 2380 H=2380:00 +CPU= 16.461
  00:24:31 STEP 2381 H=2381:00 +CPU= 16.333
  00:24:57 STEP 2382 H=2382:00 +CPU= 25.604
  00:25:13 STEP 2383 H=2383:00 +CPU= 16.403
  00:25:30 STEP 2384 H=2384:00 +CPU= 16.789
  00:25:55 STEP 2385 H=2385:00 +CPU= 25.276
  00:26:12 STEP 2386 H=2386:00 +CPU= 16.743
  00:26:28 STEP 2387 H=2387:00 +CPU= 16.195
  00:26:56 STEP 2388 H=2388:00 +CPU= 27.664
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002388
  00:27:12 STEP 2389 H=2389:00 +CPU= 16.182
  00:27:29 STEP 2390 H=2390:00 +CPU= 16.668
  00:27:54 STEP 2391 H=2391:00 +CPU= 25.176
  00:28:11 STEP 2392 H=2392:00 +CPU= 16.745
  00:28:27 STEP 2393 H=2393:00 +CPU= 16.378
  00:28:53 STEP 2394 H=2394:00 +CPU= 25.693
  00:29:09 STEP 2395 H=2395:00 +CPU= 16.149
  00:29:26 STEP 2396 H=2396:00 +CPU= 16.702
  00:29:51 STEP 2397 H=2397:00 +CPU= 25.285
  00:30:08 STEP 2398 H=2398:00 +CPU= 16.855
  00:30:25 STEP 2399 H=2399:00 +CPU= 16.629
  00:30:54 STEP 2400 H=2400:00 +CPU= 29.196
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002400
  00:31:10 STEP 2401 H=2401:00 +CPU= 16.109
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002400
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_99.zip
Uploading the intermediate file: upload_file_99.zip
  00:31:27 STEP 2402 H=2402:00 +CPU= 16.641
  00:31:52 STEP 2403 H=2403:00 +CPU= 25.172
  00:32:08 STEP 2404 H=2404:00 +CPU= 16.355
  00:32:25 STEP 2405 H=2405:00 +CPU= 16.293
  00:32:50 STEP 2406 H=2406:00 +CPU= 25.575
  00:33:06 STEP 2407 H=2407:00 +CPU= 15.983
  00:33:23 STEP 2408 H=2408:00 +CPU= 17.000
  00:33:49 STEP 2409 H=2409:00 +CPU= 25.126
  00:34:05 STEP 2410 H=2410:00 +CPU= 16.755
  00:34:22 STEP 2411 H=2411:00 +CPU= 16.361
  00:34:49 STEP 2412 H=2412:00 +CPU= 27.350
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002412
  00:35:05 STEP 2413 H=2413:00 +CPU= 16.360
  00:35:22 STEP 2414 H=2414:00 +CPU= 16.691
  00:35:47 STEP 2415 H=2415:00 +CPU= 25.193
  00:36:04 STEP 2416 H=2416:00 +CPU= 16.993
  00:36:21 STEP 2417 H=2417:00 +CPU= 16.515
  00:36:47 STEP 2418 H=2418:00 +CPU= 25.730
  00:37:03 STEP 2419 H=2419:00 +CPU= 16.144
  00:37:20 STEP 2420 H=2420:00 +CPU= 16.820
  00:37:45 STEP 2421 H=2421:00 +CPU= 25.027
  00:38:02 STEP 2422 H=2422:00 +CPU= 16.808
  00:38:18 STEP 2423 H=2423:00 +CPU= 16.439
  00:38:48 STEP 2424 H=2424:00 +CPU= 29.618
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002424
  00:39:04 STEP 2425 H=2425:00 +CPU= 16.032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002424
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_100.zip
Uploading the intermediate file: upload_file_100.zip
  00:39:20 STEP 2426 H=2426:00 +CPU= 16.483
  00:39:45 STEP 2427 H=2427:00 +CPU= 25.079
  00:40:02 STEP 2428 H=2428:00 +CPU= 16.650
  00:40:18 STEP 2429 H=2429:00 +CPU= 16.325
  00:40:44 STEP 2430 H=2430:00 +CPU= 25.817
  00:41:01 STEP 2431 H=2431:00 +CPU= 16.534
  00:41:17 STEP 2432 H=2432:00 +CPU= 16.508
  00:41:43 STEP 2433 H=2433:00 +CPU= 25.301
  00:41:59 STEP 2434 H=2434:00 +CPU= 16.653
  00:42:15 STEP 2435 H=2435:00 +CPU= 15.959
  00:42:43 STEP 2436 H=2436:00 +CPU= 27.550
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002436
  00:42:59 STEP 2437 H=2437:00 +CPU= 16.290
  00:43:15 STEP 2438 H=2438:00 +CPU= 16.401
  00:43:41 STEP 2439 H=2439:00 +CPU= 25.193
  00:43:58 STEP 2440 H=2440:00 +CPU= 16.918
  00:44:14 STEP 2441 H=2441:00 +CPU= 15.906
  00:44:39 STEP 2442 H=2442:00 +CPU= 25.719
  00:44:55 STEP 2443 H=2443:00 +CPU= 16.216
  00:45:12 STEP 2444 H=2444:00 +CPU= 16.703
  00:45:37 STEP 2445 H=2445:00 +CPU= 25.075
  00:45:54 STEP 2446 H=2446:00 +CPU= 16.713
  00:46:11 STEP 2447 H=2447:00 +CPU= 16.964
  00:46:47 STEP 2448 H=2448:00 +CPU= 29.644
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002448
  00:47:03 STEP 2449 H=2449:00 +CPU= 16.040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002448
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_101.zip
Uploading the intermediate file: upload_file_101.zip
  00:47:20 STEP 2450 H=2450:00 +CPU= 16.663
Uploading trickle at timestep: 8816400
  00:47:45 STEP 2451 H=2451:00 +CPU= 25.021
  00:48:02 STEP 2452 H=2452:00 +CPU= 16.742
  00:48:18 STEP 2453 H=2453:00 +CPU= 16.209
  00:48:44 STEP 2454 H=2454:00 +CPU= 25.645
  00:49:00 STEP 2455 H=2455:00 +CPU= 16.226
  00:49:16 STEP 2456 H=2456:00 +CPU= 16.637
  00:49:42 STEP 2457 H=2457:00 +CPU= 25.255
  00:49:58 STEP 2458 H=2458:00 +CPU= 16.646
  00:50:15 STEP 2459 H=2459:00 +CPU= 16.362
  00:50:43 STEP 2460 H=2460:00 +CPU= 27.930
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002460
  00:50:59 STEP 2461 H=2461:00 +CPU= 16.305
  00:51:16 STEP 2462 H=2462:00 +CPU= 16.752
  00:51:41 STEP 2463 H=2463:00 +CPU= 25.404
  00:51:58 STEP 2464 H=2464:00 +CPU= 17.029
  00:52:15 STEP 2465 H=2465:00 +CPU= 16.381
  00:52:41 STEP 2466 H=2466:00 +CPU= 25.865
  00:52:57 STEP 2467 H=2467:00 +CPU= 16.109
  00:53:13 STEP 2468 H=2468:00 +CPU= 16.702
  00:53:39 STEP 2469 H=2469:00 +CPU= 25.277
  00:53:56 STEP 2470 H=2470:00 +CPU= 16.786
  00:54:12 STEP 2471 H=2471:00 +CPU= 16.902
  00:54:42 STEP 2472 H=2472:00 +CPU= 29.404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002472
  00:54:58 STEP 2473 H=2473:00 +CPU= 16.213
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002472
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_102.zip
Uploading the intermediate file: upload_file_102.zip
  00:55:15 STEP 2474 H=2474:00 +CPU= 16.736
  00:55:40 STEP 2475 H=2475:00 +CPU= 25.256
  00:55:57 STEP 2476 H=2476:00 +CPU= 16.683
  00:56:13 STEP 2477 H=2477:00 +CPU= 16.218
  00:56:39 STEP 2478 H=2478:00 +CPU= 25.798
  00:56:55 STEP 2479 H=2479:00 +CPU= 16.154
  00:57:12 STEP 2480 H=2480:00 +CPU= 16.794
  00:57:37 STEP 2481 H=2481:00 +CPU= 25.281
  00:57:54 STEP 2482 H=2482:00 +CPU= 16.862
  00:58:10 STEP 2483 H=2483:00 +CPU= 16.417
  00:58:38 STEP 2484 H=2484:00 +CPU= 27.434
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002484
  00:58:54 STEP 2485 H=2485:00 +CPU= 16.310
  00:59:11 STEP 2486 H=2486:00 +CPU= 16.728
  00:59:36 STEP 2487 H=2487:00 +CPU= 25.304
  00:59:53 STEP 2488 H=2488:00 +CPU= 16.613
  01:00:09 STEP 2489 H=2489:00 +CPU= 16.439
  01:00:35 STEP 2490 H=2490:00 +CPU= 25.795
  01:00:51 STEP 2491 H=2491:00 +CPU= 16.232
  01:01:08 STEP 2492 H=2492:00 +CPU= 16.551
  01:01:33 STEP 2493 H=2493:00 +CPU= 25.080
  01:01:50 STEP 2494 H=2494:00 +CPU= 16.683
  01:02:10 STEP 2495 H=2495:00 +CPU= 16.742
  01:02:40 STEP 2496 H=2496:00 +CPU= 29.397
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002496
  01:02:56 STEP 2497 H=2497:00 +CPU= 16.492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002496
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_103.zip
Uploading the intermediate file: upload_file_103.zip
  01:03:13 STEP 2498 H=2498:00 +CPU= 16.678
  01:03:38 STEP 2499 H=2499:00 +CPU= 24.975
  01:03:54 STEP 2500 H=2500:00 +CPU= 16.570
  01:04:11 STEP 2501 H=2501:00 +CPU= 16.147
  01:04:36 STEP 2502 H=2502:00 +CPU= 25.584
  01:04:52 STEP 2503 H=2503:00 +CPU= 16.219
  01:05:09 STEP 2504 H=2504:00 +CPU= 16.711
  01:05:35 STEP 2505 H=2505:00 +CPU= 25.335
  01:05:50 STEP 2506 H=2506:00 +CPU= 15.484
  01:06:05 STEP 2507 H=2507:00 +CPU= 15.064
  01:06:32 STEP 2508 H=2508:00 +CPU= 27.224
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002508
  01:06:48 STEP 2509 H=2509:00 +CPU= 15.258
  01:07:04 STEP 2510 H=2510:00 +CPU= 16.265
  01:07:28 STEP 2511 H=2511:00 +CPU= 24.491
  01:07:45 STEP 2512 H=2512:00 +CPU= 16.529
  01:08:01 STEP 2513 H=2513:00 +CPU= 15.927
  01:08:25 STEP 2514 H=2514:00 +CPU= 23.933
  01:08:40 STEP 2515 H=2515:00 +CPU= 15.062
  01:08:56 STEP 2516 H=2516:00 +CPU= 16.365
  01:09:21 STEP 2517 H=2517:00 +CPU= 25.095
  01:09:38 STEP 2518 H=2518:00 +CPU= 16.733
  01:09:55 STEP 2519 H=2519:00 +CPU= 16.570
  01:10:24 STEP 2520 H=2520:00 +CPU= 29.649
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002520
  01:10:41 STEP 2521 H=2521:00 +CPU= 16.355
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002520
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_104.zip
Uploading the intermediate file: upload_file_104.zip
  01:10:57 STEP 2522 H=2522:00 +CPU= 16.713
  01:11:23 STEP 2523 H=2523:00 +CPU= 25.142
  01:11:39 STEP 2524 H=2524:00 +CPU= 16.675
  01:11:56 STEP 2525 H=2525:00 +CPU= 16.196
  01:12:21 STEP 2526 H=2526:00 +CPU= 25.682
  01:12:38 STEP 2527 H=2527:00 +CPU= 16.338
  01:12:54 STEP 2528 H=2528:00 +CPU= 16.613
  01:13:20 STEP 2529 H=2529:00 +CPU= 25.379
  01:13:36 STEP 2530 H=2530:00 +CPU= 16.720
  01:13:52 STEP 2531 H=2531:00 +CPU= 16.049
  01:14:20 STEP 2532 H=2532:00 +CPU= 27.783
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002532
  01:14:36 STEP 2533 H=2533:00 +CPU= 16.240
  01:14:53 STEP 2534 H=2534:00 +CPU= 16.632
  01:15:19 STEP 2535 H=2535:00 +CPU= 25.513
  01:15:35 STEP 2536 H=2536:00 +CPU= 16.718
  01:15:52 STEP 2537 H=2537:00 +CPU= 16.236
  01:16:17 STEP 2538 H=2538:00 +CPU= 25.583
  01:16:33 STEP 2539 H=2539:00 +CPU= 16.265
  01:16:50 STEP 2540 H=2540:00 +CPU= 16.626
  01:17:16 STEP 2541 H=2541:00 +CPU= 24.991
  01:17:33 STEP 2542 H=2542:00 +CPU= 16.892
  01:17:50 STEP 2543 H=2543:00 +CPU= 16.599
  01:18:22 STEP 2544 H=2544:00 +CPU= 29.650
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002544
  01:18:39 STEP 2545 H=2545:00 +CPU= 16.241
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002544
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_105.zip
Uploading the intermediate file: upload_file_105.zip
  01:18:55 STEP 2546 H=2546:00 +CPU= 16.655
  01:19:21 STEP 2547 H=2547:00 +CPU= 25.394
  01:19:37 STEP 2548 H=2548:00 +CPU= 16.645
  01:19:53 STEP 2549 H=2549:00 +CPU= 16.149
  01:20:19 STEP 2550 H=2550:00 +CPU= 25.684
  01:20:35 STEP 2551 H=2551:00 +CPU= 16.249
  01:20:52 STEP 2552 H=2552:00 +CPU= 16.570
  01:21:17 STEP 2553 H=2553:00 +CPU= 25.250
  01:21:34 STEP 2554 H=2554:00 +CPU= 16.744
  01:21:50 STEP 2555 H=2555:00 +CPU= 16.375
  01:22:18 STEP 2556 H=2556:00 +CPU= 27.661
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002556
  01:22:35 STEP 2557 H=2557:00 +CPU= 16.615
  01:22:51 STEP 2558 H=2558:00 +CPU= 16.813
  01:23:17 STEP 2559 H=2559:00 +CPU= 25.285
  01:23:34 STEP 2560 H=2560:00 +CPU= 16.864
  01:23:50 STEP 2561 H=2561:00 +CPU= 16.464
  01:24:16 STEP 2562 H=2562:00 +CPU= 25.697
  01:24:32 STEP 2563 H=2563:00 +CPU= 16.373
  01:24:49 STEP 2564 H=2564:00 +CPU= 16.845
  01:25:14 STEP 2565 H=2565:00 +CPU= 25.361
  01:25:31 STEP 2566 H=2566:00 +CPU= 16.731
  01:25:48 STEP 2567 H=2567:00 +CPU= 16.652
  01:26:20 STEP 2568 H=2568:00 +CPU= 29.821
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002568
  01:26:37 STEP 2569 H=2569:00 +CPU= 16.436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002568
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_106.zip
Uploading the intermediate file: upload_file_106.zip
  01:26:53 STEP 2570 H=2570:00 +CPU= 16.384
  01:27:18 STEP 2571 H=2571:00 +CPU= 25.308
  01:27:35 STEP 2572 H=2572:00 +CPU= 16.865
  01:27:51 STEP 2573 H=2573:00 +CPU= 16.314
  01:28:17 STEP 2574 H=2574:00 +CPU= 25.635
  01:28:33 STEP 2575 H=2575:00 +CPU= 16.350
  01:28:50 STEP 2576 H=2576:00 +CPU= 16.760
  01:29:15 STEP 2577 H=2577:00 +CPU= 25.300
  01:29:32 STEP 2578 H=2578:00 +CPU= 16.890
  01:29:49 STEP 2579 H=2579:00 +CPU= 16.191
  01:30:16 STEP 2580 H=2580:00 +CPU= 27.857
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002580
  01:30:33 STEP 2581 H=2581:00 +CPU= 16.351
  01:30:50 STEP 2582 H=2582:00 +CPU= 16.752
  01:31:15 STEP 2583 H=2583:00 +CPU= 25.398
  01:31:32 STEP 2584 H=2584:00 +CPU= 16.863
  01:31:48 STEP 2585 H=2585:00 +CPU= 16.404
  01:32:14 STEP 2586 H=2586:00 +CPU= 25.628
  01:32:30 STEP 2587 H=2587:00 +CPU= 16.477
  01:32:47 STEP 2588 H=2588:00 +CPU= 16.676
  01:33:12 STEP 2589 H=2589:00 +CPU= 25.262
  01:33:29 STEP 2590 H=2590:00 +CPU= 16.826
  01:33:46 STEP 2591 H=2591:00 +CPU= 16.887
  01:34:16 STEP 2592 H=2592:00 +CPU= 29.251
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002592
  01:34:32 STEP 2593 H=2593:00 +CPU= 16.321
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002592
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_107.zip
Uploading the intermediate file: upload_file_107.zip
  01:34:49 STEP 2594 H=2594:00 +CPU= 16.765
  01:35:14 STEP 2595 H=2595:00 +CPU= 25.564
  01:35:31 STEP 2596 H=2596:00 +CPU= 16.618
  01:35:47 STEP 2597 H=2597:00 +CPU= 16.121
  01:36:13 STEP 2598 H=2598:00 +CPU= 25.622
  01:36:29 STEP 2599 H=2599:00 +CPU= 16.259
  01:36:46 STEP 2600 H=2600:00 +CPU= 16.674
  01:37:11 STEP 2601 H=2601:00 +CPU= 25.388
  01:37:28 STEP 2602 H=2602:00 +CPU= 16.644
  01:37:44 STEP 2603 H=2603:00 +CPU= 16.245
  01:38:12 STEP 2604 H=2604:00 +CPU= 27.897
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002604
  01:38:28 STEP 2605 H=2605:00 +CPU= 16.330
  01:38:45 STEP 2606 H=2606:00 +CPU= 16.877
  01:39:11 STEP 2607 H=2607:00 +CPU= 25.504
  01:39:27 STEP 2608 H=2608:00 +CPU= 16.775
  01:39:44 STEP 2609 H=2609:00 +CPU= 16.212
  01:40:09 STEP 2610 H=2610:00 +CPU= 25.747
  01:40:26 STEP 2611 H=2611:00 +CPU= 16.285
  01:40:42 STEP 2612 H=2612:00 +CPU= 16.775
  01:41:08 STEP 2613 H=2613:00 +CPU= 25.231
  01:41:24 STEP 2614 H=2614:00 +CPU= 16.679
  01:41:41 STEP 2615 H=2615:00 +CPU= 16.628
  01:42:11 STEP 2616 H=2616:00 +CPU= 29.439
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002616
  01:42:27 STEP 2617 H=2617:00 +CPU= 16.245
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002616
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_108.zip
Uploading the intermediate file: upload_file_108.zip
  01:42:44 STEP 2618 H=2618:00 +CPU= 16.752
  01:43:09 STEP 2619 H=2619:00 +CPU= 25.085
  01:43:25 STEP 2620 H=2620:00 +CPU= 16.698
  01:43:42 STEP 2621 H=2621:00 +CPU= 16.394
  01:44:08 STEP 2622 H=2622:00 +CPU= 25.960
  01:44:24 STEP 2623 H=2623:00 +CPU= 16.272
  01:44:41 STEP 2624 H=2624:00 +CPU= 16.606
  01:45:06 STEP 2625 H=2625:00 +CPU= 25.436
  01:45:23 STEP 2626 H=2626:00 +CPU= 16.728
  01:45:39 STEP 2627 H=2627:00 +CPU= 16.197
  01:46:06 STEP 2628 H=2628:00 +CPU= 27.324
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002628
  01:46:23 STEP 2629 H=2629:00 +CPU= 16.511
  01:46:40 STEP 2630 H=2630:00 +CPU= 16.900
  01:47:05 STEP 2631 H=2631:00 +CPU= 25.315
  01:47:22 STEP 2632 H=2632:00 +CPU= 16.811
  01:47:38 STEP 2633 H=2633:00 +CPU= 16.369
  01:48:04 STEP 2634 H=2634:00 +CPU= 25.667
  01:48:21 STEP 2635 H=2635:00 +CPU= 16.563
  01:48:38 STEP 2636 H=2636:00 +CPU= 16.869
  01:49:03 STEP 2637 H=2637:00 +CPU= 25.175
  01:49:20 STEP 2638 H=2638:00 +CPU= 16.755
  01:49:36 STEP 2639 H=2639:00 +CPU= 16.467
  01:50:06 STEP 2640 H=2640:00 +CPU= 29.859
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002640
  01:50:22 STEP 2641 H=2641:00 +CPU= 16.508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002640
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_109.zip
Uploading the intermediate file: upload_file_109.zip
  01:50:39 STEP 2642 H=2642:00 +CPU= 16.807
  01:51:05 STEP 2643 H=2643:00 +CPU= 25.644
  01:51:22 STEP 2644 H=2644:00 +CPU= 16.937
  01:51:38 STEP 2645 H=2645:00 +CPU= 16.253
  01:52:04 STEP 2646 H=2646:00 +CPU= 25.991
  01:52:20 STEP 2647 H=2647:00 +CPU= 16.289
  01:52:37 STEP 2648 H=2648:00 +CPU= 16.641
  01:53:03 STEP 2649 H=2649:00 +CPU= 25.595
  01:53:19 STEP 2650 H=2650:00 +CPU= 16.757
  01:53:36 STEP 2651 H=2651:00 +CPU= 16.331
  01:54:03 STEP 2652 H=2652:00 +CPU= 27.458
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002652
  01:54:20 STEP 2653 H=2653:00 +CPU= 16.561
  01:54:37 STEP 2654 H=2654:00 +CPU= 16.680
  01:55:02 STEP 2655 H=2655:00 +CPU= 25.218
  01:55:19 STEP 2656 H=2656:00 +CPU= 16.943
  01:55:35 STEP 2657 H=2657:00 +CPU= 16.440
  01:56:01 STEP 2658 H=2658:00 +CPU= 25.573
  01:56:17 STEP 2659 H=2659:00 +CPU= 16.237
  01:56:34 STEP 2660 H=2660:00 +CPU= 16.809
  01:56:59 STEP 2661 H=2661:00 +CPU= 25.208
  01:57:16 STEP 2662 H=2662:00 +CPU= 16.687
  01:57:33 STEP 2663 H=2663:00 +CPU= 16.662
  01:58:02 STEP 2664 H=2664:00 +CPU= 29.692
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002664
  01:58:19 STEP 2665 H=2665:00 +CPU= 16.261
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002664
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_110.zip
Uploading the intermediate file: upload_file_110.zip
  01:58:35 STEP 2666 H=2666:00 +CPU= 16.435
  01:59:00 STEP 2667 H=2667:00 +CPU= 25.364
  01:59:17 STEP 2668 H=2668:00 +CPU= 16.971
  01:59:34 STEP 2669 H=2669:00 +CPU= 16.213
  01:59:59 STEP 2670 H=2670:00 +CPU= 25.860
  02:00:16 STEP 2671 H=2671:00 +CPU= 16.406
  02:00:32 STEP 2672 H=2672:00 +CPU= 16.553
  02:00:58 STEP 2673 H=2673:00 +CPU= 25.358
  02:01:15 STEP 2674 H=2674:00 +CPU= 16.720
  02:01:31 STEP 2675 H=2675:00 +CPU= 16.121
  02:01:58 STEP 2676 H=2676:00 +CPU= 27.696
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002676
  02:02:15 STEP 2677 H=2677:00 +CPU= 16.432
  02:02:32 STEP 2678 H=2678:00 +CPU= 16.737
  02:02:57 STEP 2679 H=2679:00 +CPU= 25.446
  02:03:14 STEP 2680 H=2680:00 +CPU= 16.810
  02:03:30 STEP 2681 H=2681:00 +CPU= 16.207
  02:03:56 STEP 2682 H=2682:00 +CPU= 25.609
  02:04:12 STEP 2683 H=2683:00 +CPU= 16.305
  02:04:29 STEP 2684 H=2684:00 +CPU= 16.942
  02:04:54 STEP 2685 H=2685:00 +CPU= 25.254
  02:05:11 STEP 2686 H=2686:00 +CPU= 17.122
  02:05:28 STEP 2687 H=2687:00 +CPU= 16.835
  02:05:57 STEP 2688 H=2688:00 +CPU= 28.701
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002688
  02:06:13 STEP 2689 H=2689:00 +CPU= 16.211
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002688
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_111.zip
Uploading the intermediate file: upload_file_111.zip
  02:06:30 STEP 2690 H=2690:00 +CPU= 16.629
Uploading trickle at timestep: 9680400
  02:06:55 STEP 2691 H=2691:00 +CPU= 25.115
  02:07:12 STEP 2692 H=2692:00 +CPU= 16.651
  02:07:28 STEP 2693 H=2693:00 +CPU= 16.218
  02:07:53 STEP 2694 H=2694:00 +CPU= 25.406
  02:08:10 STEP 2695 H=2695:00 +CPU= 16.212
  02:08:26 STEP 2696 H=2696:00 +CPU= 16.695
  02:08:51 STEP 2697 H=2697:00 +CPU= 24.966
  02:09:08 STEP 2698 H=2698:00 +CPU= 16.668
  02:09:24 STEP 2699 H=2699:00 +CPU= 16.304
  02:09:51 STEP 2700 H=2700:00 +CPU= 27.288
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002700
  02:10:08 STEP 2701 H=2701:00 +CPU= 16.377
  02:10:25 STEP 2702 H=2702:00 +CPU= 16.905
  02:10:50 STEP 2703 H=2703:00 +CPU= 25.019
  02:11:07 STEP 2704 H=2704:00 +CPU= 16.897
  02:11:23 STEP 2705 H=2705:00 +CPU= 16.320
  02:11:49 STEP 2706 H=2706:00 +CPU= 25.779
  02:12:05 STEP 2707 H=2707:00 +CPU= 16.502
  02:12:22 STEP 2708 H=2708:00 +CPU= 16.887
  02:12:48 STEP 2709 H=2709:00 +CPU= 25.486
  02:13:05 STEP 2710 H=2710:00 +CPU= 17.083
  02:13:22 STEP 2711 H=2711:00 +CPU= 16.788
  02:13:53 STEP 2712 H=2712:00 +CPU= 29.340
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002712
  02:14:09 STEP 2713 H=2713:00 +CPU= 16.256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002712
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_112.zip
Uploading the intermediate file: upload_file_112.zip
  02:14:26 STEP 2714 H=2714:00 +CPU= 16.533
  02:14:51 STEP 2715 H=2715:00 +CPU= 24.963
  02:15:07 STEP 2716 H=2716:00 +CPU= 16.716
  02:15:24 STEP 2717 H=2717:00 +CPU= 16.246
  02:15:49 STEP 2718 H=2718:00 +CPU= 25.378
  02:16:05 STEP 2719 H=2719:00 +CPU= 16.165
  02:16:22 STEP 2720 H=2720:00 +CPU= 16.654
  02:16:47 STEP 2721 H=2721:00 +CPU= 25.015
  02:17:03 STEP 2722 H=2722:00 +CPU= 16.655
  02:17:20 STEP 2723 H=2723:00 +CPU= 16.229
  02:17:47 STEP 2724 H=2724:00 +CPU= 27.258
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002724
  02:18:03 STEP 2725 H=2725:00 +CPU= 16.430
  02:18:20 STEP 2726 H=2726:00 +CPU= 16.747
  02:18:45 STEP 2727 H=2727:00 +CPU= 25.078
  02:19:02 STEP 2728 H=2728:00 +CPU= 16.781
  02:19:18 STEP 2729 H=2729:00 +CPU= 16.283
  02:19:44 STEP 2730 H=2730:00 +CPU= 25.744
  02:20:01 STEP 2731 H=2731:00 +CPU= 16.504
  02:20:17 STEP 2732 H=2732:00 +CPU= 16.878
  02:20:43 STEP 2733 H=2733:00 +CPU= 25.194
  02:20:59 STEP 2734 H=2734:00 +CPU= 16.620
  02:21:16 STEP 2735 H=2735:00 +CPU= 16.693
  02:21:46 STEP 2736 H=2736:00 +CPU= 29.640
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002736
  02:22:02 STEP 2737 H=2737:00 +CPU= 16.072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002736
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_113.zip
Uploading the intermediate file: upload_file_113.zip
  02:22:19 STEP 2738 H=2738:00 +CPU= 16.550
  02:22:44 STEP 2739 H=2739:00 +CPU= 25.087
  02:23:00 STEP 2740 H=2740:00 +CPU= 16.661
  02:23:17 STEP 2741 H=2741:00 +CPU= 16.276
  02:23:42 STEP 2742 H=2742:00 +CPU= 25.888
  02:23:59 STEP 2743 H=2743:00 +CPU= 16.492
  02:24:16 STEP 2744 H=2744:00 +CPU= 16.903
  02:24:41 STEP 2745 H=2745:00 +CPU= 25.436
  02:24:58 STEP 2746 H=2746:00 +CPU= 16.858
  02:25:15 STEP 2747 H=2747:00 +CPU= 16.625
  02:25:43 STEP 2748 H=2748:00 +CPU= 27.659
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002748
  02:25:59 STEP 2749 H=2749:00 +CPU= 16.252
  02:26:16 STEP 2750 H=2750:00 +CPU= 16.744
  02:26:41 STEP 2751 H=2751:00 +CPU= 25.301
  02:26:58 STEP 2752 H=2752:00 +CPU= 16.862
  02:27:14 STEP 2753 H=2753:00 +CPU= 16.308
  02:27:40 STEP 2754 H=2754:00 +CPU= 25.821
  02:27:56 STEP 2755 H=2755:00 +CPU= 16.525
  02:28:13 STEP 2756 H=2756:00 +CPU= 16.853
  02:28:38 STEP 2757 H=2757:00 +CPU= 25.063
  02:28:55 STEP 2758 H=2758:00 +CPU= 16.781
  02:29:12 STEP 2759 H=2759:00 +CPU= 16.788
  02:29:42 STEP 2760 H=2760:00 +CPU= 29.769
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002760
  02:29:58 STEP 2761 H=2761:00 +CPU= 16.453
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002760
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_114.zip
Uploading the intermediate file: upload_file_114.zip
  02:30:15 STEP 2762 H=2762:00 +CPU= 17.005
  02:30:41 STEP 2763 H=2763:00 +CPU= 25.306
  02:30:57 STEP 2764 H=2764:00 +CPU= 16.626
  02:31:14 STEP 2765 H=2765:00 +CPU= 16.239
  02:31:39 STEP 2766 H=2766:00 +CPU= 25.913
  02:31:56 STEP 2767 H=2767:00 +CPU= 16.536
  02:32:13 STEP 2768 H=2768:00 +CPU= 16.945
  02:32:38 STEP 2769 H=2769:00 +CPU= 25.386
  02:32:55 STEP 2770 H=2770:00 +CPU= 16.965
  02:33:12 STEP 2771 H=2771:00 +CPU= 16.503
  02:33:40 STEP 2772 H=2772:00 +CPU= 27.807
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002772
  02:33:56 STEP 2773 H=2773:00 +CPU= 16.495
  02:34:13 STEP 2774 H=2774:00 +CPU= 16.743
  02:34:38 STEP 2775 H=2775:00 +CPU= 25.113
  02:34:55 STEP 2776 H=2776:00 +CPU= 16.873
  02:35:12 STEP 2777 H=2777:00 +CPU= 16.590
  02:35:37 STEP 2778 H=2778:00 +CPU= 25.736
  02:35:54 STEP 2779 H=2779:00 +CPU= 16.503
  02:36:11 STEP 2780 H=2780:00 +CPU= 16.862
  02:36:36 STEP 2781 H=2781:00 +CPU= 25.478
  02:36:53 STEP 2782 H=2782:00 +CPU= 16.994
  02:37:10 STEP 2783 H=2783:00 +CPU= 16.909
  02:37:41 STEP 2784 H=2784:00 +CPU= 29.493
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002784
  02:37:58 STEP 2785 H=2785:00 +CPU= 16.246
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002784
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_115.zip
Uploading the intermediate file: upload_file_115.zip
  02:38:14 STEP 2786 H=2786:00 +CPU= 16.724
  02:38:40 STEP 2787 H=2787:00 +CPU= 25.283
  02:38:57 STEP 2788 H=2788:00 +CPU= 16.919
  02:39:13 STEP 2789 H=2789:00 +CPU= 16.645
  02:39:39 STEP 2790 H=2790:00 +CPU= 25.541
  02:39:55 STEP 2791 H=2791:00 +CPU= 16.552
  02:40:12 STEP 2792 H=2792:00 +CPU= 17.185
  02:40:38 STEP 2793 H=2793:00 +CPU= 25.274
  02:40:54 STEP 2794 H=2794:00 +CPU= 16.711
  02:41:11 STEP 2795 H=2795:00 +CPU= 16.307
  02:41:42 STEP 2796 H=2796:00 +CPU= 27.725
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002796
  02:41:58 STEP 2797 H=2797:00 +CPU= 16.286
  02:42:14 STEP 2798 H=2798:00 +CPU= 16.678
  02:42:40 STEP 2799 H=2799:00 +CPU= 25.375
  02:42:57 STEP 2800 H=2800:00 +CPU= 16.646
  02:43:13 STEP 2801 H=2801:00 +CPU= 16.563
  02:43:39 STEP 2802 H=2802:00 +CPU= 25.853
  02:43:55 STEP 2803 H=2803:00 +CPU= 16.547
  02:44:12 STEP 2804 H=2804:00 +CPU= 16.974
  02:44:38 STEP 2805 H=2805:00 +CPU= 25.242
  02:44:54 STEP 2806 H=2806:00 +CPU= 16.612
  02:45:11 STEP 2807 H=2807:00 +CPU= 16.859
  02:45:44 STEP 2808 H=2808:00 +CPU= 29.980
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002808
  02:46:01 STEP 2809 H=2809:00 +CPU= 16.526
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002808
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_116.zip
Uploading the intermediate file: upload_file_116.zip
  02:46:18 STEP 2810 H=2810:00 +CPU= 17.021
  02:46:43 STEP 2811 H=2811:00 +CPU= 25.496
  02:47:00 STEP 2812 H=2812:00 +CPU= 17.100
  02:47:17 STEP 2813 H=2813:00 +CPU= 16.652
  02:47:43 STEP 2814 H=2814:00 +CPU= 26.020
  02:47:59 STEP 2815 H=2815:00 +CPU= 16.495
  02:48:16 STEP 2816 H=2816:00 +CPU= 16.622
  02:48:41 STEP 2817 H=2817:00 +CPU= 25.255
  02:48:58 STEP 2818 H=2818:00 +CPU= 16.798
  02:49:17 STEP 2819 H=2819:00 +CPU= 16.689
  02:49:44 STEP 2820 H=2820:00 +CPU= 27.553
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002820
  02:50:01 STEP 2821 H=2821:00 +CPU= 16.461
  02:50:18 STEP 2822 H=2822:00 +CPU= 17.149
  02:50:43 STEP 2823 H=2823:00 +CPU= 25.448
  02:51:00 STEP 2824 H=2824:00 +CPU= 16.974
  02:51:17 STEP 2825 H=2825:00 +CPU= 16.164
  02:51:42 STEP 2826 H=2826:00 +CPU= 25.707
  02:51:59 STEP 2827 H=2827:00 +CPU= 16.630
  02:52:16 STEP 2828 H=2828:00 +CPU= 16.607
  02:52:41 STEP 2829 H=2829:00 +CPU= 25.162
  02:52:58 STEP 2830 H=2830:00 +CPU= 16.772
  02:53:14 STEP 2831 H=2831:00 +CPU= 16.760
  02:53:44 STEP 2832 H=2832:00 +CPU= 29.738
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002832
  02:54:01 STEP 2833 H=2833:00 +CPU= 16.246
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002832
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_117.zip
Uploading the intermediate file: upload_file_117.zip
  02:54:17 STEP 2834 H=2834:00 +CPU= 16.528
  02:54:42 STEP 2835 H=2835:00 +CPU= 25.155
  02:54:59 STEP 2836 H=2836:00 +CPU= 16.817
  02:55:15 STEP 2837 H=2837:00 +CPU= 16.226
  02:55:41 STEP 2838 H=2838:00 +CPU= 25.684
  02:55:57 STEP 2839 H=2839:00 +CPU= 16.348
  02:56:14 STEP 2840 H=2840:00 +CPU= 16.692
  02:56:39 STEP 2841 H=2841:00 +CPU= 25.230
  02:56:56 STEP 2842 H=2842:00 +CPU= 16.629
  02:57:12 STEP 2843 H=2843:00 +CPU= 16.366
  02:57:40 STEP 2844 H=2844:00 +CPU= 27.534
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002844
  02:57:57 STEP 2845 H=2845:00 +CPU= 16.533
  02:58:13 STEP 2846 H=2846:00 +CPU= 16.747
  02:58:39 STEP 2847 H=2847:00 +CPU= 25.304
  02:58:55 STEP 2848 H=2848:00 +CPU= 16.792
  02:59:12 STEP 2849 H=2849:00 +CPU= 16.245
  02:59:37 STEP 2850 H=2850:00 +CPU= 25.670
  02:59:54 STEP 2851 H=2851:00 +CPU= 16.237
  03:00:10 STEP 2852 H=2852:00 +CPU= 16.819
  03:00:36 STEP 2853 H=2853:00 +CPU= 25.622
  03:00:53 STEP 2854 H=2854:00 +CPU= 16.716
  03:01:10 STEP 2855 H=2855:00 +CPU= 16.741
  03:01:48 STEP 2856 H=2856:00 +CPU= 29.630
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002856
  03:02:05 STEP 2857 H=2857:00 +CPU= 16.294
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002856
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_118.zip
Uploading the intermediate file: upload_file_118.zip
  03:02:21 STEP 2858 H=2858:00 +CPU= 16.637
  03:02:47 STEP 2859 H=2859:00 +CPU= 25.284
  03:03:03 STEP 2860 H=2860:00 +CPU= 16.600
  03:03:19 STEP 2861 H=2861:00 +CPU= 16.193
  03:03:45 STEP 2862 H=2862:00 +CPU= 25.850
  03:04:02 STEP 2863 H=2863:00 +CPU= 16.298
  03:04:18 STEP 2864 H=2864:00 +CPU= 16.539
  03:04:44 STEP 2865 H=2865:00 +CPU= 25.566
  03:05:01 STEP 2866 H=2866:00 +CPU= 16.750
  03:05:17 STEP 2867 H=2867:00 +CPU= 16.297
  03:05:45 STEP 2868 H=2868:00 +CPU= 27.890
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002868
  03:06:01 STEP 2869 H=2869:00 +CPU= 16.380
  03:06:18 STEP 2870 H=2870:00 +CPU= 16.703
  03:06:43 STEP 2871 H=2871:00 +CPU= 25.375
  03:07:00 STEP 2872 H=2872:00 +CPU= 16.729
  03:07:17 STEP 2873 H=2873:00 +CPU= 16.467
  03:07:42 STEP 2874 H=2874:00 +CPU= 25.850
  03:07:59 STEP 2875 H=2875:00 +CPU= 16.437
  03:08:18 STEP 2876 H=2876:00 +CPU= 16.823
  03:08:44 STEP 2877 H=2877:00 +CPU= 25.344
  03:09:01 STEP 2878 H=2878:00 +CPU= 16.874
  03:09:18 STEP 2879 H=2879:00 +CPU= 16.946
  03:09:47 STEP 2880 H=2880:00 +CPU= 29.660
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002880
  03:10:04 STEP 2881 H=2881:00 +CPU= 16.489
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002880
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_119.zip
Uploading the intermediate file: upload_file_119.zip
  03:10:21 STEP 2882 H=2882:00 +CPU= 16.886
  03:10:46 STEP 2883 H=2883:00 +CPU= 25.371
  03:11:03 STEP 2884 H=2884:00 +CPU= 16.853
  03:11:19 STEP 2885 H=2885:00 +CPU= 16.471
  03:11:45 STEP 2886 H=2886:00 +CPU= 25.738
  03:12:01 STEP 2887 H=2887:00 +CPU= 16.237
  03:12:18 STEP 2888 H=2888:00 +CPU= 16.679
  03:12:44 STEP 2889 H=2889:00 +CPU= 25.537
  03:13:00 STEP 2890 H=2890:00 +CPU= 16.766
  03:13:17 STEP 2891 H=2891:00 +CPU= 16.343
  03:13:50 STEP 2892 H=2892:00 +CPU= 27.714
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002892
  03:14:06 STEP 2893 H=2893:00 +CPU= 15.972
  03:14:23 STEP 2894 H=2894:00 +CPU= 16.863
  03:14:48 STEP 2895 H=2895:00 +CPU= 25.546
  03:15:05 STEP 2896 H=2896:00 +CPU= 16.726
  03:15:22 STEP 2897 H=2897:00 +CPU= 16.493
  03:15:48 STEP 2898 H=2898:00 +CPU= 26.108
  03:16:04 STEP 2899 H=2899:00 +CPU= 16.304
  03:16:21 STEP 2900 H=2900:00 +CPU= 16.921
  03:16:47 STEP 2901 H=2901:00 +CPU= 25.555
  03:17:03 STEP 2902 H=2902:00 +CPU= 16.555
  03:17:20 STEP 2903 H=2903:00 +CPU= 16.785
  03:17:50 STEP 2904 H=2904:00 +CPU= 29.600
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002904
  03:18:06 STEP 2905 H=2905:00 +CPU= 16.293
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002904
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_120.zip
Uploading the intermediate file: upload_file_120.zip
  03:18:23 STEP 2906 H=2906:00 +CPU= 16.996
  03:18:48 STEP 2907 H=2907:00 +CPU= 25.360
  03:19:05 STEP 2908 H=2908:00 +CPU= 16.497
  03:19:21 STEP 2909 H=2909:00 +CPU= 16.662
  03:19:47 STEP 2910 H=2910:00 +CPU= 26.023
  03:20:04 STEP 2911 H=2911:00 +CPU= 16.539
  03:20:21 STEP 2912 H=2912:00 +CPU= 16.996
  03:20:46 STEP 2913 H=2913:00 +CPU= 25.407
  03:21:03 STEP 2914 H=2914:00 +CPU= 16.438
  03:21:22 STEP 2915 H=2915:00 +CPU= 16.484
  03:21:50 STEP 2916 H=2916:00 +CPU= 27.873
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002916
  03:22:07 STEP 2917 H=2917:00 +CPU= 16.291
  03:22:24 STEP 2918 H=2918:00 +CPU= 17.029
  03:22:49 STEP 2919 H=2919:00 +CPU= 25.381
  03:23:06 STEP 2920 H=2920:00 +CPU= 16.652
  03:23:22 STEP 2921 H=2921:00 +CPU= 16.282
  03:23:48 STEP 2922 H=2922:00 +CPU= 25.841
  03:24:04 STEP 2923 H=2923:00 +CPU= 16.250
  03:24:21 STEP 2924 H=2924:00 +CPU= 16.940
  03:24:46 STEP 2925 H=2925:00 +CPU= 25.257
  03:25:03 STEP 2926 H=2926:00 +CPU= 16.654
  03:25:20 STEP 2927 H=2927:00 +CPU= 16.934
  03:25:52 STEP 2928 H=2928:00 +CPU= 29.817
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002928
  03:26:08 STEP 2929 H=2929:00 +CPU= 16.179
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002928
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_121.zip
Uploading the intermediate file: upload_file_121.zip
  03:26:24 STEP 2930 H=2930:00 +CPU= 16.553
Uploading trickle at timestep: 10544400
  03:26:50 STEP 2931 H=2931:00 +CPU= 25.200
  03:27:06 STEP 2932 H=2932:00 +CPU= 16.666
  03:27:23 STEP 2933 H=2933:00 +CPU= 16.237
  03:27:48 STEP 2934 H=2934:00 +CPU= 25.666
  03:28:05 STEP 2935 H=2935:00 +CPU= 16.406
  03:28:21 STEP 2936 H=2936:00 +CPU= 16.821
  03:28:47 STEP 2937 H=2937:00 +CPU= 25.213
  03:29:03 STEP 2938 H=2938:00 +CPU= 16.574
  03:29:20 STEP 2939 H=2939:00 +CPU= 16.516
  03:29:47 STEP 2940 H=2940:00 +CPU= 27.622
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002940
  03:30:04 STEP 2941 H=2941:00 +CPU= 16.402
  03:30:21 STEP 2942 H=2942:00 +CPU= 16.799
  03:30:46 STEP 2943 H=2943:00 +CPU= 25.177
  03:31:03 STEP 2944 H=2944:00 +CPU= 16.748
  03:31:19 STEP 2945 H=2945:00 +CPU= 16.308
  03:31:45 STEP 2946 H=2946:00 +CPU= 25.904
  03:32:01 STEP 2947 H=2947:00 +CPU= 16.329
  03:32:18 STEP 2948 H=2948:00 +CPU= 16.885
  03:32:43 STEP 2949 H=2949:00 +CPU= 25.384
  03:33:00 STEP 2950 H=2950:00 +CPU= 16.612
  03:33:17 STEP 2951 H=2951:00 +CPU= 17.005
  03:33:46 STEP 2952 H=2952:00 +CPU= 28.510
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.260318722649E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.48989191816039E-02 -1.72994898449055E+00  1.89761310057317E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.11984742850110     
  MAXGPFV : MAX. VALUE =   0.737266900295405     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    347509546 BYTES IN      8 RECORDS TRANSFERRED IN    0.0004 SECONDS868773.8 Mbytes/s, TOTAL TIME=    0.0080( 5.0%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 03:33:46 STEP 2952 H=2952:00 +CPU= 28.510
 END CNT3
 NSTEP =  2952 CNT0   000000000  24.670  24.670  24.730   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           35/   804992476 WRITTEN        37300/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    903    0       35       786125    37300 ************   138.3     1.1   137.2     1.6   218.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 2601    1745.8    1745.8      9.51      0.00
   9 SPCM     - SPECTRAL COMP.                    2400     241.1     241.1      1.21      0.00
  10 SCAN2M - PHYSICS                             2401    8851.1    8851.1     44.50      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                200     998.4     998.4      0.42      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                101      13.6      13.6      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      801    8900.7    8900.7     14.93      0.00
  17 GRIDFPOS IN CNT4                              200      39.1      39.1      0.02      0.00
  27 RESTART FILES - WRITING                       100    1996.9    1996.9      0.42      0.00
  28 RESTART FILES - READING                         1    2067.5    2067.5      0.00      0.00
  29 SU4FPOS IN CNT4                               200       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               200    1763.9    1763.9      0.74      0.00
  31 POSDDH IN STEPO                                10      15.3      15.3      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2401    2473.9    2473.9     12.44      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2401    2090.3    2090.3     10.51      0.00
  39 SU0YOMB                                         1     269.3     269.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2401      11.7      11.7      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2400     162.8     162.8      0.82      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2400      19.0      19.0      0.10      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                101       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     8206     101.4     101.4      1.74      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      5000      91.9      91.9      0.96      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       5000      40.1      40.1      0.42      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      8206      31.4      31.4      0.54      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      14.8      14.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           8206      15.7      15.7      0.27      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           5000      13.4      13.4      0.14      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           8206      19.9      19.9      0.34      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           5000      15.5      15.5      0.16      0.00
 400 GSTATS                                     478310       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                458087       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    47757.2 CPU TIME   47538.6 VECTOR TIME    47538.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      222.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/3/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/3/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMGGhnw4+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213700/ICMUAhnw4+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007a_2019110100_123_993_12213700_0_r1066579952_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
03:37:09 (5544): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:12 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 10,623,600 65,891 0.0062
09 May 2023 16:54:12 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 10,544,400 65,438 0.0062
09 May 2023 16:54:11 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 9,680,400 60,679 0.0063
09 May 2023 16:54:06 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 8,816,400 55,939 0.0063
09 May 2023 16:54:04 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 7,952,400 51,211 0.0064
09 May 2023 16:54:02 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 7,088,400 46,450 0.0066
09 May 2023 16:53:59 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 6,224,400 41,638 0.0067
09 May 2023 16:53:54 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 5,360,400 36,898 0.0069
09 May 2023 16:53:52 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 4,496,400 32,147 0.0071
09 May 2023 16:53:49 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 3,632,400 27,415 0.0075
09 May 2023 16:53:43 1469580 22315046 oifs_43r3_007a_2019110100_123_993_12213700_0 2,768,400 22,682 0.0082


©2024 climateprediction.net