climateprediction.net home page
Task 22316954

Task 22316954

Name oifs_43r3_00gd_2019110100_123_993_12214027_1
Workunit 12214027
Created 25 Feb 2023, 1:22:35 UTC
Sent 25 Feb 2023, 1:30:18 UTC
Report deadline 26 Apr 2023, 1:30:18 UTC
Received 26 Feb 2023, 19:04:07 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1469580
Run time 18 hours 15 min 16 sec
CPU time 17 hours 47 min 21 sec
Validate state Invalid
Credit 14,873.04
Device peak FLOPS 5.30 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,397.07 MB
Peak swap size 4,974.79 MB
Peak disk usage 1,991.99 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>

  15:59:04 STEP 2368 H=2368:00 +CPU= 16.864
  15:59:20 STEP 2369 H=2369:00 +CPU= 16.329
  15:59:46 STEP 2370 H=2370:00 +CPU= 25.600
  16:00:02 STEP 2371 H=2371:00 +CPU= 16.302
  16:00:19 STEP 2372 H=2372:00 +CPU= 16.964
  16:00:44 STEP 2373 H=2373:00 +CPU= 25.411
  16:01:01 STEP 2374 H=2374:00 +CPU= 16.823
  16:01:18 STEP 2375 H=2375:00 +CPU= 16.876
  16:01:47 STEP 2376 H=2376:00 +CPU= 28.926
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_98.zip
Uploading the intermediate file: upload_file_98.zip
  16:02:03 STEP 2377 H=2377:00 +CPU= 16.187
  16:02:20 STEP 2378 H=2378:00 +CPU= 16.681
  16:02:48 STEP 2379 H=2379:00 +CPU= 25.195
  16:03:04 STEP 2380 H=2380:00 +CPU= 16.496
  16:03:20 STEP 2381 H=2381:00 +CPU= 16.165
  16:03:46 STEP 2382 H=2382:00 +CPU= 25.666
  16:04:02 STEP 2383 H=2383:00 +CPU= 16.216
  16:04:19 STEP 2384 H=2384:00 +CPU= 16.878
  16:04:44 STEP 2385 H=2385:00 +CPU= 25.134
  16:05:01 STEP 2386 H=2386:00 +CPU= 16.783
  16:05:18 STEP 2387 H=2387:00 +CPU= 16.521
  16:05:45 STEP 2388 H=2388:00 +CPU= 27.241
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002388
  16:06:01 STEP 2389 H=2389:00 +CPU= 16.295
  16:06:18 STEP 2390 H=2390:00 +CPU= 16.847
  16:06:43 STEP 2391 H=2391:00 +CPU= 25.030
  16:07:00 STEP 2392 H=2392:00 +CPU= 16.584
  16:07:16 STEP 2393 H=2393:00 +CPU= 16.481
  16:07:42 STEP 2394 H=2394:00 +CPU= 25.291
  16:07:58 STEP 2395 H=2395:00 +CPU= 16.259
  16:08:15 STEP 2396 H=2396:00 +CPU= 17.089
  16:08:40 STEP 2397 H=2397:00 +CPU= 25.357
  16:08:57 STEP 2398 H=2398:00 +CPU= 16.710
  16:09:14 STEP 2399 H=2399:00 +CPU= 16.952
  16:09:43 STEP 2400 H=2400:00 +CPU= 29.297
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_99.zip
Uploading the intermediate file: upload_file_99.zip
  16:10:00 STEP 2401 H=2401:00 +CPU= 16.237
  16:10:16 STEP 2402 H=2402:00 +CPU= 16.779
  16:10:42 STEP 2403 H=2403:00 +CPU= 25.210
  16:11:01 STEP 2404 H=2404:00 +CPU= 16.646
  16:11:18 STEP 2405 H=2405:00 +CPU= 16.345
  16:11:44 STEP 2406 H=2406:00 +CPU= 25.915
  16:12:00 STEP 2407 H=2407:00 +CPU= 16.209
  16:12:17 STEP 2408 H=2408:00 +CPU= 17.049
  16:12:43 STEP 2409 H=2409:00 +CPU= 25.933
  16:13:00 STEP 2410 H=2410:00 +CPU= 16.748
  16:13:16 STEP 2411 H=2411:00 +CPU= 16.580
  16:13:44 STEP 2412 H=2412:00 +CPU= 27.463
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002412
  16:14:00 STEP 2413 H=2413:00 +CPU= 16.371
  16:14:17 STEP 2414 H=2414:00 +CPU= 16.865
  16:14:42 STEP 2415 H=2415:00 +CPU= 25.131
  16:14:59 STEP 2416 H=2416:00 +CPU= 16.529
  16:15:15 STEP 2417 H=2417:00 +CPU= 16.614
  16:15:41 STEP 2418 H=2418:00 +CPU= 25.994
  16:15:57 STEP 2419 H=2419:00 +CPU= 16.161
  16:16:14 STEP 2420 H=2420:00 +CPU= 16.866
  16:16:40 STEP 2421 H=2421:00 +CPU= 25.408
  16:16:56 STEP 2422 H=2422:00 +CPU= 16.624
  16:17:13 STEP 2423 H=2423:00 +CPU= 16.766
  16:17:42 STEP 2424 H=2424:00 +CPU= 29.240
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_100.zip
Uploading the intermediate file: upload_file_100.zip
  16:17:58 STEP 2425 H=2425:00 +CPU= 16.009
  16:18:15 STEP 2426 H=2426:00 +CPU= 16.738
  16:18:40 STEP 2427 H=2427:00 +CPU= 25.289
  16:18:57 STEP 2428 H=2428:00 +CPU= 16.669
  16:19:14 STEP 2429 H=2429:00 +CPU= 16.443
  16:19:39 STEP 2430 H=2430:00 +CPU= 25.763
  16:19:55 STEP 2431 H=2431:00 +CPU= 15.913
  16:20:12 STEP 2432 H=2432:00 +CPU= 17.019
  16:20:38 STEP 2433 H=2433:00 +CPU= 25.417
  16:20:54 STEP 2434 H=2434:00 +CPU= 16.701
  16:21:11 STEP 2435 H=2435:00 +CPU= 16.579
  16:21:39 STEP 2436 H=2436:00 +CPU= 28.124
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002436
  16:21:56 STEP 2437 H=2437:00 +CPU= 16.232
  16:22:13 STEP 2438 H=2438:00 +CPU= 16.785
  16:22:38 STEP 2439 H=2439:00 +CPU= 25.677
  16:22:55 STEP 2440 H=2440:00 +CPU= 16.335
  16:23:11 STEP 2441 H=2441:00 +CPU= 16.480
  16:23:37 STEP 2442 H=2442:00 +CPU= 25.805
  16:23:53 STEP 2443 H=2443:00 +CPU= 15.968
  16:24:10 STEP 2444 H=2444:00 +CPU= 17.156
  16:24:35 STEP 2445 H=2445:00 +CPU= 25.082
  16:24:52 STEP 2446 H=2446:00 +CPU= 16.581
  16:25:09 STEP 2447 H=2447:00 +CPU= 16.929
  16:25:39 STEP 2448 H=2448:00 +CPU= 29.769
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_101.zip
Uploading the intermediate file: upload_file_101.zip
  16:25:55 STEP 2449 H=2449:00 +CPU= 16.195
  16:26:12 STEP 2450 H=2450:00 +CPU= 16.653
  16:26:37 STEP 2451 H=2451:00 +CPU= 24.976
  16:26:54 STEP 2452 H=2452:00 +CPU= 16.603
  16:27:10 STEP 2453 H=2453:00 +CPU= 16.444
  16:27:36 STEP 2454 H=2454:00 +CPU= 25.652
  16:27:52 STEP 2455 H=2455:00 +CPU= 15.916
  16:28:09 STEP 2456 H=2456:00 +CPU= 16.991
  16:28:34 STEP 2457 H=2457:00 +CPU= 25.422
  16:28:50 STEP 2458 H=2458:00 +CPU= 16.476
  16:29:07 STEP 2459 H=2459:00 +CPU= 16.629
  16:29:35 STEP 2460 H=2460:00 +CPU= 27.897
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002460
  16:29:53 STEP 2461 H=2461:00 +CPU= 16.117
  16:30:10 STEP 2462 H=2462:00 +CPU= 16.663
  16:30:35 STEP 2463 H=2463:00 +CPU= 25.325
  16:30:52 STEP 2464 H=2464:00 +CPU= 16.508
  16:31:08 STEP 2465 H=2465:00 +CPU= 16.475
  16:31:34 STEP 2466 H=2466:00 +CPU= 25.812
  16:31:50 STEP 2467 H=2467:00 +CPU= 16.396
  16:32:07 STEP 2468 H=2468:00 +CPU= 16.813
  16:32:32 STEP 2469 H=2469:00 +CPU= 25.333
  16:32:50 STEP 2470 H=2470:00 +CPU= 17.138
  16:33:07 STEP 2471 H=2471:00 +CPU= 17.082
  16:33:36 STEP 2472 H=2472:00 +CPU= 29.607
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_102.zip
Uploading the intermediate file: upload_file_102.zip
  16:33:53 STEP 2473 H=2473:00 +CPU= 16.286
  16:34:09 STEP 2474 H=2474:00 +CPU= 16.749
  16:34:35 STEP 2475 H=2475:00 +CPU= 25.361
  16:34:51 STEP 2476 H=2476:00 +CPU= 16.384
  16:35:08 STEP 2477 H=2477:00 +CPU= 16.367
  16:35:33 STEP 2478 H=2478:00 +CPU= 25.744
  16:35:50 STEP 2479 H=2479:00 +CPU= 16.239
  16:36:06 STEP 2480 H=2480:00 +CPU= 16.844
  16:36:32 STEP 2481 H=2481:00 +CPU= 25.638
  16:36:49 STEP 2482 H=2482:00 +CPU= 16.436
  16:37:05 STEP 2483 H=2483:00 +CPU= 16.485
  16:37:33 STEP 2484 H=2484:00 +CPU= 27.799
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002484
  16:37:49 STEP 2485 H=2485:00 +CPU= 16.138
  16:38:06 STEP 2486 H=2486:00 +CPU= 17.166
  16:38:32 STEP 2487 H=2487:00 +CPU= 25.546
  16:38:49 STEP 2488 H=2488:00 +CPU= 16.756
  16:39:05 STEP 2489 H=2489:00 +CPU= 16.488
  16:39:31 STEP 2490 H=2490:00 +CPU= 25.657
  16:39:47 STEP 2491 H=2491:00 +CPU= 16.317
  16:40:04 STEP 2492 H=2492:00 +CPU= 16.638
  16:40:29 STEP 2493 H=2493:00 +CPU= 25.345
  16:40:46 STEP 2494 H=2494:00 +CPU= 16.577
  16:41:02 STEP 2495 H=2495:00 +CPU= 16.803
  16:41:32 STEP 2496 H=2496:00 +CPU= 29.399
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_103.zip
Uploading the intermediate file: upload_file_103.zip
  16:41:48 STEP 2497 H=2497:00 +CPU= 16.258
  16:42:05 STEP 2498 H=2498:00 +CPU= 16.789
  16:42:30 STEP 2499 H=2499:00 +CPU= 25.475
  16:42:47 STEP 2500 H=2500:00 +CPU= 16.554
  16:43:03 STEP 2501 H=2501:00 +CPU= 16.302
  16:43:29 STEP 2502 H=2502:00 +CPU= 25.695
  16:43:45 STEP 2503 H=2503:00 +CPU= 16.099
  16:44:02 STEP 2504 H=2504:00 +CPU= 16.830
  16:44:27 STEP 2505 H=2505:00 +CPU= 25.264
  16:44:44 STEP 2506 H=2506:00 +CPU= 16.485
  16:45:00 STEP 2507 H=2507:00 +CPU= 16.513
  16:45:35 STEP 2508 H=2508:00 +CPU= 28.013
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002508
  16:45:52 STEP 2509 H=2509:00 +CPU= 16.405
  16:46:08 STEP 2510 H=2510:00 +CPU= 16.847
  16:46:34 STEP 2511 H=2511:00 +CPU= 25.086
  16:46:50 STEP 2512 H=2512:00 +CPU= 16.754
  16:47:06 STEP 2513 H=2513:00 +CPU= 16.180
  16:47:32 STEP 2514 H=2514:00 +CPU= 25.720
  16:47:48 STEP 2515 H=2515:00 +CPU= 16.259
  16:48:05 STEP 2516 H=2516:00 +CPU= 16.890
  16:48:31 STEP 2517 H=2517:00 +CPU= 25.336
  16:48:47 STEP 2518 H=2518:00 +CPU= 16.664
  16:49:04 STEP 2519 H=2519:00 +CPU= 16.747
  16:49:34 STEP 2520 H=2520:00 +CPU= 29.755
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_104.zip
Uploading the intermediate file: upload_file_104.zip
  16:49:50 STEP 2521 H=2521:00 +CPU= 16.400
Uploading trickle at timestep: 9072000
  16:50:07 STEP 2522 H=2522:00 +CPU= 16.822
  16:50:32 STEP 2523 H=2523:00 +CPU= 25.236
  16:50:49 STEP 2524 H=2524:00 +CPU= 16.961
  16:51:06 STEP 2525 H=2525:00 +CPU= 16.427
  16:51:32 STEP 2526 H=2526:00 +CPU= 25.750
  16:51:48 STEP 2527 H=2527:00 +CPU= 16.242
  16:52:05 STEP 2528 H=2528:00 +CPU= 16.714
  16:52:30 STEP 2529 H=2529:00 +CPU= 25.362
  16:52:47 STEP 2530 H=2530:00 +CPU= 17.148
  16:53:04 STEP 2531 H=2531:00 +CPU= 16.643
  16:53:31 STEP 2532 H=2532:00 +CPU= 27.607
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002532
  16:53:48 STEP 2533 H=2533:00 +CPU= 16.444
  16:54:05 STEP 2534 H=2534:00 +CPU= 16.837
  16:54:30 STEP 2535 H=2535:00 +CPU= 25.460
  16:54:47 STEP 2536 H=2536:00 +CPU= 16.754
  16:55:03 STEP 2537 H=2537:00 +CPU= 16.453
  16:55:29 STEP 2538 H=2538:00 +CPU= 25.853
  16:55:46 STEP 2539 H=2539:00 +CPU= 16.175
  16:56:03 STEP 2540 H=2540:00 +CPU= 17.044
  16:56:28 STEP 2541 H=2541:00 +CPU= 25.547
  16:56:45 STEP 2542 H=2542:00 +CPU= 17.146
  16:57:02 STEP 2543 H=2543:00 +CPU= 17.042
  16:57:32 STEP 2544 H=2544:00 +CPU= 29.428
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_105.zip
Uploading the intermediate file: upload_file_105.zip
  16:57:48 STEP 2545 H=2545:00 +CPU= 16.340
  16:58:05 STEP 2546 H=2546:00 +CPU= 16.916
  16:58:30 STEP 2547 H=2547:00 +CPU= 25.233
  16:58:47 STEP 2548 H=2548:00 +CPU= 17.107
  16:59:04 STEP 2549 H=2549:00 +CPU= 16.332
  16:59:30 STEP 2550 H=2550:00 +CPU= 25.943
  16:59:46 STEP 2551 H=2551:00 +CPU= 16.395
  17:00:03 STEP 2552 H=2552:00 +CPU= 16.895
  17:00:28 STEP 2553 H=2553:00 +CPU= 25.219
  17:00:45 STEP 2554 H=2554:00 +CPU= 16.608
  17:01:02 STEP 2555 H=2555:00 +CPU= 16.585
  17:01:30 STEP 2556 H=2556:00 +CPU= 27.859
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002556
  17:01:46 STEP 2557 H=2557:00 +CPU= 16.360
  17:02:03 STEP 2558 H=2558:00 +CPU= 16.843
  17:02:28 STEP 2559 H=2559:00 +CPU= 25.373
  17:02:45 STEP 2560 H=2560:00 +CPU= 16.573
  17:03:01 STEP 2561 H=2561:00 +CPU= 16.626
  17:03:27 STEP 2562 H=2562:00 +CPU= 25.887
  17:03:43 STEP 2563 H=2563:00 +CPU= 16.228
  17:04:01 STEP 2564 H=2564:00 +CPU= 17.059
  17:04:26 STEP 2565 H=2565:00 +CPU= 25.415
  17:04:43 STEP 2566 H=2566:00 +CPU= 16.680
  17:05:00 STEP 2567 H=2567:00 +CPU= 17.007
  17:05:30 STEP 2568 H=2568:00 +CPU= 29.733
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_106.zip
Uploading the intermediate file: upload_file_106.zip
  17:05:46 STEP 2569 H=2569:00 +CPU= 16.457
  17:06:03 STEP 2570 H=2570:00 +CPU= 16.799
  17:06:28 STEP 2571 H=2571:00 +CPU= 25.287
  17:06:45 STEP 2572 H=2572:00 +CPU= 16.578
  17:07:01 STEP 2573 H=2573:00 +CPU= 16.225
  17:07:27 STEP 2574 H=2574:00 +CPU= 25.988
  17:07:43 STEP 2575 H=2575:00 +CPU= 16.159
  17:08:00 STEP 2576 H=2576:00 +CPU= 17.002
  17:08:26 STEP 2577 H=2577:00 +CPU= 25.611
  17:08:42 STEP 2578 H=2578:00 +CPU= 16.607
  17:08:59 STEP 2579 H=2579:00 +CPU= 16.430
  17:09:26 STEP 2580 H=2580:00 +CPU= 27.548
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002580
  17:09:43 STEP 2581 H=2581:00 +CPU= 16.538
  17:10:00 STEP 2582 H=2582:00 +CPU= 16.969
  17:10:26 STEP 2583 H=2583:00 +CPU= 25.538
  17:10:42 STEP 2584 H=2584:00 +CPU= 16.843
  17:10:59 STEP 2585 H=2585:00 +CPU= 16.506
  17:11:25 STEP 2586 H=2586:00 +CPU= 25.774
  17:11:41 STEP 2587 H=2587:00 +CPU= 16.034
  17:11:57 STEP 2588 H=2588:00 +CPU= 16.668
  17:12:23 STEP 2589 H=2589:00 +CPU= 25.331
  17:12:39 STEP 2590 H=2590:00 +CPU= 16.401
  17:12:56 STEP 2591 H=2591:00 +CPU= 16.646
  17:13:26 STEP 2592 H=2592:00 +CPU= 29.575
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_107.zip
Uploading the intermediate file: upload_file_107.zip
  17:13:42 STEP 2593 H=2593:00 +CPU= 16.240
  17:13:59 STEP 2594 H=2594:00 +CPU= 16.831
  17:14:24 STEP 2595 H=2595:00 +CPU= 25.449
  17:14:42 STEP 2596 H=2596:00 +CPU= 16.553
  17:14:58 STEP 2597 H=2597:00 +CPU= 16.784
  17:15:24 STEP 2598 H=2598:00 +CPU= 25.947
  17:15:41 STEP 2599 H=2599:00 +CPU= 16.299
  17:15:58 STEP 2600 H=2600:00 +CPU= 16.874
  17:16:23 STEP 2601 H=2601:00 +CPU= 25.607
  17:16:40 STEP 2602 H=2602:00 +CPU= 16.482
  17:16:56 STEP 2603 H=2603:00 +CPU= 16.379
  17:17:24 STEP 2604 H=2604:00 +CPU= 27.740
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002604
  17:17:40 STEP 2605 H=2605:00 +CPU= 16.094
  17:17:57 STEP 2606 H=2606:00 +CPU= 17.029
  17:18:23 STEP 2607 H=2607:00 +CPU= 25.442
  17:18:39 STEP 2608 H=2608:00 +CPU= 16.541
  17:18:55 STEP 2609 H=2609:00 +CPU= 16.372
  17:19:21 STEP 2610 H=2610:00 +CPU= 25.873
  17:19:37 STEP 2611 H=2611:00 +CPU= 15.875
  17:19:54 STEP 2612 H=2612:00 +CPU= 16.671
  17:20:19 STEP 2613 H=2613:00 +CPU= 25.503
  17:20:36 STEP 2614 H=2614:00 +CPU= 16.499
  17:20:52 STEP 2615 H=2615:00 +CPU= 16.598
  17:21:22 STEP 2616 H=2616:00 +CPU= 29.373
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_108.zip
Uploading the intermediate file: upload_file_108.zip
  17:21:38 STEP 2617 H=2617:00 +CPU= 16.080
  17:21:55 STEP 2618 H=2618:00 +CPU= 17.003
  17:22:20 STEP 2619 H=2619:00 +CPU= 25.292
  17:22:37 STEP 2620 H=2620:00 +CPU= 16.698
  17:22:54 STEP 2621 H=2621:00 +CPU= 16.434
  17:23:20 STEP 2622 H=2622:00 +CPU= 26.067
  17:23:36 STEP 2623 H=2623:00 +CPU= 16.080
  17:23:52 STEP 2624 H=2624:00 +CPU= 16.678
  17:24:18 STEP 2625 H=2625:00 +CPU= 25.115
  17:24:34 STEP 2626 H=2626:00 +CPU= 16.425
  17:24:50 STEP 2627 H=2627:00 +CPU= 16.331
  17:25:18 STEP 2628 H=2628:00 +CPU= 27.904
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002628
  17:25:35 STEP 2629 H=2629:00 +CPU= 16.124
  17:25:51 STEP 2630 H=2630:00 +CPU= 16.677
  17:26:17 STEP 2631 H=2631:00 +CPU= 25.363
  17:26:33 STEP 2632 H=2632:00 +CPU= 16.596
  17:26:50 STEP 2633 H=2633:00 +CPU= 16.455
  17:27:16 STEP 2634 H=2634:00 +CPU= 26.022
  17:27:32 STEP 2635 H=2635:00 +CPU= 16.136
  17:27:48 STEP 2636 H=2636:00 +CPU= 16.698
  17:28:14 STEP 2637 H=2637:00 +CPU= 25.377
  17:28:30 STEP 2638 H=2638:00 +CPU= 16.461
  17:28:47 STEP 2639 H=2639:00 +CPU= 17.045
  17:29:19 STEP 2640 H=2640:00 +CPU= 29.722
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_109.zip
Uploading the intermediate file: upload_file_109.zip
  17:29:35 STEP 2641 H=2641:00 +CPU= 15.979
  17:29:52 STEP 2642 H=2642:00 +CPU= 16.922
  17:30:18 STEP 2643 H=2643:00 +CPU= 25.571
  17:30:34 STEP 2644 H=2644:00 +CPU= 16.404
  17:30:50 STEP 2645 H=2645:00 +CPU= 16.197
  17:31:17 STEP 2646 H=2646:00 +CPU= 26.119
  17:31:33 STEP 2647 H=2647:00 +CPU= 15.948
  17:31:49 STEP 2648 H=2648:00 +CPU= 16.700
  17:32:15 STEP 2649 H=2649:00 +CPU= 25.715
  17:32:32 STEP 2650 H=2650:00 +CPU= 16.648
  17:32:48 STEP 2651 H=2651:00 +CPU= 16.467
  17:33:16 STEP 2652 H=2652:00 +CPU= 27.824
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002652
  17:33:34 STEP 2653 H=2653:00 +CPU= 16.052
  17:33:51 STEP 2654 H=2654:00 +CPU= 16.692
  17:34:17 STEP 2655 H=2655:00 +CPU= 25.570
  17:34:33 STEP 2656 H=2656:00 +CPU= 16.596
  17:34:50 STEP 2657 H=2657:00 +CPU= 16.451
  17:35:16 STEP 2658 H=2658:00 +CPU= 26.055
  17:35:32 STEP 2659 H=2659:00 +CPU= 16.157
  17:35:49 STEP 2660 H=2660:00 +CPU= 16.712
  17:36:14 STEP 2661 H=2661:00 +CPU= 25.446
  17:36:30 STEP 2662 H=2662:00 +CPU= 16.197
  17:36:47 STEP 2663 H=2663:00 +CPU= 16.607
  17:37:17 STEP 2664 H=2664:00 +CPU= 29.891
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_110.zip
Uploading the intermediate file: upload_file_110.zip
  17:37:33 STEP 2665 H=2665:00 +CPU= 15.810
  17:37:49 STEP 2666 H=2666:00 +CPU= 16.614
  17:38:15 STEP 2667 H=2667:00 +CPU= 25.526
  17:38:31 STEP 2668 H=2668:00 +CPU= 16.478
  17:38:50 STEP 2669 H=2669:00 +CPU= 16.563
  17:39:16 STEP 2670 H=2670:00 +CPU= 26.023
  17:39:32 STEP 2671 H=2671:00 +CPU= 16.041
  17:39:49 STEP 2672 H=2672:00 +CPU= 17.051
  17:40:15 STEP 2673 H=2673:00 +CPU= 25.971
  17:40:31 STEP 2674 H=2674:00 +CPU= 16.381
  17:40:48 STEP 2675 H=2675:00 +CPU= 16.474
  17:41:15 STEP 2676 H=2676:00 +CPU= 27.834
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002676
  17:41:34 STEP 2677 H=2677:00 +CPU= 15.883
  17:41:51 STEP 2678 H=2678:00 +CPU= 16.937
  17:42:17 STEP 2679 H=2679:00 +CPU= 25.557
  17:42:33 STEP 2680 H=2680:00 +CPU= 16.167
  17:42:49 STEP 2681 H=2681:00 +CPU= 16.496
  17:43:15 STEP 2682 H=2682:00 +CPU= 25.900
  17:43:31 STEP 2683 H=2683:00 +CPU= 15.912
  17:43:48 STEP 2684 H=2684:00 +CPU= 16.800
  17:44:14 STEP 2685 H=2685:00 +CPU= 25.616
  17:44:30 STEP 2686 H=2686:00 +CPU= 16.073
  17:44:46 STEP 2687 H=2687:00 +CPU= 16.704
  17:45:16 STEP 2688 H=2688:00 +CPU= 29.583
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_111.zip
Uploading the intermediate file: upload_file_111.zip
  17:45:32 STEP 2689 H=2689:00 +CPU= 15.866
  17:45:49 STEP 2690 H=2690:00 +CPU= 17.061
  17:46:14 STEP 2691 H=2691:00 +CPU= 25.391
  17:46:31 STEP 2692 H=2692:00 +CPU= 16.315
  17:46:47 STEP 2693 H=2693:00 +CPU= 16.291
  17:47:13 STEP 2694 H=2694:00 +CPU= 26.025
  17:47:29 STEP 2695 H=2695:00 +CPU= 15.955
  17:47:46 STEP 2696 H=2696:00 +CPU= 16.733
  17:48:11 STEP 2697 H=2697:00 +CPU= 25.579
  17:48:28 STEP 2698 H=2698:00 +CPU= 16.297
  17:48:45 STEP 2699 H=2699:00 +CPU= 16.844
  17:49:13 STEP 2700 H=2700:00 +CPU= 28.011
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002700
  17:49:29 STEP 2701 H=2701:00 +CPU= 15.915
  17:49:45 STEP 2702 H=2702:00 +CPU= 16.670
  17:50:11 STEP 2703 H=2703:00 +CPU= 25.722
  17:50:27 STEP 2704 H=2704:00 +CPU= 16.251
  17:50:44 STEP 2705 H=2705:00 +CPU= 16.886
  17:51:10 STEP 2706 H=2706:00 +CPU= 26.068
  17:51:26 STEP 2707 H=2707:00 +CPU= 15.910
  17:51:43 STEP 2708 H=2708:00 +CPU= 16.659
  17:52:08 STEP 2709 H=2709:00 +CPU= 25.489
  17:52:25 STEP 2710 H=2710:00 +CPU= 16.354
  17:52:42 STEP 2711 H=2711:00 +CPU= 16.965
  17:53:11 STEP 2712 H=2712:00 +CPU= 29.636
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_112.zip
Uploading the intermediate file: upload_file_112.zip
  17:53:28 STEP 2713 H=2713:00 +CPU= 15.982
  17:53:45 STEP 2714 H=2714:00 +CPU= 17.088
  17:54:10 STEP 2715 H=2715:00 +CPU= 25.570
  17:54:27 STEP 2716 H=2716:00 +CPU= 16.456
  17:54:43 STEP 2717 H=2717:00 +CPU= 16.369
  17:55:09 STEP 2718 H=2718:00 +CPU= 26.152
  17:55:25 STEP 2719 H=2719:00 +CPU= 16.132
  17:55:42 STEP 2720 H=2720:00 +CPU= 16.742
  17:56:08 STEP 2721 H=2721:00 +CPU= 25.790
  17:56:25 STEP 2722 H=2722:00 +CPU= 16.493
  17:56:41 STEP 2723 H=2723:00 +CPU= 16.471
  17:57:09 STEP 2724 H=2724:00 +CPU= 27.875
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002724
  17:57:25 STEP 2725 H=2725:00 +CPU= 15.929
  17:57:42 STEP 2726 H=2726:00 +CPU= 16.905
  17:58:07 STEP 2727 H=2727:00 +CPU= 25.584
  17:58:24 STEP 2728 H=2728:00 +CPU= 16.735
  17:58:41 STEP 2729 H=2729:00 +CPU= 16.609
  17:59:07 STEP 2730 H=2730:00 +CPU= 25.842
  17:59:23 STEP 2731 H=2731:00 +CPU= 15.903
  17:59:39 STEP 2732 H=2732:00 +CPU= 16.654
  18:00:05 STEP 2733 H=2733:00 +CPU= 25.568
  18:00:21 STEP 2734 H=2734:00 +CPU= 16.544
  18:00:38 STEP 2735 H=2735:00 +CPU= 16.937
  18:01:08 STEP 2736 H=2736:00 +CPU= 29.630
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_113.zip
Uploading the intermediate file: upload_file_113.zip
  18:01:24 STEP 2737 H=2737:00 +CPU= 15.849
  18:01:41 STEP 2738 H=2738:00 +CPU= 17.088
  18:02:07 STEP 2739 H=2739:00 +CPU= 25.613
  18:02:26 STEP 2740 H=2740:00 +CPU= 16.508
  18:02:43 STEP 2741 H=2741:00 +CPU= 16.557
  18:03:09 STEP 2742 H=2742:00 +CPU= 26.092
  18:03:25 STEP 2743 H=2743:00 +CPU= 16.098
  18:03:42 STEP 2744 H=2744:00 +CPU= 16.967
  18:04:08 STEP 2745 H=2745:00 +CPU= 25.535
  18:04:29 STEP 2746 H=2746:00 +CPU= 16.785
  18:04:46 STEP 2747 H=2747:00 +CPU= 16.520
  18:05:14 STEP 2748 H=2748:00 +CPU= 27.917
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002748
  18:05:30 STEP 2749 H=2749:00 +CPU= 16.247
  18:05:47 STEP 2750 H=2750:00 +CPU= 16.856
  18:06:13 STEP 2751 H=2751:00 +CPU= 25.471
  18:06:29 STEP 2752 H=2752:00 +CPU= 16.699
  18:06:46 STEP 2753 H=2753:00 +CPU= 16.420
  18:07:12 STEP 2754 H=2754:00 +CPU= 25.748
  18:07:28 STEP 2755 H=2755:00 +CPU= 16.139
  18:07:45 STEP 2756 H=2756:00 +CPU= 16.779
  18:08:10 STEP 2757 H=2757:00 +CPU= 25.537
  18:08:27 STEP 2758 H=2758:00 +CPU= 16.526
  18:08:44 STEP 2759 H=2759:00 +CPU= 16.886
  18:09:13 STEP 2760 H=2760:00 +CPU= 29.606
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_114.zip
Uploading the intermediate file: upload_file_114.zip
  18:09:29 STEP 2761 H=2761:00 +CPU= 16.282
Uploading trickle at timestep: 9936000
  18:09:47 STEP 2762 H=2762:00 +CPU= 17.163
  18:10:12 STEP 2763 H=2763:00 +CPU= 25.443
  18:10:29 STEP 2764 H=2764:00 +CPU= 16.563
  18:10:45 STEP 2765 H=2765:00 +CPU= 16.450
  18:11:11 STEP 2766 H=2766:00 +CPU= 25.712
  18:11:27 STEP 2767 H=2767:00 +CPU= 16.351
  18:11:44 STEP 2768 H=2768:00 +CPU= 16.710
  18:12:10 STEP 2769 H=2769:00 +CPU= 25.590
  18:12:26 STEP 2770 H=2770:00 +CPU= 16.246
  18:12:42 STEP 2771 H=2771:00 +CPU= 16.593
  18:13:10 STEP 2772 H=2772:00 +CPU= 27.744
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002772
  18:13:26 STEP 2773 H=2773:00 +CPU= 16.173
  18:13:43 STEP 2774 H=2774:00 +CPU= 17.043
  18:14:09 STEP 2775 H=2775:00 +CPU= 25.722
  18:14:26 STEP 2776 H=2776:00 +CPU= 16.643
  18:14:42 STEP 2777 H=2777:00 +CPU= 16.321
  18:15:08 STEP 2778 H=2778:00 +CPU= 25.989
  18:15:24 STEP 2779 H=2779:00 +CPU= 16.320
  18:15:41 STEP 2780 H=2780:00 +CPU= 16.930
  18:16:07 STEP 2781 H=2781:00 +CPU= 25.458
  18:16:23 STEP 2782 H=2782:00 +CPU= 16.488
  18:16:40 STEP 2783 H=2783:00 +CPU= 16.828
  18:17:10 STEP 2784 H=2784:00 +CPU= 29.530
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_115.zip
Uploading the intermediate file: upload_file_115.zip
  18:17:26 STEP 2785 H=2785:00 +CPU= 16.232
  18:17:43 STEP 2786 H=2786:00 +CPU= 16.791
  18:18:08 STEP 2787 H=2787:00 +CPU= 25.411
  18:18:25 STEP 2788 H=2788:00 +CPU= 16.723
  18:18:42 STEP 2789 H=2789:00 +CPU= 16.704
  18:19:08 STEP 2790 H=2790:00 +CPU= 25.808
  18:19:24 STEP 2791 H=2791:00 +CPU= 16.458
  18:19:41 STEP 2792 H=2792:00 +CPU= 16.880
  18:20:06 STEP 2793 H=2793:00 +CPU= 25.463
  18:20:23 STEP 2794 H=2794:00 +CPU= 16.648
  18:20:40 STEP 2795 H=2795:00 +CPU= 16.623
  18:21:08 STEP 2796 H=2796:00 +CPU= 28.428
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002796
  18:21:25 STEP 2797 H=2797:00 +CPU= 16.775
  18:21:43 STEP 2798 H=2798:00 +CPU= 17.390
  18:22:09 STEP 2799 H=2799:00 +CPU= 26.216
  18:22:26 STEP 2800 H=2800:00 +CPU= 17.201
  18:22:43 STEP 2801 H=2801:00 +CPU= 16.659
  18:23:09 STEP 2802 H=2802:00 +CPU= 26.049
  18:23:25 STEP 2803 H=2803:00 +CPU= 16.162
  18:23:42 STEP 2804 H=2804:00 +CPU= 17.026
  18:24:07 STEP 2805 H=2805:00 +CPU= 25.349
  18:24:24 STEP 2806 H=2806:00 +CPU= 16.656
  18:24:41 STEP 2807 H=2807:00 +CPU= 16.666
  18:25:10 STEP 2808 H=2808:00 +CPU= 29.602
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_116.zip
Uploading the intermediate file: upload_file_116.zip
  18:25:27 STEP 2809 H=2809:00 +CPU= 16.338
  18:25:44 STEP 2810 H=2810:00 +CPU= 16.910
  18:26:09 STEP 2811 H=2811:00 +CPU= 25.418
  18:26:26 STEP 2812 H=2812:00 +CPU= 16.703
  18:26:42 STEP 2813 H=2813:00 +CPU= 16.321
  18:27:08 STEP 2814 H=2814:00 +CPU= 25.990
  18:27:25 STEP 2815 H=2815:00 +CPU= 16.356
  18:27:41 STEP 2816 H=2816:00 +CPU= 16.812
  18:28:07 STEP 2817 H=2817:00 +CPU= 25.617
  18:28:24 STEP 2818 H=2818:00 +CPU= 16.598
  18:28:40 STEP 2819 H=2819:00 +CPU= 16.291
  18:29:08 STEP 2820 H=2820:00 +CPU= 27.882
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002820
  18:29:24 STEP 2821 H=2821:00 +CPU= 16.269
  18:29:41 STEP 2822 H=2822:00 +CPU= 16.792
  18:30:06 STEP 2823 H=2823:00 +CPU= 25.565
  18:30:23 STEP 2824 H=2824:00 +CPU= 16.580
  18:30:40 STEP 2825 H=2825:00 +CPU= 16.470
  18:31:05 STEP 2826 H=2826:00 +CPU= 25.914
  18:31:22 STEP 2827 H=2827:00 +CPU= 16.079
  18:31:38 STEP 2828 H=2828:00 +CPU= 16.610
  18:32:04 STEP 2829 H=2829:00 +CPU= 25.409
  18:32:21 STEP 2830 H=2830:00 +CPU= 16.965
  18:32:38 STEP 2831 H=2831:00 +CPU= 17.081
  18:33:07 STEP 2832 H=2832:00 +CPU= 29.535
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_117.zip
Uploading the intermediate file: upload_file_117.zip
  18:33:23 STEP 2833 H=2833:00 +CPU= 16.046
  18:33:40 STEP 2834 H=2834:00 +CPU= 16.931
  18:34:06 STEP 2835 H=2835:00 +CPU= 25.843
  18:34:29 STEP 2836 H=2836:00 +CPU= 16.966
  18:34:46 STEP 2837 H=2837:00 +CPU= 16.612
  18:35:12 STEP 2838 H=2838:00 +CPU= 25.969
  18:35:28 STEP 2839 H=2839:00 +CPU= 16.246
  18:35:45 STEP 2840 H=2840:00 +CPU= 17.214
  18:36:11 STEP 2841 H=2841:00 +CPU= 25.653
  18:36:27 STEP 2842 H=2842:00 +CPU= 16.489
  18:36:44 STEP 2843 H=2843:00 +CPU= 16.390
  18:37:11 STEP 2844 H=2844:00 +CPU= 27.647
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002844
  18:37:28 STEP 2845 H=2845:00 +CPU= 16.145
  18:37:45 STEP 2846 H=2846:00 +CPU= 16.996
  18:38:10 STEP 2847 H=2847:00 +CPU= 25.418
  18:38:27 STEP 2848 H=2848:00 +CPU= 16.627
  18:38:43 STEP 2849 H=2849:00 +CPU= 16.397
  18:39:09 STEP 2850 H=2850:00 +CPU= 25.760
  18:39:25 STEP 2851 H=2851:00 +CPU= 16.016
  18:39:42 STEP 2852 H=2852:00 +CPU= 16.879
  18:40:07 STEP 2853 H=2853:00 +CPU= 25.524
  18:40:24 STEP 2854 H=2854:00 +CPU= 16.627
  18:40:41 STEP 2855 H=2855:00 +CPU= 16.722
  18:41:10 STEP 2856 H=2856:00 +CPU= 29.532
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_118.zip
Uploading the intermediate file: upload_file_118.zip
  18:41:26 STEP 2857 H=2857:00 +CPU= 15.966
  18:41:43 STEP 2858 H=2858:00 +CPU= 16.593
  18:42:08 STEP 2859 H=2859:00 +CPU= 25.484
  18:42:25 STEP 2860 H=2860:00 +CPU= 16.471
  18:42:44 STEP 2861 H=2861:00 +CPU= 16.410
  18:43:09 STEP 2862 H=2862:00 +CPU= 25.861
  18:43:25 STEP 2863 H=2863:00 +CPU= 16.104
  18:43:42 STEP 2864 H=2864:00 +CPU= 16.820
  18:44:08 STEP 2865 H=2865:00 +CPU= 25.494
  18:44:24 STEP 2866 H=2866:00 +CPU= 16.478
  18:44:41 STEP 2867 H=2867:00 +CPU= 16.262
  18:45:08 STEP 2868 H=2868:00 +CPU= 27.817
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002868
  18:45:25 STEP 2869 H=2869:00 +CPU= 16.133
  18:45:42 STEP 2870 H=2870:00 +CPU= 17.058
  18:46:07 STEP 2871 H=2871:00 +CPU= 25.599
  18:46:24 STEP 2872 H=2872:00 +CPU= 16.664
  18:46:41 STEP 2873 H=2873:00 +CPU= 16.646
  18:47:07 STEP 2874 H=2874:00 +CPU= 25.850
  18:47:23 STEP 2875 H=2875:00 +CPU= 16.111
  18:47:40 STEP 2876 H=2876:00 +CPU= 17.036
  18:48:05 STEP 2877 H=2877:00 +CPU= 25.273
  18:48:21 STEP 2878 H=2878:00 +CPU= 16.246
  18:48:38 STEP 2879 H=2879:00 +CPU= 17.121
  18:49:08 STEP 2880 H=2880:00 +CPU= 29.560
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_119.zip
Uploading the intermediate file: upload_file_119.zip
  18:49:24 STEP 2881 H=2881:00 +CPU= 16.144
  18:49:41 STEP 2882 H=2882:00 +CPU= 16.847
  18:50:06 STEP 2883 H=2883:00 +CPU= 25.470
  18:50:23 STEP 2884 H=2884:00 +CPU= 16.664
  18:50:40 STEP 2885 H=2885:00 +CPU= 16.386
  18:51:06 STEP 2886 H=2886:00 +CPU= 25.973
  18:51:22 STEP 2887 H=2887:00 +CPU= 16.072
  18:51:38 STEP 2888 H=2888:00 +CPU= 16.637
  18:52:04 STEP 2889 H=2889:00 +CPU= 25.512
  18:52:21 STEP 2890 H=2890:00 +CPU= 16.627
  18:52:37 STEP 2891 H=2891:00 +CPU= 16.356
  18:53:05 STEP 2892 H=2892:00 +CPU= 27.913
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002892
  18:53:21 STEP 2893 H=2893:00 +CPU= 16.094
  18:53:38 STEP 2894 H=2894:00 +CPU= 17.061
  18:54:04 STEP 2895 H=2895:00 +CPU= 25.479
  18:54:20 STEP 2896 H=2896:00 +CPU= 16.547
  18:54:37 STEP 2897 H=2897:00 +CPU= 16.505
  18:55:03 STEP 2898 H=2898:00 +CPU= 26.071
  18:55:19 STEP 2899 H=2899:00 +CPU= 16.475
  18:55:36 STEP 2900 H=2900:00 +CPU= 16.679
  18:56:02 STEP 2901 H=2901:00 +CPU= 25.612
  18:56:18 STEP 2902 H=2902:00 +CPU= 16.531
  18:56:35 STEP 2903 H=2903:00 +CPU= 16.802
  18:57:04 STEP 2904 H=2904:00 +CPU= 29.375
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_120.zip
Uploading the intermediate file: upload_file_120.zip
  18:57:20 STEP 2905 H=2905:00 +CPU= 16.125
  18:57:37 STEP 2906 H=2906:00 +CPU= 16.783
  18:58:03 STEP 2907 H=2907:00 +CPU= 25.739
  18:58:20 STEP 2908 H=2908:00 +CPU= 16.660
  18:58:37 STEP 2909 H=2909:00 +CPU= 16.133
  18:59:03 STEP 2910 H=2910:00 +CPU= 26.070
  18:59:19 STEP 2911 H=2911:00 +CPU= 16.228
  18:59:36 STEP 2912 H=2912:00 +CPU= 16.898
  19:00:01 STEP 2913 H=2913:00 +CPU= 25.490
  19:00:18 STEP 2914 H=2914:00 +CPU= 16.746
  19:00:34 STEP 2915 H=2915:00 +CPU= 16.098
  19:01:02 STEP 2916 H=2916:00 +CPU= 28.034
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002916
  19:01:18 STEP 2917 H=2917:00 +CPU= 16.104
  19:01:36 STEP 2918 H=2918:00 +CPU= 16.603
  19:02:02 STEP 2919 H=2919:00 +CPU= 25.758
  19:02:19 STEP 2920 H=2920:00 +CPU= 16.848
  19:02:36 STEP 2921 H=2921:00 +CPU= 16.511
  19:03:02 STEP 2922 H=2922:00 +CPU= 26.005
  19:03:18 STEP 2923 H=2923:00 +CPU= 16.313
  19:03:34 STEP 2924 H=2924:00 +CPU= 16.586
  19:04:00 STEP 2925 H=2925:00 +CPU= 25.508
  19:04:17 STEP 2926 H=2926:00 +CPU= 16.621
  19:04:34 STEP 2927 H=2927:00 +CPU= 17.004
  19:05:03 STEP 2928 H=2928:00 +CPU= 29.576
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_121.zip
Uploading the intermediate file: upload_file_121.zip
  19:05:19 STEP 2929 H=2929:00 +CPU= 16.022
  19:05:36 STEP 2930 H=2930:00 +CPU= 16.967
  19:06:02 STEP 2931 H=2931:00 +CPU= 25.698
  19:06:19 STEP 2932 H=2932:00 +CPU= 16.589
  19:06:35 STEP 2933 H=2933:00 +CPU= 16.167
  19:07:01 STEP 2934 H=2934:00 +CPU= 25.980
  19:07:17 STEP 2935 H=2935:00 +CPU= 16.229
  19:07:34 STEP 2936 H=2936:00 +CPU= 16.605
  19:07:59 STEP 2937 H=2937:00 +CPU= 25.437
  19:08:16 STEP 2938 H=2938:00 +CPU= 16.688
  19:08:32 STEP 2939 H=2939:00 +CPU= 16.359
  19:09:00 STEP 2940 H=2940:00 +CPU= 27.687
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002940
  19:09:16 STEP 2941 H=2941:00 +CPU= 16.473
  19:09:34 STEP 2942 H=2942:00 +CPU= 17.032
  19:09:59 STEP 2943 H=2943:00 +CPU= 25.280
  19:10:16 STEP 2944 H=2944:00 +CPU= 16.863
  19:10:32 STEP 2945 H=2945:00 +CPU= 16.497
  19:10:58 STEP 2946 H=2946:00 +CPU= 25.856
  19:11:14 STEP 2947 H=2947:00 +CPU= 16.402
  19:11:31 STEP 2948 H=2948:00 +CPU= 16.775
  19:11:57 STEP 2949 H=2949:00 +CPU= 25.276
  19:12:13 STEP 2950 H=2950:00 +CPU= 16.626
  19:12:30 STEP 2951 H=2951:00 +CPU= 16.633
  19:12:59 STEP 2952 H=2952:00 +CPU= 28.771
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.260318722649E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.48989191816039E-02 -1.72994898449055E+00  1.89761310057317E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.14738107083738     
  MAXGPFV : MAX. VALUE =   0.737301564542695     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    351801882 BYTES IN      8 RECORDS TRANSFERRED IN    0.0005 SECONDS703603.8 Mbytes/s, TOTAL TIME=    0.0085( 5.9%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 19:12:59 STEP 2952 H=2952:00 +CPU= 28.771
 END CNT3
 NSTEP =  2952 CNT0   000000000  25.200  25.200  25.223   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           35/   804992476 WRITTEN        44014/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1065    0       35       786125    44014 ************   225.1     2.1   223.0     2.6   310.4
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 *********       0.0    100.00   -100.00
   1 CNT4     - FORWARD INTEGRATION                  1 *********       0.0    100.00   -100.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3069    1759.1    1759.1      0.00      0.00
   9 SPCM     - SPECTRAL COMP.                    2832     241.6     241.6      0.00      0.00
  10 SCAN2M - PHYSICS                             2833   25794.4   25794.4      0.00      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                236     987.5     987.5      0.00      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                119      13.9      13.9      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      945    8909.4    8909.4      0.00      0.00
  17 GRIDFPOS IN CNT4                              236     301.1     301.1      0.00      0.00
  27 RESTART FILES - WRITING                       118    1975.0    1975.0      0.00      0.00
  28 RESTART FILES - READING                         1    3124.5    3124.5      0.00      0.00
  29 SU4FPOS IN CNT4                               236       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               236    1655.8    1655.8      0.00      0.00
  31 POSDDH IN STEPO                                12      40.7      40.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2833    2476.5    2476.5      0.00      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2833  -73702.7       0.0    189.38   -189.38
  39 SU0YOMB                                         1     269.0     269.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2833      11.8      11.8      0.00      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2832     164.7     164.7      0.00      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2832      19.0      19.0      0.00      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                119       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     9682     101.3     101.3      0.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      5900      92.1      92.1      0.00      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       5900      40.3      40.3      0.00      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      9682      31.4      31.4      0.00      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      15.8      15.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           9682      15.7      15.7      0.00      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           5900      13.5      13.5      0.00      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           9682      20.0      20.0      0.00      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           5900      15.4      15.4      0.00      0.00
 400 GSTATS                                     564180       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                540339       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME  -110252.3 CPU TIME   56266.5 VECTOR TIME    56266.5


===-=== END   OF TIMING STATISTICS ===-===
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/15/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/15/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_1_r1083561227_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
19:16:22 (5488): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:34 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 10,623,600 64,041 0.0060
09 May 2023 16:54:33 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 9,936,000 60,231 0.0061
09 May 2023 16:54:31 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 9,072,000 55,473 0.0061
09 May 2023 16:54:30 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 8,208,000 50,735 0.0062
09 May 2023 16:54:28 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 7,344,000 45,948 0.0063
09 May 2023 16:54:26 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 6,480,000 41,087 0.0063
09 May 2023 16:54:25 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 5,616,000 36,323 0.0065
09 May 2023 16:54:24 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 4,752,000 31,584 0.0066
09 May 2023 16:54:21 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 3,888,000 26,840 0.0069
09 May 2023 16:54:20 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 3,024,000 22,093 0.0073
09 May 2023 16:54:18 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 2,160,000 17,344 0.0080
09 May 2023 16:54:14 1469580 22316954 oifs_43r3_00gd_2019110100_123_993_12214027_1 1,296,000 12,603 0.0097


©2024 climateprediction.net