climateprediction.net home page
Task 22315244

Task 22315244

Name oifs_43r3_00cl_2019110100_123_993_12213891_0
Workunit 12213891
Created 24 Feb 2023, 13:04:38 UTC
Sent 25 Feb 2023, 1:39:22 UTC
Report deadline 26 Apr 2023, 1:39:22 UTC
Received 26 Feb 2023, 2:43:08 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1496046
Run time 23 hours 25 min 42 sec
CPU time 23 hours 13 min 37 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.39 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,416.32 MB
Peak swap size 4,974.79 MB
Peak disk usage 1,540.48 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
2213891_0_r298218781_97.zip
Uploading the intermediate file: upload_file_97.zip
  15:41:15 STEP 2354 H=2354:00 +CPU= 24.489
  15:41:52 STEP 2355 H=2355:00 +CPU= 36.850
  15:42:17 STEP 2356 H=2356:00 +CPU= 24.760
  15:42:42 STEP 2357 H=2357:00 +CPU= 24.416
  15:43:21 STEP 2358 H=2358:00 +CPU= 38.260
  15:43:45 STEP 2359 H=2359:00 +CPU= 24.571
  15:44:11 STEP 2360 H=2360:00 +CPU= 25.257
  15:44:48 STEP 2361 H=2361:00 +CPU= 36.936
  15:45:12 STEP 2362 H=2362:00 +CPU= 24.141
  15:45:36 STEP 2363 H=2363:00 +CPU= 23.894
  15:46:15 STEP 2364 H=2364:00 +CPU= 38.938
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002364
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002364
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002364
  15:46:39 STEP 2365 H=2365:00 +CPU= 23.677
  15:47:04 STEP 2366 H=2366:00 +CPU= 24.581
  15:47:40 STEP 2367 H=2367:00 +CPU= 36.210
  15:48:05 STEP 2368 H=2368:00 +CPU= 24.800
  15:48:29 STEP 2369 H=2369:00 +CPU= 23.774
  15:49:06 STEP 2370 H=2370:00 +CPU= 37.195
  15:49:29 STEP 2371 H=2371:00 +CPU= 23.151
  15:49:53 STEP 2372 H=2372:00 +CPU= 23.649
  15:50:29 STEP 2373 H=2373:00 +CPU= 35.769
  15:50:54 STEP 2374 H=2374:00 +CPU= 24.257
  15:51:18 STEP 2375 H=2375:00 +CPU= 24.447
  15:52:01 STEP 2376 H=2376:00 +CPU= 42.705
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002376
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002376
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002376
  15:52:24 STEP 2377 H=2377:00 +CPU= 23.190
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002364
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002364
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002364
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002376
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002376
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002376
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_98.zip
Uploading the intermediate file: upload_file_98.zip
  15:52:48 STEP 2378 H=2378:00 +CPU= 23.735
  15:53:25 STEP 2379 H=2379:00 +CPU= 36.280
  15:53:50 STEP 2380 H=2380:00 +CPU= 25.147
  15:54:15 STEP 2381 H=2381:00 +CPU= 24.700
  15:54:54 STEP 2382 H=2382:00 +CPU= 38.781
  15:55:20 STEP 2383 H=2383:00 +CPU= 25.136
  15:55:45 STEP 2384 H=2384:00 +CPU= 25.107
  15:56:23 STEP 2385 H=2385:00 +CPU= 37.590
  15:56:48 STEP 2386 H=2386:00 +CPU= 25.079
  15:57:12 STEP 2387 H=2387:00 +CPU= 23.803
  15:57:51 STEP 2388 H=2388:00 +CPU= 38.911
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002388
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002388
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002388
  15:58:15 STEP 2389 H=2389:00 +CPU= 24.181
  15:58:40 STEP 2390 H=2390:00 +CPU= 24.553
  15:59:17 STEP 2391 H=2391:00 +CPU= 36.596
  15:59:41 STEP 2392 H=2392:00 +CPU= 24.572
  16:00:06 STEP 2393 H=2393:00 +CPU= 24.327
  16:00:44 STEP 2394 H=2394:00 +CPU= 37.680
  16:01:08 STEP 2395 H=2395:00 +CPU= 24.553
  16:01:33 STEP 2396 H=2396:00 +CPU= 24.914
  16:02:11 STEP 2397 H=2397:00 +CPU= 36.944
  16:02:36 STEP 2398 H=2398:00 +CPU= 24.835
  16:03:00 STEP 2399 H=2399:00 +CPU= 24.234
  16:03:45 STEP 2400 H=2400:00 +CPU= 44.632
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002400
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002400
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002400
  16:04:10 STEP 2401 H=2401:00 +CPU= 25.633
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002388
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002388
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002388
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002400
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002400
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002400
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_99.zip
Uploading the intermediate file: upload_file_99.zip
  16:04:36 STEP 2402 H=2402:00 +CPU= 25.144
  16:05:13 STEP 2403 H=2403:00 +CPU= 37.204
  16:05:39 STEP 2404 H=2404:00 +CPU= 25.093
  16:06:04 STEP 2405 H=2405:00 +CPU= 24.894
  16:06:43 STEP 2406 H=2406:00 +CPU= 38.571
  16:07:08 STEP 2407 H=2407:00 +CPU= 24.510
  16:07:32 STEP 2408 H=2408:00 +CPU= 23.939
  16:08:10 STEP 2409 H=2409:00 +CPU= 37.544
  16:08:35 STEP 2410 H=2410:00 +CPU= 25.438
  16:09:00 STEP 2411 H=2411:00 +CPU= 24.347
  16:09:41 STEP 2412 H=2412:00 +CPU= 40.643
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002412
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002412
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002412
  16:10:05 STEP 2413 H=2413:00 +CPU= 24.023
  16:10:30 STEP 2414 H=2414:00 +CPU= 24.779
  16:11:07 STEP 2415 H=2415:00 +CPU= 36.856
  16:11:33 STEP 2416 H=2416:00 +CPU= 25.896
  16:11:57 STEP 2417 H=2417:00 +CPU= 24.354
  16:12:34 STEP 2418 H=2418:00 +CPU= 36.670
  16:12:57 STEP 2419 H=2419:00 +CPU= 23.324
  16:13:22 STEP 2420 H=2420:00 +CPU= 24.491
  16:13:59 STEP 2421 H=2421:00 +CPU= 36.936
  16:14:23 STEP 2422 H=2422:00 +CPU= 24.236
  16:14:49 STEP 2423 H=2423:00 +CPU= 25.257
  16:15:32 STEP 2424 H=2424:00 +CPU= 42.938
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002424
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002424
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002424
  16:15:56 STEP 2425 H=2425:00 +CPU= 23.941
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002412
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002412
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002412
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002424
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002424
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002424
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_100.zip
Uploading the intermediate file: upload_file_100.zip
  16:16:23 STEP 2426 H=2426:00 +CPU= 26.331
  16:17:00 STEP 2427 H=2427:00 +CPU= 37.574
  16:17:27 STEP 2428 H=2428:00 +CPU= 26.461
  16:17:52 STEP 2429 H=2429:00 +CPU= 24.797
  16:18:30 STEP 2430 H=2430:00 +CPU= 37.467
  16:18:54 STEP 2431 H=2431:00 +CPU= 24.280
  16:19:19 STEP 2432 H=2432:00 +CPU= 24.281
  16:19:54 STEP 2433 H=2433:00 +CPU= 35.744
  16:20:19 STEP 2434 H=2434:00 +CPU= 24.371
  16:20:43 STEP 2435 H=2435:00 +CPU= 23.753
  16:21:23 STEP 2436 H=2436:00 +CPU= 40.036
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002436
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002436
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002436
  16:21:48 STEP 2437 H=2437:00 +CPU= 24.567
  16:22:13 STEP 2438 H=2438:00 +CPU= 24.936
  16:22:50 STEP 2439 H=2439:00 +CPU= 36.934
  16:23:16 STEP 2440 H=2440:00 +CPU= 25.665
  16:23:40 STEP 2441 H=2441:00 +CPU= 23.777
  16:24:18 STEP 2442 H=2442:00 +CPU= 38.132
  16:24:42 STEP 2443 H=2443:00 +CPU= 24.048
  16:25:07 STEP 2444 H=2444:00 +CPU= 25.044
  16:25:45 STEP 2445 H=2445:00 +CPU= 37.209
  16:26:09 STEP 2446 H=2446:00 +CPU= 24.157
  16:26:34 STEP 2447 H=2447:00 +CPU= 25.419
  16:27:19 STEP 2448 H=2448:00 +CPU= 44.518
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002448
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002448
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002448
  16:27:45 STEP 2449 H=2449:00 +CPU= 25.928
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002436
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002436
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002436
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002448
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002448
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002448
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_101.zip
Uploading the intermediate file: upload_file_101.zip
  16:28:11 STEP 2450 H=2450:00 +CPU= 25.820
  16:28:50 STEP 2451 H=2451:00 +CPU= 38.402
  16:29:15 STEP 2452 H=2452:00 +CPU= 25.375
  16:29:40 STEP 2453 H=2453:00 +CPU= 24.859
  16:30:18 STEP 2454 H=2454:00 +CPU= 38.099
  16:30:45 STEP 2455 H=2455:00 +CPU= 26.076
  16:31:10 STEP 2456 H=2456:00 +CPU= 24.961
  16:31:49 STEP 2457 H=2457:00 +CPU= 38.894
  16:32:14 STEP 2458 H=2458:00 +CPU= 25.202
  16:32:39 STEP 2459 H=2459:00 +CPU= 25.153
  16:33:23 STEP 2460 H=2460:00 +CPU= 43.407
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002460
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002460
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002460
  16:33:48 STEP 2461 H=2461:00 +CPU= 25.176
  16:34:15 STEP 2462 H=2462:00 +CPU= 26.728
  16:34:52 STEP 2463 H=2463:00 +CPU= 36.851
  16:35:18 STEP 2464 H=2464:00 +CPU= 25.522
  16:35:42 STEP 2465 H=2465:00 +CPU= 24.172
  16:36:19 STEP 2466 H=2466:00 +CPU= 37.054
  16:36:44 STEP 2467 H=2467:00 +CPU= 24.456
  16:37:11 STEP 2468 H=2468:00 +CPU= 26.369
  16:37:50 STEP 2469 H=2469:00 +CPU= 39.118
  16:38:15 STEP 2470 H=2470:00 +CPU= 24.874
  16:38:41 STEP 2471 H=2471:00 +CPU= 25.961
  16:39:26 STEP 2472 H=2472:00 +CPU= 44.500
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002472
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002472
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002472
  16:39:50 STEP 2473 H=2473:00 +CPU= 24.054
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002460
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002460
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002460
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002472
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002472
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002472
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_102.zip
Uploading the intermediate file: upload_file_102.zip
Uploading trickle at timestep: 8902800
  16:40:15 STEP 2474 H=2474:00 +CPU= 24.955
  16:40:53 STEP 2475 H=2475:00 +CPU= 37.425
  16:41:19 STEP 2476 H=2476:00 +CPU= 26.331
  16:41:44 STEP 2477 H=2477:00 +CPU= 24.250
  16:42:22 STEP 2478 H=2478:00 +CPU= 37.897
  16:42:47 STEP 2479 H=2479:00 +CPU= 25.360
  16:43:13 STEP 2480 H=2480:00 +CPU= 26.069
  16:43:51 STEP 2481 H=2481:00 +CPU= 37.669
  16:44:16 STEP 2482 H=2482:00 +CPU= 24.550
  16:44:42 STEP 2483 H=2483:00 +CPU= 25.456
  16:45:26 STEP 2484 H=2484:00 +CPU= 44.247
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002484
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002484
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002484
  16:45:52 STEP 2485 H=2485:00 +CPU= 25.249
  16:46:18 STEP 2486 H=2486:00 +CPU= 25.476
  16:46:55 STEP 2487 H=2487:00 +CPU= 36.975
  16:47:19 STEP 2488 H=2488:00 +CPU= 24.483
  16:47:42 STEP 2489 H=2489:00 +CPU= 22.747
  16:48:22 STEP 2490 H=2490:00 +CPU= 39.732
  16:48:47 STEP 2491 H=2491:00 +CPU= 24.637
  16:49:11 STEP 2492 H=2492:00 +CPU= 24.280
  16:49:48 STEP 2493 H=2493:00 +CPU= 36.510
  16:50:12 STEP 2494 H=2494:00 +CPU= 23.916
  16:50:37 STEP 2495 H=2495:00 +CPU= 24.885
  16:51:21 STEP 2496 H=2496:00 +CPU= 43.972
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002496
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002496
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002496
  16:51:46 STEP 2497 H=2497:00 +CPU= 23.958
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002484
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002484
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002484
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002496
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002496
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002496
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_103.zip
Uploading the intermediate file: upload_file_103.zip
  16:52:10 STEP 2498 H=2498:00 +CPU= 24.636
  16:52:47 STEP 2499 H=2499:00 +CPU= 36.710
  16:53:13 STEP 2500 H=2500:00 +CPU= 25.278
  16:53:38 STEP 2501 H=2501:00 +CPU= 24.776
  16:54:17 STEP 2502 H=2502:00 +CPU= 38.755
  16:54:42 STEP 2503 H=2503:00 +CPU= 24.768
  16:55:07 STEP 2504 H=2504:00 +CPU= 25.019
  16:55:44 STEP 2505 H=2505:00 +CPU= 36.280
  16:56:09 STEP 2506 H=2506:00 +CPU= 24.900
  16:56:33 STEP 2507 H=2507:00 +CPU= 23.717
  16:57:13 STEP 2508 H=2508:00 +CPU= 39.870
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002508
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002508
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002508
  16:57:38 STEP 2509 H=2509:00 +CPU= 24.676
  16:58:02 STEP 2510 H=2510:00 +CPU= 24.685
  16:58:39 STEP 2511 H=2511:00 +CPU= 36.646
  16:59:04 STEP 2512 H=2512:00 +CPU= 24.827
  16:59:28 STEP 2513 H=2513:00 +CPU= 23.642
  17:00:06 STEP 2514 H=2514:00 +CPU= 37.370
  17:00:29 STEP 2515 H=2515:00 +CPU= 23.618
  17:00:53 STEP 2516 H=2516:00 +CPU= 24.141
  17:01:31 STEP 2517 H=2517:00 +CPU= 37.729
  17:01:56 STEP 2518 H=2518:00 +CPU= 24.860
  17:02:22 STEP 2519 H=2519:00 +CPU= 24.908
  17:03:06 STEP 2520 H=2520:00 +CPU= 44.329
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002520
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002520
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002520
  17:03:30 STEP 2521 H=2521:00 +CPU= 24.104
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002508
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002508
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002508
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002520
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002520
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002520
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_104.zip
Uploading the intermediate file: upload_file_104.zip
  17:03:56 STEP 2522 H=2522:00 +CPU= 25.752
  17:04:33 STEP 2523 H=2523:00 +CPU= 37.027
  17:04:59 STEP 2524 H=2524:00 +CPU= 25.513
  17:05:23 STEP 2525 H=2525:00 +CPU= 23.975
  17:06:02 STEP 2526 H=2526:00 +CPU= 38.931
  17:06:27 STEP 2527 H=2527:00 +CPU= 24.795
  17:06:53 STEP 2528 H=2528:00 +CPU= 24.974
  17:07:29 STEP 2529 H=2529:00 +CPU= 36.028
  17:07:55 STEP 2530 H=2530:00 +CPU= 26.403
  17:08:19 STEP 2531 H=2531:00 +CPU= 23.883
  17:08:59 STEP 2532 H=2532:00 +CPU= 40.045
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002532
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002532
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002532
  17:09:23 STEP 2533 H=2533:00 +CPU= 23.508
  17:09:48 STEP 2534 H=2534:00 +CPU= 24.575
  17:10:26 STEP 2535 H=2535:00 +CPU= 37.843
  17:10:51 STEP 2536 H=2536:00 +CPU= 25.119
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           11  MAX ETADOT VERTICAL VEL.=   2.522278025633483E-007
  LON  =    171.250000000000       degrees
  LAT  =    39.8128523737712       degrees
  17:11:15 STEP 2537 H=2537:00 +CPU= 24.172
  17:11:54 STEP 2538 H=2538:00 +CPU= 38.596
  17:12:19 STEP 2539 H=2539:00 +CPU= 25.185
  17:12:43 STEP 2540 H=2540:00 +CPU= 23.927
  17:13:22 STEP 2541 H=2541:00 +CPU= 38.153
  17:13:47 STEP 2542 H=2542:00 +CPU= 24.697
  17:14:12 STEP 2543 H=2543:00 +CPU= 25.410
  17:14:57 STEP 2544 H=2544:00 +CPU= 44.555
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002544
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002544
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002544
  17:15:22 STEP 2545 H=2545:00 +CPU= 24.884
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002532
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002532
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002532
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002544
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002544
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002544
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_105.zip
Uploading the intermediate file: upload_file_105.zip
  17:15:48 STEP 2546 H=2546:00 +CPU= 25.603
  17:16:27 STEP 2547 H=2547:00 +CPU= 38.777
  17:16:53 STEP 2548 H=2548:00 +CPU= 25.051
  17:17:19 STEP 2549 H=2549:00 +CPU= 25.630
  17:17:57 STEP 2550 H=2550:00 +CPU= 38.725
  17:18:22 STEP 2551 H=2551:00 +CPU= 24.867
  17:18:47 STEP 2552 H=2552:00 +CPU= 24.204
  17:19:23 STEP 2553 H=2553:00 +CPU= 35.972
  17:19:48 STEP 2554 H=2554:00 +CPU= 25.017
  17:20:13 STEP 2555 H=2555:00 +CPU= 24.430
  17:20:53 STEP 2556 H=2556:00 +CPU= 40.242
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002556
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002556
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002556
  17:21:18 STEP 2557 H=2557:00 +CPU= 24.240
  17:21:43 STEP 2558 H=2558:00 +CPU= 24.911
  17:22:19 STEP 2559 H=2559:00 +CPU= 36.554
  17:22:45 STEP 2560 H=2560:00 +CPU= 25.244
  17:23:10 STEP 2561 H=2561:00 +CPU= 24.677
  17:23:47 STEP 2562 H=2562:00 +CPU= 37.033
  17:24:11 STEP 2563 H=2563:00 +CPU= 24.198
  17:24:38 STEP 2564 H=2564:00 +CPU= 26.579
  17:25:15 STEP 2565 H=2565:00 +CPU= 37.211
  17:25:40 STEP 2566 H=2566:00 +CPU= 24.555
  17:26:06 STEP 2567 H=2567:00 +CPU= 25.868
  17:26:51 STEP 2568 H=2568:00 +CPU= 44.576
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002568
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002568
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002568
  17:27:17 STEP 2569 H=2569:00 +CPU= 25.542
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002556
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002556
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002556
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002568
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002568
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002568
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_106.zip
Uploading the intermediate file: upload_file_106.zip
  17:27:43 STEP 2570 H=2570:00 +CPU= 25.844
  17:28:21 STEP 2571 H=2571:00 +CPU= 37.567
  17:28:48 STEP 2572 H=2572:00 +CPU= 26.541
  17:29:11 STEP 2573 H=2573:00 +CPU= 23.449
  17:29:50 STEP 2574 H=2574:00 +CPU= 38.278
  17:30:15 STEP 2575 H=2575:00 +CPU= 24.846
  17:30:40 STEP 2576 H=2576:00 +CPU= 25.376
  17:31:18 STEP 2577 H=2577:00 +CPU= 37.360
  17:31:43 STEP 2578 H=2578:00 +CPU= 24.892
  17:32:08 STEP 2579 H=2579:00 +CPU= 25.128
  17:32:50 STEP 2580 H=2580:00 +CPU= 41.594
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002580
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002580
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002580
  17:33:14 STEP 2581 H=2581:00 +CPU= 24.617
  17:33:40 STEP 2582 H=2582:00 +CPU= 25.136
  17:34:17 STEP 2583 H=2583:00 +CPU= 37.490
  17:34:43 STEP 2584 H=2584:00 +CPU= 25.746
  17:35:07 STEP 2585 H=2585:00 +CPU= 24.026
  17:35:46 STEP 2586 H=2586:00 +CPU= 38.306
  17:36:11 STEP 2587 H=2587:00 +CPU= 25.182
  17:36:36 STEP 2588 H=2588:00 +CPU= 24.874
  17:37:14 STEP 2589 H=2589:00 +CPU= 37.921
  17:37:41 STEP 2590 H=2590:00 +CPU= 26.426
  17:38:09 STEP 2591 H=2591:00 +CPU= 27.563
  17:38:55 STEP 2592 H=2592:00 +CPU= 45.866
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002592
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002592
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002592
  17:39:19 STEP 2593 H=2593:00 +CPU= 24.655
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002580
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002580
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002580
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002592
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002592
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002592
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_107.zip
Uploading the intermediate file: upload_file_107.zip
  17:39:44 STEP 2594 H=2594:00 +CPU= 24.909
  17:40:23 STEP 2595 H=2595:00 +CPU= 38.510
  17:40:48 STEP 2596 H=2596:00 +CPU= 24.591
  17:41:14 STEP 2597 H=2597:00 +CPU= 25.100
  17:41:52 STEP 2598 H=2598:00 +CPU= 38.234
  17:42:17 STEP 2599 H=2599:00 +CPU= 24.916
  17:42:43 STEP 2600 H=2600:00 +CPU= 25.118
  17:43:20 STEP 2601 H=2601:00 +CPU= 37.504
  17:43:45 STEP 2602 H=2602:00 +CPU= 24.708
  17:44:10 STEP 2603 H=2603:00 +CPU= 24.717
  17:44:50 STEP 2604 H=2604:00 +CPU= 39.343
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002604
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002604
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002604
  17:45:14 STEP 2605 H=2605:00 +CPU= 24.663
  17:45:39 STEP 2606 H=2606:00 +CPU= 24.942
  17:46:17 STEP 2607 H=2607:00 +CPU= 37.686
  17:46:43 STEP 2608 H=2608:00 +CPU= 25.954
  17:47:09 STEP 2609 H=2609:00 +CPU= 25.478
  17:47:48 STEP 2610 H=2610:00 +CPU= 38.829
  17:48:14 STEP 2611 H=2611:00 +CPU= 25.457
  17:48:41 STEP 2612 H=2612:00 +CPU= 26.443
  17:49:19 STEP 2613 H=2613:00 +CPU= 37.690
  17:49:44 STEP 2614 H=2614:00 +CPU= 25.382
  17:50:10 STEP 2615 H=2615:00 +CPU= 25.187
  17:50:55 STEP 2616 H=2616:00 +CPU= 44.600
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002616
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002616
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002616
  17:51:19 STEP 2617 H=2617:00 +CPU= 24.816
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002604
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002604
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002604
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002616
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002616
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002616
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_108.zip
Uploading the intermediate file: upload_file_108.zip
  17:51:45 STEP 2618 H=2618:00 +CPU= 25.522
  17:52:24 STEP 2619 H=2619:00 +CPU= 38.755
  17:52:49 STEP 2620 H=2620:00 +CPU= 25.300
  17:53:15 STEP 2621 H=2621:00 +CPU= 25.606
  17:53:53 STEP 2622 H=2622:00 +CPU= 38.082
  17:54:19 STEP 2623 H=2623:00 +CPU= 25.659
  17:54:45 STEP 2624 H=2624:00 +CPU= 25.280
  17:55:23 STEP 2625 H=2625:00 +CPU= 38.046
  17:55:48 STEP 2626 H=2626:00 +CPU= 24.913
  17:56:13 STEP 2627 H=2627:00 +CPU= 25.385
  17:56:56 STEP 2628 H=2628:00 +CPU= 42.337
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002628
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002628
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002628
  17:57:22 STEP 2629 H=2629:00 +CPU= 25.420
  17:57:48 STEP 2630 H=2630:00 +CPU= 25.922
  17:58:26 STEP 2631 H=2631:00 +CPU= 38.018
  17:58:51 STEP 2632 H=2632:00 +CPU= 25.011
  17:59:18 STEP 2633 H=2633:00 +CPU= 26.479
  17:59:57 STEP 2634 H=2634:00 +CPU= 38.614
  18:00:22 STEP 2635 H=2635:00 +CPU= 24.959
  18:00:47 STEP 2636 H=2636:00 +CPU= 25.447
  18:01:25 STEP 2637 H=2637:00 +CPU= 37.090
  18:01:51 STEP 2638 H=2638:00 +CPU= 26.137
  18:02:16 STEP 2639 H=2639:00 +CPU= 24.787
  18:03:03 STEP 2640 H=2640:00 +CPU= 46.529
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002640
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002640
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002640
  18:03:28 STEP 2641 H=2641:00 +CPU= 25.038
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002628
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002628
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002628
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002640
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002640
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002640
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_109.zip
Uploading the intermediate file: upload_file_109.zip
  18:03:53 STEP 2642 H=2642:00 +CPU= 24.408
  18:04:30 STEP 2643 H=2643:00 +CPU= 36.810
  18:04:55 STEP 2644 H=2644:00 +CPU= 24.323
  18:05:18 STEP 2645 H=2645:00 +CPU= 23.396
  18:05:57 STEP 2646 H=2646:00 +CPU= 38.253
  18:06:22 STEP 2647 H=2647:00 +CPU= 24.997
  18:06:49 STEP 2648 H=2648:00 +CPU= 26.059
  18:07:29 STEP 2649 H=2649:00 +CPU= 40.076
  18:07:54 STEP 2650 H=2650:00 +CPU= 25.594
  18:08:20 STEP 2651 H=2651:00 +CPU= 25.115
  18:08:59 STEP 2652 H=2652:00 +CPU= 38.791
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002652
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002652
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002652
  18:09:22 STEP 2653 H=2653:00 +CPU= 23.788
  18:09:48 STEP 2654 H=2654:00 +CPU= 25.198
  18:10:27 STEP 2655 H=2655:00 +CPU= 38.583
  18:10:51 STEP 2656 H=2656:00 +CPU= 24.570
  18:11:16 STEP 2657 H=2657:00 +CPU= 25.123
  18:11:55 STEP 2658 H=2658:00 +CPU= 38.421
  18:12:19 STEP 2659 H=2659:00 +CPU= 24.082
  18:12:44 STEP 2660 H=2660:00 +CPU= 25.215
  18:13:21 STEP 2661 H=2661:00 +CPU= 36.211
  18:13:45 STEP 2662 H=2662:00 +CPU= 24.314
  18:14:09 STEP 2663 H=2663:00 +CPU= 24.236
  18:14:52 STEP 2664 H=2664:00 +CPU= 42.267
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002664
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002664
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002664
  18:15:16 STEP 2665 H=2665:00 +CPU= 24.105
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002652
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002652
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002652
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002664
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002664
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002664
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_110.zip
Uploading the intermediate file: upload_file_110.zip
  18:15:41 STEP 2666 H=2666:00 +CPU= 24.069
  18:16:19 STEP 2667 H=2667:00 +CPU= 37.871
  18:16:43 STEP 2668 H=2668:00 +CPU= 23.955
  18:17:08 STEP 2669 H=2669:00 +CPU= 24.246
  18:17:46 STEP 2670 H=2670:00 +CPU= 38.216
  18:18:11 STEP 2671 H=2671:00 +CPU= 24.269
  18:18:36 STEP 2672 H=2672:00 +CPU= 25.333
  18:19:13 STEP 2673 H=2673:00 +CPU= 36.449
  18:19:36 STEP 2674 H=2674:00 +CPU= 23.062
  18:20:00 STEP 2675 H=2675:00 +CPU= 23.813
  18:20:39 STEP 2676 H=2676:00 +CPU= 38.496
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002676
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002676
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002676
  18:21:04 STEP 2677 H=2677:00 +CPU= 24.835
  18:21:29 STEP 2678 H=2678:00 +CPU= 25.186
  18:22:06 STEP 2679 H=2679:00 +CPU= 36.293
  18:22:31 STEP 2680 H=2680:00 +CPU= 24.805
  18:22:55 STEP 2681 H=2681:00 +CPU= 24.048
  18:23:31 STEP 2682 H=2682:00 +CPU= 36.216
  18:23:55 STEP 2683 H=2683:00 +CPU= 23.176
  18:24:19 STEP 2684 H=2684:00 +CPU= 24.567
  18:24:59 STEP 2685 H=2685:00 +CPU= 39.494
  18:25:27 STEP 2686 H=2686:00 +CPU= 27.074
  18:25:53 STEP 2687 H=2687:00 +CPU= 25.676
  18:26:37 STEP 2688 H=2688:00 +CPU= 43.532
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002688
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002688
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002688
  18:27:01 STEP 2689 H=2689:00 +CPU= 24.064
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002676
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002676
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002676
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002688
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002688
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002688
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_111.zip
Uploading the intermediate file: upload_file_111.zip
  18:27:27 STEP 2690 H=2690:00 +CPU= 26.204
  18:28:05 STEP 2691 H=2691:00 +CPU= 37.672
  18:28:31 STEP 2692 H=2692:00 +CPU= 25.652
  18:28:57 STEP 2693 H=2693:00 +CPU= 25.569
  18:29:35 STEP 2694 H=2694:00 +CPU= 38.621
  18:30:00 STEP 2695 H=2695:00 +CPU= 24.695
  18:30:26 STEP 2696 H=2696:00 +CPU= 25.154
  18:31:03 STEP 2697 H=2697:00 +CPU= 37.384
  18:31:29 STEP 2698 H=2698:00 +CPU= 25.865
  18:31:54 STEP 2699 H=2699:00 +CPU= 24.680
  18:32:36 STEP 2700 H=2700:00 +CPU= 41.451
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002700
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002700
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002700
  18:33:01 STEP 2701 H=2701:00 +CPU= 24.925
  18:33:26 STEP 2702 H=2702:00 +CPU= 25.093
  18:34:04 STEP 2703 H=2703:00 +CPU= 37.421
  18:34:31 STEP 2704 H=2704:00 +CPU= 26.147
  18:34:56 STEP 2705 H=2705:00 +CPU= 24.516
  18:35:35 STEP 2706 H=2706:00 +CPU= 39.438
  18:36:00 STEP 2707 H=2707:00 +CPU= 24.650
  18:36:25 STEP 2708 H=2708:00 +CPU= 25.205
  18:37:03 STEP 2709 H=2709:00 +CPU= 37.040
  18:37:27 STEP 2710 H=2710:00 +CPU= 24.337
  18:37:54 STEP 2711 H=2711:00 +CPU= 26.437
  18:38:39 STEP 2712 H=2712:00 +CPU= 44.834
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002712
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002712
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002712
  18:39:03 STEP 2713 H=2713:00 +CPU= 24.245
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002700
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002700
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002700
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002712
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002712
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002712
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_112.zip
Uploading the intermediate file: upload_file_112.zip
Uploading trickle at timestep: 9766800
  18:39:29 STEP 2714 H=2714:00 +CPU= 25.628
  18:40:06 STEP 2715 H=2715:00 +CPU= 37.236
  18:40:31 STEP 2716 H=2716:00 +CPU= 24.567
  18:40:56 STEP 2717 H=2717:00 +CPU= 24.706
  18:41:34 STEP 2718 H=2718:00 +CPU= 37.641
  18:41:57 STEP 2719 H=2719:00 +CPU= 23.654
  18:42:23 STEP 2720 H=2720:00 +CPU= 25.034
  18:43:01 STEP 2721 H=2721:00 +CPU= 38.340
  18:43:25 STEP 2722 H=2722:00 +CPU= 24.211
  18:43:50 STEP 2723 H=2723:00 +CPU= 24.136
  18:44:31 STEP 2724 H=2724:00 +CPU= 40.653
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002724
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002724
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002724
  18:44:55 STEP 2725 H=2725:00 +CPU= 24.255
  18:45:21 STEP 2726 H=2726:00 +CPU= 25.161
  18:45:59 STEP 2727 H=2727:00 +CPU= 37.693
  18:46:26 STEP 2728 H=2728:00 +CPU= 26.939
  18:46:51 STEP 2729 H=2729:00 +CPU= 25.255
  18:47:30 STEP 2730 H=2730:00 +CPU= 38.728
  18:47:55 STEP 2731 H=2731:00 +CPU= 24.456
  18:48:21 STEP 2732 H=2732:00 +CPU= 25.330
  18:48:59 STEP 2733 H=2733:00 +CPU= 38.429
  18:49:25 STEP 2734 H=2734:00 +CPU= 25.612
  18:49:50 STEP 2735 H=2735:00 +CPU= 24.993
  18:50:34 STEP 2736 H=2736:00 +CPU= 43.490
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002736
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002736
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002736
  18:50:58 STEP 2737 H=2737:00 +CPU= 24.014
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002724
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002724
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002724
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002736
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002736
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002736
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_113.zip
Uploading the intermediate file: upload_file_113.zip
  18:51:23 STEP 2738 H=2738:00 +CPU= 24.211
  18:52:00 STEP 2739 H=2739:00 +CPU= 37.302
  18:52:25 STEP 2740 H=2740:00 +CPU= 24.936
  18:52:50 STEP 2741 H=2741:00 +CPU= 24.157
  18:53:30 STEP 2742 H=2742:00 +CPU= 39.790
  18:53:55 STEP 2743 H=2743:00 +CPU= 25.197
  18:54:20 STEP 2744 H=2744:00 +CPU= 25.148
  18:54:58 STEP 2745 H=2745:00 +CPU= 37.356
  18:55:24 STEP 2746 H=2746:00 +CPU= 25.902
  18:55:49 STEP 2747 H=2747:00 +CPU= 25.303
  18:56:31 STEP 2748 H=2748:00 +CPU= 40.912
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002748
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002748
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002748
  18:56:55 STEP 2749 H=2749:00 +CPU= 24.564
  18:57:20 STEP 2750 H=2750:00 +CPU= 24.484
  18:58:00 STEP 2751 H=2751:00 +CPU= 38.985
  18:58:28 STEP 2752 H=2752:00 +CPU= 27.691
  18:58:55 STEP 2753 H=2753:00 +CPU= 26.116
  18:59:35 STEP 2754 H=2754:00 +CPU= 40.225
  19:00:00 STEP 2755 H=2755:00 +CPU= 24.673
  19:00:27 STEP 2756 H=2756:00 +CPU= 26.384
  19:01:04 STEP 2757 H=2757:00 +CPU= 37.004
  19:01:29 STEP 2758 H=2758:00 +CPU= 25.070
  19:01:57 STEP 2759 H=2759:00 +CPU= 27.334
  19:02:41 STEP 2760 H=2760:00 +CPU= 44.169
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002760
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002760
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002760
  19:03:06 STEP 2761 H=2761:00 +CPU= 24.763
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002748
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002748
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002748
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002760
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002760
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002760
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_114.zip
Uploading the intermediate file: upload_file_114.zip
  19:03:31 STEP 2762 H=2762:00 +CPU= 25.148
  19:04:09 STEP 2763 H=2763:00 +CPU= 37.435
  19:04:35 STEP 2764 H=2764:00 +CPU= 25.440
  19:05:00 STEP 2765 H=2765:00 +CPU= 24.968
  19:05:39 STEP 2766 H=2766:00 +CPU= 38.810
  19:06:03 STEP 2767 H=2767:00 +CPU= 23.926
  19:06:29 STEP 2768 H=2768:00 +CPU= 26.059
  19:07:07 STEP 2769 H=2769:00 +CPU= 37.851
  19:07:32 STEP 2770 H=2770:00 +CPU= 24.983
  19:07:57 STEP 2771 H=2771:00 +CPU= 24.668
  19:08:39 STEP 2772 H=2772:00 +CPU= 41.528
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002772
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002772
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002772
  19:09:04 STEP 2773 H=2773:00 +CPU= 24.966
  19:09:30 STEP 2774 H=2774:00 +CPU= 26.407
  19:10:10 STEP 2775 H=2775:00 +CPU= 39.052
  19:10:36 STEP 2776 H=2776:00 +CPU= 25.977
  19:11:01 STEP 2777 H=2777:00 +CPU= 25.141
  19:11:40 STEP 2778 H=2778:00 +CPU= 38.442
  19:12:05 STEP 2779 H=2779:00 +CPU= 25.174
  19:12:30 STEP 2780 H=2780:00 +CPU= 25.169
  19:13:09 STEP 2781 H=2781:00 +CPU= 38.160
  19:13:35 STEP 2782 H=2782:00 +CPU= 26.302
  19:14:00 STEP 2783 H=2783:00 +CPU= 24.707
  19:14:42 STEP 2784 H=2784:00 +CPU= 41.893
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002784
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002784
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002784
  19:15:06 STEP 2785 H=2785:00 +CPU= 23.808
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002772
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002772
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002772
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002784
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002784
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002784
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_115.zip
Uploading the intermediate file: upload_file_115.zip
  19:15:31 STEP 2786 H=2786:00 +CPU= 25.216
  19:16:09 STEP 2787 H=2787:00 +CPU= 37.099
  19:16:35 STEP 2788 H=2788:00 +CPU= 25.901
  19:16:59 STEP 2789 H=2789:00 +CPU= 24.590
  19:17:39 STEP 2790 H=2790:00 +CPU= 39.135
  19:18:05 STEP 2791 H=2791:00 +CPU= 26.398
  19:18:30 STEP 2792 H=2792:00 +CPU= 25.252
  19:19:09 STEP 2793 H=2793:00 +CPU= 38.317
  19:19:35 STEP 2794 H=2794:00 +CPU= 25.697
  19:20:00 STEP 2795 H=2795:00 +CPU= 24.942
  19:20:44 STEP 2796 H=2796:00 +CPU= 43.283
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002796
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002796
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002796
  19:21:09 STEP 2797 H=2797:00 +CPU= 25.096
  19:21:35 STEP 2798 H=2798:00 +CPU= 26.035
  19:22:13 STEP 2799 H=2799:00 +CPU= 37.062
  19:22:37 STEP 2800 H=2800:00 +CPU= 24.361
  19:23:01 STEP 2801 H=2801:00 +CPU= 23.990
  19:23:41 STEP 2802 H=2802:00 +CPU= 39.876
  19:24:06 STEP 2803 H=2803:00 +CPU= 24.406
  19:24:31 STEP 2804 H=2804:00 +CPU= 25.015
  19:25:09 STEP 2805 H=2805:00 +CPU= 38.294
  19:25:35 STEP 2806 H=2806:00 +CPU= 25.455
  19:26:01 STEP 2807 H=2807:00 +CPU= 25.743
  19:26:46 STEP 2808 H=2808:00 +CPU= 45.087
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002808
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002808
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002808
  19:27:11 STEP 2809 H=2809:00 +CPU= 24.264
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002796
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002796
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002796
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002808
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002808
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002808
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_116.zip
Uploading the intermediate file: upload_file_116.zip
  19:27:35 STEP 2810 H=2810:00 +CPU= 24.173
  19:28:11 STEP 2811 H=2811:00 +CPU= 35.750
  19:28:34 STEP 2812 H=2812:00 +CPU= 23.429
  19:28:58 STEP 2813 H=2813:00 +CPU= 23.321
  19:29:34 STEP 2814 H=2814:00 +CPU= 36.545
  19:29:58 STEP 2815 H=2815:00 +CPU= 23.244
  19:30:21 STEP 2816 H=2816:00 +CPU= 22.830
  19:30:59 STEP 2817 H=2817:00 +CPU= 37.776
  19:31:25 STEP 2818 H=2818:00 +CPU= 25.963
  19:31:50 STEP 2819 H=2819:00 +CPU= 24.137
  19:32:31 STEP 2820 H=2820:00 +CPU= 41.073
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002820
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002820
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002820
  19:32:55 STEP 2821 H=2821:00 +CPU= 23.735
  19:33:20 STEP 2822 H=2822:00 +CPU= 25.324
  19:33:58 STEP 2823 H=2823:00 +CPU= 37.849
  19:34:24 STEP 2824 H=2824:00 +CPU= 24.991
  19:34:49 STEP 2825 H=2825:00 +CPU= 25.065
  19:35:27 STEP 2826 H=2826:00 +CPU= 38.057
  19:35:51 STEP 2827 H=2827:00 +CPU= 23.615
  19:36:16 STEP 2828 H=2828:00 +CPU= 25.612
  19:36:54 STEP 2829 H=2829:00 +CPU= 37.860
  19:37:20 STEP 2830 H=2830:00 +CPU= 25.178
  19:37:45 STEP 2831 H=2831:00 +CPU= 25.091
  19:38:30 STEP 2832 H=2832:00 +CPU= 44.842
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002832
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002832
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002832
  19:38:55 STEP 2833 H=2833:00 +CPU= 24.471
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002820
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002820
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002820
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002832
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002832
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002832
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_117.zip
Uploading the intermediate file: upload_file_117.zip
  19:39:20 STEP 2834 H=2834:00 +CPU= 25.196
  19:39:58 STEP 2835 H=2835:00 +CPU= 38.055
  19:40:23 STEP 2836 H=2836:00 +CPU= 25.116
  19:40:48 STEP 2837 H=2837:00 +CPU= 24.205
  19:41:27 STEP 2838 H=2838:00 +CPU= 38.584
  19:41:53 STEP 2839 H=2839:00 +CPU= 25.579
  19:42:20 STEP 2840 H=2840:00 +CPU= 26.773
  19:42:59 STEP 2841 H=2841:00 +CPU= 39.325
  19:43:25 STEP 2842 H=2842:00 +CPU= 25.057
  19:43:49 STEP 2843 H=2843:00 +CPU= 24.605
  19:44:32 STEP 2844 H=2844:00 +CPU= 42.849
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002844
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002844
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002844
  19:44:57 STEP 2845 H=2845:00 +CPU= 24.760
  19:45:23 STEP 2846 H=2846:00 +CPU= 25.631
  19:46:02 STEP 2847 H=2847:00 +CPU= 37.766
  19:46:27 STEP 2848 H=2848:00 +CPU= 24.855
  19:46:51 STEP 2849 H=2849:00 +CPU= 23.615
  19:47:29 STEP 2850 H=2850:00 +CPU= 38.207
  19:47:54 STEP 2851 H=2851:00 +CPU= 24.782
  19:48:20 STEP 2852 H=2852:00 +CPU= 25.695
  19:48:57 STEP 2853 H=2853:00 +CPU= 37.228
  19:49:23 STEP 2854 H=2854:00 +CPU= 25.635
  19:49:48 STEP 2855 H=2855:00 +CPU= 24.963
  19:50:33 STEP 2856 H=2856:00 +CPU= 44.426
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002856
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002856
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002856
  19:50:58 STEP 2857 H=2857:00 +CPU= 24.885
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002844
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002844
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002844
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002856
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002856
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002856
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:51:24 STEP 2858 H=2858:00 +CPU= 26.165
  19:52:02 STEP 2859 H=2859:00 +CPU= 37.807
  19:52:27 STEP 2860 H=2860:00 +CPU= 24.508
  19:52:52 STEP 2861 H=2861:00 +CPU= 24.461
  19:53:30 STEP 2862 H=2862:00 +CPU= 37.400
  19:53:54 STEP 2863 H=2863:00 +CPU= 24.525
  19:54:20 STEP 2864 H=2864:00 +CPU= 25.902
  19:54:58 STEP 2865 H=2865:00 +CPU= 37.431
  19:55:23 STEP 2866 H=2866:00 +CPU= 24.615
  19:55:47 STEP 2867 H=2867:00 +CPU= 23.668
  19:56:26 STEP 2868 H=2868:00 +CPU= 38.990
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002868
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002868
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002868
  19:56:50 STEP 2869 H=2869:00 +CPU= 24.426
  19:57:14 STEP 2870 H=2870:00 +CPU= 23.734
  19:57:54 STEP 2871 H=2871:00 +CPU= 39.194
  19:58:19 STEP 2872 H=2872:00 +CPU= 25.094
  19:58:44 STEP 2873 H=2873:00 +CPU= 24.631
  19:59:22 STEP 2874 H=2874:00 +CPU= 38.064
  19:59:47 STEP 2875 H=2875:00 +CPU= 25.448
  20:00:13 STEP 2876 H=2876:00 +CPU= 25.722
  20:00:49 STEP 2877 H=2877:00 +CPU= 35.737
  20:01:14 STEP 2878 H=2878:00 +CPU= 24.071
  20:01:41 STEP 2879 H=2879:00 +CPU= 26.866
  20:02:27 STEP 2880 H=2880:00 +CPU= 45.534
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002880
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002880
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002880
  20:02:53 STEP 2881 H=2881:00 +CPU= 25.671
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002868
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002868
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002868
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002880
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002880
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002880
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_119.zip
Uploading the intermediate file: upload_file_119.zip
  20:03:19 STEP 2882 H=2882:00 +CPU= 25.999
  20:03:57 STEP 2883 H=2883:00 +CPU= 38.481
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            6  MAX ETADOT VERTICAL VEL.=   2.261522453891510E-007
  LON  =    160.312500000000       degrees
  LAT  =    45.4202786265483       degrees
  20:04:25 STEP 2884 H=2884:00 +CPU= 27.295
  20:04:51 STEP 2885 H=2885:00 +CPU= 26.598
  20:05:30 STEP 2886 H=2886:00 +CPU= 38.163
  20:05:55 STEP 2887 H=2887:00 +CPU= 25.497
  20:06:20 STEP 2888 H=2888:00 +CPU= 24.405
  20:06:59 STEP 2889 H=2889:00 +CPU= 38.652
  20:07:24 STEP 2890 H=2890:00 +CPU= 24.941
  20:07:50 STEP 2891 H=2891:00 +CPU= 26.131
  20:08:33 STEP 2892 H=2892:00 +CPU= 42.473
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002892
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002892
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002892
  20:08:58 STEP 2893 H=2893:00 +CPU= 25.204
  20:09:23 STEP 2894 H=2894:00 +CPU= 24.364
  20:09:58 STEP 2895 H=2895:00 +CPU= 34.895
  20:10:22 STEP 2896 H=2896:00 +CPU= 23.905
  20:10:46 STEP 2897 H=2897:00 +CPU= 23.134
  20:11:24 STEP 2898 H=2898:00 +CPU= 38.404
  20:11:48 STEP 2899 H=2899:00 +CPU= 23.617
  20:12:12 STEP 2900 H=2900:00 +CPU= 23.630
  20:12:50 STEP 2901 H=2901:00 +CPU= 37.525
  20:13:16 STEP 2902 H=2902:00 +CPU= 25.605
  20:13:42 STEP 2903 H=2903:00 +CPU= 25.109
  20:14:29 STEP 2904 H=2904:00 +CPU= 46.188
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002904
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002904
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002904
  20:14:52 STEP 2905 H=2905:00 +CPU= 23.290
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002892
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002892
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002892
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002904
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002904
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002904
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_120.zip
Uploading the intermediate file: upload_file_120.zip
  20:15:17 STEP 2906 H=2906:00 +CPU= 24.950
  20:15:55 STEP 2907 H=2907:00 +CPU= 37.047
  20:16:20 STEP 2908 H=2908:00 +CPU= 24.918
  20:16:44 STEP 2909 H=2909:00 +CPU= 23.986
  20:17:22 STEP 2910 H=2910:00 +CPU= 37.780
  20:17:45 STEP 2911 H=2911:00 +CPU= 23.634
  20:18:12 STEP 2912 H=2912:00 +CPU= 26.835
  20:18:51 STEP 2913 H=2913:00 +CPU= 38.759
  20:19:17 STEP 2914 H=2914:00 +CPU= 26.084
  20:19:42 STEP 2915 H=2915:00 +CPU= 24.281
  20:20:24 STEP 2916 H=2916:00 +CPU= 42.331
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002916
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002916
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002916
  20:20:49 STEP 2917 H=2917:00 +CPU= 24.513
  20:21:15 STEP 2918 H=2918:00 +CPU= 25.684
  20:21:54 STEP 2919 H=2919:00 +CPU= 39.014
  20:22:20 STEP 2920 H=2920:00 +CPU= 25.845
  20:22:45 STEP 2921 H=2921:00 +CPU= 24.765
  20:23:24 STEP 2922 H=2922:00 +CPU= 39.159
  20:23:51 STEP 2923 H=2923:00 +CPU= 26.388
  20:24:18 STEP 2924 H=2924:00 +CPU= 27.149
  20:24:57 STEP 2925 H=2925:00 +CPU= 38.835
  20:25:24 STEP 2926 H=2926:00 +CPU= 26.278
  20:25:50 STEP 2927 H=2927:00 +CPU= 25.375
  20:26:36 STEP 2928 H=2928:00 +CPU= 45.344
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002928
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002928
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002928
  20:27:01 STEP 2929 H=2929:00 +CPU= 25.190
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002916
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002916
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002916
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002928
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002928
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002928
Zipping up the intermediate file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_121.zip
Uploading the intermediate file: upload_file_121.zip
  20:27:26 STEP 2930 H=2930:00 +CPU= 24.809
  20:28:03 STEP 2931 H=2931:00 +CPU= 37.148
  20:28:28 STEP 2932 H=2932:00 +CPU= 24.701
  20:28:52 STEP 2933 H=2933:00 +CPU= 23.823
  20:29:30 STEP 2934 H=2934:00 +CPU= 38.031
  20:29:55 STEP 2935 H=2935:00 +CPU= 25.072
  20:30:21 STEP 2936 H=2936:00 +CPU= 25.594
  20:30:59 STEP 2937 H=2937:00 +CPU= 37.332
  20:31:24 STEP 2938 H=2938:00 +CPU= 25.097
  20:31:49 STEP 2939 H=2939:00 +CPU= 24.791
  20:32:30 STEP 2940 H=2940:00 +CPU= 41.010
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002940
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002940
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002940
  20:32:55 STEP 2941 H=2941:00 +CPU= 24.323
  20:33:20 STEP 2942 H=2942:00 +CPU= 25.098
  20:33:57 STEP 2943 H=2943:00 +CPU= 36.584
  20:34:22 STEP 2944 H=2944:00 +CPU= 24.897
  20:34:46 STEP 2945 H=2945:00 +CPU= 23.964
  20:35:23 STEP 2946 H=2946:00 +CPU= 36.797
  20:35:47 STEP 2947 H=2947:00 +CPU= 23.613
  20:36:11 STEP 2948 H=2948:00 +CPU= 24.603
  20:36:49 STEP 2949 H=2949:00 +CPU= 37.296
  20:37:16 STEP 2950 H=2950:00 +CPU= 25.865
  20:37:41 STEP 2951 H=2951:00 +CPU= 25.360
  20:38:26 STEP 2952 H=2952:00 +CPU= 44.558
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.260318722649E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.48989191816039E-02 -1.72994898449055E+00  1.89761310057317E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.26345330502093     
  MAXGPFV : MAX. VALUE =   0.758294221764770     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    357478042 BYTES IN      8 RECORDS TRANSFERRED IN    0.0007 SECONDS510682.9 Mbytes/s, TOTAL TIME=    0.0129( 5.4%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 20:38:26 STEP 2952 H=2952:00 +CPU= 44.558
 END CNT3
 NSTEP =  2952 CNT0   000000000  38.731  38.731  38.983   0.994               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           35/   804992476 WRITTEN        10817/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    264    0       35       786125    10817 ************    60.4     1.2    59.2     1.8    87.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  755    2954.2    2954.2     10.77      0.00
   9 SPCM     - SPECTRAL COMP.                     696     340.6     340.6      1.14      0.00
  10 SCAN2M - PHYSICS                              697   12518.5   12518.5     42.12      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 58    1397.0    1397.0      0.39      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 30      18.4      18.4      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      233   12957.4   12957.4     14.57      0.00
  17 GRIDFPOS IN CNT4                               58      53.5      53.5      0.01      0.00
  27 RESTART FILES - WRITING                        29    2794.0    2794.0      0.39      0.00
  28 RESTART FILES - READING                         1    2403.0    2403.0      0.01      0.00
  29 SU4FPOS IN CNT4                                58       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                58    2514.6    2514.6      0.70      0.00
  31 POSDDH IN STEPO                                 3       1.4       1.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    697    4071.6    4071.6     13.70      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL           697    3142.3    3142.3     10.57      0.00
  39 SU0YOMB                                         1     320.3     320.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    697      15.6      15.6      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              696     228.9     228.9      0.77      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              696      29.7      29.7      0.10      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 30       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2384     174.2     174.2      2.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1450     157.5     157.5      1.10      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1450      65.2      65.2      0.46      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2384      52.7      52.7      0.61      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      24.6      24.6      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2384      23.0      23.0      0.26      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1450      18.9      18.9      0.13      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2384      27.8      27.8      0.32      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1450      21.2      21.2      0.15      0.00
 400 GSTATS                                     139605       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                133653       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    20714.3 CPU TIME   20581.1 VECTOR TIME    20581.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      513.1
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /boinc_data/boinc/slots/25/ICMGGhnw4+002952
Moving to projects directory: /boinc_data/boinc/slots/25/ICMSHhnw4+002952
Moving to projects directory: /boinc_data/boinc/slots/25/ICMUAhnw4+002952
Adding to the zip: /boinc_data/boinc/slots/25/NODE.001_01
Adding to the zip: /boinc_data/boinc/slots/25/ifs.stat
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002952
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002940
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+001152
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+002952
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+001152
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMUAhnw4+002940
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002940
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMSHhnw4+002952
Adding to the zip: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_12213891/ICMGGhnw4+001152
Zipping up the final file: /boinc_data/boinc/projects/climateprediction.net/oifs_43r3_00cl_2019110100_123_993_12213891_0_r298218781_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
20:41:50 (269145): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:12 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 10,623,600 83,617 0.0079
09 May 2023 16:54:08 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 9,766,800 76,504 0.0078
09 May 2023 16:54:04 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 8,902,800 69,397 0.0078
09 May 2023 16:53:55 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 7,520,400 58,130 0.0077
09 May 2023 16:53:49 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 6,656,400 51,179 0.0077
09 May 2023 16:53:43 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 5,792,400 44,303 0.0076
09 May 2023 16:53:37 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 4,928,400 37,491 0.0076
09 May 2023 16:53:29 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 3,456,000 26,099 0.0076
09 May 2023 16:53:22 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 2,592,000 19,581 0.0076
09 May 2023 16:53:16 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 1,728,000 13,070 0.0076
09 May 2023 16:53:09 1496046 22315244 oifs_43r3_00cl_2019110100_123_993_12213891_0 864,000 6,581 0.0076


©2024 climateprediction.net