climateprediction.net home page
Task 22317034

Task 22317034

Name oifs_43r3_017c_2019110100_123_993_12214998_1
Workunit 12214998
Created 25 Feb 2023, 9:43:33 UTC
Sent 25 Feb 2023, 9:46:27 UTC
Report deadline 26 Apr 2023, 9:46:27 UTC
Received 26 Feb 2023, 2:06:33 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1514479
Run time 15 hours 31 min 54 sec
CPU time 15 hours 20 min 35 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 3.64 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,416.14 MB
Peak swap size 4,974.26 MB
Peak disk usage 1,268.74 MB
Stderr
<core_client_version>7.23.0</core_client_version>
<![CDATA[
<stderr_txt>
58
  17:26:01 STEP 2371 H=2371:00 +CPU= 14.562
  17:26:17 STEP 2372 H=2372:00 +CPU= 15.170
  17:26:39 STEP 2373 H=2373:00 +CPU= 22.437
  17:26:54 STEP 2374 H=2374:00 +CPU= 14.500
  17:27:08 STEP 2375 H=2375:00 +CPU= 14.594
  17:27:34 STEP 2376 H=2376:00 +CPU= 25.011
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002376
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002376
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002376
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002352
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002352
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002352
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002364
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002364
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002364
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_98.zip
Uploading the intermediate file: upload_file_98.zip
  17:27:48 STEP 2377 H=2377:00 +CPU= 14.221
  17:28:04 STEP 2378 H=2378:00 +CPU= 15.303
  17:28:26 STEP 2379 H=2379:00 +CPU= 22.045
  17:28:40 STEP 2380 H=2380:00 +CPU= 14.607
  17:28:55 STEP 2381 H=2381:00 +CPU= 14.499
  17:29:17 STEP 2382 H=2382:00 +CPU= 21.743
  17:29:31 STEP 2383 H=2383:00 +CPU= 14.022
  17:29:45 STEP 2384 H=2384:00 +CPU= 13.649
  17:30:06 STEP 2385 H=2385:00 +CPU= 20.387
  17:30:20 STEP 2386 H=2386:00 +CPU= 13.926
  17:30:34 STEP 2387 H=2387:00 +CPU= 13.909
  17:30:57 STEP 2388 H=2388:00 +CPU= 23.260
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002388
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002388
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002388
  17:31:11 STEP 2389 H=2389:00 +CPU= 14.109
  17:31:26 STEP 2390 H=2390:00 +CPU= 14.521
  17:31:48 STEP 2391 H=2391:00 +CPU= 21.439
  17:32:02 STEP 2392 H=2392:00 +CPU= 14.457
  17:32:15 STEP 2393 H=2393:00 +CPU= 12.971
  17:32:36 STEP 2394 H=2394:00 +CPU= 20.580
  17:32:50 STEP 2395 H=2395:00 +CPU= 14.573
  17:33:05 STEP 2396 H=2396:00 +CPU= 14.399
  17:33:25 STEP 2397 H=2397:00 +CPU= 20.392
  17:33:38 STEP 2398 H=2398:00 +CPU= 12.915
  17:33:53 STEP 2399 H=2399:00 +CPU= 14.277
  17:34:17 STEP 2400 H=2400:00 +CPU= 24.574
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002400
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002400
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002400
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002376
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002376
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002376
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002388
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002388
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002388
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_99.zip
Uploading the intermediate file: upload_file_99.zip
  17:34:31 STEP 2401 H=2401:00 +CPU= 13.366
  17:34:44 STEP 2402 H=2402:00 +CPU= 12.934
Uploading trickle at timestep: 8640000
  17:35:06 STEP 2403 H=2403:00 +CPU= 21.808
  17:35:21 STEP 2404 H=2404:00 +CPU= 14.843
  17:35:34 STEP 2405 H=2405:00 +CPU= 13.459
  17:35:56 STEP 2406 H=2406:00 +CPU= 21.725
  17:36:09 STEP 2407 H=2407:00 +CPU= 13.373
  17:36:24 STEP 2408 H=2408:00 +CPU= 14.781
  17:36:46 STEP 2409 H=2409:00 +CPU= 21.156
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            9  MAX ETADOT VERTICAL VEL.=   2.063638820338410E-007
  LON  =    60.4687500000000       degrees
  LAT  =    42.0558239509352       degrees
  17:36:59 STEP 2410 H=2410:00 +CPU= 13.209
  17:37:12 STEP 2411 H=2411:00 +CPU= 12.957
  17:37:36 STEP 2412 H=2412:00 +CPU= 23.885
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002412
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002412
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002412
  17:37:50 STEP 2413 H=2413:00 +CPU= 14.442
  17:38:05 STEP 2414 H=2414:00 +CPU= 14.938
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           11  MAX ETADOT VERTICAL VEL.=   1.090741653663125E-007
  LON  =    57.6562500000000       degrees
  LAT  =    43.1773092288349       degrees
  17:38:26 STEP 2415 H=2415:00 +CPU= 20.467
  17:38:41 STEP 2416 H=2416:00 +CPU= 15.353
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           12  MAX ETADOT VERTICAL VEL.=   3.808900202055429E-008
  LON  =    56.2500000000000       degrees
  LAT  =    44.2987941306940       degrees
  17:38:55 STEP 2417 H=2417:00 +CPU= 14.044
  17:39:19 STEP 2418 H=2418:00 +CPU= 23.650
  17:39:34 STEP 2419 H=2419:00 +CPU= 15.231
  17:39:50 STEP 2420 H=2420:00 +CPU= 15.528
  17:40:13 STEP 2421 H=2421:00 +CPU= 22.549
  17:40:28 STEP 2422 H=2422:00 +CPU= 15.390
  17:40:44 STEP 2423 H=2423:00 +CPU= 15.735
  17:41:10 STEP 2424 H=2424:00 +CPU= 26.358
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002424
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002424
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002424
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002400
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002400
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002400
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002412
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002412
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002412
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_100.zip
Uploading the intermediate file: upload_file_100.zip
  17:41:26 STEP 2425 H=2425:00 +CPU= 16.026
  17:41:43 STEP 2426 H=2426:00 +CPU= 16.558
  17:42:07 STEP 2427 H=2427:00 +CPU= 23.656
  17:42:23 STEP 2428 H=2428:00 +CPU= 16.317
  17:42:39 STEP 2429 H=2429:00 +CPU= 16.160
  17:43:05 STEP 2430 H=2430:00 +CPU= 25.999
  17:43:21 STEP 2431 H=2431:00 +CPU= 15.563
  17:43:38 STEP 2432 H=2432:00 +CPU= 16.996
  17:44:02 STEP 2433 H=2433:00 +CPU= 23.960
  17:44:18 STEP 2434 H=2434:00 +CPU= 16.108
  17:44:34 STEP 2435 H=2435:00 +CPU= 15.769
  17:45:00 STEP 2436 H=2436:00 +CPU= 26.335
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002436
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002436
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002436
  17:45:16 STEP 2437 H=2437:00 +CPU= 16.046
  17:45:33 STEP 2438 H=2438:00 +CPU= 16.040
  17:45:57 STEP 2439 H=2439:00 +CPU= 24.004
  17:46:14 STEP 2440 H=2440:00 +CPU= 17.663
  17:46:30 STEP 2441 H=2441:00 +CPU= 15.454
  17:46:55 STEP 2442 H=2442:00 +CPU= 24.903
  17:47:10 STEP 2443 H=2443:00 +CPU= 15.378
  17:47:28 STEP 2444 H=2444:00 +CPU= 17.311
  17:47:52 STEP 2445 H=2445:00 +CPU= 24.278
  17:48:08 STEP 2446 H=2446:00 +CPU= 16.393
  17:48:25 STEP 2447 H=2447:00 +CPU= 16.766
  17:48:54 STEP 2448 H=2448:00 +CPU= 28.485
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002448
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002448
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002448
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002424
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002424
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002424
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002436
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002436
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002436
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_101.zip
Uploading the intermediate file: upload_file_101.zip
  17:49:10 STEP 2449 H=2449:00 +CPU= 15.560
  17:49:26 STEP 2450 H=2450:00 +CPU= 16.590
  17:49:51 STEP 2451 H=2451:00 +CPU= 24.267
  17:50:07 STEP 2452 H=2452:00 +CPU= 16.882
  17:50:23 STEP 2453 H=2453:00 +CPU= 15.696
  17:50:48 STEP 2454 H=2454:00 +CPU= 24.824
  17:51:04 STEP 2455 H=2455:00 +CPU= 16.021
  17:51:21 STEP 2456 H=2456:00 +CPU= 16.554
  17:51:45 STEP 2457 H=2457:00 +CPU= 24.103
  17:52:02 STEP 2458 H=2458:00 +CPU= 16.623
  17:52:18 STEP 2459 H=2459:00 +CPU= 16.394
  17:52:46 STEP 2460 H=2460:00 +CPU= 27.484
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002460
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002460
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002460
  17:53:02 STEP 2461 H=2461:00 +CPU= 16.087
  17:53:19 STEP 2462 H=2462:00 +CPU= 16.808
  17:53:44 STEP 2463 H=2463:00 +CPU= 24.657
  17:54:00 STEP 2464 H=2464:00 +CPU= 16.441
  17:54:16 STEP 2465 H=2465:00 +CPU= 16.153
  17:54:41 STEP 2466 H=2466:00 +CPU= 24.888
  17:54:57 STEP 2467 H=2467:00 +CPU= 16.011
  17:55:14 STEP 2468 H=2468:00 +CPU= 16.186
  17:55:38 STEP 2469 H=2469:00 +CPU= 24.185
  17:55:54 STEP 2470 H=2470:00 +CPU= 16.081
  17:56:11 STEP 2471 H=2471:00 +CPU= 16.814
  17:56:39 STEP 2472 H=2472:00 +CPU= 27.704
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002472
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002472
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002472
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002448
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002448
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002448
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002460
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002460
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002460
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_102.zip
Uploading the intermediate file: upload_file_102.zip
  17:56:55 STEP 2473 H=2473:00 +CPU= 16.178
  17:57:11 STEP 2474 H=2474:00 +CPU= 16.172
  17:57:35 STEP 2475 H=2475:00 +CPU= 23.988
  17:57:52 STEP 2476 H=2476:00 +CPU= 16.382
  17:58:08 STEP 2477 H=2477:00 +CPU= 16.388
  17:58:33 STEP 2478 H=2478:00 +CPU= 24.655
  17:58:49 STEP 2479 H=2479:00 +CPU= 15.638
  17:59:05 STEP 2480 H=2480:00 +CPU= 16.019
  17:59:29 STEP 2481 H=2481:00 +CPU= 23.888
  17:59:45 STEP 2482 H=2482:00 +CPU= 16.021
  17:59:59 STEP 2483 H=2483:00 +CPU= 14.290
  18:00:24 STEP 2484 H=2484:00 +CPU= 24.919
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002484
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002484
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002484
  18:00:40 STEP 2485 H=2485:00 +CPU= 15.286
  18:00:55 STEP 2486 H=2486:00 +CPU= 15.139
  18:01:18 STEP 2487 H=2487:00 +CPU= 23.431
  18:01:33 STEP 2488 H=2488:00 +CPU= 14.873
  18:01:48 STEP 2489 H=2489:00 +CPU= 14.841
  18:02:11 STEP 2490 H=2490:00 +CPU= 22.769
  18:02:26 STEP 2491 H=2491:00 +CPU= 14.756
  18:02:41 STEP 2492 H=2492:00 +CPU= 14.851
  18:03:03 STEP 2493 H=2493:00 +CPU= 22.665
  18:03:19 STEP 2494 H=2494:00 +CPU= 15.027
  18:03:33 STEP 2495 H=2495:00 +CPU= 14.747
  18:04:00 STEP 2496 H=2496:00 +CPU= 26.874
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002496
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002496
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002496
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002472
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002472
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002472
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002484
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002484
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002484
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_103.zip
Uploading the intermediate file: upload_file_103.zip
  18:04:15 STEP 2497 H=2497:00 +CPU= 14.827
  18:04:31 STEP 2498 H=2498:00 +CPU= 15.262
  18:04:53 STEP 2499 H=2499:00 +CPU= 22.620
  18:05:09 STEP 2500 H=2500:00 +CPU= 15.643
  18:05:24 STEP 2501 H=2501:00 +CPU= 15.099
  18:05:48 STEP 2502 H=2502:00 +CPU= 23.603
  18:06:03 STEP 2503 H=2503:00 +CPU= 15.492
  18:06:19 STEP 2504 H=2504:00 +CPU= 15.227
  18:06:41 STEP 2505 H=2505:00 +CPU= 22.026
  18:06:56 STEP 2506 H=2506:00 +CPU= 14.917
  18:07:11 STEP 2507 H=2507:00 +CPU= 14.760
  18:07:37 STEP 2508 H=2508:00 +CPU= 26.326
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002508
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002508
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002508
  18:07:52 STEP 2509 H=2509:00 +CPU= 14.598
  18:08:06 STEP 2510 H=2510:00 +CPU= 14.706
  18:08:30 STEP 2511 H=2511:00 +CPU= 23.197
  18:08:45 STEP 2512 H=2512:00 +CPU= 15.334
  18:09:01 STEP 2513 H=2513:00 +CPU= 15.440
  18:09:24 STEP 2514 H=2514:00 +CPU= 23.034
  18:09:39 STEP 2515 H=2515:00 +CPU= 15.154
  18:09:55 STEP 2516 H=2516:00 +CPU= 16.222
  18:10:18 STEP 2517 H=2517:00 +CPU= 22.936
  18:10:33 STEP 2518 H=2518:00 +CPU= 15.195
  18:10:49 STEP 2519 H=2519:00 +CPU= 15.300
  18:11:17 STEP 2520 H=2520:00 +CPU= 27.907
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002520
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002520
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002520
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002496
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002496
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002496
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002508
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002508
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002508
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_104.zip
Uploading the intermediate file: upload_file_104.zip
  18:11:32 STEP 2521 H=2521:00 +CPU= 15.030
  18:11:47 STEP 2522 H=2522:00 +CPU= 15.214
  18:12:10 STEP 2523 H=2523:00 +CPU= 22.872
  18:12:26 STEP 2524 H=2524:00 +CPU= 15.512
  18:12:41 STEP 2525 H=2525:00 +CPU= 15.145
  18:13:06 STEP 2526 H=2526:00 +CPU= 24.606
  18:13:21 STEP 2527 H=2527:00 +CPU= 14.876
  18:13:36 STEP 2528 H=2528:00 +CPU= 15.597
  18:14:00 STEP 2529 H=2529:00 +CPU= 23.094
  18:14:15 STEP 2530 H=2530:00 +CPU= 15.128
  18:14:30 STEP 2531 H=2531:00 +CPU= 15.195
  18:14:56 STEP 2532 H=2532:00 +CPU= 25.418
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002532
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002532
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002532
  18:15:11 STEP 2533 H=2533:00 +CPU= 15.211
  18:15:27 STEP 2534 H=2534:00 +CPU= 15.656
  18:15:50 STEP 2535 H=2535:00 +CPU= 23.093
  18:16:05 STEP 2536 H=2536:00 +CPU= 15.219
  18:16:20 STEP 2537 H=2537:00 +CPU= 15.469
  18:16:44 STEP 2538 H=2538:00 +CPU= 23.585
  18:16:59 STEP 2539 H=2539:00 +CPU= 15.166
  18:17:15 STEP 2540 H=2540:00 +CPU= 15.704
  18:17:39 STEP 2541 H=2541:00 +CPU= 23.271
  18:17:54 STEP 2542 H=2542:00 +CPU= 15.620
  18:18:10 STEP 2543 H=2543:00 +CPU= 15.885
  18:18:38 STEP 2544 H=2544:00 +CPU= 27.999
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002544
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002544
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002544
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002520
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002520
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002520
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002532
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002532
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002532
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_105.zip
Uploading the intermediate file: upload_file_105.zip
  18:18:53 STEP 2545 H=2545:00 +CPU= 15.171
  18:19:09 STEP 2546 H=2546:00 +CPU= 15.677
  18:19:32 STEP 2547 H=2547:00 +CPU= 22.830
  18:19:48 STEP 2548 H=2548:00 +CPU= 15.501
  18:20:02 STEP 2549 H=2549:00 +CPU= 14.462
  18:20:25 STEP 2550 H=2550:00 +CPU= 22.857
  18:20:40 STEP 2551 H=2551:00 +CPU= 15.375
  18:20:56 STEP 2552 H=2552:00 +CPU= 15.224
  18:21:20 STEP 2553 H=2553:00 +CPU= 23.676
  18:21:35 STEP 2554 H=2554:00 +CPU= 15.535
  18:21:50 STEP 2555 H=2555:00 +CPU= 14.621
  18:22:16 STEP 2556 H=2556:00 +CPU= 25.975
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002556
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002556
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002556
  18:22:31 STEP 2557 H=2557:00 +CPU= 14.891
  18:22:46 STEP 2558 H=2558:00 +CPU= 15.098
  18:23:09 STEP 2559 H=2559:00 +CPU= 23.353
  18:23:25 STEP 2560 H=2560:00 +CPU= 15.408
  18:23:40 STEP 2561 H=2561:00 +CPU= 14.625
  18:24:03 STEP 2562 H=2562:00 +CPU= 23.361
  18:24:18 STEP 2563 H=2563:00 +CPU= 14.851
  18:24:34 STEP 2564 H=2564:00 +CPU= 15.283
  18:24:57 STEP 2565 H=2565:00 +CPU= 22.960
  18:25:12 STEP 2566 H=2566:00 +CPU= 15.672
  18:25:27 STEP 2567 H=2567:00 +CPU= 14.918
  18:25:55 STEP 2568 H=2568:00 +CPU= 27.503
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002568
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002568
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002568
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002544
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002544
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002544
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002556
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002556
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002556
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_106.zip
Uploading the intermediate file: upload_file_106.zip
  18:26:10 STEP 2569 H=2569:00 +CPU= 14.957
  18:26:25 STEP 2570 H=2570:00 +CPU= 15.131
  18:26:48 STEP 2571 H=2571:00 +CPU= 23.311
  18:27:05 STEP 2572 H=2572:00 +CPU= 16.527
  18:27:20 STEP 2573 H=2573:00 +CPU= 15.112
  18:27:44 STEP 2574 H=2574:00 +CPU= 23.491
  18:27:59 STEP 2575 H=2575:00 +CPU= 15.260
  18:28:14 STEP 2576 H=2576:00 +CPU= 15.234
  18:28:37 STEP 2577 H=2577:00 +CPU= 22.911
  18:28:53 STEP 2578 H=2578:00 +CPU= 16.092
  18:29:08 STEP 2579 H=2579:00 +CPU= 15.032
  18:29:34 STEP 2580 H=2580:00 +CPU= 25.764
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002580
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002580
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002580
  18:29:50 STEP 2581 H=2581:00 +CPU= 15.848
  18:30:06 STEP 2582 H=2582:00 +CPU= 15.893
  18:30:29 STEP 2583 H=2583:00 +CPU= 22.970
  18:30:46 STEP 2584 H=2584:00 +CPU= 16.311
  18:31:01 STEP 2585 H=2585:00 +CPU= 14.982
  18:31:25 STEP 2586 H=2586:00 +CPU= 24.264
  18:31:40 STEP 2587 H=2587:00 +CPU= 15.348
  18:31:56 STEP 2588 H=2588:00 +CPU= 15.293
  18:32:19 STEP 2589 H=2589:00 +CPU= 23.263
  18:32:35 STEP 2590 H=2590:00 +CPU= 15.932
  18:32:51 STEP 2591 H=2591:00 +CPU= 15.554
  18:33:18 STEP 2592 H=2592:00 +CPU= 27.173
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002592
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002592
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002592
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002568
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002568
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002568
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002580
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002580
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002580
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_107.zip
Uploading the intermediate file: upload_file_107.zip
  18:33:33 STEP 2593 H=2593:00 +CPU= 15.041
  18:33:49 STEP 2594 H=2594:00 +CPU= 15.535
  18:34:12 STEP 2595 H=2595:00 +CPU= 23.157
  18:34:27 STEP 2596 H=2596:00 +CPU= 15.184
  18:34:43 STEP 2597 H=2597:00 +CPU= 15.348
  18:35:06 STEP 2598 H=2598:00 +CPU= 23.678
  18:35:21 STEP 2599 H=2599:00 +CPU= 15.009
  18:35:37 STEP 2600 H=2600:00 +CPU= 15.667
  18:36:01 STEP 2601 H=2601:00 +CPU= 23.237
  18:36:17 STEP 2602 H=2602:00 +CPU= 16.160
  18:36:34 STEP 2603 H=2603:00 +CPU= 16.740
  18:37:00 STEP 2604 H=2604:00 +CPU= 25.956
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002604
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002604
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002604
  18:37:15 STEP 2605 H=2605:00 +CPU= 15.624
  18:37:31 STEP 2606 H=2606:00 +CPU= 15.712
  18:37:54 STEP 2607 H=2607:00 +CPU= 22.938
  18:38:10 STEP 2608 H=2608:00 +CPU= 15.877
  18:38:25 STEP 2609 H=2609:00 +CPU= 14.731
  18:38:49 STEP 2610 H=2610:00 +CPU= 23.789
  18:39:05 STEP 2611 H=2611:00 +CPU= 15.834
  18:39:20 STEP 2612 H=2612:00 +CPU= 15.374
  18:39:43 STEP 2613 H=2613:00 +CPU= 23.277
  18:39:59 STEP 2614 H=2614:00 +CPU= 15.560
  18:40:15 STEP 2615 H=2615:00 +CPU= 16.230
  18:40:44 STEP 2616 H=2616:00 +CPU= 28.313
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002616
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002616
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002616
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002592
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002592
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002592
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002604
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002604
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002604
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_108.zip
Uploading the intermediate file: upload_file_108.zip
  18:40:59 STEP 2617 H=2617:00 +CPU= 15.155
  18:41:15 STEP 2618 H=2618:00 +CPU= 15.613
  18:41:38 STEP 2619 H=2619:00 +CPU= 22.981
  18:41:54 STEP 2620 H=2620:00 +CPU= 16.312
  18:42:10 STEP 2621 H=2621:00 +CPU= 16.088
  18:42:34 STEP 2622 H=2622:00 +CPU= 23.883
  18:42:50 STEP 2623 H=2623:00 +CPU= 15.526
  18:43:06 STEP 2624 H=2624:00 +CPU= 15.794
  18:43:30 STEP 2625 H=2625:00 +CPU= 24.534
  18:43:46 STEP 2626 H=2626:00 +CPU= 15.959
  18:44:01 STEP 2627 H=2627:00 +CPU= 15.003
  18:44:27 STEP 2628 H=2628:00 +CPU= 25.841
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002628
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002628
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002628
  18:44:43 STEP 2629 H=2629:00 +CPU= 15.182
  18:44:58 STEP 2630 H=2630:00 +CPU= 15.598
  18:45:20 STEP 2631 H=2631:00 +CPU= 22.064
  18:45:37 STEP 2632 H=2632:00 +CPU= 16.779
  18:45:53 STEP 2633 H=2633:00 +CPU= 15.830
  18:46:17 STEP 2634 H=2634:00 +CPU= 24.186
  18:46:33 STEP 2635 H=2635:00 +CPU= 15.354
  18:46:48 STEP 2636 H=2636:00 +CPU= 15.429
  18:47:11 STEP 2637 H=2637:00 +CPU= 22.842
  18:47:27 STEP 2638 H=2638:00 +CPU= 15.657
  18:47:43 STEP 2639 H=2639:00 +CPU= 15.702
  18:48:11 STEP 2640 H=2640:00 +CPU= 28.249
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002640
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002640
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002640
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002616
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002616
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002616
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002628
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002628
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002628
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_109.zip
Uploading the intermediate file: upload_file_109.zip
  18:48:27 STEP 2641 H=2641:00 +CPU= 15.462
Uploading trickle at timestep: 9504000
  18:48:42 STEP 2642 H=2642:00 +CPU= 15.634
  18:49:05 STEP 2643 H=2643:00 +CPU= 22.909
  18:49:21 STEP 2644 H=2644:00 +CPU= 15.601
  18:49:37 STEP 2645 H=2645:00 +CPU= 15.711
  18:50:00 STEP 2646 H=2646:00 +CPU= 23.505
  18:50:16 STEP 2647 H=2647:00 +CPU= 15.368
  18:50:31 STEP 2648 H=2648:00 +CPU= 15.630
  18:50:55 STEP 2649 H=2649:00 +CPU= 23.937
  18:51:11 STEP 2650 H=2650:00 +CPU= 15.966
  18:51:27 STEP 2651 H=2651:00 +CPU= 15.419
  18:51:54 STEP 2652 H=2652:00 +CPU= 26.533
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002652
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002652
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002652
  18:52:09 STEP 2653 H=2653:00 +CPU= 15.152
  18:52:24 STEP 2654 H=2654:00 +CPU= 15.560
  18:52:48 STEP 2655 H=2655:00 +CPU= 23.325
  18:53:04 STEP 2656 H=2656:00 +CPU= 15.792
  18:53:19 STEP 2657 H=2657:00 +CPU= 14.949
  18:53:43 STEP 2658 H=2658:00 +CPU= 23.841
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            4  MAX ETADOT VERTICAL VEL.=   1.260509072495194E-007
  LON  =    180.000000000000       degrees
  LAT  =    40.9343383242788       degrees
  18:53:58 STEP 2659 H=2659:00 +CPU= 15.290
  18:54:14 STEP 2660 H=2660:00 +CPU= 15.668
  18:54:37 STEP 2661 H=2661:00 +CPU= 23.109
  18:54:53 STEP 2662 H=2662:00 +CPU= 15.891
  18:55:10 STEP 2663 H=2663:00 +CPU= 16.738
  18:55:38 STEP 2664 H=2664:00 +CPU= 28.108
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002664
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002664
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002664
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002640
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002640
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002640
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002652
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002652
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002652
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_110.zip
Uploading the intermediate file: upload_file_110.zip
  18:55:54 STEP 2665 H=2665:00 +CPU= 16.213
  18:56:10 STEP 2666 H=2666:00 +CPU= 15.870
  18:56:34 STEP 2667 H=2667:00 +CPU= 24.274
  18:56:51 STEP 2668 H=2668:00 +CPU= 16.125
  18:57:06 STEP 2669 H=2669:00 +CPU= 15.173
  18:57:31 STEP 2670 H=2670:00 +CPU= 24.480
  18:57:46 STEP 2671 H=2671:00 +CPU= 15.113
  18:58:01 STEP 2672 H=2672:00 +CPU= 15.489
  18:58:25 STEP 2673 H=2673:00 +CPU= 24.001
  18:58:41 STEP 2674 H=2674:00 +CPU= 16.005
  18:58:57 STEP 2675 H=2675:00 +CPU= 15.329
  18:59:22 STEP 2676 H=2676:00 +CPU= 25.554
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002676
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002676
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002676
  18:59:38 STEP 2677 H=2677:00 +CPU= 15.174
  18:59:53 STEP 2678 H=2678:00 +CPU= 15.634
  19:00:16 STEP 2679 H=2679:00 +CPU= 22.393
  19:00:31 STEP 2680 H=2680:00 +CPU= 15.382
  19:00:46 STEP 2681 H=2681:00 +CPU= 15.068
  19:01:10 STEP 2682 H=2682:00 +CPU= 23.885
  19:01:26 STEP 2683 H=2683:00 +CPU= 15.529
  19:01:42 STEP 2684 H=2684:00 +CPU= 16.075
  19:02:05 STEP 2685 H=2685:00 +CPU= 22.498
  19:02:20 STEP 2686 H=2686:00 +CPU= 15.204
  19:02:36 STEP 2687 H=2687:00 +CPU= 16.009
  19:03:04 STEP 2688 H=2688:00 +CPU= 27.895
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002688
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002688
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002688
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002664
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002664
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002664
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002676
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002676
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002676
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_111.zip
Uploading the intermediate file: upload_file_111.zip
  19:03:20 STEP 2689 H=2689:00 +CPU= 16.297
  19:03:36 STEP 2690 H=2690:00 +CPU= 15.800
  19:04:01 STEP 2691 H=2691:00 +CPU= 24.159
  19:04:17 STEP 2692 H=2692:00 +CPU= 16.206
  19:04:33 STEP 2693 H=2693:00 +CPU= 15.816
  19:04:57 STEP 2694 H=2694:00 +CPU= 24.394
  19:05:13 STEP 2695 H=2695:00 +CPU= 15.378
  19:05:28 STEP 2696 H=2696:00 +CPU= 15.826
  19:05:52 STEP 2697 H=2697:00 +CPU= 23.868
  19:06:08 STEP 2698 H=2698:00 +CPU= 15.246
  19:06:23 STEP 2699 H=2699:00 +CPU= 15.271
  19:06:49 STEP 2700 H=2700:00 +CPU= 25.406
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002700
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002700
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002700
  19:07:04 STEP 2701 H=2701:00 +CPU= 15.028
  19:07:19 STEP 2702 H=2702:00 +CPU= 15.288
  19:07:43 STEP 2703 H=2703:00 +CPU= 23.476
  19:07:59 STEP 2704 H=2704:00 +CPU= 15.896
  19:08:14 STEP 2705 H=2705:00 +CPU= 15.486
  19:08:37 STEP 2706 H=2706:00 +CPU= 22.805
  19:08:53 STEP 2707 H=2707:00 +CPU= 15.562
  19:09:08 STEP 2708 H=2708:00 +CPU= 15.149
  19:09:31 STEP 2709 H=2709:00 +CPU= 22.519
  19:09:47 STEP 2710 H=2710:00 +CPU= 16.596
  19:10:03 STEP 2711 H=2711:00 +CPU= 15.879
  19:10:31 STEP 2712 H=2712:00 +CPU= 27.366
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002712
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002712
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002712
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002688
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002688
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002688
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002700
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002700
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002700
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_112.zip
Uploading the intermediate file: upload_file_112.zip
  19:10:46 STEP 2713 H=2713:00 +CPU= 15.033
  19:11:02 STEP 2714 H=2714:00 +CPU= 15.935
  19:11:27 STEP 2715 H=2715:00 +CPU= 24.718
  19:11:43 STEP 2716 H=2716:00 +CPU= 15.950
  19:11:59 STEP 2717 H=2717:00 +CPU= 15.969
  19:12:25 STEP 2718 H=2718:00 +CPU= 25.474
  19:12:41 STEP 2719 H=2719:00 +CPU= 15.992
  19:12:57 STEP 2720 H=2720:00 +CPU= 15.540
  19:13:22 STEP 2721 H=2721:00 +CPU= 24.497
  19:13:38 STEP 2722 H=2722:00 +CPU= 16.115
  19:13:54 STEP 2723 H=2723:00 +CPU= 16.099
  19:14:20 STEP 2724 H=2724:00 +CPU= 26.217
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002724
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002724
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002724
  19:14:37 STEP 2725 H=2725:00 +CPU= 16.085
  19:14:53 STEP 2726 H=2726:00 +CPU= 16.321
  19:15:17 STEP 2727 H=2727:00 +CPU= 23.799
  19:15:34 STEP 2728 H=2728:00 +CPU= 16.847
  19:15:50 STEP 2729 H=2729:00 +CPU= 16.288
  19:16:14 STEP 2730 H=2730:00 +CPU= 23.263
  19:16:29 STEP 2731 H=2731:00 +CPU= 15.315
  19:16:46 STEP 2732 H=2732:00 +CPU= 16.420
  19:17:10 STEP 2733 H=2733:00 +CPU= 24.135
  19:17:27 STEP 2734 H=2734:00 +CPU= 16.001
  19:17:43 STEP 2735 H=2735:00 +CPU= 16.408
  19:18:11 STEP 2736 H=2736:00 +CPU= 27.846
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002736
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002736
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002736
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002712
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002712
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002712
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002724
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002724
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002724
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_113.zip
Uploading the intermediate file: upload_file_113.zip
  19:18:27 STEP 2737 H=2737:00 +CPU= 15.771
  19:18:44 STEP 2738 H=2738:00 +CPU= 16.484
  19:19:09 STEP 2739 H=2739:00 +CPU= 25.015
  19:19:25 STEP 2740 H=2740:00 +CPU= 16.399
  19:19:42 STEP 2741 H=2741:00 +CPU= 16.529
  19:20:07 STEP 2742 H=2742:00 +CPU= 24.300
  19:20:22 STEP 2743 H=2743:00 +CPU= 15.537
  19:20:38 STEP 2744 H=2744:00 +CPU= 16.060
  19:21:04 STEP 2745 H=2745:00 +CPU= 25.696
  19:21:21 STEP 2746 H=2746:00 +CPU= 16.198
  19:21:37 STEP 2747 H=2747:00 +CPU= 16.190
  19:22:04 STEP 2748 H=2748:00 +CPU= 26.535
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002748
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002748
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002748
  19:22:19 STEP 2749 H=2749:00 +CPU= 15.309
  19:22:36 STEP 2750 H=2750:00 +CPU= 15.976
  19:23:00 STEP 2751 H=2751:00 +CPU= 24.584
  19:23:17 STEP 2752 H=2752:00 +CPU= 16.452
  19:23:33 STEP 2753 H=2753:00 +CPU= 15.528
  19:23:58 STEP 2754 H=2754:00 +CPU= 24.575
  19:24:14 STEP 2755 H=2755:00 +CPU= 16.068
  19:24:30 STEP 2756 H=2756:00 +CPU= 16.369
  19:24:55 STEP 2757 H=2757:00 +CPU= 24.286
  19:25:11 STEP 2758 H=2758:00 +CPU= 15.903
  19:25:28 STEP 2759 H=2759:00 +CPU= 16.841
  19:25:58 STEP 2760 H=2760:00 +CPU= 29.551
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002760
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002760
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002760
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002736
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002736
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002736
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002748
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002748
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002748
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_114.zip
Uploading the intermediate file: upload_file_114.zip
  19:26:14 STEP 2761 H=2761:00 +CPU= 16.455
  19:26:31 STEP 2762 H=2762:00 +CPU= 16.483
  19:26:54 STEP 2763 H=2763:00 +CPU= 23.258
  19:27:11 STEP 2764 H=2764:00 +CPU= 16.253
  19:27:26 STEP 2765 H=2765:00 +CPU= 15.697
  19:27:51 STEP 2766 H=2766:00 +CPU= 24.866
  19:28:07 STEP 2767 H=2767:00 +CPU= 15.747
  19:28:24 STEP 2768 H=2768:00 +CPU= 16.245
  19:28:48 STEP 2769 H=2769:00 +CPU= 24.370
  19:29:05 STEP 2770 H=2770:00 +CPU= 16.250
  19:29:21 STEP 2771 H=2771:00 +CPU= 15.941
  19:29:49 STEP 2772 H=2772:00 +CPU= 28.823
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002772
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002772
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002772
  19:30:05 STEP 2773 H=2773:00 +CPU= 15.881
  19:30:22 STEP 2774 H=2774:00 +CPU= 16.554
  19:30:46 STEP 2775 H=2775:00 +CPU= 23.529
  19:31:03 STEP 2776 H=2776:00 +CPU= 16.781
  19:31:19 STEP 2777 H=2777:00 +CPU= 16.246
  19:31:44 STEP 2778 H=2778:00 +CPU= 24.544
  19:32:00 STEP 2779 H=2779:00 +CPU= 16.179
  19:32:17 STEP 2780 H=2780:00 +CPU= 16.261
  19:32:41 STEP 2781 H=2781:00 +CPU= 24.139
  19:32:58 STEP 2782 H=2782:00 +CPU= 16.611
  19:33:14 STEP 2783 H=2783:00 +CPU= 16.134
  19:33:42 STEP 2784 H=2784:00 +CPU= 28.194
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002784
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002784
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002784
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002760
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002760
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002760
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002772
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002772
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002772
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_115.zip
Uploading the intermediate file: upload_file_115.zip
  19:33:59 STEP 2785 H=2785:00 +CPU= 16.013
  19:34:16 STEP 2786 H=2786:00 +CPU= 16.910
  19:34:40 STEP 2787 H=2787:00 +CPU= 24.240
  19:34:56 STEP 2788 H=2788:00 +CPU= 16.235
  19:35:13 STEP 2789 H=2789:00 +CPU= 16.812
  19:35:39 STEP 2790 H=2790:00 +CPU= 24.780
  19:35:55 STEP 2791 H=2791:00 +CPU= 15.924
  19:36:12 STEP 2792 H=2792:00 +CPU= 16.836
  19:36:37 STEP 2793 H=2793:00 +CPU= 25.174
  19:36:54 STEP 2794 H=2794:00 +CPU= 16.818
  19:37:10 STEP 2795 H=2795:00 +CPU= 15.915
  19:37:37 STEP 2796 H=2796:00 +CPU= 26.924
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002796
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002796
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002796
  19:37:53 STEP 2797 H=2797:00 +CPU= 16.110
  19:38:11 STEP 2798 H=2798:00 +CPU= 17.224
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:40:16 STEP 2799 H=2799:00 +CPU= 24.039
  19:40:32 STEP 2800 H=2800:00 +CPU= 15.437
  19:40:48 STEP 2801 H=2801:00 +CPU= 16.293
  19:41:12 STEP 2802 H=2802:00 +CPU= 24.258
  19:41:29 STEP 2803 H=2803:00 +CPU= 16.295
  19:41:45 STEP 2804 H=2804:00 +CPU= 16.069
  19:42:09 STEP 2805 H=2805:00 +CPU= 24.520
  19:42:26 STEP 2806 H=2806:00 +CPU= 16.915
  19:42:43 STEP 2807 H=2807:00 +CPU= 16.441
  19:43:11 STEP 2808 H=2808:00 +CPU= 28.170
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002808
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002808
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002808
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002784
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002784
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002784
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002796
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002796
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002796
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_116.zip
Uploading the intermediate file: upload_file_116.zip
  19:43:28 STEP 2809 H=2809:00 +CPU= 16.639
  19:43:45 STEP 2810 H=2810:00 +CPU= 16.947
  19:44:10 STEP 2811 H=2811:00 +CPU= 25.290
  19:44:27 STEP 2812 H=2812:00 +CPU= 16.884
  19:44:44 STEP 2813 H=2813:00 +CPU= 16.128
  19:45:08 STEP 2814 H=2814:00 +CPU= 24.663
  19:45:24 STEP 2815 H=2815:00 +CPU= 15.758
  19:45:40 STEP 2816 H=2816:00 +CPU= 15.971
  19:46:05 STEP 2817 H=2817:00 +CPU= 24.591
  19:46:21 STEP 2818 H=2818:00 +CPU= 16.401
  19:46:37 STEP 2819 H=2819:00 +CPU= 15.758
  19:47:04 STEP 2820 H=2820:00 +CPU= 26.669
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002820
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002820
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002820
  19:47:19 STEP 2821 H=2821:00 +CPU= 15.449
  19:47:36 STEP 2822 H=2822:00 +CPU= 16.272
  19:47:59 STEP 2823 H=2823:00 +CPU= 23.673
  19:48:15 STEP 2824 H=2824:00 +CPU= 15.721
  19:48:31 STEP 2825 H=2825:00 +CPU= 15.812
  19:48:55 STEP 2826 H=2826:00 +CPU= 24.211
  19:49:11 STEP 2827 H=2827:00 +CPU= 15.228
  19:49:26 STEP 2828 H=2828:00 +CPU= 15.695
  19:49:50 STEP 2829 H=2829:00 +CPU= 23.380
  19:50:06 STEP 2830 H=2830:00 +CPU= 16.200
  19:50:22 STEP 2831 H=2831:00 +CPU= 15.667
  19:50:49 STEP 2832 H=2832:00 +CPU= 26.816
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002832
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002832
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002832
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002808
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002808
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002808
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002820
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002820
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002820
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_117.zip
Uploading the intermediate file: upload_file_117.zip
  19:51:04 STEP 2833 H=2833:00 +CPU= 15.433
  19:51:20 STEP 2834 H=2834:00 +CPU= 15.907
  19:51:43 STEP 2835 H=2835:00 +CPU= 22.736
  19:51:59 STEP 2836 H=2836:00 +CPU= 15.936
  19:52:14 STEP 2837 H=2837:00 +CPU= 15.210
  19:52:38 STEP 2838 H=2838:00 +CPU= 24.107
  19:52:54 STEP 2839 H=2839:00 +CPU= 15.426
  19:53:10 STEP 2840 H=2840:00 +CPU= 16.237
  19:53:34 STEP 2841 H=2841:00 +CPU= 23.409
  19:53:49 STEP 2842 H=2842:00 +CPU= 15.220
  19:54:03 STEP 2843 H=2843:00 +CPU= 13.923
  19:54:27 STEP 2844 H=2844:00 +CPU= 24.277
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002844
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002844
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002844
  19:54:42 STEP 2845 H=2845:00 +CPU= 14.810
  19:54:59 STEP 2846 H=2846:00 +CPU= 16.924
  19:55:21 STEP 2847 H=2847:00 +CPU= 22.169
  19:55:37 STEP 2848 H=2848:00 +CPU= 15.285
  19:55:51 STEP 2849 H=2849:00 +CPU= 14.344
  19:56:14 STEP 2850 H=2850:00 +CPU= 22.673
  19:56:28 STEP 2851 H=2851:00 +CPU= 14.344
  19:56:44 STEP 2852 H=2852:00 +CPU= 15.737
  19:57:07 STEP 2853 H=2853:00 +CPU= 23.124
  19:57:22 STEP 2854 H=2854:00 +CPU= 14.894
  19:57:38 STEP 2855 H=2855:00 +CPU= 15.891
  19:58:06 STEP 2856 H=2856:00 +CPU= 27.566
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002856
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002856
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002856
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002832
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002832
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002832
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002844
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002844
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002844
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:58:21 STEP 2857 H=2857:00 +CPU= 15.029
  19:58:36 STEP 2858 H=2858:00 +CPU= 15.476
  19:59:00 STEP 2859 H=2859:00 +CPU= 23.482
  19:59:16 STEP 2860 H=2860:00 +CPU= 16.015
  19:59:31 STEP 2861 H=2861:00 +CPU= 15.072
  19:59:55 STEP 2862 H=2862:00 +CPU= 23.933
  20:00:10 STEP 2863 H=2863:00 +CPU= 15.031
  20:00:27 STEP 2864 H=2864:00 +CPU= 16.293
  20:00:49 STEP 2865 H=2865:00 +CPU= 22.813
  20:01:06 STEP 2866 H=2866:00 +CPU= 16.121
  20:01:21 STEP 2867 H=2867:00 +CPU= 15.476
  20:01:46 STEP 2868 H=2868:00 +CPU= 24.966
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002868
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002868
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002868
  20:02:02 STEP 2869 H=2869:00 +CPU= 15.048
  20:02:16 STEP 2870 H=2870:00 +CPU= 14.594
  20:02:40 STEP 2871 H=2871:00 +CPU= 23.235
  20:02:56 STEP 2872 H=2872:00 +CPU= 16.098
  20:03:11 STEP 2873 H=2873:00 +CPU= 15.235
  20:03:35 STEP 2874 H=2874:00 +CPU= 23.816
  20:03:50 STEP 2875 H=2875:00 +CPU= 15.143
  20:04:05 STEP 2876 H=2876:00 +CPU= 15.428
  20:04:29 STEP 2877 H=2877:00 +CPU= 23.088
  20:04:43 STEP 2878 H=2878:00 +CPU= 14.437
  20:04:59 STEP 2879 H=2879:00 +CPU= 15.455
  20:05:25 STEP 2880 H=2880:00 +CPU= 26.190
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002880
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002880
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002880
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002856
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002856
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002856
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002868
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002868
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002868
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_119.zip
Uploading the intermediate file: upload_file_119.zip
  20:05:40 STEP 2881 H=2881:00 +CPU= 14.709
Uploading trickle at timestep: 10368000
  20:05:55 STEP 2882 H=2882:00 +CPU= 15.213
  20:06:18 STEP 2883 H=2883:00 +CPU= 23.084
  20:06:33 STEP 2884 H=2884:00 +CPU= 14.962
  20:06:48 STEP 2885 H=2885:00 +CPU= 14.570
  20:07:11 STEP 2886 H=2886:00 +CPU= 22.598
  20:07:25 STEP 2887 H=2887:00 +CPU= 14.564
  20:07:41 STEP 2888 H=2888:00 +CPU= 15.696
  20:08:03 STEP 2889 H=2889:00 +CPU= 22.009
  20:08:18 STEP 2890 H=2890:00 +CPU= 15.151
  20:08:33 STEP 2891 H=2891:00 +CPU= 14.650
  20:08:58 STEP 2892 H=2892:00 +CPU= 24.575
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002892
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002892
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002892
  20:09:12 STEP 2893 H=2893:00 +CPU= 14.566
  20:09:28 STEP 2894 H=2894:00 +CPU= 15.627
  20:09:51 STEP 2895 H=2895:00 +CPU= 22.597
  20:10:06 STEP 2896 H=2896:00 +CPU= 15.227
  20:10:21 STEP 2897 H=2897:00 +CPU= 15.297
  20:10:43 STEP 2898 H=2898:00 +CPU= 22.221
  20:10:58 STEP 2899 H=2899:00 +CPU= 14.688
  20:11:14 STEP 2900 H=2900:00 +CPU= 15.257
  20:11:36 STEP 2901 H=2901:00 +CPU= 22.453
  20:11:50 STEP 2902 H=2902:00 +CPU= 13.928
  20:12:05 STEP 2903 H=2903:00 +CPU= 15.278
  20:12:33 STEP 2904 H=2904:00 +CPU= 27.632
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002904
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002904
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002904
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002880
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002880
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002880
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002892
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002892
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002892
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_120.zip
Uploading the intermediate file: upload_file_120.zip
  20:12:47 STEP 2905 H=2905:00 +CPU= 14.174
  20:13:02 STEP 2906 H=2906:00 +CPU= 15.030
  20:13:25 STEP 2907 H=2907:00 +CPU= 22.490
  20:13:40 STEP 2908 H=2908:00 +CPU= 15.002
  20:13:55 STEP 2909 H=2909:00 +CPU= 14.638
  20:14:18 STEP 2910 H=2910:00 +CPU= 22.970
  20:14:32 STEP 2911 H=2911:00 +CPU= 14.123
  20:14:47 STEP 2912 H=2912:00 +CPU= 15.280
  20:15:10 STEP 2913 H=2913:00 +CPU= 22.631
  20:15:26 STEP 2914 H=2914:00 +CPU= 15.992
  20:15:41 STEP 2915 H=2915:00 +CPU= 15.035
  20:16:06 STEP 2916 H=2916:00 +CPU= 24.720
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002916
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002916
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002916
  20:16:21 STEP 2917 H=2917:00 +CPU= 14.370
  20:16:36 STEP 2918 H=2918:00 +CPU= 15.061
  20:16:58 STEP 2919 H=2919:00 +CPU= 22.339
  20:17:14 STEP 2920 H=2920:00 +CPU= 15.564
  20:17:28 STEP 2921 H=2921:00 +CPU= 14.318
  20:17:51 STEP 2922 H=2922:00 +CPU= 22.766
  20:18:06 STEP 2923 H=2923:00 +CPU= 14.651
  20:18:22 STEP 2924 H=2924:00 +CPU= 16.081
  20:18:45 STEP 2925 H=2925:00 +CPU= 23.038
  20:19:00 STEP 2926 H=2926:00 +CPU= 15.335
  20:19:16 STEP 2927 H=2927:00 +CPU= 15.268
  20:19:42 STEP 2928 H=2928:00 +CPU= 26.202
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002928
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002928
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002928
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002904
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002904
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002904
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002916
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002916
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002916
Zipping up the intermediate file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_121.zip
Uploading the intermediate file: upload_file_121.zip
  20:19:57 STEP 2929 H=2929:00 +CPU= 15.041
  20:20:12 STEP 2930 H=2930:00 +CPU= 14.916
  20:20:35 STEP 2931 H=2931:00 +CPU= 22.626
  20:20:50 STEP 2932 H=2932:00 +CPU= 15.171
  20:21:05 STEP 2933 H=2933:00 +CPU= 14.809
  20:21:28 STEP 2934 H=2934:00 +CPU= 22.857
  20:21:42 STEP 2935 H=2935:00 +CPU= 14.227
  20:21:57 STEP 2936 H=2936:00 +CPU= 15.130
  20:22:20 STEP 2937 H=2937:00 +CPU= 22.442
  20:22:35 STEP 2938 H=2938:00 +CPU= 15.297
  20:22:50 STEP 2939 H=2939:00 +CPU= 14.666
  20:23:15 STEP 2940 H=2940:00 +CPU= 24.497
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002940
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002940
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002940
  20:23:29 STEP 2941 H=2941:00 +CPU= 14.537
  20:23:45 STEP 2942 H=2942:00 +CPU= 15.458
  20:24:08 STEP 2943 H=2943:00 +CPU= 23.081
  20:24:22 STEP 2944 H=2944:00 +CPU= 14.390
  20:24:38 STEP 2945 H=2945:00 +CPU= 15.734
  20:25:02 STEP 2946 H=2946:00 +CPU= 23.414
  20:25:17 STEP 2947 H=2947:00 +CPU= 14.946
  20:25:32 STEP 2948 H=2948:00 +CPU= 14.863
  20:25:54 STEP 2949 H=2949:00 +CPU= 22.702
  20:26:11 STEP 2950 H=2950:00 +CPU= 16.918
  20:26:27 STEP 2951 H=2951:00 +CPU= 15.384
  20:26:52 STEP 2952 H=2952:00 +CPU= 25.656
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.18968881616733     
  MAXGPFV : MAX. VALUE =   0.743172046163575     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    322588634 BYTES IN      8 RECORDS TRANSFERRED IN    0.0004 SECONDS806471.6 Mbytes/s, TOTAL TIME=    0.0077( 5.2%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 20:26:52 STEP 2952 H=2952:00 +CPU= 25.656
 END CNT3
 NSTEP =  2952 CNT0   000000000  22.438  22.438  22.476   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   141.8     0.0   141.8     0.7   228.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1651.9    1651.9      9.39      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     292.7     292.7      1.53      0.00
  10 SCAN2M - PHYSICS                             2953    7844.3    7844.3     41.13      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     894.4     894.4      0.39      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      14.5      14.5      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    8381.0    8381.0     14.66      0.00
  14 SUINIF                                          1    1204.6    1204.6      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      34.5      34.5      0.02      0.00
  18 SUSPECG                                         1     215.0     215.0      0.00      0.00
  19 SUSPEC                                          1     221.6     221.6      0.00      0.00
  24 SUGRIDU                                         1     735.5     735.5      0.00      0.00
  25 SPECRT                                          1     117.6     117.6      0.00      0.00
  26 SUGRIDF                                         1     129.8     129.8      0.00      0.00
  27 RESTART FILES - WRITING                       123    1796.0    1796.0      0.39      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1565.5    1565.5      0.69      0.00
  31 POSDDH IN STEPO                                13       0.5       0.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    2683.8    2683.8     14.07      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    2118.8    2118.8     11.11      0.00
  39 SU0YOMB                                         1     202.8     202.8      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953      13.2      13.2      0.07      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952     260.9     260.9      1.37      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      41.1      41.1      0.22      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094     109.0     109.0      1.95      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152     108.0     108.0      1.18      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      43.9      43.9      0.48      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      41.8      41.8      0.75      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      17.3      17.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      15.7      15.7      0.28      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152      14.1      14.1      0.15      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      19.2      19.2      0.34      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      11.5      11.5      0.13      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    56314.8 CPU TIME   55235.1 VECTOR TIME    55235.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      188.7
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/psands/BOINC/slots/10/ICMGGhnw4+002952
Moving to projects directory: /home/psands/BOINC/slots/10/ICMSHhnw4+002952
Moving to projects directory: /home/psands/BOINC/slots/10/ICMUAhnw4+002952
Adding to the zip: /home/psands/BOINC/slots/10/NODE.001_01
Adding to the zip: /home/psands/BOINC/slots/10/ifs.stat
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002952
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002928
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002928
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002952
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMGGhnw4+002940
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002952
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002940
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMSHhnw4+002940
Adding to the zip: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_12214998/ICMUAhnw4+002928
Zipping up the final file: /home/psands/BOINC/projects/climateprediction.net/oifs_43r3_017c_2019110100_123_993_12214998_1_r1385476059_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
20:30:14 (21910): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:11 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 10,623,600 55,235 0.0052
09 May 2023 16:54:09 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 10,368,000 53,956 0.0052
09 May 2023 16:54:06 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 9,504,000 49,444 0.0052
09 May 2023 16:54:04 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 8,640,000 45,036 0.0052
09 May 2023 16:54:01 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 7,776,000 40,638 0.0052
09 May 2023 16:53:58 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 6,912,000 36,155 0.0052
09 May 2023 16:53:54 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 6,048,000 31,678 0.0052
09 May 2023 16:53:51 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 5,184,000 27,160 0.0052
09 May 2023 16:53:47 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 4,320,000 22,766 0.0053
09 May 2023 16:53:44 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 3,456,000 18,195 0.0053
09 May 2023 16:53:40 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 2,592,000 13,633 0.0053
09 May 2023 16:53:36 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 1,728,000 9,112 0.0053
09 May 2023 16:53:32 1514479 22317034 oifs_43r3_017c_2019110100_123_993_12214998_1 864,000 4,561 0.0053


©2024 climateprediction.net