climateprediction.net home page
Task 22315022

Task 22315022

Name oifs_43r3_006m_2019110100_123_993_12213676_0
Workunit 12213676
Created 24 Feb 2023, 12:19:03 UTC
Sent 24 Feb 2023, 18:18:50 UTC
Report deadline 25 Apr 2023, 18:18:50 UTC
Received 25 Feb 2023, 20:19:37 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1526034
Run time 11 hours 18 min 18 sec
CPU time 11 hours 18 min 18 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 9.31 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,767.81 MB
Peak swap size 4,974.78 MB
Peak disk usage 1,267.00 MB
Stderr
<core_client_version>7.22.0</core_client_version>
<![CDATA[
<stderr_txt>
fs_43r3_12213676/ICMSHhnw4+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002340
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_97.zip
Uploading the intermediate file: upload_file_97.zip
  17:42:32 STEP 2353 H=2353:00 +CPU= 10.317
  17:42:43 STEP 2354 H=2354:00 +CPU= 10.677
Uploading trickle at timestep: 8467200
  17:43:00 STEP 2355 H=2355:00 +CPU= 16.480
  17:43:11 STEP 2356 H=2356:00 +CPU= 10.628
  17:43:22 STEP 2357 H=2357:00 +CPU= 10.248
  17:43:39 STEP 2358 H=2358:00 +CPU= 16.714
  17:43:50 STEP 2359 H=2359:00 +CPU= 10.285
  17:44:01 STEP 2360 H=2360:00 +CPU= 10.687
  17:44:18 STEP 2361 H=2361:00 +CPU= 16.437
  17:44:29 STEP 2362 H=2362:00 +CPU= 10.589
  17:44:40 STEP 2363 H=2363:00 +CPU= 10.265
  17:44:59 STEP 2364 H=2364:00 +CPU= 17.878
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002364
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002364
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002364
  17:45:09 STEP 2365 H=2365:00 +CPU= 10.326
  17:45:21 STEP 2366 H=2366:00 +CPU= 10.733
  17:45:38 STEP 2367 H=2367:00 +CPU= 16.644
  17:45:49 STEP 2368 H=2368:00 +CPU= 10.806
  17:46:00 STEP 2369 H=2369:00 +CPU= 10.493
  17:46:18 STEP 2370 H=2370:00 +CPU= 17.053
  17:46:29 STEP 2371 H=2371:00 +CPU= 10.460
  17:46:40 STEP 2372 H=2372:00 +CPU= 10.875
  17:46:58 STEP 2373 H=2373:00 +CPU= 16.620
  17:47:09 STEP 2374 H=2374:00 +CPU= 10.766
  17:47:20 STEP 2375 H=2375:00 +CPU= 10.755
  17:47:40 STEP 2376 H=2376:00 +CPU= 18.934
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_98.zip
Uploading the intermediate file: upload_file_98.zip
  17:47:51 STEP 2377 H=2377:00 +CPU= 10.333
  17:48:02 STEP 2378 H=2378:00 +CPU= 10.652
  17:48:19 STEP 2379 H=2379:00 +CPU= 16.437
  17:48:30 STEP 2380 H=2380:00 +CPU= 10.618
  17:48:41 STEP 2381 H=2381:00 +CPU= 10.383
  17:48:59 STEP 2382 H=2382:00 +CPU= 16.949
  17:49:09 STEP 2383 H=2383:00 +CPU= 10.297
  17:49:20 STEP 2384 H=2384:00 +CPU= 10.551
  17:49:37 STEP 2385 H=2385:00 +CPU= 16.385
  17:49:49 STEP 2386 H=2386:00 +CPU= 10.641
  17:49:59 STEP 2387 H=2387:00 +CPU= 10.348
  17:50:18 STEP 2388 H=2388:00 +CPU= 17.866
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002388
  17:50:29 STEP 2389 H=2389:00 +CPU= 10.334
  17:50:40 STEP 2390 H=2390:00 +CPU= 10.666
  17:50:57 STEP 2391 H=2391:00 +CPU= 16.443
  17:51:08 STEP 2392 H=2392:00 +CPU= 10.653
  17:51:19 STEP 2393 H=2393:00 +CPU= 10.325
  17:51:36 STEP 2394 H=2394:00 +CPU= 16.636
  17:51:47 STEP 2395 H=2395:00 +CPU= 10.275
  17:51:58 STEP 2396 H=2396:00 +CPU= 10.651
  17:52:15 STEP 2397 H=2397:00 +CPU= 16.364
  17:52:26 STEP 2398 H=2398:00 +CPU= 10.617
  17:52:37 STEP 2399 H=2399:00 +CPU= 10.628
  17:52:57 STEP 2400 H=2400:00 +CPU= 18.638
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_99.zip
Uploading the intermediate file: upload_file_99.zip
  17:53:08 STEP 2401 H=2401:00 +CPU= 10.322
  17:53:19 STEP 2402 H=2402:00 +CPU= 10.615
  17:53:36 STEP 2403 H=2403:00 +CPU= 16.410
  17:53:47 STEP 2404 H=2404:00 +CPU= 10.760
  17:53:58 STEP 2405 H=2405:00 +CPU= 10.254
  17:54:15 STEP 2406 H=2406:00 +CPU= 16.847
  17:54:26 STEP 2407 H=2407:00 +CPU= 10.300
  17:54:37 STEP 2408 H=2408:00 +CPU= 10.600
  17:54:54 STEP 2409 H=2409:00 +CPU= 16.428
  17:55:05 STEP 2410 H=2410:00 +CPU= 10.623
  17:55:16 STEP 2411 H=2411:00 +CPU= 10.271
  17:55:34 STEP 2412 H=2412:00 +CPU= 17.649
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002412
  17:55:45 STEP 2413 H=2413:00 +CPU= 10.146
  17:55:56 STEP 2414 H=2414:00 +CPU= 10.543
  17:56:13 STEP 2415 H=2415:00 +CPU= 16.163
  17:56:24 STEP 2416 H=2416:00 +CPU= 10.560
  17:56:35 STEP 2417 H=2417:00 +CPU= 10.163
  17:56:52 STEP 2418 H=2418:00 +CPU= 16.613
  17:57:03 STEP 2419 H=2419:00 +CPU= 10.249
  17:57:13 STEP 2420 H=2420:00 +CPU= 10.444
  17:57:30 STEP 2421 H=2421:00 +CPU= 16.160
  17:57:41 STEP 2422 H=2422:00 +CPU= 10.558
  17:57:52 STEP 2423 H=2423:00 +CPU= 10.478
  17:58:12 STEP 2424 H=2424:00 +CPU= 18.722
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_100.zip
Uploading the intermediate file: upload_file_100.zip
  17:58:22 STEP 2425 H=2425:00 +CPU= 10.108
  17:58:33 STEP 2426 H=2426:00 +CPU= 10.520
  17:58:50 STEP 2427 H=2427:00 +CPU= 16.197
  17:59:01 STEP 2428 H=2428:00 +CPU= 10.562
  17:59:12 STEP 2429 H=2429:00 +CPU= 10.247
  17:59:29 STEP 2430 H=2430:00 +CPU= 16.642
  17:59:40 STEP 2431 H=2431:00 +CPU= 10.221
  17:59:51 STEP 2432 H=2432:00 +CPU= 10.573
  18:00:08 STEP 2433 H=2433:00 +CPU= 16.342
  18:00:19 STEP 2434 H=2434:00 +CPU= 10.558
  18:00:30 STEP 2435 H=2435:00 +CPU= 10.248
  18:00:48 STEP 2436 H=2436:00 +CPU= 17.729
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002436
  18:00:59 STEP 2437 H=2437:00 +CPU= 10.075
  18:01:10 STEP 2438 H=2438:00 +CPU= 10.509
  18:01:27 STEP 2439 H=2439:00 +CPU= 16.257
  18:01:38 STEP 2440 H=2440:00 +CPU= 10.757
  18:01:49 STEP 2441 H=2441:00 +CPU= 10.328
  18:02:07 STEP 2442 H=2442:00 +CPU= 16.771
  18:02:17 STEP 2443 H=2443:00 +CPU= 10.338
  18:02:29 STEP 2444 H=2444:00 +CPU= 10.633
  18:02:46 STEP 2445 H=2445:00 +CPU= 16.455
  18:02:57 STEP 2446 H=2446:00 +CPU= 10.680
  18:03:08 STEP 2447 H=2447:00 +CPU= 10.699
  18:03:28 STEP 2448 H=2448:00 +CPU= 19.081
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_101.zip
Uploading the intermediate file: upload_file_101.zip
  18:03:40 STEP 2449 H=2449:00 +CPU= 10.682
  18:03:51 STEP 2450 H=2450:00 +CPU= 10.924
  18:04:09 STEP 2451 H=2451:00 +CPU= 16.927
  18:04:20 STEP 2452 H=2452:00 +CPU= 10.963
  18:04:32 STEP 2453 H=2453:00 +CPU= 10.622
  18:04:50 STEP 2454 H=2454:00 +CPU= 17.119
  18:05:01 STEP 2455 H=2455:00 +CPU= 10.572
  18:05:12 STEP 2456 H=2456:00 +CPU= 10.873
  18:05:30 STEP 2457 H=2457:00 +CPU= 16.840
  18:05:41 STEP 2458 H=2458:00 +CPU= 10.877
  18:05:52 STEP 2459 H=2459:00 +CPU= 10.623
  18:06:12 STEP 2460 H=2460:00 +CPU= 18.617
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002460
  18:06:24 STEP 2461 H=2461:00 +CPU= 11.270
  18:06:36 STEP 2462 H=2462:00 +CPU= 11.597
  18:06:54 STEP 2463 H=2463:00 +CPU= 17.308
  18:07:06 STEP 2464 H=2464:00 +CPU= 11.187
  18:07:17 STEP 2465 H=2465:00 +CPU= 10.826
  18:07:36 STEP 2466 H=2466:00 +CPU= 17.694
  18:07:47 STEP 2467 H=2467:00 +CPU= 10.798
  18:07:59 STEP 2468 H=2468:00 +CPU= 11.312
  18:08:17 STEP 2469 H=2469:00 +CPU= 17.317
  18:08:29 STEP 2470 H=2470:00 +CPU= 11.251
  18:08:41 STEP 2471 H=2471:00 +CPU= 11.270
  18:09:02 STEP 2472 H=2472:00 +CPU= 19.813
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_102.zip
Uploading the intermediate file: upload_file_102.zip
  18:09:13 STEP 2473 H=2473:00 +CPU= 10.907
  18:09:25 STEP 2474 H=2474:00 +CPU= 11.127
  18:09:43 STEP 2475 H=2475:00 +CPU= 17.324
  18:09:55 STEP 2476 H=2476:00 +CPU= 11.330
  18:10:07 STEP 2477 H=2477:00 +CPU= 11.161
  18:10:26 STEP 2478 H=2478:00 +CPU= 18.116
  18:10:38 STEP 2479 H=2479:00 +CPU= 11.248
  18:10:50 STEP 2480 H=2480:00 +CPU= 11.411
  18:11:08 STEP 2481 H=2481:00 +CPU= 17.757
  18:11:21 STEP 2482 H=2482:00 +CPU= 11.498
  18:11:32 STEP 2483 H=2483:00 +CPU= 11.195
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:12:14 STEP 2484 H=2484:00 +CPU= 19.677
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002484
  18:12:26 STEP 2485 H=2485:00 +CPU= 11.474
  18:12:38 STEP 2486 H=2486:00 +CPU= 11.558
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:13:18 STEP 2487 H=2487:00 +CPU= 17.505
  18:13:30 STEP 2488 H=2488:00 +CPU= 11.552
  18:13:42 STEP 2489 H=2489:00 +CPU= 11.059
  18:14:01 STEP 2490 H=2490:00 +CPU= 18.230
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:14:34 STEP 2491 H=2491:00 +CPU= 11.210
  18:14:46 STEP 2492 H=2492:00 +CPU= 11.824
  18:15:05 STEP 2493 H=2493:00 +CPU= 17.703
  18:15:17 STEP 2494 H=2494:00 +CPU= 11.721
  18:15:30 STEP 2495 H=2495:00 +CPU= 11.899
  18:15:51 STEP 2496 H=2496:00 +CPU= 20.476
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_103.zip
Uploading the intermediate file: upload_file_103.zip
  18:16:03 STEP 2497 H=2497:00 +CPU= 11.138
  18:16:15 STEP 2498 H=2498:00 +CPU= 11.610
  18:16:34 STEP 2499 H=2499:00 +CPU= 17.637
  18:16:46 STEP 2500 H=2500:00 +CPU= 11.437
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:17:19 STEP 2501 H=2501:00 +CPU= 11.040
  18:17:38 STEP 2502 H=2502:00 +CPU= 18.053
  18:17:50 STEP 2503 H=2503:00 +CPU= 11.252
  18:18:02 STEP 2504 H=2504:00 +CPU= 11.761
  18:18:21 STEP 2505 H=2505:00 +CPU= 17.951
  18:18:33 STEP 2506 H=2506:00 +CPU= 11.680
  18:18:45 STEP 2507 H=2507:00 +CPU= 11.443
  18:19:06 STEP 2508 H=2508:00 +CPU= 19.323
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002508
  18:19:18 STEP 2509 H=2509:00 +CPU= 11.333
  18:19:30 STEP 2510 H=2510:00 +CPU= 11.534
  18:19:48 STEP 2511 H=2511:00 +CPU= 17.437
  18:20:01 STEP 2512 H=2512:00 +CPU= 11.501
  18:20:12 STEP 2513 H=2513:00 +CPU= 11.123
  18:20:31 STEP 2514 H=2514:00 +CPU= 17.824
  18:20:43 STEP 2515 H=2515:00 +CPU= 11.011
  18:20:55 STEP 2516 H=2516:00 +CPU= 11.472
  18:21:13 STEP 2517 H=2517:00 +CPU= 17.312
  18:21:25 STEP 2518 H=2518:00 +CPU= 11.346
  18:21:37 STEP 2519 H=2519:00 +CPU= 11.624
  18:21:59 STEP 2520 H=2520:00 +CPU= 20.834
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_104.zip
Uploading the intermediate file: upload_file_104.zip
  18:22:12 STEP 2521 H=2521:00 +CPU= 11.406
  18:22:24 STEP 2522 H=2522:00 +CPU= 11.639
  18:22:43 STEP 2523 H=2523:00 +CPU= 17.672
  18:22:55 STEP 2524 H=2524:00 +CPU= 11.388
  18:23:06 STEP 2525 H=2525:00 +CPU= 11.202
  18:23:25 STEP 2526 H=2526:00 +CPU= 17.697
  18:23:36 STEP 2527 H=2527:00 +CPU= 11.008
  18:23:48 STEP 2528 H=2528:00 +CPU= 11.473
  18:24:06 STEP 2529 H=2529:00 +CPU= 17.138
  18:24:17 STEP 2530 H=2530:00 +CPU= 10.248
  18:24:27 STEP 2531 H=2531:00 +CPU= 10.277
  18:24:47 STEP 2532 H=2532:00 +CPU= 18.960
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002532
  18:24:59 STEP 2533 H=2533:00 +CPU= 10.956
  18:25:11 STEP 2534 H=2534:00 +CPU= 11.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:25:49 STEP 2535 H=2535:00 +CPU= 16.613
  18:26:01 STEP 2536 H=2536:00 +CPU= 11.010
  18:26:12 STEP 2537 H=2537:00 +CPU= 10.727
  18:26:30 STEP 2538 H=2538:00 +CPU= 17.345
  18:26:41 STEP 2539 H=2539:00 +CPU= 10.673
  18:26:53 STEP 2540 H=2540:00 +CPU= 11.024
  18:27:10 STEP 2541 H=2541:00 +CPU= 16.551
  18:27:22 STEP 2542 H=2542:00 +CPU= 11.049
  18:27:34 STEP 2543 H=2543:00 +CPU= 11.223
  18:27:54 STEP 2544 H=2544:00 +CPU= 19.293
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_105.zip
Uploading the intermediate file: upload_file_105.zip
  18:28:05 STEP 2545 H=2545:00 +CPU= 10.704
  18:28:17 STEP 2546 H=2546:00 +CPU= 10.859
  18:28:35 STEP 2547 H=2547:00 +CPU= 16.837
  18:28:46 STEP 2548 H=2548:00 +CPU= 10.973
  18:28:57 STEP 2549 H=2549:00 +CPU= 10.642
  18:29:16 STEP 2550 H=2550:00 +CPU= 17.403
  18:29:27 STEP 2551 H=2551:00 +CPU= 10.895
  18:29:39 STEP 2552 H=2552:00 +CPU= 11.221
  18:29:57 STEP 2553 H=2553:00 +CPU= 17.213
  18:30:09 STEP 2554 H=2554:00 +CPU= 11.208
  18:30:20 STEP 2555 H=2555:00 +CPU= 10.839
  18:30:40 STEP 2556 H=2556:00 +CPU= 18.526
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002556
  18:30:51 STEP 2557 H=2557:00 +CPU= 10.532
  18:31:03 STEP 2558 H=2558:00 +CPU= 11.198
  18:31:21 STEP 2559 H=2559:00 +CPU= 17.288
  18:31:33 STEP 2560 H=2560:00 +CPU= 11.396
  18:31:45 STEP 2561 H=2561:00 +CPU= 11.014
  18:32:03 STEP 2562 H=2562:00 +CPU= 17.451
  18:32:15 STEP 2563 H=2563:00 +CPU= 11.050
  18:32:27 STEP 2564 H=2564:00 +CPU= 11.259
  18:32:44 STEP 2565 H=2565:00 +CPU= 17.072
  18:32:56 STEP 2566 H=2566:00 +CPU= 10.992
  18:33:08 STEP 2567 H=2567:00 +CPU= 10.898
  18:33:28 STEP 2568 H=2568:00 +CPU= 19.156
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_106.zip
Uploading the intermediate file: upload_file_106.zip
  18:33:39 STEP 2569 H=2569:00 +CPU= 10.768
  18:33:51 STEP 2570 H=2570:00 +CPU= 11.153
  18:34:09 STEP 2571 H=2571:00 +CPU= 16.996
  18:34:20 STEP 2572 H=2572:00 +CPU= 11.217
  18:34:32 STEP 2573 H=2573:00 +CPU= 10.829
  18:34:50 STEP 2574 H=2574:00 +CPU= 17.351
  18:35:02 STEP 2575 H=2575:00 +CPU= 10.696
  18:35:13 STEP 2576 H=2576:00 +CPU= 10.901
  18:35:31 STEP 2577 H=2577:00 +CPU= 16.754
  18:35:42 STEP 2578 H=2578:00 +CPU= 10.935
  18:35:53 STEP 2579 H=2579:00 +CPU= 10.626
  18:36:13 STEP 2580 H=2580:00 +CPU= 18.221
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002580
  18:36:24 STEP 2581 H=2581:00 +CPU= 10.794
  18:36:35 STEP 2582 H=2582:00 +CPU= 11.000
  18:36:53 STEP 2583 H=2583:00 +CPU= 16.969
  18:37:05 STEP 2584 H=2584:00 +CPU= 11.281
  18:37:17 STEP 2585 H=2585:00 +CPU= 10.978
  18:37:35 STEP 2586 H=2586:00 +CPU= 17.387
  18:37:46 STEP 2587 H=2587:00 +CPU= 10.744
  18:37:58 STEP 2588 H=2588:00 +CPU= 11.142
  18:38:16 STEP 2589 H=2589:00 +CPU= 17.023
  18:38:28 STEP 2590 H=2590:00 +CPU= 11.322
  18:38:40 STEP 2591 H=2591:00 +CPU= 11.212
  18:39:00 STEP 2592 H=2592:00 +CPU= 19.207
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_107.zip
Uploading the intermediate file: upload_file_107.zip
  18:39:11 STEP 2593 H=2593:00 +CPU= 10.561
  18:39:22 STEP 2594 H=2594:00 +CPU= 10.913
Uploading trickle at timestep: 9331200
  18:39:40 STEP 2595 H=2595:00 +CPU= 16.705
  18:39:52 STEP 2596 H=2596:00 +CPU= 10.965
  18:40:03 STEP 2597 H=2597:00 +CPU= 10.562
  18:40:21 STEP 2598 H=2598:00 +CPU= 17.192
  18:40:32 STEP 2599 H=2599:00 +CPU= 10.670
  18:40:44 STEP 2600 H=2600:00 +CPU= 11.025
  18:41:02 STEP 2601 H=2601:00 +CPU= 16.966
  18:41:13 STEP 2602 H=2602:00 +CPU= 10.937
  18:41:24 STEP 2603 H=2603:00 +CPU= 10.536
  18:41:43 STEP 2604 H=2604:00 +CPU= 18.098
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002604
  18:41:55 STEP 2605 H=2605:00 +CPU= 10.708
  18:42:06 STEP 2606 H=2606:00 +CPU= 11.024
  18:42:24 STEP 2607 H=2607:00 +CPU= 16.956
  18:42:36 STEP 2608 H=2608:00 +CPU= 11.013
  18:42:47 STEP 2609 H=2609:00 +CPU= 10.742
  18:43:05 STEP 2610 H=2610:00 +CPU= 17.180
  18:43:16 STEP 2611 H=2611:00 +CPU= 10.630
  18:43:28 STEP 2612 H=2612:00 +CPU= 11.134
  18:43:46 STEP 2613 H=2613:00 +CPU= 16.959
  18:43:57 STEP 2614 H=2614:00 +CPU= 11.120
  18:44:09 STEP 2615 H=2615:00 +CPU= 11.064
  18:44:30 STEP 2616 H=2616:00 +CPU= 19.671
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_108.zip
Uploading the intermediate file: upload_file_108.zip
  18:44:41 STEP 2617 H=2617:00 +CPU= 10.938
  18:44:53 STEP 2618 H=2618:00 +CPU= 11.121
  18:45:11 STEP 2619 H=2619:00 +CPU= 17.108
  18:45:23 STEP 2620 H=2620:00 +CPU= 11.080
  18:45:34 STEP 2621 H=2621:00 +CPU= 10.772
  18:45:53 STEP 2622 H=2622:00 +CPU= 17.572
  18:46:04 STEP 2623 H=2623:00 +CPU= 10.852
  18:46:16 STEP 2624 H=2624:00 +CPU= 11.221
  18:46:34 STEP 2625 H=2625:00 +CPU= 17.101
  18:46:46 STEP 2626 H=2626:00 +CPU= 11.289
  18:46:57 STEP 2627 H=2627:00 +CPU= 10.835
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:47:37 STEP 2628 H=2628:00 +CPU= 18.370
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002628
  18:47:49 STEP 2629 H=2629:00 +CPU= 10.778
  18:48:01 STEP 2630 H=2630:00 +CPU= 11.289
  18:48:19 STEP 2631 H=2631:00 +CPU= 17.011
  18:48:30 STEP 2632 H=2632:00 +CPU= 11.265
  18:48:42 STEP 2633 H=2633:00 +CPU= 10.983
  18:49:00 STEP 2634 H=2634:00 +CPU= 17.452
  18:49:12 STEP 2635 H=2635:00 +CPU= 10.899
  18:49:24 STEP 2636 H=2636:00 +CPU= 11.225
  18:49:41 STEP 2637 H=2637:00 +CPU= 16.816
  18:49:53 STEP 2638 H=2638:00 +CPU= 10.941
  18:50:05 STEP 2639 H=2639:00 +CPU= 11.029
  18:50:24 STEP 2640 H=2640:00 +CPU= 18.739
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_109.zip
Uploading the intermediate file: upload_file_109.zip
  18:50:35 STEP 2641 H=2641:00 +CPU= 10.241
  18:50:46 STEP 2642 H=2642:00 +CPU= 10.697
  18:51:04 STEP 2643 H=2643:00 +CPU= 16.627
  18:51:15 STEP 2644 H=2644:00 +CPU= 10.731
  18:51:26 STEP 2645 H=2645:00 +CPU= 10.360
  18:51:43 STEP 2646 H=2646:00 +CPU= 16.519
  18:51:54 STEP 2647 H=2647:00 +CPU= 10.370
  18:52:06 STEP 2648 H=2648:00 +CPU= 10.586
  18:52:23 STEP 2649 H=2649:00 +CPU= 16.191
  18:52:34 STEP 2650 H=2650:00 +CPU= 10.658
  18:52:45 STEP 2651 H=2651:00 +CPU= 10.388
  18:53:03 STEP 2652 H=2652:00 +CPU= 17.593
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002652
  18:53:14 STEP 2653 H=2653:00 +CPU= 10.190
  18:53:25 STEP 2654 H=2654:00 +CPU= 10.529
  18:53:42 STEP 2655 H=2655:00 +CPU= 15.921
  18:53:53 STEP 2656 H=2656:00 +CPU= 10.643
  18:54:03 STEP 2657 H=2657:00 +CPU= 10.213
  18:54:21 STEP 2658 H=2658:00 +CPU= 16.347
  18:54:32 STEP 2659 H=2659:00 +CPU= 10.475
  18:54:43 STEP 2660 H=2660:00 +CPU= 10.765
  18:55:00 STEP 2661 H=2661:00 +CPU= 16.241
  18:55:11 STEP 2662 H=2662:00 +CPU= 10.629
  18:55:22 STEP 2663 H=2663:00 +CPU= 10.535
  18:55:41 STEP 2664 H=2664:00 +CPU= 18.246
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_110.zip
Uploading the intermediate file: upload_file_110.zip
  18:55:52 STEP 2665 H=2665:00 +CPU= 10.031
  18:56:03 STEP 2666 H=2666:00 +CPU= 10.456
  18:56:20 STEP 2667 H=2667:00 +CPU= 16.032
  18:56:31 STEP 2668 H=2668:00 +CPU= 10.532
  18:56:42 STEP 2669 H=2669:00 +CPU= 10.350
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:57:20 STEP 2670 H=2670:00 +CPU= 16.469
  18:57:31 STEP 2671 H=2671:00 +CPU= 10.361
  18:57:42 STEP 2672 H=2672:00 +CPU= 10.592
  18:57:59 STEP 2673 H=2673:00 +CPU= 16.614
  18:58:11 STEP 2674 H=2674:00 +CPU= 10.702
  18:58:21 STEP 2675 H=2675:00 +CPU= 10.399
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           13  MAX ETADOT VERTICAL VEL.=   3.264367035464041E-007
  LON  =    151.250000000000       degrees
  LAT  =    35.3269057618723       degrees
  18:58:41 STEP 2676 H=2676:00 +CPU= 18.488
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002676
  18:58:53 STEP 2677 H=2677:00 +CPU= 10.758
  18:59:04 STEP 2678 H=2678:00 +CPU= 10.866
  18:59:21 STEP 2679 H=2679:00 +CPU= 16.374
  18:59:33 STEP 2680 H=2680:00 +CPU= 10.747
  18:59:44 STEP 2681 H=2681:00 +CPU= 10.417
  19:00:01 STEP 2682 H=2682:00 +CPU= 16.701
  19:00:13 STEP 2683 H=2683:00 +CPU= 10.745
  19:00:24 STEP 2684 H=2684:00 +CPU= 10.791
  19:00:42 STEP 2685 H=2685:00 +CPU= 16.630
  19:00:53 STEP 2686 H=2686:00 +CPU= 10.755
  19:01:05 STEP 2687 H=2687:00 +CPU= 10.855
  19:01:25 STEP 2688 H=2688:00 +CPU= 19.338
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_111.zip
Uploading the intermediate file: upload_file_111.zip
  19:01:36 STEP 2689 H=2689:00 +CPU= 10.433
  19:01:48 STEP 2690 H=2690:00 +CPU= 10.655
  19:02:05 STEP 2691 H=2691:00 +CPU= 16.549
  19:02:16 STEP 2692 H=2692:00 +CPU= 10.648
  19:02:27 STEP 2693 H=2693:00 +CPU= 10.521
  19:02:45 STEP 2694 H=2694:00 +CPU= 16.802
  19:02:56 STEP 2695 H=2695:00 +CPU= 10.492
  19:03:08 STEP 2696 H=2696:00 +CPU= 10.898
  19:03:25 STEP 2697 H=2697:00 +CPU= 16.563
  19:03:37 STEP 2698 H=2698:00 +CPU= 10.839
  19:03:48 STEP 2699 H=2699:00 +CPU= 10.599
  19:04:07 STEP 2700 H=2700:00 +CPU= 18.105
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002700
  19:04:18 STEP 2701 H=2701:00 +CPU= 10.820
  19:04:30 STEP 2702 H=2702:00 +CPU= 11.034
  19:04:48 STEP 2703 H=2703:00 +CPU= 16.773
  19:04:59 STEP 2704 H=2704:00 +CPU= 11.060
  19:05:10 STEP 2705 H=2705:00 +CPU= 10.699
  19:05:28 STEP 2706 H=2706:00 +CPU= 17.085
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:06:00 STEP 2707 H=2707:00 +CPU= 10.420
  19:06:12 STEP 2708 H=2708:00 +CPU= 11.016
  19:06:30 STEP 2709 H=2709:00 +CPU= 16.795
  19:06:41 STEP 2710 H=2710:00 +CPU= 11.124
  19:06:53 STEP 2711 H=2711:00 +CPU= 11.264
  19:07:14 STEP 2712 H=2712:00 +CPU= 19.562
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_112.zip
Uploading the intermediate file: upload_file_112.zip
  19:07:25 STEP 2713 H=2713:00 +CPU= 10.906
  19:07:37 STEP 2714 H=2714:00 +CPU= 11.244
  19:07:55 STEP 2715 H=2715:00 +CPU= 17.114
  19:08:06 STEP 2716 H=2716:00 +CPU= 11.212
  19:08:18 STEP 2717 H=2717:00 +CPU= 11.037
  19:08:36 STEP 2718 H=2718:00 +CPU= 17.621
  19:08:48 STEP 2719 H=2719:00 +CPU= 10.937
  19:09:00 STEP 2720 H=2720:00 +CPU= 11.369
  19:09:18 STEP 2721 H=2721:00 +CPU= 17.328
  19:09:30 STEP 2722 H=2722:00 +CPU= 11.372
  19:09:41 STEP 2723 H=2723:00 +CPU= 11.131
  19:10:01 STEP 2724 H=2724:00 +CPU= 18.862
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002724
  19:10:13 STEP 2725 H=2725:00 +CPU= 11.113
  19:10:25 STEP 2726 H=2726:00 +CPU= 11.333
  19:10:43 STEP 2727 H=2727:00 +CPU= 17.217
  19:10:55 STEP 2728 H=2728:00 +CPU= 11.285
  19:11:06 STEP 2729 H=2729:00 +CPU= 11.027
  19:11:24 STEP 2730 H=2730:00 +CPU= 17.201
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:11:57 STEP 2731 H=2731:00 +CPU= 11.166
  19:12:09 STEP 2732 H=2732:00 +CPU= 11.628
  19:12:28 STEP 2733 H=2733:00 +CPU= 17.450
  19:12:40 STEP 2734 H=2734:00 +CPU= 11.565
  19:12:52 STEP 2735 H=2735:00 +CPU= 11.671
  19:13:14 STEP 2736 H=2736:00 +CPU= 19.993
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_113.zip
Uploading the intermediate file: upload_file_113.zip
  19:13:25 STEP 2737 H=2737:00 +CPU= 11.043
  19:13:37 STEP 2738 H=2738:00 +CPU= 11.518
  19:13:56 STEP 2739 H=2739:00 +CPU= 17.874
  19:14:09 STEP 2740 H=2740:00 +CPU= 11.663
  19:14:21 STEP 2741 H=2741:00 +CPU= 11.295
  19:14:40 STEP 2742 H=2742:00 +CPU= 18.378
  19:14:52 STEP 2743 H=2743:00 +CPU= 11.326
  19:15:04 STEP 2744 H=2744:00 +CPU= 11.488
  19:15:23 STEP 2745 H=2745:00 +CPU= 17.600
  19:15:35 STEP 2746 H=2746:00 +CPU= 11.422
  19:15:46 STEP 2747 H=2747:00 +CPU= 11.149
  19:16:06 STEP 2748 H=2748:00 +CPU= 19.191
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002748
  19:16:18 STEP 2749 H=2749:00 +CPU= 11.285
  19:16:31 STEP 2750 H=2750:00 +CPU= 11.518
  19:16:49 STEP 2751 H=2751:00 +CPU= 17.353
  19:17:01 STEP 2752 H=2752:00 +CPU= 11.492
  19:17:13 STEP 2753 H=2753:00 +CPU= 11.126
  19:17:31 STEP 2754 H=2754:00 +CPU= 17.693
  19:17:43 STEP 2755 H=2755:00 +CPU= 11.158
  19:17:55 STEP 2756 H=2756:00 +CPU= 11.395
  19:18:14 STEP 2757 H=2757:00 +CPU= 17.456
  19:18:26 STEP 2758 H=2758:00 +CPU= 11.520
  19:18:38 STEP 2759 H=2759:00 +CPU= 11.429
  19:18:59 STEP 2760 H=2760:00 +CPU= 20.150
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_114.zip
Uploading the intermediate file: upload_file_114.zip
  19:19:11 STEP 2761 H=2761:00 +CPU= 10.934
  19:19:22 STEP 2762 H=2762:00 +CPU= 11.147
  19:19:41 STEP 2763 H=2763:00 +CPU= 17.173
  19:19:52 STEP 2764 H=2764:00 +CPU= 11.197
  19:20:04 STEP 2765 H=2765:00 +CPU= 10.900
  19:20:22 STEP 2766 H=2766:00 +CPU= 17.616
  19:20:34 STEP 2767 H=2767:00 +CPU= 11.267
  19:20:46 STEP 2768 H=2768:00 +CPU= 11.622
  19:21:05 STEP 2769 H=2769:00 +CPU= 17.875
  19:21:18 STEP 2770 H=2770:00 +CPU= 11.687
  19:21:29 STEP 2771 H=2771:00 +CPU= 11.283
  19:21:50 STEP 2772 H=2772:00 +CPU= 19.323
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002772
  19:22:02 STEP 2773 H=2773:00 +CPU= 11.390
  19:22:14 STEP 2774 H=2774:00 +CPU= 11.787
  19:22:33 STEP 2775 H=2775:00 +CPU= 17.867
  19:22:45 STEP 2776 H=2776:00 +CPU= 11.841
  19:22:58 STEP 2777 H=2777:00 +CPU= 11.710
  19:23:17 STEP 2778 H=2778:00 +CPU= 18.075
  19:23:29 STEP 2779 H=2779:00 +CPU= 11.243
  19:23:41 STEP 2780 H=2780:00 +CPU= 11.596
  19:23:59 STEP 2781 H=2781:00 +CPU= 17.454
  19:24:11 STEP 2782 H=2782:00 +CPU= 11.376
  19:24:23 STEP 2783 H=2783:00 +CPU= 11.320
  19:24:44 STEP 2784 H=2784:00 +CPU= 19.845
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_115.zip
Uploading the intermediate file: upload_file_115.zip
  19:24:55 STEP 2785 H=2785:00 +CPU= 10.865
  19:25:07 STEP 2786 H=2786:00 +CPU= 11.131
  19:25:25 STEP 2787 H=2787:00 +CPU= 17.546
  19:25:37 STEP 2788 H=2788:00 +CPU= 11.462
  19:25:49 STEP 2789 H=2789:00 +CPU= 11.317
  19:26:08 STEP 2790 H=2790:00 +CPU= 18.011
  19:26:20 STEP 2791 H=2791:00 +CPU= 11.177
  19:26:32 STEP 2792 H=2792:00 +CPU= 11.438
  19:26:51 STEP 2793 H=2793:00 +CPU= 17.696
  19:27:03 STEP 2794 H=2794:00 +CPU= 11.662
  19:27:14 STEP 2795 H=2795:00 +CPU= 11.098
  19:27:34 STEP 2796 H=2796:00 +CPU= 19.008
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002796
  19:27:46 STEP 2797 H=2797:00 +CPU= 10.842
  19:27:57 STEP 2798 H=2798:00 +CPU= 11.031
  19:28:15 STEP 2799 H=2799:00 +CPU= 17.006
  19:28:27 STEP 2800 H=2800:00 +CPU= 11.366
  19:28:39 STEP 2801 H=2801:00 +CPU= 10.912
  19:28:57 STEP 2802 H=2802:00 +CPU= 17.483
  19:29:08 STEP 2803 H=2803:00 +CPU= 10.884
  19:29:20 STEP 2804 H=2804:00 +CPU= 11.261
  19:29:38 STEP 2805 H=2805:00 +CPU= 17.425
  19:29:50 STEP 2806 H=2806:00 +CPU= 11.365
  19:30:02 STEP 2807 H=2807:00 +CPU= 11.227
  19:30:23 STEP 2808 H=2808:00 +CPU= 20.186
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_116.zip
Uploading the intermediate file: upload_file_116.zip
  19:30:35 STEP 2809 H=2809:00 +CPU= 11.202
  19:30:47 STEP 2810 H=2810:00 +CPU= 11.179
  19:31:05 STEP 2811 H=2811:00 +CPU= 17.318
  19:31:17 STEP 2812 H=2812:00 +CPU= 11.685
  19:31:29 STEP 2813 H=2813:00 +CPU= 11.184
  19:31:48 STEP 2814 H=2814:00 +CPU= 18.123
  19:32:00 STEP 2815 H=2815:00 +CPU= 11.427
  19:32:13 STEP 2816 H=2816:00 +CPU= 11.819
  19:32:32 STEP 2817 H=2817:00 +CPU= 18.432
  19:32:45 STEP 2818 H=2818:00 +CPU= 11.838
  19:32:57 STEP 2819 H=2819:00 +CPU= 11.330
  19:33:18 STEP 2820 H=2820:00 +CPU= 19.886
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002820
  19:33:29 STEP 2821 H=2821:00 +CPU= 11.161
  19:33:41 STEP 2822 H=2822:00 +CPU= 11.388
  19:34:00 STEP 2823 H=2823:00 +CPU= 17.312
  19:34:12 STEP 2824 H=2824:00 +CPU= 11.563
  19:34:24 STEP 2825 H=2825:00 +CPU= 11.167
  19:34:43 STEP 2826 H=2826:00 +CPU= 17.961
  19:34:54 STEP 2827 H=2827:00 +CPU= 11.318
  19:35:06 STEP 2828 H=2828:00 +CPU= 11.364
  19:35:25 STEP 2829 H=2829:00 +CPU= 17.545
  19:35:37 STEP 2830 H=2830:00 +CPU= 11.592
  19:35:49 STEP 2831 H=2831:00 +CPU= 11.643
  19:36:11 STEP 2832 H=2832:00 +CPU= 20.220
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_117.zip
Uploading the intermediate file: upload_file_117.zip
  19:36:22 STEP 2833 H=2833:00 +CPU= 11.220
  19:36:34 STEP 2834 H=2834:00 +CPU= 11.408
Uploading trickle at timestep: 10195200
  19:36:53 STEP 2835 H=2835:00 +CPU= 17.897
  19:37:05 STEP 2836 H=2836:00 +CPU= 11.611
  19:37:17 STEP 2837 H=2837:00 +CPU= 11.125
  19:37:36 STEP 2838 H=2838:00 +CPU= 17.815
  19:37:48 STEP 2839 H=2839:00 +CPU= 11.284
  19:38:00 STEP 2840 H=2840:00 +CPU= 11.878
  19:38:19 STEP 2841 H=2841:00 +CPU= 18.045
  19:38:31 STEP 2842 H=2842:00 +CPU= 11.747
  19:38:43 STEP 2843 H=2843:00 +CPU= 11.264
  19:39:04 STEP 2844 H=2844:00 +CPU= 19.554
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002844
  19:39:15 STEP 2845 H=2845:00 +CPU= 11.058
  19:39:27 STEP 2846 H=2846:00 +CPU= 11.109
  19:39:46 STEP 2847 H=2847:00 +CPU= 17.629
  19:39:58 STEP 2848 H=2848:00 +CPU= 11.449
  19:40:09 STEP 2849 H=2849:00 +CPU= 11.126
  19:40:28 STEP 2850 H=2850:00 +CPU= 17.839
  19:40:40 STEP 2851 H=2851:00 +CPU= 11.317
  19:40:53 STEP 2852 H=2852:00 +CPU= 11.861
  19:41:12 STEP 2853 H=2853:00 +CPU= 18.149
  19:41:24 STEP 2854 H=2854:00 +CPU= 11.825
  19:41:36 STEP 2855 H=2855:00 +CPU= 11.758
  19:41:58 STEP 2856 H=2856:00 +CPU= 20.390
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:42:10 STEP 2857 H=2857:00 +CPU= 11.220
  19:42:22 STEP 2858 H=2858:00 +CPU= 11.408
  19:42:40 STEP 2859 H=2859:00 +CPU= 17.538
  19:42:52 STEP 2860 H=2860:00 +CPU= 11.479
  19:43:04 STEP 2861 H=2861:00 +CPU= 11.179
  19:43:23 STEP 2862 H=2862:00 +CPU= 17.977
  19:43:35 STEP 2863 H=2863:00 +CPU= 11.158
  19:43:47 STEP 2864 H=2864:00 +CPU= 11.722
  19:44:05 STEP 2865 H=2865:00 +CPU= 17.667
  19:44:18 STEP 2866 H=2866:00 +CPU= 11.761
  19:44:30 STEP 2867 H=2867:00 +CPU= 11.305
  19:44:50 STEP 2868 H=2868:00 +CPU= 19.158
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002868
  19:45:02 STEP 2869 H=2869:00 +CPU= 11.159
  19:45:13 STEP 2870 H=2870:00 +CPU= 11.373
  19:45:32 STEP 2871 H=2871:00 +CPU= 17.502
  19:45:44 STEP 2872 H=2872:00 +CPU= 11.506
  19:45:56 STEP 2873 H=2873:00 +CPU= 11.079
  19:46:14 STEP 2874 H=2874:00 +CPU= 17.801
  19:46:26 STEP 2875 H=2875:00 +CPU= 11.128
  19:46:38 STEP 2876 H=2876:00 +CPU= 11.928
  19:46:57 STEP 2877 H=2877:00 +CPU= 17.664
  19:47:09 STEP 2878 H=2878:00 +CPU= 11.551
  19:47:22 STEP 2879 H=2879:00 +CPU= 11.812
  19:47:43 STEP 2880 H=2880:00 +CPU= 20.468
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:47:55 STEP 2881 H=2881:00 +CPU= 11.173
  19:48:07 STEP 2882 H=2882:00 +CPU= 11.361
  19:48:25 STEP 2883 H=2883:00 +CPU= 17.394
  19:48:37 STEP 2884 H=2884:00 +CPU= 11.415
  19:48:49 STEP 2885 H=2885:00 +CPU= 11.178
  19:49:08 STEP 2886 H=2886:00 +CPU= 18.034
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:49:41 STEP 2887 H=2887:00 +CPU= 11.387
  19:49:53 STEP 2888 H=2888:00 +CPU= 12.097
  19:50:12 STEP 2889 H=2889:00 +CPU= 18.190
  19:50:25 STEP 2890 H=2890:00 +CPU= 11.674
  19:50:37 STEP 2891 H=2891:00 +CPU= 11.383
  19:50:57 STEP 2892 H=2892:00 +CPU= 19.423
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002892
  19:51:09 STEP 2893 H=2893:00 +CPU= 11.209
  19:51:21 STEP 2894 H=2894:00 +CPU= 11.620
  19:51:39 STEP 2895 H=2895:00 +CPU= 17.612
  19:51:52 STEP 2896 H=2896:00 +CPU= 11.647
  19:52:04 STEP 2897 H=2897:00 +CPU= 11.525
  19:52:23 STEP 2898 H=2898:00 +CPU= 18.091
  19:52:35 STEP 2899 H=2899:00 +CPU= 11.220
  19:52:47 STEP 2900 H=2900:00 +CPU= 11.827
  19:53:06 STEP 2901 H=2901:00 +CPU= 17.947
  19:53:18 STEP 2902 H=2902:00 +CPU= 11.724
  19:53:30 STEP 2903 H=2903:00 +CPU= 11.677
  19:53:52 STEP 2904 H=2904:00 +CPU= 20.090
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_120.zip
Uploading the intermediate file: upload_file_120.zip
  19:54:03 STEP 2905 H=2905:00 +CPU= 11.134
  19:54:15 STEP 2906 H=2906:00 +CPU= 11.532
  19:54:34 STEP 2907 H=2907:00 +CPU= 17.725
  19:54:46 STEP 2908 H=2908:00 +CPU= 11.645
  19:54:58 STEP 2909 H=2909:00 +CPU= 11.318
  19:55:17 STEP 2910 H=2910:00 +CPU= 17.847
  19:55:29 STEP 2911 H=2911:00 +CPU= 11.285
  19:55:41 STEP 2912 H=2912:00 +CPU= 11.420
  19:55:59 STEP 2913 H=2913:00 +CPU= 17.339
  19:56:11 STEP 2914 H=2914:00 +CPU= 11.512
  19:56:23 STEP 2915 H=2915:00 +CPU= 11.139
  19:56:43 STEP 2916 H=2916:00 +CPU= 18.795
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002916
  19:56:54 STEP 2917 H=2917:00 +CPU= 10.898
  19:57:06 STEP 2918 H=2918:00 +CPU= 11.308
  19:57:24 STEP 2919 H=2919:00 +CPU= 17.483
  19:57:36 STEP 2920 H=2920:00 +CPU= 11.522
  19:57:48 STEP 2921 H=2921:00 +CPU= 11.228
  19:58:07 STEP 2922 H=2922:00 +CPU= 17.603
  19:58:18 STEP 2923 H=2923:00 +CPU= 10.980
  19:58:30 STEP 2924 H=2924:00 +CPU= 11.498
  19:58:49 STEP 2925 H=2925:00 +CPU= 17.510
  19:59:01 STEP 2926 H=2926:00 +CPU= 11.559
  19:59:13 STEP 2927 H=2927:00 +CPU= 11.747
  19:59:34 STEP 2928 H=2928:00 +CPU= 20.126
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_121.zip
Uploading the intermediate file: upload_file_121.zip
  19:59:46 STEP 2929 H=2929:00 +CPU= 11.042
  19:59:58 STEP 2930 H=2930:00 +CPU= 11.127
  20:00:16 STEP 2931 H=2931:00 +CPU= 17.472
  20:00:28 STEP 2932 H=2932:00 +CPU= 11.372
  20:00:40 STEP 2933 H=2933:00 +CPU= 10.954
  20:00:58 STEP 2934 H=2934:00 +CPU= 17.670
  20:01:10 STEP 2935 H=2935:00 +CPU= 11.172
  20:01:23 STEP 2936 H=2936:00 +CPU= 11.818
  20:01:41 STEP 2937 H=2937:00 +CPU= 17.542
  20:01:53 STEP 2938 H=2938:00 +CPU= 11.437
  20:02:05 STEP 2939 H=2939:00 +CPU= 10.998
  20:02:25 STEP 2940 H=2940:00 +CPU= 18.812
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002940
  20:02:36 STEP 2941 H=2941:00 +CPU= 11.193
  20:02:48 STEP 2942 H=2942:00 +CPU= 11.546
  20:03:07 STEP 2943 H=2943:00 +CPU= 17.478
  20:03:19 STEP 2944 H=2944:00 +CPU= 11.466
  20:03:31 STEP 2945 H=2945:00 +CPU= 11.189
  20:03:49 STEP 2946 H=2946:00 +CPU= 17.442
  20:04:00 STEP 2947 H=2947:00 +CPU= 10.754
  20:04:13 STEP 2948 H=2948:00 +CPU= 11.567
  20:04:31 STEP 2949 H=2949:00 +CPU= 17.929
  20:04:43 STEP 2950 H=2950:00 +CPU= 11.315
  20:04:56 STEP 2951 H=2951:00 +CPU= 11.696
  20:05:17 STEP 2952 H=2952:00 +CPU= 20.143
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.260318722649E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.48989191816039E-02 -1.72994898449055E+00  1.89761310057317E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.16778532200291     
  MAXGPFV : MAX. VALUE =   0.736877051261131     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    358045146 BYTES IN      8 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0059( 3.4%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 20:05:17 STEP 2952 H=2952:00 +CPU= 20.143
 END CNT3
 NSTEP =  2952 CNT0   000000000  17.710  17.710  18.743   0.945               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           35/   804992476 WRITTEN        31705/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    768    0       35       786125    31705 ************    64.0     1.4    62.6     1.7    91.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 2211     995.7     995.7      7.58      0.00
   9 SPCM     - SPECTRAL COMP.                    2040     128.2     128.2      0.90      0.00
  10 SCAN2M - PHYSICS                             2041    6578.7    6578.7     46.25      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                170     487.0     487.0      0.29      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 86      11.0      11.0      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      681    6695.3    6695.3     15.70      0.00
  17 GRIDFPOS IN CNT4                              170      23.9      23.9      0.01      0.00
  27 RESTART FILES - WRITING                        85     974.1     974.1      0.29      0.00
  28 RESTART FILES - READING                         1    1984.7    1984.7      0.01      0.00
  29 SU4FPOS IN CNT4                               170       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               170    1105.8    1105.8      0.65      0.00
  31 POSDDH IN STEPO                                 9       0.5       0.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2041    1872.2    1872.2     13.16      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2041    1472.0    1472.0     10.35      0.00
  39 SU0YOMB                                         1     141.5     141.5      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2041       6.2       6.2      0.04      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2040      70.8      70.8      0.50      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2040      12.7      12.7      0.09      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 86       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     6976      75.5      75.5      1.81      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      4250      77.2      77.2      1.13      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       4250      23.6      23.6      0.35      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      6976      25.0      25.0      0.60      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      30.5      30.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           6976       6.1       6.1      0.15      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           4250       5.3       5.3      0.08      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           6976      10.2      10.2      0.25      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           4250       9.1       9.1      0.13      0.00
 400 GSTATS                                     406755       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                389547       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    29033.5 CPU TIME   27242.8 VECTOR TIME    27242.8


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      366.1
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc/slots/3/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/3/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12213676/ICMUAhnw4+002952
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_006m_2019110100_123_993_12213676_0_r21889625_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
20:08:40 (19772): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:55 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 10,623,600 40,698 0.0038
09 May 2023 16:53:55 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 10,195,200 39,063 0.0038
09 May 2023 16:53:53 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 9,331,200 35,880 0.0038
09 May 2023 16:53:50 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 8,467,200 32,744 0.0039
09 May 2023 16:53:47 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 7,603,200 29,684 0.0039
09 May 2023 16:53:44 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 6,739,200 26,651 0.0040
09 May 2023 16:53:41 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 5,875,200 23,639 0.0040
09 May 2023 16:53:38 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 5,011,200 20,219 0.0040
09 May 2023 16:53:35 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 4,147,200 16,766 0.0040
09 May 2023 16:53:32 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 2,592,000 10,504 0.0041
09 May 2023 16:52:51 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 1,728,000 6,999 0.0041
09 May 2023 16:52:46 1526034 22315022 oifs_43r3_006m_2019110100_123_993_12213676_0 864,000 3,349 0.0039


©2024 climateprediction.net