climateprediction.net home page
Task 22315746

Task 22315746

Name oifs_43r3_00q2_2019110100_123_993_12214376_0
Workunit 12214376
Created 24 Feb 2023, 14:47:15 UTC
Sent 24 Feb 2023, 14:59:11 UTC
Report deadline 25 Apr 2023, 14:59:11 UTC
Received 27 Feb 2023, 7:12:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1538124
Run time 21 hours 43 min 45 sec
CPU time 21 hours 36 min 29 sec
Validate state Invalid
Credit 14,873.04
Device peak FLOPS 5.47 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,424.76 MB
Peak swap size 4,983.13 MB
Peak disk usage 1,268.39 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
TEP 2368 H=2368:00 +CPU= 21.589
  02:56:20 STEP 2369 H=2369:00 +CPU= 21.247
  02:56:56 STEP 2370 H=2370:00 +CPU= 35.977
  02:57:17 STEP 2371 H=2371:00 +CPU= 20.878
  02:57:39 STEP 2372 H=2372:00 +CPU= 21.916
  02:58:14 STEP 2373 H=2373:00 +CPU= 35.032
  02:58:35 STEP 2374 H=2374:00 +CPU= 21.370
  02:58:57 STEP 2375 H=2375:00 +CPU= 21.940
  02:59:38 STEP 2376 H=2376:00 +CPU= 40.480
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_98.zip
Uploading the intermediate file: upload_file_98.zip
  02:59:59 STEP 2377 H=2377:00 +CPU= 21.119
  03:00:22 STEP 2378 H=2378:00 +CPU= 22.022
  03:00:56 STEP 2379 H=2379:00 +CPU= 34.914
  03:01:18 STEP 2380 H=2380:00 +CPU= 21.696
  03:01:40 STEP 2381 H=2381:00 +CPU= 21.289
  03:02:15 STEP 2382 H=2382:00 +CPU= 35.616
  03:02:36 STEP 2383 H=2383:00 +CPU= 21.027
  03:02:58 STEP 2384 H=2384:00 +CPU= 21.956
  03:03:33 STEP 2385 H=2385:00 +CPU= 34.930
  03:03:55 STEP 2386 H=2386:00 +CPU= 21.717
  03:04:16 STEP 2387 H=2387:00 +CPU= 21.306
  03:04:54 STEP 2388 H=2388:00 +CPU= 37.923
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002388
  03:05:15 STEP 2389 H=2389:00 +CPU= 21.024
  03:05:37 STEP 2390 H=2390:00 +CPU= 21.946
  03:06:12 STEP 2391 H=2391:00 +CPU= 34.644
  03:06:34 STEP 2392 H=2392:00 +CPU= 21.890
  03:06:55 STEP 2393 H=2393:00 +CPU= 21.225
  03:07:31 STEP 2394 H=2394:00 +CPU= 35.437
  03:07:52 STEP 2395 H=2395:00 +CPU= 21.031
  03:08:14 STEP 2396 H=2396:00 +CPU= 22.107
  03:08:49 STEP 2397 H=2397:00 +CPU= 34.972
  03:09:11 STEP 2398 H=2398:00 +CPU= 21.643
  03:09:33 STEP 2399 H=2399:00 +CPU= 22.024
  03:10:13 STEP 2400 H=2400:00 +CPU= 40.056
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_99.zip
Uploading the intermediate file: upload_file_99.zip
  03:10:35 STEP 2401 H=2401:00 +CPU= 21.264
Uploading trickle at timestep: 8640000
  03:10:57 STEP 2402 H=2402:00 +CPU= 21.846
  03:11:32 STEP 2403 H=2403:00 +CPU= 34.471
  03:11:53 STEP 2404 H=2404:00 +CPU= 21.816
  03:12:15 STEP 2405 H=2405:00 +CPU= 21.185
  03:12:50 STEP 2406 H=2406:00 +CPU= 35.301
  03:13:11 STEP 2407 H=2407:00 +CPU= 21.199
  03:13:33 STEP 2408 H=2408:00 +CPU= 21.863
  03:14:08 STEP 2409 H=2409:00 +CPU= 34.559
  03:14:30 STEP 2410 H=2410:00 +CPU= 21.831
  03:14:51 STEP 2411 H=2411:00 +CPU= 21.221
  03:15:28 STEP 2412 H=2412:00 +CPU= 37.590
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002412
  03:15:50 STEP 2413 H=2413:00 +CPU= 21.166
  03:16:11 STEP 2414 H=2414:00 +CPU= 21.810
  03:16:46 STEP 2415 H=2415:00 +CPU= 34.265
  03:17:08 STEP 2416 H=2416:00 +CPU= 21.779
  03:17:29 STEP 2417 H=2417:00 +CPU= 21.179
  03:18:04 STEP 2418 H=2418:00 +CPU= 35.294
  03:18:25 STEP 2419 H=2419:00 +CPU= 21.257
  03:18:48 STEP 2420 H=2420:00 +CPU= 22.053
  03:19:23 STEP 2421 H=2421:00 +CPU= 34.586
  03:19:44 STEP 2422 H=2422:00 +CPU= 21.807
  03:20:06 STEP 2423 H=2423:00 +CPU= 21.938
  03:20:46 STEP 2424 H=2424:00 +CPU= 39.701
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_100.zip
Uploading the intermediate file: upload_file_100.zip
  03:21:08 STEP 2425 H=2425:00 +CPU= 21.228
  03:21:30 STEP 2426 H=2426:00 +CPU= 21.854
  03:22:04 STEP 2427 H=2427:00 +CPU= 34.392
  03:22:26 STEP 2428 H=2428:00 +CPU= 21.738
  03:22:47 STEP 2429 H=2429:00 +CPU= 21.138
  03:23:23 STEP 2430 H=2430:00 +CPU= 35.218
  03:23:44 STEP 2431 H=2431:00 +CPU= 21.163
  03:24:05 STEP 2432 H=2432:00 +CPU= 21.623
  03:24:40 STEP 2433 H=2433:00 +CPU= 34.514
  03:25:02 STEP 2434 H=2434:00 +CPU= 21.801
  03:25:23 STEP 2435 H=2435:00 +CPU= 21.200
  03:26:00 STEP 2436 H=2436:00 +CPU= 37.487
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002436
  03:26:22 STEP 2437 H=2437:00 +CPU= 21.147
  03:26:44 STEP 2438 H=2438:00 +CPU= 21.814
  03:27:18 STEP 2439 H=2439:00 +CPU= 34.424
  03:27:40 STEP 2440 H=2440:00 +CPU= 21.778
  03:28:01 STEP 2441 H=2441:00 +CPU= 21.190
  03:28:36 STEP 2442 H=2442:00 +CPU= 35.301
  03:28:58 STEP 2443 H=2443:00 +CPU= 21.319
  03:29:20 STEP 2444 H=2444:00 +CPU= 21.967
  03:29:55 STEP 2445 H=2445:00 +CPU= 34.512
  03:30:16 STEP 2446 H=2446:00 +CPU= 21.782
  03:30:38 STEP 2447 H=2447:00 +CPU= 21.859
  03:31:18 STEP 2448 H=2448:00 +CPU= 39.607
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_101.zip
Uploading the intermediate file: upload_file_101.zip
  03:31:40 STEP 2449 H=2449:00 +CPU= 21.194
  03:32:02 STEP 2450 H=2450:00 +CPU= 21.839
  03:32:36 STEP 2451 H=2451:00 +CPU= 34.329
  03:32:58 STEP 2452 H=2452:00 +CPU= 21.763
  03:33:19 STEP 2453 H=2453:00 +CPU= 21.168
  03:33:54 STEP 2454 H=2454:00 +CPU= 35.173
  03:34:15 STEP 2455 H=2455:00 +CPU= 21.221
  03:34:37 STEP 2456 H=2456:00 +CPU= 21.826
  03:35:12 STEP 2457 H=2457:00 +CPU= 34.264
  03:35:34 STEP 2458 H=2458:00 +CPU= 21.821
  03:35:55 STEP 2459 H=2459:00 +CPU= 21.178
  03:36:32 STEP 2460 H=2460:00 +CPU= 37.456
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002460
  03:36:53 STEP 2461 H=2461:00 +CPU= 21.196
  03:37:15 STEP 2462 H=2462:00 +CPU= 21.820
  03:37:50 STEP 2463 H=2463:00 +CPU= 34.413
  03:38:12 STEP 2464 H=2464:00 +CPU= 21.816
  03:38:33 STEP 2465 H=2465:00 +CPU= 21.182
  03:39:08 STEP 2466 H=2466:00 +CPU= 35.257
  03:39:30 STEP 2467 H=2467:00 +CPU= 21.295
  03:39:52 STEP 2468 H=2468:00 +CPU= 21.992
  03:40:27 STEP 2469 H=2469:00 +CPU= 34.546
  03:40:48 STEP 2470 H=2470:00 +CPU= 21.787
  03:41:10 STEP 2471 H=2471:00 +CPU= 21.892
  03:41:50 STEP 2472 H=2472:00 +CPU= 39.714
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_102.zip
Uploading the intermediate file: upload_file_102.zip
  03:42:12 STEP 2473 H=2473:00 +CPU= 21.259
  03:42:34 STEP 2474 H=2474:00 +CPU= 21.891
  03:43:08 STEP 2475 H=2475:00 +CPU= 34.170
  03:43:30 STEP 2476 H=2476:00 +CPU= 21.787
  03:43:51 STEP 2477 H=2477:00 +CPU= 21.207
  03:44:26 STEP 2478 H=2478:00 +CPU= 35.247
  03:44:47 STEP 2479 H=2479:00 +CPU= 21.207
  03:45:09 STEP 2480 H=2480:00 +CPU= 21.824
  03:45:44 STEP 2481 H=2481:00 +CPU= 34.420
  03:46:06 STEP 2482 H=2482:00 +CPU= 21.816
  03:46:27 STEP 2483 H=2483:00 +CPU= 21.190
  03:47:04 STEP 2484 H=2484:00 +CPU= 37.506
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002484
  03:47:26 STEP 2485 H=2485:00 +CPU= 21.252
  03:47:48 STEP 2486 H=2486:00 +CPU= 21.848
  03:48:22 STEP 2487 H=2487:00 +CPU= 34.539
  03:48:44 STEP 2488 H=2488:00 +CPU= 21.866
  03:49:05 STEP 2489 H=2489:00 +CPU= 21.244
  03:49:41 STEP 2490 H=2490:00 +CPU= 35.522
  03:50:02 STEP 2491 H=2491:00 +CPU= 21.331
  03:50:25 STEP 2492 H=2492:00 +CPU= 21.847
  03:50:59 STEP 2493 H=2493:00 +CPU= 34.438
  03:51:21 STEP 2494 H=2494:00 +CPU= 21.774
  03:51:43 STEP 2495 H=2495:00 +CPU= 21.899
  03:52:23 STEP 2496 H=2496:00 +CPU= 39.890
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_103.zip
Uploading the intermediate file: upload_file_103.zip
  03:52:45 STEP 2497 H=2497:00 +CPU= 21.367
  03:53:07 STEP 2498 H=2498:00 +CPU= 21.889
  03:53:41 STEP 2499 H=2499:00 +CPU= 34.358
  03:54:03 STEP 2500 H=2500:00 +CPU= 21.768
  03:54:24 STEP 2501 H=2501:00 +CPU= 21.223
  03:54:59 STEP 2502 H=2502:00 +CPU= 35.335
  03:55:21 STEP 2503 H=2503:00 +CPU= 21.231
  03:55:43 STEP 2504 H=2504:00 +CPU= 21.830
  03:56:17 STEP 2505 H=2505:00 +CPU= 34.463
  03:56:39 STEP 2506 H=2506:00 +CPU= 21.830
  03:57:00 STEP 2507 H=2507:00 +CPU= 21.218
  03:57:38 STEP 2508 H=2508:00 +CPU= 37.649
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002508
  03:57:59 STEP 2509 H=2509:00 +CPU= 21.279
  03:58:21 STEP 2510 H=2510:00 +CPU= 21.887
  03:58:56 STEP 2511 H=2511:00 +CPU= 34.615
  03:59:18 STEP 2512 H=2512:00 +CPU= 21.915
  03:59:39 STEP 2513 H=2513:00 +CPU= 21.298
  04:00:14 STEP 2514 H=2514:00 +CPU= 35.370
  04:00:36 STEP 2515 H=2515:00 +CPU= 21.334
  04:00:58 STEP 2516 H=2516:00 +CPU= 21.949
  04:01:32 STEP 2517 H=2517:00 +CPU= 34.176
  04:01:54 STEP 2518 H=2518:00 +CPU= 21.762
  04:02:16 STEP 2519 H=2519:00 +CPU= 21.879
  04:02:56 STEP 2520 H=2520:00 +CPU= 40.000
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_104.zip
Uploading the intermediate file: upload_file_104.zip
  04:03:18 STEP 2521 H=2521:00 +CPU= 21.317
  04:03:40 STEP 2522 H=2522:00 +CPU= 21.876
  04:04:14 STEP 2523 H=2523:00 +CPU= 34.617
  04:04:36 STEP 2524 H=2524:00 +CPU= 21.841
  04:04:57 STEP 2525 H=2525:00 +CPU= 21.262
  04:05:33 STEP 2526 H=2526:00 +CPU= 35.312
  04:05:54 STEP 2527 H=2527:00 +CPU= 21.240
  04:06:16 STEP 2528 H=2528:00 +CPU= 21.853
  04:06:51 STEP 2529 H=2529:00 +CPU= 34.644
  04:07:13 STEP 2530 H=2530:00 +CPU= 21.881
  04:07:34 STEP 2531 H=2531:00 +CPU= 21.282
  04:08:12 STEP 2532 H=2532:00 +CPU= 37.944
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002532
  04:08:33 STEP 2533 H=2533:00 +CPU= 21.285
  04:08:55 STEP 2534 H=2534:00 +CPU= 21.896
  04:09:30 STEP 2535 H=2535:00 +CPU= 34.718
  04:09:52 STEP 2536 H=2536:00 +CPU= 21.890
  04:10:13 STEP 2537 H=2537:00 +CPU= 21.291
  04:10:49 STEP 2538 H=2538:00 +CPU= 35.266
  04:11:10 STEP 2539 H=2539:00 +CPU= 21.348
  04:11:32 STEP 2540 H=2540:00 +CPU= 21.903
  04:12:07 STEP 2541 H=2541:00 +CPU= 34.432
  04:12:29 STEP 2542 H=2542:00 +CPU= 21.831
  04:12:50 STEP 2543 H=2543:00 +CPU= 21.924
  04:13:31 STEP 2544 H=2544:00 +CPU= 40.299
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_105.zip
Uploading the intermediate file: upload_file_105.zip
  04:13:52 STEP 2545 H=2545:00 +CPU= 21.363
  04:14:14 STEP 2546 H=2546:00 +CPU= 21.961
  04:14:49 STEP 2547 H=2547:00 +CPU= 34.847
  04:15:11 STEP 2548 H=2548:00 +CPU= 21.991
  04:15:33 STEP 2549 H=2549:00 +CPU= 21.387
  04:16:08 STEP 2550 H=2550:00 +CPU= 35.447
  04:16:30 STEP 2551 H=2551:00 +CPU= 21.360
  04:16:52 STEP 2552 H=2552:00 +CPU= 21.960
  04:17:27 STEP 2553 H=2553:00 +CPU= 34.824
  04:17:49 STEP 2554 H=2554:00 +CPU= 21.929
  04:18:10 STEP 2555 H=2555:00 +CPU= 21.298
  04:18:48 STEP 2556 H=2556:00 +CPU= 38.012
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002556
  04:19:09 STEP 2557 H=2557:00 +CPU= 21.331
  04:19:31 STEP 2558 H=2558:00 +CPU= 21.703
  04:20:06 STEP 2559 H=2559:00 +CPU= 34.744
  04:20:28 STEP 2560 H=2560:00 +CPU= 21.884
  04:20:49 STEP 2561 H=2561:00 +CPU= 21.261
  04:21:24 STEP 2562 H=2562:00 +CPU= 35.239
  04:21:46 STEP 2563 H=2563:00 +CPU= 21.429
  04:22:08 STEP 2564 H=2564:00 +CPU= 21.963
  04:22:43 STEP 2565 H=2565:00 +CPU= 34.677
  04:23:05 STEP 2566 H=2566:00 +CPU= 21.858
  04:23:27 STEP 2567 H=2567:00 +CPU= 22.045
  04:24:07 STEP 2568 H=2568:00 +CPU= 40.173
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_106.zip
Uploading the intermediate file: upload_file_106.zip
  04:24:29 STEP 2569 H=2569:00 +CPU= 21.274
  04:24:51 STEP 2570 H=2570:00 +CPU= 21.985
  04:25:26 STEP 2571 H=2571:00 +CPU= 34.700
  04:25:48 STEP 2572 H=2572:00 +CPU= 21.813
  04:26:09 STEP 2573 H=2573:00 +CPU= 21.149
  04:26:44 STEP 2574 H=2574:00 +CPU= 35.408
  04:27:06 STEP 2575 H=2575:00 +CPU= 21.319
  04:27:27 STEP 2576 H=2576:00 +CPU= 21.890
  04:28:02 STEP 2577 H=2577:00 +CPU= 34.688
  04:28:24 STEP 2578 H=2578:00 +CPU= 21.874
  04:28:45 STEP 2579 H=2579:00 +CPU= 21.294
  04:29:23 STEP 2580 H=2580:00 +CPU= 37.841
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002580
  04:29:45 STEP 2581 H=2581:00 +CPU= 21.204
  04:30:06 STEP 2582 H=2582:00 +CPU= 21.871
  04:30:41 STEP 2583 H=2583:00 +CPU= 34.337
  04:31:03 STEP 2584 H=2584:00 +CPU= 21.783
  04:31:24 STEP 2585 H=2585:00 +CPU= 21.022
  04:31:59 STEP 2586 H=2586:00 +CPU= 35.519
  04:32:21 STEP 2587 H=2587:00 +CPU= 21.450
  04:32:43 STEP 2588 H=2588:00 +CPU= 21.995
  04:33:18 STEP 2589 H=2589:00 +CPU= 34.759
  04:33:40 STEP 2590 H=2590:00 +CPU= 21.911
  04:34:02 STEP 2591 H=2591:00 +CPU= 22.018
  04:34:42 STEP 2592 H=2592:00 +CPU= 40.034
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_107.zip
Uploading the intermediate file: upload_file_107.zip
  04:35:04 STEP 2593 H=2593:00 +CPU= 21.291
  04:35:26 STEP 2594 H=2594:00 +CPU= 21.894
  04:36:00 STEP 2595 H=2595:00 +CPU= 34.545
  04:36:22 STEP 2596 H=2596:00 +CPU= 21.782
  04:36:43 STEP 2597 H=2597:00 +CPU= 21.305
  04:37:19 STEP 2598 H=2598:00 +CPU= 35.310
  04:37:40 STEP 2599 H=2599:00 +CPU= 21.016
  04:38:02 STEP 2600 H=2600:00 +CPU= 21.880
  04:38:36 STEP 2601 H=2601:00 +CPU= 34.631
  04:38:58 STEP 2602 H=2602:00 +CPU= 21.853
  04:39:20 STEP 2603 H=2603:00 +CPU= 21.317
  04:39:57 STEP 2604 H=2604:00 +CPU= 37.597
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002604
  04:40:18 STEP 2605 H=2605:00 +CPU= 21.161
  04:40:40 STEP 2606 H=2606:00 +CPU= 21.786
  04:41:15 STEP 2607 H=2607:00 +CPU= 34.545
  04:41:37 STEP 2608 H=2608:00 +CPU= 21.781
  04:41:58 STEP 2609 H=2609:00 +CPU= 21.221
  04:42:34 STEP 2610 H=2610:00 +CPU= 35.586
  04:42:55 STEP 2611 H=2611:00 +CPU= 21.367
  04:43:17 STEP 2612 H=2612:00 +CPU= 21.819
  04:43:52 STEP 2613 H=2613:00 +CPU= 34.646
  04:44:14 STEP 2614 H=2614:00 +CPU= 21.832
  04:44:36 STEP 2615 H=2615:00 +CPU= 22.049
  04:45:16 STEP 2616 H=2616:00 +CPU= 39.860
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_108.zip
Uploading the intermediate file: upload_file_108.zip
  04:45:38 STEP 2617 H=2617:00 +CPU= 21.281
  04:46:00 STEP 2618 H=2618:00 +CPU= 21.887
  04:46:34 STEP 2619 H=2619:00 +CPU= 34.632
  04:46:56 STEP 2620 H=2620:00 +CPU= 21.786
  04:47:17 STEP 2621 H=2621:00 +CPU= 21.340
  04:47:53 STEP 2622 H=2622:00 +CPU= 35.253
  04:48:14 STEP 2623 H=2623:00 +CPU= 21.203
  04:48:36 STEP 2624 H=2624:00 +CPU= 21.844
  04:49:10 STEP 2625 H=2625:00 +CPU= 34.434
  04:49:32 STEP 2626 H=2626:00 +CPU= 21.791
  04:49:53 STEP 2627 H=2627:00 +CPU= 21.251
  04:50:31 STEP 2628 H=2628:00 +CPU= 37.610
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002628
  04:50:52 STEP 2629 H=2629:00 +CPU= 21.194
  04:51:14 STEP 2630 H=2630:00 +CPU= 21.766
  04:51:49 STEP 2631 H=2631:00 +CPU= 34.633
  04:52:11 STEP 2632 H=2632:00 +CPU= 21.817
  04:52:32 STEP 2633 H=2633:00 +CPU= 21.396
  04:53:08 STEP 2634 H=2634:00 +CPU= 35.440
  04:53:29 STEP 2635 H=2635:00 +CPU= 21.322
  04:53:51 STEP 2636 H=2636:00 +CPU= 21.995
  04:54:26 STEP 2637 H=2637:00 +CPU= 34.567
  04:54:48 STEP 2638 H=2638:00 +CPU= 21.807
  04:55:10 STEP 2639 H=2639:00 +CPU= 21.961
  04:55:50 STEP 2640 H=2640:00 +CPU= 39.815
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_109.zip
Uploading the intermediate file: upload_file_109.zip
  04:56:12 STEP 2641 H=2641:00 +CPU= 21.244
Uploading trickle at timestep: 9504000
  04:56:33 STEP 2642 H=2642:00 +CPU= 21.605
  04:57:08 STEP 2643 H=2643:00 +CPU= 34.666
  04:57:30 STEP 2644 H=2644:00 +CPU= 21.780
  04:57:51 STEP 2645 H=2645:00 +CPU= 21.248
  04:58:26 STEP 2646 H=2646:00 +CPU= 35.307
  04:58:48 STEP 2647 H=2647:00 +CPU= 21.192
  04:59:10 STEP 2648 H=2648:00 +CPU= 21.812
  04:59:44 STEP 2649 H=2649:00 +CPU= 34.644
  05:00:06 STEP 2650 H=2650:00 +CPU= 21.805
  05:00:27 STEP 2651 H=2651:00 +CPU= 21.156
  05:01:05 STEP 2652 H=2652:00 +CPU= 37.679
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002652
  05:01:26 STEP 2653 H=2653:00 +CPU= 21.217
  05:01:48 STEP 2654 H=2654:00 +CPU= 21.743
  05:02:23 STEP 2655 H=2655:00 +CPU= 34.670
  05:02:45 STEP 2656 H=2656:00 +CPU= 21.853
  05:03:06 STEP 2657 H=2657:00 +CPU= 21.322
  05:03:42 STEP 2658 H=2658:00 +CPU= 35.553
  05:04:03 STEP 2659 H=2659:00 +CPU= 21.335
  05:04:25 STEP 2660 H=2660:00 +CPU= 21.792
  05:05:00 STEP 2661 H=2661:00 +CPU= 34.613
  05:05:22 STEP 2662 H=2662:00 +CPU= 21.814
  05:05:43 STEP 2663 H=2663:00 +CPU= 21.838
  05:06:23 STEP 2664 H=2664:00 +CPU= 39.846
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_110.zip
Uploading the intermediate file: upload_file_110.zip
  05:06:45 STEP 2665 H=2665:00 +CPU= 21.341
  05:07:07 STEP 2666 H=2666:00 +CPU= 21.746
  05:07:41 STEP 2667 H=2667:00 +CPU= 34.474
  05:08:03 STEP 2668 H=2668:00 +CPU= 21.829
  05:08:25 STEP 2669 H=2669:00 +CPU= 21.237
  05:09:00 STEP 2670 H=2670:00 +CPU= 35.365
  05:09:21 STEP 2671 H=2671:00 +CPU= 21.263
  05:09:43 STEP 2672 H=2672:00 +CPU= 21.788
  05:10:18 STEP 2673 H=2673:00 +CPU= 34.686
  05:10:40 STEP 2674 H=2674:00 +CPU= 21.877
  05:11:01 STEP 2675 H=2675:00 +CPU= 21.168
  05:11:39 STEP 2676 H=2676:00 +CPU= 37.742
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002676
  05:12:00 STEP 2677 H=2677:00 +CPU= 21.314
  05:12:22 STEP 2678 H=2678:00 +CPU= 21.792
  05:12:57 STEP 2679 H=2679:00 +CPU= 34.668
  05:13:19 STEP 2680 H=2680:00 +CPU= 21.959
  05:13:40 STEP 2681 H=2681:00 +CPU= 21.280
  05:14:16 STEP 2682 H=2682:00 +CPU= 35.568
  05:14:38 STEP 2683 H=2683:00 +CPU= 21.484
  05:14:59 STEP 2684 H=2684:00 +CPU= 21.617
  05:15:34 STEP 2685 H=2685:00 +CPU= 34.653
  05:15:56 STEP 2686 H=2686:00 +CPU= 21.827
  05:16:18 STEP 2687 H=2687:00 +CPU= 21.844
  05:16:58 STEP 2688 H=2688:00 +CPU= 40.218
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_111.zip
Uploading the intermediate file: upload_file_111.zip
  05:17:20 STEP 2689 H=2689:00 +CPU= 21.302
  05:17:42 STEP 2690 H=2690:00 +CPU= 21.757
  05:18:16 STEP 2691 H=2691:00 +CPU= 34.746
  05:18:38 STEP 2692 H=2692:00 +CPU= 21.940
  05:18:59 STEP 2693 H=2693:00 +CPU= 21.072
  05:19:35 STEP 2694 H=2694:00 +CPU= 35.487
  05:19:56 STEP 2695 H=2695:00 +CPU= 21.268
  05:20:18 STEP 2696 H=2696:00 +CPU= 21.766
  05:20:53 STEP 2697 H=2697:00 +CPU= 34.784
  05:21:15 STEP 2698 H=2698:00 +CPU= 22.025
  05:21:36 STEP 2699 H=2699:00 +CPU= 21.050
  05:22:14 STEP 2700 H=2700:00 +CPU= 37.992
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002700
  05:22:36 STEP 2701 H=2701:00 +CPU= 21.408
  05:22:57 STEP 2702 H=2702:00 +CPU= 21.659
  05:23:32 STEP 2703 H=2703:00 +CPU= 34.850
  05:23:54 STEP 2704 H=2704:00 +CPU= 21.936
  05:24:15 STEP 2705 H=2705:00 +CPU= 21.073
  05:24:51 STEP 2706 H=2706:00 +CPU= 35.708
  05:25:13 STEP 2707 H=2707:00 +CPU= 21.339
  05:25:35 STEP 2708 H=2708:00 +CPU= 21.768
  05:26:10 STEP 2709 H=2709:00 +CPU= 34.721
  05:26:31 STEP 2710 H=2710:00 +CPU= 21.858
  05:26:53 STEP 2711 H=2711:00 +CPU= 21.750
  05:27:34 STEP 2712 H=2712:00 +CPU= 40.340
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_112.zip
Uploading the intermediate file: upload_file_112.zip
  05:27:55 STEP 2713 H=2713:00 +CPU= 21.369
  05:28:17 STEP 2714 H=2714:00 +CPU= 21.421
  05:28:52 STEP 2715 H=2715:00 +CPU= 34.946
  05:29:14 STEP 2716 H=2716:00 +CPU= 21.761
  05:29:35 STEP 2717 H=2717:00 +CPU= 20.880
  05:30:10 STEP 2718 H=2718:00 +CPU= 35.625
  05:30:32 STEP 2719 H=2719:00 +CPU= 21.289
  05:30:53 STEP 2720 H=2720:00 +CPU= 21.570
  05:31:28 STEP 2721 H=2721:00 +CPU= 34.893
  05:31:50 STEP 2722 H=2722:00 +CPU= 21.961
  05:32:11 STEP 2723 H=2723:00 +CPU= 20.882
  05:32:49 STEP 2724 H=2724:00 +CPU= 38.010
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002724
  05:33:11 STEP 2725 H=2725:00 +CPU= 21.323
  05:33:32 STEP 2726 H=2726:00 +CPU= 21.175
  05:34:07 STEP 2727 H=2727:00 +CPU= 34.976
  05:34:29 STEP 2728 H=2728:00 +CPU= 21.729
  05:34:50 STEP 2729 H=2729:00 +CPU= 21.083
  05:35:26 STEP 2730 H=2730:00 +CPU= 35.777
  05:35:47 STEP 2731 H=2731:00 +CPU= 21.372
  05:36:09 STEP 2732 H=2732:00 +CPU= 21.614
  05:36:44 STEP 2733 H=2733:00 +CPU= 34.800
  05:37:06 STEP 2734 H=2734:00 +CPU= 21.939
  05:37:27 STEP 2735 H=2735:00 +CPU= 21.644
  05:38:08 STEP 2736 H=2736:00 +CPU= 40.233
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_113.zip
Uploading the intermediate file: upload_file_113.zip
  05:38:30 STEP 2737 H=2737:00 +CPU= 21.406
  05:38:51 STEP 2738 H=2738:00 +CPU= 21.341
  05:39:26 STEP 2739 H=2739:00 +CPU= 34.985
  05:39:48 STEP 2740 H=2740:00 +CPU= 21.984
  05:40:09 STEP 2741 H=2741:00 +CPU= 20.751
  05:40:45 STEP 2742 H=2742:00 +CPU= 35.734
  05:41:06 STEP 2743 H=2743:00 +CPU= 21.332
  05:41:27 STEP 2744 H=2744:00 +CPU= 21.362
  05:42:02 STEP 2745 H=2745:00 +CPU= 35.048
  05:42:24 STEP 2746 H=2746:00 +CPU= 21.942
  05:42:45 STEP 2747 H=2747:00 +CPU= 20.729
  05:43:23 STEP 2748 H=2748:00 +CPU= 38.105
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002748
  05:43:45 STEP 2749 H=2749:00 +CPU= 21.238
  05:44:06 STEP 2750 H=2750:00 +CPU= 21.357
  05:44:41 STEP 2751 H=2751:00 +CPU= 34.975
  05:45:03 STEP 2752 H=2752:00 +CPU= 21.969
  05:45:24 STEP 2753 H=2753:00 +CPU= 20.859
  05:46:00 STEP 2754 H=2754:00 +CPU= 36.010
  05:46:22 STEP 2755 H=2755:00 +CPU= 21.293
  05:46:43 STEP 2756 H=2756:00 +CPU= 21.504
  05:47:18 STEP 2757 H=2757:00 +CPU= 35.080
  05:47:40 STEP 2758 H=2758:00 +CPU= 21.955
  05:48:02 STEP 2759 H=2759:00 +CPU= 21.483
  05:48:42 STEP 2760 H=2760:00 +CPU= 40.429
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_114.zip
Uploading the intermediate file: upload_file_114.zip
  05:49:04 STEP 2761 H=2761:00 +CPU= 21.307
  05:49:26 STEP 2762 H=2762:00 +CPU= 21.563
  05:50:01 STEP 2763 H=2763:00 +CPU= 35.168
  05:50:23 STEP 2764 H=2764:00 +CPU= 21.979
  05:50:44 STEP 2765 H=2765:00 +CPU= 20.731
  05:51:20 STEP 2766 H=2766:00 +CPU= 35.702
  05:51:41 STEP 2767 H=2767:00 +CPU= 21.302
  05:52:02 STEP 2768 H=2768:00 +CPU= 21.129
  05:52:37 STEP 2769 H=2769:00 +CPU= 35.155
  05:52:59 STEP 2770 H=2770:00 +CPU= 21.847
  05:53:20 STEP 2771 H=2771:00 +CPU= 20.723
  05:53:58 STEP 2772 H=2772:00 +CPU= 38.244
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002772
  05:54:20 STEP 2773 H=2773:00 +CPU= 21.223
  05:54:41 STEP 2774 H=2774:00 +CPU= 21.407
  05:55:16 STEP 2775 H=2775:00 +CPU= 35.191
  05:55:38 STEP 2776 H=2776:00 +CPU= 22.075
  05:55:59 STEP 2777 H=2777:00 +CPU= 20.835
  05:56:36 STEP 2778 H=2778:00 +CPU= 35.845
  05:56:57 STEP 2779 H=2779:00 +CPU= 21.546
  05:57:19 STEP 2780 H=2780:00 +CPU= 21.303
  05:57:54 STEP 2781 H=2781:00 +CPU= 34.992
  05:58:16 STEP 2782 H=2782:00 +CPU= 21.914
  05:58:37 STEP 2783 H=2783:00 +CPU= 21.363
  05:59:18 STEP 2784 H=2784:00 +CPU= 40.522
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_115.zip
Uploading the intermediate file: upload_file_115.zip
  05:59:39 STEP 2785 H=2785:00 +CPU= 21.266
  06:00:01 STEP 2786 H=2786:00 +CPU= 21.586
  06:00:36 STEP 2787 H=2787:00 +CPU= 35.109
  06:00:58 STEP 2788 H=2788:00 +CPU= 21.925
  06:01:19 STEP 2789 H=2789:00 +CPU= 20.861
  06:01:56 STEP 2790 H=2790:00 +CPU= 35.941
  06:02:18 STEP 2791 H=2791:00 +CPU= 21.222
  06:02:39 STEP 2792 H=2792:00 +CPU= 21.485
  06:03:14 STEP 2793 H=2793:00 +CPU= 35.094
  06:03:36 STEP 2794 H=2794:00 +CPU= 21.822
  06:03:57 STEP 2795 H=2795:00 +CPU= 20.893
  06:04:35 STEP 2796 H=2796:00 +CPU= 38.283
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002796
  06:04:57 STEP 2797 H=2797:00 +CPU= 21.187
  06:05:19 STEP 2798 H=2798:00 +CPU= 21.831
  06:05:54 STEP 2799 H=2799:00 +CPU= 34.949
  06:06:16 STEP 2800 H=2800:00 +CPU= 22.050
  06:06:37 STEP 2801 H=2801:00 +CPU= 20.920
  06:07:13 STEP 2802 H=2802:00 +CPU= 36.091
  06:07:35 STEP 2803 H=2803:00 +CPU= 21.228
  06:07:56 STEP 2804 H=2804:00 +CPU= 21.498
  06:08:31 STEP 2805 H=2805:00 +CPU= 35.136
  06:08:53 STEP 2806 H=2806:00 +CPU= 21.763
  06:09:15 STEP 2807 H=2807:00 +CPU= 21.707
  06:09:55 STEP 2808 H=2808:00 +CPU= 40.249
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_116.zip
Uploading the intermediate file: upload_file_116.zip
  06:10:17 STEP 2809 H=2809:00 +CPU= 21.168
  06:10:39 STEP 2810 H=2810:00 +CPU= 21.797
  06:11:14 STEP 2811 H=2811:00 +CPU= 34.791
  06:11:36 STEP 2812 H=2812:00 +CPU= 21.870
  06:11:57 STEP 2813 H=2813:00 +CPU= 21.185
  06:12:32 STEP 2814 H=2814:00 +CPU= 35.469
  06:12:54 STEP 2815 H=2815:00 +CPU= 21.194
  06:13:16 STEP 2816 H=2816:00 +CPU= 21.895
  06:13:50 STEP 2817 H=2817:00 +CPU= 34.789
  06:14:12 STEP 2818 H=2818:00 +CPU= 21.826
  06:14:34 STEP 2819 H=2819:00 +CPU= 21.335
  06:15:12 STEP 2820 H=2820:00 +CPU= 37.888
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002820
  06:15:33 STEP 2821 H=2821:00 +CPU= 21.112
  06:15:55 STEP 2822 H=2822:00 +CPU= 21.902
  06:16:30 STEP 2823 H=2823:00 +CPU= 34.864
  06:16:52 STEP 2824 H=2824:00 +CPU= 21.759
  06:17:13 STEP 2825 H=2825:00 +CPU= 21.292
  06:17:49 STEP 2826 H=2826:00 +CPU= 35.725
  06:18:10 STEP 2827 H=2827:00 +CPU= 21.300
  06:18:32 STEP 2828 H=2828:00 +CPU= 21.930
  06:19:07 STEP 2829 H=2829:00 +CPU= 34.706
  06:19:29 STEP 2830 H=2830:00 +CPU= 21.808
  06:19:51 STEP 2831 H=2831:00 +CPU= 22.021
  06:20:31 STEP 2832 H=2832:00 +CPU= 40.201
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_117.zip
Uploading the intermediate file: upload_file_117.zip
  06:20:53 STEP 2833 H=2833:00 +CPU= 21.132
  06:21:15 STEP 2834 H=2834:00 +CPU= 21.951
  06:21:50 STEP 2835 H=2835:00 +CPU= 34.709
  06:22:11 STEP 2836 H=2836:00 +CPU= 21.766
  06:22:36 STEP 2837 H=2837:00 +CPU= 21.462
  06:23:13 STEP 2838 H=2838:00 +CPU= 35.781
  06:23:34 STEP 2839 H=2839:00 +CPU= 21.222
  06:23:59 STEP 2840 H=2840:00 +CPU= 22.301
  06:24:34 STEP 2841 H=2841:00 +CPU= 34.978
  06:24:56 STEP 2842 H=2842:00 +CPU= 21.745
  06:25:17 STEP 2843 H=2843:00 +CPU= 21.273
  06:25:56 STEP 2844 H=2844:00 +CPU= 38.150
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002844
  06:26:17 STEP 2845 H=2845:00 +CPU= 20.865
  06:26:39 STEP 2846 H=2846:00 +CPU= 21.887
  06:27:14 STEP 2847 H=2847:00 +CPU= 34.900
  06:27:35 STEP 2848 H=2848:00 +CPU= 21.723
  06:27:57 STEP 2849 H=2849:00 +CPU= 21.379
  06:28:33 STEP 2850 H=2850:00 +CPU= 35.741
  06:28:54 STEP 2851 H=2851:00 +CPU= 21.155
  06:29:16 STEP 2852 H=2852:00 +CPU= 21.752
  06:29:51 STEP 2853 H=2853:00 +CPU= 34.832
  06:30:13 STEP 2854 H=2854:00 +CPU= 21.640
  06:30:35 STEP 2855 H=2855:00 +CPU= 21.961
  06:31:15 STEP 2856 H=2856:00 +CPU= 40.404
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_118.zip
Uploading the intermediate file: upload_file_118.zip
  06:31:36 STEP 2857 H=2857:00 +CPU= 20.753
  06:31:58 STEP 2858 H=2858:00 +CPU= 22.001
  06:32:34 STEP 2859 H=2859:00 +CPU= 35.071
  06:32:55 STEP 2860 H=2860:00 +CPU= 21.452
  06:33:16 STEP 2861 H=2861:00 +CPU= 21.228
  06:33:52 STEP 2862 H=2862:00 +CPU= 35.717
  06:34:13 STEP 2863 H=2863:00 +CPU= 20.867
  06:34:35 STEP 2864 H=2864:00 +CPU= 21.858
  06:35:10 STEP 2865 H=2865:00 +CPU= 35.066
  06:35:32 STEP 2866 H=2866:00 +CPU= 21.471
  06:35:53 STEP 2867 H=2867:00 +CPU= 21.259
  06:36:31 STEP 2868 H=2868:00 +CPU= 38.172
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002868
  06:36:52 STEP 2869 H=2869:00 +CPU= 20.710
  06:37:14 STEP 2870 H=2870:00 +CPU= 21.834
  06:37:49 STEP 2871 H=2871:00 +CPU= 34.916
  06:38:11 STEP 2872 H=2872:00 +CPU= 21.757
  06:38:32 STEP 2873 H=2873:00 +CPU= 21.384
  06:39:08 STEP 2874 H=2874:00 +CPU= 35.694
  06:39:29 STEP 2875 H=2875:00 +CPU= 20.806
  06:39:51 STEP 2876 H=2876:00 +CPU= 21.864
  06:40:26 STEP 2877 H=2877:00 +CPU= 34.895
  06:40:48 STEP 2878 H=2878:00 +CPU= 21.625
  06:41:09 STEP 2879 H=2879:00 +CPU= 21.899
  06:41:50 STEP 2880 H=2880:00 +CPU= 40.401
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_119.zip
Uploading the intermediate file: upload_file_119.zip
  06:42:11 STEP 2881 H=2881:00 +CPU= 20.875
Uploading trickle at timestep: 10368000
  06:42:33 STEP 2882 H=2882:00 +CPU= 21.901
  06:43:09 STEP 2883 H=2883:00 +CPU= 35.257
  06:43:30 STEP 2884 H=2884:00 +CPU= 21.354
  06:43:51 STEP 2885 H=2885:00 +CPU= 21.244
  06:44:27 STEP 2886 H=2886:00 +CPU= 35.781
  06:44:48 STEP 2887 H=2887:00 +CPU= 20.725
  06:45:10 STEP 2888 H=2888:00 +CPU= 21.826
  06:45:45 STEP 2889 H=2889:00 +CPU= 35.046
  06:46:06 STEP 2890 H=2890:00 +CPU= 21.328
  06:46:28 STEP 2891 H=2891:00 +CPU= 21.236
  06:47:06 STEP 2892 H=2892:00 +CPU= 38.200
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002892
  06:47:27 STEP 2893 H=2893:00 +CPU= 20.762
  06:47:48 STEP 2894 H=2894:00 +CPU= 21.719
  06:48:24 STEP 2895 H=2895:00 +CPU= 35.238
  06:48:45 STEP 2896 H=2896:00 +CPU= 21.417
  06:49:07 STEP 2897 H=2897:00 +CPU= 21.309
  06:49:43 STEP 2898 H=2898:00 +CPU= 35.890
  06:50:04 STEP 2899 H=2899:00 +CPU= 20.760
  06:50:25 STEP 2900 H=2900:00 +CPU= 21.802
  06:51:00 STEP 2901 H=2901:00 +CPU= 34.997
  06:51:22 STEP 2902 H=2902:00 +CPU= 21.331
  06:51:44 STEP 2903 H=2903:00 +CPU= 21.877
  06:52:24 STEP 2904 H=2904:00 +CPU= 40.402
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_120.zip
Uploading the intermediate file: upload_file_120.zip
  06:52:45 STEP 2905 H=2905:00 +CPU= 20.845
  06:53:07 STEP 2906 H=2906:00 +CPU= 21.982
  06:53:43 STEP 2907 H=2907:00 +CPU= 35.265
  06:54:04 STEP 2908 H=2908:00 +CPU= 21.362
  06:54:25 STEP 2909 H=2909:00 +CPU= 21.240
  06:55:01 STEP 2910 H=2910:00 +CPU= 35.835
  06:55:22 STEP 2911 H=2911:00 +CPU= 20.803
  06:55:44 STEP 2912 H=2912:00 +CPU= 21.927
  06:56:19 STEP 2913 H=2913:00 +CPU= 35.267
  06:56:41 STEP 2914 H=2914:00 +CPU= 21.438
  06:57:02 STEP 2915 H=2915:00 +CPU= 21.306
  06:57:40 STEP 2916 H=2916:00 +CPU= 38.169
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002916
  06:58:01 STEP 2917 H=2917:00 +CPU= 20.785
  06:58:23 STEP 2918 H=2918:00 +CPU= 21.997
  06:58:59 STEP 2919 H=2919:00 +CPU= 35.429
  06:59:20 STEP 2920 H=2920:00 +CPU= 21.489
  06:59:42 STEP 2921 H=2921:00 +CPU= 21.375
  07:00:18 STEP 2922 H=2922:00 +CPU= 35.894
  07:00:39 STEP 2923 H=2923:00 +CPU= 20.762
  07:01:01 STEP 2924 H=2924:00 +CPU= 21.878
  07:01:36 STEP 2925 H=2925:00 +CPU= 35.198
  07:01:57 STEP 2926 H=2926:00 +CPU= 21.366
  07:02:19 STEP 2927 H=2927:00 +CPU= 21.962
  07:03:00 STEP 2928 H=2928:00 +CPU= 40.489
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_121.zip
Uploading the intermediate file: upload_file_121.zip
  07:03:22 STEP 2929 H=2929:00 +CPU= 21.209
  07:03:44 STEP 2930 H=2930:00 +CPU= 22.095
  07:04:19 STEP 2931 H=2931:00 +CPU= 35.046
  07:04:40 STEP 2932 H=2932:00 +CPU= 21.592
  07:05:02 STEP 2933 H=2933:00 +CPU= 21.339
  07:05:38 STEP 2934 H=2934:00 +CPU= 35.701
  07:05:59 STEP 2935 H=2935:00 +CPU= 21.079
  07:06:21 STEP 2936 H=2936:00 +CPU= 21.999
  07:06:56 STEP 2937 H=2937:00 +CPU= 34.839
  07:07:17 STEP 2938 H=2938:00 +CPU= 21.768
  07:07:39 STEP 2939 H=2939:00 +CPU= 21.432
  07:08:17 STEP 2940 H=2940:00 +CPU= 37.995
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002940
  07:08:38 STEP 2941 H=2941:00 +CPU= 21.299
  07:09:00 STEP 2942 H=2942:00 +CPU= 21.929
  07:09:35 STEP 2943 H=2943:00 +CPU= 34.873
  07:09:57 STEP 2944 H=2944:00 +CPU= 21.725
  07:10:19 STEP 2945 H=2945:00 +CPU= 21.581
  07:10:55 STEP 2946 H=2946:00 +CPU= 35.779
  07:11:16 STEP 2947 H=2947:00 +CPU= 21.099
  07:11:38 STEP 2948 H=2948:00 +CPU= 21.974
  07:12:13 STEP 2949 H=2949:00 +CPU= 34.958
  07:12:35 STEP 2950 H=2950:00 +CPU= 21.732
  07:12:57 STEP 2951 H=2951:00 +CPU= 22.118
  07:13:36 STEP 2952 H=2952:00 +CPU= 38.882
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.14738107083738     
  MAXGPFV : MAX. VALUE =   0.730460296467738     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    301461290 BYTES IN      8 RECORDS TRANSFERRED IN    0.0005 SECONDS602922.6 Mbytes/s, TOTAL TIME=    0.0102( 4.9%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 07:13:36 STEP 2952 H=2952:00 +CPU= 38.882
 END CNT3
 NSTEP =  2952 CNT0   000000000  34.335  34.335  34.526   0.994               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   177.0     0.0   177.0     0.9   281.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    2204.3    2204.3      9.04      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     374.9     374.9      1.42      0.00
  10 SCAN2M - PHYSICS                             2953   11272.2   11272.2     42.67      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247    1068.6    1068.6      0.34      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      14.1      14.1      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985   13525.1   13525.1     17.08      0.00
  14 SUINIF                                          1    1578.9    1578.9      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      45.4      45.4      0.01      0.00
  18 SUSPECG                                         1     284.8     284.8      0.00      0.00
  19 SUSPEC                                          1     292.5     292.5      0.00      0.00
  24 SUGRIDU                                         1     967.9     967.9      0.00      0.00
  25 SPECRT                                          1     162.6     162.6      0.00      0.00
  26 SUGRIDF                                         1     155.9     155.9      0.00      0.00
  27 RESTART FILES - WRITING                       123    2145.8    2145.8      0.34      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               247    2114.5    2114.5      0.67      0.00
  31 POSDDH IN STEPO                                13       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    3279.9    3279.9     12.41      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    2751.1    2751.1     10.41      0.00
  39 SU0YOMB                                         1     276.5     276.5      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953      28.8      28.8      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952     236.0     236.0      0.89      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      57.3      57.3      0.22      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094     145.2     145.2      1.88      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152     133.2     133.2      1.05      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      54.4      54.4      0.43      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      50.5      50.5      0.65      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      20.1      20.1      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      17.5      17.5      0.23      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152      15.2      15.2      0.12      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      17.4      17.4      0.23      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      15.2      15.2      0.12      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    78018.2 CPU TIME   77788.9 VECTOR TIME    77788.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      136.2
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/0/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/0/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214376/ICMGGhnw4+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00q2_2019110100_123_993_12214376_0_r355219719_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
07:16:59 (11512): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:45 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 10,623,600 77,789 0.0073
09 May 2023 16:54:44 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 10,368,000 75,890 0.0073
09 May 2023 16:54:43 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 9,504,000 69,557 0.0073
09 May 2023 16:54:42 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 8,640,000 63,240 0.0073
09 May 2023 16:54:40 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 7,776,000 56,929 0.0073
09 May 2023 16:54:38 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 6,912,000 50,615 0.0073
09 May 2023 16:54:36 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 6,048,000 44,296 0.0073
09 May 2023 16:54:35 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 5,184,000 37,979 0.0073
09 May 2023 16:54:33 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 4,320,000 31,650 0.0073
09 May 2023 16:54:31 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 3,456,000 25,331 0.0073
09 May 2023 16:54:29 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 2,592,000 19,003 0.0073
09 May 2023 16:54:27 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 1,728,000 12,668 0.0073
09 May 2023 16:54:24 1538124 22315746 oifs_43r3_00q2_2019110100_123_993_12214376_0 864,000 6,343 0.0073


©2024 climateprediction.net