climateprediction.net home page
Task 22304469

Task 22304469

Name oifs_43r3_ps_0355_2000050100_123_969_12185999_1
Workunit 12185999
Created 29 Jan 2023, 10:35:52 UTC
Sent 29 Jan 2023, 10:36:57 UTC
Report deadline 30 Mar 2023, 10:36:57 UTC
Received 29 Jan 2023, 19:43:06 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1538423
Run time 7 hours 12 min 22 sec
CPU time 7 hours 12 min 22 sec
Validate state Invalid
Credit 4,838.40
Device peak FLOPS 4.36 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,394.98 MB
Peak swap size 4,974.27 MB
Peak disk usage 1,213.60 MB
Stderr 
<core_client_version>7.22.0</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
/home/pat/slots/1/ICMSHhq0f+000408
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000408
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000384
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000384
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000384
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000396
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000396
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000396
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_16.zip
Uploading the intermediate file: upload_file_16.zip
  14:45:08 STEP  409 H= 409:00 +CPU= 18.077
  14:45:26 STEP  410 H= 410:00 +CPU= 18.590
  14:45:54 STEP  411 H= 411:00 +CPU= 27.758
  14:46:13 STEP  412 H= 412:00 +CPU= 18.415
  14:46:31 STEP  413 H= 413:00 +CPU= 17.883
  14:46:59 STEP  414 H= 414:00 +CPU= 28.325
  14:47:17 STEP  415 H= 415:00 +CPU= 17.681
  14:47:36 STEP  416 H= 416:00 +CPU= 18.661
  14:48:04 STEP  417 H= 417:00 +CPU= 28.125
  14:48:22 STEP  418 H= 418:00 +CPU= 18.403
  14:48:41 STEP  419 H= 419:00 +CPU= 18.036
  14:49:12 STEP  420 H= 420:00 +CPU= 31.250
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000420
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000420
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000420
  14:49:30 STEP  421 H= 421:00 +CPU= 18.123
  14:49:49 STEP  422 H= 422:00 +CPU= 18.503
  14:50:17 STEP  423 H= 423:00 +CPU= 27.936
  14:50:35 STEP  424 H= 424:00 +CPU= 18.391
  14:50:53 STEP  425 H= 425:00 +CPU= 18.130
  14:51:22 STEP  426 H= 426:00 +CPU= 28.701
  14:51:40 STEP  427 H= 427:00 +CPU= 17.786
  14:51:59 STEP  428 H= 428:00 +CPU= 18.529
  14:52:27 STEP  429 H= 429:00 +CPU= 27.964
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:53:23 STEP  430 H= 430:00 +CPU= 18.213
  14:53:42 STEP  431 H= 431:00 +CPU= 18.597
  14:54:16 STEP  432 H= 432:00 +CPU= 33.651
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000432
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000432
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000432
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000408
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000408
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000408
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000420
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000420
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000420
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_17.zip
Uploading the intermediate file: upload_file_17.zip
  14:54:34 STEP  433 H= 433:00 +CPU= 18.032
  14:54:53 STEP  434 H= 434:00 +CPU= 18.950
  14:55:21 STEP  435 H= 435:00 +CPU= 28.250
  14:55:40 STEP  436 H= 436:00 +CPU= 18.651
  14:55:58 STEP  437 H= 437:00 +CPU= 18.237
  14:56:27 STEP  438 H= 438:00 +CPU= 28.675
  14:56:45 STEP  439 H= 439:00 +CPU= 17.998
  14:57:04 STEP  440 H= 440:00 +CPU= 18.859
  14:57:33 STEP  441 H= 441:00 +CPU= 28.585
  14:57:51 STEP  442 H= 442:00 +CPU= 18.388
  14:58:10 STEP  443 H= 443:00 +CPU= 18.350
  14:58:42 STEP  444 H= 444:00 +CPU= 31.698
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000444
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000444
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000444
  14:59:00 STEP  445 H= 445:00 +CPU= 18.136
  14:59:19 STEP  446 H= 446:00 +CPU= 18.696
  14:59:47 STEP  447 H= 447:00 +CPU= 28.512
  15:00:06 STEP  448 H= 448:00 +CPU= 18.504
  15:00:24 STEP  449 H= 449:00 +CPU= 18.300
  15:00:53 STEP  450 H= 450:00 +CPU= 28.986
  15:01:12 STEP  451 H= 451:00 +CPU= 18.034
  15:01:30 STEP  452 H= 452:00 +CPU= 18.705
  15:01:59 STEP  453 H= 453:00 +CPU= 28.665
  15:02:18 STEP  454 H= 454:00 +CPU= 18.477
  15:02:37 STEP  455 H= 455:00 +CPU= 18.810
  15:03:11 STEP  456 H= 456:00 +CPU= 34.058
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000456
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000456
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000456
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000432
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000432
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000432
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000444
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000444
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000444
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_18.zip
Uploading the intermediate file: upload_file_18.zip
  15:03:29 STEP  457 H= 457:00 +CPU= 18.136
  15:03:48 STEP  458 H= 458:00 +CPU= 18.797
  15:04:16 STEP  459 H= 459:00 +CPU= 28.135
  15:04:35 STEP  460 H= 460:00 +CPU= 18.591
  15:04:53 STEP  461 H= 461:00 +CPU= 18.221
  15:05:22 STEP  462 H= 462:00 +CPU= 28.709
  15:05:40 STEP  463 H= 463:00 +CPU= 17.778
  15:05:59 STEP  464 H= 464:00 +CPU= 18.736
  15:06:27 STEP  465 H= 465:00 +CPU= 28.578
  15:06:46 STEP  466 H= 466:00 +CPU= 18.315
  15:07:04 STEP  467 H= 467:00 +CPU= 18.267
  15:07:36 STEP  468 H= 468:00 +CPU= 31.171
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000468
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000468
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000468
  15:07:54 STEP  469 H= 469:00 +CPU= 17.839
  15:08:12 STEP  470 H= 470:00 +CPU= 18.758
  15:08:41 STEP  471 H= 471:00 +CPU= 28.432
  15:08:59 STEP  472 H= 472:00 +CPU= 18.465
  15:09:18 STEP  473 H= 473:00 +CPU= 18.014
  15:09:46 STEP  474 H= 474:00 +CPU= 28.751
  15:10:04 STEP  475 H= 475:00 +CPU= 17.623
  15:10:23 STEP  476 H= 476:00 +CPU= 18.592
  15:10:51 STEP  477 H= 477:00 +CPU= 28.338
  15:11:09 STEP  478 H= 478:00 +CPU= 18.056
  15:11:28 STEP  479 H= 479:00 +CPU= 18.791
  15:12:02 STEP  480 H= 480:00 +CPU= 33.902
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000480
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000480
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000480
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000456
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000456
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000456
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000468
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000468
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000468
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_19.zip
Uploading the intermediate file: upload_file_19.zip
  15:12:20 STEP  481 H= 481:00 +CPU= 18.028
Uploading trickle at timestep: 1728000
  15:12:39 STEP  482 H= 482:00 +CPU= 18.846
  15:13:08 STEP  483 H= 483:00 +CPU= 28.292
  15:13:26 STEP  484 H= 484:00 +CPU= 18.464
  15:13:45 STEP  485 H= 485:00 +CPU= 18.244
  15:14:16 STEP  486 H= 486:00 +CPU= 30.657
  15:14:34 STEP  487 H= 487:00 +CPU= 17.862
  15:14:53 STEP  488 H= 488:00 +CPU= 18.851
  15:15:21 STEP  489 H= 489:00 +CPU= 28.768
  15:15:40 STEP  490 H= 490:00 +CPU= 18.344
  15:15:58 STEP  491 H= 491:00 +CPU= 18.315
  15:16:30 STEP  492 H= 492:00 +CPU= 31.402
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000492
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000492
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000492
  15:16:48 STEP  493 H= 493:00 +CPU= 17.813
  15:17:07 STEP  494 H= 494:00 +CPU= 18.927
  15:17:35 STEP  495 H= 495:00 +CPU= 28.335
  15:17:54 STEP  496 H= 496:00 +CPU= 18.245
  15:18:12 STEP  497 H= 497:00 +CPU= 18.354
  15:18:41 STEP  498 H= 498:00 +CPU= 29.244
  15:18:59 STEP  499 H= 499:00 +CPU= 17.739
  15:19:18 STEP  500 H= 500:00 +CPU= 18.539
  15:19:47 STEP  501 H= 501:00 +CPU= 28.548
  15:20:05 STEP  502 H= 502:00 +CPU= 18.322
  15:20:24 STEP  503 H= 503:00 +CPU= 18.661
  15:20:58 STEP  504 H= 504:00 +CPU= 33.911
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000504
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000504
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000504
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000480
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000480
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000480
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000492
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000492
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000492
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_20.zip
Uploading the intermediate file: upload_file_20.zip
  15:21:16 STEP  505 H= 505:00 +CPU= 18.011
  15:21:35 STEP  506 H= 506:00 +CPU= 18.609
  15:22:03 STEP  507 H= 507:00 +CPU= 28.058
  15:22:21 STEP  508 H= 508:00 +CPU= 18.445
  15:22:40 STEP  509 H= 509:00 +CPU= 18.035
  15:23:08 STEP  510 H= 510:00 +CPU= 28.717
  15:23:26 STEP  511 H= 511:00 +CPU= 17.829
  15:23:45 STEP  512 H= 512:00 +CPU= 18.850
  15:24:14 STEP  513 H= 513:00 +CPU= 28.447
  15:24:32 STEP  514 H= 514:00 +CPU= 18.232
  15:24:50 STEP  515 H= 515:00 +CPU= 18.127
  15:25:22 STEP  516 H= 516:00 +CPU= 31.318
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000516
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000516
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000516
  15:25:40 STEP  517 H= 517:00 +CPU= 18.076
  15:25:59 STEP  518 H= 518:00 +CPU= 18.646
  15:26:27 STEP  519 H= 519:00 +CPU= 28.478
  15:26:46 STEP  520 H= 520:00 +CPU= 18.198
  15:27:04 STEP  521 H= 521:00 +CPU= 18.192
  15:27:33 STEP  522 H= 522:00 +CPU= 28.751
  15:27:51 STEP  523 H= 523:00 +CPU= 17.720
  15:28:09 STEP  524 H= 524:00 +CPU= 18.600
  15:28:37 STEP  525 H= 525:00 +CPU= 27.991
  15:28:56 STEP  526 H= 526:00 +CPU= 18.305
  15:29:14 STEP  527 H= 527:00 +CPU= 18.595
  15:29:48 STEP  528 H= 528:00 +CPU= 33.774
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000528
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000528
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000528
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000504
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000504
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000504
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000516
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000516
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000516
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_21.zip
Uploading the intermediate file: upload_file_21.zip
  15:30:07 STEP  529 H= 529:00 +CPU= 18.051
  15:30:25 STEP  530 H= 530:00 +CPU= 18.763
  15:30:54 STEP  531 H= 531:00 +CPU= 28.448
  15:31:12 STEP  532 H= 532:00 +CPU= 18.338
  15:31:31 STEP  533 H= 533:00 +CPU= 18.307
  15:32:00 STEP  534 H= 534:00 +CPU= 28.803
  15:32:18 STEP  535 H= 535:00 +CPU= 17.873
  15:32:37 STEP  536 H= 536:00 +CPU= 18.810
  15:33:05 STEP  537 H= 537:00 +CPU= 28.534
  15:33:24 STEP  538 H= 538:00 +CPU= 18.333
  15:33:42 STEP  539 H= 539:00 +CPU= 18.074
  15:34:13 STEP  540 H= 540:00 +CPU= 31.310
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000540
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000540
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000540
  15:34:31 STEP  541 H= 541:00 +CPU= 17.758
  15:34:50 STEP  542 H= 542:00 +CPU= 18.695
  15:35:18 STEP  543 H= 543:00 +CPU= 28.218
  15:35:37 STEP  544 H= 544:00 +CPU= 18.420
  15:35:55 STEP  545 H= 545:00 +CPU= 18.034
  15:36:24 STEP  546 H= 546:00 +CPU= 28.872
  15:36:42 STEP  547 H= 547:00 +CPU= 17.979
  15:37:01 STEP  548 H= 548:00 +CPU= 18.548
  15:37:29 STEP  549 H= 549:00 +CPU= 28.196
  15:37:47 STEP  550 H= 550:00 +CPU= 18.201
  15:38:06 STEP  551 H= 551:00 +CPU= 18.658
  15:38:40 STEP  552 H= 552:00 +CPU= 34.016
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000552
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000552
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000552
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000528
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000528
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000528
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000540
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000540
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000540
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_22.zip
Uploading the intermediate file: upload_file_22.zip
  15:38:58 STEP  553 H= 553:00 +CPU= 17.633
  15:39:17 STEP  554 H= 554:00 +CPU= 18.583
  15:39:46 STEP  555 H= 555:00 +CPU= 28.717
  15:40:04 STEP  556 H= 556:00 +CPU= 18.080
  15:40:22 STEP  557 H= 557:00 +CPU= 18.097
  15:40:50 STEP  558 H= 558:00 +CPU= 28.453
  15:41:08 STEP  559 H= 559:00 +CPU= 17.826
  15:41:27 STEP  560 H= 560:00 +CPU= 18.547
  15:41:56 STEP  561 H= 561:00 +CPU= 28.400
  15:42:14 STEP  562 H= 562:00 +CPU= 18.295
  15:42:32 STEP  563 H= 563:00 +CPU= 18.323
  15:43:04 STEP  564 H= 564:00 +CPU= 31.164
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000564
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000564
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000564
  15:43:22 STEP  565 H= 565:00 +CPU= 18.147
  15:43:41 STEP  566 H= 566:00 +CPU= 18.664
  15:44:09 STEP  567 H= 567:00 +CPU= 28.095
  15:44:27 STEP  568 H= 568:00 +CPU= 18.450
  15:44:46 STEP  569 H= 569:00 +CPU= 18.052
  15:45:14 STEP  570 H= 570:00 +CPU= 28.715
  15:45:32 STEP  571 H= 571:00 +CPU= 17.849
  15:45:51 STEP  572 H= 572:00 +CPU= 18.557
  15:46:19 STEP  573 H= 573:00 +CPU= 28.133
  15:46:38 STEP  574 H= 574:00 +CPU= 18.397
  15:46:57 STEP  575 H= 575:00 +CPU= 18.766
  15:47:31 STEP  576 H= 576:00 +CPU= 33.841
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000576
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000576
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000576
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000552
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000552
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000552
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000564
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000564
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000564
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_23.zip
Uploading the intermediate file: upload_file_23.zip
  15:47:48 STEP  577 H= 577:00 +CPU= 17.727
  15:48:07 STEP  578 H= 578:00 +CPU= 18.545
  15:48:36 STEP  579 H= 579:00 +CPU= 28.357
  15:48:54 STEP  580 H= 580:00 +CPU= 18.297
  15:49:12 STEP  581 H= 581:00 +CPU= 18.094
  15:49:41 STEP  582 H= 582:00 +CPU= 28.756
  15:49:59 STEP  583 H= 583:00 +CPU= 17.867
  15:50:18 STEP  584 H= 584:00 +CPU= 18.526
  15:50:46 STEP  585 H= 585:00 +CPU= 28.369
  15:51:05 STEP  586 H= 586:00 +CPU= 18.516
  15:51:23 STEP  587 H= 587:00 +CPU= 18.332
  15:51:54 STEP  588 H= 588:00 +CPU= 30.995
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000588
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000588
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000588
  15:52:12 STEP  589 H= 589:00 +CPU= 17.833
  15:52:31 STEP  590 H= 590:00 +CPU= 18.569
  15:52:59 STEP  591 H= 591:00 +CPU= 28.211
  15:53:18 STEP  592 H= 592:00 +CPU= 18.251
  15:53:36 STEP  593 H= 593:00 +CPU= 18.117
  15:54:05 STEP  594 H= 594:00 +CPU= 28.674
  15:54:22 STEP  595 H= 595:00 +CPU= 17.746
  15:54:41 STEP  596 H= 596:00 +CPU= 18.715
  15:55:10 STEP  597 H= 597:00 +CPU= 28.191
  15:55:28 STEP  598 H= 598:00 +CPU= 18.561
  15:55:47 STEP  599 H= 599:00 +CPU= 18.593
  15:56:21 STEP  600 H= 600:00 +CPU= 33.891
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000600
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000600
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000600
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000576
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000576
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000576
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000588
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000588
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000588
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_24.zip
Uploading the intermediate file: upload_file_24.zip
  15:56:39 STEP  601 H= 601:00 +CPU= 17.874
  15:56:58 STEP  602 H= 602:00 +CPU= 19.026
  15:57:27 STEP  603 H= 603:00 +CPU= 28.431
  15:57:45 STEP  604 H= 604:00 +CPU= 18.240
  15:58:03 STEP  605 H= 605:00 +CPU= 18.131
  15:58:32 STEP  606 H= 606:00 +CPU= 28.584
  15:58:50 STEP  607 H= 607:00 +CPU= 17.909
  15:59:09 STEP  608 H= 608:00 +CPU= 18.596
  15:59:37 STEP  609 H= 609:00 +CPU= 28.409
  15:59:56 STEP  610 H= 610:00 +CPU= 18.570
  16:00:14 STEP  611 H= 611:00 +CPU= 18.207
  16:00:45 STEP  612 H= 612:00 +CPU= 31.101
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000612
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000612
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000612
  16:01:03 STEP  613 H= 613:00 +CPU= 18.020
  16:01:22 STEP  614 H= 614:00 +CPU= 18.791
  16:01:51 STEP  615 H= 615:00 +CPU= 28.238
  16:02:09 STEP  616 H= 616:00 +CPU= 18.492
  16:02:27 STEP  617 H= 617:00 +CPU= 18.012
  16:02:56 STEP  618 H= 618:00 +CPU= 28.918
  16:03:14 STEP  619 H= 619:00 +CPU= 17.896
  16:03:33 STEP  620 H= 620:00 +CPU= 18.404
  16:04:01 STEP  621 H= 621:00 +CPU= 28.418
  16:04:20 STEP  622 H= 622:00 +CPU= 18.545
  16:04:39 STEP  623 H= 623:00 +CPU= 18.523
  16:05:13 STEP  624 H= 624:00 +CPU= 33.692
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000624
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000624
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000624
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000600
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000600
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000600
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000612
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000612
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000612
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_25.zip
Uploading the intermediate file: upload_file_25.zip
  16:05:31 STEP  625 H= 625:00 +CPU= 17.897
  16:05:49 STEP  626 H= 626:00 +CPU= 18.755
  16:06:18 STEP  627 H= 627:00 +CPU= 28.190
  16:06:36 STEP  628 H= 628:00 +CPU= 18.339
  16:06:54 STEP  629 H= 629:00 +CPU= 18.250
  16:07:23 STEP  630 H= 630:00 +CPU= 28.631
  16:07:41 STEP  631 H= 631:00 +CPU= 17.885
  16:08:00 STEP  632 H= 632:00 +CPU= 18.548
  16:08:28 STEP  633 H= 633:00 +CPU= 28.258
  16:08:47 STEP  634 H= 634:00 +CPU= 18.689
  16:09:05 STEP  635 H= 635:00 +CPU= 18.073
  16:09:36 STEP  636 H= 636:00 +CPU= 30.928
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000636
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000636
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000636
  16:09:55 STEP  637 H= 637:00 +CPU= 18.139
  16:10:13 STEP  638 H= 638:00 +CPU= 18.573
  16:10:41 STEP  639 H= 639:00 +CPU= 28.084
  16:11:00 STEP  640 H= 640:00 +CPU= 18.490
  16:11:18 STEP  641 H= 641:00 +CPU= 17.837
  16:11:47 STEP  642 H= 642:00 +CPU= 28.743
  16:12:05 STEP  643 H= 643:00 +CPU= 18.017
  16:12:24 STEP  644 H= 644:00 +CPU= 18.505
  16:12:52 STEP  645 H= 645:00 +CPU= 28.439
  16:13:11 STEP  646 H= 646:00 +CPU= 18.692
  16:13:30 STEP  647 H= 647:00 +CPU= 18.595
  16:14:03 STEP  648 H= 648:00 +CPU= 33.581
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000648
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000648
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000648
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000624
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000624
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000624
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000636
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000636
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000636
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_26.zip
Uploading the intermediate file: upload_file_26.zip
  16:14:22 STEP  649 H= 649:00 +CPU= 18.165
  16:14:41 STEP  650 H= 650:00 +CPU= 18.815
  16:15:09 STEP  651 H= 651:00 +CPU= 28.132
  16:15:27 STEP  652 H= 652:00 +CPU= 18.281
  16:15:45 STEP  653 H= 653:00 +CPU= 18.188
  16:16:14 STEP  654 H= 654:00 +CPU= 28.681
  16:16:33 STEP  655 H= 655:00 +CPU= 18.239
  16:16:51 STEP  656 H= 656:00 +CPU= 18.520
  16:17:20 STEP  657 H= 657:00 +CPU= 28.339
  16:17:39 STEP  658 H= 658:00 +CPU= 18.757
  16:17:57 STEP  659 H= 659:00 +CPU= 18.157
  16:18:28 STEP  660 H= 660:00 +CPU= 31.055
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000660
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000660
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000660
  16:18:46 STEP  661 H= 661:00 +CPU= 17.997
  16:19:05 STEP  662 H= 662:00 +CPU= 18.612
  16:19:33 STEP  663 H= 663:00 +CPU= 28.244
  16:19:52 STEP  664 H= 664:00 +CPU= 18.471
  16:20:10 STEP  665 H= 665:00 +CPU= 18.023
  16:20:39 STEP  666 H= 666:00 +CPU= 28.725
  16:20:57 STEP  667 H= 667:00 +CPU= 18.057
  16:21:16 STEP  668 H= 668:00 +CPU= 18.677
  16:21:44 STEP  669 H= 669:00 +CPU= 28.319
  16:22:03 STEP  670 H= 670:00 +CPU= 18.589
  16:22:21 STEP  671 H= 671:00 +CPU= 18.561
  16:22:55 STEP  672 H= 672:00 +CPU= 33.615
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000672
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000672
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000672
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000648
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000648
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000648
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000660
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000660
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000660
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_27.zip
Uploading the intermediate file: upload_file_27.zip
  16:23:13 STEP  673 H= 673:00 +CPU= 18.034
  16:23:32 STEP  674 H= 674:00 +CPU= 18.835
  16:24:01 STEP  675 H= 675:00 +CPU= 28.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:28:48 STEP  676 H= 676:00 +CPU= 18.705
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:29:54 STEP  677 H= 677:00 +CPU= 18.129
  16:30:23 STEP  678 H= 678:00 +CPU= 28.893
  16:30:41 STEP  679 H= 679:00 +CPU= 18.307
  16:31:00 STEP  680 H= 680:00 +CPU= 18.714
  16:31:29 STEP  681 H= 681:00 +CPU= 28.383
  16:31:48 STEP  682 H= 682:00 +CPU= 18.878
  16:32:06 STEP  683 H= 683:00 +CPU= 18.287
  16:32:37 STEP  684 H= 684:00 +CPU= 31.239
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000684
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000684
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000684
  16:32:56 STEP  685 H= 685:00 +CPU= 18.254
  16:33:14 STEP  686 H= 686:00 +CPU= 18.446
  16:33:43 STEP  687 H= 687:00 +CPU= 28.385
  16:34:02 STEP  688 H= 688:00 +CPU= 18.589
  16:34:20 STEP  689 H= 689:00 +CPU= 18.145
  16:34:49 STEP  690 H= 690:00 +CPU= 28.958
  16:35:07 STEP  691 H= 691:00 +CPU= 18.142
  16:35:26 STEP  692 H= 692:00 +CPU= 18.516
  16:35:54 STEP  693 H= 693:00 +CPU= 28.340
  16:36:13 STEP  694 H= 694:00 +CPU= 18.801
  16:36:32 STEP  695 H= 695:00 +CPU= 18.736
  16:37:06 STEP  696 H= 696:00 +CPU= 34.005
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000696
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000696
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000696
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000672
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000672
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000672
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000684
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000684
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000684
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_28.zip
Uploading the intermediate file: upload_file_28.zip
  16:37:24 STEP  697 H= 697:00 +CPU= 18.055
  16:37:44 STEP  698 H= 698:00 +CPU= 19.102
  16:38:12 STEP  699 H= 699:00 +CPU= 28.490
  16:38:31 STEP  700 H= 700:00 +CPU= 18.794
  16:38:50 STEP  701 H= 701:00 +CPU= 18.453
  16:39:19 STEP  702 H= 702:00 +CPU= 29.007
  16:39:37 STEP  703 H= 703:00 +CPU= 18.282
  16:39:56 STEP  704 H= 704:00 +CPU= 18.607
  16:40:24 STEP  705 H= 705:00 +CPU= 28.306
  16:40:43 STEP  706 H= 706:00 +CPU= 18.901
  16:41:01 STEP  707 H= 707:00 +CPU= 18.031
  16:41:33 STEP  708 H= 708:00 +CPU= 31.300
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000708
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000708
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000708
  16:41:51 STEP  709 H= 709:00 +CPU= 18.084
  16:42:10 STEP  710 H= 710:00 +CPU= 18.625
  16:42:38 STEP  711 H= 711:00 +CPU= 28.320
  16:42:57 STEP  712 H= 712:00 +CPU= 18.590
  16:43:16 STEP  713 H= 713:00 +CPU= 18.473
  16:43:45 STEP  714 H= 714:00 +CPU= 28.901
  16:44:03 STEP  715 H= 715:00 +CPU= 18.062
  16:44:21 STEP  716 H= 716:00 +CPU= 18.440
  16:44:50 STEP  717 H= 717:00 +CPU= 28.435
  16:45:09 STEP  718 H= 718:00 +CPU= 18.752
  16:45:27 STEP  719 H= 719:00 +CPU= 18.290
  16:46:01 STEP  720 H= 720:00 +CPU= 33.867
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000720
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000720
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000720
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000696
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000696
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000696
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000708
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000708
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000708
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_29.zip
Uploading the intermediate file: upload_file_29.zip
  16:46:19 STEP  721 H= 721:00 +CPU= 18.264
Uploading trickle at timestep: 2592000
  16:46:38 STEP  722 H= 722:00 +CPU= 18.664
  16:47:07 STEP  723 H= 723:00 +CPU= 28.370
  16:47:25 STEP  724 H= 724:00 +CPU= 18.474
  16:47:43 STEP  725 H= 725:00 +CPU= 17.991
  16:48:12 STEP  726 H= 726:00 +CPU= 28.835
  16:48:31 STEP  727 H= 727:00 +CPU= 18.111
  16:48:49 STEP  728 H= 728:00 +CPU= 18.317
  16:49:18 STEP  729 H= 729:00 +CPU= 28.505
  16:49:37 STEP  730 H= 730:00 +CPU= 18.988
  16:49:55 STEP  731 H= 731:00 +CPU= 17.959
  16:50:26 STEP  732 H= 732:00 +CPU= 31.437
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000732
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000732
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000732
  16:50:45 STEP  733 H= 733:00 +CPU= 18.112
  16:51:03 STEP  734 H= 734:00 +CPU= 18.662
  16:51:32 STEP  735 H= 735:00 +CPU= 28.350
  16:51:50 STEP  736 H= 736:00 +CPU= 18.350
  16:52:08 STEP  737 H= 737:00 +CPU= 17.888
  16:52:37 STEP  738 H= 738:00 +CPU= 28.733
  16:52:56 STEP  739 H= 739:00 +CPU= 18.288
  16:53:14 STEP  740 H= 740:00 +CPU= 18.272
  16:53:42 STEP  741 H= 741:00 +CPU= 28.322
  16:54:01 STEP  742 H= 742:00 +CPU= 18.562
  16:54:20 STEP  743 H= 743:00 +CPU= 18.406
  16:54:53 STEP  744 H= 744:00 +CPU= 33.694
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000744
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000744
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000744
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000720
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000720
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000720
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000732
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000732
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000732
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_30.zip
Uploading the intermediate file: upload_file_30.zip
  16:55:12 STEP  745 H= 745:00 +CPU= 18.219
  16:55:31 STEP  746 H= 746:00 +CPU= 19.400
  16:56:00 STEP  747 H= 747:00 +CPU= 28.254
  16:56:18 STEP  748 H= 748:00 +CPU= 18.569
  16:56:37 STEP  749 H= 749:00 +CPU= 18.516
  16:57:06 STEP  750 H= 750:00 +CPU= 28.868
  16:57:25 STEP  751 H= 751:00 +CPU= 18.433
  16:57:43 STEP  752 H= 752:00 +CPU= 18.340
  16:58:12 STEP  753 H= 753:00 +CPU= 28.577
  16:58:31 STEP  754 H= 754:00 +CPU= 18.731
  16:58:49 STEP  755 H= 755:00 +CPU= 17.852
  16:59:20 STEP  756 H= 756:00 +CPU= 31.213
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000756
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000756
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000756
  16:59:38 STEP  757 H= 757:00 +CPU= 18.217
  16:59:57 STEP  758 H= 758:00 +CPU= 18.384
  17:00:25 STEP  759 H= 759:00 +CPU= 28.202
  17:00:44 STEP  760 H= 760:00 +CPU= 18.503
  17:01:02 STEP  761 H= 761:00 +CPU= 17.941
  17:01:31 STEP  762 H= 762:00 +CPU= 28.919
  17:01:49 STEP  763 H= 763:00 +CPU= 18.048
  17:02:07 STEP  764 H= 764:00 +CPU= 18.336
  17:02:36 STEP  765 H= 765:00 +CPU= 28.312
  17:02:54 STEP  766 H= 766:00 +CPU= 18.622
  17:03:13 STEP  767 H= 767:00 +CPU= 18.429
  17:03:47 STEP  768 H= 768:00 +CPU= 33.815
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000768
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000768
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000768
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000744
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000744
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000744
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000756
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000756
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000756
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_31.zip
Uploading the intermediate file: upload_file_31.zip
  17:04:05 STEP  769 H= 769:00 +CPU= 18.060
  17:04:24 STEP  770 H= 770:00 +CPU= 18.709
  17:04:52 STEP  771 H= 771:00 +CPU= 28.273
  17:05:11 STEP  772 H= 772:00 +CPU= 18.494
  17:05:29 STEP  773 H= 773:00 +CPU= 17.978
  17:05:58 STEP  774 H= 774:00 +CPU= 28.707
  17:06:16 STEP  775 H= 775:00 +CPU= 18.204
  17:06:34 STEP  776 H= 776:00 +CPU= 18.268
  17:07:03 STEP  777 H= 777:00 +CPU= 28.559
  17:07:22 STEP  778 H= 778:00 +CPU= 18.801
  17:07:40 STEP  779 H= 779:00 +CPU= 17.943
  17:08:11 STEP  780 H= 780:00 +CPU= 31.211
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000780
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000780
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000780
  17:08:30 STEP  781 H= 781:00 +CPU= 18.106
  17:08:48 STEP  782 H= 782:00 +CPU= 18.508
  17:09:16 STEP  783 H= 783:00 +CPU= 28.086
  17:09:35 STEP  784 H= 784:00 +CPU= 18.403
  17:09:53 STEP  785 H= 785:00 +CPU= 17.849
  17:10:22 STEP  786 H= 786:00 +CPU= 28.718
  17:10:40 STEP  787 H= 787:00 +CPU= 18.119
  17:10:58 STEP  788 H= 788:00 +CPU= 18.320
  17:11:27 STEP  789 H= 789:00 +CPU= 28.223
  17:11:45 STEP  790 H= 790:00 +CPU= 18.493
  17:12:04 STEP  791 H= 791:00 +CPU= 18.142
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:20:01 STEP  792 H= 792:00 +CPU= 34.152
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000792
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000792
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000792
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000768
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000768
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000768
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000780
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000780
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000780
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_32.zip
Uploading the intermediate file: upload_file_32.zip
  17:20:22 STEP  793 H= 793:00 +CPU= 19.854
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:21:22 STEP  794 H= 794:00 +CPU= 20.775
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:25:23 STEP  795 H= 795:00 +CPU= 32.542
  17:25:42 STEP  796 H= 796:00 +CPU= 18.497
  17:26:00 STEP  797 H= 797:00 +CPU= 18.173
  17:26:29 STEP  798 H= 798:00 +CPU= 28.866
  17:26:47 STEP  799 H= 799:00 +CPU= 18.285
  17:27:06 STEP  800 H= 800:00 +CPU= 18.908
  17:27:35 STEP  801 H= 801:00 +CPU= 28.427
  17:27:54 STEP  802 H= 802:00 +CPU= 18.700
  17:28:12 STEP  803 H= 803:00 +CPU= 18.773
  17:28:43 STEP  804 H= 804:00 +CPU= 30.907
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000804
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000804
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000804
  17:29:02 STEP  805 H= 805:00 +CPU= 18.265
  17:29:21 STEP  806 H= 806:00 +CPU= 18.989
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:30:31 STEP  807 H= 807:00 +CPU= 28.226
  17:30:50 STEP  808 H= 808:00 +CPU= 18.597
  17:31:09 STEP  809 H= 809:00 +CPU= 18.418
  17:31:37 STEP  810 H= 810:00 +CPU= 28.771
  17:31:56 STEP  811 H= 811:00 +CPU= 18.109
  17:32:15 STEP  812 H= 812:00 +CPU= 18.954
  17:32:43 STEP  813 H= 813:00 +CPU= 28.315
  17:33:02 STEP  814 H= 814:00 +CPU= 18.683
  17:33:21 STEP  815 H= 815:00 +CPU= 18.560
  17:33:55 STEP  816 H= 816:00 +CPU= 33.834
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000816
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000816
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000816
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000792
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000792
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000792
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000804
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000804
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000804
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_33.zip
Uploading the intermediate file: upload_file_33.zip
  17:34:13 STEP  817 H= 817:00 +CPU= 18.355
  17:34:32 STEP  818 H= 818:00 +CPU= 18.750
  17:35:00 STEP  819 H= 819:00 +CPU= 28.208
  17:35:19 STEP  820 H= 820:00 +CPU= 18.791
  17:35:38 STEP  821 H= 821:00 +CPU= 18.208
  17:36:06 STEP  822 H= 822:00 +CPU= 28.671
  17:36:25 STEP  823 H= 823:00 +CPU= 18.127
  17:36:44 STEP  824 H= 824:00 +CPU= 18.843
  17:37:12 STEP  825 H= 825:00 +CPU= 28.327
  17:37:31 STEP  826 H= 826:00 +CPU= 18.699
  17:37:49 STEP  827 H= 827:00 +CPU= 18.469
  17:38:21 STEP  828 H= 828:00 +CPU= 30.983
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000828
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000828
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000828
  17:38:39 STEP  829 H= 829:00 +CPU= 18.175
  17:38:57 STEP  830 H= 830:00 +CPU= 18.400
  17:39:25 STEP  831 H= 831:00 +CPU= 27.991
  17:39:44 STEP  832 H= 832:00 +CPU= 18.650
  17:40:02 STEP  833 H= 833:00 +CPU= 18.087
  17:40:31 STEP  834 H= 834:00 +CPU= 28.584
  17:40:49 STEP  835 H= 835:00 +CPU= 18.063
  17:41:08 STEP  836 H= 836:00 +CPU= 18.673
  17:41:36 STEP  837 H= 837:00 +CPU= 27.845
  17:41:55 STEP  838 H= 838:00 +CPU= 18.416
  17:42:13 STEP  839 H= 839:00 +CPU= 18.623
  17:42:47 STEP  840 H= 840:00 +CPU= 33.379
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000840
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000840
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000840
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000816
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000816
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000816
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000828
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000828
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000828
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_34.zip
Uploading the intermediate file: upload_file_34.zip
  17:43:05 STEP  841 H= 841:00 +CPU= 18.182
  17:43:24 STEP  842 H= 842:00 +CPU= 18.680
  17:43:52 STEP  843 H= 843:00 +CPU= 28.229
  17:44:11 STEP  844 H= 844:00 +CPU= 18.677
  17:44:29 STEP  845 H= 845:00 +CPU= 17.965
  17:44:58 STEP  846 H= 846:00 +CPU= 28.616
  17:45:16 STEP  847 H= 847:00 +CPU= 18.062
  17:45:35 STEP  848 H= 848:00 +CPU= 18.516
  17:46:03 STEP  849 H= 849:00 +CPU= 28.493
  17:46:22 STEP  850 H= 850:00 +CPU= 18.842
  17:46:41 STEP  851 H= 851:00 +CPU= 18.369
  17:47:12 STEP  852 H= 852:00 +CPU= 31.153
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000852
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000852
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000852
  17:47:30 STEP  853 H= 853:00 +CPU= 18.150
  17:47:49 STEP  854 H= 854:00 +CPU= 18.746
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:00:43 STEP  855 H= 855:00 +CPU= 28.005
  18:01:02 STEP  856 H= 856:00 +CPU= 18.380
  18:01:19 STEP  857 H= 857:00 +CPU= 17.836
  18:01:47 STEP  858 H= 858:00 +CPU= 27.941
  18:02:05 STEP  859 H= 859:00 +CPU= 17.838
  18:02:24 STEP  860 H= 860:00 +CPU= 18.261
  18:02:52 STEP  861 H= 861:00 +CPU= 27.974
  18:03:10 STEP  862 H= 862:00 +CPU= 18.686
  18:03:29 STEP  863 H= 863:00 +CPU= 18.677
  18:04:02 STEP  864 H= 864:00 +CPU= 32.727
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000864
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000864
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000864
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000840
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000840
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000840
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000852
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000852
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000852
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_35.zip
Uploading the intermediate file: upload_file_35.zip
  18:04:20 STEP  865 H= 865:00 +CPU= 17.736
  18:04:38 STEP  866 H= 866:00 +CPU= 18.423
  18:05:06 STEP  867 H= 867:00 +CPU= 27.437
  18:05:24 STEP  868 H= 868:00 +CPU= 18.290
  18:05:42 STEP  869 H= 869:00 +CPU= 17.875
  18:06:10 STEP  870 H= 870:00 +CPU= 27.974
  18:06:28 STEP  871 H= 871:00 +CPU= 17.870
  18:06:46 STEP  872 H= 872:00 +CPU= 18.259
  18:07:14 STEP  873 H= 873:00 +CPU= 27.687
  18:07:33 STEP  874 H= 874:00 +CPU= 18.448
  18:07:51 STEP  875 H= 875:00 +CPU= 18.177
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:08:40 STEP  876 H= 876:00 +CPU= 30.524
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000876
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000876
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000876
  18:08:58 STEP  877 H= 877:00 +CPU= 17.704
  18:09:17 STEP  878 H= 878:00 +CPU= 18.280
  18:09:44 STEP  879 H= 879:00 +CPU= 27.331
  18:10:02 STEP  880 H= 880:00 +CPU= 18.217
  18:10:20 STEP  881 H= 881:00 +CPU= 17.572
  18:10:48 STEP  882 H= 882:00 +CPU= 28.222
  18:11:06 STEP  883 H= 883:00 +CPU= 17.867
  18:11:24 STEP  884 H= 884:00 +CPU= 18.275
  18:11:52 STEP  885 H= 885:00 +CPU= 27.403
  18:12:10 STEP  886 H= 886:00 +CPU= 18.135
  18:12:28 STEP  887 H= 887:00 +CPU= 18.158
  18:13:01 STEP  888 H= 888:00 +CPU= 32.877
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000888
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000888
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000888
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000864
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000864
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000864
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000876
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000876
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000876
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_36.zip
Uploading the intermediate file: upload_file_36.zip
  18:13:19 STEP  889 H= 889:00 +CPU= 18.002
  18:13:38 STEP  890 H= 890:00 +CPU= 18.462
  18:14:05 STEP  891 H= 891:00 +CPU= 27.486
  18:14:24 STEP  892 H= 892:00 +CPU= 18.372
  18:14:42 STEP  893 H= 893:00 +CPU= 17.961
  18:15:10 STEP  894 H= 894:00 +CPU= 27.973
  18:15:28 STEP  895 H= 895:00 +CPU= 18.007
  18:15:46 STEP  896 H= 896:00 +CPU= 18.349
  18:16:14 STEP  897 H= 897:00 +CPU= 27.265
  18:16:32 STEP  898 H= 898:00 +CPU= 18.433
  18:16:50 STEP  899 H= 899:00 +CPU= 17.887
  18:17:21 STEP  900 H= 900:00 +CPU= 30.660
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000900
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000900
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000900
  18:17:39 STEP  901 H= 901:00 +CPU= 18.256
  18:17:58 STEP  902 H= 902:00 +CPU= 18.621
  18:18:26 STEP  903 H= 903:00 +CPU= 27.572
  18:18:44 STEP  904 H= 904:00 +CPU= 18.588
  18:19:02 STEP  905 H= 905:00 +CPU= 18.095
  18:19:31 STEP  906 H= 906:00 +CPU= 28.246
  18:19:49 STEP  907 H= 907:00 +CPU= 18.203
  18:20:08 STEP  908 H= 908:00 +CPU= 18.629
  18:20:35 STEP  909 H= 909:00 +CPU= 27.184
  18:20:53 STEP  910 H= 910:00 +CPU= 18.383
  18:21:12 STEP  911 H= 911:00 +CPU= 18.296
  18:21:45 STEP  912 H= 912:00 +CPU= 33.080
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000912
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000912
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000912
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000888
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000888
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000888
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000900
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000900
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000900
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_37.zip
Uploading the intermediate file: upload_file_37.zip
  18:22:03 STEP  913 H= 913:00 +CPU= 17.744
  18:22:21 STEP  914 H= 914:00 +CPU= 18.379
  18:22:49 STEP  915 H= 915:00 +CPU= 27.398
  18:23:07 STEP  916 H= 916:00 +CPU= 18.080
  18:23:25 STEP  917 H= 917:00 +CPU= 17.835
  18:23:53 STEP  918 H= 918:00 +CPU= 27.999
  18:24:11 STEP  919 H= 919:00 +CPU= 17.837
  18:24:29 STEP  920 H= 920:00 +CPU= 18.085
  18:24:56 STEP  921 H= 921:00 +CPU= 27.446
  18:25:15 STEP  922 H= 922:00 +CPU= 18.557
  18:25:33 STEP  923 H= 923:00 +CPU= 18.175
  18:26:04 STEP  924 H= 924:00 +CPU= 30.508
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000924
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000924
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000924
  18:26:22 STEP  925 H= 925:00 +CPU= 17.903
  18:26:40 STEP  926 H= 926:00 +CPU= 18.247
  18:27:07 STEP  927 H= 927:00 +CPU= 27.404
  18:27:26 STEP  928 H= 928:00 +CPU= 18.289
  18:27:43 STEP  929 H= 929:00 +CPU= 17.773
  18:28:12 STEP  930 H= 930:00 +CPU= 28.046
  18:28:29 STEP  931 H= 931:00 +CPU= 17.831
  18:28:48 STEP  932 H= 932:00 +CPU= 18.381
  18:29:15 STEP  933 H= 933:00 +CPU= 27.287
  18:29:34 STEP  934 H= 934:00 +CPU= 18.395
  18:29:52 STEP  935 H= 935:00 +CPU= 18.575
  18:30:26 STEP  936 H= 936:00 +CPU= 33.035
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000936
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000936
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000936
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000912
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000912
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000912
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000924
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000924
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000924
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_38.zip
Uploading the intermediate file: upload_file_38.zip
  18:30:43 STEP  937 H= 937:00 +CPU= 17.792
  18:31:02 STEP  938 H= 938:00 +CPU= 18.440
  18:31:29 STEP  939 H= 939:00 +CPU= 27.466
  18:31:48 STEP  940 H= 940:00 +CPU= 18.129
  18:32:05 STEP  941 H= 941:00 +CPU= 17.605
  18:32:33 STEP  942 H= 942:00 +CPU= 28.009
  18:32:51 STEP  943 H= 943:00 +CPU= 17.627
  18:33:09 STEP  944 H= 944:00 +CPU= 18.202
  18:33:37 STEP  945 H= 945:00 +CPU= 27.304
  18:33:55 STEP  946 H= 946:00 +CPU= 18.515
  18:34:13 STEP  947 H= 947:00 +CPU= 18.131
  18:34:44 STEP  948 H= 948:00 +CPU= 30.541
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000948
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000948
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000948
  18:35:02 STEP  949 H= 949:00 +CPU= 17.873
  18:35:20 STEP  950 H= 950:00 +CPU= 18.337
  18:35:48 STEP  951 H= 951:00 +CPU= 27.286
  18:36:06 STEP  952 H= 952:00 +CPU= 18.223
  18:36:24 STEP  953 H= 953:00 +CPU= 17.780
  18:36:52 STEP  954 H= 954:00 +CPU= 27.962
  18:37:10 STEP  955 H= 955:00 +CPU= 17.699
  18:37:28 STEP  956 H= 956:00 +CPU= 18.162
  18:37:55 STEP  957 H= 957:00 +CPU= 27.116
  18:38:13 STEP  958 H= 958:00 +CPU= 18.350
  18:38:32 STEP  959 H= 959:00 +CPU= 18.207
  18:39:04 STEP  960 H= 960:00 +CPU= 32.687
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000960
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000960
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000960
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000936
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000936
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000936
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000948
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000948
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000948
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_39.zip
Uploading the intermediate file: upload_file_39.zip
  18:39:22 STEP  961 H= 961:00 +CPU= 17.480
Uploading trickle at timestep: 3456000
  18:39:40 STEP  962 H= 962:00 +CPU= 18.273
  18:40:07 STEP  963 H= 963:00 +CPU= 27.133
  18:40:26 STEP  964 H= 964:00 +CPU= 18.048
  18:40:43 STEP  965 H= 965:00 +CPU= 17.499
  18:41:11 STEP  966 H= 966:00 +CPU= 27.648
  18:41:28 STEP  967 H= 967:00 +CPU= 17.479
  18:41:46 STEP  968 H= 968:00 +CPU= 18.011
  18:42:17 STEP  969 H= 969:00 +CPU= 30.974
  18:42:40 STEP  970 H= 970:00 +CPU= 22.163
  18:43:03 STEP  971 H= 971:00 +CPU= 23.083
  18:43:41 STEP  972 H= 972:00 +CPU= 38.402
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000972
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000972
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000972
  18:44:04 STEP  973 H= 973:00 +CPU= 22.005
  18:44:27 STEP  974 H= 974:00 +CPU= 23.363
  18:45:01 STEP  975 H= 975:00 +CPU= 33.826
  18:45:24 STEP  976 H= 976:00 +CPU= 22.732
  18:45:47 STEP  977 H= 977:00 +CPU= 22.670
  18:46:22 STEP  978 H= 978:00 +CPU= 34.871
  18:46:44 STEP  979 H= 979:00 +CPU= 22.044
  18:47:07 STEP  980 H= 980:00 +CPU= 23.095
  18:47:41 STEP  981 H= 981:00 +CPU= 34.085
  18:48:03 STEP  982 H= 982:00 +CPU= 22.282
  18:48:27 STEP  983 H= 983:00 +CPU= 23.123
  18:49:07 STEP  984 H= 984:00 +CPU= 40.731
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000984
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000984
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000984
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000960
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000960
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000960
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000972
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000972
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000972
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_40.zip
Uploading the intermediate file: upload_file_40.zip
  18:49:30 STEP  985 H= 985:00 +CPU= 22.631
  18:49:54 STEP  986 H= 986:00 +CPU= 23.296
  18:50:27 STEP  987 H= 987:00 +CPU= 33.672
  18:50:51 STEP  988 H= 988:00 +CPU= 23.494
  18:51:15 STEP  989 H= 989:00 +CPU= 23.597
  18:51:49 STEP  990 H= 990:00 +CPU= 34.163
  18:52:12 STEP  991 H= 991:00 +CPU= 23.048
  18:52:35 STEP  992 H= 992:00 +CPU= 22.883
  18:53:09 STEP  993 H= 993:00 +CPU= 33.587
  18:53:32 STEP  994 H= 994:00 +CPU= 22.803
  18:53:55 STEP  995 H= 995:00 +CPU= 22.875
  18:54:32 STEP  996 H= 996:00 +CPU= 37.470
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+000996
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+000996
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+000996
  18:54:54 STEP  997 H= 997:00 +CPU= 21.804
  18:55:17 STEP  998 H= 998:00 +CPU= 22.932
  18:55:50 STEP  999 H= 999:00 +CPU= 33.093
  18:56:13 STEP 1000 H=1000:00 +CPU= 22.328
  18:56:35 STEP 1001 H=1001:00 +CPU= 22.094
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:57:31 STEP 1002 H=1002:00 +CPU= 35.729
  18:57:53 STEP 1003 H=1003:00 +CPU= 22.421
  18:58:17 STEP 1004 H=1004:00 +CPU= 23.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:11:28 STEP 1005 H=1005:00 +CPU= 33.612
  19:11:50 STEP 1006 H=1006:00 +CPU= 22.764
  19:12:14 STEP 1007 H=1007:00 +CPU= 23.271
  19:12:54 STEP 1008 H=1008:00 +CPU= 40.212
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+001008
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+001008
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+001008
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000984
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000984
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000984
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+000996
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+000996
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+000996
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_41.zip
Uploading the intermediate file: upload_file_41.zip
  19:13:17 STEP 1009 H=1009:00 +CPU= 22.416
  19:13:40 STEP 1010 H=1010:00 +CPU= 23.243
  19:14:14 STEP 1011 H=1011:00 +CPU= 34.163
  19:14:38 STEP 1012 H=1012:00 +CPU= 23.788
  19:15:01 STEP 1013 H=1013:00 +CPU= 22.222
  19:15:35 STEP 1014 H=1014:00 +CPU= 33.885
  19:15:57 STEP 1015 H=1015:00 +CPU= 22.230
  19:16:20 STEP 1016 H=1016:00 +CPU= 23.020
  19:16:54 STEP 1017 H=1017:00 +CPU= 33.951
  19:17:17 STEP 1018 H=1018:00 +CPU= 22.914
  19:17:40 STEP 1019 H=1019:00 +CPU= 22.854
  19:18:18 STEP 1020 H=1020:00 +CPU= 37.619
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+001020
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+001020
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+001020
  19:18:40 STEP 1021 H=1021:00 +CPU= 21.840
  19:19:03 STEP 1022 H=1022:00 +CPU= 23.109
  19:19:37 STEP 1023 H=1023:00 +CPU= 33.246
  19:19:59 STEP 1024 H=1024:00 +CPU= 22.276
  19:20:21 STEP 1025 H=1025:00 +CPU= 22.538
  19:20:56 STEP 1026 H=1026:00 +CPU= 34.322
  19:21:18 STEP 1027 H=1027:00 +CPU= 22.008
  19:21:41 STEP 1028 H=1028:00 +CPU= 22.931
  19:22:15 STEP 1029 H=1029:00 +CPU= 33.987
  19:22:37 STEP 1030 H=1030:00 +CPU= 22.000
  19:23:01 STEP 1031 H=1031:00 +CPU= 23.218
  19:23:41 STEP 1032 H=1032:00 +CPU= 40.085
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+001032
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+001032
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+001032
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+001008
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+001008
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+001008
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+001020
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+001020
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+001020
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_42.zip
Uploading the intermediate file: upload_file_42.zip
  19:24:04 STEP 1033 H=1033:00 +CPU= 22.805
  19:24:27 STEP 1034 H=1034:00 +CPU= 23.070
  19:25:01 STEP 1035 H=1035:00 +CPU= 34.134
  19:25:26 STEP 1036 H=1036:00 +CPU= 24.360
  19:25:48 STEP 1037 H=1037:00 +CPU= 22.619
  19:26:22 STEP 1038 H=1038:00 +CPU= 33.655
  19:26:45 STEP 1039 H=1039:00 +CPU= 22.504
  19:27:08 STEP 1040 H=1040:00 +CPU= 23.458
  19:27:42 STEP 1041 H=1041:00 +CPU= 34.031
  19:28:05 STEP 1042 H=1042:00 +CPU= 22.507
  19:28:28 STEP 1043 H=1043:00 +CPU= 22.973
  19:29:06 STEP 1044 H=1044:00 +CPU= 37.474
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+001044
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+001044
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+001044
  19:29:28 STEP 1045 H=1045:00 +CPU= 22.251
  19:29:52 STEP 1046 H=1046:00 +CPU= 23.800
  19:30:26 STEP 1047 H=1047:00 +CPU= 34.069
  19:30:50 STEP 1048 H=1048:00 +CPU= 23.432
  19:31:12 STEP 1049 H=1049:00 +CPU= 22.435
  19:31:47 STEP 1050 H=1050:00 +CPU= 34.785
  19:32:10 STEP 1051 H=1051:00 +CPU= 22.466
  19:32:34 STEP 1052 H=1052:00 +CPU= 23.805
  19:33:07 STEP 1053 H=1053:00 +CPU= 33.603
  19:33:31 STEP 1054 H=1054:00 +CPU= 23.414
  19:33:55 STEP 1055 H=1055:00 +CPU= 24.030
  19:34:35 STEP 1056 H=1056:00 +CPU= 40.124
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+001056
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+001056
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+001056
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+001032
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+001032
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+001032
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMGGhq0f+001044
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMSHhq0f+001044
Adding to the zip: /home/pat/projects/climateprediction.net/oifs_43r3_ps_12185999/ICMUAhq0f+001044
Zipping up the intermediate file: /home/pat/projects/climateprediction.net/oifs_43r3_ps_0355_2000050100_123_969_12185999_1_r57006018_43.zip
Uploading the intermediate file: upload_file_43.zip
  19:34:59 STEP 1057 H=1057:00 +CPU= 23.387
  19:35:22 STEP 1058 H=1058:00 +CPU= 23.290
  19:35:56 STEP 1059 H=1059:00 +CPU= 33.871
  19:36:20 STEP 1060 H=1060:00 +CPU= 23.264
  19:36:42 STEP 1061 H=1061:00 +CPU= 22.733
  19:37:17 STEP 1062 H=1062:00 +CPU= 34.232
  19:37:39 STEP 1063 H=1063:00 +CPU= 22.475
  19:38:02 STEP 1064 H=1064:00 +CPU= 23.072
  19:38:37 STEP 1065 H=1065:00 +CPU= 34.130
  19:39:00 STEP 1066 H=1066:00 +CPU= 22.943
  19:39:23 STEP 1067 H=1067:00 +CPU= 23.528
  19:40:01 STEP 1068 H=1068:00 +CPU= 37.165
Moving to projects directory: /home/pat/slots/1/ICMGGhq0f+001068
Moving to projects directory: /home/pat/slots/1/ICMSHhq0f+001068
Moving to projects directory: /home/pat/slots/1/ICMUAhq0f+001068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:41:24 STEP 1069 H=1069:00 +CPU= 21.991
  19:41:48 STEP 1070 H=1070:00 +CPU= 23.787
  19:42:22 STEP 1071 H=1071:00 +CPU= 34.101
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:46:16 STEP 1072 H=1072:00 +CPU= 29.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:58:33 STEP 1073 H=1073:00 +CPU= 32.637
  19:59:23 STEP 1074 H=1074:00 +CPU= 49.775
  19:59:54 STEP 1075 H=1075:00 +CPU= 28.087
  20:00:26 STEP 1076 H=1076:00 +CPU= 30.232
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:45:03 1538423 22304469 oifs_43r3_ps_0355_2000050100_123_969_12185999_1 3,456,000 22,799 0.0066
09 May 2023 16:45:01 1538423 22304469 oifs_43r3_ps_0355_2000050100_123_969_12185999_1 2,592,000 17,536 0.0068
09 May 2023 16:44:59 1538423 22304469 oifs_43r3_ps_0355_2000050100_123_969_12185999_1 1,728,000 12,236 0.0071
09 May 2023 16:44:56 1538423 22304469 oifs_43r3_ps_0355_2000050100_123_969_12185999_1 864,000 6,490 0.0075


©2024 climateprediction.net