climateprediction.net home page
Task 22448767

Task 22448767

Name oifs_43r3_bl_a1sc_2016092300_20_1018_12290643_2
Workunit 12290643
Created 14 Jun 2024, 8:40:25 UTC
Sent 14 Jun 2024, 8:42:00 UTC
Report deadline 13 Aug 2024, 8:42:00 UTC
Received 16 Jun 2024, 14:25:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1537118
Run time 2 hours 56 min 25 sec
CPU time 2 hours 55 min 15 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 9.87 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,497.31 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,286.99 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
lots/0/ICMUAh7zg+000444
  05:45:30 STEP  445 H= 111:15 +CPU= 11.755
  05:45:42 STEP  446 H= 111:30 +CPU= 12.028
  05:45:55 STEP  447 H= 111:45 +CPU= 12.583
  05:46:07 STEP  448 H= 112:00 +CPU= 12.207
  05:46:19 STEP  449 H= 112:15 +CPU= 11.766
  05:46:31 STEP  450 H= 112:30 +CPU= 12.292
  05:46:43 STEP  451 H= 112:45 +CPU= 11.926
  05:46:56 STEP  452 H= 113:00 +CPU= 12.410
  05:47:07 STEP  453 H= 113:15 +CPU= 11.713
  05:47:19 STEP  454 H= 113:30 +CPU= 11.484
  05:47:31 STEP  455 H= 113:45 +CPU= 12.263
  05:47:46 STEP  456 H= 114:00 +CPU= 14.954
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000456
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000456
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000456
  05:47:58 STEP  457 H= 114:15 +CPU= 11.532
  05:48:10 STEP  458 H= 114:30 +CPU= 12.009
  05:48:21 STEP  459 H= 114:45 +CPU= 11.722
  05:48:33 STEP  460 H= 115:00 +CPU= 12.150
  05:48:45 STEP  461 H= 115:15 +CPU= 11.767
  05:48:57 STEP  462 H= 115:30 +CPU= 11.449
  05:49:09 STEP  463 H= 115:45 +CPU= 11.881
  05:49:21 STEP  464 H= 116:00 +CPU= 12.029
  05:49:32 STEP  465 H= 116:15 +CPU= 11.740
  05:49:44 STEP  466 H= 116:30 +CPU= 11.338
  05:49:55 STEP  467 H= 116:45 +CPU= 11.377
  05:50:10 STEP  468 H= 117:00 +CPU= 15.235
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000468
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000468
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000468
  05:50:22 STEP  469 H= 117:15 +CPU= 11.603
  05:50:34 STEP  470 H= 117:30 +CPU= 12.069
  05:50:46 STEP  471 H= 117:45 +CPU= 11.573
  05:50:57 STEP  472 H= 118:00 +CPU= 11.759
  05:51:09 STEP  473 H= 118:15 +CPU= 11.284
  05:51:21 STEP  474 H= 118:30 +CPU= 12.243
  05:51:32 STEP  475 H= 118:45 +CPU= 11.374
  05:51:44 STEP  476 H= 119:00 +CPU= 11.626
  05:51:55 STEP  477 H= 119:15 +CPU= 11.401
  05:52:07 STEP  478 H= 119:30 +CPU= 11.546
  05:52:18 STEP  479 H= 119:45 +CPU= 11.526
  05:52:34 STEP  480 H= 120:00 +CPU= 15.865
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000480
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000480
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1sc_2016092300_20_1018_12290643_2_r1412778992_4.zip
  05:52:46 STEP  481 H= 120:15 +CPU= 11.565
Uploading the intermediate file: upload_file_4.zip
  05:52:58 STEP  482 H= 120:30 +CPU= 11.863
  05:53:09 STEP  483 H= 120:45 +CPU= 11.403
  05:53:21 STEP  484 H= 121:00 +CPU= 11.746
  05:53:33 STEP  485 H= 121:15 +CPU= 11.873
  05:53:45 STEP  486 H= 121:30 +CPU= 11.786
  05:53:57 STEP  487 H= 121:45 +CPU= 12.345
  05:54:09 STEP  488 H= 122:00 +CPU= 11.996
  05:54:21 STEP  489 H= 122:15 +CPU= 11.973
  05:54:33 STEP  490 H= 122:30 +CPU= 12.210
  05:54:46 STEP  491 H= 122:45 +CPU= 12.781
  05:55:01 STEP  492 H= 123:00 +CPU= 14.743
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000492
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000492
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000492
  05:55:13 STEP  493 H= 123:15 +CPU= 12.275
  05:55:25 STEP  494 H= 123:30 +CPU= 12.485
  05:55:38 STEP  495 H= 123:45 +CPU= 12.145
  05:55:50 STEP  496 H= 124:00 +CPU= 12.717
  05:56:02 STEP  497 H= 124:15 +CPU= 12.183
  05:56:15 STEP  498 H= 124:30 +CPU= 12.040
  05:56:27 STEP  499 H= 124:45 +CPU= 12.053
  05:56:39 STEP  500 H= 125:00 +CPU= 12.414
  05:56:51 STEP  501 H= 125:15 +CPU= 12.174
  05:57:04 STEP  502 H= 125:30 +CPU= 12.296
  05:57:16 STEP  503 H= 125:45 +CPU= 12.556
  05:57:33 STEP  504 H= 126:00 +CPU= 16.636
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000504
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000504
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000504
  05:57:45 STEP  505 H= 126:15 +CPU= 12.257
  05:57:58 STEP  506 H= 126:30 +CPU= 12.749
  05:58:10 STEP  507 H= 126:45 +CPU= 12.049
  05:58:22 STEP  508 H= 127:00 +CPU= 12.639
  05:58:35 STEP  509 H= 127:15 +CPU= 12.485
  05:58:48 STEP  510 H= 127:30 +CPU= 13.160
  05:59:01 STEP  511 H= 127:45 +CPU= 12.355
  05:59:13 STEP  512 H= 128:00 +CPU= 12.451
  05:59:25 STEP  513 H= 128:15 +CPU= 12.115
  05:59:37 STEP  514 H= 128:30 +CPU= 11.965
  05:59:49 STEP  515 H= 128:45 +CPU= 11.786
  06:00:04 STEP  516 H= 129:00 +CPU= 14.791
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000516
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000516
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000516
  06:00:16 STEP  517 H= 129:15 +CPU= 11.938
  06:00:28 STEP  518 H= 129:30 +CPU= 12.008
  06:00:40 STEP  519 H= 129:45 +CPU= 12.284
  06:00:52 STEP  520 H= 130:00 +CPU= 12.467
  06:01:04 STEP  521 H= 130:15 +CPU= 11.677
  06:01:15 STEP  522 H= 130:30 +CPU= 11.421
  06:01:27 STEP  523 H= 130:45 +CPU= 11.955
  06:01:40 STEP  524 H= 131:00 +CPU= 12.509
  06:01:52 STEP  525 H= 131:15 +CPU= 11.639
  06:02:03 STEP  526 H= 131:30 +CPU= 11.681
  06:02:15 STEP  527 H= 131:45 +CPU= 11.394
  06:02:31 STEP  528 H= 132:00 +CPU= 16.241
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000528
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000528
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000528
  06:02:42 STEP  529 H= 132:15 +CPU= 11.359
  06:02:54 STEP  530 H= 132:30 +CPU= 11.500
  06:03:06 STEP  531 H= 132:45 +CPU= 11.929
  06:03:18 STEP  532 H= 133:00 +CPU= 11.941
  06:03:29 STEP  533 H= 133:15 +CPU= 11.537
  06:03:41 STEP  534 H= 133:30 +CPU= 11.326
  06:03:52 STEP  535 H= 133:45 +CPU= 11.513
  06:04:04 STEP  536 H= 134:00 +CPU= 12.124
  06:04:16 STEP  537 H= 134:15 +CPU= 11.459
  06:04:28 STEP  538 H= 134:30 +CPU= 12.390
  06:04:40 STEP  539 H= 134:45 +CPU= 11.648
  06:04:54 STEP  540 H= 135:00 +CPU= 14.306
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000540
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000540
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000540
  06:05:06 STEP  541 H= 135:15 +CPU= 11.764
  06:05:18 STEP  542 H= 135:30 +CPU= 11.755
  06:05:31 STEP  543 H= 135:45 +CPU= 12.907
  06:05:42 STEP  544 H= 136:00 +CPU= 11.963
  06:05:54 STEP  545 H= 136:15 +CPU= 11.922
  06:06:06 STEP  546 H= 136:30 +CPU= 11.545
  06:06:19 STEP  547 H= 136:45 +CPU= 12.975
  06:06:32 STEP  548 H= 137:00 +CPU= 12.632
  06:06:45 STEP  549 H= 137:15 +CPU= 13.095
  06:06:57 STEP  550 H= 137:30 +CPU= 12.408
  06:07:09 STEP  551 H= 137:45 +CPU= 12.031
  06:07:25 STEP  552 H= 138:00 +CPU= 15.670
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000552
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000552
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000552
  06:07:37 STEP  553 H= 138:15 +CPU= 11.771
  06:07:49 STEP  554 H= 138:30 +CPU= 12.482
  06:08:01 STEP  555 H= 138:45 +CPU= 12.070
  06:08:14 STEP  556 H= 139:00 +CPU= 12.529
  06:08:26 STEP  557 H= 139:15 +CPU= 12.070
  06:08:38 STEP  558 H= 139:30 +CPU= 12.278
  06:08:50 STEP  559 H= 139:45 +CPU= 12.313
  06:09:03 STEP  560 H= 140:00 +CPU= 12.461
  06:09:15 STEP  561 H= 140:15 +CPU= 11.917
  06:09:27 STEP  562 H= 140:30 +CPU= 11.836
  06:09:38 STEP  563 H= 140:45 +CPU= 11.808
  06:09:53 STEP  564 H= 141:00 +CPU= 15.106
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000564
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000564
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000564
  06:10:06 STEP  565 H= 141:15 +CPU= 12.259
  06:10:18 STEP  566 H= 141:30 +CPU= 11.898
  06:10:30 STEP  567 H= 141:45 +CPU= 12.064
  06:10:42 STEP  568 H= 142:00 +CPU= 12.598
  06:10:54 STEP  569 H= 142:15 +CPU= 12.208
  06:11:07 STEP  570 H= 142:30 +CPU= 12.095
  06:11:19 STEP  571 H= 142:45 +CPU= 12.091
  06:11:31 STEP  572 H= 143:00 +CPU= 12.126
  06:11:43 STEP  573 H= 143:15 +CPU= 12.156
  06:11:55 STEP  574 H= 143:30 +CPU= 11.844
  06:12:07 STEP  575 H= 143:45 +CPU= 12.324
  06:12:25 STEP  576 H= 144:00 +CPU= 16.932
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000576
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000576
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1sc_2016092300_20_1018_12290643_2_r1412778992_5.zip
  06:12:37 STEP  577 H= 144:15 +CPU= 12.234
Uploading the intermediate file: upload_file_5.zip
  06:12:49 STEP  578 H= 144:30 +CPU= 11.311
  06:13:00 STEP  579 H= 144:45 +CPU= 11.553
  06:13:11 STEP  580 H= 145:00 +CPU= 11.127
  06:13:22 STEP  581 H= 145:15 +CPU= 11.080
  06:13:34 STEP  582 H= 145:30 +CPU= 11.188
  06:13:45 STEP  583 H= 145:45 +CPU= 10.885
  06:13:56 STEP  584 H= 146:00 +CPU= 11.395
  06:14:07 STEP  585 H= 146:15 +CPU= 11.162
  06:14:18 STEP  586 H= 146:30 +CPU= 10.816
  06:14:29 STEP  587 H= 146:45 +CPU= 11.157
  06:14:43 STEP  588 H= 147:00 +CPU= 13.990
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000588
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000588
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000588
  06:14:54 STEP  589 H= 147:15 +CPU= 10.758
  06:15:05 STEP  590 H= 147:30 +CPU= 10.865
  06:15:16 STEP  591 H= 147:45 +CPU= 11.064
  06:15:28 STEP  592 H= 148:00 +CPU= 11.860
  06:15:39 STEP  593 H= 148:15 +CPU= 11.075
  06:15:50 STEP  594 H= 148:30 +CPU= 10.961
  06:16:01 STEP  595 H= 148:45 +CPU= 11.174
  06:16:12 STEP  596 H= 149:00 +CPU= 11.575
  06:16:24 STEP  597 H= 149:15 +CPU= 11.806
  06:16:36 STEP  598 H= 149:30 +CPU= 11.749
  06:16:48 STEP  599 H= 149:45 +CPU= 11.736
  06:17:02 STEP  600 H= 150:00 +CPU= 14.771
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000600
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000600
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000600
  06:17:14 STEP  601 H= 150:15 +CPU= 11.879
  06:17:26 STEP  602 H= 150:30 +CPU= 11.902
  06:17:39 STEP  603 H= 150:45 +CPU= 12.251
  06:17:51 STEP  604 H= 151:00 +CPU= 12.279
  06:18:03 STEP  605 H= 151:15 +CPU= 12.261
  06:18:15 STEP  606 H= 151:30 +CPU= 12.109
  06:18:27 STEP  607 H= 151:45 +CPU= 12.072
  06:18:40 STEP  608 H= 152:00 +CPU= 12.864
  06:18:53 STEP  609 H= 152:15 +CPU= 12.897
  06:19:05 STEP  610 H= 152:30 +CPU= 11.618
  06:19:17 STEP  611 H= 152:45 +CPU= 12.150
  06:19:32 STEP  612 H= 153:00 +CPU= 14.750
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000612
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000612
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000612
  06:19:44 STEP  613 H= 153:15 +CPU= 12.864
  06:19:57 STEP  614 H= 153:30 +CPU= 12.667
  06:20:09 STEP  615 H= 153:45 +CPU= 12.168
  06:20:22 STEP  616 H= 154:00 +CPU= 12.785
  06:20:34 STEP  617 H= 154:15 +CPU= 12.206
  06:20:46 STEP  618 H= 154:30 +CPU= 12.051
  06:20:59 STEP  619 H= 154:45 +CPU= 12.684
  06:21:12 STEP  620 H= 155:00 +CPU= 13.149
  06:21:26 STEP  621 H= 155:15 +CPU= 13.553
  06:21:38 STEP  622 H= 155:30 +CPU= 12.280
  06:21:50 STEP  623 H= 155:45 +CPU= 12.253
  06:22:07 STEP  624 H= 156:00 +CPU= 17.048
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000624
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000624
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000624
  06:22:20 STEP  625 H= 156:15 +CPU= 12.202
  06:22:32 STEP  626 H= 156:30 +CPU= 12.142
  06:22:44 STEP  627 H= 156:45 +CPU= 12.094
  06:22:57 STEP  628 H= 157:00 +CPU= 12.700
  06:23:09 STEP  629 H= 157:15 +CPU= 12.113
  06:23:21 STEP  630 H= 157:30 +CPU= 11.957
  06:23:33 STEP  631 H= 157:45 +CPU= 12.186
  06:23:45 STEP  632 H= 158:00 +CPU= 12.507
  06:23:58 STEP  633 H= 158:15 +CPU= 12.363
  06:24:10 STEP  634 H= 158:30 +CPU= 12.799
  06:24:23 STEP  635 H= 158:45 +CPU= 12.152
  06:24:38 STEP  636 H= 159:00 +CPU= 15.073
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000636
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000636
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000636
  06:24:50 STEP  637 H= 159:15 +CPU= 12.126
  06:25:02 STEP  638 H= 159:30 +CPU= 12.259
  06:25:14 STEP  639 H= 159:45 +CPU= 11.997
  06:25:27 STEP  640 H= 160:00 +CPU= 12.749
  06:25:39 STEP  641 H= 160:15 +CPU= 12.252
  06:25:51 STEP  642 H= 160:30 +CPU= 11.728
  06:26:03 STEP  643 H= 160:45 +CPU= 11.921
  06:26:15 STEP  644 H= 161:00 +CPU= 12.048
  06:26:26 STEP  645 H= 161:15 +CPU= 11.500
  06:26:38 STEP  646 H= 161:30 +CPU= 11.522
  06:26:50 STEP  647 H= 161:45 +CPU= 11.801
  06:27:05 STEP  648 H= 162:00 +CPU= 15.337
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000648
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000648
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000648
  06:27:17 STEP  649 H= 162:15 +CPU= 12.283
  06:27:29 STEP  650 H= 162:30 +CPU= 11.620
  06:27:42 STEP  651 H= 162:45 +CPU= 12.710
  06:27:54 STEP  652 H= 163:00 +CPU= 12.010
  06:28:05 STEP  653 H= 163:15 +CPU= 11.428
  06:28:18 STEP  654 H= 163:30 +CPU= 13.328
  06:28:31 STEP  655 H= 163:45 +CPU= 12.119
  06:28:43 STEP  656 H= 164:00 +CPU= 12.445
  06:28:55 STEP  657 H= 164:15 +CPU= 11.691
  06:29:07 STEP  658 H= 164:30 +CPU= 12.072
  06:29:19 STEP  659 H= 164:45 +CPU= 12.643
  06:29:35 STEP  660 H= 165:00 +CPU= 15.071
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000660
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000660
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000660
  06:29:46 STEP  661 H= 165:15 +CPU= 11.598
  06:29:58 STEP  662 H= 165:30 +CPU= 12.250
  06:30:11 STEP  663 H= 165:45 +CPU= 12.552
  06:30:23 STEP  664 H= 166:00 +CPU= 12.144
  06:30:35 STEP  665 H= 166:15 +CPU= 11.834
  06:30:47 STEP  666 H= 166:30 +CPU= 12.215
  06:30:59 STEP  667 H= 166:45 +CPU= 12.102
  06:31:12 STEP  668 H= 167:00 +CPU= 12.422
  06:31:24 STEP  669 H= 167:15 +CPU= 12.066
  06:31:38 STEP  670 H= 167:30 +CPU= 13.710
  06:31:50 STEP  671 H= 167:45 +CPU= 12.029
  06:32:07 STEP  672 H= 168:00 +CPU= 17.474
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000672
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000672
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1sc_2016092300_20_1018_12290643_2_r1412778992_6.zip
Uploading the intermediate file: upload_file_6.zip
  06:32:19 STEP  673 H= 168:15 +CPU= 12.120
  06:32:31 STEP  674 H= 168:30 +CPU= 11.724
  06:32:43 STEP  675 H= 168:45 +CPU= 12.068
  06:32:55 STEP  676 H= 169:00 +CPU= 12.338
  06:33:08 STEP  677 H= 169:15 +CPU= 12.469
  06:33:20 STEP  678 H= 169:30 +CPU= 12.073
  06:33:32 STEP  679 H= 169:45 +CPU= 12.392
  06:33:45 STEP  680 H= 170:00 +CPU= 12.468
  06:33:57 STEP  681 H= 170:15 +CPU= 12.048
  06:34:09 STEP  682 H= 170:30 +CPU= 12.204
  06:34:21 STEP  683 H= 170:45 +CPU= 12.106
  06:34:36 STEP  684 H= 171:00 +CPU= 15.279
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000684
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000684
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000684
  06:34:49 STEP  685 H= 171:15 +CPU= 12.157
  06:35:01 STEP  686 H= 171:30 +CPU= 12.089
  06:35:13 STEP  687 H= 171:45 +CPU= 12.039
  06:35:25 STEP  688 H= 172:00 +CPU= 12.560
  06:35:37 STEP  689 H= 172:15 +CPU= 12.096
  06:35:49 STEP  690 H= 172:30 +CPU= 11.900
  06:36:07 STEP  691 H= 172:45 +CPU= 17.178
  06:36:21 STEP  692 H= 173:00 +CPU= 14.543
  06:36:33 STEP  693 H= 173:15 +CPU= 11.850
  06:36:45 STEP  694 H= 173:30 +CPU= 11.799
  06:36:56 STEP  695 H= 173:45 +CPU= 11.671
  06:37:11 STEP  696 H= 174:00 +CPU= 14.909
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000696
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000696
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000696
  06:37:24 STEP  697 H= 174:15 +CPU= 12.163
  06:37:36 STEP  698 H= 174:30 +CPU= 12.033
  06:37:48 STEP  699 H= 174:45 +CPU= 12.377
  06:38:00 STEP  700 H= 175:00 +CPU= 12.144
  06:38:12 STEP  701 H= 175:15 +CPU= 11.887
  06:38:24 STEP  702 H= 175:30 +CPU= 11.941
  06:38:36 STEP  703 H= 175:45 +CPU= 11.909
  06:38:48 STEP  704 H= 176:00 +CPU= 12.044
  06:39:01 STEP  705 H= 176:15 +CPU= 12.603
  06:39:13 STEP  706 H= 176:30 +CPU= 12.454
  06:39:26 STEP  707 H= 176:45 +CPU= 12.929
  06:39:42 STEP  708 H= 177:00 +CPU= 16.389
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000708
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000708
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000708
  06:39:54 STEP  709 H= 177:15 +CPU= 12.007
  06:40:07 STEP  710 H= 177:30 +CPU= 12.130
  06:40:19 STEP  711 H= 177:45 +CPU= 12.334
  06:40:32 STEP  712 H= 178:00 +CPU= 12.684
  06:40:43 STEP  713 H= 178:15 +CPU= 11.678
  06:40:55 STEP  714 H= 178:30 +CPU= 12.025
  06:41:08 STEP  715 H= 178:45 +CPU= 12.522
  06:41:21 STEP  716 H= 179:00 +CPU= 13.017
  06:41:33 STEP  717 H= 179:15 +CPU= 12.502
  06:41:45 STEP  718 H= 179:30 +CPU= 11.915
  06:41:57 STEP  719 H= 179:45 +CPU= 12.103
  06:42:16 STEP  720 H= 180:00 +CPU= 18.262
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000720
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000720
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000720
  06:42:28 STEP  721 H= 180:15 +CPU= 12.619
  06:42:41 STEP  722 H= 180:30 +CPU= 12.232
  06:42:53 STEP  723 H= 180:45 +CPU= 12.307
  06:43:06 STEP  724 H= 181:00 +CPU= 12.747
  06:43:18 STEP  725 H= 181:15 +CPU= 12.170
  06:43:30 STEP  726 H= 181:30 +CPU= 12.186
  06:43:42 STEP  727 H= 181:45 +CPU= 12.180
  06:43:55 STEP  728 H= 182:00 +CPU= 12.614
  06:44:07 STEP  729 H= 182:15 +CPU= 12.228
  06:44:20 STEP  730 H= 182:30 +CPU= 12.513
  06:44:32 STEP  731 H= 182:45 +CPU= 12.652
  06:44:48 STEP  732 H= 183:00 +CPU= 15.584
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000732
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000732
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000732
  06:45:00 STEP  733 H= 183:15 +CPU= 11.657
  06:45:11 STEP  734 H= 183:30 +CPU= 11.736
  06:45:23 STEP  735 H= 183:45 +CPU= 11.953
  06:45:35 STEP  736 H= 184:00 +CPU= 12.018
  06:45:47 STEP  737 H= 184:15 +CPU= 11.469
  06:45:59 STEP  738 H= 184:30 +CPU= 11.803
  06:46:11 STEP  739 H= 184:45 +CPU= 12.089
  06:46:23 STEP  740 H= 185:00 +CPU= 12.269
  06:46:35 STEP  741 H= 185:15 +CPU= 11.611
  06:46:47 STEP  742 H= 185:30 +CPU= 12.021
  06:46:58 STEP  743 H= 185:45 +CPU= 11.660
  06:47:14 STEP  744 H= 186:00 +CPU= 15.369
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000744
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000744
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000744
  06:47:26 STEP  745 H= 186:15 +CPU= 12.134
  06:47:38 STEP  746 H= 186:30 +CPU= 11.858
  06:47:50 STEP  747 H= 186:45 +CPU= 12.209
  06:48:02 STEP  748 H= 187:00 +CPU= 12.455
  06:48:14 STEP  749 H= 187:15 +CPU= 11.880
  06:48:26 STEP  750 H= 187:30 +CPU= 12.040
  06:48:38 STEP  751 H= 187:45 +CPU= 12.074
  06:48:51 STEP  752 H= 188:00 +CPU= 12.322
  06:49:02 STEP  753 H= 188:15 +CPU= 11.777
  06:49:14 STEP  754 H= 188:30 +CPU= 11.730
  06:49:26 STEP  755 H= 188:45 +CPU= 12.159
  06:49:41 STEP  756 H= 189:00 +CPU= 14.875
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000756
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000756
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000756
  06:49:53 STEP  757 H= 189:15 +CPU= 12.045
  06:50:05 STEP  758 H= 189:30 +CPU= 12.053
  06:50:17 STEP  759 H= 189:45 +CPU= 12.074
  06:50:30 STEP  760 H= 190:00 +CPU= 12.462
  06:50:42 STEP  761 H= 190:15 +CPU= 12.221
  06:50:54 STEP  762 H= 190:30 +CPU= 12.084
  06:51:08 STEP  763 H= 190:45 +CPU= 13.296
  06:51:20 STEP  764 H= 191:00 +CPU= 12.327
  06:51:32 STEP  765 H= 191:15 +CPU= 12.386
  06:51:45 STEP  766 H= 191:30 +CPU= 12.557
  06:51:57 STEP  767 H= 191:45 +CPU= 12.213
  06:52:14 STEP  768 H= 192:00 +CPU= 17.327
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000768
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000768
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMGGh7zg+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMSHh7zg+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290643/ICMUAh7zg+000756
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1sc_2016092300_20_1018_12290643_2_r1412778992_7.zip
Uploading the intermediate file: upload_file_7.zip
  06:52:27 STEP  769 H= 192:15 +CPU= 12.486
  06:52:39 STEP  770 H= 192:30 +CPU= 12.444
  06:52:52 STEP  771 H= 192:45 +CPU= 12.248
  06:53:04 STEP  772 H= 193:00 +CPU= 12.455
  06:53:16 STEP  773 H= 193:15 +CPU= 12.161
  06:53:28 STEP  774 H= 193:30 +CPU= 11.953
  06:53:40 STEP  775 H= 193:45 +CPU= 12.024
  06:53:53 STEP  776 H= 194:00 +CPU= 12.749
  06:54:06 STEP  777 H= 194:15 +CPU= 12.594
  06:54:18 STEP  778 H= 194:30 +CPU= 12.199
  06:54:30 STEP  779 H= 194:45 +CPU= 12.597
  06:54:45 STEP  780 H= 195:00 +CPU= 14.750
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000780
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000780
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000780
  06:54:57 STEP  781 H= 195:15 +CPU= 11.452
  06:55:08 STEP  782 H= 195:30 +CPU= 11.621
  06:55:20 STEP  783 H= 195:45 +CPU= 11.704
  06:55:32 STEP  784 H= 196:00 +CPU= 12.275
  06:55:44 STEP  785 H= 196:15 +CPU= 11.456
  06:55:55 STEP  786 H= 196:30 +CPU= 11.392
  06:56:07 STEP  787 H= 196:45 +CPU= 11.720
  06:56:19 STEP  788 H= 197:00 +CPU= 12.344
  06:56:31 STEP  789 H= 197:15 +CPU= 11.868
  06:56:43 STEP  790 H= 197:30 +CPU= 12.297
  06:56:55 STEP  791 H= 197:45 +CPU= 11.606
  06:57:10 STEP  792 H= 198:00 +CPU= 14.544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000792
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000792
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000792
  06:57:21 STEP  793 H= 198:15 +CPU= 11.850
  06:57:33 STEP  794 H= 198:30 +CPU= 11.740
  06:57:44 STEP  795 H= 198:45 +CPU= 11.278
  06:57:56 STEP  796 H= 199:00 +CPU= 11.841
  06:58:08 STEP  797 H= 199:15 +CPU= 11.593
  06:58:20 STEP  798 H= 199:30 +CPU= 11.860
  06:58:31 STEP  799 H= 199:45 +CPU= 11.401
  06:58:44 STEP  800 H= 200:00 +CPU= 12.794
  06:58:56 STEP  801 H= 200:15 +CPU= 11.747
  06:59:07 STEP  802 H= 200:30 +CPU= 11.497
  06:59:19 STEP  803 H= 200:45 +CPU= 11.531
  06:59:34 STEP  804 H= 201:00 +CPU= 15.519
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000804
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000804
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000804
  06:59:47 STEP  805 H= 201:15 +CPU= 12.304
  06:59:59 STEP  806 H= 201:30 +CPU= 12.087
  07:00:11 STEP  807 H= 201:45 +CPU= 12.044
  07:00:23 STEP  808 H= 202:00 +CPU= 12.289
  07:00:35 STEP  809 H= 202:15 +CPU= 11.774
  07:00:47 STEP  810 H= 202:30 +CPU= 11.879
  07:00:59 STEP  811 H= 202:45 +CPU= 11.843
  07:01:12 STEP  812 H= 203:00 +CPU= 13.122
  07:01:24 STEP  813 H= 203:15 +CPU= 12.130
  07:01:36 STEP  814 H= 203:30 +CPU= 11.930
  07:01:48 STEP  815 H= 203:45 +CPU= 12.269
  07:02:05 STEP  816 H= 204:00 +CPU= 16.923
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000816
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000816
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000816
  07:02:17 STEP  817 H= 204:15 +CPU= 12.025
  07:02:29 STEP  818 H= 204:30 +CPU= 12.098
  07:02:41 STEP  819 H= 204:45 +CPU= 11.955
  07:02:53 STEP  820 H= 205:00 +CPU= 12.355
  07:03:06 STEP  821 H= 205:15 +CPU= 12.153
  07:03:18 STEP  822 H= 205:30 +CPU= 12.450
  07:03:31 STEP  823 H= 205:45 +CPU= 13.205
  07:03:44 STEP  824 H= 206:00 +CPU= 12.602
  07:03:56 STEP  825 H= 206:15 +CPU= 12.127
  07:04:08 STEP  826 H= 206:30 +CPU= 12.031
  07:04:20 STEP  827 H= 206:45 +CPU= 12.301
  07:04:36 STEP  828 H= 207:00 +CPU= 15.919
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000828
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000828
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000828
  07:04:48 STEP  829 H= 207:15 +CPU= 12.034
  07:05:00 STEP  830 H= 207:30 +CPU= 11.868
  07:05:12 STEP  831 H= 207:45 +CPU= 11.845
  07:05:24 STEP  832 H= 208:00 +CPU= 12.339
  07:05:37 STEP  833 H= 208:15 +CPU= 12.269
  07:05:49 STEP  834 H= 208:30 +CPU= 12.036
  07:06:01 STEP  835 H= 208:45 +CPU= 12.081
  07:06:14 STEP  836 H= 209:00 +CPU= 12.733
  07:06:26 STEP  837 H= 209:15 +CPU= 11.925
  07:06:37 STEP  838 H= 209:30 +CPU= 11.471
  07:06:49 STEP  839 H= 209:45 +CPU= 11.380
  07:07:04 STEP  840 H= 210:00 +CPU= 14.967
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000840
  07:07:15 STEP  841 H= 210:15 +CPU= 11.930
  07:07:27 STEP  842 H= 210:30 +CPU= 11.492
  07:07:38 STEP  843 H= 210:45 +CPU= 11.438
  07:07:51 STEP  844 H= 211:00 +CPU= 12.153
  07:08:02 STEP  845 H= 211:15 +CPU= 11.776
  07:08:14 STEP  846 H= 211:30 +CPU= 11.455
  07:08:26 STEP  847 H= 211:45 +CPU= 11.998
  07:08:37 STEP  848 H= 212:00 +CPU= 11.625
  07:08:48 STEP  849 H= 212:15 +CPU= 10.914
  07:08:59 STEP  850 H= 212:30 +CPU= 10.897
  07:09:10 STEP  851 H= 212:45 +CPU= 11.223
  07:09:24 STEP  852 H= 213:00 +CPU= 13.929
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000852
  07:09:35 STEP  853 H= 213:15 +CPU= 10.842
  07:09:46 STEP  854 H= 213:30 +CPU= 10.863
  07:09:57 STEP  855 H= 213:45 +CPU= 11.092
  07:10:08 STEP  856 H= 214:00 +CPU= 11.257
  07:10:19 STEP  857 H= 214:15 +CPU= 10.413
  07:10:29 STEP  858 H= 214:30 +CPU= 10.377
  07:10:40 STEP  859 H= 214:45 +CPU= 10.412
  07:10:51 STEP  860 H= 215:00 +CPU= 10.855
  07:11:01 STEP  861 H= 215:15 +CPU= 10.421
  07:11:11 STEP  862 H= 215:30 +CPU= 10.433
  07:11:22 STEP  863 H= 215:45 +CPU= 10.576
  07:11:37 STEP  864 H= 216:00 +CPU= 14.886
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.071] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4412MB (heap), 5554MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.072] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.072] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.072] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc6692], nsigs = 1
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.072] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.072] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 4412 MB (maxheap), 5554 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071143:1718547103:10522.073] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/0/oifs_43r3_model.exe' : sigcontextptr=0x7ffcfa36c350
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/0/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dd5490] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc6692] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x121fd8b] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x1207e29] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x11fdcb2] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xfac003] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xf5fa6b] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf4dbc4] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbd7131] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x12c5002] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0xbacbae] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x688153] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4cd1dc] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4b5d85] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b4f52] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49d638] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x406fbd] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x401e7f] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e12] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1dcc34a] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcdbe7] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x401cd5] : ??() at ??:0
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.073] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/0/oifs_43r3_model.exe' : sigcontextptr=0x7ffcfa36c260
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/0/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x822540 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x822540] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dd5490] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc6692] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x121fd8b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x1207e29] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x11fdcb2] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xfac003] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf5fa6b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xf4dbc4] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xbd7131] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x12c5002] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0xbacbae] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x688153] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4cd1dc] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b5d85] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4b4f52] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49d638] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x406fbd] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e7f] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x401e12] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcc34a] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1dcdbe7] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x401cd5] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.089] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:desktop-b650ef:1:1:200719:200719] [20240616:071144:1718547104:10523.089] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC6692  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000121FD8B  vdfmain_                  874  vdfmain.F90
oifs_43r3_model.e  0000000001207E29  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  00000000011FDCB2  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000000FAC003  callpar_                  869  callpar.F90
oifs_43r3_model.e  0000000000F5FA6B  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000F4DBC4  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BD7131  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

 GPNORM SNOW                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.125099503687319E-04 0.000000000000000E+00 0.156962193865012E-01
 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.317822047564129E-05 0.000000000000000E+00 0.595016160927194E-02
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.216953033722333E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.171522659305229E-05 0.000000000000000E+00 0.630309526121110E-02
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.369876109128039E-05 0.000000000000000E+00 0.697294191233733E-02
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.216987957312713E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.115659348582864E-04 0.000000000000000E+00 0.203245172451674E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.405433105273338E-05 0.000000000000000E+00 0.519198542229331E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.346613216469150E-05 0.000000000000000E+00 0.123927856939721E-01
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.535447545422785E-06 0.000000000000000E+00 0.786177635147693E-02
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.105511168054072E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   864 STEPO   F00000000
 CREATE RESTART FILE ./srf00090000.0001                                                                                                                                                                                                                                              
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./srf00090000.0001 MODE=w
 IO-STREAM CLOSED - ./srf00090000.0001
 MPI-TASK:   1 - ************ BYTES IN     46 RECORDS TRANSFERRED IN    0.9944 SECONDS******** Mbytes/s, TOTAL TIME=    1.2734(78.1%)
 CREATE RESTART CONTROL FILE ./rcf                                                                                                                   
 WRRESF: DELETED PREVIOUS RESTART FILE OK: ./srf00081200.0001
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   864 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000864 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000864
 MPI-TASK:   1 -    324490404 BYTES IN      6 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0049( 6.1%)
 NSTEP =   864 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000864 MODE=w
 IO-STREAM CLOSED - ./ICMSHh7zg+000864
 MPI-TASK:   1 -    707399250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0074 SECONDS 95594.5 Mbytes/s, TOTAL TIME=    0.0990( 7.5%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000864 MODE=w
 IO-STREAM CLOSED - ./ICMUAh7zg+000864
 MPI-TASK:   1 -   5191846464 BYTES IN    125 RECORDS TRANSFERRED IN    0.0046 SECONDS******** Mbytes/s, TOTAL TIME=    0.0701( 6.6%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000864 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000864
 MPI-TASK:   1 -           10 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS     0.1 Mbytes/s, TOTAL TIME=    0.0027( 3.7%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000864 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000864
 MPI-TASK:   1 -    315910675 BYTES IN      4 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0043( 4.7%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =   864 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   864 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000864 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000864
 MPI-TASK:   1 -    324490404 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS811226.0 Mbytes/s, TOTAL TIME=    0.0041( 9.8%)
 07:11:37 STEP  864 H= 216:00 +CPU= 14.886
ISTEP=     865 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=     865 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =   865 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 07:11:22 F00000000 STEPO      864    10.689   10.689   10.691    174:54    175:00 0.19997604828275E-04       2GB       0MB
 07:11:24 0AA000000 STEPO      864     1.546    1.546    1.547    174:56    175:02 0.19997604828275E-04       2GB       0MB
 07:11:24 FULLPOS-B DYNFPOS    864     0.504    0.504    0.504    174:56    175:02 0.19997604828275E-04       2GB       0MB
 07:11:25 FULLPOS-V DYNFPOS    864     1.200    1.200    1.200    174:57    175:04 0.19997604828275E-04       2GB       0MB
 07:11:26 FULLPOS-T DYNFPOS    864     0.279    0.279    0.279    174:58    175:04 0.19997604828275E-04       2GB       0MB
 07:11:26 0AAA00AAA STEPO      864     0.316    0.316    0.316    174:58    175:04 0.19997604828275E-04       2GB       0MB
 07:11:37 0AAA00AAA STEPO      865    10.927   10.927   11.012    175:09    175:15 0.19997604828275E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     864",
 CTIME   = "00090000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         852, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/0/progress_file_12290643.xml

<running_values>
  <last_cpu_time>10508.240000</last_cpu_time>
  <upload_file_number>8</upload_file_number>
  <last_iter>864</last_iter>
  <last_upload>691200</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net