climateprediction.net home page
Task 22312774

Task 22312774

Name oifs_43r3_bl_a4ey_2016092300_15_991_12212509_0
Workunit 12212509
Created 13 Feb 2023, 22:32:21 UTC
Sent 13 Feb 2023, 22:42:36 UTC
Report deadline 14 Apr 2023, 22:42:36 UTC
Received 19 Feb 2023, 19:17:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1537173
Run time 1 hours 59 min 40 sec
CPU time 1 hours 58 min 33 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 7.89 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,073.42 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,373.95 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
et/oifs_43r3_bl_12212509/ICMGGh7zg+000360
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000360
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000360
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000372
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000372
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000372
Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_15_991_12212509_0_r940998444_3.zip
  12:37:27 STEP  385 H=  96:15 +CPU=  8.772
Uploading the intermediate file: upload_file_3.zip
  12:37:37 STEP  386 H=  96:30 +CPU=  9.485
  12:37:45 STEP  387 H=  96:45 +CPU=  8.463
  12:37:54 STEP  388 H=  97:00 +CPU=  8.777
  12:38:02 STEP  389 H=  97:15 +CPU=  8.489
  12:38:11 STEP  390 H=  97:30 +CPU=  8.466
  12:38:19 STEP  391 H=  97:45 +CPU=  8.582
  12:38:28 STEP  392 H=  98:00 +CPU=  8.757
  12:38:37 STEP  393 H=  98:15 +CPU=  8.635
  12:38:45 STEP  394 H=  98:30 +CPU=  8.635
  12:38:54 STEP  395 H=  98:45 +CPU=  8.581
  12:39:05 STEP  396 H=  99:00 +CPU= 10.908
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000396
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000396
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000396
  12:39:14 STEP  397 H=  99:15 +CPU=  8.547
  12:39:22 STEP  398 H=  99:30 +CPU=  8.524
  12:39:31 STEP  399 H=  99:45 +CPU=  8.564
  12:39:39 STEP  400 H= 100:00 +CPU=  8.747
  12:39:48 STEP  401 H= 100:15 +CPU=  8.583
  12:39:57 STEP  402 H= 100:30 +CPU=  8.575
  12:40:05 STEP  403 H= 100:45 +CPU=  8.729
  12:40:14 STEP  404 H= 101:00 +CPU=  8.823
  12:40:23 STEP  405 H= 101:15 +CPU=  8.707
  12:40:32 STEP  406 H= 101:30 +CPU=  8.697
  12:40:40 STEP  407 H= 101:45 +CPU=  8.661
  12:40:51 STEP  408 H= 102:00 +CPU= 11.194
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000408
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000408
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000408
  12:41:01 STEP  409 H= 102:15 +CPU=  9.371
  12:41:09 STEP  410 H= 102:30 +CPU=  8.706
  12:41:18 STEP  411 H= 102:45 +CPU=  8.744
  12:41:27 STEP  412 H= 103:00 +CPU=  8.947
  12:41:36 STEP  413 H= 103:15 +CPU=  8.751
  12:41:45 STEP  414 H= 103:30 +CPU=  8.596
  12:41:53 STEP  415 H= 103:45 +CPU=  8.788
  12:42:02 STEP  416 H= 104:00 +CPU=  8.924
  12:42:11 STEP  417 H= 104:15 +CPU=  8.677
  12:42:20 STEP  418 H= 104:30 +CPU=  8.674
  12:42:28 STEP  419 H= 104:45 +CPU=  8.691
  12:42:40 STEP  420 H= 105:00 +CPU= 11.169
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000420
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000420
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000420
  12:42:48 STEP  421 H= 105:15 +CPU=  8.848
  12:42:57 STEP  422 H= 105:30 +CPU=  8.896
  12:43:06 STEP  423 H= 105:45 +CPU=  8.555
  12:43:15 STEP  424 H= 106:00 +CPU=  8.811
  12:43:23 STEP  425 H= 106:15 +CPU=  8.719
  12:43:32 STEP  426 H= 106:30 +CPU=  8.547
  12:43:40 STEP  427 H= 106:45 +CPU=  8.525
  12:43:49 STEP  428 H= 107:00 +CPU=  8.834
  12:43:58 STEP  429 H= 107:15 +CPU=  8.713
  12:44:07 STEP  430 H= 107:30 +CPU=  8.542
  12:44:15 STEP  431 H= 107:45 +CPU=  8.723
  12:44:28 STEP  432 H= 108:00 +CPU= 12.444
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000432
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000432
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000432
  12:44:36 STEP  433 H= 108:15 +CPU=  8.737
  12:44:45 STEP  434 H= 108:30 +CPU=  8.745
  12:44:54 STEP  435 H= 108:45 +CPU=  8.596
  12:45:03 STEP  436 H= 109:00 +CPU=  8.780
  12:45:11 STEP  437 H= 109:15 +CPU=  8.582
  12:45:20 STEP  438 H= 109:30 +CPU=  8.556
  12:45:29 STEP  439 H= 109:45 +CPU=  8.795
  12:45:38 STEP  440 H= 110:00 +CPU=  8.971
  12:45:46 STEP  441 H= 110:15 +CPU=  8.598
  12:45:55 STEP  442 H= 110:30 +CPU=  8.772
  12:46:04 STEP  443 H= 110:45 +CPU=  8.788
  12:46:15 STEP  444 H= 111:00 +CPU= 10.981
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000444
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000444
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000444
  12:46:23 STEP  445 H= 111:15 +CPU=  8.625
  12:46:32 STEP  446 H= 111:30 +CPU=  8.681
  12:46:41 STEP  447 H= 111:45 +CPU=  8.655
  12:46:50 STEP  448 H= 112:00 +CPU=  8.895
  12:46:58 STEP  449 H= 112:15 +CPU=  8.816
  12:47:07 STEP  450 H= 112:30 +CPU=  8.800
  12:47:16 STEP  451 H= 112:45 +CPU=  8.786
  12:47:25 STEP  452 H= 113:00 +CPU=  9.092
  12:47:34 STEP  453 H= 113:15 +CPU=  8.690
  12:47:43 STEP  454 H= 113:30 +CPU=  8.839
  12:47:51 STEP  455 H= 113:45 +CPU=  8.847
  12:48:03 STEP  456 H= 114:00 +CPU= 11.170
  12:48:11 STEP  457 H= 114:15 +CPU=  8.726
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000456
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000456
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000456
  12:48:20 STEP  458 H= 114:30 +CPU=  8.688
  12:48:29 STEP  459 H= 114:45 +CPU=  8.826
  12:48:38 STEP  460 H= 115:00 +CPU=  8.962
  12:48:47 STEP  461 H= 115:15 +CPU=  8.763
  12:48:55 STEP  462 H= 115:30 +CPU=  8.646
  12:49:04 STEP  463 H= 115:45 +CPU=  8.962
  12:49:13 STEP  464 H= 116:00 +CPU=  9.087
  12:49:22 STEP  465 H= 116:15 +CPU=  8.637
  12:49:31 STEP  466 H= 116:30 +CPU=  8.651
  12:49:39 STEP  467 H= 116:45 +CPU=  8.636
  12:49:50 STEP  468 H= 117:00 +CPU= 10.976
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000468
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000468
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000468
  12:49:59 STEP  469 H= 117:15 +CPU=  8.736
  12:50:08 STEP  470 H= 117:30 +CPU=  8.902
  12:50:17 STEP  471 H= 117:45 +CPU=  8.686
  12:50:26 STEP  472 H= 118:00 +CPU=  9.050
  12:50:34 STEP  473 H= 118:15 +CPU=  8.706
  12:50:43 STEP  474 H= 118:30 +CPU=  8.703
  12:50:52 STEP  475 H= 118:45 +CPU=  8.728
  12:51:01 STEP  476 H= 119:00 +CPU=  8.978
  12:51:10 STEP  477 H= 119:15 +CPU=  8.805
  12:51:18 STEP  478 H= 119:30 +CPU=  8.760
  12:51:27 STEP  479 H= 119:45 +CPU=  8.706
  12:51:40 STEP  480 H= 120:00 +CPU= 12.527
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000480
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000480
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000384
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000384
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000396
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000396
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000396
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000408
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000408
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000408
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000420
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000420
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000420
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000432
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000432
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000432
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000444
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000444
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000444
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000456
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000456
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000456
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000468
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000468
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000468
Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_15_991_12212509_0_r940998444_4.zip
  12:51:49 STEP  481 H= 120:15 +CPU=  8.881
Uploading the intermediate file: upload_file_4.zip
  12:51:58 STEP  482 H= 120:30 +CPU=  8.950
  12:52:07 STEP  483 H= 120:45 +CPU=  8.998
  12:52:16 STEP  484 H= 121:00 +CPU=  9.423
  12:52:25 STEP  485 H= 121:15 +CPU=  8.749
  12:52:34 STEP  486 H= 121:30 +CPU=  9.023
  12:52:43 STEP  487 H= 121:45 +CPU=  9.050
  12:52:52 STEP  488 H= 122:00 +CPU=  8.938
  12:53:01 STEP  489 H= 122:15 +CPU=  8.999
  12:53:10 STEP  490 H= 122:30 +CPU=  8.838
  12:53:18 STEP  491 H= 122:45 +CPU=  8.817
  12:53:30 STEP  492 H= 123:00 +CPU= 11.128
  12:53:38 STEP  493 H= 123:15 +CPU=  8.808
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000492
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000492
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000492
  12:53:47 STEP  494 H= 123:30 +CPU=  8.775
  12:53:56 STEP  495 H= 123:45 +CPU=  8.753
  12:54:05 STEP  496 H= 124:00 +CPU=  8.969
  12:54:14 STEP  497 H= 124:15 +CPU=  8.847
  12:54:23 STEP  498 H= 124:30 +CPU=  8.894
  12:54:32 STEP  499 H= 124:45 +CPU=  9.038
  12:54:41 STEP  500 H= 125:00 +CPU=  9.157
  12:54:50 STEP  501 H= 125:15 +CPU=  8.929
  12:54:59 STEP  502 H= 125:30 +CPU=  9.372
  12:55:08 STEP  503 H= 125:45 +CPU=  9.282
  12:55:20 STEP  504 H= 126:00 +CPU= 11.281
  12:55:29 STEP  505 H= 126:15 +CPU=  8.875
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000504
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000504
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000504
  12:55:38 STEP  506 H= 126:30 +CPU=  8.929
  12:55:46 STEP  507 H= 126:45 +CPU=  8.900
  12:55:55 STEP  508 H= 127:00 +CPU=  9.072
  12:56:04 STEP  509 H= 127:15 +CPU=  8.928
  12:56:14 STEP  510 H= 127:30 +CPU=  9.100
  12:56:22 STEP  511 H= 127:45 +CPU=  8.784
  12:56:31 STEP  512 H= 128:00 +CPU=  9.066
  12:56:40 STEP  513 H= 128:15 +CPU=  9.081
  12:56:49 STEP  514 H= 128:30 +CPU=  8.974
  12:56:58 STEP  515 H= 128:45 +CPU=  8.961
  12:57:10 STEP  516 H= 129:00 +CPU= 11.474
  12:57:19 STEP  517 H= 129:15 +CPU=  9.029
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000516
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000516
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000516
  12:57:28 STEP  518 H= 129:30 +CPU=  8.951
  12:57:37 STEP  519 H= 129:45 +CPU=  8.786
  12:57:46 STEP  520 H= 130:00 +CPU=  9.074
  12:57:55 STEP  521 H= 130:15 +CPU=  8.792
  12:58:03 STEP  522 H= 130:30 +CPU=  8.879
  12:58:13 STEP  523 H= 130:45 +CPU=  9.229
  12:58:22 STEP  524 H= 131:00 +CPU=  9.321
  12:58:31 STEP  525 H= 131:15 +CPU=  8.845
  12:58:40 STEP  526 H= 131:30 +CPU=  9.040
  12:58:49 STEP  527 H= 131:45 +CPU=  8.823
  12:59:02 STEP  528 H= 132:00 +CPU= 12.971
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000528
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000528
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000528
  12:59:11 STEP  529 H= 132:15 +CPU=  8.807
  12:59:19 STEP  530 H= 132:30 +CPU=  8.831
  12:59:28 STEP  531 H= 132:45 +CPU=  8.773
  12:59:37 STEP  532 H= 133:00 +CPU=  9.212
  12:59:46 STEP  533 H= 133:15 +CPU=  8.792
  12:59:55 STEP  534 H= 133:30 +CPU=  8.975
  13:00:04 STEP  535 H= 133:45 +CPU=  8.908
  13:00:13 STEP  536 H= 134:00 +CPU=  9.008
  13:00:22 STEP  537 H= 134:15 +CPU=  8.892
  13:00:31 STEP  538 H= 134:30 +CPU=  8.986
  13:00:40 STEP  539 H= 134:45 +CPU=  8.886
  13:00:51 STEP  540 H= 135:00 +CPU= 11.353
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000540
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000540
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000540
  13:01:00 STEP  541 H= 135:15 +CPU=  9.065
  13:01:09 STEP  542 H= 135:30 +CPU=  9.118
  13:01:18 STEP  543 H= 135:45 +CPU=  8.829
  13:01:27 STEP  544 H= 136:00 +CPU=  9.022
  13:01:36 STEP  545 H= 136:15 +CPU=  8.794
  13:01:45 STEP  546 H= 136:30 +CPU=  8.955
  13:01:54 STEP  547 H= 136:45 +CPU=  9.089
  13:02:03 STEP  548 H= 137:00 +CPU=  9.264
  13:02:12 STEP  549 H= 137:15 +CPU=  8.809
  13:02:21 STEP  550 H= 137:30 +CPU=  9.097
  13:02:30 STEP  551 H= 137:45 +CPU=  8.983
  13:02:42 STEP  552 H= 138:00 +CPU= 11.380
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000552
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000552
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000552
  13:02:51 STEP  553 H= 138:15 +CPU=  9.131
  13:03:00 STEP  554 H= 138:30 +CPU=  8.868
  13:03:09 STEP  555 H= 138:45 +CPU=  8.891
  13:03:18 STEP  556 H= 139:00 +CPU=  9.073
  13:03:27 STEP  557 H= 139:15 +CPU=  9.004
  13:03:36 STEP  558 H= 139:30 +CPU=  8.876
  13:03:44 STEP  559 H= 139:45 +CPU=  8.851
  13:03:54 STEP  560 H= 140:00 +CPU=  9.336
  13:04:03 STEP  561 H= 140:15 +CPU=  8.898
  13:04:12 STEP  562 H= 140:30 +CPU=  9.065
  13:04:21 STEP  563 H= 140:45 +CPU=  8.968
  13:04:32 STEP  564 H= 141:00 +CPU= 11.255
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000564
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000564
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000564
  13:04:41 STEP  565 H= 141:15 +CPU=  8.936
  13:04:50 STEP  566 H= 141:30 +CPU=  9.058
  13:04:59 STEP  567 H= 141:45 +CPU=  9.036
  13:05:08 STEP  568 H= 142:00 +CPU=  9.154
  13:05:17 STEP  569 H= 142:15 +CPU=  9.145
  13:05:26 STEP  570 H= 142:30 +CPU=  8.957
  13:05:35 STEP  571 H= 142:45 +CPU=  8.871
  13:05:44 STEP  572 H= 143:00 +CPU=  9.047
  13:05:53 STEP  573 H= 143:15 +CPU=  8.972
  13:06:02 STEP  574 H= 143:30 +CPU=  8.975
  13:06:11 STEP  575 H= 143:45 +CPU=  9.186
  13:06:24 STEP  576 H= 144:00 +CPU= 12.877
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000576
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000576
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000480
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000480
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000492
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000492
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000492
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000504
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000504
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000504
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000516
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000516
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000516
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000528
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000528
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000528
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000540
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000540
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000540
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000552
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000552
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000552
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000564
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000564
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000564
Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_15_991_12212509_0_r940998444_5.zip
  13:06:33 STEP  577 H= 144:15 +CPU=  9.152
Uploading the intermediate file: upload_file_5.zip
  13:06:42 STEP  578 H= 144:30 +CPU=  8.972
  13:06:51 STEP  579 H= 144:45 +CPU=  8.985
  13:07:01 STEP  580 H= 145:00 +CPU=  9.228
  13:07:10 STEP  581 H= 145:15 +CPU=  9.033
  13:07:19 STEP  582 H= 145:30 +CPU=  8.944
  13:07:28 STEP  583 H= 145:45 +CPU=  9.100
  13:07:37 STEP  584 H= 146:00 +CPU=  9.100
  13:07:46 STEP  585 H= 146:15 +CPU=  8.914
  13:07:55 STEP  586 H= 146:30 +CPU=  8.943
  13:08:04 STEP  587 H= 146:45 +CPU=  9.155
  13:08:15 STEP  588 H= 147:00 +CPU= 11.274
  13:08:24 STEP  589 H= 147:15 +CPU=  8.939
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000588
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000588
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000588
  13:08:33 STEP  590 H= 147:30 +CPU=  8.914
  13:08:42 STEP  591 H= 147:45 +CPU=  9.270
  13:08:51 STEP  592 H= 148:00 +CPU=  9.254
  13:09:01 STEP  593 H= 148:15 +CPU=  9.055
  13:09:10 STEP  594 H= 148:30 +CPU=  9.047
  13:09:19 STEP  595 H= 148:45 +CPU=  8.999
  13:09:28 STEP  596 H= 149:00 +CPU=  9.220
  13:09:37 STEP  597 H= 149:15 +CPU=  8.988
  13:09:46 STEP  598 H= 149:30 +CPU=  8.956
  13:09:55 STEP  599 H= 149:45 +CPU=  8.940
  13:10:06 STEP  600 H= 150:00 +CPU= 11.299
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000600
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000600
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000600
  13:10:15 STEP  601 H= 150:15 +CPU=  9.004
  13:10:24 STEP  602 H= 150:30 +CPU=  9.024
  13:10:33 STEP  603 H= 150:45 +CPU=  9.112
  13:10:43 STEP  604 H= 151:00 +CPU=  9.385
  13:10:52 STEP  605 H= 151:15 +CPU=  9.266
  13:11:01 STEP  606 H= 151:30 +CPU=  9.396
  13:11:10 STEP  607 H= 151:45 +CPU=  9.008
  13:11:20 STEP  608 H= 152:00 +CPU=  9.416
  13:11:29 STEP  609 H= 152:15 +CPU=  9.178
  13:11:38 STEP  610 H= 152:30 +CPU=  9.156
  13:11:47 STEP  611 H= 152:45 +CPU=  8.963
  13:11:58 STEP  612 H= 153:00 +CPU= 11.408
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000612
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000612
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000612
  13:12:08 STEP  613 H= 153:15 +CPU=  9.119
  13:12:17 STEP  614 H= 153:30 +CPU=  9.091
  13:12:26 STEP  615 H= 153:45 +CPU=  9.038
  13:12:35 STEP  616 H= 154:00 +CPU=  9.300
  13:12:44 STEP  617 H= 154:15 +CPU=  9.056
  13:12:53 STEP  618 H= 154:30 +CPU=  9.231
  13:13:02 STEP  619 H= 154:45 +CPU=  9.137
  13:13:12 STEP  620 H= 155:00 +CPU=  9.452
  13:13:21 STEP  621 H= 155:15 +CPU=  9.074
  13:13:30 STEP  622 H= 155:30 +CPU=  9.091
  13:13:39 STEP  623 H= 155:45 +CPU=  8.994
  13:13:52 STEP  624 H= 156:00 +CPU= 12.804
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000624
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000624
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000624
  13:14:01 STEP  625 H= 156:15 +CPU=  9.362
  13:14:10 STEP  626 H= 156:30 +CPU=  9.182
  13:14:20 STEP  627 H= 156:45 +CPU=  9.147
  13:14:29 STEP  628 H= 157:00 +CPU=  9.310
  13:14:38 STEP  629 H= 157:15 +CPU=  9.093
  13:14:47 STEP  630 H= 157:30 +CPU=  9.346
  13:14:57 STEP  631 H= 157:45 +CPU=  9.220
  13:15:06 STEP  632 H= 158:00 +CPU=  9.418
  13:15:15 STEP  633 H= 158:15 +CPU=  9.119
  13:15:24 STEP  634 H= 158:30 +CPU=  9.098
  13:15:33 STEP  635 H= 158:45 +CPU=  9.244
  13:15:45 STEP  636 H= 159:00 +CPU= 11.572
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000636
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000636
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000636
  13:15:54 STEP  637 H= 159:15 +CPU=  9.239
  13:16:04 STEP  638 H= 159:30 +CPU=  9.190
  13:16:13 STEP  639 H= 159:45 +CPU=  9.080
  13:16:22 STEP  640 H= 160:00 +CPU=  9.633
  13:16:32 STEP  641 H= 160:15 +CPU=  9.488
  13:16:41 STEP  642 H= 160:30 +CPU=  9.307
  13:16:50 STEP  643 H= 160:45 +CPU=  9.263
  13:17:00 STEP  644 H= 161:00 +CPU=  9.579
  13:17:09 STEP  645 H= 161:15 +CPU=  9.279
  13:17:18 STEP  646 H= 161:30 +CPU=  9.177
  13:17:28 STEP  647 H= 161:45 +CPU=  9.611
  13:17:39 STEP  648 H= 162:00 +CPU= 11.510
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000648
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000648
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000648
  13:17:49 STEP  649 H= 162:15 +CPU=  9.145
  13:17:58 STEP  650 H= 162:30 +CPU=  9.311
  13:18:07 STEP  651 H= 162:45 +CPU=  9.209
  13:18:17 STEP  652 H= 163:00 +CPU=  9.763
  13:18:26 STEP  653 H= 163:15 +CPU=  9.322
  13:18:36 STEP  654 H= 163:30 +CPU=  9.354
  13:18:45 STEP  655 H= 163:45 +CPU=  9.269
  13:18:54 STEP  656 H= 164:00 +CPU=  9.519
  13:19:04 STEP  657 H= 164:15 +CPU=  9.252
  13:19:13 STEP  658 H= 164:30 +CPU=  9.198
  13:19:22 STEP  659 H= 164:45 +CPU=  9.237
  13:19:34 STEP  660 H= 165:00 +CPU= 11.618
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000660
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000660
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000660
  13:19:43 STEP  661 H= 165:15 +CPU=  9.226
  13:19:52 STEP  662 H= 165:30 +CPU=  9.345
  13:20:02 STEP  663 H= 165:45 +CPU=  9.579
  13:20:12 STEP  664 H= 166:00 +CPU=  9.793
  13:20:21 STEP  665 H= 166:15 +CPU=  9.150
  13:20:30 STEP  666 H= 166:30 +CPU=  9.364
  13:20:39 STEP  667 H= 166:45 +CPU=  9.157
  13:20:49 STEP  668 H= 167:00 +CPU=  9.489
  13:20:58 STEP  669 H= 167:15 +CPU=  9.501
  13:21:08 STEP  670 H= 167:30 +CPU=  9.276
  13:21:17 STEP  671 H= 167:45 +CPU=  9.215
  13:21:30 STEP  672 H= 168:00 +CPU= 13.025
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000672
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000672
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000576
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000576
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000588
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000588
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000588
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000600
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000600
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000600
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000612
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000612
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000612
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000624
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000624
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000624
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000636
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000636
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000636
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000648
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000648
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000648
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000660
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000660
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000660
Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_15_991_12212509_0_r940998444_6.zip
  13:21:39 STEP  673 H= 168:15 +CPU=  9.219
Uploading the intermediate file: upload_file_6.zip
  13:21:49 STEP  674 H= 168:30 +CPU=  9.396
  13:21:58 STEP  675 H= 168:45 +CPU=  9.440
  13:22:08 STEP  676 H= 169:00 +CPU=  9.655
  13:22:17 STEP  677 H= 169:15 +CPU=  9.253
  13:22:26 STEP  678 H= 169:30 +CPU=  9.302
  13:22:36 STEP  679 H= 169:45 +CPU=  9.313
  13:22:45 STEP  680 H= 170:00 +CPU=  9.484
  13:22:55 STEP  681 H= 170:15 +CPU=  9.529
  13:23:04 STEP  682 H= 170:30 +CPU=  9.481
  13:23:14 STEP  683 H= 170:45 +CPU=  9.423
  13:23:25 STEP  684 H= 171:00 +CPU= 11.879
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000684
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000684
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000684
  13:23:35 STEP  685 H= 171:15 +CPU=  9.241
  13:23:44 STEP  686 H= 171:30 +CPU=  9.309
  13:23:53 STEP  687 H= 171:45 +CPU=  9.286
  13:24:03 STEP  688 H= 172:00 +CPU=  9.500
  13:24:12 STEP  689 H= 172:15 +CPU=  9.480
  13:24:22 STEP  690 H= 172:30 +CPU=  9.460
  13:24:31 STEP  691 H= 172:45 +CPU=  9.387
  13:24:41 STEP  692 H= 173:00 +CPU=  9.599
  13:24:50 STEP  693 H= 173:15 +CPU=  9.484
  13:25:00 STEP  694 H= 173:30 +CPU=  9.734
  13:25:09 STEP  695 H= 173:45 +CPU=  9.454
  13:25:21 STEP  696 H= 174:00 +CPU= 11.567
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000696
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000696
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000696
  13:25:30 STEP  697 H= 174:15 +CPU=  9.339
  13:25:40 STEP  698 H= 174:30 +CPU=  9.363
  13:25:49 STEP  699 H= 174:45 +CPU=  9.374
  13:25:59 STEP  700 H= 175:00 +CPU=  9.600
  13:26:08 STEP  701 H= 175:15 +CPU=  9.290
  13:26:18 STEP  702 H= 175:30 +CPU=  9.564
  13:26:27 STEP  703 H= 175:45 +CPU=  9.380
  13:26:36 STEP  704 H= 176:00 +CPU=  9.454
  13:26:46 STEP  705 H= 176:15 +CPU=  9.435
  13:26:55 STEP  706 H= 176:30 +CPU=  9.407
  13:27:05 STEP  707 H= 176:45 +CPU=  9.590
  13:27:17 STEP  708 H= 177:00 +CPU= 11.896
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000708
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000708
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000708
  13:27:26 STEP  709 H= 177:15 +CPU=  9.663
  13:27:36 STEP  710 H= 177:30 +CPU=  9.524
  13:27:45 STEP  711 H= 177:45 +CPU=  9.293
  13:27:55 STEP  712 H= 178:00 +CPU=  9.562
  13:28:04 STEP  713 H= 178:15 +CPU=  9.325
  13:28:13 STEP  714 H= 178:30 +CPU=  9.250
  13:28:23 STEP  715 H= 178:45 +CPU=  9.292
  13:28:32 STEP  716 H= 179:00 +CPU=  9.523
  13:28:42 STEP  717 H= 179:15 +CPU=  9.332
  13:28:51 STEP  718 H= 179:30 +CPU=  9.445
  13:29:00 STEP  719 H= 179:45 +CPU=  9.429
  13:29:14 STEP  720 H= 180:00 +CPU= 13.044
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000720
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000720
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000720
  13:29:23 STEP  721 H= 180:15 +CPU=  9.322
  13:29:32 STEP  722 H= 180:30 +CPU=  9.327
  13:29:41 STEP  723 H= 180:45 +CPU=  9.324
  13:29:51 STEP  724 H= 181:00 +CPU=  9.567
  13:30:01 STEP  725 H= 181:15 +CPU=  9.676
  13:30:10 STEP  726 H= 181:30 +CPU=  9.331
  13:30:19 STEP  727 H= 181:45 +CPU=  9.387
  13:30:29 STEP  728 H= 182:00 +CPU=  9.660
  13:30:38 STEP  729 H= 182:15 +CPU=  9.317
  13:30:48 STEP  730 H= 182:30 +CPU=  9.341
  13:30:57 STEP  731 H= 182:45 +CPU=  9.423
  13:31:09 STEP  732 H= 183:00 +CPU= 11.898
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000732
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000732
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000732
  13:31:19 STEP  733 H= 183:15 +CPU=  9.624
  13:31:28 STEP  734 H= 183:30 +CPU=  9.336
  13:31:38 STEP  735 H= 183:45 +CPU=  9.426
  13:31:47 STEP  736 H= 184:00 +CPU=  9.647
  13:31:57 STEP  737 H= 184:15 +CPU=  9.477
  13:32:06 STEP  738 H= 184:30 +CPU=  9.297
  13:32:15 STEP  739 H= 184:45 +CPU=  9.295
  13:32:25 STEP  740 H= 185:00 +CPU=  9.596
  13:32:34 STEP  741 H= 185:15 +CPU=  9.328
  13:32:44 STEP  742 H= 185:30 +CPU=  9.306
  13:32:53 STEP  743 H= 185:45 +CPU=  9.411
  13:33:05 STEP  744 H= 186:00 +CPU= 11.846
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000744
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000744
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000744
  13:33:14 STEP  745 H= 186:15 +CPU=  9.435
  13:33:24 STEP  746 H= 186:30 +CPU=  9.485
  13:33:33 STEP  747 H= 186:45 +CPU=  9.574
  13:33:43 STEP  748 H= 187:00 +CPU=  9.540
  13:33:52 STEP  749 H= 187:15 +CPU=  9.373
  13:34:02 STEP  750 H= 187:30 +CPU=  9.378
  13:34:11 STEP  751 H= 187:45 +CPU=  9.528
  13:34:21 STEP  752 H= 188:00 +CPU=  9.699
  13:34:31 STEP  753 H= 188:15 +CPU=  9.761
  13:34:40 STEP  754 H= 188:30 +CPU=  9.480
  13:34:50 STEP  755 H= 188:45 +CPU=  9.595
  13:35:02 STEP  756 H= 189:00 +CPU= 11.969
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000756
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000756
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000756
  13:35:11 STEP  757 H= 189:15 +CPU=  9.507
  13:35:21 STEP  758 H= 189:30 +CPU=  9.424
  13:35:30 STEP  759 H= 189:45 +CPU=  9.422
  13:35:40 STEP  760 H= 190:00 +CPU= 10.036
  13:35:50 STEP  761 H= 190:15 +CPU=  9.678
  13:35:59 STEP  762 H= 190:30 +CPU=  9.643
  13:36:09 STEP  763 H= 190:45 +CPU=  9.510
  13:36:19 STEP  764 H= 191:00 +CPU=  9.935
  13:36:29 STEP  765 H= 191:15 +CPU=  9.608
  13:36:38 STEP  766 H= 191:30 +CPU=  9.448
  13:36:48 STEP  767 H= 191:45 +CPU= 10.025
  13:37:02 STEP  768 H= 192:00 +CPU= 13.480
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000768
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000768
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000672
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000672
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000684
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000684
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000684
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000696
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000696
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000696
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000708
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000708
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000708
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000720
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000720
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000720
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000732
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000732
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000732
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000744
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000744
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000744
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMGGh7zg+000756
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMSHh7zg+000756
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12212509/ICMUAh7zg+000756
Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_15_991_12212509_0_r940998444_7.zip
Uploading the intermediate file: upload_file_7.zip
  13:37:11 STEP  769 H= 192:15 +CPU=  9.829
  13:37:21 STEP  770 H= 192:30 +CPU=  9.771
  13:37:31 STEP  771 H= 192:45 +CPU=  9.620
  13:37:40 STEP  772 H= 193:00 +CPU=  9.701
  13:37:50 STEP  773 H= 193:15 +CPU=  9.783
  13:38:00 STEP  774 H= 193:30 +CPU=  9.571
  13:38:09 STEP  775 H= 193:45 +CPU=  9.420
  13:38:19 STEP  776 H= 194:00 +CPU=  9.597
  13:38:28 STEP  777 H= 194:15 +CPU=  9.368
  13:38:38 STEP  778 H= 194:30 +CPU=  9.473
  13:38:47 STEP  779 H= 194:45 +CPU=  9.455
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4362MB (heap), 5076MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 4362 MB (maxheap), 5076 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS CLDPP T/S    (1002) 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133854:1676831934:7117.524] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client-cpdn/slots/0/oifs_43r3_model.exe' : sigcontextptr=0x7ffef5816110
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client-cpdn/slots/0/oifs_43r3_model.exe' 0x838803 0x838e09 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc4a8f] : __libm_exp_e7() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x12d283b] : vdfmain_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12ba8d9] : vdfouter_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12b0762] : turbulence_layer_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x1163fc3] : callpar_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x10b682f] : ec_phys_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10a915c] : ec_phys_drv_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xe680c3] : gp_model_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x15c1e62] : gp_model_heap_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15ac40e] : scan2m_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x6620b4] : stepo_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4a0e7c] : cnt4_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x49dc29] : cnt3_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49ce72] : cnt2_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49cd68] : cnt1_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x4078ad] : cnt0_() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x40276f] : MAIN__() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40270d] : main() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d840d7] : __libc_start_main_impl() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x4025e5] : _start() at ??:?
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.525] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client-cpdn/slots/0/oifs_43r3_model.exe' : sigcontextptr=0x7ffef5816020
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client-cpdn/slots/0/oifs_43r3_model.exe' 0x838803 0x838e09 0x820d70 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x820d70] : signal_drhook() at drhook.c:1734
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc4a8f] : __libm_exp_e7() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12d283b] : vdfmain_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12ba8d9] : vdfouter_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x12b0762] : turbulence_layer_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x1163fc3] : callpar_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10b682f] : ec_phys_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x10a915c] : ec_phys_drv_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xe680c3] : gp_model_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15c1e62] : gp_model_heap_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x15ac40e] : scan2m_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x6620b4] : stepo_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4a0e7c] : cnt4_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49dc29] : cnt3_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49ce72] : cnt2_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49cd68] : cnt1_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x4078ad] : cnt0_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40276f] : MAIN__() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x40270d] : main() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1d840d7] : __libc_start_main_impl() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x4025e5] : _start() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.585] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:ava:1:1:67412:67412] [20230219:133855:1676831935:7118.585] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  000000000081FCF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8BB20  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC4A8F  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000012D283B  vdfmain_                  874  vdfmain.F90
oifs_43r3_model.e  00000000012BA8D9  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  00000000012B0762  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000001163FC3  callpar_                  869  callpar.F90
oifs_43r3_model.e  00000000010B682F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  00000000010A915C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000E680C3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000015C1E62  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  00000000015AC40E  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  00000000006620B4  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004A0E7C  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  000000000049DC29  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  000000000049CE72  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049CD68  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  00000000004078AD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040276F  MAIN__                     96  master.F90
oifs_43r3_model.e  000000000040270D  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8287A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D840D7  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000004025E5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

 13:38:47 STEP  779 H= 194:45 +CPU=  9.455
ISTEP=     780 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=     780 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
  DATE= 2016    9   23
ISTEP=     780: Reset RSOLINC= 1361.4482 RIP0= 1361.4482
 SU_GHGCLIM, RCARDI,RCH4,RN2O,RCFC11,RCFC12,RNO2:   6.175516699499999E-004
  1.087291259320000E-006  4.989444016862500E-007  3.778881179906250E-009
  2.099153872040000E-009  7.940283000000001E-011
 suecaec NAERMACC =  1
 UPDT RAESHDU =  2000.0
 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT)     20160923
         270  9.999999999999998E-005
 GPNORM  HUMIDITY            AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.467104506419495E-02 0.999999999695249E-08 0.540303601265926E-01
 GPNORM  LIQUID WATER        AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.222566304086366E-05 0.000000000000000E+00 0.102990529084599E-01
 GPNORM  ICE WATER           AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.309385987046953E-04 0.000000000000000E+00 0.160917331749982E-01
 GPNORM SNOW                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.597281802749075E-04 0.000000000000000E+00 0.219059911467759E-01
 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.352356189822320E-05 0.000000000000000E+00 0.727206229733175E-02
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.194537887523603E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.223418979912122E-05 0.000000000000000E+00 0.963426954598592E-02
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.302187778266741E-04 0.000000000000000E+00 0.174612729632304E-01
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.194055010280331E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.120621315480089E-04 0.000000000000000E+00 0.216379980145746E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.121195138453632E-04 0.000000000000000E+00 0.677469216804444E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.308855108984036E-05 0.000000000000000E+00 0.201437191821073E-01
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.116747353108869E-05 0.000000000000000E+00 0.112642386448075E-01
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.130579406009354E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   780 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   780 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000780 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000780
 MPI-TASK:   1 -    319804730 BYTES IN      6 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0051( 3.9%)
 NSTEP =   780 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000780 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+000780
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0034 SECONDS208166.2 Mbytes/s, TOTAL TIME=    0.0959( 3.5%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000780 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000780
 MPI-TASK:   1 -   5116875671 BYTES IN    125 RECORDS TRANSFERRED IN    0.0024 SECONDS******** Mbytes/s, TOTAL TIME=    0.0803( 3.0%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000780 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000780
 MPI-TASK:   1 -    311231097 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0017( 5.9%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000780 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000780
 MPI-TASK:   1 -    319804730 BYTES IN      4 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0026( 3.8%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =   780 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 13:38:38 0AAA00AAA STEPO      779     9.473    9.473    9.476    118:16    118:21 0.30536659942335E-04       2GB       0MB
 13:38:47 A00000000 STEPO      780     9.542    9.542    9.547    118:26    118:30 0.30536659942335E-04       2GB       0MB
 13:38:47 0AA000000 STEPO      780     0.012    0.012    0.012    118:26    118:30 0.30536659942335E-04       2GB       0MB
 13:38:48 FULLPOS-B DYNFPOS    780     0.568    0.568    0.568    118:26    118:31 0.30536659942335E-04       2GB       0MB
 13:38:49 FULLPOS-V DYNFPOS    780     1.102    1.102    1.103    118:28    118:32 0.30536659942335E-04       2GB       0MB
 13:38:49 FULLPOS-T DYNFPOS    780     0.222    0.222    0.222    118:28    118:32 0.30536659942335E-04       2GB       0MB
 13:38:49 0AAA00AAA STEPO      780     0.212    0.212    0.212    118:28    118:32 0.30536659942335E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     768",
 CTIME   = "00080000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         756, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client-cpdn/slots/0/progress_file_12212509.xml

<running_values>
  <last_cpu_time>7105.760000</last_cpu_time>
  <upload_file_number>8</upload_file_number>
  <last_iter>780</last_iter>
  <last_upload>691200</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net