climateprediction.net home page
Task 22314006

Task 22314006

Name oifs_43r3_bl_a333_2016092300_15_991_12210786_2
Workunit 12210786
Created 15 Feb 2023, 14:05:44 UTC
Sent 15 Feb 2023, 14:07:38 UTC
Report deadline 16 Apr 2023, 14:07:38 UTC
Received 21 Feb 2023, 23:09:19 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1537173
Run time 1 hours 54 min 15 sec
CPU time 1 hours 53 min 8 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 7.89 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,069.22 MB
Peak swap size 5,930.78 MB
Peak disk usage 1,294.45 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>

  17:00:53 STEP  330 H=  82:30 +CPU=  8.881
  17:01:02 STEP  331 H=  82:45 +CPU=  8.901
  17:01:11 STEP  332 H=  83:00 +CPU=  9.097
  17:01:20 STEP  333 H=  83:15 +CPU=  8.955
  17:01:29 STEP  334 H=  83:30 +CPU=  8.891
  17:01:37 STEP  335 H=  83:45 +CPU=  8.893
  17:01:50 STEP  336 H=  84:00 +CPU= 12.635
  17:01:59 STEP  337 H=  84:15 +CPU=  8.944
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000336
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000336
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000336
  17:02:08 STEP  338 H=  84:30 +CPU=  8.968
  17:02:17 STEP  339 H=  84:45 +CPU=  8.915
  17:02:26 STEP  340 H=  85:00 +CPU=  9.506
  17:02:35 STEP  341 H=  85:15 +CPU=  8.957
  17:02:44 STEP  342 H=  85:30 +CPU=  9.104
  17:02:54 STEP  343 H=  85:45 +CPU=  9.198
  17:03:03 STEP  344 H=  86:00 +CPU=  9.411
  17:03:12 STEP  345 H=  86:15 +CPU=  9.144
  17:03:21 STEP  346 H=  86:30 +CPU=  9.114
  17:03:30 STEP  347 H=  86:45 +CPU=  8.862
  17:03:42 STEP  348 H=  87:00 +CPU= 11.264
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000348
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000348
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000348
  17:03:50 STEP  349 H=  87:15 +CPU=  8.942
  17:04:00 STEP  350 H=  87:30 +CPU=  9.088
  17:04:08 STEP  351 H=  87:45 +CPU=  8.878
  17:04:18 STEP  352 H=  88:00 +CPU=  9.107
  17:04:27 STEP  353 H=  88:15 +CPU=  8.955
  17:04:36 STEP  354 H=  88:30 +CPU=  9.082
  17:04:44 STEP  355 H=  88:45 +CPU=  8.841
  17:04:54 STEP  356 H=  89:00 +CPU=  9.052
  17:05:03 STEP  357 H=  89:15 +CPU=  8.972
  17:05:12 STEP  358 H=  89:30 +CPU=  9.108
  17:05:21 STEP  359 H=  89:45 +CPU=  9.091
  17:05:32 STEP  360 H=  90:00 +CPU= 11.180
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000360
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000360
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000360
  17:05:41 STEP  361 H=  90:15 +CPU=  9.169
  17:05:50 STEP  362 H=  90:30 +CPU=  8.939
  17:05:59 STEP  363 H=  90:45 +CPU=  8.936
  17:06:08 STEP  364 H=  91:00 +CPU=  9.155
  17:06:17 STEP  365 H=  91:15 +CPU=  8.860
  17:06:26 STEP  366 H=  91:30 +CPU=  8.897
  17:06:35 STEP  367 H=  91:45 +CPU=  9.181
  17:06:44 STEP  368 H=  92:00 +CPU=  9.226
  17:06:53 STEP  369 H=  92:15 +CPU=  9.156
  17:07:03 STEP  370 H=  92:30 +CPU=  9.019
  17:07:11 STEP  371 H=  92:45 +CPU=  8.937
  17:07:23 STEP  372 H=  93:00 +CPU= 11.302
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000372
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000372
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000372
  17:07:32 STEP  373 H=  93:15 +CPU=  8.924
  17:07:41 STEP  374 H=  93:30 +CPU=  9.045
  17:07:50 STEP  375 H=  93:45 +CPU=  9.093
  17:07:59 STEP  376 H=  94:00 +CPU=  9.122
  17:08:08 STEP  377 H=  94:15 +CPU=  8.842
  17:08:17 STEP  378 H=  94:30 +CPU=  9.139
  17:08:26 STEP  379 H=  94:45 +CPU=  8.971
  17:08:35 STEP  380 H=  95:00 +CPU=  9.137
  17:08:44 STEP  381 H=  95:15 +CPU=  9.337
  17:08:53 STEP  382 H=  95:30 +CPU=  8.943
  17:09:02 STEP  383 H=  95:45 +CPU=  8.855
  17:09:15 STEP  384 H=  96:00 +CPU= 12.795
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000384
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000384
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000288
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000288
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000288
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000300
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000300
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000300
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000312
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000312
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000312
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000324
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000324
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000324
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000336
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000336
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000336
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000348
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000348
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000348
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000360
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000360
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000360
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000372
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000372
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000372
Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a333_2016092300_15_991_12210786_2_r2131116941_3.zip
  17:09:24 STEP  385 H=  96:15 +CPU=  9.074
Uploading the intermediate file: upload_file_3.zip
  17:09:34 STEP  386 H=  96:30 +CPU=  9.557
  17:09:43 STEP  387 H=  96:45 +CPU=  8.863
  17:09:52 STEP  388 H=  97:00 +CPU=  9.052
  17:10:01 STEP  389 H=  97:15 +CPU=  8.992
  17:10:10 STEP  390 H=  97:30 +CPU=  8.942
  17:10:18 STEP  391 H=  97:45 +CPU=  8.784
  17:10:27 STEP  392 H=  98:00 +CPU=  9.035
  17:10:37 STEP  393 H=  98:15 +CPU=  9.184
  17:10:46 STEP  394 H=  98:30 +CPU=  8.911
  17:10:54 STEP  395 H=  98:45 +CPU=  8.908
  17:11:06 STEP  396 H=  99:00 +CPU= 11.237
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000396
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000396
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000396
  17:11:15 STEP  397 H=  99:15 +CPU=  8.971
  17:11:24 STEP  398 H=  99:30 +CPU=  8.912
  17:11:32 STEP  399 H=  99:45 +CPU=  8.839
  17:11:42 STEP  400 H= 100:00 +CPU=  9.161
  17:11:51 STEP  401 H= 100:15 +CPU=  8.938
  17:12:00 STEP  402 H= 100:30 +CPU=  8.948
  17:12:09 STEP  403 H= 100:45 +CPU=  9.081
  17:12:18 STEP  404 H= 101:00 +CPU=  9.050
  17:12:27 STEP  405 H= 101:15 +CPU=  8.878
  17:12:36 STEP  406 H= 101:30 +CPU=  8.972
  17:12:45 STEP  407 H= 101:45 +CPU=  8.989
  17:12:56 STEP  408 H= 102:00 +CPU= 11.282
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000408
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000408
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000408
  17:13:05 STEP  409 H= 102:15 +CPU=  8.928
  17:13:14 STEP  410 H= 102:30 +CPU=  8.879
  17:13:23 STEP  411 H= 102:45 +CPU=  8.894
  17:13:32 STEP  412 H= 103:00 +CPU=  9.317
  17:13:41 STEP  413 H= 103:15 +CPU=  8.873
  17:13:50 STEP  414 H= 103:30 +CPU=  9.209
  17:14:00 STEP  415 H= 103:45 +CPU=  9.813
  17:14:09 STEP  416 H= 104:00 +CPU=  9.360
  17:14:18 STEP  417 H= 104:15 +CPU=  9.034
  17:14:27 STEP  418 H= 104:30 +CPU=  9.185
  17:14:36 STEP  419 H= 104:45 +CPU=  9.015
  17:14:48 STEP  420 H= 105:00 +CPU= 11.115
  17:14:56 STEP  421 H= 105:15 +CPU=  8.927
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000420
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000420
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000420
  17:15:05 STEP  422 H= 105:30 +CPU=  8.937
  17:15:14 STEP  423 H= 105:45 +CPU=  8.759
  17:15:23 STEP  424 H= 106:00 +CPU=  8.997
  17:15:32 STEP  425 H= 106:15 +CPU=  8.940
  17:15:41 STEP  426 H= 106:30 +CPU=  8.945
  17:15:50 STEP  427 H= 106:45 +CPU=  8.928
  17:15:59 STEP  428 H= 107:00 +CPU=  9.092
  17:16:08 STEP  429 H= 107:15 +CPU=  8.797
  17:16:17 STEP  430 H= 107:30 +CPU=  8.830
  17:16:26 STEP  431 H= 107:45 +CPU=  8.896
  17:16:38 STEP  432 H= 108:00 +CPU= 12.478
  17:16:47 STEP  433 H= 108:15 +CPU=  8.841
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000432
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000432
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000432
  17:16:56 STEP  434 H= 108:30 +CPU=  8.892
  17:17:05 STEP  435 H= 108:45 +CPU=  8.871
  17:17:14 STEP  436 H= 109:00 +CPU=  9.038
  17:17:23 STEP  437 H= 109:15 +CPU=  8.949
  17:17:32 STEP  438 H= 109:30 +CPU=  9.036
  17:17:41 STEP  439 H= 109:45 +CPU=  8.898
  17:17:50 STEP  440 H= 110:00 +CPU=  9.129
  17:17:59 STEP  441 H= 110:15 +CPU=  8.908
  17:18:08 STEP  442 H= 110:30 +CPU=  8.789
  17:18:16 STEP  443 H= 110:45 +CPU=  8.954
  17:18:28 STEP  444 H= 111:00 +CPU= 11.525
  17:18:37 STEP  445 H= 111:15 +CPU=  9.177
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000444
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000444
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000444
  17:18:46 STEP  446 H= 111:30 +CPU=  8.978
  17:18:55 STEP  447 H= 111:45 +CPU=  9.016
  17:19:04 STEP  448 H= 112:00 +CPU=  9.230
  17:19:14 STEP  449 H= 112:15 +CPU=  9.088
  17:19:22 STEP  450 H= 112:30 +CPU=  8.948
  17:19:31 STEP  451 H= 112:45 +CPU=  8.866
  17:19:41 STEP  452 H= 113:00 +CPU=  9.294
  17:19:50 STEP  453 H= 113:15 +CPU=  8.912
  17:19:59 STEP  454 H= 113:30 +CPU=  8.944
  17:20:07 STEP  455 H= 113:45 +CPU=  8.898
  17:20:19 STEP  456 H= 114:00 +CPU= 11.172
  17:20:27 STEP  457 H= 114:15 +CPU=  8.848
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000456
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000456
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000456
  17:20:36 STEP  458 H= 114:30 +CPU=  8.824
  17:20:45 STEP  459 H= 114:45 +CPU=  8.801
  17:20:54 STEP  460 H= 115:00 +CPU=  9.080
  17:21:03 STEP  461 H= 115:15 +CPU=  8.869
  17:21:12 STEP  462 H= 115:30 +CPU=  8.842
  17:21:21 STEP  463 H= 115:45 +CPU=  8.937
  17:21:30 STEP  464 H= 116:00 +CPU=  9.122
  17:21:39 STEP  465 H= 116:15 +CPU=  8.923
  17:21:48 STEP  466 H= 116:30 +CPU=  8.950
  17:21:57 STEP  467 H= 116:45 +CPU=  8.871
  17:22:08 STEP  468 H= 117:00 +CPU= 11.239
  17:22:17 STEP  469 H= 117:15 +CPU=  8.830
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000468
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000468
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000468
  17:22:26 STEP  470 H= 117:30 +CPU=  8.952
  17:22:35 STEP  471 H= 117:45 +CPU=  8.951
  17:22:44 STEP  472 H= 118:00 +CPU=  9.419
  17:22:53 STEP  473 H= 118:15 +CPU=  8.989
  17:23:02 STEP  474 H= 118:30 +CPU=  9.093
  17:23:11 STEP  475 H= 118:45 +CPU=  8.935
  17:23:20 STEP  476 H= 119:00 +CPU=  9.099
  17:23:29 STEP  477 H= 119:15 +CPU=  9.075
  17:23:38 STEP  478 H= 119:30 +CPU=  9.058
  17:23:48 STEP  479 H= 119:45 +CPU=  9.155
  17:24:00 STEP  480 H= 120:00 +CPU= 12.615
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000480
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000480
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000384
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000384
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000396
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000396
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000396
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000408
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000408
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000408
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000420
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000420
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000420
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000432
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000432
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000432
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000444
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000444
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000444
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000456
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000456
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000456
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000468
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000468
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000468
Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a333_2016092300_15_991_12210786_2_r2131116941_4.zip
  17:24:09 STEP  481 H= 120:15 +CPU=  8.873
Uploading the intermediate file: upload_file_4.zip
  17:24:18 STEP  482 H= 120:30 +CPU=  9.047
  17:24:27 STEP  483 H= 120:45 +CPU=  8.838
  17:24:36 STEP  484 H= 121:00 +CPU=  9.149
  17:24:45 STEP  485 H= 121:15 +CPU=  8.853
  17:24:54 STEP  486 H= 121:30 +CPU=  8.876
  17:25:03 STEP  487 H= 121:45 +CPU=  8.939
  17:25:12 STEP  488 H= 122:00 +CPU=  9.203
  17:25:21 STEP  489 H= 122:15 +CPU=  8.910
  17:25:30 STEP  490 H= 122:30 +CPU=  8.962
  17:25:39 STEP  491 H= 122:45 +CPU=  9.062
  17:25:50 STEP  492 H= 123:00 +CPU= 11.244
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000492
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000492
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000492
  17:25:59 STEP  493 H= 123:15 +CPU=  9.146
  17:26:08 STEP  494 H= 123:30 +CPU=  8.920
  17:26:17 STEP  495 H= 123:45 +CPU=  8.879
  17:26:26 STEP  496 H= 124:00 +CPU=  9.049
  17:26:35 STEP  497 H= 124:15 +CPU=  8.813
  17:26:44 STEP  498 H= 124:30 +CPU=  8.876
  17:26:53 STEP  499 H= 124:45 +CPU=  8.944
  17:27:02 STEP  500 H= 125:00 +CPU=  9.410
  17:27:11 STEP  501 H= 125:15 +CPU=  8.927
  17:27:20 STEP  502 H= 125:30 +CPU=  8.899
  17:27:29 STEP  503 H= 125:45 +CPU=  8.962
  17:27:40 STEP  504 H= 126:00 +CPU= 11.329
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000504
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000504
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000504
  17:27:50 STEP  505 H= 126:15 +CPU=  9.213
  17:27:59 STEP  506 H= 126:30 +CPU=  9.387
  17:28:08 STEP  507 H= 126:45 +CPU=  8.939
  17:28:17 STEP  508 H= 127:00 +CPU=  8.801
  17:28:26 STEP  509 H= 127:15 +CPU=  8.729
  17:28:34 STEP  510 H= 127:30 +CPU=  8.609
  17:28:43 STEP  511 H= 127:45 +CPU=  8.615
  17:28:52 STEP  512 H= 128:00 +CPU=  8.812
  17:29:00 STEP  513 H= 128:15 +CPU=  8.648
  17:29:09 STEP  514 H= 128:30 +CPU=  8.565
  17:29:17 STEP  515 H= 128:45 +CPU=  8.562
  17:29:28 STEP  516 H= 129:00 +CPU= 10.924
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000516
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000516
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000516
  17:29:37 STEP  517 H= 129:15 +CPU=  8.584
  17:29:46 STEP  518 H= 129:30 +CPU=  8.691
  17:29:54 STEP  519 H= 129:45 +CPU=  8.622
  17:30:03 STEP  520 H= 130:00 +CPU=  8.817
  17:30:12 STEP  521 H= 130:15 +CPU=  8.569
  17:30:20 STEP  522 H= 130:30 +CPU=  8.601
  17:30:29 STEP  523 H= 130:45 +CPU=  8.700
  17:30:38 STEP  524 H= 131:00 +CPU=  8.786
  17:30:46 STEP  525 H= 131:15 +CPU=  8.618
  17:30:55 STEP  526 H= 131:30 +CPU=  8.641
  17:31:04 STEP  527 H= 131:45 +CPU=  8.665
  17:31:16 STEP  528 H= 132:00 +CPU= 12.314
  17:31:25 STEP  529 H= 132:15 +CPU=  8.645
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000528
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000528
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000528
  17:31:33 STEP  530 H= 132:30 +CPU=  8.606
  17:31:42 STEP  531 H= 132:45 +CPU=  9.011
  17:31:51 STEP  532 H= 133:00 +CPU=  9.190
  17:32:01 STEP  533 H= 133:15 +CPU=  9.123
  17:32:10 STEP  534 H= 133:30 +CPU=  9.176
  17:32:19 STEP  535 H= 133:45 +CPU=  9.163
  17:32:28 STEP  536 H= 134:00 +CPU=  9.179
  17:32:37 STEP  537 H= 134:15 +CPU=  9.029
  17:32:46 STEP  538 H= 134:30 +CPU=  8.918
  17:32:55 STEP  539 H= 134:45 +CPU=  8.999
  17:33:07 STEP  540 H= 135:00 +CPU= 11.674
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000540
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000540
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000540
  17:33:16 STEP  541 H= 135:15 +CPU=  9.110
  17:33:25 STEP  542 H= 135:30 +CPU=  9.044
  17:33:34 STEP  543 H= 135:45 +CPU=  9.095
  17:33:43 STEP  544 H= 136:00 +CPU=  9.218
  17:33:52 STEP  545 H= 136:15 +CPU=  8.935
  17:34:01 STEP  546 H= 136:30 +CPU=  9.031
  17:34:10 STEP  547 H= 136:45 +CPU=  8.935
  17:34:19 STEP  548 H= 137:00 +CPU=  9.214
  17:34:28 STEP  549 H= 137:15 +CPU=  8.981
  17:34:38 STEP  550 H= 137:30 +CPU=  9.178
  17:34:47 STEP  551 H= 137:45 +CPU=  9.030
  17:34:58 STEP  552 H= 138:00 +CPU= 11.444
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000552
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000552
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000552
  17:35:07 STEP  553 H= 138:15 +CPU=  8.935
  17:35:16 STEP  554 H= 138:30 +CPU=  8.944
  17:35:25 STEP  555 H= 138:45 +CPU=  8.994
  17:35:34 STEP  556 H= 139:00 +CPU=  9.129
  17:35:43 STEP  557 H= 139:15 +CPU=  8.871
  17:35:52 STEP  558 H= 139:30 +CPU=  8.865
  17:36:01 STEP  559 H= 139:45 +CPU=  8.985
  17:36:10 STEP  560 H= 140:00 +CPU=  9.218
  17:36:19 STEP  561 H= 140:15 +CPU=  8.943
  17:36:28 STEP  562 H= 140:30 +CPU=  8.962
  17:36:37 STEP  563 H= 140:45 +CPU=  8.882
  17:36:48 STEP  564 H= 141:00 +CPU= 11.479
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000564
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000564
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000564
  17:36:57 STEP  565 H= 141:15 +CPU=  8.930
  17:37:06 STEP  566 H= 141:30 +CPU=  8.924
  17:37:15 STEP  567 H= 141:45 +CPU=  8.947
  17:37:24 STEP  568 H= 142:00 +CPU=  9.226
  17:37:33 STEP  569 H= 142:15 +CPU=  9.092
  17:37:43 STEP  570 H= 142:30 +CPU=  9.345
  17:37:52 STEP  571 H= 142:45 +CPU=  9.140
  17:38:01 STEP  572 H= 143:00 +CPU=  9.385
  17:38:11 STEP  573 H= 143:15 +CPU=  9.157
  17:38:20 STEP  574 H= 143:30 +CPU=  9.092
  17:38:29 STEP  575 H= 143:45 +CPU=  8.946
  17:38:42 STEP  576 H= 144:00 +CPU= 12.953
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000576
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000576
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000480
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000480
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000492
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000492
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000492
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000504
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000504
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000504
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000516
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000516
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000516
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000528
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000528
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000528
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000540
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000540
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000540
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000552
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000552
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000552
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000564
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000564
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000564
Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a333_2016092300_15_991_12210786_2_r2131116941_5.zip
  17:38:51 STEP  577 H= 144:15 +CPU=  9.141
Uploading the intermediate file: upload_file_5.zip
  17:39:00 STEP  578 H= 144:30 +CPU=  9.032
  17:39:09 STEP  579 H= 144:45 +CPU=  9.265
  17:39:18 STEP  580 H= 145:00 +CPU=  9.487
  17:39:28 STEP  581 H= 145:15 +CPU=  9.236
  17:39:37 STEP  582 H= 145:30 +CPU=  9.422
  17:39:46 STEP  583 H= 145:45 +CPU=  9.046
  17:39:55 STEP  584 H= 146:00 +CPU=  9.256
  17:40:04 STEP  585 H= 146:15 +CPU=  8.958
  17:40:13 STEP  586 H= 146:30 +CPU=  9.058
  17:40:23 STEP  587 H= 146:45 +CPU=  9.077
  17:40:34 STEP  588 H= 147:00 +CPU= 11.161
  17:40:43 STEP  589 H= 147:15 +CPU=  8.851
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000588
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000588
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000588
  17:40:52 STEP  590 H= 147:30 +CPU=  9.069
  17:41:01 STEP  591 H= 147:45 +CPU=  9.079
  17:41:10 STEP  592 H= 148:00 +CPU=  9.114
  17:41:19 STEP  593 H= 148:15 +CPU=  8.945
  17:41:28 STEP  594 H= 148:30 +CPU=  8.970
  17:41:37 STEP  595 H= 148:45 +CPU=  8.964
  17:41:46 STEP  596 H= 149:00 +CPU=  9.153
  17:41:55 STEP  597 H= 149:15 +CPU=  9.130
  17:42:04 STEP  598 H= 149:30 +CPU=  9.095
  17:42:13 STEP  599 H= 149:45 +CPU=  9.073
  17:42:25 STEP  600 H= 150:00 +CPU= 11.388
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000600
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000600
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000600
  17:42:34 STEP  601 H= 150:15 +CPU=  9.113
  17:42:43 STEP  602 H= 150:30 +CPU=  9.078
  17:42:52 STEP  603 H= 150:45 +CPU=  8.879
  17:43:01 STEP  604 H= 151:00 +CPU=  9.163
  17:43:10 STEP  605 H= 151:15 +CPU=  8.961
  17:43:19 STEP  606 H= 151:30 +CPU=  8.948
  17:43:28 STEP  607 H= 151:45 +CPU=  8.996
  17:43:37 STEP  608 H= 152:00 +CPU=  9.160
  17:43:46 STEP  609 H= 152:15 +CPU=  9.089
  17:43:55 STEP  610 H= 152:30 +CPU=  9.061
  17:44:04 STEP  611 H= 152:45 +CPU=  8.945
  17:44:15 STEP  612 H= 153:00 +CPU= 11.227
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000612
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000612
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000612
  17:44:24 STEP  613 H= 153:15 +CPU=  9.029
  17:44:33 STEP  614 H= 153:30 +CPU=  8.943
  17:44:42 STEP  615 H= 153:45 +CPU=  9.022
  17:44:52 STEP  616 H= 154:00 +CPU=  9.196
  17:45:00 STEP  617 H= 154:15 +CPU=  8.909
  17:45:09 STEP  618 H= 154:30 +CPU=  8.954
  17:45:18 STEP  619 H= 154:45 +CPU=  8.921
  17:45:27 STEP  620 H= 155:00 +CPU=  9.168
  17:45:37 STEP  621 H= 155:15 +CPU=  9.087
  17:45:46 STEP  622 H= 155:30 +CPU=  9.134
  17:45:55 STEP  623 H= 155:45 +CPU=  9.256
  17:46:08 STEP  624 H= 156:00 +CPU= 13.124
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000624
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000624
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000624
  17:46:17 STEP  625 H= 156:15 +CPU=  9.169
  17:46:26 STEP  626 H= 156:30 +CPU=  9.014
  17:46:35 STEP  627 H= 156:45 +CPU=  9.071
  17:46:45 STEP  628 H= 157:00 +CPU=  9.475
  17:46:54 STEP  629 H= 157:15 +CPU=  9.576
  17:47:04 STEP  630 H= 157:30 +CPU=  9.161
  17:47:13 STEP  631 H= 157:45 +CPU=  9.046
  17:47:22 STEP  632 H= 158:00 +CPU=  9.313
  17:47:31 STEP  633 H= 158:15 +CPU=  9.025
  17:47:40 STEP  634 H= 158:30 +CPU=  9.117
  17:47:49 STEP  635 H= 158:45 +CPU=  9.204
  17:48:01 STEP  636 H= 159:00 +CPU= 11.249
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000636
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000636
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000636
  17:48:10 STEP  637 H= 159:15 +CPU=  9.008
  17:48:19 STEP  638 H= 159:30 +CPU=  9.236
  17:48:28 STEP  639 H= 159:45 +CPU=  9.290
  17:48:38 STEP  640 H= 160:00 +CPU=  9.454
  17:48:47 STEP  641 H= 160:15 +CPU=  9.410
  17:48:56 STEP  642 H= 160:30 +CPU=  9.254
  17:49:05 STEP  643 H= 160:45 +CPU=  9.179
  17:49:15 STEP  644 H= 161:00 +CPU=  9.092
  17:49:24 STEP  645 H= 161:15 +CPU=  9.069
  17:49:33 STEP  646 H= 161:30 +CPU=  9.357
  17:49:42 STEP  647 H= 161:45 +CPU=  9.026
  17:49:53 STEP  648 H= 162:00 +CPU= 11.243
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000648
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000648
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000648
  17:50:02 STEP  649 H= 162:15 +CPU=  9.021
  17:50:11 STEP  650 H= 162:30 +CPU=  9.014
  17:50:20 STEP  651 H= 162:45 +CPU=  9.087
  17:50:30 STEP  652 H= 163:00 +CPU=  9.346
  17:50:39 STEP  653 H= 163:15 +CPU=  9.062
  17:50:48 STEP  654 H= 163:30 +CPU=  9.107
  17:50:57 STEP  655 H= 163:45 +CPU=  9.134
  17:51:06 STEP  656 H= 164:00 +CPU=  9.167
  17:51:15 STEP  657 H= 164:15 +CPU=  9.001
  17:51:24 STEP  658 H= 164:30 +CPU=  8.983
  17:51:33 STEP  659 H= 164:45 +CPU=  9.084
  17:51:45 STEP  660 H= 165:00 +CPU= 11.265
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000660
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000660
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000660
  17:51:54 STEP  661 H= 165:15 +CPU=  8.981
  17:52:03 STEP  662 H= 165:30 +CPU=  9.175
  17:52:12 STEP  663 H= 165:45 +CPU=  9.030
  17:52:21 STEP  664 H= 166:00 +CPU=  9.226
  17:52:30 STEP  665 H= 166:15 +CPU=  9.068
  17:52:39 STEP  666 H= 166:30 +CPU=  8.998
  17:52:48 STEP  667 H= 166:45 +CPU=  9.089
  17:52:58 STEP  668 H= 167:00 +CPU=  9.362
  17:53:07 STEP  669 H= 167:15 +CPU=  9.016
  17:53:16 STEP  670 H= 167:30 +CPU=  9.150
  17:53:25 STEP  671 H= 167:45 +CPU=  8.979
  17:53:38 STEP  672 H= 168:00 +CPU= 12.747
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000672
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000672
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000576
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000576
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000588
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000588
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000588
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000600
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000600
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000600
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000612
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000612
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000612
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000624
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000624
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000624
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000636
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000636
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000636
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000648
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000648
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000648
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMGGh7zg+000660
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMSHh7zg+000660
Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12210786/ICMUAh7zg+000660
Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a333_2016092300_15_991_12210786_2_r2131116941_6.zip
  17:53:47 STEP  673 H= 168:15 +CPU=  9.145
Uploading the intermediate file: upload_file_6.zip
  17:53:56 STEP  674 H= 168:30 +CPU=  9.316
  17:54:05 STEP  675 H= 168:45 +CPU=  9.008
  17:54:14 STEP  676 H= 169:00 +CPU=  9.336
  17:54:23 STEP  677 H= 169:15 +CPU=  9.137
  17:54:33 STEP  678 H= 169:30 +CPU=  9.113
  17:54:42 STEP  679 H= 169:45 +CPU=  9.221
  17:54:51 STEP  680 H= 170:00 +CPU=  9.226
  17:55:00 STEP  681 H= 170:15 +CPU=  9.077
  17:55:09 STEP  682 H= 170:30 +CPU=  9.252
  17:55:18 STEP  683 H= 170:45 +CPU=  8.975
  17:55:30 STEP  684 H= 171:00 +CPU= 11.539
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000684
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000684
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000684
  17:55:39 STEP  685 H= 171:15 +CPU=  9.071
  17:55:48 STEP  686 H= 171:30 +CPU=  9.114
  17:55:57 STEP  687 H= 171:45 +CPU=  9.074
  17:56:07 STEP  688 H= 172:00 +CPU=  9.461
  17:56:16 STEP  689 H= 172:15 +CPU=  8.989
  17:56:25 STEP  690 H= 172:30 +CPU=  9.268
  17:56:34 STEP  691 H= 172:45 +CPU=  9.217
  17:56:43 STEP  692 H= 173:00 +CPU=  9.156
  17:56:52 STEP  693 H= 173:15 +CPU=  9.057
  17:57:01 STEP  694 H= 173:30 +CPU=  8.997
  17:57:10 STEP  695 H= 173:45 +CPU=  9.055
  17:57:22 STEP  696 H= 174:00 +CPU= 11.695
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000696
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000696
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000696
  17:57:31 STEP  697 H= 174:15 +CPU=  9.168
  17:57:41 STEP  698 H= 174:30 +CPU=  9.319
  17:57:50 STEP  699 H= 174:45 +CPU=  9.221
  17:57:59 STEP  700 H= 175:00 +CPU=  9.315
  17:58:08 STEP  701 H= 175:15 +CPU=  9.108
  17:58:18 STEP  702 H= 175:30 +CPU=  9.239
  17:58:27 STEP  703 H= 175:45 +CPU=  9.310
  17:58:36 STEP  704 H= 176:00 +CPU=  9.449
  17:58:45 STEP  705 H= 176:15 +CPU=  9.065
  17:58:55 STEP  706 H= 176:30 +CPU=  9.157
  17:59:04 STEP  707 H= 176:45 +CPU=  8.968
  17:59:15 STEP  708 H= 177:00 +CPU= 11.330
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000708
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000708
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000708
  17:59:24 STEP  709 H= 177:15 +CPU=  9.255
  17:59:33 STEP  710 H= 177:30 +CPU=  9.136
  17:59:42 STEP  711 H= 177:45 +CPU=  9.046
  17:59:52 STEP  712 H= 178:00 +CPU=  9.287
  18:00:01 STEP  713 H= 178:15 +CPU=  9.108
  18:00:10 STEP  714 H= 178:30 +CPU=  9.040
  18:00:19 STEP  715 H= 178:45 +CPU=  9.141
  18:00:28 STEP  716 H= 179:00 +CPU=  9.240
  18:00:37 STEP  717 H= 179:15 +CPU=  9.258
  18:00:47 STEP  718 H= 179:30 +CPU=  9.346
  18:00:56 STEP  719 H= 179:45 +CPU=  9.131
  18:01:09 STEP  720 H= 180:00 +CPU= 12.806
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000720
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000720
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000720
  18:01:18 STEP  721 H= 180:15 +CPU=  9.080
  18:01:27 STEP  722 H= 180:30 +CPU=  9.092
  18:01:36 STEP  723 H= 180:45 +CPU=  9.127
  18:01:45 STEP  724 H= 181:00 +CPU=  9.229
  18:01:55 STEP  725 H= 181:15 +CPU=  9.154
  18:02:04 STEP  726 H= 181:30 +CPU=  9.348
  18:02:13 STEP  727 H= 181:45 +CPU=  9.050
  18:02:22 STEP  728 H= 182:00 +CPU=  9.241
  18:02:31 STEP  729 H= 182:15 +CPU=  9.193
  18:02:40 STEP  730 H= 182:30 +CPU=  8.917
  18:02:49 STEP  731 H= 182:45 +CPU=  8.990
  18:03:01 STEP  732 H= 183:00 +CPU= 11.283
  18:03:10 STEP  733 H= 183:15 +CPU=  9.045
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMGGh7zg+000732
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMSHh7zg+000732
Moving to projects directory: /var/lib/boinc-client-cpdn/slots/0/ICMUAh7zg+000732
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4362MB (heap), 5076MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 4362 MB (maxheap), 5076 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180317:1677020597:6792.707] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client-cpdn/slots/0/oifs_43r3_model.exe' : sigcontextptr=0x7ffecfbb1f10
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client-cpdn/slots/0/oifs_43r3_model.exe' 0x838803 0x838e09 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc4a8f] : __libm_exp_e7() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x12d283b] : vdfmain_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12ba8d9] : vdfouter_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12b0762] : turbulence_layer_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x1163fc3] : callpar_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x10b682f] : ec_phys_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10a915c] : ec_phys_drv_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xe680c3] : gp_model_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x15c1e62] : gp_model_heap_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15ac40e] : scan2m_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x6620b4] : stepo_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4a0e7c] : cnt4_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x49dc29] : cnt3_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49ce72] : cnt2_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49cd68] : cnt1_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x4078ad] : cnt0_() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x40276f] : MAIN__() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40270d] : main() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d840d7] : __libc_start_main_impl() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x4025e5] : _start() at ??:?
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.707] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client-cpdn/slots/0/oifs_43r3_model.exe' : sigcontextptr=0x7ffecfbb1e20
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client-cpdn/slots/0/oifs_43r3_model.exe' 0x838803 0x838e09 0x820d70 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x820d70] : signal_drhook() at drhook.c:1734
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc4a8f] : __libm_exp_e7() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12d283b] : vdfmain_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12ba8d9] : vdfouter_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x12b0762] : turbulence_layer_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x1163fc3] : callpar_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10b682f] : ec_phys_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x10a915c] : ec_phys_drv_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xe680c3] : gp_model_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15c1e62] : gp_model_heap_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x15ac40e] : scan2m_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x6620b4] : stepo_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4a0e7c] : cnt4_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49dc29] : cnt3_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49ce72] : cnt2_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49cd68] : cnt1_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x4078ad] : cnt0_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40276f] : MAIN__() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x40270d] : main() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1d840d7] : __libc_start_main_impl() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x4025e5] : _start() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.760] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:ava:1:1:81601:81601] [20230221:180318:1677020598:6793.760] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  000000000081FCF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8BB20  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC4A8F  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000012D283B  vdfmain_                  874  vdfmain.F90
oifs_43r3_model.e  00000000012BA8D9  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  00000000012B0762  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000001163FC3  callpar_                  869  callpar.F90
oifs_43r3_model.e  00000000010B682F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  00000000010A915C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000E680C3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000015C1E62  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  00000000015AC40E  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  00000000006620B4  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004A0E7C  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  000000000049DC29  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  000000000049CE72  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049CD68  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  00000000004078AD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040276F  MAIN__                     96  master.F90
oifs_43r3_model.e  000000000040270D  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8287A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D840D7  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000004025E5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

         990  9.999999999999998E-005
 GPNORM  HUMIDITY            AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.219923262598873E-02 0.999999999847186E-08 0.236498190575025E-01
 GPNORM  LIQUID WATER        AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.121790719572238E-05 0.000000000000000E+00 0.366941748965868E-02
 GPNORM  ICE WATER           AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.613797956766159E-05 0.000000000000000E+00 0.499193015397772E-02
 GPNORM SNOW                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.150652778931136E-04 0.000000000000000E+00 0.122089477168430E-01
 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.106259788367838E-05 0.000000000000000E+00 0.384571993463874E-02
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.265890970071532E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.121037606569765E-05 0.000000000000000E+00 0.364144296739943E-02
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.613324974522981E-05 0.000000000000000E+00 0.486876983685938E-02
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.265621562391332E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.419345368462396E-05 0.000000000000000E+00 0.157780174906249E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.565498967285199E-05 0.000000000000000E+00 0.571404597355742E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.148409298305152E-05 0.000000000000000E+00 0.229338887835134E-02
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.614126721761765E-06 0.000000000000000E+00 0.200021826999378E-02
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.161370113504164E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   732 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   732 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000732 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000732
 MPI-TASK:   1 -    319092026 BYTES IN      6 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0036( 5.6%)
 NSTEP =   732 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000732 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+000732
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0037 SECONDS191287.9 Mbytes/s, TOTAL TIME=    0.0967( 3.8%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000732 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000732
 MPI-TASK:   1 -   5105472407 BYTES IN    125 RECORDS TRANSFERRED IN    0.0023 SECONDS******** Mbytes/s, TOTAL TIME=    0.0815( 2.8%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000732 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000732
 MPI-TASK:   1 -    310518393 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0016( 6.2%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000732 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000732
 MPI-TASK:   1 -    319092026 BYTES IN      4 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0026( 3.8%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =   732 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   732 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000732 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000732
 MPI-TASK:   1 -    319092017 BYTES IN      7 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0042( 4.8%)
 18:03:01 STEP  732 H= 183:00 +CPU= 11.283
 NSTEP =   733 STEPO   0AAA00AAA
 18:03:10 STEP  733 H= 183:15 +CPU=  9.045
 NSTEP =   734 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 18:02:49 0AA000000 STEPO      732     0.008    0.008    0.008    112:41    112:45 0.20043384012247E-04       2GB       0MB
 18:02:50 FULLPOS-B DYNFPOS    732     0.509    0.509    0.509    112:41    112:45 0.20043384012247E-04       2GB       0MB
 18:02:51 FULLPOS-V DYNFPOS    732     1.086    1.086    1.087    112:42    112:47 0.20043384012247E-04       2GB       0MB
 18:02:51 FULLPOS-T DYNFPOS    732     0.212    0.212    0.212    112:43    112:47 0.20043384012247E-04       2GB       0MB
 18:02:51 0AAA00AAA STEPO      732     0.211    0.211    0.211    112:43    112:47 0.20043384012247E-04       2GB       0MB
 18:03:01 0AAA00AAA STEPO      733     9.177    9.177    9.188    112:52    112:56 0.20043384012247E-04       2GB       0MB
 18:03:10 0AAA00AAA STEPO      734     9.045    9.045    9.062    113:01    113:05 0.20043384012247E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     720",
 CTIME   = "00071200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         708, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client-cpdn/slots/0/progress_file_12210786.xml

<running_values>
  <last_cpu_time>6781.340000</last_cpu_time>
  <upload_file_number>7</upload_file_number>
  <last_iter>734</last_iter>
  <last_upload>604800</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net