Name | oifs_43r3_bl_a4ey_2016092300_20_1018_12294049_1 |
Workunit | 12294049 |
Created | 13 Jun 2024, 19:58:00 UTC |
Sent | 13 Jun 2024, 20:01:40 UTC |
Report deadline | 12 Aug 2024, 20:01:40 UTC |
Received | 20 Jun 2024, 5:17:15 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1537173 |
Run time | 2 hours 5 min 42 sec |
CPU time | 2 hours 4 min 19 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 7.55 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.13 x86_64-pc-linux-gnu |
Peak working set size | 5,022.44 MB |
Peak swap size | 5,981.07 MB |
Peak disk usage | 1,365.57 MB |
Stderr | <core_client_version>7.18.1</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> teprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000324 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000336 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000336 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000336 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000348 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000348 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000348 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000360 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000360 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000360 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000372 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000372 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000372 Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_20_1018_12294049_1_r837151728_3.zip Uploading the intermediate file: upload_file_3.zip 23:16:02 STEP 386 H= 96:30 +CPU= 8.854 23:16:11 STEP 387 H= 96:45 +CPU= 8.834 23:16:20 STEP 388 H= 97:00 +CPU= 9.104 23:16:29 STEP 389 H= 97:15 +CPU= 8.774 23:16:38 STEP 390 H= 97:30 +CPU= 8.750 23:16:47 STEP 391 H= 97:45 +CPU= 8.750 23:16:56 STEP 392 H= 98:00 +CPU= 8.959 23:17:04 STEP 393 H= 98:15 +CPU= 8.770 23:17:13 STEP 394 H= 98:30 +CPU= 8.617 23:17:22 STEP 395 H= 98:45 +CPU= 8.699 23:17:33 STEP 396 H= 99:00 +CPU= 10.943 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000396 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000396 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000396 23:17:41 STEP 397 H= 99:15 +CPU= 8.736 23:17:50 STEP 398 H= 99:30 +CPU= 8.711 23:17:59 STEP 399 H= 99:45 +CPU= 8.716 23:18:08 STEP 400 H= 100:00 +CPU= 8.894 23:18:16 STEP 401 H= 100:15 +CPU= 8.715 23:18:25 STEP 402 H= 100:30 +CPU= 8.672 23:18:34 STEP 403 H= 100:45 +CPU= 8.718 23:18:43 STEP 404 H= 101:00 +CPU= 8.892 23:18:51 STEP 405 H= 101:15 +CPU= 8.780 23:19:00 STEP 406 H= 101:30 +CPU= 8.706 23:19:09 STEP 407 H= 101:45 +CPU= 8.809 23:19:20 STEP 408 H= 102:00 +CPU= 10.918 23:19:29 STEP 409 H= 102:15 +CPU= 8.767 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000408 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000408 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000408 23:19:37 STEP 410 H= 102:30 +CPU= 8.705 23:19:46 STEP 411 H= 102:45 +CPU= 8.794 23:19:55 STEP 412 H= 103:00 +CPU= 8.904 23:20:04 STEP 413 H= 103:15 +CPU= 8.687 23:20:13 STEP 414 H= 103:30 +CPU= 8.764 23:20:21 STEP 415 H= 103:45 +CPU= 8.815 23:20:30 STEP 416 H= 104:00 +CPU= 9.070 23:20:39 STEP 417 H= 104:15 +CPU= 8.813 23:20:48 STEP 418 H= 104:30 +CPU= 8.752 23:20:57 STEP 419 H= 104:45 +CPU= 8.824 23:21:08 STEP 420 H= 105:00 +CPU= 11.156 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000420 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000420 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000420 23:21:17 STEP 421 H= 105:15 +CPU= 8.756 23:21:26 STEP 422 H= 105:30 +CPU= 8.760 23:21:34 STEP 423 H= 105:45 +CPU= 8.761 23:21:43 STEP 424 H= 106:00 +CPU= 9.060 23:21:52 STEP 425 H= 106:15 +CPU= 8.851 23:22:01 STEP 426 H= 106:30 +CPU= 8.919 23:22:10 STEP 427 H= 106:45 +CPU= 8.912 23:22:19 STEP 428 H= 107:00 +CPU= 9.105 23:22:28 STEP 429 H= 107:15 +CPU= 8.697 23:22:37 STEP 430 H= 107:30 +CPU= 8.786 23:22:46 STEP 431 H= 107:45 +CPU= 8.955 23:22:58 STEP 432 H= 108:00 +CPU= 12.361 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000432 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000432 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000432 23:23:07 STEP 433 H= 108:15 +CPU= 8.757 23:23:16 STEP 434 H= 108:30 +CPU= 8.751 23:23:25 STEP 435 H= 108:45 +CPU= 8.895 23:23:33 STEP 436 H= 109:00 +CPU= 8.979 23:23:42 STEP 437 H= 109:15 +CPU= 8.828 23:23:51 STEP 438 H= 109:30 +CPU= 8.839 23:24:00 STEP 439 H= 109:45 +CPU= 8.843 23:24:09 STEP 440 H= 110:00 +CPU= 9.028 23:24:18 STEP 441 H= 110:15 +CPU= 8.706 23:24:27 STEP 442 H= 110:30 +CPU= 8.803 23:24:35 STEP 443 H= 110:45 +CPU= 8.753 23:24:46 STEP 444 H= 111:00 +CPU= 11.062 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000444 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000444 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000444 23:24:55 STEP 445 H= 111:15 +CPU= 8.853 23:25:04 STEP 446 H= 111:30 +CPU= 8.841 23:25:13 STEP 447 H= 111:45 +CPU= 8.855 23:25:22 STEP 448 H= 112:00 +CPU= 9.120 23:25:31 STEP 449 H= 112:15 +CPU= 8.904 23:25:40 STEP 450 H= 112:30 +CPU= 8.857 23:25:49 STEP 451 H= 112:45 +CPU= 8.899 23:25:58 STEP 452 H= 113:00 +CPU= 9.074 23:26:07 STEP 453 H= 113:15 +CPU= 8.912 23:26:16 STEP 454 H= 113:30 +CPU= 8.895 23:26:25 STEP 455 H= 113:45 +CPU= 8.886 23:26:36 STEP 456 H= 114:00 +CPU= 11.113 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000456 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000456 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000456 23:26:45 STEP 457 H= 114:15 +CPU= 8.823 23:26:53 STEP 458 H= 114:30 +CPU= 8.895 23:27:02 STEP 459 H= 114:45 +CPU= 8.917 23:27:11 STEP 460 H= 115:00 +CPU= 9.049 23:27:20 STEP 461 H= 115:15 +CPU= 8.898 23:27:29 STEP 462 H= 115:30 +CPU= 8.864 23:27:38 STEP 463 H= 115:45 +CPU= 8.794 23:27:47 STEP 464 H= 116:00 +CPU= 9.098 23:27:56 STEP 465 H= 116:15 +CPU= 8.875 23:28:05 STEP 466 H= 116:30 +CPU= 8.802 23:28:14 STEP 467 H= 116:45 +CPU= 8.912 23:28:25 STEP 468 H= 117:00 +CPU= 11.099 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000468 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000468 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000468 23:28:34 STEP 469 H= 117:15 +CPU= 8.861 23:28:43 STEP 470 H= 117:30 +CPU= 8.934 23:28:52 STEP 471 H= 117:45 +CPU= 8.890 23:29:01 STEP 472 H= 118:00 +CPU= 9.092 23:29:09 STEP 473 H= 118:15 +CPU= 8.875 23:29:18 STEP 474 H= 118:30 +CPU= 8.881 23:29:27 STEP 475 H= 118:45 +CPU= 8.914 23:29:36 STEP 476 H= 119:00 +CPU= 9.096 23:29:45 STEP 477 H= 119:15 +CPU= 8.926 23:29:54 STEP 478 H= 119:30 +CPU= 8.913 23:30:03 STEP 479 H= 119:45 +CPU= 8.908 23:30:16 STEP 480 H= 120:00 +CPU= 12.596 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000480 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000480 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000480 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000384 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000384 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000384 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000396 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000396 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000396 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000408 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000408 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000408 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000420 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000420 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000420 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000432 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000432 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000432 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000444 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000444 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000444 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000456 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000456 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000456 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000468 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000468 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000468 Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_20_1018_12294049_1_r837151728_4.zip 23:30:25 STEP 481 H= 120:15 +CPU= 8.966 Uploading the intermediate file: upload_file_4.zip 23:30:34 STEP 482 H= 120:30 +CPU= 8.917 23:30:43 STEP 483 H= 120:45 +CPU= 8.929 23:30:52 STEP 484 H= 121:00 +CPU= 9.013 23:31:01 STEP 485 H= 121:15 +CPU= 8.910 23:31:10 STEP 486 H= 121:30 +CPU= 8.963 23:31:18 STEP 487 H= 121:45 +CPU= 8.958 23:31:28 STEP 488 H= 122:00 +CPU= 9.218 23:31:37 STEP 489 H= 122:15 +CPU= 9.101 23:31:46 STEP 490 H= 122:30 +CPU= 8.978 23:31:55 STEP 491 H= 122:45 +CPU= 9.070 23:32:06 STEP 492 H= 123:00 +CPU= 11.224 23:32:15 STEP 493 H= 123:15 +CPU= 8.957 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000492 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000492 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000492 23:32:24 STEP 494 H= 123:30 +CPU= 8.925 23:32:33 STEP 495 H= 123:45 +CPU= 9.101 23:32:42 STEP 496 H= 124:00 +CPU= 9.191 23:32:51 STEP 497 H= 124:15 +CPU= 8.882 23:33:00 STEP 498 H= 124:30 +CPU= 8.859 23:33:09 STEP 499 H= 124:45 +CPU= 9.013 23:33:18 STEP 500 H= 125:00 +CPU= 9.183 23:33:27 STEP 501 H= 125:15 +CPU= 9.006 23:33:36 STEP 502 H= 125:30 +CPU= 8.901 23:33:45 STEP 503 H= 125:45 +CPU= 8.896 23:33:56 STEP 504 H= 126:00 +CPU= 11.127 23:34:05 STEP 505 H= 126:15 +CPU= 8.977 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000504 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000504 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000504 23:34:14 STEP 506 H= 126:30 +CPU= 9.016 23:34:23 STEP 507 H= 126:45 +CPU= 9.074 23:34:32 STEP 508 H= 127:00 +CPU= 9.168 23:34:41 STEP 509 H= 127:15 +CPU= 8.928 23:34:50 STEP 510 H= 127:30 +CPU= 8.925 23:34:59 STEP 511 H= 127:45 +CPU= 9.063 23:35:09 STEP 512 H= 128:00 +CPU= 9.347 23:35:18 STEP 513 H= 128:15 +CPU= 9.090 23:35:27 STEP 514 H= 128:30 +CPU= 9.182 23:35:36 STEP 515 H= 128:45 +CPU= 9.141 23:35:48 STEP 516 H= 129:00 +CPU= 11.454 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000516 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000516 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000516 23:35:57 STEP 517 H= 129:15 +CPU= 9.098 23:36:06 STEP 518 H= 129:30 +CPU= 9.067 23:36:15 STEP 519 H= 129:45 +CPU= 9.104 23:36:24 STEP 520 H= 130:00 +CPU= 9.235 23:36:33 STEP 521 H= 130:15 +CPU= 9.012 23:36:42 STEP 522 H= 130:30 +CPU= 9.073 23:36:52 STEP 523 H= 130:45 +CPU= 9.091 23:37:01 STEP 524 H= 131:00 +CPU= 9.349 23:37:10 STEP 525 H= 131:15 +CPU= 9.159 23:37:19 STEP 526 H= 131:30 +CPU= 9.177 23:37:29 STEP 527 H= 131:45 +CPU= 9.268 23:37:41 STEP 528 H= 132:00 +CPU= 12.888 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000528 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000528 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000528 23:37:51 STEP 529 H= 132:15 +CPU= 9.119 23:38:00 STEP 530 H= 132:30 +CPU= 9.079 23:38:09 STEP 531 H= 132:45 +CPU= 9.063 23:38:18 STEP 532 H= 133:00 +CPU= 9.342 23:38:28 STEP 533 H= 133:15 +CPU= 9.348 23:38:37 STEP 534 H= 133:30 +CPU= 9.427 23:38:46 STEP 535 H= 133:45 +CPU= 9.192 23:38:56 STEP 536 H= 134:00 +CPU= 9.276 23:39:05 STEP 537 H= 134:15 +CPU= 9.080 23:39:14 STEP 538 H= 134:30 +CPU= 9.104 23:39:23 STEP 539 H= 134:45 +CPU= 9.087 23:39:34 STEP 540 H= 135:00 +CPU= 11.410 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000540 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000540 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000540 23:39:43 STEP 541 H= 135:15 +CPU= 9.119 23:39:53 STEP 542 H= 135:30 +CPU= 9.147 23:40:02 STEP 543 H= 135:45 +CPU= 9.051 23:40:11 STEP 544 H= 136:00 +CPU= 9.331 23:40:20 STEP 545 H= 136:15 +CPU= 9.165 23:40:29 STEP 546 H= 136:30 +CPU= 9.186 23:40:39 STEP 547 H= 136:45 +CPU= 9.174 23:40:48 STEP 548 H= 137:00 +CPU= 9.400 23:40:57 STEP 549 H= 137:15 +CPU= 9.176 23:41:07 STEP 550 H= 137:30 +CPU= 9.354 23:41:16 STEP 551 H= 137:45 +CPU= 9.165 23:41:27 STEP 552 H= 138:00 +CPU= 11.452 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000552 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000552 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000552 23:41:36 STEP 553 H= 138:15 +CPU= 9.102 23:41:45 STEP 554 H= 138:30 +CPU= 9.061 23:41:55 STEP 555 H= 138:45 +CPU= 9.165 23:42:04 STEP 556 H= 139:00 +CPU= 9.371 23:42:13 STEP 557 H= 139:15 +CPU= 9.175 23:42:22 STEP 558 H= 139:30 +CPU= 9.202 23:42:32 STEP 559 H= 139:45 +CPU= 9.221 23:42:41 STEP 560 H= 140:00 +CPU= 9.329 23:42:50 STEP 561 H= 140:15 +CPU= 9.209 23:42:59 STEP 562 H= 140:30 +CPU= 9.201 23:43:09 STEP 563 H= 140:45 +CPU= 9.134 23:43:20 STEP 564 H= 141:00 +CPU= 11.419 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000564 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000564 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000564 23:43:29 STEP 565 H= 141:15 +CPU= 9.086 23:43:38 STEP 566 H= 141:30 +CPU= 9.144 23:43:48 STEP 567 H= 141:45 +CPU= 9.152 23:43:57 STEP 568 H= 142:00 +CPU= 9.460 23:44:06 STEP 569 H= 142:15 +CPU= 9.252 23:44:15 STEP 570 H= 142:30 +CPU= 9.218 23:44:25 STEP 571 H= 142:45 +CPU= 9.132 23:44:34 STEP 572 H= 143:00 +CPU= 9.441 23:44:43 STEP 573 H= 143:15 +CPU= 9.355 23:44:53 STEP 574 H= 143:30 +CPU= 9.173 23:45:02 STEP 575 H= 143:45 +CPU= 9.290 23:45:15 STEP 576 H= 144:00 +CPU= 12.766 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000576 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000576 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000576 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000480 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000480 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000480 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000492 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000492 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000492 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000504 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000504 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000504 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000516 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000516 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000516 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000528 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000528 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000528 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000540 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000540 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000540 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000552 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000552 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000552 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000564 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000564 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000564 Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_20_1018_12294049_1_r837151728_5.zip Uploading the intermediate file: upload_file_5.zip 23:45:24 STEP 577 H= 144:15 +CPU= 9.323 23:45:33 STEP 578 H= 144:30 +CPU= 9.246 23:45:43 STEP 579 H= 144:45 +CPU= 9.312 23:45:52 STEP 580 H= 145:00 +CPU= 9.372 23:46:01 STEP 581 H= 145:15 +CPU= 9.280 23:46:11 STEP 582 H= 145:30 +CPU= 9.210 23:46:20 STEP 583 H= 145:45 +CPU= 9.271 23:46:29 STEP 584 H= 146:00 +CPU= 9.414 23:46:39 STEP 585 H= 146:15 +CPU= 9.186 23:46:48 STEP 586 H= 146:30 +CPU= 9.177 23:46:57 STEP 587 H= 146:45 +CPU= 9.233 23:47:09 STEP 588 H= 147:00 +CPU= 11.506 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000588 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000588 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000588 23:47:18 STEP 589 H= 147:15 +CPU= 9.321 23:47:27 STEP 590 H= 147:30 +CPU= 9.371 23:47:37 STEP 591 H= 147:45 +CPU= 9.322 23:47:46 STEP 592 H= 148:00 +CPU= 9.498 23:47:55 STEP 593 H= 148:15 +CPU= 9.220 23:48:05 STEP 594 H= 148:30 +CPU= 9.212 23:48:14 STEP 595 H= 148:45 +CPU= 9.319 23:48:23 STEP 596 H= 149:00 +CPU= 9.464 23:48:33 STEP 597 H= 149:15 +CPU= 9.258 23:48:42 STEP 598 H= 149:30 +CPU= 9.168 23:48:51 STEP 599 H= 149:45 +CPU= 9.278 23:49:03 STEP 600 H= 150:00 +CPU= 11.666 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000600 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000600 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000600 23:49:12 STEP 601 H= 150:15 +CPU= 9.309 23:49:21 STEP 602 H= 150:30 +CPU= 9.293 23:49:31 STEP 603 H= 150:45 +CPU= 9.446 23:49:40 STEP 604 H= 151:00 +CPU= 9.495 23:49:50 STEP 605 H= 151:15 +CPU= 9.234 23:49:59 STEP 606 H= 151:30 +CPU= 9.306 23:50:08 STEP 607 H= 151:45 +CPU= 9.285 23:50:18 STEP 608 H= 152:00 +CPU= 9.543 23:50:27 STEP 609 H= 152:15 +CPU= 9.335 23:50:36 STEP 610 H= 152:30 +CPU= 9.184 23:50:46 STEP 611 H= 152:45 +CPU= 9.360 23:50:57 STEP 612 H= 153:00 +CPU= 11.635 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000612 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000612 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000612 23:51:07 STEP 613 H= 153:15 +CPU= 9.299 23:51:16 STEP 614 H= 153:30 +CPU= 9.347 23:51:26 STEP 615 H= 153:45 +CPU= 9.482 23:51:35 STEP 616 H= 154:00 +CPU= 9.612 23:51:45 STEP 617 H= 154:15 +CPU= 9.410 23:51:54 STEP 618 H= 154:30 +CPU= 9.326 23:52:03 STEP 619 H= 154:45 +CPU= 9.286 23:52:13 STEP 620 H= 155:00 +CPU= 9.535 23:52:22 STEP 621 H= 155:15 +CPU= 9.281 23:52:32 STEP 622 H= 155:30 +CPU= 9.371 23:52:41 STEP 623 H= 155:45 +CPU= 9.400 23:52:54 STEP 624 H= 156:00 +CPU= 12.981 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000624 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000624 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000624 23:53:03 STEP 625 H= 156:15 +CPU= 9.363 23:53:13 STEP 626 H= 156:30 +CPU= 9.344 23:53:22 STEP 627 H= 156:45 +CPU= 9.442 23:53:32 STEP 628 H= 157:00 +CPU= 9.727 23:53:41 STEP 629 H= 157:15 +CPU= 9.376 23:53:51 STEP 630 H= 157:30 +CPU= 9.475 23:54:00 STEP 631 H= 157:45 +CPU= 9.444 23:54:10 STEP 632 H= 158:00 +CPU= 9.580 23:54:19 STEP 633 H= 158:15 +CPU= 9.350 23:54:29 STEP 634 H= 158:30 +CPU= 9.340 23:54:38 STEP 635 H= 158:45 +CPU= 9.288 23:54:50 STEP 636 H= 159:00 +CPU= 11.615 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000636 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000636 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000636 23:54:59 STEP 637 H= 159:15 +CPU= 9.472 23:55:08 STEP 638 H= 159:30 +CPU= 9.419 23:55:18 STEP 639 H= 159:45 +CPU= 9.398 23:55:27 STEP 640 H= 160:00 +CPU= 9.568 23:55:37 STEP 641 H= 160:15 +CPU= 9.320 23:55:46 STEP 642 H= 160:30 +CPU= 9.377 23:55:56 STEP 643 H= 160:45 +CPU= 9.430 23:56:05 STEP 644 H= 161:00 +CPU= 9.580 23:56:15 STEP 645 H= 161:15 +CPU= 9.535 23:56:24 STEP 646 H= 161:30 +CPU= 9.461 23:56:34 STEP 647 H= 161:45 +CPU= 9.379 23:56:45 STEP 648 H= 162:00 +CPU= 11.707 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000648 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000648 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000648 23:56:55 STEP 649 H= 162:15 +CPU= 9.574 23:57:05 STEP 650 H= 162:30 +CPU= 9.594 23:57:14 STEP 651 H= 162:45 +CPU= 9.436 23:57:24 STEP 652 H= 163:00 +CPU= 9.555 23:57:33 STEP 653 H= 163:15 +CPU= 9.360 23:57:42 STEP 654 H= 163:30 +CPU= 9.319 23:57:52 STEP 655 H= 163:45 +CPU= 9.407 23:58:01 STEP 656 H= 164:00 +CPU= 9.608 23:58:11 STEP 657 H= 164:15 +CPU= 9.451 23:58:20 STEP 658 H= 164:30 +CPU= 9.364 23:58:30 STEP 659 H= 164:45 +CPU= 9.456 23:58:42 STEP 660 H= 165:00 +CPU= 11.767 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000660 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000660 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000660 23:58:51 STEP 661 H= 165:15 +CPU= 9.417 23:59:00 STEP 662 H= 165:30 +CPU= 9.394 23:59:10 STEP 663 H= 165:45 +CPU= 9.484 23:59:20 STEP 664 H= 166:00 +CPU= 9.664 23:59:29 STEP 665 H= 166:15 +CPU= 9.508 23:59:39 STEP 666 H= 166:30 +CPU= 9.693 23:59:48 STEP 667 H= 166:45 +CPU= 9.514 23:59:58 STEP 668 H= 167:00 +CPU= 9.645 00:00:08 STEP 669 H= 167:15 +CPU= 9.449 00:00:17 STEP 670 H= 167:30 +CPU= 9.629 00:00:27 STEP 671 H= 167:45 +CPU= 9.640 00:00:40 STEP 672 H= 168:00 +CPU= 13.100 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000672 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000672 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000672 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000576 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000576 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000576 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000588 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000588 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000588 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000600 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000600 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000600 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000612 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000612 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000612 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000624 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000624 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000624 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000636 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000636 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000636 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000648 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000648 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000648 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000660 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000660 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000660 Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_20_1018_12294049_1_r837151728_6.zip Uploading the intermediate file: upload_file_6.zip 00:00:50 STEP 673 H= 168:15 +CPU= 9.570 00:00:59 STEP 674 H= 168:30 +CPU= 9.536 00:01:09 STEP 675 H= 168:45 +CPU= 9.483 00:01:18 STEP 676 H= 169:00 +CPU= 9.705 00:01:28 STEP 677 H= 169:15 +CPU= 9.677 00:01:38 STEP 678 H= 169:30 +CPU= 9.614 00:01:47 STEP 679 H= 169:45 +CPU= 9.685 00:01:57 STEP 680 H= 170:00 +CPU= 9.723 00:02:07 STEP 681 H= 170:15 +CPU= 9.487 00:02:16 STEP 682 H= 170:30 +CPU= 9.490 00:02:26 STEP 683 H= 170:45 +CPU= 9.596 00:02:38 STEP 684 H= 171:00 +CPU= 11.799 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000684 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000684 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000684 00:02:47 STEP 685 H= 171:15 +CPU= 9.543 00:02:57 STEP 686 H= 171:30 +CPU= 9.559 00:03:06 STEP 687 H= 171:45 +CPU= 9.519 00:03:16 STEP 688 H= 172:00 +CPU= 9.812 00:03:26 STEP 689 H= 172:15 +CPU= 9.648 00:03:35 STEP 690 H= 172:30 +CPU= 9.529 00:03:45 STEP 691 H= 172:45 +CPU= 9.528 00:03:55 STEP 692 H= 173:00 +CPU= 9.731 00:04:04 STEP 693 H= 173:15 +CPU= 9.677 00:04:14 STEP 694 H= 173:30 +CPU= 9.585 00:04:24 STEP 695 H= 173:45 +CPU= 9.631 00:04:36 STEP 696 H= 174:00 +CPU= 11.888 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000696 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000696 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000696 00:04:45 STEP 697 H= 174:15 +CPU= 9.532 00:04:55 STEP 698 H= 174:30 +CPU= 9.481 00:05:04 STEP 699 H= 174:45 +CPU= 9.529 00:05:14 STEP 700 H= 175:00 +CPU= 9.837 00:05:24 STEP 701 H= 175:15 +CPU= 9.515 00:05:33 STEP 702 H= 175:30 +CPU= 9.552 00:05:43 STEP 703 H= 175:45 +CPU= 9.541 00:05:53 STEP 704 H= 176:00 +CPU= 9.829 00:06:02 STEP 705 H= 176:15 +CPU= 9.647 00:06:12 STEP 706 H= 176:30 +CPU= 9.672 00:06:22 STEP 707 H= 176:45 +CPU= 9.662 00:06:34 STEP 708 H= 177:00 +CPU= 11.851 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000708 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000708 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000708 00:06:43 STEP 709 H= 177:15 +CPU= 9.633 00:06:53 STEP 710 H= 177:30 +CPU= 9.668 00:07:02 STEP 711 H= 177:45 +CPU= 9.480 00:07:12 STEP 712 H= 178:00 +CPU= 9.697 00:07:22 STEP 713 H= 178:15 +CPU= 9.644 00:07:31 STEP 714 H= 178:30 +CPU= 9.570 00:07:41 STEP 715 H= 178:45 +CPU= 9.611 00:07:51 STEP 716 H= 179:00 +CPU= 9.862 00:08:00 STEP 717 H= 179:15 +CPU= 9.517 00:08:10 STEP 718 H= 179:30 +CPU= 9.531 00:08:20 STEP 719 H= 179:45 +CPU= 9.637 00:08:33 STEP 720 H= 180:00 +CPU= 13.361 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000720 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000720 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000720 00:08:43 STEP 721 H= 180:15 +CPU= 9.620 00:08:52 STEP 722 H= 180:30 +CPU= 9.691 00:09:02 STEP 723 H= 180:45 +CPU= 9.693 00:09:12 STEP 724 H= 181:00 +CPU= 9.772 00:09:21 STEP 725 H= 181:15 +CPU= 9.453 00:09:31 STEP 726 H= 181:30 +CPU= 9.557 00:09:40 STEP 727 H= 181:45 +CPU= 9.456 00:09:50 STEP 728 H= 182:00 +CPU= 9.812 00:10:00 STEP 729 H= 182:15 +CPU= 9.512 00:10:09 STEP 730 H= 182:30 +CPU= 9.540 00:10:19 STEP 731 H= 182:45 +CPU= 9.657 00:10:31 STEP 732 H= 183:00 +CPU= 12.129 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000732 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000732 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000732 00:10:41 STEP 733 H= 183:15 +CPU= 9.631 00:10:50 STEP 734 H= 183:30 +CPU= 9.704 00:11:00 STEP 735 H= 183:45 +CPU= 9.532 00:11:10 STEP 736 H= 184:00 +CPU= 9.710 00:11:20 STEP 737 H= 184:15 +CPU= 9.901 00:11:29 STEP 738 H= 184:30 +CPU= 9.701 00:11:39 STEP 739 H= 184:45 +CPU= 9.765 00:11:49 STEP 740 H= 185:00 +CPU= 9.753 00:11:58 STEP 741 H= 185:15 +CPU= 9.655 00:12:08 STEP 742 H= 185:30 +CPU= 9.725 00:12:18 STEP 743 H= 185:45 +CPU= 9.527 00:12:30 STEP 744 H= 186:00 +CPU= 11.968 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000744 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000744 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000744 00:12:39 STEP 745 H= 186:15 +CPU= 9.665 00:12:49 STEP 746 H= 186:30 +CPU= 9.689 00:12:59 STEP 747 H= 186:45 +CPU= 9.833 00:13:09 STEP 748 H= 187:00 +CPU= 9.856 00:13:18 STEP 749 H= 187:15 +CPU= 9.596 00:13:28 STEP 750 H= 187:30 +CPU= 9.796 00:13:38 STEP 751 H= 187:45 +CPU= 9.739 00:13:48 STEP 752 H= 188:00 +CPU= 9.858 00:13:58 STEP 753 H= 188:15 +CPU= 9.632 00:14:07 STEP 754 H= 188:30 +CPU= 9.569 00:14:17 STEP 755 H= 188:45 +CPU= 9.543 00:14:29 STEP 756 H= 189:00 +CPU= 11.979 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000756 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000756 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000756 00:14:38 STEP 757 H= 189:15 +CPU= 9.696 00:14:48 STEP 758 H= 189:30 +CPU= 9.667 00:14:58 STEP 759 H= 189:45 +CPU= 9.578 00:15:08 STEP 760 H= 190:00 +CPU= 9.874 00:15:17 STEP 761 H= 190:15 +CPU= 9.622 00:15:27 STEP 762 H= 190:30 +CPU= 9.766 00:15:37 STEP 763 H= 190:45 +CPU= 9.712 00:15:47 STEP 764 H= 191:00 +CPU= 9.907 00:15:56 STEP 765 H= 191:15 +CPU= 9.621 00:16:06 STEP 766 H= 191:30 +CPU= 9.672 00:16:16 STEP 767 H= 191:45 +CPU= 9.597 00:16:29 STEP 768 H= 192:00 +CPU= 13.241 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000768 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000768 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000768 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000672 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000672 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000672 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000684 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000684 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000684 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000696 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000696 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000696 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000708 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000708 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000708 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000720 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000720 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000720 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000732 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000732 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000732 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000744 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000744 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000744 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMGGh7zg+000756 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMSHh7zg+000756 Adding to the zip: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_12294049/ICMUAh7zg+000756 Zipping up the intermediate file: /var/lib/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_bl_a4ey_2016092300_20_1018_12294049_1_r837151728_7.zip 00:16:39 STEP 769 H= 192:15 +CPU= 9.672 Uploading the intermediate file: upload_file_7.zip 00:16:48 STEP 770 H= 192:30 +CPU= 9.721 00:16:58 STEP 771 H= 192:45 +CPU= 9.851 00:17:08 STEP 772 H= 193:00 +CPU= 9.892 00:17:18 STEP 773 H= 193:15 +CPU= 9.673 00:17:28 STEP 774 H= 193:30 +CPU= 9.848 00:17:37 STEP 775 H= 193:45 +CPU= 9.707 00:17:47 STEP 776 H= 194:00 +CPU= 9.799 00:17:57 STEP 777 H= 194:15 +CPU= 9.622 00:18:06 STEP 778 H= 194:30 +CPU= 9.536 00:18:16 STEP 779 H= 194:45 +CPU= 9.753 00:18:28 STEP 780 H= 195:00 +CPU= 12.054 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMGGh7zg+000780 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMSHh7zg+000780 Moving to projects directory: /var/lib/boinc-client-cpdn/slots/2/ICMUAh7zg+000780 00:18:38 STEP 781 H= 195:15 +CPU= 9.701 00:18:48 STEP 782 H= 195:30 +CPU= 9.658 00:18:57 STEP 783 H= 195:45 +CPU= 9.774 00:19:07 STEP 784 H= 196:00 +CPU= 9.840 00:19:17 STEP 785 H= 196:15 +CPU= 9.668 00:19:27 STEP 786 H= 196:30 +CPU= 9.644 00:19:37 STEP 787 H= 196:45 +CPU= 9.987 00:19:46 STEP 788 H= 197:00 +CPU= 9.882 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4412MB (heap), 5025MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil)) [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc6692], nsigs = 1 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 4412 MB (maxheap), 5025 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001) [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CALLPAR [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : TURBULENCE_LAYER [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFOUTER [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001952:1718857192:7480.496] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFMAIN [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client-cpdn/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7ffeb8bf5d50 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client-cpdn/slots/2/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dd5490] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc6692] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x121fd8b] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x1207e29] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x11fdcb2] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xfac003] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xf5fa6b] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf4dbc4] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbd7131] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x12c5002] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0xbacbae] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x688153] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4cd1dc] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4b5d85] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b4f52] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49d638] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x406fbd] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x401e7f] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e12] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1dcc34a] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcdbe7] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x401cd5] : ??() at ??:0 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.496] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) Process 1 thread 1 calling linux_trbk from intel_trbk() [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client-cpdn/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7ffeb8bf5c60 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client-cpdn/slots/2/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x822540 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x822540] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dd5490] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc6692] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x121fd8b] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x1207e29] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x11fdcb2] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xfac003] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf5fa6b] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xf4dbc4] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xbd7131] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x12c5002] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0xbacbae] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x688153] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4cd1dc] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b5d85] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4b4f52] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49d638] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x406fbd] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e7f] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x401e12] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcc34a] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1dcdbe7] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x401cd5] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.503] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1 [EC_DRHOOK:ava:1:1:33607:33607] [20240620:001953:1718857193:7481.503] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1 forrtl: error (72): floating overflow Image PC Routine Line Source oifs_43r3_model.e 0000000001CF935B Unknown Unknown Unknown oifs_43r3_model.e 00000000008214C1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DD5490 Unknown Unknown Unknown oifs_43r3_model.e 0000000001CC6692 Unknown Unknown Unknown oifs_43r3_model.e 000000000121FD8B vdfmain_ 874 vdfmain.F90 oifs_43r3_model.e 0000000001207E29 vdfouter_ 739 vdfouter.F90 oifs_43r3_model.e 00000000011FDCB2 turbulence_layer_ 158 turbulence_layer.F90 oifs_43r3_model.e 0000000000FAC003 callpar_ 869 callpar.F90 oifs_43r3_model.e 0000000000F5FA6B ec_phys_ 670 ec_phys.F90 oifs_43r3_model.e 0000000000F4DBC4 ec_phys_drv_ 599 ec_phys_drv.F90 oifs_43r3_model.e 0000000000BD7131 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 00000000012C5002 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 0000000000BACBAE scan2m_ 535 scan2m.F90 oifs_43r3_model.e 0000000000688153 stepo_ 327 stepo.F90 oifs_43r3_model.e 00000000004CD1DC cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 00000000004B5D85 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 00000000004B4F52 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 000000000049D638 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 0000000000406FBD cnt0_ 146 cnt0.F90 oifs_43r3_model.e 0000000000401E7F MAIN__ 96 master.F90 oifs_43r3_model.e 0000000000401E12 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCC34A Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCDBE7 Unknown Unknown Unknown oifs_43r3_model.e 0000000000401CD5 Unknown Unknown Unknown ..The child process has been killed with signal: 6 >>> Printing last 70 lines from file: NODE.001_01 AVE 0.296217924754256E-04 0.000000000000000E+00 0.189874075399629E-01 GPNORM CC AVERAGE MINIMUM MAXIMUM AVE 0.192497502160076E+00 0.000000000000000E+00 0.100000000000000E+01 GPNORM RFL AVERAGE MINIMUM MAXIMUM AVE 0.111019216106429E-04 0.000000000000000E+00 0.248338569519060E-01 GPNORM SFL AVERAGE MINIMUM MAXIMUM AVE 0.114508128477882E-04 0.000000000000000E+00 0.778240146647627E-02 GPNORM CRFL AVERAGE MINIMUM MAXIMUM AVE 0.297645895384325E-05 0.000000000000000E+00 0.195287185029061E-01 GPNORM CSFL AVERAGE MINIMUM MAXIMUM AVE 0.121939425678934E-05 0.000000000000000E+00 0.116716714606144E-01 GPNORM PFRC AVERAGE MINIMUM MAXIMUM AVE 0.132947993604869E+00 0.000000000000000E+00 0.100000000000000E+01 NSTEP = 780 STEPO A00000000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 780 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000780 MODE=w IO-STREAM CLOSED - ICMGGh7zg+000780 MPI-TASK: 1 - 306337252 BYTES IN 6 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0038( 5.3%) NSTEP = 780 STEPO 0AA000000 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMSHh7zg+000780 MODE=w IO-STREAM CLOSED - ./ICMSHh7zg+000780 MPI-TASK: 1 - 707399250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0036 SECONDS196499.8 Mbytes/s, TOTAL TIME= 0.0948( 3.8%) IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000780 MODE=w IO-STREAM CLOSED - ./ICMUAh7zg+000780 MPI-TASK: 1 - 4901396032 BYTES IN 125 RECORDS TRANSFERRED IN 0.0025 SECONDS******** Mbytes/s, TOTAL TIME= 0.0833( 3.0%) STEPO_FPOS WAS : B00000F00E IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000780 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000780 MPI-TASK: 1 - 10 BYTES IN 2 RECORDS TRANSFERRED IN 0.0001 SECONDS 0.1 Mbytes/s, TOTAL TIME= 0.0017( 5.9%) STEPO_FPOS WAS : V00000000Y IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000780 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000780 MPI-TASK: 1 - 297757523 BYTES IN 4 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0032( 6.3%) STEPO_FPOS WAS : T00000000M NSTEP = 780 STEPO 0AAA00AAA MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 780 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000780 MODE=a IO-STREAM CLOSED - ICMGGh7zg+000780 MPI-TASK: 1 - 306337252 BYTES IN 7 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0043( 4.7%) 00:18:28 STEP 780 H= 195:00 +CPU= 12.054 NSTEP = 781 STEPO 0AAA00AAA 00:18:38 STEP 781 H= 195:15 +CPU= 9.701 NSTEP = 782 STEPO 0AAA00AAA 00:18:48 STEP 782 H= 195:30 +CPU= 9.658 NSTEP = 783 STEPO 0AAA00AAA 00:18:57 STEP 783 H= 195:45 +CPU= 9.774 NSTEP = 784 STEPO 0AAA00AAA 00:19:07 STEP 784 H= 196:00 +CPU= 9.840 ISTEP= 785 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 785 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 785 STEPO 0AAA00AAA 00:19:17 STEP 785 H= 196:15 +CPU= 9.668 NSTEP = 786 STEPO 0AAA00AAA 00:19:27 STEP 786 H= 196:30 +CPU= 9.644 NSTEP = 787 STEPO 0AAA00AAA 00:19:37 STEP 787 H= 196:45 +CPU= 9.987 NSTEP = 788 STEPO 0AAA00AAA 00:19:46 STEP 788 H= 197:00 +CPU= 9.882 NSTEP = 789 STEPO 0AAA00AAA ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 00:18:48 0AAA00AAA STEPO 783 9.658 9.658 9.668 123:15 123:36 0.31359401573947E-04 2GB 0MB 00:18:57 0AAA00AAA STEPO 784 9.774 9.774 9.789 123:24 123:46 0.31359401573947E-04 2GB 0MB 00:19:07 0AAA00AAA STEPO 785 9.840 9.840 9.863 123:34 123:56 0.31359401573947E-04 2GB 0MB 00:19:17 0AAA00AAA STEPO 786 9.668 9.668 9.711 123:44 124:05 0.31359401573947E-04 2GB 0MB 00:19:27 0AAA00AAA STEPO 787 9.644 9.644 9.674 123:53 124:15 0.31359401573947E-04 2GB 0MB 00:19:37 0AAA00AAA STEPO 788 9.987 9.987 9.994 124:03 124:25 0.31359401573947E-04 2GB 0MB 00:19:46 0AAA00AAA STEPO 789 9.882 9.882 9.887 124:13 124:35 0.31359401573947E-04 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 768", CTIME = "00080000 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 756, 2*0, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 0.000000000000000E+000, GMASSI = 0.000000000000000E+000 / ------------------------------------------------ >>> Printing last 8 lines from file: /var/lib/boinc-client-cpdn/slots/2/progress_file_12294049.xml <running_values> <last_cpu_time>7458.960000</last_cpu_time> <upload_file_number>8</upload_file_number> <last_iter>789</last_iter> <last_upload>691200</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully </stderr_txt> ]]> |
No trickles! |
---|
©2024 climateprediction.net