climateprediction.net home page
Task 22442490

Task 22442490

Name oifs_43r3_bl_a0gi_2016092300_20_1018_12288921_0
Workunit 12288921
Created 12 Jun 2024, 20:50:09 UTC
Sent 13 Jun 2024, 23:27:49 UTC
Report deadline 12 Aug 2024, 23:27:49 UTC
Received 14 Jun 2024, 22:01:35 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1545138
Run time 21 hours 32 min 53 sec
CPU time 18 hours 32 min 29 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 1.54 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 4,040.48 MB
Peak swap size 5,981.12 MB
Peak disk usage 2,172.89 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
ectory: /config/slots/1/ICMUAh7zg+000204
  04:30:31 STEP  205 H=  51:15 +CPU= 76.574
  04:32:01 STEP  206 H=  51:30 +CPU= 76.833
  04:33:27 STEP  207 H=  51:45 +CPU= 74.374
  04:34:55 STEP  208 H=  52:00 +CPU= 77.226
  04:36:23 STEP  209 H=  52:15 +CPU= 75.727
  04:37:51 STEP  210 H=  52:30 +CPU= 75.788
  04:39:20 STEP  211 H=  52:45 +CPU= 75.623
  04:40:50 STEP  212 H=  53:00 +CPU= 77.286
  04:42:16 STEP  213 H=  53:15 +CPU= 74.346
  04:43:44 STEP  214 H=  53:30 +CPU= 75.772
  04:45:11 STEP  215 H=  53:45 +CPU= 75.286
  04:46:57 STEP  216 H=  54:00 +CPU= 92.218
Moving to projects directory: /config/slots/1/ICMGGh7zg+000216
Moving to projects directory: /config/slots/1/ICMSHh7zg+000216
Moving to projects directory: /config/slots/1/ICMUAh7zg+000216
  04:48:24 STEP  217 H=  54:15 +CPU= 75.048
  04:49:54 STEP  218 H=  54:30 +CPU= 76.229
  04:51:24 STEP  219 H=  54:45 +CPU= 75.689
  04:52:52 STEP  220 H=  55:00 +CPU= 76.305
  04:54:19 STEP  221 H=  55:15 +CPU= 75.338
  04:55:47 STEP  222 H=  55:30 +CPU= 75.415
  04:57:13 STEP  223 H=  55:45 +CPU= 74.446
  04:58:44 STEP  224 H=  56:00 +CPU= 77.371
  05:00:11 STEP  225 H=  56:15 +CPU= 75.292
  05:01:37 STEP  226 H=  56:30 +CPU= 74.689
  05:03:07 STEP  227 H=  56:45 +CPU= 75.031
  05:04:53 STEP  228 H=  57:00 +CPU= 91.613
Moving to projects directory: /config/slots/1/ICMGGh7zg+000228
Moving to projects directory: /config/slots/1/ICMSHh7zg+000228
Moving to projects directory: /config/slots/1/ICMUAh7zg+000228
  05:06:22 STEP  229 H=  57:15 +CPU= 75.225
  05:07:48 STEP  230 H=  57:30 +CPU= 74.805
  05:09:15 STEP  231 H=  57:45 +CPU= 74.814
  05:10:42 STEP  232 H=  58:00 +CPU= 75.841
  05:12:09 STEP  233 H=  58:15 +CPU= 74.801
  05:13:37 STEP  234 H=  58:30 +CPU= 75.067
  05:15:03 STEP  235 H=  58:45 +CPU= 74.250
  05:16:30 STEP  236 H=  59:00 +CPU= 75.582
  05:17:55 STEP  237 H=  59:15 +CPU= 74.482
  05:19:19 STEP  238 H=  59:30 +CPU= 73.499
  05:20:46 STEP  239 H=  59:45 +CPU= 74.937
  05:22:38 STEP  240 H=  60:00 +CPU= 98.249
Moving to projects directory: /config/slots/1/ICMGGh7zg+000240
Moving to projects directory: /config/slots/1/ICMSHh7zg+000240
Moving to projects directory: /config/slots/1/ICMUAh7zg+000240
  05:24:06 STEP  241 H=  60:15 +CPU= 75.336
  05:25:33 STEP  242 H=  60:30 +CPU= 73.815
  05:26:57 STEP  243 H=  60:45 +CPU= 73.089
  05:28:26 STEP  244 H=  61:00 +CPU= 78.241
  05:29:56 STEP  245 H=  61:15 +CPU= 76.892
  05:31:24 STEP  246 H=  61:30 +CPU= 74.981
  05:32:48 STEP  247 H=  61:45 +CPU= 72.220
  05:34:13 STEP  248 H=  62:00 +CPU= 73.607
  05:35:36 STEP  249 H=  62:15 +CPU= 72.221
  05:36:59 STEP  250 H=  62:30 +CPU= 72.747
  05:38:23 STEP  251 H=  62:45 +CPU= 72.696
  05:40:08 STEP  252 H=  63:00 +CPU= 90.905
Moving to projects directory: /config/slots/1/ICMGGh7zg+000252
Moving to projects directory: /config/slots/1/ICMSHh7zg+000252
Moving to projects directory: /config/slots/1/ICMUAh7zg+000252
  05:41:36 STEP  253 H=  63:15 +CPU= 74.449
  05:43:02 STEP  254 H=  63:30 +CPU= 74.062
  05:44:31 STEP  255 H=  63:45 +CPU= 75.112
  05:45:57 STEP  256 H=  64:00 +CPU= 75.025
  05:47:24 STEP  257 H=  64:15 +CPU= 73.843
  05:48:50 STEP  258 H=  64:30 +CPU= 73.607
  05:50:12 STEP  259 H=  64:45 +CPU= 71.944
  05:51:42 STEP  260 H=  65:00 +CPU= 76.020
  05:53:04 STEP  261 H=  65:15 +CPU= 71.879
  05:54:30 STEP  262 H=  65:30 +CPU= 73.020
  05:55:59 STEP  263 H=  65:45 +CPU= 74.331
  05:57:45 STEP  264 H=  66:00 +CPU= 91.542
Moving to projects directory: /config/slots/1/ICMGGh7zg+000264
Moving to projects directory: /config/slots/1/ICMSHh7zg+000264
Moving to projects directory: /config/slots/1/ICMUAh7zg+000264
  05:59:09 STEP  265 H=  66:15 +CPU= 73.193
  06:00:36 STEP  266 H=  66:30 +CPU= 74.192
  06:02:00 STEP  267 H=  66:45 +CPU= 72.765
  06:03:24 STEP  268 H=  67:00 +CPU= 74.168
  06:04:50 STEP  269 H=  67:15 +CPU= 73.462
  06:06:17 STEP  270 H=  67:30 +CPU= 73.727
  06:07:43 STEP  271 H=  67:45 +CPU= 73.152
  06:09:07 STEP  272 H=  68:00 +CPU= 73.715
  06:10:32 STEP  273 H=  68:15 +CPU= 72.911
  06:11:57 STEP  274 H=  68:30 +CPU= 72.442
  06:13:19 STEP  275 H=  68:45 +CPU= 71.724
  06:15:01 STEP  276 H=  69:00 +CPU= 89.759
Moving to projects directory: /config/slots/1/ICMGGh7zg+000276
Moving to projects directory: /config/slots/1/ICMSHh7zg+000276
Moving to projects directory: /config/slots/1/ICMUAh7zg+000276
  06:16:29 STEP  277 H=  69:15 +CPU= 74.622
  06:17:49 STEP  278 H=  69:30 +CPU= 71.692
  06:19:19 STEP  279 H=  69:45 +CPU= 74.267
  06:20:44 STEP  280 H=  70:00 +CPU= 73.900
  06:22:07 STEP  281 H=  70:15 +CPU= 72.652
  06:23:33 STEP  282 H=  70:30 +CPU= 73.393
  06:25:00 STEP  283 H=  70:45 +CPU= 73.678
  06:26:26 STEP  284 H=  71:00 +CPU= 74.625
  06:27:50 STEP  285 H=  71:15 +CPU= 72.855
  06:29:16 STEP  286 H=  71:30 +CPU= 74.112
  06:30:40 STEP  287 H=  71:45 +CPU= 73.671
  06:32:30 STEP  288 H=  72:00 +CPU= 96.111
Moving to projects directory: /config/slots/1/ICMGGh7zg+000288
Moving to projects directory: /config/slots/1/ICMSHh7zg+000288
Moving to projects directory: /config/slots/1/ICMUAh7zg+000288
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000192
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000192
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000192
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000204
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000204
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000204
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000216
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000216
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000216
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000228
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000228
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000228
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000240
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000240
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000240
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000252
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000252
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000252
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000264
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000264
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000264
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000276
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000276
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000276
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_bl_a0gi_2016092300_20_1018_12288921_0_r854800425_2.zip
Uploading the intermediate file: upload_file_2.zip
  06:33:59 STEP  289 H=  72:15 +CPU= 73.761
  06:35:23 STEP  290 H=  72:30 +CPU= 72.482
  06:36:47 STEP  291 H=  72:45 +CPU= 72.604
  06:38:12 STEP  292 H=  73:00 +CPU= 74.110
  06:39:38 STEP  293 H=  73:15 +CPU= 73.636
  06:41:01 STEP  294 H=  73:30 +CPU= 71.958
  06:42:25 STEP  295 H=  73:45 +CPU= 73.074
  06:43:51 STEP  296 H=  74:00 +CPU= 74.176
  06:45:18 STEP  297 H=  74:15 +CPU= 73.706
  06:46:44 STEP  298 H=  74:30 +CPU= 73.433
  06:48:07 STEP  299 H=  74:45 +CPU= 72.556
  06:49:53 STEP  300 H=  75:00 +CPU= 90.688
Moving to projects directory: /config/slots/1/ICMGGh7zg+000300
Moving to projects directory: /config/slots/1/ICMSHh7zg+000300
Moving to projects directory: /config/slots/1/ICMUAh7zg+000300
  06:51:17 STEP  301 H=  75:15 +CPU= 72.511
  06:52:41 STEP  302 H=  75:30 +CPU= 72.325
  06:54:07 STEP  303 H=  75:45 +CPU= 72.544
  06:55:32 STEP  304 H=  76:00 +CPU= 74.385
  06:56:56 STEP  305 H=  76:15 +CPU= 72.756
  06:58:21 STEP  306 H=  76:30 +CPU= 72.371
  06:59:47 STEP  307 H=  76:45 +CPU= 73.430
  07:01:12 STEP  308 H=  77:00 +CPU= 74.055
  07:02:37 STEP  309 H=  77:15 +CPU= 72.953
  07:04:05 STEP  310 H=  77:30 +CPU= 76.384
  07:05:40 STEP  311 H=  77:45 +CPU= 80.406
  07:07:29 STEP  312 H=  78:00 +CPU= 93.776
Moving to projects directory: /config/slots/1/ICMGGh7zg+000312
Moving to projects directory: /config/slots/1/ICMSHh7zg+000312
Moving to projects directory: /config/slots/1/ICMUAh7zg+000312
  07:08:56 STEP  313 H=  78:15 +CPU= 74.735
  07:10:24 STEP  314 H=  78:30 +CPU= 75.554
  07:11:49 STEP  315 H=  78:45 +CPU= 74.360
  07:13:16 STEP  316 H=  79:00 +CPU= 76.385
  07:14:44 STEP  317 H=  79:15 +CPU= 75.438
  07:16:15 STEP  318 H=  79:30 +CPU= 76.928
  07:17:40 STEP  319 H=  79:45 +CPU= 75.141
  07:19:09 STEP  320 H=  80:00 +CPU= 77.361
  07:20:42 STEP  321 H=  80:15 +CPU= 76.047
  07:22:11 STEP  322 H=  80:30 +CPU= 75.469
  07:23:37 STEP  323 H=  80:45 +CPU= 73.549
  07:25:24 STEP  324 H=  81:00 +CPU= 91.568
Moving to projects directory: /config/slots/1/ICMGGh7zg+000324
Moving to projects directory: /config/slots/1/ICMSHh7zg+000324
Moving to projects directory: /config/slots/1/ICMUAh7zg+000324
  07:26:49 STEP  325 H=  81:15 +CPU= 72.775
  07:28:15 STEP  326 H=  81:30 +CPU= 73.653
  07:29:36 STEP  327 H=  81:45 +CPU= 71.458
  07:31:03 STEP  328 H=  82:00 +CPU= 74.378
  07:32:27 STEP  329 H=  82:15 +CPU= 72.598
  07:33:50 STEP  330 H=  82:30 +CPU= 71.859
  07:35:15 STEP  331 H=  82:45 +CPU= 73.327
  07:36:40 STEP  332 H=  83:00 +CPU= 73.908
  07:38:03 STEP  333 H=  83:15 +CPU= 72.132
  07:39:32 STEP  334 H=  83:30 +CPU= 73.372
  07:40:58 STEP  335 H=  83:45 +CPU= 72.563
  07:42:47 STEP  336 H=  84:00 +CPU= 96.245
Moving to projects directory: /config/slots/1/ICMGGh7zg+000336
Moving to projects directory: /config/slots/1/ICMSHh7zg+000336
Moving to projects directory: /config/slots/1/ICMUAh7zg+000336
  07:44:12 STEP  337 H=  84:15 +CPU= 72.906
  07:45:36 STEP  338 H=  84:30 +CPU= 72.930
  07:47:04 STEP  339 H=  84:45 +CPU= 76.580
  07:48:36 STEP  340 H=  85:00 +CPU= 78.577
  07:50:03 STEP  341 H=  85:15 +CPU= 74.983
  07:51:34 STEP  342 H=  85:30 +CPU= 75.945
  07:53:03 STEP  343 H=  85:45 +CPU= 76.979
  07:54:35 STEP  344 H=  86:00 +CPU= 78.469
  07:56:05 STEP  345 H=  86:15 +CPU= 76.424
  07:57:33 STEP  346 H=  86:30 +CPU= 75.773
  07:59:02 STEP  347 H=  86:45 +CPU= 75.612
  08:00:48 STEP  348 H=  87:00 +CPU= 94.507
Moving to projects directory: /config/slots/1/ICMGGh7zg+000348
Moving to projects directory: /config/slots/1/ICMSHh7zg+000348
Moving to projects directory: /config/slots/1/ICMUAh7zg+000348
  08:02:18 STEP  349 H=  87:15 +CPU= 76.425
  08:03:46 STEP  350 H=  87:30 +CPU= 75.764
  08:05:18 STEP  351 H=  87:45 +CPU= 77.374
  08:06:52 STEP  352 H=  88:00 +CPU= 78.841
  08:08:21 STEP  353 H=  88:15 +CPU= 74.563
  08:09:52 STEP  354 H=  88:30 +CPU= 75.361
  08:11:13 STEP  355 H=  88:45 +CPU= 72.459
  08:12:41 STEP  356 H=  89:00 +CPU= 75.236
  08:14:06 STEP  357 H=  89:15 +CPU= 73.104
  08:15:30 STEP  358 H=  89:30 +CPU= 72.844
  08:16:54 STEP  359 H=  89:45 +CPU= 73.182
  08:18:43 STEP  360 H=  90:00 +CPU= 96.840
Moving to projects directory: /config/slots/1/ICMGGh7zg+000360
Moving to projects directory: /config/slots/1/ICMSHh7zg+000360
Moving to projects directory: /config/slots/1/ICMUAh7zg+000360
  08:20:11 STEP  361 H=  90:15 +CPU= 76.149
  08:21:35 STEP  362 H=  90:30 +CPU= 74.264
  08:23:01 STEP  363 H=  90:45 +CPU= 74.695
  08:24:30 STEP  364 H=  91:00 +CPU= 77.237
  08:25:58 STEP  365 H=  91:15 +CPU= 75.801
  08:27:29 STEP  366 H=  91:30 +CPU= 76.532
  08:28:57 STEP  367 H=  91:45 +CPU= 74.803
  08:30:27 STEP  368 H=  92:00 +CPU= 77.233
  08:31:54 STEP  369 H=  92:15 +CPU= 75.713
  08:33:19 STEP  370 H=  92:30 +CPU= 74.419
  08:34:45 STEP  371 H=  92:45 +CPU= 74.653
  08:36:34 STEP  372 H=  93:00 +CPU= 94.293
Moving to projects directory: /config/slots/1/ICMGGh7zg+000372
Moving to projects directory: /config/slots/1/ICMSHh7zg+000372
Moving to projects directory: /config/slots/1/ICMUAh7zg+000372
  08:38:06 STEP  373 H=  93:15 +CPU= 77.892
  08:39:34 STEP  374 H=  93:30 +CPU= 74.275
  08:41:00 STEP  375 H=  93:45 +CPU= 73.142
  08:42:28 STEP  376 H=  94:00 +CPU= 74.389
  08:43:54 STEP  377 H=  94:15 +CPU= 73.465
  08:45:18 STEP  378 H=  94:30 +CPU= 73.717
  08:46:43 STEP  379 H=  94:45 +CPU= 72.325
  08:48:08 STEP  380 H=  95:00 +CPU= 73.645
  08:49:38 STEP  381 H=  95:15 +CPU= 74.396
  08:50:58 STEP  382 H=  95:30 +CPU= 71.645
  08:52:21 STEP  383 H=  95:45 +CPU= 72.051
  08:54:10 STEP  384 H=  96:00 +CPU= 95.708
Moving to projects directory: /config/slots/1/ICMGGh7zg+000384
Moving to projects directory: /config/slots/1/ICMSHh7zg+000384
Moving to projects directory: /config/slots/1/ICMUAh7zg+000384
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000288
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000288
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000288
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000300
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000300
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000300
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000312
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000312
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000312
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000324
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000324
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000324
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000336
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000336
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000336
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000348
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000348
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000348
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000360
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000360
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000360
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000372
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000372
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000372
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_bl_a0gi_2016092300_20_1018_12288921_0_r854800425_3.zip
Uploading the intermediate file: upload_file_3.zip
  08:55:40 STEP  385 H=  96:15 +CPU= 74.224
  08:57:03 STEP  386 H=  96:30 +CPU= 72.327
  08:58:30 STEP  387 H=  96:45 +CPU= 73.212
  08:59:54 STEP  388 H=  97:00 +CPU= 73.987
  09:01:19 STEP  389 H=  97:15 +CPU= 73.121
  09:02:42 STEP  390 H=  97:30 +CPU= 72.616
  09:04:08 STEP  391 H=  97:45 +CPU= 73.056
  09:05:34 STEP  392 H=  98:00 +CPU= 74.847
  09:06:55 STEP  393 H=  98:15 +CPU= 71.499
  09:08:27 STEP  394 H=  98:30 +CPU= 74.788
  09:09:50 STEP  395 H=  98:45 +CPU= 72.779
  09:11:33 STEP  396 H=  99:00 +CPU= 89.820
Moving to projects directory: /config/slots/1/ICMGGh7zg+000396
Moving to projects directory: /config/slots/1/ICMSHh7zg+000396
Moving to projects directory: /config/slots/1/ICMUAh7zg+000396
  09:12:58 STEP  397 H=  99:15 +CPU= 72.668
  09:14:23 STEP  398 H=  99:30 +CPU= 72.597
  09:15:47 STEP  399 H=  99:45 +CPU= 72.691
  09:17:14 STEP  400 H= 100:00 +CPU= 74.763
  09:18:38 STEP  401 H= 100:15 +CPU= 73.400
  09:20:03 STEP  402 H= 100:30 +CPU= 72.462
  09:21:25 STEP  403 H= 100:45 +CPU= 72.126
  09:22:53 STEP  404 H= 101:00 +CPU= 74.735
  09:24:19 STEP  405 H= 101:15 +CPU= 73.343
  09:25:46 STEP  406 H= 101:30 +CPU= 74.376
  09:27:10 STEP  407 H= 101:45 +CPU= 72.125
  09:28:57 STEP  408 H= 102:00 +CPU= 90.663
Moving to projects directory: /config/slots/1/ICMGGh7zg+000408
Moving to projects directory: /config/slots/1/ICMSHh7zg+000408
Moving to projects directory: /config/slots/1/ICMUAh7zg+000408
  09:30:22 STEP  409 H= 102:15 +CPU= 72.711
  09:31:46 STEP  410 H= 102:30 +CPU= 72.936
  09:33:09 STEP  411 H= 102:45 +CPU= 72.099
  09:34:37 STEP  412 H= 103:00 +CPU= 75.059
  09:36:00 STEP  413 H= 103:15 +CPU= 72.129
  09:37:22 STEP  414 H= 103:30 +CPU= 71.616
  09:38:48 STEP  415 H= 103:45 +CPU= 73.281
  09:40:16 STEP  416 H= 104:00 +CPU= 74.984
  09:41:38 STEP  417 H= 104:15 +CPU= 72.291
  09:43:01 STEP  418 H= 104:30 +CPU= 72.364
  09:44:25 STEP  419 H= 104:45 +CPU= 71.939
  09:46:08 STEP  420 H= 105:00 +CPU= 90.019
Moving to projects directory: /config/slots/1/ICMGGh7zg+000420
Moving to projects directory: /config/slots/1/ICMSHh7zg+000420
Moving to projects directory: /config/slots/1/ICMUAh7zg+000420
  09:47:34 STEP  421 H= 105:15 +CPU= 73.452
  09:48:57 STEP  422 H= 105:30 +CPU= 71.408
  09:50:21 STEP  423 H= 105:45 +CPU= 73.006
  09:51:47 STEP  424 H= 106:00 +CPU= 74.264
  09:53:11 STEP  425 H= 106:15 +CPU= 72.512
  09:54:35 STEP  426 H= 106:30 +CPU= 72.312
  09:56:00 STEP  427 H= 106:45 +CPU= 72.171
  09:57:26 STEP  428 H= 107:00 +CPU= 74.327
  09:58:49 STEP  429 H= 107:15 +CPU= 71.660
  10:00:15 STEP  430 H= 107:30 +CPU= 73.260
  10:01:40 STEP  431 H= 107:45 +CPU= 73.216
  10:03:29 STEP  432 H= 108:00 +CPU= 95.454
Moving to projects directory: /config/slots/1/ICMGGh7zg+000432
Moving to projects directory: /config/slots/1/ICMSHh7zg+000432
Moving to projects directory: /config/slots/1/ICMUAh7zg+000432
  10:04:54 STEP  433 H= 108:15 +CPU= 72.594
  10:06:19 STEP  434 H= 108:30 +CPU= 72.668
  10:07:41 STEP  435 H= 108:45 +CPU= 72.077
  10:09:05 STEP  436 H= 109:00 +CPU= 72.960
  10:10:34 STEP  437 H= 109:15 +CPU= 74.320
  10:11:57 STEP  438 H= 109:30 +CPU= 72.129
  10:13:20 STEP  439 H= 109:45 +CPU= 72.063
  10:14:47 STEP  440 H= 110:00 +CPU= 74.041
  10:16:11 STEP  441 H= 110:15 +CPU= 72.892
  10:17:34 STEP  442 H= 110:30 +CPU= 72.012
  10:18:57 STEP  443 H= 110:45 +CPU= 71.805
  10:20:43 STEP  444 H= 111:00 +CPU= 90.542
Moving to projects directory: /config/slots/1/ICMGGh7zg+000444
Moving to projects directory: /config/slots/1/ICMSHh7zg+000444
Moving to projects directory: /config/slots/1/ICMUAh7zg+000444
  10:22:08 STEP  445 H= 111:15 +CPU= 72.730
  10:23:31 STEP  446 H= 111:30 +CPU= 72.891
  10:25:00 STEP  447 H= 111:45 +CPU= 75.135
  10:26:29 STEP  448 H= 112:00 +CPU= 76.802
  10:27:51 STEP  449 H= 112:15 +CPU= 71.717
  10:29:15 STEP  450 H= 112:30 +CPU= 72.685
  10:30:40 STEP  451 H= 112:45 +CPU= 73.218
  10:32:06 STEP  452 H= 113:00 +CPU= 74.388
  10:33:32 STEP  453 H= 113:15 +CPU= 72.546
  10:34:57 STEP  454 H= 113:30 +CPU= 72.544
  10:36:17 STEP  455 H= 113:45 +CPU= 71.231
  10:37:59 STEP  456 H= 114:00 +CPU= 89.773
Moving to projects directory: /config/slots/1/ICMGGh7zg+000456
Moving to projects directory: /config/slots/1/ICMSHh7zg+000456
Moving to projects directory: /config/slots/1/ICMUAh7zg+000456
  10:39:24 STEP  457 H= 114:15 +CPU= 72.824
  10:40:51 STEP  458 H= 114:30 +CPU= 75.029
  10:42:26 STEP  459 H= 114:45 +CPU= 80.697
  10:44:07 STEP  460 H= 115:00 +CPU= 82.139
  10:45:39 STEP  461 H= 115:15 +CPU= 77.346
  10:47:08 STEP  462 H= 115:30 +CPU= 76.127
  10:48:35 STEP  463 H= 115:45 +CPU= 75.446
  10:50:00 STEP  464 H= 116:00 +CPU= 74.816
  10:51:28 STEP  465 H= 116:15 +CPU= 75.797
  10:52:55 STEP  466 H= 116:30 +CPU= 75.235
  10:54:22 STEP  467 H= 116:45 +CPU= 75.408
  10:56:08 STEP  468 H= 117:00 +CPU= 93.337
Moving to projects directory: /config/slots/1/ICMGGh7zg+000468
Moving to projects directory: /config/slots/1/ICMSHh7zg+000468
Moving to projects directory: /config/slots/1/ICMUAh7zg+000468
  10:57:36 STEP  469 H= 117:15 +CPU= 75.461
  10:59:01 STEP  470 H= 117:30 +CPU= 74.953
  11:00:34 STEP  471 H= 117:45 +CPU= 77.797
  11:02:02 STEP  472 H= 118:00 +CPU= 77.000
  11:03:29 STEP  473 H= 118:15 +CPU= 75.533
  11:04:58 STEP  474 H= 118:30 +CPU= 76.076
  11:06:25 STEP  475 H= 118:45 +CPU= 76.069
  11:07:54 STEP  476 H= 119:00 +CPU= 77.440
  11:09:22 STEP  477 H= 119:15 +CPU= 76.045
  11:10:53 STEP  478 H= 119:30 +CPU= 77.011
  11:12:20 STEP  479 H= 119:45 +CPU= 75.559
  11:14:15 STEP  480 H= 120:00 +CPU= 99.564
Moving to projects directory: /config/slots/1/ICMGGh7zg+000480
Moving to projects directory: /config/slots/1/ICMSHh7zg+000480
Moving to projects directory: /config/slots/1/ICMUAh7zg+000480
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000384
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000384
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000384
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000396
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000396
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000396
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000408
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000408
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000408
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000420
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000420
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000420
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000432
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000432
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000432
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000444
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000444
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000444
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000456
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000456
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000456
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000468
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000468
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000468
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_bl_a0gi_2016092300_20_1018_12288921_0_r854800425_4.zip
Uploading the intermediate file: upload_file_4.zip
  11:15:41 STEP  481 H= 120:15 +CPU= 75.722
  11:17:07 STEP  482 H= 120:30 +CPU= 74.406
  11:18:36 STEP  483 H= 120:45 +CPU= 75.360
  11:20:06 STEP  484 H= 121:00 +CPU= 76.319
  11:21:33 STEP  485 H= 121:15 +CPU= 75.958
  11:23:00 STEP  486 H= 121:30 +CPU= 75.007
  11:24:22 STEP  487 H= 121:45 +CPU= 72.996
  11:25:49 STEP  488 H= 122:00 +CPU= 74.893
  11:27:12 STEP  489 H= 122:15 +CPU= 72.798
  11:28:37 STEP  490 H= 122:30 +CPU= 73.611
  11:30:05 STEP  491 H= 122:45 +CPU= 74.171
  11:31:47 STEP  492 H= 123:00 +CPU= 89.303
Moving to projects directory: /config/slots/1/ICMGGh7zg+000492
Moving to projects directory: /config/slots/1/ICMSHh7zg+000492
Moving to projects directory: /config/slots/1/ICMUAh7zg+000492
  11:33:15 STEP  493 H= 123:15 +CPU= 74.422
  11:34:37 STEP  494 H= 123:30 +CPU= 71.416
  11:36:01 STEP  495 H= 123:45 +CPU= 72.182
  11:37:31 STEP  496 H= 124:00 +CPU= 75.128
  11:38:52 STEP  497 H= 124:15 +CPU= 71.852
  11:40:20 STEP  498 H= 124:30 +CPU= 73.791
  11:41:45 STEP  499 H= 124:45 +CPU= 73.000
  11:43:13 STEP  500 H= 125:00 +CPU= 74.366
  11:44:38 STEP  501 H= 125:15 +CPU= 72.953
  11:46:02 STEP  502 H= 125:30 +CPU= 72.633
  11:47:26 STEP  503 H= 125:45 +CPU= 72.212
  11:49:12 STEP  504 H= 126:00 +CPU= 90.148
Moving to projects directory: /config/slots/1/ICMGGh7zg+000504
Moving to projects directory: /config/slots/1/ICMSHh7zg+000504
Moving to projects directory: /config/slots/1/ICMUAh7zg+000504
  11:50:43 STEP  505 H= 126:15 +CPU= 79.082
  11:52:14 STEP  506 H= 126:30 +CPU= 77.253
  11:53:46 STEP  507 H= 126:45 +CPU= 77.198
  11:55:16 STEP  508 H= 127:00 +CPU= 77.626
  11:56:41 STEP  509 H= 127:15 +CPU= 74.621
  11:58:07 STEP  510 H= 127:30 +CPU= 75.109
  11:59:35 STEP  511 H= 127:45 +CPU= 76.644
  12:01:08 STEP  512 H= 128:00 +CPU= 79.120
  12:02:34 STEP  513 H= 128:15 +CPU= 74.612
  12:04:06 STEP  514 H= 128:30 +CPU= 77.016
  12:05:30 STEP  515 H= 128:45 +CPU= 73.876
  12:07:16 STEP  516 H= 129:00 +CPU= 92.356
Moving to projects directory: /config/slots/1/ICMGGh7zg+000516
Moving to projects directory: /config/slots/1/ICMSHh7zg+000516
Moving to projects directory: /config/slots/1/ICMUAh7zg+000516
  12:08:44 STEP  517 H= 129:15 +CPU= 75.638
  12:10:15 STEP  518 H= 129:30 +CPU= 76.685
  12:11:44 STEP  519 H= 129:45 +CPU= 76.296
  12:13:13 STEP  520 H= 130:00 +CPU= 76.883
  12:14:39 STEP  521 H= 130:15 +CPU= 75.057
  12:16:04 STEP  522 H= 130:30 +CPU= 74.982
  12:17:30 STEP  523 H= 130:45 +CPU= 74.474
  12:19:01 STEP  524 H= 131:00 +CPU= 77.941
  12:20:29 STEP  525 H= 131:15 +CPU= 76.086
  12:21:58 STEP  526 H= 131:30 +CPU= 75.674
  12:23:25 STEP  527 H= 131:45 +CPU= 75.570
  12:25:21 STEP  528 H= 132:00 +CPU=100.958
Moving to projects directory: /config/slots/1/ICMGGh7zg+000528
Moving to projects directory: /config/slots/1/ICMSHh7zg+000528
Moving to projects directory: /config/slots/1/ICMUAh7zg+000528
  12:26:47 STEP  529 H= 132:15 +CPU= 74.694
  12:28:17 STEP  530 H= 132:30 +CPU= 77.093
  12:29:45 STEP  531 H= 132:45 +CPU= 75.515
  12:31:18 STEP  532 H= 133:00 +CPU= 78.015
  12:32:43 STEP  533 H= 133:15 +CPU= 73.901
  12:34:11 STEP  534 H= 133:30 +CPU= 75.389
  12:35:38 STEP  535 H= 133:45 +CPU= 74.569
  12:37:05 STEP  536 H= 134:00 +CPU= 75.587
  12:38:35 STEP  537 H= 134:15 +CPU= 75.946
  12:40:01 STEP  538 H= 134:30 +CPU= 74.582
  12:41:29 STEP  539 H= 134:45 +CPU= 75.274
  12:43:18 STEP  540 H= 135:00 +CPU= 93.325
Moving to projects directory: /config/slots/1/ICMGGh7zg+000540
Moving to projects directory: /config/slots/1/ICMSHh7zg+000540
Moving to projects directory: /config/slots/1/ICMUAh7zg+000540
  12:44:43 STEP  541 H= 135:15 +CPU= 74.385
  12:46:09 STEP  542 H= 135:30 +CPU= 74.460
  12:47:35 STEP  543 H= 135:45 +CPU= 74.586
  12:49:04 STEP  544 H= 136:00 +CPU= 79.265
  12:50:36 STEP  545 H= 136:15 +CPU= 76.616
  12:52:11 STEP  546 H= 136:30 +CPU= 76.905
  12:53:37 STEP  547 H= 136:45 +CPU= 73.657
  12:55:05 STEP  548 H= 137:00 +CPU= 75.683
  12:56:27 STEP  549 H= 137:15 +CPU= 72.334
  12:57:52 STEP  550 H= 137:30 +CPU= 73.014
  12:59:21 STEP  551 H= 137:45 +CPU= 75.101
  13:01:06 STEP  552 H= 138:00 +CPU= 91.341
Moving to projects directory: /config/slots/1/ICMGGh7zg+000552
Moving to projects directory: /config/slots/1/ICMSHh7zg+000552
Moving to projects directory: /config/slots/1/ICMUAh7zg+000552
  13:02:33 STEP  553 H= 138:15 +CPU= 74.466
  13:03:56 STEP  554 H= 138:30 +CPU= 72.881
  13:05:21 STEP  555 H= 138:45 +CPU= 73.263
  13:06:49 STEP  556 H= 139:00 +CPU= 75.866
  13:08:14 STEP  557 H= 139:15 +CPU= 72.962
  13:09:40 STEP  558 H= 139:30 +CPU= 73.287
  13:11:06 STEP  559 H= 139:45 +CPU= 73.317
  13:12:29 STEP  560 H= 140:00 +CPU= 72.948
  13:13:55 STEP  561 H= 140:15 +CPU= 73.590
  13:15:20 STEP  562 H= 140:30 +CPU= 73.478
  13:16:44 STEP  563 H= 140:45 +CPU= 73.713
  13:18:26 STEP  564 H= 141:00 +CPU= 90.033
Moving to projects directory: /config/slots/1/ICMGGh7zg+000564
Moving to projects directory: /config/slots/1/ICMSHh7zg+000564
Moving to projects directory: /config/slots/1/ICMUAh7zg+000564
  13:19:53 STEP  565 H= 141:15 +CPU= 74.667
  13:21:19 STEP  566 H= 141:30 +CPU= 74.091
  13:22:44 STEP  567 H= 141:45 +CPU= 73.201
  13:24:10 STEP  568 H= 142:00 +CPU= 74.697
  13:25:35 STEP  569 H= 142:15 +CPU= 73.054
  13:27:01 STEP  570 H= 142:30 +CPU= 74.226
  13:28:29 STEP  571 H= 142:45 +CPU= 75.343
  13:29:55 STEP  572 H= 143:00 +CPU= 74.555
  13:31:21 STEP  573 H= 143:15 +CPU= 73.000
  13:32:46 STEP  574 H= 143:30 +CPU= 72.680
  13:34:11 STEP  575 H= 143:45 +CPU= 72.653
  13:36:00 STEP  576 H= 144:00 +CPU= 96.018
Moving to projects directory: /config/slots/1/ICMGGh7zg+000576
Moving to projects directory: /config/slots/1/ICMSHh7zg+000576
Moving to projects directory: /config/slots/1/ICMUAh7zg+000576
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000480
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000480
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000480
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000492
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000492
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000492
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000504
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000504
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000504
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000516
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000516
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000516
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000528
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000528
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000528
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000540
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000540
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000540
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000552
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000552
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000552
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000564
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000564
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000564
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_bl_a0gi_2016092300_20_1018_12288921_0_r854800425_5.zip
Uploading the intermediate file: upload_file_5.zip
  13:37:28 STEP  577 H= 144:15 +CPU= 74.146
  13:38:54 STEP  578 H= 144:30 +CPU= 73.034
  13:40:18 STEP  579 H= 144:45 +CPU= 72.678
  13:41:44 STEP  580 H= 145:00 +CPU= 74.246
  13:43:11 STEP  581 H= 145:15 +CPU= 73.138
  13:44:35 STEP  582 H= 145:30 +CPU= 72.760
  13:45:58 STEP  583 H= 145:45 +CPU= 72.408
  13:47:27 STEP  584 H= 146:00 +CPU= 75.209
  13:48:50 STEP  585 H= 146:15 +CPU= 72.761
  13:50:14 STEP  586 H= 146:30 +CPU= 72.992
  13:51:39 STEP  587 H= 146:45 +CPU= 73.544
  13:53:24 STEP  588 H= 147:00 +CPU= 90.699
Moving to projects directory: /config/slots/1/ICMGGh7zg+000588
Moving to projects directory: /config/slots/1/ICMSHh7zg+000588
Moving to projects directory: /config/slots/1/ICMUAh7zg+000588
  13:54:51 STEP  589 H= 147:15 +CPU= 73.102
  13:56:16 STEP  590 H= 147:30 +CPU= 73.101
  13:57:42 STEP  591 H= 147:45 +CPU= 73.648
  13:59:07 STEP  592 H= 148:00 +CPU= 74.309
  14:00:32 STEP  593 H= 148:15 +CPU= 73.849
  14:01:56 STEP  594 H= 148:30 +CPU= 72.434
  14:03:21 STEP  595 H= 148:45 +CPU= 72.835
  14:04:46 STEP  596 H= 149:00 +CPU= 73.563
  14:06:13 STEP  597 H= 149:15 +CPU= 73.562
  14:07:35 STEP  598 H= 149:30 +CPU= 71.880
  14:08:58 STEP  599 H= 149:45 +CPU= 71.863
  14:10:43 STEP  600 H= 150:00 +CPU= 90.441
Moving to projects directory: /config/slots/1/ICMGGh7zg+000600
Moving to projects directory: /config/slots/1/ICMSHh7zg+000600
Moving to projects directory: /config/slots/1/ICMUAh7zg+000600
  14:12:07 STEP  601 H= 150:15 +CPU= 72.712
  14:13:33 STEP  602 H= 150:30 +CPU= 74.189
  14:14:59 STEP  603 H= 150:45 +CPU= 74.119
  14:16:28 STEP  604 H= 151:00 +CPU= 75.661
  14:17:57 STEP  605 H= 151:15 +CPU= 76.687
  14:19:30 STEP  606 H= 151:30 +CPU= 79.323
  14:20:53 STEP  607 H= 151:45 +CPU= 72.741
  14:22:19 STEP  608 H= 152:00 +CPU= 74.640
  14:23:41 STEP  609 H= 152:15 +CPU= 71.990
  14:25:06 STEP  610 H= 152:30 +CPU= 73.380
  14:26:29 STEP  611 H= 152:45 +CPU= 72.544
  14:28:14 STEP  612 H= 153:00 +CPU= 91.192
Moving to projects directory: /config/slots/1/ICMGGh7zg+000612
Moving to projects directory: /config/slots/1/ICMSHh7zg+000612
Moving to projects directory: /config/slots/1/ICMUAh7zg+000612
  14:29:42 STEP  613 H= 153:15 +CPU= 74.445
  14:31:05 STEP  614 H= 153:30 +CPU= 73.099
  14:32:31 STEP  615 H= 153:45 +CPU= 73.478
  14:33:59 STEP  616 H= 154:00 +CPU= 75.574
  14:35:24 STEP  617 H= 154:15 +CPU= 72.679
  14:36:50 STEP  618 H= 154:30 +CPU= 74.001
  14:38:17 STEP  619 H= 154:45 +CPU= 73.697
  14:39:45 STEP  620 H= 155:00 +CPU= 74.901
  14:41:08 STEP  621 H= 155:15 +CPU= 72.478
  14:42:30 STEP  622 H= 155:30 +CPU= 72.119
  14:43:58 STEP  623 H= 155:45 +CPU= 73.793
  14:45:48 STEP  624 H= 156:00 +CPU= 96.209
Moving to projects directory: /config/slots/1/ICMGGh7zg+000624
Moving to projects directory: /config/slots/1/ICMSHh7zg+000624
Moving to projects directory: /config/slots/1/ICMUAh7zg+000624
  14:47:15 STEP  625 H= 156:15 +CPU= 73.771
  14:48:41 STEP  626 H= 156:30 +CPU= 73.794
  14:50:04 STEP  627 H= 156:45 +CPU= 72.017
  14:51:31 STEP  628 H= 157:00 +CPU= 74.950
  14:52:53 STEP  629 H= 157:15 +CPU= 72.076
  14:54:18 STEP  630 H= 157:30 +CPU= 72.914
  14:55:45 STEP  631 H= 157:45 +CPU= 73.589
  14:57:11 STEP  632 H= 158:00 +CPU= 74.651
  14:58:35 STEP  633 H= 158:15 +CPU= 72.594
  14:59:59 STEP  634 H= 158:30 +CPU= 73.579
  15:01:23 STEP  635 H= 158:45 +CPU= 73.476
  15:03:06 STEP  636 H= 159:00 +CPU= 89.757
Moving to projects directory: /config/slots/1/ICMGGh7zg+000636
Moving to projects directory: /config/slots/1/ICMSHh7zg+000636
Moving to projects directory: /config/slots/1/ICMUAh7zg+000636
  15:04:33 STEP  637 H= 159:15 +CPU= 74.403
  15:05:58 STEP  638 H= 159:30 +CPU= 72.699
  15:07:24 STEP  639 H= 159:45 +CPU= 73.610
  15:08:51 STEP  640 H= 160:00 +CPU= 74.883
  15:10:14 STEP  641 H= 160:15 +CPU= 71.924
  15:11:41 STEP  642 H= 160:30 +CPU= 73.949
  15:13:02 STEP  643 H= 160:45 +CPU= 71.747
  15:14:30 STEP  644 H= 161:00 +CPU= 75.642
  15:15:56 STEP  645 H= 161:15 +CPU= 74.119
  15:17:22 STEP  646 H= 161:30 +CPU= 73.577
  15:18:47 STEP  647 H= 161:45 +CPU= 73.067
  15:20:29 STEP  648 H= 162:00 +CPU= 89.127
Moving to projects directory: /config/slots/1/ICMGGh7zg+000648
Moving to projects directory: /config/slots/1/ICMSHh7zg+000648
Moving to projects directory: /config/slots/1/ICMUAh7zg+000648
  15:21:54 STEP  649 H= 162:15 +CPU= 72.842
  15:23:20 STEP  650 H= 162:30 +CPU= 73.649
  15:24:45 STEP  651 H= 162:45 +CPU= 73.678
  15:26:11 STEP  652 H= 163:00 +CPU= 75.264
  15:27:37 STEP  653 H= 163:15 +CPU= 73.633
  15:29:02 STEP  654 H= 163:30 +CPU= 73.576
  15:30:27 STEP  655 H= 163:45 +CPU= 73.125
  15:31:54 STEP  656 H= 164:00 +CPU= 74.672
  15:33:19 STEP  657 H= 164:15 +CPU= 73.293
  15:34:48 STEP  658 H= 164:30 +CPU= 75.053
  15:36:12 STEP  659 H= 164:45 +CPU= 73.002
  15:37:56 STEP  660 H= 165:00 +CPU= 90.527
Moving to projects directory: /config/slots/1/ICMGGh7zg+000660
Moving to projects directory: /config/slots/1/ICMSHh7zg+000660
Moving to projects directory: /config/slots/1/ICMUAh7zg+000660
  15:39:21 STEP  661 H= 165:15 +CPU= 73.173
  15:40:45 STEP  662 H= 165:30 +CPU= 72.745
  15:42:12 STEP  663 H= 165:45 +CPU= 74.321
  15:43:40 STEP  664 H= 166:00 +CPU= 75.568
  15:45:05 STEP  665 H= 166:15 +CPU= 73.292
  15:46:30 STEP  666 H= 166:30 +CPU= 73.519
  15:47:55 STEP  667 H= 166:45 +CPU= 73.829
  15:49:24 STEP  668 H= 167:00 +CPU= 74.864
  15:50:48 STEP  669 H= 167:15 +CPU= 72.888
  15:52:12 STEP  670 H= 167:30 +CPU= 72.978
  15:53:37 STEP  671 H= 167:45 +CPU= 73.043
  15:55:27 STEP  672 H= 168:00 +CPU= 96.677
Moving to projects directory: /config/slots/1/ICMGGh7zg+000672
Moving to projects directory: /config/slots/1/ICMSHh7zg+000672
Moving to projects directory: /config/slots/1/ICMUAh7zg+000672
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000576
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000576
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000576
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000588
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000588
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000588
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000600
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000600
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000600
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000612
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000612
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000612
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000624
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000624
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000624
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000636
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000636
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000636
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000648
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000648
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000648
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000660
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000660
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000660
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_bl_a0gi_2016092300_20_1018_12288921_0_r854800425_6.zip
Uploading the intermediate file: upload_file_6.zip
  15:56:59 STEP  673 H= 168:15 +CPU= 75.792
  15:58:24 STEP  674 H= 168:30 +CPU= 73.562
  15:59:48 STEP  675 H= 168:45 +CPU= 72.878
  16:01:26 STEP  676 H= 169:00 +CPU= 83.148
  16:02:54 STEP  677 H= 169:15 +CPU= 76.735
  16:04:26 STEP  678 H= 169:30 +CPU= 77.781
  16:05:48 STEP  679 H= 169:45 +CPU= 72.175
  16:07:15 STEP  680 H= 170:00 +CPU= 75.292
  16:08:39 STEP  681 H= 170:15 +CPU= 72.940
  16:10:04 STEP  682 H= 170:30 +CPU= 73.049
  16:11:28 STEP  683 H= 170:45 +CPU= 73.212
  16:13:20 STEP  684 H= 171:00 +CPU= 92.378
Moving to projects directory: /config/slots/1/ICMGGh7zg+000684
Moving to projects directory: /config/slots/1/ICMSHh7zg+000684
Moving to projects directory: /config/slots/1/ICMUAh7zg+000684
  16:14:43 STEP  685 H= 171:15 +CPU= 72.656
  16:16:09 STEP  686 H= 171:30 +CPU= 73.830
  16:17:34 STEP  687 H= 171:45 +CPU= 73.031
  16:19:07 STEP  688 H= 172:00 +CPU= 79.249
  16:20:40 STEP  689 H= 172:15 +CPU= 79.589
  16:22:11 STEP  690 H= 172:30 +CPU= 77.875
  16:23:41 STEP  691 H= 172:45 +CPU= 76.211
  16:25:15 STEP  692 H= 173:00 +CPU= 78.255
  16:26:41 STEP  693 H= 173:15 +CPU= 74.852
  16:28:12 STEP  694 H= 173:30 +CPU= 76.942
  16:29:40 STEP  695 H= 173:45 +CPU= 76.417
  16:31:32 STEP  696 H= 174:00 +CPU= 96.195
Moving to projects directory: /config/slots/1/ICMGGh7zg+000696
Moving to projects directory: /config/slots/1/ICMSHh7zg+000696
Moving to projects directory: /config/slots/1/ICMUAh7zg+000696
  16:33:01 STEP  697 H= 174:15 +CPU= 77.188
  16:34:30 STEP  698 H= 174:30 +CPU= 76.387
  16:35:58 STEP  699 H= 174:45 +CPU= 76.465
  16:37:30 STEP  700 H= 175:00 +CPU= 79.012
  16:38:57 STEP  701 H= 175:15 +CPU= 74.411
  16:40:24 STEP  702 H= 175:30 +CPU= 75.306
  16:41:53 STEP  703 H= 175:45 +CPU= 75.612
  16:43:20 STEP  704 H= 176:00 +CPU= 76.275
  16:44:47 STEP  705 H= 176:15 +CPU= 75.685
  16:46:17 STEP  706 H= 176:30 +CPU= 76.604
  16:47:45 STEP  707 H= 176:45 +CPU= 76.175
  16:49:31 STEP  708 H= 177:00 +CPU= 93.344
Moving to projects directory: /config/slots/1/ICMGGh7zg+000708
Moving to projects directory: /config/slots/1/ICMSHh7zg+000708
Moving to projects directory: /config/slots/1/ICMUAh7zg+000708
  16:51:00 STEP  709 H= 177:15 +CPU= 76.651
  16:52:29 STEP  710 H= 177:30 +CPU= 75.831
  16:53:58 STEP  711 H= 177:45 +CPU= 76.418
  16:55:26 STEP  712 H= 178:00 +CPU= 77.008
  16:56:53 STEP  713 H= 178:15 +CPU= 75.435
  16:58:24 STEP  714 H= 178:30 +CPU= 76.707
  16:59:51 STEP  715 H= 178:45 +CPU= 74.847
  17:01:21 STEP  716 H= 179:00 +CPU= 78.084
  17:02:48 STEP  717 H= 179:15 +CPU= 75.072
  17:04:16 STEP  718 H= 179:30 +CPU= 75.639
  17:05:42 STEP  719 H= 179:45 +CPU= 74.992
  17:07:35 STEP  720 H= 180:00 +CPU= 98.596
Moving to projects directory: /config/slots/1/ICMGGh7zg+000720
Moving to projects directory: /config/slots/1/ICMSHh7zg+000720
Moving to projects directory: /config/slots/1/ICMUAh7zg+000720
  17:09:03 STEP  721 H= 180:15 +CPU= 75.530
  17:10:31 STEP  722 H= 180:30 +CPU= 75.514
  17:11:58 STEP  723 H= 180:45 +CPU= 75.400
  17:13:27 STEP  724 H= 181:00 +CPU= 76.824
  17:14:53 STEP  725 H= 181:15 +CPU= 74.564
  17:16:22 STEP  726 H= 181:30 +CPU= 75.695
  17:17:49 STEP  727 H= 181:45 +CPU= 75.175
  17:19:17 STEP  728 H= 182:00 +CPU= 76.923
  17:20:45 STEP  729 H= 182:15 +CPU= 74.937
  17:22:09 STEP  730 H= 182:30 +CPU= 74.440
  17:23:34 STEP  731 H= 182:45 +CPU= 74.507
  17:25:22 STEP  732 H= 183:00 +CPU= 93.823
Moving to projects directory: /config/slots/1/ICMGGh7zg+000732
Moving to projects directory: /config/slots/1/ICMSHh7zg+000732
Moving to projects directory: /config/slots/1/ICMUAh7zg+000732
  17:26:49 STEP  733 H= 183:15 +CPU= 75.420
  17:28:15 STEP  734 H= 183:30 +CPU= 74.951
  17:29:42 STEP  735 H= 183:45 +CPU= 76.493
  17:31:10 STEP  736 H= 184:00 +CPU= 76.849
  17:32:39 STEP  737 H= 184:15 +CPU= 75.653
  17:34:10 STEP  738 H= 184:30 +CPU= 76.488
  17:35:37 STEP  739 H= 184:45 +CPU= 74.958
  17:37:05 STEP  740 H= 185:00 +CPU= 76.227
  17:38:33 STEP  741 H= 185:15 +CPU= 75.605
  17:39:57 STEP  742 H= 185:30 +CPU= 74.132
  17:41:25 STEP  743 H= 185:45 +CPU= 75.131
  17:43:12 STEP  744 H= 186:00 +CPU= 93.102
Moving to projects directory: /config/slots/1/ICMGGh7zg+000744
Moving to projects directory: /config/slots/1/ICMSHh7zg+000744
Moving to projects directory: /config/slots/1/ICMUAh7zg+000744
  17:44:41 STEP  745 H= 186:15 +CPU= 75.490
  17:46:08 STEP  746 H= 186:30 +CPU= 75.761
  17:47:34 STEP  747 H= 186:45 +CPU= 75.126
  17:49:02 STEP  748 H= 187:00 +CPU= 76.081
  17:50:29 STEP  749 H= 187:15 +CPU= 75.828
  17:52:06 STEP  750 H= 187:30 +CPU= 80.782
  17:53:36 STEP  751 H= 187:45 +CPU= 76.702
  17:55:07 STEP  752 H= 188:00 +CPU= 77.020
  17:56:29 STEP  753 H= 188:15 +CPU= 72.623
  17:57:56 STEP  754 H= 188:30 +CPU= 73.851
  17:59:18 STEP  755 H= 188:45 +CPU= 73.848
  18:01:04 STEP  756 H= 189:00 +CPU= 91.629
Moving to projects directory: /config/slots/1/ICMGGh7zg+000756
Moving to projects directory: /config/slots/1/ICMSHh7zg+000756
Moving to projects directory: /config/slots/1/ICMUAh7zg+000756
  18:02:29 STEP  757 H= 189:15 +CPU= 74.594
  18:03:53 STEP  758 H= 189:30 +CPU= 72.805
  18:05:18 STEP  759 H= 189:45 +CPU= 73.960
  18:06:50 STEP  760 H= 190:00 +CPU= 77.488
  18:08:16 STEP  761 H= 190:15 +CPU= 73.850
  18:09:38 STEP  762 H= 190:30 +CPU= 72.268
  18:11:03 STEP  763 H= 190:45 +CPU= 73.416
  18:12:32 STEP  764 H= 191:00 +CPU= 76.928
  18:13:57 STEP  765 H= 191:15 +CPU= 73.804
  18:15:24 STEP  766 H= 191:30 +CPU= 74.476
  18:16:51 STEP  767 H= 191:45 +CPU= 74.400
  18:18:46 STEP  768 H= 192:00 +CPU= 99.259
Moving to projects directory: /config/slots/1/ICMGGh7zg+000768
Moving to projects directory: /config/slots/1/ICMSHh7zg+000768
Moving to projects directory: /config/slots/1/ICMUAh7zg+000768
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000672
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000672
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000672
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000684
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000684
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000684
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000696
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000696
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000696
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000708
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000708
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000708
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000720
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000720
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000720
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000732
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000732
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000732
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000744
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000744
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000744
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000756
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000756
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000756
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_bl_a0gi_2016092300_20_1018_12288921_0_r854800425_7.zip
Uploading the intermediate file: upload_file_7.zip
  18:20:15 STEP  769 H= 192:15 +CPU= 75.408
  18:21:41 STEP  770 H= 192:30 +CPU= 73.913
  18:23:06 STEP  771 H= 192:45 +CPU= 73.909
  18:24:33 STEP  772 H= 193:00 +CPU= 75.873
  18:25:59 STEP  773 H= 193:15 +CPU= 74.359
  18:27:27 STEP  774 H= 193:30 +CPU= 74.699
  18:28:52 STEP  775 H= 193:45 +CPU= 73.906
  18:30:24 STEP  776 H= 194:00 +CPU= 77.942
  18:31:49 STEP  777 H= 194:15 +CPU= 73.567
  18:33:15 STEP  778 H= 194:30 +CPU= 74.451
  18:34:41 STEP  779 H= 194:45 +CPU= 74.288
  18:36:26 STEP  780 H= 195:00 +CPU= 91.864
Moving to projects directory: /config/slots/1/ICMGGh7zg+000780
Moving to projects directory: /config/slots/1/ICMSHh7zg+000780
Moving to projects directory: /config/slots/1/ICMUAh7zg+000780
  18:37:52 STEP  781 H= 195:15 +CPU= 74.282
  18:39:18 STEP  782 H= 195:30 +CPU= 74.338
  18:40:43 STEP  783 H= 195:45 +CPU= 73.900
  18:42:10 STEP  784 H= 196:00 +CPU= 75.397
  18:43:36 STEP  785 H= 196:15 +CPU= 73.738
  18:45:04 STEP  786 H= 196:30 +CPU= 74.757
  18:46:32 STEP  787 H= 196:45 +CPU= 74.232
  18:47:58 STEP  788 H= 197:00 +CPU= 75.420
  18:49:28 STEP  789 H= 197:15 +CPU= 74.732
  18:50:53 STEP  790 H= 197:30 +CPU= 73.567
  18:52:16 STEP  791 H= 197:45 +CPU= 72.454
  18:53:59 STEP  792 H= 198:00 +CPU= 90.601
Moving to projects directory: /config/slots/1/ICMGGh7zg+000792
Moving to projects directory: /config/slots/1/ICMSHh7zg+000792
Moving to projects directory: /config/slots/1/ICMUAh7zg+000792
  18:55:25 STEP  793 H= 198:15 +CPU= 73.898
  18:56:50 STEP  794 H= 198:30 +CPU= 73.672
  18:58:16 STEP  795 H= 198:45 +CPU= 73.866
  18:59:42 STEP  796 H= 199:00 +CPU= 74.865
  19:01:08 STEP  797 H= 199:15 +CPU= 74.204
  19:02:35 STEP  798 H= 199:30 +CPU= 72.934
  19:04:01 STEP  799 H= 199:45 +CPU= 73.924
  19:05:28 STEP  800 H= 200:00 +CPU= 76.182
  19:06:53 STEP  801 H= 200:15 +CPU= 73.766
  19:08:20 STEP  802 H= 200:30 +CPU= 73.978
  19:09:43 STEP  803 H= 200:45 +CPU= 72.742
  19:11:27 STEP  804 H= 201:00 +CPU= 90.808
Moving to projects directory: /config/slots/1/ICMGGh7zg+000804
Moving to projects directory: /config/slots/1/ICMSHh7zg+000804
Moving to projects directory: /config/slots/1/ICMUAh7zg+000804
  19:12:54 STEP  805 H= 201:15 +CPU= 75.903
  19:14:30 STEP  806 H= 201:30 +CPU= 81.157
  19:15:59 STEP  807 H= 201:45 +CPU= 78.012
  19:17:34 STEP  808 H= 202:00 +CPU= 79.330
  19:19:01 STEP  809 H= 202:15 +CPU= 75.679
  19:20:33 STEP  810 H= 202:30 +CPU= 77.832
  19:21:57 STEP  811 H= 202:45 +CPU= 74.867
  19:23:25 STEP  812 H= 203:00 +CPU= 76.529
  19:24:57 STEP  813 H= 203:15 +CPU= 76.618
  19:26:27 STEP  814 H= 203:30 +CPU= 76.402
  19:27:54 STEP  815 H= 203:45 +CPU= 75.738
  19:29:45 STEP  816 H= 204:00 +CPU= 99.133
Moving to projects directory: /config/slots/1/ICMGGh7zg+000816
Moving to projects directory: /config/slots/1/ICMSHh7zg+000816
Moving to projects directory: /config/slots/1/ICMUAh7zg+000816
  19:31:16 STEP  817 H= 204:15 +CPU= 78.709
  19:32:49 STEP  818 H= 204:30 +CPU= 78.159
  19:34:16 STEP  819 H= 204:45 +CPU= 74.312
  19:35:54 STEP  820 H= 205:00 +CPU= 82.938
  19:37:34 STEP  821 H= 205:15 +CPU= 82.091
  19:39:04 STEP  822 H= 205:30 +CPU= 77.816
  19:40:31 STEP  823 H= 205:45 +CPU= 75.813
  19:41:59 STEP  824 H= 206:00 +CPU= 77.380
  19:43:36 STEP  825 H= 206:15 +CPU= 79.195
  19:45:05 STEP  826 H= 206:30 +CPU= 76.584
  19:46:32 STEP  827 H= 206:45 +CPU= 76.065
  19:48:25 STEP  828 H= 207:00 +CPU= 96.466
Moving to projects directory: /config/slots/1/ICMGGh7zg+000828
Moving to projects directory: /config/slots/1/ICMSHh7zg+000828
Moving to projects directory: /config/slots/1/ICMUAh7zg+000828
  19:49:51 STEP  829 H= 207:15 +CPU= 75.609
  19:51:19 STEP  830 H= 207:30 +CPU= 76.547
  19:52:48 STEP  831 H= 207:45 +CPU= 77.105
  19:54:18 STEP  832 H= 208:00 +CPU= 77.641
  19:55:49 STEP  833 H= 208:15 +CPU= 77.075
  19:57:17 STEP  834 H= 208:30 +CPU= 76.345
  19:58:46 STEP  835 H= 208:45 +CPU= 76.802
  20:00:13 STEP  836 H= 209:00 +CPU= 77.619
  20:01:39 STEP  837 H= 209:15 +CPU= 75.554
  20:03:08 STEP  838 H= 209:30 +CPU= 76.658
  20:04:36 STEP  839 H= 209:45 +CPU= 75.585
  20:06:24 STEP  840 H= 210:00 +CPU= 94.181
Moving to projects directory: /config/slots/1/ICMGGh7zg+000840
Moving to projects directory: /config/slots/1/ICMSHh7zg+000840
Moving to projects directory: /config/slots/1/ICMUAh7zg+000840
  20:07:52 STEP  841 H= 210:15 +CPU= 75.677
  20:09:21 STEP  842 H= 210:30 +CPU= 76.483
  20:10:48 STEP  843 H= 210:45 +CPU= 76.448
  20:12:23 STEP  844 H= 211:00 +CPU= 78.874
  20:13:51 STEP  845 H= 211:15 +CPU= 76.093
  20:15:26 STEP  846 H= 211:30 +CPU= 77.352
  20:16:56 STEP  847 H= 211:45 +CPU= 74.642
  20:18:22 STEP  848 H= 212:00 +CPU= 75.212
  20:19:48 STEP  849 H= 212:15 +CPU= 73.843
  20:21:11 STEP  850 H= 212:30 +CPU= 73.487
  20:22:40 STEP  851 H= 212:45 +CPU= 74.648
  20:24:26 STEP  852 H= 213:00 +CPU= 91.205
Moving to projects directory: /config/slots/1/ICMGGh7zg+000852
Moving to projects directory: /config/slots/1/ICMSHh7zg+000852
Moving to projects directory: /config/slots/1/ICMUAh7zg+000852
  20:25:52 STEP  853 H= 213:15 +CPU= 74.242
  20:27:18 STEP  854 H= 213:30 +CPU= 74.256
  20:28:40 STEP  855 H= 213:45 +CPU= 72.969
  20:30:05 STEP  856 H= 214:00 +CPU= 75.110
  20:31:32 STEP  857 H= 214:15 +CPU= 74.554
  20:32:58 STEP  858 H= 214:30 +CPU= 74.019
  20:34:26 STEP  859 H= 214:45 +CPU= 74.923
  20:35:52 STEP  860 H= 215:00 +CPU= 74.966
  20:37:19 STEP  861 H= 215:15 +CPU= 73.844
  20:38:41 STEP  862 H= 215:30 +CPU= 72.104
  20:40:05 STEP  863 H= 215:45 +CPU= 73.176
  20:41:57 STEP  864 H= 216:00 +CPU= 97.513
Moving to projects directory: /config/slots/1/ICMGGh7zg+000864
Moving to projects directory: /config/slots/1/ICMSHh7zg+000864
Moving to projects directory: /config/slots/1/ICMUAh7zg+000864
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000768
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000768
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000768
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000780
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000780
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000780
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000792
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000792
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000792
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000804
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000804
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000804
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000816
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000816
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000816
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000828
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000828
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000828
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000840
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000840
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000840
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMGGh7zg+000852
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMSHh7zg+000852
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12288921/ICMUAh7zg+000852
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_bl_a0gi_2016092300_20_1018_12288921_0_r854800425_8.zip
Uploading the intermediate file: upload_file_8.zip
  20:43:25 STEP  865 H= 216:15 +CPU= 75.100
  20:44:54 STEP  866 H= 216:30 +CPU= 74.338
  20:46:22 STEP  867 H= 216:45 +CPU= 74.651
  20:47:49 STEP  868 H= 217:00 +CPU= 74.869
  20:49:14 STEP  869 H= 217:15 +CPU= 73.605
  20:50:39 STEP  870 H= 217:30 +CPU= 73.739
  20:52:06 STEP  871 H= 217:45 +CPU= 74.158
  20:53:31 STEP  872 H= 218:00 +CPU= 74.186
  20:54:54 STEP  873 H= 218:15 +CPU= 72.716
  20:56:18 STEP  874 H= 218:30 +CPU= 72.953
  20:57:43 STEP  875 H= 218:45 +CPU= 72.933
  20:59:26 STEP  876 H= 219:00 +CPU= 90.704
Moving to projects directory: /config/slots/1/ICMGGh7zg+000876
Moving to projects directory: /config/slots/1/ICMSHh7zg+000876
Moving to projects directory: /config/slots/1/ICMUAh7zg+000876
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01

 UPDT RAESHDU =  2000.0
 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT)     20160923
         270  9.999999999999998E-005
 GPNORM  HUMIDITY            AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.270769383547047E-02 0.999999999999995E-08 0.266856131832187E-01
 GPNORM  LIQUID WATER        AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.693198979449296E-06 0.000000000000000E+00 0.654509362288973E-03
 GPNORM  ICE WATER           AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.257696028305036E-06 0.000000000000000E+00 0.351082442559650E-03
 GPNORM SNOW                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.782344201519236E-06 0.000000000000000E+00 0.850710874506477E-03
 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.130301958254411E-06 0.000000000000000E+00 0.293018504744313E-03
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.114427133563195E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.690300034853989E-06 0.000000000000000E+00 0.674932157118621E-03
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.257139266210298E-06 0.000000000000000E+00 0.310262542212803E-03
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.114409702347621E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.558230065400865E-06 0.000000000000000E+00 0.108352822183272E-02
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.803268540689829E-06 0.000000000000000E+00 0.649581863614396E-03
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.237507065128095E-06 0.000000000000000E+00 0.104749275715822E-02
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.836120859874754E-07 0.000000000000000E+00 0.754791517521642E-03
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.490790997876359E-01 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   876 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   876 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000876 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000876
 MPI-TASK:   1 -    301474404 BYTES IN      6 RECORDS TRANSFERRED IN    0.0010 SECONDS301474.4 Mbytes/s, TOTAL TIME=    0.1387( 0.7%)
 NSTEP =   876 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000876 MODE=w
 IO-STREAM CLOSED - ./ICMSHh7zg+000876
 MPI-TASK:   1 -    707399250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0080 SECONDS 88424.9 Mbytes/s, TOTAL TIME=    0.6601( 1.2%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000876 MODE=w
 IO-STREAM CLOSED - ./ICMUAh7zg+000876
 MPI-TASK:   1 -   4823590464 BYTES IN    125 RECORDS TRANSFERRED IN    0.0041 SECONDS******** Mbytes/s, TOTAL TIME=    0.4604( 0.9%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000876 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000876
 MPI-TASK:   1 -           10 BYTES IN      2 RECORDS TRANSFERRED IN    0.0002 SECONDS     0.0 Mbytes/s, TOTAL TIME=    0.0092( 2.2%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000876 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000876
 MPI-TASK:   1 -    292894675 BYTES IN      4 RECORDS TRANSFERRED IN    0.0003 SECONDS976315.5 Mbytes/s, TOTAL TIME=    0.0190( 1.6%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =   876 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   876 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000876 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000876
 MPI-TASK:   1 -    301474404 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS430677.7 Mbytes/s, TOTAL TIME=    0.0653( 1.1%)
 20:59:26 STEP  876 H= 219:00 +CPU= 90.704
 NSTEP =   877 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 20:57:44 A00000000 STEPO      876    73.262   73.262   85.073   1110:35   1289:36 0.33106875653470E-05       2GB       0MB
 20:57:44 0AA000000 STEPO      876     0.141    0.141    0.309   1110:35   1289:36 0.33106875653470E-05       2GB       0MB
 20:57:49 FULLPOS-B DYNFPOS    876     3.923    3.923    4.909   1110:39   1289:41 0.33106875653470E-05       2GB       0MB
 20:57:56 FULLPOS-V DYNFPOS    876     7.626    7.626    7.691   1110:47   1289:49 0.33106875653470E-05       2GB       0MB
 20:57:58 FULLPOS-T DYNFPOS    876     1.646    1.646    1.656   1110:48   1289:51 0.33106875653470E-05       2GB       0MB
 20:58:00 0AAA00AAA STEPO      876     1.581    1.581    1.592   1110:50   1289:52 0.33106875653470E-05       2GB       0MB
 20:59:26 0AAA00AAA STEPO      877    75.460   75.460   86.765   1112:06   1291:19 0.33106875653470E-05       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     864",
 CTIME   = "00090000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         852, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /config/slots/1/progress_file_12288921.xml

<running_values>
  <last_cpu_time>66746.600000</last_cpu_time>
  <upload_file_number>9</upload_file_number>
  <last_iter>877</last_iter>
  <last_upload>777600</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net