climateprediction.net home page
Task 11247389

Task 11247389

Name hadsm3dhet2_k6vm_006618564_2
Workunit 6821937
Created 15 Mar 2010, 12:31:33 UTC
Sent 21 Apr 2010, 6:10:32 UTC
Report deadline 3 Apr 2011, 11:30:32 UTC
Received 5 Aug 2011, 3:00:09 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status -197 (0xFFFFFF3B) ERR_ABORTED_VIA_GUI
Computer ID 963319
Run time 250 days 19 hours 44 min 40 sec
CPU time 241 days 18 hours 4 min 30 sec
Validate state Invalid
Credit 6,748.55
Device peak FLOPS 0.00 GFLOPS
Application version ---
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
aborted by user
</message>
<stderr_txt>
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=324, iMonCtr=1
Model crash detected, will try to restart...
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
MainError:	12:58:43 AM	No files match the supplied pattern.
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4800, iMonCtr=1
Model crash detected, will try to restart...
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
MainError:	03:31:36 PM	No files match the supplied pattern.
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5360, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5316, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5576, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5488, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5932, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5612, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5612, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5756, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3252, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3252, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4028, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4028, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4028, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4028, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4028, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4028, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
called boinc_finish
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4900, iMonCtr=1
Model crash detected, will try to restart...
CMainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
MainError:	06:02:31 AM	No files match the supplied pattern.
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5368, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5296, iMonCtr=1
Model crash detected, will try to restart...
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
MainError:	08:38:38 AM	No files match the supplied pattern.
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4864, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5736, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6072, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5248, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5548, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5432, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5388, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5580, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3016, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5112, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3188, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1
Model crash detected, will try to restart...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5704, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4760, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4412, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5468, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6128, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5216, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5356, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5540, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4156, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1
Model crash detected, will try to restart...
CCPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3328, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3328, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3328, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5244, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1476, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6100, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3712, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4456, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6052, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5828, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3984, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4804, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4804, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Abort request from BOINC...
called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Sep 2010 21:21:12 963319 11247389 hadsm3dhet2_k6vm_006618564_2 216,040 6,575,352 8.9517
22 Aug 2010 22:33:22 963319 11247389 hadsm3dhet2_k6vm_006618564_2 205,238 5,565,668 7.6902
28 Jul 2010 19:34:31 963319 11247389 hadsm3dhet2_k6vm_006618564_2 194,436 4,514,611 6.3325
14 Jul 2010 12:06:24 963319 11247389 hadsm3dhet2_k6vm_006618564_2 183,634 3,729,123 5.3112
02 Jul 2010 06:07:03 963319 11247389 hadsm3dhet2_k6vm_006618564_2 172,832 2,940,414 4.2533
17 Jun 2010 12:45:12 963319 11247389 hadsm3dhet2_k6vm_006618564_2 162,030 2,164,975 3.1813
01 Jun 2010 07:23:21 963319 11247389 hadsm3dhet2_k6vm_006618564_2 151,228 1,463,591 2.1854
29 May 2010 05:03:30 963319 11247389 hadsm3dhet2_k6vm_006618564_2 140,426 1,203,288 1.8261
29 May 2010 01:35:05 963319 11247389 hadsm3dhet2_k6vm_006618564_2 129,624 1,189,024 1.8346
28 May 2010 20:59:22 963319 11247389 hadsm3dhet2_k6vm_006618564_2 118,822 1,174,955 1.8436
26 May 2010 22:06:39 963319 11247389 hadsm3dhet2_k6vm_006618564_2 108,020 1,156,811 1.8464
19 May 2010 21:39:16 963319 11247389 hadsm3dhet2_k6vm_006618564_2 97,218 1,140,991 1.8531
19 May 2010 16:28:11 963319 11247389 hadsm3dhet2_k6vm_006618564_2 86,416 1,124,437 1.8588
19 May 2010 11:07:16 963319 11247389 hadsm3dhet2_k6vm_006618564_2 75,614 1,106,156 1.8619
19 May 2010 05:38:21 963319 11247389 hadsm3dhet2_k6vm_006618564_2 64,812 1,087,767 1.8648
18 May 2010 15:57:57 963319 11247389 hadsm3dhet2_k6vm_006618564_2 54,010 1,069,672 1.8684
18 May 2010 10:32:15 963319 11247389 hadsm3dhet2_k6vm_006618564_2 43,208 1,051,125 1.8713
18 May 2010 05:04:13 963319 11247389 hadsm3dhet2_k6vm_006618564_2 32,406 1,032,664 1.8745
17 May 2010 23:43:21 963319 11247389 hadsm3dhet2_k6vm_006618564_2 21,604 1,014,225 1.8778
17 May 2010 19:24:38 963319 11247389 hadsm3dhet2_k6vm_006618564_2 10,802 999,160 1.8877


©2024 climateprediction.net