climateprediction.net home page
Task 13517080

Task 13517080

Name hadam3p_eu_6mrm_2000_1_007496775_1
Workunit 7694250
Created 25 Oct 2011, 16:02:37 UTC
Sent 25 Oct 2011, 16:05:18 UTC
Report deadline 6 Oct 2012, 21:25:18 UTC
Received 3 Dec 2011, 17:20:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1130285
Run time 6 days 9 hours 5 min 27 sec
CPU time 5 days 12 hours 18 min 23 sec
Validate state Invalid
Credit 1,790.21
Device peak FLOPS 1.40 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Europe v6.09
windows_intelx86
Stderr
<core_client_version>6.10.56</core_client_version>
<![CDATA[
<stderr_txt>
23:52:11 (588): No heartbeat from core client for 30 sec - exiting
23:52:12 (588): No heartbeat from core client for 30 sec - exiting
23:52:13 (588): No heartbeat from core client for 30 sec - exiting
23:52:14 (588): No heartbeat from core client for 30 sec - exiting
23:52:15 (588): No heartbeat from core client for 30 sec - exiting
23:52:16 (588): No heartbeat from core client for 30 sec - exiting
23:52:17 (588): No heartbeat from core client for 30 sec - exiting
23:52:18 (588): No heartbeat from core client for 30 sec - exiting
23:52:19 (588): No heartbeat from core client for 30 sec - exiting
23:52:21 (588): No heartbeat from core client for 30 sec - exiting
23:52:22 (588): No heartbeat from core client for 30 sec - exiting
23:52:23 (588): No heartbeat from core client for 30 sec - exiting
23:52:24 (588): No heartbeat from core client for 30 sec - exiting
23:52:25 (588): No heartbeat from core client for 30 sec - exiting
23:52:26 (588): No heartbeat from core client for 30 sec - exiting
23:52:27 (588): No heartbeat from core client for 30 sec - exiting
23:52:28 (588): No heartbeat from core client for 30 sec - exiting
23:52:29 (588): No heartbeat from core client for 30 sec - exiting
23:52:30 (588): No heartbeat from core client for 30 sec - exiting
23:52:32 (588): No heartbeat from core client for 30 sec - exiting
23:52:33 (588): No heartbeat from core client for 30 sec - exiting
23:52:34 (588): No heartbeat from core client for 30 sec - exiting
23:52:35 (588): No heartbeat from core client for 30 sec - exiting
23:52:36 (588): No heartbeat from core client for 30 sec - exiting
23:52:37 (588): No heartbeat from core client for 30 sec - exiting
23:52:38 (588): No heartbeat from core client for 30 sec - exiting
23:52:39 (588): No heartbeat from core client for 30 sec - exiting
23:52:40 (588): No heartbeat from core client for 30 sec - exiting
23:52:41 (588): No heartbeat from core client for 30 sec - exiting
23:52:42 (588): No heartbeat from core client for 30 sec - exiting
23:52:44 (588): No heartbeat from core client for 30 sec - exiting
23:52:45 (588): No heartbeat from core client for 30 sec - exiting
23:52:46 (588): No heartbeat from core client for 30 sec - exiting
23:52:47 (588): No heartbeat from core client for 30 sec - exiting
23:52:48 (588): No heartbeat from core client for 30 sec - exiting
23:52:49 (588): No heartbeat from core client for 30 sec - exiting
23:52:50 (588): No heartbeat from core client for 30 sec - exiting
23:52:51 (588): No heartbeat from core client for 30 sec - exiting
23:52:52 (588): No heartbeat from core client for 30 sec - exiting
23:52:53 (588): No heartbeat from core client for 30 sec - exiting
23:52:54 (588): No heartbeat from core client for 30 sec - exiting
23:52:56 (588): No heartbeat from core client for 30 sec - exiting
23:52:57 (588): No heartbeat from core client for 30 sec - exiting
23:52:58 (588): No heartbeat from core client for 30 sec - exiting
23:52:59 (588): No heartbeat from core client for 30 sec - exiting
23:53:00 (588): No heartbeat from core client for 30 sec - exiting
23:53:01 (588): No heartbeat from core client for 30 sec - exiting
23:53:02 (588): No heartbeat from core client for 30 sec - exiting
23:53:03 (588): No heartbeat from core client for 30 sec - exiting
23:53:04 (588): No heartbeat from core client for 30 sec - exiting
23:53:05 (588): No heartbeat from core client for 30 sec - exiting
23:53:07 (588): No heartbeat from core client for 30 sec - exiting
23:53:08 (588): No heartbeat from core client for 30 sec - exiting
23:53:09 (588): No heartbeat from core client for 30 sec - exiting
23:53:10 (588): No heartbeat from core client for 30 sec - exiting
23:53:11 (588): No heartbeat from core client for 30 sec - exiting
23:53:12 (588): No heartbeat from core client for 30 sec - exiting
23:53:13 (588): No heartbeat from core client for 30 sec - exiting
23:53:14 (588): No heartbeat from core client for 30 sec - exiting
23:53:15 (588): No heartbeat from core client for 30 sec - exiting
23:53:16 (588): No heartbeat from core client for 30 sec - exiting
23:53:17 (588): No heartbeat from core client for 30 sec - exiting
23:53:19 (588): No heartbeat from core client for 30 sec - exiting
23:53:20 (588): No heartbeat from core client for 30 sec - exiting
23:53:21 (588): No heartbeat from core client for 30 sec - exiting
23:53:22 (588): No heartbeat from core client for 30 sec - exiting
23:53:23 (588): No heartbeat from core client for 30 sec - exiting
23:53:24 (588): No heartbeat from core client for 30 sec - exiting
23:53:25 (588): No heartbeat from core client for 30 sec - exiting
23:53:26 (588): No heartbeat from core client for 30 sec - exiting
23:53:27 (588): No heartbeat from core client for 30 sec - exiting
23:53:28 (588): No heartbeat from core client for 30 sec - exiting
23:53:29 (588): No heartbeat from core client for 30 sec - exiting
23:53:31 (588): No heartbeat from core client for 30 sec - exiting
23:53:32 (588): No heartbeat from core client for 30 sec - exiting
23:53:33 (588): No heartbeat from core client for 30 sec - exiting
23:53:34 (588): No heartbeat from core client for 30 sec - exiting
23:53:35 (588): No heartbeat from core client for 30 sec - exiting
23:53:36 (588): No heartbeat from core client for 30 sec - exiting
23:53:37 (588): No heartbeat from core client for 30 sec - exiting
23:53:38 (588): No heartbeat from core client for 30 sec - exiting
23:53:39 (588): No heartbeat from core client for 30 sec - exiting
23:53:40 (588): No heartbeat from core client for 30 sec - exiting
23:53:42 (588): No heartbeat from core client for 30 sec - exiting
23:53:43 (588): No heartbeat from core client for 30 sec - exiting
23:53:44 (588): No heartbeat from core client for 30 sec - exiting
23:53:45 (588): No heartbeat from core client for 30 sec - exiting
23:53:46 (588): No heartbeat from core client for 30 sec - exiting
23:53:47 (588): No heartbeat from core client for 30 sec - exiting
23:53:48 (588): No heartbeat from core client for 30 sec - exiting
23:53:49 (588): No heartbeat from core client for 30 sec - exiting
23:53:50 (588): No heartbeat from core client for 30 sec - exiting
23:53:52 (588): No heartbeat from core client for 30 sec - exiting
23:53:53 (588): No heartbeat from core client for 30 sec - exiting
23:53:54 (588): No heartbeat from core client for 30 sec - exiting
23:53:55 (588): No heartbeat from core client for 30 sec - exiting
23:53:56 (588): No heartbeat from core client for 30 sec - exiting
23:53:57 (588): No heartbeat from core client for 30 sec - exiting
23:53:58 (588): No heartbeat from core client for 30 sec - exiting
23:53:59 (588): No heartbeat from core client for 30 sec - exiting
23:54:01 (588): No heartbeat from core client for 30 sec - exiting
23:54:02 (588): No heartbeat from core client for 30 sec - exiting
23:54:03 (588): No heartbeat from core client for 30 sec - exiting
23:54:04 (588): No heartbeat from core client for 30 sec - exiting
23:54:05 (588): No heartbeat from core client for 30 sec - exiting
23:54:06 (588): No heartbeat from core client for 30 sec - exiting
23:54:07 (588): No heartbeat from core client for 30 sec - exiting
23:54:08 (588): No heartbeat from core client for 30 sec - exiting
23:54:10 (588): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3632, selfPID=3632, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1628, selfPID=1628, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2900, selfPID=2900, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4016, selfPID=4016, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=356, selfPID=356, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2916, selfPID=2916, iMonCtr=2
08:57:58 (3096): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1112, selfPID=1112, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2812, selfPID=2812, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:14:31 (1820): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2592, selfPID=2592, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2752, selfPID=2752, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1684, selfPID=1684, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3708, selfPID=3708, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1512, selfPID=1512, iMonCtr=2
23:18:46 (1484): No heartbeat from core client for 30 sec - exiting
23:18:47 (1484): No heartbeat from core client for 30 sec - exiting
23:18:49 (1484): No heartbeat from core client for 30 sec - exiting
23:18:50 (1484): No heartbeat from core client for 30 sec - exiting
23:18:51 (1484): No heartbeat from core client for 30 sec - exiting
23:18:52 (1484): No heartbeat from core client for 30 sec - exiting
23:18:53 (1484): No heartbeat from core client for 30 sec - exiting
23:18:54 (1484): No heartbeat from core client for 30 sec - exiting
23:18:55 (1484): No heartbeat from core client for 30 sec - exiting
23:18:57 (1484): No heartbeat from core client for 30 sec - exiting
23:18:58 (1484): No heartbeat from core client for 30 sec - exiting
23:18:59 (1484): No heartbeat from core client for 30 sec - exiting
23:19:00 (1484): No heartbeat from core client for 30 sec - exiting
23:19:01 (1484): No heartbeat from core client for 30 sec - exiting
23:19:02 (1484): No heartbeat from core client for 30 sec - exiting
23:19:04 (1484): No heartbeat from core client for 30 sec - exiting
23:19:05 (1484): No heartbeat from core client for 30 sec - exiting
23:19:06 (1484): No heartbeat from core client for 30 sec - exiting
23:19:07 (1484): No heartbeat from core client for 30 sec - exiting
23:19:08 (1484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3312, selfPID=3312, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:46:20 (4040): No heartbeat from core client for 30 sec - exiting
12:46:21 (4040): No heartbeat from core client for 30 sec - exiting
12:46:22 (4040): No heartbeat from core client for 30 sec - exiting
12:46:23 (4040): No heartbeat from core client for 30 sec - exiting
12:46:24 (4040): No heartbeat from core client for 30 sec - exiting
12:46:25 (4040): No heartbeat from core client for 30 sec - exiting
12:46:26 (4040): No heartbeat from core client for 30 sec - exiting
12:46:27 (4040): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:59:19 (1276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=328, selfPID=328, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
01:29:33 (2396): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2732, selfPID=2732, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1736, selfPID=1736, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=412, selfPID=412, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:29:08 (1024): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3908, selfPID=3908, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3564, selfPID=3564, iMonCtr=2
10:21:59 (3316): Can't acquire lockfile (32) - waiting 35s
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3060, selfPID=3060, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=600, selfPID=600, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Cforrtl: Access is denied.

forrtl: Access is denied.

forrtl: severe (38): error during write, unit 8, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadam3p_eu_6mrm_2000_1_007496775\tmp\xaakm.pipe_dummy

Image              PC        Routine            Line        Source             
hadam3p_eu_um_6.0  0076A39A  Unknown               Unknown  Unknown
hadam3p_eu_um_6.0  007676C8  Unknown               Unknown  Unknown
hadam3p_eu_um_6.0  00712CD0  Unknown               Unknown  Unknown
hadam3p_eu_um_6.0  00711E9A  Unknown               Unknown  Unknown
hadam3p_eu_um_6.0  006EAA9D  Unknown               Unknown  Unknown
hadam3p_eu_um_6.0  0068F27C  Unknown               Unknown  Unknown
hadam3p_eu_um_6.0  00409BD2  Unknown               Unknown  Unknown
hadam3p_eu_um_6.0  0074E638  Unknown               Unknown  Unknown
kernel32.dll       7C817077  Unknown               Unknown  Unknown
forrtl: severe (38): error during write, unit 8, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadam3p_eu_6mrm_2000_1_007496775\tmp\xaakg.pipe_dummy

Image              PC        Routine            Line        Source             
hadrm3p_eu_um_6.0  0073C52A  Unknown               Unknown  Unknown
hadrm3p_eu_um_6.0  00739858  Unknown               Unknown  Unknown
hadrm3p_eu_um_6.0  006E4460  Unknown               Unknown  Unknown
hadrm3p_eu_um_6.0  006E362A  Unknown               Unknown  Unknown
hadrm3p_eu_um_6.0  006BA6ED  Unknown               Unknown  Unknown
hadrm3p_eu_um_6.0  00663551  Unknown               Unknown  Unknown
hadrm3p_eu_um_6.0  00409860  Unknown               Unknown  Unknown
hadrm3p_eu_um_6.0  00720893  Unknown               Unknown  Unknown
kernel32.dll       7C817077  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1288, selfPID=3660, iMonCtr=1
Model crash detected, will try to restart...
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1288, selfPID=1288, iMonCtr=2
Leaving CPDN_Main::Monitor...
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2792, iMonCtr=2
Called boinc_finish

</stderr_txt>
<message>
<file_xfer_error>
  <file_name>hadam3p_eu_6mrm_2000_1_007496775_1_10.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_eu_6mrm_2000_1_007496775_1_11.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_eu_6mrm_2000_1_007496775_1_12.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Dec 2011 12:27:22 1130285 13517080 hadam3p_eu_6mrm_2000_1_007496775_1 103,776 450,638 4.3424
30 Nov 2011 01:59:27 1130285 13517080 hadam3p_eu_6mrm_2000_1_007496775_1 92,256 401,202 4.3488
23 Nov 2011 09:02:54 1130285 13517080 hadam3p_eu_6mrm_2000_1_007496775_1 80,736 350,580 4.3423
21 Nov 2011 14:09:53 1130285 13517080 hadam3p_eu_6mrm_2000_1_007496775_1 69,216 300,523 4.3418
19 Nov 2011 18:32:38 1130285 13517080 hadam3p_eu_6mrm_2000_1_007496775_1 57,696 250,093 4.3347
18 Nov 2011 03:17:44 1130285 13517080 hadam3p_eu_6mrm_2000_1_007496775_1 46,176 199,451 4.3194
31 Oct 2011 19:33:05 1130285 13517080 hadam3p_eu_6mrm_2000_1_007496775_1 34,656 149,373 4.3102
31 Oct 2011 18:27:52 1130285 13517080 hadam3p_eu_6mrm_2000_1_007496775_1 23,136 99,567 4.3036
31 Oct 2011 16:59:19 1130285 13517080 hadam3p_eu_6mrm_2000_1_007496775_1 11,616 50,153 4.3176


©2024 climateprediction.net