climateprediction.net home page
Task 18871810

Task 18871810

Name hadam3p_anz_v02n_1994_1_010148682_0
Workunit 10106587
Created 3 Sep 2015, 8:21:02 UTC
Sent 3 Sep 2015, 9:16:42 UTC
Report deadline 15 Aug 2016, 14:36:42 UTC
Received 17 Sep 2015, 19:22:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -187 (0xFFFFFF45) ERR_RESULT_UPLOAD
Computer ID 1288392
Run time 12 days 5 hours 33 min 55 sec
CPU time 11 days 0 hours 13 min 46 sec
Validate state Invalid
Credit 4,484.28
Device peak FLOPS 2.50 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10
windows_intelx86
Stderr
<core_client_version>7.6.9</core_client_version>
<![CDATA[
<message>
upload failure
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4608, selfPID=4608, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:37:31 (6364): No heartbeat from core client for 30 sec - exiting
23:37:33 (6364): No heartbeat from core client for 30 sec - exiting
23:37:34 (6364): No heartbeat from core client for 30 sec - exiting
23:37:35 (6364): No heartbeat from core client for 30 sec - exiting
23:37:36 (6364): No heartbeat from core client for 30 sec - exiting
23:37:37 (6364): No heartbeat from core client for 30 sec - exiting
23:37:38 (6364): No heartbeat from core client for 30 sec - exiting
23:37:39 (6364): No heartbeat from core client for 30 sec - exiting
23:37:40 (6364): No heartbeat from core client for 30 sec - exiting
23:37:41 (6364): No heartbeat from core client for 30 sec - exiting
23:37:42 (6364): No heartbeat from core client for 30 sec - exiting
23:37:44 (6364): No heartbeat from core client for 30 sec - exiting
23:37:45 (6364): No heartbeat from core client for 30 sec - exiting
23:37:46 (6364): No heartbeat from core client for 30 sec - exiting
23:37:47 (6364): No heartbeat from core client for 30 sec - exiting
23:37:48 (6364): No heartbeat from core client for 30 sec - exiting
23:37:49 (6364): No heartbeat from core client for 30 sec - exiting
23:37:50 (6364): No heartbeat from core client for 30 sec - exiting
23:37:51 (6364): No heartbeat from core client for 30 sec - exiting
23:37:52 (6364): No heartbeat from core client for 30 sec - exiting
23:37:53 (6364): No heartbeat from core client for 30 sec - exiting
23:37:54 (6364): No heartbeat from core client for 30 sec - exiting
23:37:56 (6364): No heartbeat from core client for 30 sec - exiting
23:37:57 (6364): No heartbeat from core client for 30 sec - exiting
23:37:58 (6364): No heartbeat from core client for 30 sec - exiting
23:37:59 (6364): No heartbeat from core client for 30 sec - exiting
23:38:00 (6364): No heartbeat from core client for 30 sec - exiting
23:38:01 (6364): No heartbeat from core client for 30 sec - exiting
23:38:02 (6364): No heartbeat from core client for 30 sec - exiting
23:38:03 (6364): No heartbeat from core client for 30 sec - exiting
23:38:04 (6364): No heartbeat from core client for 30 sec - exiting
23:38:05 (6364): No heartbeat from core client for 30 sec - exiting
23:38:06 (6364): No heartbeat from core client for 30 sec - exiting
23:38:08 (6364): No heartbeat from core client for 30 sec - exiting
23:38:09 (6364): No heartbeat from core client for 30 sec - exiting
23:38:10 (6364): No heartbeat from core client for 30 sec - exiting
23:38:11 (6364): No heartbeat from core client for 30 sec - exiting
23:38:12 (6364): No heartbeat from core client for 30 sec - exiting
23:38:13 (6364): No heartbeat from core client for 30 sec - exiting
23:38:14 (6364): No heartbeat from core client for 30 sec - exiting
23:38:15 (6364): No heartbeat from core client for 30 sec - exiting
23:38:16 (6364): No heartbeat from core client for 30 sec - exiting
23:38:17 (6364): No heartbeat from core client for 30 sec - exiting
23:38:18 (6364): No heartbeat from core client for 30 sec - exiting
23:38:20 (6364): No heartbeat from core client for 30 sec - exiting
23:38:21 (6364): No heartbeat from core client for 30 sec - exiting
23:38:22 (6364): No heartbeat from core client for 30 sec - exiting
23:38:23 (6364): No heartbeat from core client for 30 sec - exiting
23:38:24 (6364): No heartbeat from core client for 30 sec - exiting
23:38:25 (6364): No heartbeat from core client for 30 sec - exiting
23:38:26 (6364): No heartbeat from core client for 30 sec - exiting
23:38:27 (6364): No heartbeat from core client for 30 sec - exiting
23:38:28 (6364): No heartbeat from core client for 30 sec - exiting
23:38:29 (6364): No heartbeat from core client for 30 sec - exiting
23:38:30 (6364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:47:55 (2912): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:47:56 (2912): No heartbeat from core client for 30 sec - exiting
02:47:57 (2912): No heartbeat from core client for 30 sec - exiting
02:47:58 (2912): No heartbeat from core client for 30 sec - exiting
02:51:13 (3840): No heartbeat from core client for 30 sec - exiting
02:51:15 (3840): No heartbeat from core client for 30 sec - exiting
02:51:16 (3840): No heartbeat from core client for 30 sec - exiting
02:51:17 (3840): No heartbeat from core client for 30 sec - exiting
02:51:18 (3840): No heartbeat from core client for 30 sec - exiting
02:51:19 (3840): No heartbeat from core client for 30 sec - exiting
02:51:20 (3840): No heartbeat from core client for 30 sec - exiting
02:51:21 (3840): No heartbeat from core client for 30 sec - exiting
02:51:22 (3840): No heartbeat from core client for 30 sec - exiting
02:51:23 (3840): No heartbeat from core client for 30 sec - exiting
02:51:24 (3840): No heartbeat from core client for 30 sec - exiting
02:51:25 (3840): No heartbeat from core client for 30 sec - exiting
02:51:27 (3840): No heartbeat from core client for 30 sec - exiting
02:51:28 (3840): No heartbeat from core client for 30 sec - exiting
02:51:29 (3840): No heartbeat from core client for 30 sec - exiting
02:51:30 (3840): No heartbeat from core client for 30 sec - exiting
02:51:31 (3840): No heartbeat from core client for 30 sec - exiting
02:51:32 (3840): No heartbeat from core client for 30 sec - exiting
02:51:33 (3840): No heartbeat from core client for 30 sec - exiting
02:51:34 (3840): No heartbeat from core client for 30 sec - exiting
02:51:35 (3840): No heartbeat from core client for 30 sec - exiting
02:51:36 (3840): No heartbeat from core client for 30 sec - exiting
02:51:37 (3840): No heartbeat from core client for 30 sec - exiting
02:51:39 (3840): No heartbeat from core client for 30 sec - exiting
02:51:40 (3840): No heartbeat from core client for 30 sec - exiting
02:51:41 (3840): No heartbeat from core client for 30 sec - exiting
02:51:42 (3840): No heartbeat from core client for 30 sec - exiting
02:51:43 (3840): No heartbeat from core client for 30 sec - exiting
02:51:44 (3840): No heartbeat from core client for 30 sec - exiting
02:51:45 (3840): No heartbeat from core client for 30 sec - exiting
02:51:46 (3840): No heartbeat from core client for 30 sec - exiting
02:51:47 (3840): No heartbeat from core client for 30 sec - exiting
02:51:48 (3840): No heartbeat from core client for 30 sec - exiting
02:51:50 (3840): No heartbeat from core client for 30 sec - exiting
02:51:51 (3840): No heartbeat from core client for 30 sec - exiting
02:51:52 (3840): No heartbeat from core client for 30 sec - exiting
02:51:53 (3840): No heartbeat from core client for 30 sec - exiting
02:51:54 (3840): No heartbeat from core client for 30 sec - exiting
02:51:55 (3840): No heartbeat from core client for 30 sec - exiting
02:51:56 (3840): No heartbeat from core client for 30 sec - exiting
02:51:57 (3840): No heartbeat from core client for 30 sec - exiting
02:51:58 (3840): No heartbeat from core client for 30 sec - exiting
02:51:59 (3840): No heartbeat from core client for 30 sec - exiting
02:52:00 (3840): No heartbeat from core client for 30 sec - exiting
02:52:02 (3840): No heartbeat from core client for 30 sec - exiting
02:52:03 (3840): No heartbeat from core client for 30 sec - exiting
02:52:04 (3840): No heartbeat from core client for 30 sec - exiting
02:52:05 (3840): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
04:03:58 (7292): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:03:59 (7292): No heartbeat from core client for 30 sec - exiting
04:04:00 (7292): No heartbeat from core client for 30 sec - exiting
04:04:02 (7292): No heartbeat from core client for 30 sec - exiting
04:14:34 (156): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5316, selfPID=5316, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:49:26 (1704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:49:27 (1704): No heartbeat from core client for 30 sec - exiting
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6708, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2132, iMonCtr=2
Leaving CPDN_Main::Monitor...
21:23:31 (7740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:23:32 (7740): No heartbeat from core client for 30 sec - exiting
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8056, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8124, iMonCtr=2
Leaving CPDN_Main::Monitor...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:07:24 (8268): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:07:26 (8268): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:28:25 (6244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:28:26 (6244): No heartbeat from core client for 30 sec - exiting
02:28:27 (6244): No heartbeat from core client for 30 sec - exiting
02:28:28 (6244): No heartbeat from core client for 30 sec - exiting
02:28:29 (6244): No heartbeat from core client for 30 sec - exiting
02:28:30 (6244): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:56:00 (7556): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:56:01 (7556): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:20:02 (8864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:27:40 (8360): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:47:52 (9900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:47:53 (9900): No heartbeat from core client for 30 sec - exiting
03:47:55 (9900): No heartbeat from core client for 30 sec - exiting
03:47:56 (9900): No heartbeat from core client for 30 sec - exiting
03:55:35 (9272): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2292, selfPID=2292, iMonCtr=2
04:01:32 (7280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1852, selfPID=1852, iMonCtr=2
04:08:40 (7976): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
04:32:12 (8140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:32:14 (8140): No heartbeat from core client for 30 sec - exiting
04:32:15 (8140): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
06:04:39 (7696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:04:40 (7696): No heartbeat from core client for 30 sec - exiting
06:04:41 (7696): No heartbeat from core client for 30 sec - exiting
06:04:42 (7696): No heartbeat from core client for 30 sec - exiting
06:04:44 (7696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
18:55:27 (2424): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/xaakm.pipe_dummy                                                            2048    
Leaving CPDN_Main::Monitor...

zip error: Output file write failure (write error on zip file)
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Sep 2015 03:02:37 1288392 18871810 hadam3p_anz_v02n_1994_1_010148682_0 103,979 906,519 8.7183
15 Sep 2015 09:17:03 1288392 18871810 hadam3p_anz_v02n_1994_1_010148682_0 92,459 804,119 8.6970
14 Sep 2015 00:08:28 1288392 18871810 hadam3p_anz_v02n_1994_1_010148682_0 80,939 701,185 8.6631
12 Sep 2015 12:10:43 1288392 18871810 hadam3p_anz_v02n_1994_1_010148682_0 69,419 599,299 8.6331
10 Sep 2015 23:46:31 1288392 18871810 hadam3p_anz_v02n_1994_1_010148682_0 57,899 498,062 8.6023
09 Sep 2015 11:54:56 1288392 18871810 hadam3p_anz_v02n_1994_1_010148682_0 46,379 398,176 8.5853
07 Sep 2015 23:28:18 1288392 18871810 hadam3p_anz_v02n_1994_1_010148682_0 34,859 299,276 8.5853
06 Sep 2015 14:47:49 1288392 18871810 hadam3p_anz_v02n_1994_1_010148682_0 23,339 198,806 8.5182
04 Sep 2015 23:39:05 1288392 18871810 hadam3p_anz_v02n_1994_1_010148682_0 11,819 98,735 8.3539


©2024 climateprediction.net