climateprediction.net home page
Task 14434782

Task 14434782

Name hadam3p_pnw_b7w1_1984_1_007896528_0
Workunit 8051640
Created 17 Apr 2012, 15:11:17 UTC
Sent 16 May 2012, 4:22:16 UTC
Report deadline 28 Apr 2013, 9:42:16 UTC
Received 18 Sep 2012, 23:06:50 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1119216
Run time 11 days 9 hours 29 min 10 sec
CPU time 10 days 14 hours 26 min 11 sec
Validate state Workunit error - check skipped
Credit 3,005.88
Device peak FLOPS 2.56 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v6.09
windows_intelx86
Stderr 
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=556, iMonCtr=2
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
21:20:07 (3984): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
21:20:09 (3984): No heartbeat from core client for 30 sec - exiting
21:20:10 (3984): No heartbeat from core client for 30 sec - exiting
21:20:11 (3984): No heartbeat from core client for 30 sec - exiting
21:20:12 (3984): No heartbeat from core client for 30 sec - exiting
21:20:13 (3984): No heartbeat from core client for 30 sec - exiting
21:20:14 (3984): No heartbeat from core client for 30 sec - exiting
21:20:15 (3984): No heartbeat from core client for 30 sec - exiting
21:20:16 (3984): No heartbeat from core client for 30 sec - exiting
21:20:17 (3984): No heartbeat from core client for 30 sec - exiting
21:20:18 (3984): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:38:27 (8000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:27:59 (4716): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:58:22 (4320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:10:20 (3920): No heartbeat from core client for 30 sec - exiting
09:10:22 (3920): No heartbeat from core client for 30 sec - exiting
09:10:23 (3920): No heartbeat from core client for 30 sec - exiting
09:10:24 (3920): No heartbeat from core client for 30 sec - exiting
09:10:25 (3920): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
10:17:08 (276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2908, selfPID=2908, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:23:20 (7064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:47:31 (6204): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:05:36 (7812): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:17:10 (8064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:23:13 (1412): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:38:31 (7140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:11:39 (7364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:14:42 (3416): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:18:05 (6468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:24:07 (6996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7068, selfPID=7068, iMonCtr=2
23:27:10 (7992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
12:02:33 (3800): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:02:35 (3800): No heartbeat from core client for 30 sec - exiting
12:02:36 (3800): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
15:24:35 (996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4000, selfPID=4000, iMonCtr=2
15:27:42 (6532): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4364, selfPID=4364, iMonCtr=2
15:27:43 (6532): No heartbeat from core client for 30 sec - exiting
15:27:48 (6716): Can't acquire lockfile (32) - waiting 35s
16:31:28 (6716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:34:32 (4744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:54:54 (7252): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:04:00 (7936): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:19:14 (5076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:49:30 (7216): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:58:42 (3764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:02:14 (6168): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:14:39 (6100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:20:43 (5188): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:36:45 (4588): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:39:52 (6220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:07:23 (7020): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:56:06 (7612): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
23:56:07 (7612): No heartbeat from core client for 30 sec - exiting
23:56:08 (7612): No heartbeat from core client for 30 sec - exiting
23:56:09 (7612): No heartbeat from core client for 30 sec - exiting
23:56:10 (7612): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:07:55 (7800): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
17:07:56 (7800): No heartbeat from core client for 30 sec - exiting
17:07:57 (7800): No heartbeat from core client for 30 sec - exiting
17:07:58 (7800): No heartbeat from core client for 30 sec - exiting
17:07:59 (7800): No heartbeat from core client for 30 sec - exiting
17:08:00 (7800): No heartbeat from core client for 30 sec - exiting
17:08:01 (7800): No heartbeat from core client for 30 sec - exiting
17:08:02 (7800): No heartbeat from core client for 30 sec - exiting
17:08:03 (7800): No heartbeat from core client for 30 sec - exiting
17:08:04 (7800): No heartbeat from core client for 30 sec - exiting
17:08:05 (7800): No heartbeat from core client for 30 sec - exiting
17:08:06 (7800): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:32:02 (5864): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
09:32:03 (5864): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1968, iMonCtr=2
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1112, iMonCtr=2
Model crash detected, will try to restart...
lobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2412, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
19:17:12 (6204): No heartbeat from core client for 30 sec - exiting
19:17:13 (6204): No heartbeat from core client for 30 sec - exiting
19:17:14 (6204): No heartbeat from core client for 30 sec - exiting
19:17:16 (6204): No heartbeat from core client for 30 sec - exiting
19:17:17 (6204): No heartbeat from core client for 30 sec - exiting
19:17:18 (6204): No heartbeat from core client for 30 sec - exiting
19:17:19 (6204): No heartbeat from core client for 30 sec - exiting
19:17:20 (6204): No heartbeat from core client for 30 sec - exiting
19:17:21 (6204): No heartbeat from core client for 30 sec - exiting
19:17:22 (6204): No heartbeat from core client for 30 sec - exiting
19:17:23 (6204): No heartbeat from core client for 30 sec - exiting
19:17:24 (6204): No heartbeat from core client for 30 sec - exiting
19:17:25 (6204): No heartbeat from core client for 30 sec - exiting
19:17:26 (6204): No heartbeat from core client for 30 sec - exiting
19:17:28 (6204): No heartbeat from core client for 30 sec - exiting
19:17:29 (6204): No heartbeat from core client for 30 sec - exiting
19:17:30 (6204): No heartbeat from core client for 30 sec - exiting
19:17:31 (6204): No heartbeat from core client for 30 sec - exiting
19:17:32 (6204): No heartbeat from core client for 30 sec - exiting
19:17:33 (6204): No heartbeat from core client for 30 sec - exiting
19:17:34 (6204): No heartbeat from core client for 30 sec - exiting
19:17:35 (6204): No heartbeat from core client for 30 sec - exiting
19:17:36 (6204): No heartbeat from core client for 30 sec - exiting
19:17:37 (6204): No heartbeat from core client for 30 sec - exiting
19:17:38 (6204): No heartbeat from core client for 30 sec - exiting
19:17:40 (6204): No heartbeat from core client for 30 sec - exiting
19:17:41 (6204): No heartbeat from core client for 30 sec - exiting
19:17:42 (6204): No heartbeat from core client for 30 sec - exiting
19:17:43 (6204): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:17:44 (6204): No heartbeat from core client for 30 sec - exiting
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5944, selfPID=5088, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 9
03:20:05 (1080): No heartbeat from core client for 30 sec - exiting
03:20:06 (1080): No heartbeat from core client for 30 sec - exiting
03:20:08 (1080): No heartbeat from core client for 30 sec - exiting
03:20:09 (1080): No heartbeat from core client for 30 sec - exiting
03:20:10 (1080): No heartbeat from core client for 30 sec - exiting
03:20:11 (1080): No heartbeat from core client for 30 sec - exiting
03:20:12 (1080): No heartbeat from core client for 30 sec - exiting
03:20:13 (1080): No heartbeat from core client for 30 sec - exiting
03:20:14 (1080): No heartbeat from core client for 30 sec - exiting
03:20:15 (1080): No heartbeat from core client for 30 sec - exiting
03:20:16 (1080): No heartbeat from core client for 30 sec - exiting
03:20:17 (1080): No heartbeat from core client for 30 sec - exiting
03:20:18 (1080): No heartbeat from core client for 30 sec - exiting
03:20:20 (1080): No heartbeat from core client for 30 sec - exiting
03:20:21 (1080): No heartbeat from core client for 30 sec - exiting
03:20:22 (1080): No heartbeat from core client for 30 sec - exiting
03:20:23 (1080): No heartbeat from core client for 30 sec - exiting
03:20:24 (1080): No heartbeat from core client for 30 sec - exiting
03:20:25 (1080): No heartbeat from core client for 30 sec - exiting
03:20:26 (1080): No heartbeat from core client for 30 sec - exiting
03:20:27 (1080): No heartbeat from core client for 30 sec - exiting
03:20:28 (1080): No heartbeat from core client for 30 sec - exiting
03:20:30 (1080): No heartbeat from core client for 30 sec - exiting
03:20:31 (1080): No heartbeat from core client for 30 sec - exiting
03:20:32 (1080): No heartbeat from core client for 30 sec - exiting
03:20:33 (1080): No heartbeat from core client for 30 sec - exiting
03:20:34 (1080): No heartbeat from core client for 30 sec - exiting
03:20:35 (1080): No heartbeat from core client for 30 sec - exiting
03:20:36 (1080): No heartbeat from core client for 30 sec - exiting
03:20:37 (1080): No heartbeat from core client for 30 sec - exiting
03:20:38 (1080): No heartbeat from core client for 30 sec - exiting
03:20:39 (1080): No heartbeat from core client for 30 sec - exiting
03:20:40 (1080): No heartbeat from core client for 30 sec - exiting
03:20:42 (1080): No heartbeat from core client for 30 sec - exiting
03:20:43 (1080): No heartbeat from core client for 30 sec - exiting
03:20:44 (1080): No heartbeat from core client for 30 sec - exiting
03:20:45 (1080): No heartbeat from core client for 30 sec - exiting
03:20:46 (1080): No heartbeat from core client for 30 sec - exiting
03:20:47 (1080): No heartbeat from core client for 30 sec - exiting
03:20:48 (1080): No heartbeat from core client for 30 sec - exiting
03:20:49 (1080): No heartbeat from core client for 30 sec - exiting
03:20:50 (1080): No heartbeat from core client for 30 sec - exiting
03:20:51 (1080): No heartbeat from core client for 30 sec - exiting
03:20:52 (1080): No heartbeat from core client for 30 sec - exiting
03:20:54 (1080): No heartbeat from core client for 30 sec - exiting
03:20:55 (1080): No heartbeat from core client for 30 sec - exiting
03:20:56 (1080): No heartbeat from core client for 30 sec - exiting
03:20:57 (1080): No heartbeat from core client for 30 sec - exiting
03:20:58 (1080): No heartbeat from core client for 30 sec - exiting
03:20:59 (1080): No heartbeat from core client for 30 sec - exiting
03:21:00 (1080): No heartbeat from core client for 30 sec - exiting
03:21:01 (1080): No heartbeat from core client for 30 sec - exiting
03:21:02 (1080): No heartbeat from core client for 30 sec - exiting
03:21:03 (1080): No heartbeat from core client for 30 sec - exiting
03:21:04 (1080): No heartbeat from core client for 30 sec - exiting
03:21:06 (1080): No heartbeat from core client for 30 sec - exiting
03:21:07 (1080): No heartbeat from core client for 30 sec - exiting
03:21:08 (1080): No heartbeat from core client for 30 sec - exiting
03:21:09 (1080): No heartbeat from core client for 30 sec - exiting
03:21:10 (1080): No heartbeat from core client for 30 sec - exiting
03:21:11 (1080): No heartbeat from core client for 30 sec - exiting
03:21:12 (1080): No heartbeat from core client for 30 sec - exiting
03:21:13 (1080): No heartbeat from core client for 30 sec - exiting
03:21:14 (1080): No heartbeat from core client for 30 sec - exiting
03:21:15 (1080): No heartbeat from core client for 30 sec - exiting
03:21:16 (1080): No heartbeat from core client for 30 sec - exiting
03:21:18 (1080): No heartbeat from core client for 30 sec - exiting
03:21:19 (1080): No heartbeat from core client for 30 sec - exiting
03:21:20 (1080): No heartbeat from core client for 30 sec - exiting
03:21:21 (1080): No heartbeat from core client for 30 sec - exiting
03:21:22 (1080): No heartbeat from core client for 30 sec - exiting
03:21:23 (1080): No heartbeat from core client for 30 sec - exiting
03:21:24 (1080): No heartbeat from core client for 30 sec - exiting
03:21:25 (1080): No heartbeat from core client for 30 sec - exiting
03:21:26 (1080): No heartbeat from core client for 30 sec - exiting
03:21:27 (1080): No heartbeat from core client for 30 sec - exiting
03:21:29 (1080): No heartbeat from core client for 30 sec - exiting
03:21:30 (1080): No heartbeat from core client for 30 sec - exiting
03:21:31 (1080): No heartbeat from core client for 30 sec - exiting
03:21:32 (1080): No heartbeat from core client for 30 sec - exiting
03:21:33 (1080): No heartbeat from core client for 30 sec - exiting
03:21:34 (1080): No heartbeat from core client for 30 sec - exiting
03:21:35 (1080): No heartbeat from core client for 30 sec - exiting
03:21:36 (1080): No heartbeat from core client for 30 sec - exiting
03:21:37 (1080): No heartbeat from core client for 30 sec - exiting
03:21:38 (1080): No heartbeat from core client for 30 sec - exiting
03:21:39 (1080): No heartbeat from core client for 30 sec - exiting
03:21:41 (1080): No heartbeat from core client for 30 sec - exiting
03:21:42 (1080): No heartbeat from core client for 30 sec - exiting
03:21:43 (1080): No heartbeat from core client for 30 sec - exiting
03:21:44 (1080): No heartbeat from core client for 30 sec - exiting
03:21:45 (1080): No heartbeat from core client for 30 sec - exiting
03:21:46 (1080): No heartbeat from core client for 30 sec - exiting
03:21:47 (1080): No heartbeat from core client for 30 sec - exiting
03:21:48 (1080): No heartbeat from core client for 30 sec - exiting
03:21:49 (1080): No heartbeat from core client for 30 sec - exiting
03:21:50 (1080): No heartbeat from core client for 30 sec - exiting
03:21:51 (1080): No heartbeat from core client for 30 sec - exiting
03:21:53 (1080): No heartbeat from core client for 30 sec - exiting
03:21:54 (1080): No heartbeat from core client for 30 sec - exiting
03:21:55 (1080): No heartbeat from core client for 30 sec - exiting
03:21:56 (1080): No heartbeat from core client for 30 sec - exiting
03:21:57 (1080): No heartbeat from core client for 30 sec - exiting
03:21:58 (1080): No heartbeat from core client for 30 sec - exiting
03:21:59 (1080): No heartbeat from core client for 30 sec - exiting
03:22:00 (1080): No heartbeat from core client for 30 sec - exiting
03:22:01 (1080): No heartbeat from core client for 30 sec - exiting
03:22:02 (1080): No heartbeat from core client for 30 sec - exiting
03:22:03 (1080): No heartbeat from core client for 30 sec - exiting
03:22:05 (1080): No heartbeat from core client for 30 sec - exiting
03:22:06 (1080): No heartbeat from core client for 30 sec - exiting
03:22:07 (1080): No heartbeat from core client for 30 sec - exiting
03:22:08 (1080): No heartbeat from core client for 30 sec - exiting
03:22:09 (1080): No heartbeat from core client for 30 sec - exiting
03:22:10 (1080): No heartbeat from core client for 30 sec - exiting
03:22:11 (1080): No heartbeat from core client for 30 sec - exiting
03:22:12 (1080): No heartbeat from core client for 30 sec - exiting
03:22:13 (1080): No heartbeat from core client for 30 sec - exiting
03:22:14 (1080): No heartbeat from core client for 30 sec - exiting
03:22:16 (1080): No heartbeat from core client for 30 sec - exiting
03:22:17 (1080): No heartbeat from core client for 30 sec - exiting
03:22:18 (1080): No heartbeat from core client for 30 sec - exiting
03:22:19 (1080): No heartbeat from core client for 30 sec - exiting
03:22:20 (1080): No heartbeat from core client for 30 sec - exiting
03:22:21 (1080): No heartbeat from core client for 30 sec - exiting
03:22:22 (1080): No heartbeat from core client for 30 sec - exiting
03:22:23 (1080): No heartbeat from core client for 30 sec - exiting
03:22:24 (1080): No heartbeat from core client for 30 sec - exiting
03:22:26 (1080): No heartbeat from core client for 30 sec - exiting
03:22:27 (1080): No heartbeat from core client for 30 sec - exiting
03:22:28 (1080): No heartbeat from core client for 30 sec - exiting
03:22:29 (1080): No heartbeat from core client for 30 sec - exiting
03:22:30 (1080): No heartbeat from core client for 30 sec - exiting
03:22:31 (1080): No heartbeat from core client for 30 sec - exiting
03:22:32 (1080): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Leaving CPDN_Main::Monitor...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 Sep 2012 14:11:40 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 138,336 914,900 6.6136
17 Sep 2012 21:32:38 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 126,816 846,171 6.6724
17 Sep 2012 02:38:46 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 115,296 761,582 6.6055
15 Sep 2012 12:58:27 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 103,776 678,012 6.5334
12 Aug 2012 04:59:37 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 92,256 596,139 6.4618
10 Aug 2012 03:00:48 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 80,736 519,101 6.4296
07 Aug 2012 23:00:09 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 69,216 442,741 6.3965
06 Aug 2012 13:44:35 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 57,696 388,767 6.7382
02 Aug 2012 00:55:37 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 46,176 322,181 6.9772
29 Jul 2012 06:59:03 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 34,656 238,839 6.8917
14 Jun 2012 15:10:09 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 23,136 156,982 6.7852
13 Jun 2012 16:43:23 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 11,617 78,951 6.7962
13 Jun 2012 09:31:25 1119216 14434782 hadam3p_pnw_b7w1_1984_1_007896528_0 11,616 78,147 6.7275


©2024 climateprediction.net