climateprediction.net home page
Task 15290188

Task 15290188

Name hadcm3n_zfb3_1880_40_008199453_4
Workunit 8354577
Created 17 Sep 2012, 18:50:20 UTC
Sent 17 Sep 2012, 18:53:08 UTC
Report deadline 18 Dec 2012, 2:20:19 UTC
Received 2 Oct 2012, 11:51:44 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1194034
Run time 11 days 14 hours 44 min 18 sec
CPU time 7 days 17 hours 50 min 50 sec
Validate state Invalid
Credit 5,598.72
Device peak FLOPS 3.16 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
03:51:14 (4784): No heartbeat from core client for 30 sec - exiting
03:51:15 (4784): No heartbeat from core client for 30 sec - exiting
03:51:16 (4784): No heartbeat from core client for 30 sec - exiting
03:51:17 (4784): No heartbeat from core client for 30 sec - exiting
03:51:18 (4784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:51:54 (1844): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:40:18 (5300): No heartbeat from core client for 30 sec - exiting
11:40:19 (5300): No heartbeat from core client for 30 sec - exiting
11:40:20 (5300): No heartbeat from core client for 30 sec - exiting
11:40:21 (5300): No heartbeat from core client for 30 sec - exiting
11:40:22 (5300): No heartbeat from core client for 30 sec - exiting
11:40:23 (5300): No heartbeat from core client for 30 sec - exiting
11:40:24 (5300): No heartbeat from core client for 30 sec - exiting
11:40:26 (5300): No heartbeat from core client for 30 sec - exiting
11:40:27 (5300): No heartbeat from core client for 30 sec - exiting
11:40:28 (5300): No heartbeat from core client for 30 sec - exiting
11:40:29 (5300): No heartbeat from core client for 30 sec - exiting
11:40:30 (5300): No heartbeat from core client for 30 sec - exiting
11:40:31 (5300): No heartbeat from core client for 30 sec - exiting
11:40:32 (5300): No heartbeat from core client for 30 sec - exiting
11:40:33 (5300): No heartbeat from core client for 30 sec - exiting
11:40:34 (5300): No heartbeat from core client for 30 sec - exiting
11:40:35 (5300): No heartbeat from core client for 30 sec - exiting
11:40:36 (5300): No heartbeat from core client for 30 sec - exiting
11:40:38 (5300): No heartbeat from core client for 30 sec - exiting
11:40:39 (5300): No heartbeat from core client for 30 sec - exiting
11:40:40 (5300): No heartbeat from core client for 30 sec - exiting
11:40:41 (5300): No heartbeat from core client for 30 sec - exiting
11:40:42 (5300): No heartbeat from core client for 30 sec - exiting
11:40:43 (5300): No heartbeat from core client for 30 sec - exiting
11:40:44 (5300): No heartbeat from core client for 30 sec - exiting
11:40:45 (5300): No heartbeat from core client for 30 sec - exiting
11:40:46 (5300): No heartbeat from core client for 30 sec - exiting
11:40:47 (5300): No heartbeat from core client for 30 sec - exiting
11:40:48 (5300): No heartbeat from core client for 30 sec - exiting
11:40:50 (5300): No heartbeat from core client for 30 sec - exiting
11:40:51 (5300): No heartbeat from core client for 30 sec - exiting
11:40:52 (5300): No heartbeat from core client for 30 sec - exiting
11:40:53 (5300): No heartbeat from core client for 30 sec - exiting
11:40:54 (5300): No heartbeat from core client for 30 sec - exiting
11:40:55 (5300): No heartbeat from core client for 30 sec - exiting
11:40:56 (5300): No heartbeat from core client for 30 sec - exiting
11:40:57 (5300): No heartbeat from core client for 30 sec - exiting
11:40:58 (5300): No heartbeat from core client for 30 sec - exiting
11:40:59 (5300): No heartbeat from core client for 30 sec - exiting
11:41:00 (5300): No heartbeat from core client for 30 sec - exiting
11:41:02 (5300): No heartbeat from core client for 30 sec - exiting
11:41:03 (5300): No heartbeat from core client for 30 sec - exiting
11:41:04 (5300): No heartbeat from core client for 30 sec - exiting
11:41:05 (5300): No heartbeat from core client for 30 sec - exiting
11:41:06 (5300): No heartbeat from core client for 30 sec - exiting
11:41:07 (5300): No heartbeat from core client for 30 sec - exiting
11:41:08 (5300): No heartbeat from core client for 30 sec - exiting
11:41:09 (5300): No heartbeat from core client for 30 sec - exiting
11:41:10 (5300): No heartbeat from core client for 30 sec - exiting
11:41:11 (5300): No heartbeat from core client for 30 sec - exiting
11:41:12 (5300): No heartbeat from core client for 30 sec - exiting
11:41:14 (5300): No heartbeat from core client for 30 sec - exiting
11:41:15 (5300): No heartbeat from core client for 30 sec - exiting
11:41:16 (5300): No heartbeat from core client for 30 sec - exiting
11:41:17 (5300): No heartbeat from core client for 30 sec - exiting
11:41:18 (5300): No heartbeat from core client for 30 sec - exiting
11:41:19 (5300): No heartbeat from core client for 30 sec - exiting
11:41:20 (5300): No heartbeat from core client for 30 sec - exiting
11:41:21 (5300): No heartbeat from core client for 30 sec - exiting
11:41:22 (5300): No heartbeat from core client for 30 sec - exiting
11:41:23 (5300): No heartbeat from core client for 30 sec - exiting
11:41:24 (5300): No heartbeat from core client for 30 sec - exiting
11:41:26 (5300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:42:24 (5456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5824, iMonCtr=1
Model crash detected, will try to restart...
14:38:23 (4976): No heartbeat from core client for 30 sec - exiting
14:38:24 (4976): No heartbeat from core client for 30 sec - exiting
14:38:25 (4976): No heartbeat from core client for 30 sec - exiting
14:38:26 (4976): No heartbeat from core client for 30 sec - exiting
14:38:28 (4976): No heartbeat from core client for 30 sec - exiting
14:38:29 (4976): No heartbeat from core client for 30 sec - exiting
14:38:30 (4976): No heartbeat from core client for 30 sec - exiting
14:38:31 (4976): No heartbeat from core client for 30 sec - exiting
14:38:32 (4976): No heartbeat from core client for 30 sec - exiting
14:38:33 (4976): No heartbeat from core client for 30 sec - exiting
14:38:34 (4976): No heartbeat from core client for 30 sec - exiting
14:38:35 (4976): No heartbeat from core client for 30 sec - exiting
14:38:36 (4976): No heartbeat from core client for 30 sec - exiting
14:38:37 (4976): No heartbeat from core client for 30 sec - exiting
14:38:38 (4976): No heartbeat from core client for 30 sec - exiting
14:38:40 (4976): No heartbeat from core client for 30 sec - exiting
14:38:41 (4976): No heartbeat from core client for 30 sec - exiting
14:38:42 (4976): No heartbeat from core client for 30 sec - exiting
14:38:43 (4976): No heartbeat from core client for 30 sec - exiting
14:38:44 (4976): No heartbeat from core client for 30 sec - exiting
14:38:45 (4976): No heartbeat from core client for 30 sec - exiting
14:38:46 (4976): No heartbeat from core client for 30 sec - exiting
14:38:47 (4976): No heartbeat from core client for 30 sec - exiting
14:38:48 (4976): No heartbeat from core client for 30 sec - exiting
14:38:49 (4976): No heartbeat from core client for 30 sec - exiting
14:38:51 (4976): No heartbeat from core client for 30 sec - exiting
14:38:52 (4976): No heartbeat from core client for 30 sec - exiting
14:38:53 (4976): No heartbeat from core client for 30 sec - exiting
14:38:54 (4976): No heartbeat from core client for 30 sec - exiting
14:38:55 (4976): No heartbeat from core client for 30 sec - exiting
14:38:56 (4976): No heartbeat from core client for 30 sec - exiting
14:38:57 (4976): No heartbeat from core client for 30 sec - exiting
14:38:58 (4976): No heartbeat from core client for 30 sec - exiting
14:38:59 (4976): No heartbeat from core client for 30 sec - exiting
14:39:00 (4976): No heartbeat from core client for 30 sec - exiting
14:39:01 (4976): No heartbeat from core client for 30 sec - exiting
14:39:03 (4976): No heartbeat from core client for 30 sec - exiting
14:39:04 (4976): No heartbeat from core client for 30 sec - exiting
14:39:05 (4976): No heartbeat from core client for 30 sec - exiting
14:39:06 (4976): No heartbeat from core client for 30 sec - exiting
14:39:07 (4976): No heartbeat from core client for 30 sec - exiting
14:39:08 (4976): No heartbeat from core client for 30 sec - exiting
14:39:09 (4976): No heartbeat from core client for 30 sec - exiting
14:39:10 (4976): No heartbeat from core client for 30 sec - exiting
14:39:11 (4976): No heartbeat from core client for 30 sec - exiting
14:39:12 (4976): No heartbeat from core client for 30 sec - exiting
14:39:13 (4976): No heartbeat from core client for 30 sec - exiting
14:39:15 (4976): No heartbeat from core client for 30 sec - exiting
14:39:16 (4976): No heartbeat from core client for 30 sec - exiting
14:39:17 (4976): No heartbeat from core client for 30 sec - exiting
14:39:18 (4976): No heartbeat from core client for 30 sec - exiting
14:39:19 (4976): No heartbeat from core client for 30 sec - exiting
14:39:20 (4976): No heartbeat from core client for 30 sec - exiting
14:39:21 (4976): No heartbeat from core client for 30 sec - exiting
14:39:22 (4976): No heartbeat from core client for 30 sec - exiting
14:39:23 (4976): No heartbeat from core client for 30 sec - exiting
14:39:24 (4976): No heartbeat from core client for 30 sec - exiting
14:39:25 (4976): No heartbeat from core client for 30 sec - exiting
14:39:27 (4976): No heartbeat from core client for 30 sec - exiting
14:39:28 (4976): No heartbeat from core client for 30 sec - exiting
14:39:29 (4976): No heartbeat from core client for 30 sec - exiting
14:39:30 (4976): No heartbeat from core client for 30 sec - exiting
14:39:31 (4976): No heartbeat from core client for 30 sec - exiting
14:39:32 (4976): No heartbeat from core client for 30 sec - exiting
14:39:33 (4976): No heartbeat from core client for 30 sec - exiting
14:39:34 (4976): No heartbeat from core client for 30 sec - exiting
14:39:35 (4976): No heartbeat from core client for 30 sec - exiting
14:39:36 (4976): No heartbeat from core client for 30 sec - exiting
14:39:37 (4976): No heartbeat from core client for 30 sec - exiting
14:39:39 (4976): No heartbeat from core client for 30 sec - exiting
14:39:40 (4976): No heartbeat from core client for 30 sec - exiting
14:39:41 (4976): No heartbeat from core client for 30 sec - exiting
14:39:42 (4976): No heartbeat from core client for 30 sec - exiting
14:39:43 (4976): No heartbeat from core client for 30 sec - exiting
14:39:44 (4976): No heartbeat from core client for 30 sec - exiting
14:39:45 (4976): No heartbeat from core client for 30 sec - exiting
14:39:46 (4976): No heartbeat from core client for 30 sec - exiting
14:39:47 (4976): No heartbeat from core client for 30 sec - exiting
14:39:48 (4976): No heartbeat from core client for 30 sec - exiting
14:39:49 (4976): No heartbeat from core client for 30 sec - exiting
14:39:51 (4976): No heartbeat from core client for 30 sec - exiting
14:39:52 (4976): No heartbeat from core client for 30 sec - exiting
14:39:53 (4976): No heartbeat from core client for 30 sec - exiting
14:39:54 (4976): No heartbeat from core client for 30 sec - exiting
14:39:55 (4976): No heartbeat from core client for 30 sec - exiting
14:39:56 (4976): No heartbeat from core client for 30 sec - exiting
14:39:57 (4976): No heartbeat from core client for 30 sec - exiting
14:39:58 (4976): No heartbeat from core client for 30 sec - exiting
14:39:59 (4976): No heartbeat from core client for 30 sec - exiting
14:40:00 (4976): No heartbeat from core client for 30 sec - exiting
14:40:01 (4976): No heartbeat from core client for 30 sec - exiting
14:40:03 (4976): No heartbeat from core client for 30 sec - exiting
14:40:04 (4976): No heartbeat from core client for 30 sec - exiting
14:40:05 (4976): No heartbeat from core client for 30 sec - exiting
14:40:06 (4976): No heartbeat from core client for 30 sec - exiting
14:40:07 (4976): No heartbeat from core client for 30 sec - exiting
14:40:08 (4976): No heartbeat from core client for 30 sec - exiting
14:40:09 (4976): No heartbeat from core client for 30 sec - exiting
14:40:10 (4976): No heartbeat from core client for 30 sec - exiting
14:40:11 (4976): No heartbeat from core client for 30 sec - exiting
14:40:12 (4976): No heartbeat from core client for 30 sec - exiting
14:40:13 (4976): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:40:15 (4976): No heartbeat from core client for 30 sec - exiting
14:40:16 (4976): No heartbeat from core client for 30 sec - exiting
14:40:17 (4976): No heartbeat from core client for 30 sec - exiting
14:41:37 (3088): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:19:26 (5020): No heartbeat from core client for 30 sec - exiting
15:19:27 (5020): No heartbeat from core client for 30 sec - exiting
15:19:28 (5020): No heartbeat from core client for 30 sec - exiting
15:19:29 (5020): No heartbeat from core client for 30 sec - exiting
15:19:30 (5020): No heartbeat from core client for 30 sec - exiting
15:19:31 (5020): No heartbeat from core client for 30 sec - exiting
15:19:32 (5020): No heartbeat from core client for 30 sec - exiting
15:19:33 (5020): No heartbeat from core client for 30 sec - exiting
15:19:34 (5020): No heartbeat from core client for 30 sec - exiting
15:19:35 (5020): No heartbeat from core client for 30 sec - exiting
15:19:37 (5020): No heartbeat from core client for 30 sec - exiting
15:19:38 (5020): No heartbeat from core client for 30 sec - exiting
15:19:39 (5020): No heartbeat from core client for 30 sec - exiting
15:19:40 (5020): No heartbeat from core client for 30 sec - exiting
15:19:41 (5020): No heartbeat from core client for 30 sec - exiting
15:19:42 (5020): No heartbeat from core client for 30 sec - exiting
15:19:43 (5020): No heartbeat from core client for 30 sec - exiting
15:19:44 (5020): No heartbeat from core client for 30 sec - exiting
15:19:45 (5020): No heartbeat from core client for 30 sec - exiting
15:19:46 (5020): No heartbeat from core client for 30 sec - exiting
15:19:47 (5020): No heartbeat from core client for 30 sec - exiting
15:19:49 (5020): No heartbeat from core client for 30 sec - exiting
15:19:50 (5020): No heartbeat from core client for 30 sec - exiting
15:19:51 (5020): No heartbeat from core client for 30 sec - exiting
15:19:52 (5020): No heartbeat from core client for 30 sec - exiting
15:19:53 (5020): No heartbeat from core client for 30 sec - exiting
15:19:54 (5020): No heartbeat from core client for 30 sec - exiting
15:19:55 (5020): No heartbeat from core client for 30 sec - exiting
15:19:56 (5020): No heartbeat from core client for 30 sec - exiting
15:19:57 (5020): No heartbeat from core client for 30 sec - exiting
15:19:58 (5020): No heartbeat from core client for 30 sec - exiting
15:20:00 (5020): No heartbeat from core client for 30 sec - exiting
15:20:01 (5020): No heartbeat from core client for 30 sec - exiting
15:20:02 (5020): No heartbeat from core client for 30 sec - exiting
15:20:03 (5020): No heartbeat from core client for 30 sec - exiting
15:20:04 (5020): No heartbeat from core client for 30 sec - exiting
15:20:05 (5020): No heartbeat from core client for 30 sec - exiting
15:20:06 (5020): No heartbeat from core client for 30 sec - exiting
15:20:07 (5020): No heartbeat from core client for 30 sec - exiting
15:20:08 (5020): No heartbeat from core client for 30 sec - exiting
15:20:09 (5020): No heartbeat from core client for 30 sec - exiting
15:20:10 (5020): No heartbeat from core client for 30 sec - exiting
15:20:12 (5020): No heartbeat from core client for 30 sec - exiting
15:20:13 (5020): No heartbeat from core client for 30 sec - exiting
15:20:14 (5020): No heartbeat from core client for 30 sec - exiting
15:20:15 (5020): No heartbeat from core client for 30 sec - exiting
15:20:16 (5020): No heartbeat from core client for 30 sec - exiting
15:20:17 (5020): No heartbeat from core client for 30 sec - exiting
15:20:18 (5020): No heartbeat from core client for 30 sec - exiting
15:20:19 (5020): No heartbeat from core client for 30 sec - exiting
15:20:20 (5020): No heartbeat from core client for 30 sec - exiting
15:20:21 (5020): No heartbeat from core client for 30 sec - exiting
15:20:22 (5020): No heartbeat from core client for 30 sec - exiting
15:20:24 (5020): No heartbeat from core client for 30 sec - exiting
15:20:25 (5020): No heartbeat from core client for 30 sec - exiting
15:20:26 (5020): No heartbeat from core client for 30 sec - exiting
15:20:27 (5020): No heartbeat from core client for 30 sec - exiting
15:20:28 (5020): No heartbeat from core client for 30 sec - exiting
15:20:29 (5020): No heartbeat from core client for 30 sec - exiting
15:20:30 (5020): No heartbeat from core client for 30 sec - exiting
15:20:31 (5020): No heartbeat from core client for 30 sec - exiting
15:20:32 (5020): No heartbeat from core client for 30 sec - exiting
15:20:33 (5020): No heartbeat from core client for 30 sec - exiting
15:20:34 (5020): No heartbeat from core client for 30 sec - exiting
15:20:36 (5020): No heartbeat from core client for 30 sec - exiting
15:20:37 (5020): No heartbeat from core client for 30 sec - exiting
15:20:38 (5020): No heartbeat from core client for 30 sec - exiting
15:20:39 (5020): No heartbeat from core client for 30 sec - exiting
15:20:40 (5020): No heartbeat from core client for 30 sec - exiting
15:20:41 (5020): No heartbeat from core client for 30 sec - exiting
15:20:42 (5020): No heartbeat from core client for 30 sec - exiting
15:20:43 (5020): No heartbeat from core client for 30 sec - exiting
15:20:44 (5020): No heartbeat from core client for 30 sec - exiting
15:20:45 (5020): No heartbeat from core client for 30 sec - exiting
15:20:46 (5020): No heartbeat from core client for 30 sec - exiting
15:20:48 (5020): No heartbeat from core client for 30 sec - exiting
15:20:49 (5020): No heartbeat from core client for 30 sec - exiting
15:20:50 (5020): No heartbeat from core client for 30 sec - exiting
15:20:51 (5020): No heartbeat from core client for 30 sec - exiting
15:20:52 (5020): No heartbeat from core client for 30 sec - exiting
15:20:53 (5020): No heartbeat from core client for 30 sec - exiting
15:20:54 (5020): No heartbeat from core client for 30 sec - exiting
15:20:55 (5020): No heartbeat from core client for 30 sec - exiting
15:20:56 (5020): No heartbeat from core client for 30 sec - exiting
15:20:57 (5020): No heartbeat from core client for 30 sec - exiting
15:20:58 (5020): No heartbeat from core client for 30 sec - exiting
15:21:00 (5020): No heartbeat from core client for 30 sec - exiting
15:21:01 (5020): No heartbeat from core client for 30 sec - exiting
15:21:02 (5020): No heartbeat from core client for 30 sec - exiting
15:21:03 (5020): No heartbeat from core client for 30 sec - exiting
15:21:04 (5020): No heartbeat from core client for 30 sec - exiting
15:21:05 (5020): No heartbeat from core client for 30 sec - exiting
15:21:06 (5020): No heartbeat from core client for 30 sec - exiting
15:21:07 (5020): No heartbeat from core client for 30 sec - exiting
15:21:08 (5020): No heartbeat from core client for 30 sec - exiting
15:21:09 (5020): No heartbeat from core client for 30 sec - exiting
15:21:10 (5020): No heartbeat from core client for 30 sec - exiting
15:21:12 (5020): No heartbeat from core client for 30 sec - exiting
15:21:13 (5020): No heartbeat from core client for 30 sec - exiting
15:21:14 (5020): No heartbeat from core client for 30 sec - exiting
15:21:15 (5020): No heartbeat from core client for 30 sec - exiting
15:21:16 (5020): No heartbeat from core client for 30 sec - exiting
15:21:17 (5020): No heartbeat from core client for 30 sec - exiting
15:21:18 (5020): No heartbeat from core client for 30 sec - exiting
15:21:19 (5020): No heartbeat from core client for 30 sec - exiting
15:21:20 (5020): No heartbeat from core client for 30 sec - exiting
15:21:21 (5020): No heartbeat from core client for 30 sec - exiting
15:21:23 (5020): No heartbeat from core client for 30 sec - exiting
15:21:24 (5020): No heartbeat from core client for 30 sec - exiting
15:21:25 (5020): No heartbeat from core client for 30 sec - exiting
15:21:26 (5020): No heartbeat from core client for 30 sec - exiting
15:21:27 (5020): No heartbeat from core client for 30 sec - exiting
15:21:28 (5020): No heartbeat from core client for 30 sec - exiting
15:21:29 (5020): No heartbeat from core client for 30 sec - exiting
15:21:30 (5020): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:21:31 (5020): No heartbeat from core client for 30 sec - exiting
15:22:35 (2472): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
02 Oct 2012 02:20:21 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 466,560 960,418 2.0585
01 Oct 2012 13:11:19 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 440,640 911,173 2.0678
30 Sep 2012 21:58:01 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 414,720 859,751 2.0731
30 Sep 2012 07:11:16 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 388,800 806,101 2.0733
29 Sep 2012 16:53:15 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 362,880 754,697 2.0797
29 Sep 2012 02:19:30 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 336,960 701,450 2.0817
25 Sep 2012 09:18:05 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 311,040 647,460 2.0816
24 Sep 2012 17:24:17 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 285,120 592,269 2.0773
24 Sep 2012 01:23:15 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 259,200 536,737 2.0707
23 Sep 2012 10:46:40 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 233,280 483,179 2.0712
22 Sep 2012 19:36:25 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 207,360 428,441 2.0662
22 Sep 2012 03:46:55 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 181,440 373,510 2.0586
21 Sep 2012 13:08:49 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 155,520 319,179 2.0523
20 Sep 2012 20:43:46 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 129,600 263,284 2.0315
20 Sep 2012 05:35:53 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 103,680 209,756 2.0231
19 Sep 2012 15:09:37 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 77,760 155,820 2.0039
19 Sep 2012 00:46:00 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 51,840 103,804 2.0024
18 Sep 2012 10:15:47 1194034 15290188 hadcm3n_zfb3_1880_40_008199453_4 25,920 51,927 2.0034


©2024 climateprediction.net