climateprediction.net home page
Task 19132246

Task 19132246

Name hadcm3n_xdny_198012_480_010221223_0
Workunit 10221223
Created 4 Dec 2015, 15:06:37 UTC
Sent 4 Dec 2015, 16:26:26 UTC
Report deadline 15 Nov 2016, 21:46:26 UTC
Received 11 Jan 2016, 18:26:47 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1364480
Run time 6 days 0 hours 14 min 23 sec
CPU time 5 days 3 hours 37 min 52 sec
Validate state Invalid
Credit 8,398.08
Device peak FLOPS 4.25 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.6.12</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:05:29 (647): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:08:22 (994): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:09:26 (1023): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:47:16 (603): No heartbeat from core client for 30 sec - exiting
09:47:28 (603): No heartbeat from core client for 30 sec - exiting
09:47:29 (603): No heartbeat from core client for 30 sec - exiting
09:47:31 (603): No heartbeat from core client for 30 sec - exiting
09:47:32 (603): No heartbeat from core client for 30 sec - exiting
09:47:33 (603): No heartbeat from core client for 30 sec - exiting
09:47:34 (603): No heartbeat from core client for 30 sec - exiting
09:47:35 (603): No heartbeat from core client for 30 sec - exiting
09:47:36 (603): No heartbeat from core client for 30 sec - exiting
09:47:37 (603): No heartbeat from core client for 30 sec - exiting
09:47:38 (603): No heartbeat from core client for 30 sec - exiting
09:47:39 (603): No heartbeat from core client for 30 sec - exiting
09:47:40 (603): No heartbeat from core client for 30 sec - exiting
09:47:41 (603): No heartbeat from core client for 30 sec - exiting
09:47:42 (603): No heartbeat from core client for 30 sec - exiting
09:47:43 (603): No heartbeat from core client for 30 sec - exiting
09:47:44 (603): No heartbeat from core client for 30 sec - exiting
09:47:45 (603): No heartbeat from core client for 30 sec - exiting
09:47:46 (603): No heartbeat from core client for 30 sec - exiting
09:47:47 (603): No heartbeat from core client for 30 sec - exiting
09:47:48 (603): No heartbeat from core client for 30 sec - exiting
09:47:49 (603): No heartbeat from core client for 30 sec - exiting
09:47:50 (603): No heartbeat from core client for 30 sec - exiting
09:47:51 (603): No heartbeat from core client for 30 sec - exiting
09:47:52 (603): No heartbeat from core client for 30 sec - exiting
09:47:53 (603): No heartbeat from core client for 30 sec - exiting
09:47:54 (603): No heartbeat from core client for 30 sec - exiting
09:47:55 (603): No heartbeat from core client for 30 sec - exiting
09:47:56 (603): No heartbeat from core client for 30 sec - exiting
09:47:57 (603): No heartbeat from core client for 30 sec - exiting
09:47:58 (603): No heartbeat from core client for 30 sec - exiting
09:47:59 (603): No heartbeat from core client for 30 sec - exiting
09:48:00 (603): No heartbeat from core client for 30 sec - exiting
09:48:01 (603): No heartbeat from core client for 30 sec - exiting
09:48:03 (603): No heartbeat from core client for 30 sec - exiting
09:48:04 (603): No heartbeat from core client for 30 sec - exiting
09:48:05 (603): No heartbeat from core client for 30 sec - exiting
09:48:06 (603): No heartbeat from core client for 30 sec - exiting
09:48:07 (603): No heartbeat from core client for 30 sec - exiting
09:48:08 (603): No heartbeat from core client for 30 sec - exiting
09:48:09 (603): No heartbeat from core client for 30 sec - exiting
09:48:10 (603): No heartbeat from core client for 30 sec - exiting
09:48:11 (603): No heartbeat from core client for 30 sec - exiting
09:48:12 (603): No heartbeat from core client for 30 sec - exiting
09:48:13 (603): No heartbeat from core client for 30 sec - exiting
09:48:14 (603): No heartbeat from core client for 30 sec - exiting
09:48:15 (603): No heartbeat from core client for 30 sec - exiting
09:48:16 (603): No heartbeat from core client for 30 sec - exiting
09:48:17 (603): No heartbeat from core client for 30 sec - exiting
09:48:18 (603): No heartbeat from core client for 30 sec - exiting
09:48:19 (603): No heartbeat from core client for 30 sec - exiting
09:48:20 (603): No heartbeat from core client for 30 sec - exiting
09:48:21 (603): No heartbeat from core client for 30 sec - exiting
09:48:22 (603): No heartbeat from core client for 30 sec - exiting
09:48:23 (603): No heartbeat from core client for 30 sec - exiting
09:51:26 (603): No heartbeat from core client for 30 sec - exiting
09:51:27 (603): No heartbeat from core client for 30 sec - exiting
09:51:28 (603): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:55:49 (1410): No heartbeat from core client for 30 sec - exiting
09:56:12 (1410): No heartbeat from core client for 30 sec - exiting
09:56:13 (1410): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:00:54 (1425): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:01:04 (1425): No heartbeat from core client for 30 sec - exiting
10:01:05 (1425): No heartbeat from core client for 30 sec - exiting
10:01:06 (1425): No heartbeat from core client for 30 sec - exiting
10:01:07 (1425): No heartbeat from core client for 30 sec - exiting
10:01:08 (1425): No heartbeat from core client for 30 sec - exiting
10:01:09 (1425): No heartbeat from core client for 30 sec - exiting
10:01:10 (1425): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
11:02:17 (1920): No heartbeat from core client for 30 sec - exiting
11:03:01 (1920): No heartbeat from core client for 30 sec - exiting
11:03:02 (1920): No heartbeat from core client for 30 sec - exiting
11:03:03 (1920): No heartbeat from core client for 30 sec - exiting
11:03:04 (1920): No heartbeat from core client for 30 sec - exiting
11:03:05 (1920): No heartbeat from core client for 30 sec - exiting
11:03:06 (1920): No heartbeat from core client for 30 sec - exiting
11:03:07 (1920): No heartbeat from core client for 30 sec - exiting
11:03:08 (1920): No heartbeat from core client for 30 sec - exiting
11:03:09 (1920): No heartbeat from core client for 30 sec - exiting
11:03:10 (1920): No heartbeat from core client for 30 sec - exiting
11:03:11 (1920): No heartbeat from core client for 30 sec - exiting
11:03:12 (1920): No heartbeat from core client for 30 sec - exiting
11:03:13 (1920): No heartbeat from core client for 30 sec - exiting
11:03:14 (1920): No heartbeat from core client for 30 sec - exiting
11:03:15 (1920): No heartbeat from core client for 30 sec - exiting
11:03:16 (1920): No heartbeat from core client for 30 sec - exiting
11:03:17 (1920): No heartbeat from core client for 30 sec - exiting
11:03:18 (1920): No heartbeat from core client for 30 sec - exiting
11:03:19 (1920): No heartbeat from core client for 30 sec - exiting
11:03:20 (1920): No heartbeat from core client for 30 sec - exiting
11:03:21 (1920): No heartbeat from core client for 30 sec - exiting
11:03:22 (1920): No heartbeat from core client for 30 sec - exiting
11:03:23 (1920): No heartbeat from core client for 30 sec - exiting
11:03:24 (1920): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:19:35 (4127): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Jan 2016 17:29:19 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 699,840 469,660 0.6711
11 Jan 2016 12:48:38 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 673,920 453,121 0.6724
10 Jan 2016 19:52:51 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 648,000 436,301 0.6733
10 Jan 2016 13:52:19 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 622,080 419,463 0.6743
09 Jan 2016 07:38:27 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 596,160 402,501 0.6752
08 Jan 2016 16:05:08 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 570,240 384,795 0.6748
08 Jan 2016 11:03:57 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 544,320 367,475 0.6751
07 Jan 2016 18:37:50 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 518,400 349,594 0.6744
07 Jan 2016 13:37:12 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 492,480 332,942 0.6761
06 Jan 2016 13:19:54 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 466,560 315,566 0.6764
05 Jan 2016 19:38:47 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 440,640 298,050 0.6764
05 Jan 2016 13:38:09 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 414,720 280,457 0.6763
05 Jan 2016 08:22:09 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 388,800 262,923 0.6762
04 Jan 2016 13:57:37 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 362,880 245,405 0.6763
03 Jan 2016 21:22:45 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 336,960 227,931 0.6764
03 Jan 2016 13:06:50 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 311,040 210,640 0.6772
02 Jan 2016 18:23:26 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 285,120 193,245 0.6778
01 Jan 2016 18:35:36 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 259,200 175,673 0.6778
31 Dec 2015 23:02:15 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 233,280 158,679 0.6802
31 Dec 2015 18:21:48 1364480 19132246 hadcm3n_xdny_198012_480_010221223_0 207,360 142,408 0.6868


©2024 climateprediction.net