climateprediction.net home page
Task 19709291

Task 19709291

Name hadcm3n_xcof_198012_480_374_010412969_2
Workunit 10412969
Created 20 May 2016, 23:54:40 UTC
Sent 20 May 2016, 23:56:54 UTC
Report deadline 3 May 2017, 5:16:54 UTC
Received 17 Jun 2016, 9:26:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 976228
Run time 11 days 23 hours 45 min 33 sec
CPU time 9 days 9 hours 17 min 30 sec
Validate state Invalid
Credit 5,598.72
Device peak FLOPS 2.84 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>6.6.29</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
06:47:17 (83137): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:46:38 (84511): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:48:49 (92002): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:46:39 (92410): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:21:17 (24283): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:23:15 (33319): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:37:46 (33750): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:39:25 (47287): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:14:44 (47726): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:53:39 (89021): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:41:40 (40930): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:18:36 (38793): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:20:07 (28282): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:16:59 (35095): No heartbeat from core client for 30 sec - exiting
03:17:01 (35095): No heartbeat from core client for 30 sec - exiting
03:17:02 (35095): No heartbeat from core client for 30 sec - exiting
03:17:03 (35095): No heartbeat from core client for 30 sec - exiting
03:17:04 (35095): No heartbeat from core client for 30 sec - exiting
03:17:05 (35095): No heartbeat from core client for 30 sec - exiting
03:17:06 (35095): No heartbeat from core client for 30 sec - exiting
03:17:07 (35095): No heartbeat from core client for 30 sec - exiting
03:17:08 (35095): No heartbeat from core client for 30 sec - exiting
03:17:09 (35095): No heartbeat from core client for 30 sec - exiting
03:17:10 (35095): No heartbeat from core client for 30 sec - exiting
03:17:11 (35095): No heartbeat from core client for 30 sec - exiting
03:17:12 (35095): No heartbeat from core client for 30 sec - exiting
03:17:13 (35095): No heartbeat from core client for 30 sec - exiting
03:17:14 (35095): No heartbeat from core client for 30 sec - exiting
03:17:15 (35095): No heartbeat from core client for 30 sec - exiting
03:17:16 (35095): No heartbeat from core client for 30 sec - exiting
03:17:17 (35095): No heartbeat from core client for 30 sec - exiting
03:17:18 (35095): No heartbeat from core client for 30 sec - exiting
03:17:19 (35095): No heartbeat from core client for 30 sec - exiting
03:17:20 (35095): No heartbeat from core client for 30 sec - exiting
03:17:21 (35095): No heartbeat from core client for 30 sec - exiting
03:17:22 (35095): No heartbeat from core client for 30 sec - exiting
03:17:23 (35095): No heartbeat from core client for 30 sec - exiting
03:17:24 (35095): No heartbeat from core client for 30 sec - exiting
03:17:25 (35095): No heartbeat from core client for 30 sec - exiting
03:17:26 (35095): No heartbeat from core client for 30 sec - exiting
03:17:27 (35095): No heartbeat from core client for 30 sec - exiting
03:17:28 (35095): No heartbeat from core client for 30 sec - exiting
03:17:29 (35095): No heartbeat from core client for 30 sec - exiting
03:17:30 (35095): No heartbeat from core client for 30 sec - exiting
03:17:31 (35095): No heartbeat from core client for 30 sec - exiting
03:17:32 (35095): No heartbeat from core client for 30 sec - exiting
03:17:33 (35095): No heartbeat from core client for 30 sec - exiting
03:17:34 (35095): No heartbeat from core client for 30 sec - exiting
03:17:35 (35095): No heartbeat from core client for 30 sec - exiting
03:17:36 (35095): No heartbeat from core client for 30 sec - exiting
03:17:37 (35095): No heartbeat from core client for 30 sec - exiting
03:17:38 (35095): No heartbeat from core client for 30 sec - exiting
03:17:39 (35095): No heartbeat from core client for 30 sec - exiting
03:17:40 (35095): No heartbeat from core client for 30 sec - exiting
03:17:41 (35095): No heartbeat from core client for 30 sec - exiting
03:17:42 (35095): No heartbeat from core client for 30 sec - exiting
03:17:43 (35095): No heartbeat from core client for 30 sec - exiting
03:17:44 (35095): No heartbeat from core client for 30 sec - exiting
03:17:45 (35095): No heartbeat from core client for 30 sec - exiting
03:17:46 (35095): No heartbeat from core client for 30 sec - exiting
03:17:47 (35095): No heartbeat from core client for 30 sec - exiting
03:17:48 (35095): No heartbeat from core client for 30 sec - exiting
03:17:49 (35095): No heartbeat from core client for 30 sec - exiting
03:17:50 (35095): No heartbeat from core client for 30 sec - exiting
03:17:51 (35095): No heartbeat from core client for 30 sec - exiting
03:17:52 (35095): No heartbeat from core client for 30 sec - exiting
03:17:53 (35095): No heartbeat from core client for 30 sec - exiting
03:17:54 (35095): No heartbeat from core client for 30 sec - exiting
03:17:55 (35095): No heartbeat from core client for 30 sec - exiting
03:17:56 (35095): No heartbeat from core client for 30 sec - exiting
03:17:57 (35095): No heartbeat from core client for 30 sec - exiting
03:17:58 (35095): No heartbeat from core client for 30 sec - exiting
03:17:59 (35095): No heartbeat from core client for 30 sec - exiting
03:18:00 (35095): No heartbeat from core client for 30 sec - exiting
03:18:01 (35095): No heartbeat from core client for 30 sec - exiting
03:18:02 (35095): No heartbeat from core client for 30 sec - exiting
03:18:03 (35095): No heartbeat from core client for 30 sec - exiting
03:18:04 (35095): No heartbeat from core client for 30 sec - exiting
03:18:05 (35095): No heartbeat from core client for 30 sec - exiting
03:18:06 (35095): No heartbeat from core client for 30 sec - exiting
03:18:07 (35095): No heartbeat from core client for 30 sec - exiting
03:18:08 (35095): No heartbeat from core client for 30 sec - exiting
03:18:09 (35095): No heartbeat from core client for 30 sec - exiting
03:18:10 (35095): No heartbeat from core client for 30 sec - exiting
03:18:11 (35095): No heartbeat from core client for 30 sec - exiting
03:18:12 (35095): No heartbeat from core client for 30 sec - exiting
03:18:13 (35095): No heartbeat from core client for 30 sec - exiting
03:18:14 (35095): No heartbeat from core client for 30 sec - exiting
03:18:15 (35095): No heartbeat from core client for 30 sec - exiting
03:18:16 (35095): No heartbeat from core client for 30 sec - exiting
03:18:17 (35095): No heartbeat from core client for 30 sec - exiting
03:18:18 (35095): No heartbeat from core client for 30 sec - exiting
03:18:19 (35095): No heartbeat from core client for 30 sec - exiting
03:18:20 (35095): No heartbeat from core client for 30 sec - exiting
03:18:21 (35095): No heartbeat from core client for 30 sec - exiting
03:18:22 (35095): No heartbeat from core client for 30 sec - exiting
03:18:23 (35095): No heartbeat from core client for 30 sec - exiting
03:18:24 (35095): No heartbeat from core client for 30 sec - exiting
03:18:25 (35095): No heartbeat from core client for 30 sec - exiting
03:18:26 (35095): No heartbeat from core client for 30 sec - exiting
03:18:27 (35095): No heartbeat from core client for 30 sec - exiting
03:18:28 (35095): No heartbeat from core client for 30 sec - exiting
03:18:29 (35095): No heartbeat from core client for 30 sec - exiting
03:18:30 (35095): No heartbeat from core client for 30 sec - exiting
03:18:32 (35095): No heartbeat from core client for 30 sec - exiting
03:18:33 (35095): No heartbeat from core client for 30 sec - exiting
03:18:34 (35095): No heartbeat from core client for 30 sec - exiting
03:18:35 (35095): No heartbeat from core client for 30 sec - exiting
03:18:36 (35095): No heartbeat from core client for 30 sec - exiting
03:18:37 (35095): No heartbeat from core client for 30 sec - exiting
03:18:38 (35095): No heartbeat from core client for 30 sec - exiting
03:18:39 (35095): No heartbeat from core client for 30 sec - exiting
03:18:40 (35095): No heartbeat from core client for 30 sec - exiting
03:18:41 (35095): No heartbeat from core client for 30 sec - exiting
03:18:42 (35095): No heartbeat from core client for 30 sec - exiting
03:18:43 (35095): No heartbeat from core client for 30 sec - exiting
03:18:44 (35095): No heartbeat from core client for 30 sec - exiting
03:18:45 (35095): No heartbeat from core client for 30 sec - exiting
03:18:46 (35095): No heartbeat from core client for 30 sec - exiting
03:18:47 (35095): No heartbeat from core client for 30 sec - exiting
03:18:48 (35095): No heartbeat from core client for 30 sec - exiting
03:18:49 (35095): No heartbeat from core client for 30 sec - exiting
03:18:50 (35095): No heartbeat from core client for 30 sec - exiting
03:18:51 (35095): No heartbeat from core client for 30 sec - exiting
03:18:52 (35095): No heartbeat from core client for 30 sec - exiting
03:18:53 (35095): No heartbeat from core client for 30 sec - exiting
03:18:54 (35095): No heartbeat from core client for 30 sec - exiting
03:18:55 (35095): No heartbeat from core client for 30 sec - exiting
03:18:56 (35095): No heartbeat from core client for 30 sec - exiting
03:18:57 (35095): No heartbeat from core client for 30 sec - exiting
03:18:58 (35095): No heartbeat from core client for 30 sec - exiting
03:18:59 (35095): No heartbeat from core client for 30 sec - exiting
03:19:00 (35095): No heartbeat from core client for 30 sec - exiting
03:19:01 (35095): No heartbeat from core client for 30 sec - exiting
03:19:02 (35095): No heartbeat from core client for 30 sec - exiting
03:19:03 (35095): No heartbeat from core client for 30 sec - exiting
03:19:04 (35095): No heartbeat from core client for 30 sec - exiting
03:19:05 (35095): No heartbeat from core client for 30 sec - exiting
03:19:06 (35095): No heartbeat from core client for 30 sec - exiting
03:19:07 (35095): No heartbeat from core client for 30 sec - exiting
03:19:08 (35095): No heartbeat from core client for 30 sec - exiting
03:19:09 (35095): No heartbeat from core client for 30 sec - exiting
03:19:10 (35095): No heartbeat from core client for 30 sec - exiting
03:19:11 (35095): No heartbeat from core client for 30 sec - exiting
03:19:12 (35095): No heartbeat from core client for 30 sec - exiting
03:19:13 (35095): No heartbeat from core client for 30 sec - exiting
03:19:14 (35095): No heartbeat from core client for 30 sec - exiting
03:19:15 (35095): No heartbeat from core client for 30 sec - exiting
03:19:16 (35095): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:26:59 (45569): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:45:27 (70130): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:45:56 (77457): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:12:47 (89060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
03:16:30 (90653): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:34:49 (93848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:37:04 (41898): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:35:59 (42413): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:23:12 (84282): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:25:05 (86100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:05:56 (86598): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Jun 2016 21:29:21 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 466,560 942,166 2.0194
15 Jun 2016 18:25:20 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 440,640 890,495 2.0209
14 Jun 2016 15:29:39 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 414,720 837,100 2.0185
13 Jun 2016 12:11:25 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 388,800 783,620 2.0155
11 Jun 2016 15:56:03 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 362,880 729,945 2.0115
10 Jun 2016 15:45:08 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 336,960 677,422 2.0104
09 Jun 2016 17:32:18 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 311,040 623,123 2.0034
09 Jun 2016 01:41:03 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 285,120 570,539 2.0010
08 Jun 2016 10:19:55 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 259,200 521,818 2.0132
06 Jun 2016 15:13:59 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 233,280 467,997 2.0062
04 Jun 2016 14:58:39 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 207,360 415,945 2.0059
03 Jun 2016 14:42:00 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 181,440 362,574 1.9983
02 Jun 2016 12:46:03 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 155,520 309,620 1.9909
01 Jun 2016 09:50:37 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 129,600 257,086 1.9837
31 May 2016 17:38:49 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 103,680 203,015 1.9581
30 May 2016 22:17:41 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 77,760 152,480 1.9609
30 May 2016 06:19:45 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 51,840 101,733 1.9624
29 May 2016 12:22:00 976228 19709291 hadcm3n_xcof_198012_480_374_010412969_2 25,920 51,459 1.9853


©2024 cpdn.org