climateprediction.net home page
Task 14298426

Task 14298426

Name hadcm3n_o3u2_1980_40_007833960_4
Workunit 7989072
Created 20 Mar 2012, 16:38:51 UTC
Sent 20 Mar 2012, 16:38:53 UTC
Report deadline 20 Jun 2012, 0:06:04 UTC
Received 16 Apr 2012, 12:39:29 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID 1035544
Run time 15 days 11 hours 47 min 21 sec
CPU time 13 days 9 hours 52 min 25 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.60 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.18</core_client_version>
<![CDATA[
<message>
 - exit code -1073741819 (0xc0000005)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
05:48:54 (708): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:49:01 (708): No heartbeat from core client for 30 sec - exiting
05:49:03 (708): No heartbeat from core client for 30 sec - exiting
05:49:04 (708): No heartbeat from core client for 30 sec - exiting
05:49:05 (708): No heartbeat from core client for 30 sec - exiting
05:49:06 (708): No heartbeat from core client for 30 sec - exiting
05:49:07 (708): No heartbeat from core client for 30 sec - exiting
05:49:08 (708): No heartbeat from core client for 30 sec - exiting
05:49:09 (708): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:00:15 (2316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:00:20 (2316): No heartbeat from core client for 30 sec - exiting
06:00:21 (2316): No heartbeat from core client for 30 sec - exiting
06:00:22 (2316): No heartbeat from core client for 30 sec - exiting
06:00:23 (2316): No heartbeat from core client for 30 sec - exiting
06:00:24 (2316): No heartbeat from core client for 30 sec - exiting
06:00:25 (2316): No heartbeat from core client for 30 sec - exiting
06:00:27 (2316): No heartbeat from core client for 30 sec - exiting
06:00:28 (2316): No heartbeat from core client for 30 sec - exiting
06:00:29 (2316): No heartbeat from core client for 30 sec - exiting
06:00:30 (2316): No heartbeat from core client for 30 sec - exiting
09:47:50 (3160): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:47:53 (3160): No heartbeat from core client for 30 sec - exiting
09:47:54 (3160): No heartbeat from core client for 30 sec - exiting
09:47:56 (3160): No heartbeat from core client for 30 sec - exiting
09:47:57 (3160): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:05:19 (3452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:05:21 (3452): No heartbeat from core client for 30 sec - exiting
19:05:22 (3452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:15:50 (2564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:25:24 (2232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:00:41 (3520): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:00:42 (3520): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:04:34 (276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:04:36 (276): No heartbeat from core client for 30 sec - exiting
03:04:37 (276): No heartbeat from core client for 30 sec - exiting
03:04:38 (276): No heartbeat from core client for 30 sec - exiting
03:04:39 (276): No heartbeat from core client for 30 sec - exiting
03:04:40 (276): No heartbeat from core client for 30 sec - exiting
03:04:41 (276): No heartbeat from core client for 30 sec - exiting
03:04:42 (276): No heartbeat from core client for 30 sec - exiting
03:04:43 (276): No heartbeat from core client for 30 sec - exiting
03:04:44 (276): No heartbeat from core client for 30 sec - exiting
03:04:45 (276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:04:22 (2916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:04:24 (2916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:32:07 (2488): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:11:43 (1596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:11:44 (1596): No heartbeat from core client for 30 sec - exiting
20:11:45 (1596): No heartbeat from core client for 30 sec - exiting
20:11:46 (1596): No heartbeat from core client for 30 sec - exiting
20:11:47 (1596): No heartbeat from core client for 30 sec - exiting
20:11:48 (1596): No heartbeat from core client for 30 sec - exiting
20:11:50 (1596): No heartbeat from core client for 30 sec - exiting
20:11:51 (1596): No heartbeat from core client for 30 sec - exiting
20:11:52 (1596): No heartbeat from core client for 30 sec - exiting
20:11:53 (1596): No heartbeat from core client for 30 sec - exiting
20:11:54 (1596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:53:38 (1184): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
23:55:58 (3992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:55:59 (3992): No heartbeat from core client for 30 sec - exiting
23:56:01 (3992): No heartbeat from core client for 30 sec - exiting
23:56:02 (3992): No heartbeat from core client for 30 sec - exiting
23:56:03 (3992): No heartbeat from core client for 30 sec - exiting
23:56:04 (3992): No heartbeat from core client for 30 sec - exiting
23:56:05 (3992): No heartbeat from core client for 30 sec - exiting
23:56:06 (3992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
19:25:33 (1616): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
22:23:36 (1440): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:23:37 (1440): No heartbeat from core client for 30 sec - exiting
22:23:38 (1440): No heartbeat from core client for 30 sec - exiting
22:23:39 (1440): No heartbeat from core client for 30 sec - exiting
22:23:40 (1440): No heartbeat from core client for 30 sec - exiting
22:23:41 (1440): No heartbeat from core client for 30 sec - exiting
22:23:43 (1440): No heartbeat from core client for 30 sec - exiting
22:23:44 (1440): No heartbeat from core client for 30 sec - exiting
22:23:45 (1440): No heartbeat from core client for 30 sec - exiting
22:23:46 (1440): No heartbeat from core client for 30 sec - exiting
22:23:47 (1440): No heartbeat from core client for 30 sec - exiting
04:34:36 (2808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:34:38 (2808): No heartbeat from core client for 30 sec - exiting
04:34:39 (2808): No heartbeat from core client for 30 sec - exiting
04:34:40 (2808): No heartbeat from core client for 30 sec - exiting
04:34:41 (2808): No heartbeat from core client for 30 sec - exiting
04:34:42 (2808): No heartbeat from core client for 30 sec - exiting
04:34:43 (2808): No heartbeat from core client for 30 sec - exiting
04:34:44 (2808): No heartbeat from core client for 30 sec - exiting
04:34:45 (2808): No heartbeat from core client for 30 sec - exiting
04:34:46 (2808): No heartbeat from core client for 30 sec - exiting
04:34:48 (2808): No heartbeat from core client for 30 sec - exiting
10:11:57 (2172): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:11:59 (2172): No heartbeat from core client for 30 sec - exiting
10:12:00 (2172): No heartbeat from core client for 30 sec - exiting
10:12:01 (2172): No heartbeat from core client for 30 sec - exiting
10:12:02 (2172): No heartbeat from core client for 30 sec - exiting
10:12:03 (2172): No heartbeat from core client for 30 sec - exiting
10:12:04 (2172): No heartbeat from core client for 30 sec - exiting
10:12:05 (2172): No heartbeat from core client for 30 sec - exiting
10:12:06 (2172): No heartbeat from core client for 30 sec - exiting
10:12:07 (2172): No heartbeat from core client for 30 sec - exiting
10:12:08 (2172): No heartbeat from core client for 30 sec - exiting
20:24:06 (3956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:24:07 (3956): No heartbeat from core client for 30 sec - exiting
20:24:08 (3956): No heartbeat from core client for 30 sec - exiting
20:24:09 (3956): No heartbeat from core client for 30 sec - exiting
20:24:10 (3956): No heartbeat from core client for 30 sec - exiting
20:24:12 (3956): No heartbeat from core client for 30 sec - exiting
20:24:13 (3956): No heartbeat from core client for 30 sec - exiting
20:24:14 (3956): No heartbeat from core client for 30 sec - exiting
20:24:15 (3956): No heartbeat from core client for 30 sec - exiting
20:24:16 (3956): No heartbeat from core client for 30 sec - exiting
05:19:40 (3904): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:19:45 (3904): No heartbeat from core client for 30 sec - exiting
05:19:46 (3904): No heartbeat from core client for 30 sec - exiting
05:19:47 (3904): No heartbeat from core client for 30 sec - exiting
05:19:48 (3904): No heartbeat from core client for 30 sec - exiting
05:19:49 (3904): No heartbeat from core client for 30 sec - exiting
05:19:50 (3904): No heartbeat from core client for 30 sec - exiting
05:19:51 (3904): No heartbeat from core client for 30 sec - exiting
05:19:52 (3904): No heartbeat from core client for 30 sec - exiting
05:19:53 (3904): No heartbeat from core client for 30 sec - exiting
05:19:55 (3904): No heartbeat from core client for 30 sec - exiting
05:19:56 (3904): No heartbeat from core client for 30 sec - exiting
06:10:25 (1452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:10:26 (1452): No heartbeat from core client for 30 sec - exiting
06:10:27 (1452): No heartbeat from core client for 30 sec - exiting
06:10:28 (1452): No heartbeat from core client for 30 sec - exiting
06:10:29 (1452): No heartbeat from core client for 30 sec - exiting
06:10:31 (1452): No heartbeat from core client for 30 sec - exiting
06:10:32 (1452): No heartbeat from core client for 30 sec - exiting
06:10:33 (1452): No heartbeat from core client for 30 sec - exiting
06:10:34 (1452): No heartbeat from core client for 30 sec - exiting
06:10:35 (1452): No heartbeat from core client for 30 sec - exiting
06:10:36 (1452): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
07:19:24 (3316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:19:25 (3316): No heartbeat from core client for 30 sec - exiting
07:19:26 (3316): No heartbeat from core client for 30 sec - exiting
07:19:28 (3316): No heartbeat from core client for 30 sec - exiting
07:19:29 (3316): No heartbeat from core client for 30 sec - exiting
07:19:30 (3316): No heartbeat from core client for 30 sec - exiting
11:07:38 (1052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x7D621DA7 read attempt to address 0x4001C243

Engaging BOINC Windows Runtime Debugger...

Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2660, selfPID=2660, iMonCtr=1

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Apr 2012 11:42:35 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 777,600 1,158,734 1.4901
16 Apr 2012 02:06:41 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 751,680 1,126,502 1.4986
15 Apr 2012 15:00:49 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 725,760 1,090,956 1.5032
15 Apr 2012 02:53:08 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 699,840 1,053,640 1.5055
14 Apr 2012 13:11:02 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 673,920 1,008,951 1.4971
13 Apr 2012 23:51:23 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 648,000 963,505 1.4869
13 Apr 2012 10:59:20 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 622,080 918,778 1.4769
12 Apr 2012 05:45:59 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 596,160 878,388 1.4734
11 Apr 2012 18:21:44 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 570,240 878,695 1.5409
11 Apr 2012 04:58:06 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 544,320 876,366 1.6100
10 Apr 2012 03:10:13 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 518,400 834,890 1.6105
09 Apr 2012 04:04:16 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 492,480 793,100 1.6104
08 Apr 2012 09:55:04 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 466,560 751,245 1.6102
07 Apr 2012 13:47:28 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 440,640 709,833 1.6109
06 Apr 2012 15:13:16 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 414,720 668,371 1.6116
05 Apr 2012 19:20:41 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 388,800 626,526 1.6114
05 Apr 2012 00:32:07 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 362,880 584,637 1.6111
04 Apr 2012 05:58:58 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 336,960 543,114 1.6118
03 Apr 2012 10:26:11 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 311,040 501,586 1.6126
02 Apr 2012 09:59:33 1035544 14298426 hadcm3n_o3u2_1980_40_007833960_4 285,120 459,956 1.6132


©2024 climateprediction.net