climateprediction.net home page
Task 13142414

Task 13142414

Name hadcm3n_ym2u_1900_40_007361472_2
Workunit 7558902
Created 16 Jul 2011, 17:11:31 UTC
Sent 16 Jul 2011, 17:12:40 UTC
Report deadline 16 Oct 2011, 0:39:51 UTC
Received 30 Aug 2011, 8:40:26 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1139562
Run time 20 days 2 hours 6 min 38 sec
CPU time 19 days 10 hours 11 min 15 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 1.65 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
 - exit code 193 (0xc1)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:54:10 (7476): No heartbeat from core client for 30 sec - exiting
23:54:11 (7476): No heartbeat from core client for 30 sec - exiting
23:54:12 (7476): No heartbeat from core client for 30 sec - exiting
23:54:13 (7476): No heartbeat from core client for 30 sec - exiting
23:54:14 (7476): No heartbeat from core client for 30 sec - exiting
23:54:15 (7476): No heartbeat from core client for 30 sec - exiting
23:54:16 (7476): No heartbeat from core client for 30 sec - exiting
23:54:17 (7476): No heartbeat from core client for 30 sec - exiting
23:54:18 (7476): No heartbeat from core client for 30 sec - exiting
23:54:19 (7476): No heartbeat from core client for 30 sec - exiting
23:54:20 (7476): No heartbeat from core client for 30 sec - exiting
23:54:21 (7476): No heartbeat from core client for 30 sec - exiting
23:54:22 (7476): No heartbeat from core client for 30 sec - exiting
23:54:23 (7476): No heartbeat from core client for 30 sec - exiting
23:54:24 (7476): No heartbeat from core client for 30 sec - exiting
23:54:25 (7476): No heartbeat from core client for 30 sec - exiting
23:54:26 (7476): No heartbeat from core client for 30 sec - exiting
23:54:27 (7476): No heartbeat from core client for 30 sec - exiting
23:54:28 (7476): No heartbeat from core client for 30 sec - exiting
23:54:29 (7476): No heartbeat from core client for 30 sec - exiting
23:54:30 (7476): No heartbeat from core client for 30 sec - exiting
23:54:31 (7476): No heartbeat from core client for 30 sec - exiting
23:54:32 (7476): No heartbeat from core client for 30 sec - exiting
23:54:33 (7476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:51:09 (104452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:13:53 (100628): No heartbeat from core client for 30 sec - exiting
21:13:54 (100628): No heartbeat from core client for 30 sec - exiting
21:13:55 (100628): No heartbeat from core client for 30 sec - exiting
21:13:56 (100628): No heartbeat from core client for 30 sec - exiting
21:13:57 (100628): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:13:58 (100628): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:03:09 (107004): Can't acquire lockfile (32) - waiting 35s
CPDN Monitor - Quit request from BOINC...
04:36:03 (109924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:40:54 (113776): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:05:11 (118716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CNo Process Handle
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=118032, selfPID=118032, iMonCtr=1
14:41:10 (119068): No heartbeat from core client for 30 sec - exiting
14:41:13 (119068): No heartbeat from core client for 30 sec - exiting
14:41:14 (119068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:32:47 (119248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:05:14 (11568): No heartbeat from core client for 30 sec - exiting
14:05:15 (11568): No heartbeat from core client for 30 sec - exiting
14:05:16 (11568): No heartbeat from core client for 30 sec - exiting
14:05:17 (11568): No heartbeat from core client for 30 sec - exiting
14:05:18 (11568): No heartbeat from core client for 30 sec - exiting
14:05:19 (11568): No heartbeat from core client for 30 sec - exiting
14:05:20 (11568): No heartbeat from core client for 30 sec - exiting
14:05:21 (11568): No heartbeat from core client for 30 sec - exiting
14:05:22 (11568): No heartbeat from core client for 30 sec - exiting
14:05:23 (11568): No heartbeat from core client for 30 sec - exiting
14:05:24 (11568): No heartbeat from core client for 30 sec - exiting
14:05:25 (11568): No heartbeat from core client for 30 sec - exiting
14:05:26 (11568): No heartbeat from core client for 30 sec - exiting
14:05:27 (11568): No heartbeat from core client for 30 sec - exiting
14:05:28 (11568): No heartbeat from core client for 30 sec - exiting
14:05:29 (11568): No heartbeat from core client for 30 sec - exiting
14:05:30 (11568): No heartbeat from core client for 30 sec - exiting
14:05:31 (11568): No heartbeat from core client for 30 sec - exiting
14:05:32 (11568): No heartbeat from core client for 30 sec - exiting
14:05:33 (11568): No heartbeat from core client for 30 sec - exiting
14:05:34 (11568): No heartbeat from core client for 30 sec - exiting
14:05:35 (11568): No heartbeat from core client for 30 sec - exiting
14:05:36 (11568): No heartbeat from core client for 30 sec - exiting
14:05:37 (11568): No heartbeat from core client for 30 sec - exiting
14:05:38 (11568): No heartbeat from core client for 30 sec - exiting
14:05:39 (11568): No heartbeat from core client for 30 sec - exiting
14:05:40 (11568): No heartbeat from core client for 30 sec - exiting
14:05:41 (11568): No heartbeat from core client for 30 sec - exiting
14:05:42 (11568): No heartbeat from core client for 30 sec - exiting
14:05:43 (11568): No heartbeat from core client for 30 sec - exiting
14:05:44 (11568): No heartbeat from core client for 30 sec - exiting
14:05:45 (11568): No heartbeat from core client for 30 sec - exiting
14:05:46 (11568): No heartbeat from core client for 30 sec - exiting
14:05:47 (11568): No heartbeat from core client for 30 sec - exiting
14:05:48 (11568): No heartbeat from core client for 30 sec - exiting
14:05:49 (11568): No heartbeat from core client for 30 sec - exiting
14:05:50 (11568): No heartbeat from core client for 30 sec - exiting
14:05:51 (11568): No heartbeat from core client for 30 sec - exiting
14:05:52 (11568): No heartbeat from core client for 30 sec - exiting
14:05:53 (11568): No heartbeat from core client for 30 sec - exiting
14:05:54 (11568): No heartbeat from core client for 30 sec - exiting
14:05:55 (11568): No heartbeat from core client for 30 sec - exiting
14:05:56 (11568): No heartbeat from core client for 30 sec - exiting
14:05:57 (11568): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:57:47 (20472): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:34:50 (16732): No heartbeat from core client for 30 sec - exiting
19:34:51 (16732): No heartbeat from core client for 30 sec - exiting
19:34:52 (16732): No heartbeat from core client for 30 sec - exiting
19:34:53 (16732): No heartbeat from core client for 30 sec - exiting
19:34:54 (16732): No heartbeat from core client for 30 sec - exiting
19:34:55 (16732): No heartbeat from core client for 30 sec - exiting
19:34:56 (16732): No heartbeat from core client for 30 sec - exiting
19:34:57 (16732): No heartbeat from core client for 30 sec - exiting
19:34:58 (16732): No heartbeat from core client for 30 sec - exiting
19:34:59 (16732): No heartbeat from core client for 30 sec - exiting
19:35:00 (16732): No heartbeat from core client for 30 sec - exiting
19:35:01 (16732): No heartbeat from core client for 30 sec - exiting
19:35:02 (16732): No heartbeat from core client for 30 sec - exiting
19:35:03 (16732): No heartbeat from core client for 30 sec - exiting
19:35:04 (16732): No heartbeat from core client for 30 sec - exiting
19:35:05 (16732): No heartbeat from core client for 30 sec - exiting
19:35:06 (16732): No heartbeat from core client for 30 sec - exiting
19:35:07 (16732): No heartbeat from core client for 30 sec - exiting
19:35:08 (16732): No heartbeat from core client for 30 sec - exiting
19:35:09 (16732): No heartbeat from core client for 30 sec - exiting
19:35:10 (16732): No heartbeat from core client for 30 sec - exiting
19:35:11 (16732): No heartbeat from core client for 30 sec - exiting
19:35:12 (16732): No heartbeat from core client for 30 sec - exiting
19:35:13 (16732): No heartbeat from core client for 30 sec - exiting
19:35:14 (16732): No heartbeat from core client for 30 sec - exiting
19:35:15 (16732): No heartbeat from core client for 30 sec - exiting
19:35:16 (16732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:29:29 (25076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:45:28 (23900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x770D3A93 read attempt to address 0x4059D84A

Engaging BOINC Windows Runtime Debugger...

Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=27596, selfPID=27596, iMonCtr=1


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x770D3A93 read attempt to address 0x4059D84A

Engaging BOINC Windows Runtime Debugger...

Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_ym2u_1900_40_007361472/dataout/shmem_restart.day
Signal 11 received, exiting...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Aug 2011 08:41:36 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 518,400 1,676,810 3.2346
29 Aug 2011 04:44:30 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 492,480 1,590,870 3.2303
27 Aug 2011 23:02:41 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 466,560 1,505,527 3.2269
26 Aug 2011 16:51:00 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 440,640 1,420,220 3.2231
25 Aug 2011 03:14:01 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 414,720 1,334,818 3.2186
24 Aug 2011 01:16:23 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 388,800 1,249,831 3.2146
22 Aug 2011 22:49:13 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 362,880 1,165,069 3.2106
21 Aug 2011 13:50:58 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 336,960 1,080,808 3.2075
20 Aug 2011 09:34:11 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 311,040 1,000,223 3.2157
16 Aug 2011 09:04:46 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 285,120 919,469 3.2248
14 Aug 2011 23:42:05 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 259,200 838,619 3.2354
13 Aug 2011 18:28:57 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 233,280 754,086 3.2325
12 Aug 2011 15:53:33 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 207,360 670,816 3.2350
07 Aug 2011 16:37:35 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 181,440 586,890 3.2346
03 Aug 2011 02:59:12 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 155,520 503,334 3.2365
02 Aug 2011 03:15:11 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 129,600 419,988 3.2406
31 Jul 2011 02:31:01 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 103,680 336,095 3.2417
27 Jul 2011 19:48:11 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 77,760 252,030 3.2411
26 Jul 2011 16:46:37 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 51,840 167,902 3.2389
26 Jul 2011 16:46:37 1139562 13142414 hadcm3n_ym2u_1900_40_007361472_2 25,920 83,756 3.2313


©2024 cpdn.org