climateprediction.net home page
Task 15804973

Task 15804973

Name hadcm3n_o4q0_2020_40_008376110_0
Workunit 8526969
Created 30 May 2013, 1:48:53 UTC
Sent 30 May 2013, 1:55:30 UTC
Report deadline 29 Aug 2013, 9:22:41 UTC
Received 21 Oct 2013, 6:20:26 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1068473
Run time 32 days 19 hours 21 min 46 sec
CPU time 14 days 11 hours 43 min 57 sec
Validate state Invalid
Credit 11,819.52
Device peak FLOPS 3.58 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
15:54:25 (7665): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
16:48:49 (300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
18:22:50 (376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x90ce04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x90ce00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x10fd004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x10fd000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x90ce04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x90ce00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x90ce04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x90ce00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x90ce04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(332,0xacd4da28) malloc: *** error for object 0x90ce00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
hadcm3n_6.07_i686-apple-darwin(321,0xacd4da28) malloc: *** error for object 0x934404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(321,0xacd4da28) malloc: *** error for object 0x115c804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(321,0xacd4da28) malloc: *** error for object 0x934404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(321,0xacd4da28) malloc: *** error for object 0x936004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(321,0xacd4da28) malloc: *** error for object 0x936000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(321,0xacd4da28) malloc: *** error for object 0x936004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(321,0xacd4da28) malloc: *** error for object 0x936000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(321,0xacd4da28) malloc: *** error for object 0x936004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0xa16a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x1208600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x11cb604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(288,0xacd4da28) malloc: *** error for object 0x11cb600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/2/../../switcher/switcher) is setuid or setgid
Signal 3 received, exiting...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Oct 2013 01:35:58 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 984,960 1,227,441 1.2462
18 Oct 2013 02:22:59 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 959,040 1,194,637 1.2457
14 Oct 2013 23:40:50 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 933,120 1,161,086 1.2443
12 Oct 2013 21:39:31 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 907,200 1,128,086 1.2435
09 Oct 2013 01:19:19 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 881,280 1,097,014 1.2448
04 Oct 2013 21:03:34 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 855,360 1,066,163 1.2464
30 Sep 2013 23:06:22 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 829,440 1,032,693 1.2450
22 Sep 2013 00:53:03 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 803,520 1,001,560 1.2465
19 Sep 2013 01:50:39 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 777,600 971,011 1.2487
15 Sep 2013 03:42:36 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 751,680 939,333 1.2496
10 Sep 2013 01:21:12 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 725,760 906,405 1.2489
04 Sep 2013 00:22:58 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 699,840 873,858 1.2487
26 Aug 2013 06:33:47 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 673,920 839,760 1.2461
24 Aug 2013 23:46:24 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 648,000 805,027 1.2423
24 Aug 2013 01:21:13 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 622,080 769,721 1.2373
21 Aug 2013 04:10:39 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 596,160 735,218 1.2333
19 Aug 2013 02:58:32 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 570,240 700,794 1.2289
16 Aug 2013 22:37:41 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 544,320 667,664 1.2266
14 Aug 2013 23:32:10 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 518,400 634,267 1.2235
14 Aug 2013 23:32:10 1068473 15804973 hadcm3n_o4q0_2020_40_008376110_0 492,480 601,268 1.2209


©2024 cpdn.org