Name | hadcm3n_u7bz_1980_40_007535429_1 |
Workunit | 7732661 |
Created | 5 Nov 2011, 8:42:00 UTC |
Sent | 8 Nov 2011, 19:47:59 UTC |
Report deadline | 8 Feb 2012, 3:15:10 UTC |
Received | 24 Nov 2011, 17:55:52 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 1164855 |
Run time | 11 days 18 hours 57 min 54 sec |
CPU time | 11 days 6 hours 17 min 14 sec |
Validate state | Invalid |
Credit | 6,220.80 |
Device peak FLOPS | 1.67 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:38:17 (4926): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:19 (4926): No heartbeat from core client for 30 sec - exiting 12:38:21 (4926): No heartbeat from core client for 30 sec - exiting 12:38:22 (4926): No heartbeat from core client for 30 sec - exiting 12:38:24 (4926): No heartbeat from core client for 30 sec - exiting 12:38:25 (4926): No heartbeat from core client for 30 sec - exiting 12:38:27 (4926): No heartbeat from core client for 30 sec - exiting 12:38:30 (4926): No heartbeat from core client for 30 sec - exiting 12:38:31 (4926): No heartbeat from core client for 30 sec - exiting 12:38:32 (4926): No heartbeat from core client for 30 sec - exiting 12:38:34 (4926): No heartbeat from core client for 30 sec - exiting 12:38:35 (4926): No heartbeat from core client for 30 sec - exiting 12:38:36 (4926): No heartbeat from core client for 30 sec - exiting 12:38:37 (4926): No heartbeat from core client for 30 sec - exiting 12:38:41 (4926): No heartbeat from core client for 30 sec - exiting 12:38:42 (4926): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:12:36 (6861): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:14:01 (20340): No heartbeat from core client for 30 sec - exiting 19:14:22 (20340): No heartbeat from core client for 30 sec - exiting 19:14:25 (20340): No heartbeat from core client for 30 sec - exiting 19:14:26 (20340): No heartbeat from core client for 30 sec - exiting 19:14:27 (20340): No heartbeat from core client for 30 sec - exiting 19:14:29 (20340): No heartbeat from core client for 30 sec - exiting 19:14:30 (20340): No heartbeat from core client for 30 sec - exiting 19:14:31 (20340): No heartbeat from core client for 30 sec - exiting 19:14:32 (20340): No heartbeat from core client for 30 sec - exiting 19:14:35 (20340): No heartbeat from core client for 30 sec - exiting 19:14:36 (20340): No heartbeat from core client for 30 sec - exiting 19:14:37 (20340): No heartbeat from core client for 30 sec - exiting 19:14:40 (20340): No heartbeat from core client for 30 sec - exiting 19:14:41 (20340): No heartbeat from core client for 30 sec - exiting 19:14:42 (20340): No heartbeat from core client for 30 sec - exiting 19:14:45 (20340): No heartbeat from core client for 30 sec - exiting 19:14:46 (20340): No heartbeat from core client for 30 sec - exiting 19:14:47 (20340): No heartbeat from core client for 30 sec - exiting 19:14:48 (20340): No heartbeat from core client for 30 sec - exiting 19:14:50 (20340): No heartbeat from core client for 30 sec - exiting 19:14:51 (20340): No heartbeat from core client for 30 sec - exiting 19:14:52 (20340): No heartbeat from core client for 30 sec - exiting 19:14:53 (20340): No heartbeat from core client for 30 sec - exiting 19:14:56 (20340): No heartbeat from core client for 30 sec - exiting 19:14:57 (20340): No heartbeat from core client for 30 sec - exiting 19:14:58 (20340): No heartbeat from core client for 30 sec - exiting 19:14:59 (20340): No heartbeat from core client for 30 sec - exiting 19:15:00 (20340): No heartbeat from core client for 30 sec - exiting 19:15:01 (20340): No heartbeat from core client for 30 sec - exiting 19:15:02 (20340): No heartbeat from core client for 30 sec - exiting 19:15:03 (20340): No heartbeat from core client for 30 sec - exiting 19:15:04 (20340): No heartbeat from core client for 30 sec - exiting 19:15:05 (20340): No heartbeat from core client for 30 sec - exiting 19:15:38 (20340): No heartbeat from core client for 30 sec - exiting 19:15:46 (20340): No heartbeat from core client for 30 sec - exiting 19:15:47 (20340): No heartbeat from core client for 30 sec - exiting 19:15:48 (20340): No heartbeat from core client for 30 sec - exiting 19:15:49 (20340): No heartbeat from core client for 30 sec - exiting 19:15:51 (20340): No heartbeat from core client for 30 sec - exiting 19:15:52 (20340): No heartbeat from core client for 30 sec - exiting 19:16:23 (20340): No heartbeat from core client for 30 sec - exiting 19:16:24 (20340): No heartbeat from core client for 30 sec - exiting 19:16:25 (20340): No heartbeat from core client for 30 sec - exiting 19:16:28 (20340): No heartbeat from core client for 30 sec - exiting 19:16:29 (20340): No heartbeat from core client for 30 sec - exiting 19:16:30 (20340): No heartbeat from core client for 30 sec - exiting 19:16:31 (20340): No heartbeat from core client for 30 sec - exiting 19:16:35 (20340): No heartbeat from core client for 30 sec - exiting 19:16:36 (20340): No heartbeat from core client for 30 sec - exiting 19:16:37 (20340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:14 (20340): No heartbeat from core client for 30 sec - exiting 19:17:15 (20340): No heartbeat from core client for 30 sec - exiting 19:17:16 (20340): No heartbeat from core client for 30 sec - exiting 19:17:17 (20340): No heartbeat from core client for 30 sec - exiting 19:17:29 (20340): No heartbeat from core client for 30 sec - exiting 19:17:34 (20340): No heartbeat from core client for 30 sec - exiting 19:17:41 (20340): No heartbeat from core client for 30 sec - exiting 19:17:55 (20340): No heartbeat from core client for 30 sec - exiting 19:18:08 (20340): No heartbeat from core client for 30 sec - exiting 19:18:09 (20340): No heartbeat from core client for 30 sec - exiting 19:18:10 (20340): No heartbeat from core client for 30 sec - exiting 19:18:11 (20340): No heartbeat from core client for 30 sec - exiting 19:18:12 (20340): No heartbeat from core client for 30 sec - exiting 19:18:13 (20340): No heartbeat from core client for 30 sec - exiting 19:18:16 (20340): No heartbeat from core client for 30 sec - exiting 19:18:17 (20340): No heartbeat from core client for 30 sec - exiting 19:18:18 (20340): No heartbeat from core client for 30 sec - exiting 19:18:22 (20340): No heartbeat from core client for 30 sec - exiting 19:18:23 (20340): No heartbeat from core client for 30 sec - exiting 19:18:29 (20340): No heartbeat from core client for 30 sec - exiting 19:18:31 (20340): No heartbeat from core client for 30 sec - exiting 19:18:32 (20340): No heartbeat from core client for 30 sec - exiting 19:18:33 (20340): No heartbeat from core client for 30 sec - exiting 19:18:34 (20340): No heartbeat from core client for 30 sec - exiting 19:18:41 (20340): No heartbeat from core client for 30 sec - exiting 19:18:42 (20340): No heartbeat from core client for 30 sec - exiting 19:18:49 (20340): No heartbeat from core client for 30 sec - exiting 19:18:52 (20340): No heartbeat from core client for 30 sec - exiting 19:18:53 (20340): No heartbeat from core client for 30 sec - exiting 19:18:57 (20340): No heartbeat from core client for 30 sec - exiting 19:18:58 (20340): No heartbeat from core client for 30 sec - exiting 19:18:59 (20340): No heartbeat from core client for 30 sec - exiting 19:19:01 (20340): No heartbeat from core client for 30 sec - exiting 19:19:02 (20340): No heartbeat from core client for 30 sec - exiting 19:19:03 (20340): No heartbeat from core client for 30 sec - exiting 19:19:04 (20340): No heartbeat from core client for 30 sec - exiting 19:19:06 (20340): No heartbeat from core client for 30 sec - exiting 19:19:07 (20340): No heartbeat from core client for 30 sec - exiting 19:19:08 (20340): No heartbeat from core client for 30 sec - exiting 19:19:09 (20340): No heartbeat from core client for 30 sec - exiting 19:19:12 (20340): No heartbeat from core client for 30 sec - exiting 19:19:13 (20340): No heartbeat from core client for 30 sec - exiting 19:19:14 (20340): No heartbeat from core client for 30 sec - exiting 19:19:16 (20340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09b36a40 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6c501)[0x1d4501] /lib/libc.so.6(+0x6dd70)[0x1d5d70] /lib/libc.so.6(cfree+0x6d)[0x1d8e5d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x49b441] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x49b49d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe7)[0x17ece7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 0014e000-00163000 r-xp 00000000 08:02 29630563 /lib/libpthread-2.12.1.so 00163000-00164000 ---p 00015000 08:02 29630563 /lib/libpthread-2.12.1.so 00164000-00165000 r--p 00015000 08:02 29630563 /lib/libpthread-2.12.1.so 00165000-00166000 rw-p 00016000 08:02 29630563 /lib/libpthread-2.12.1.so 00166000-00168000 rw-p 00000000 00:00 0 00168000-002bf000 r-xp 00000000 08:02 29630549 /lib/libc-2.12.1.so 002bf000-002c1000 r--p 00157000 08:02 29630549 /lib/libc-2.12.1.so 002c1000-002c2000 rw-p 00159000 08:02 29630549 /lib/libc-2.12.1.so 002c2000-002c5000 rw-p 00000000 00:00 0 003f1000-004d0000 r-xp 00000000 08:02 376955 /usr/lib/libstdc++.so.6.0.14 004d0000-004d4000 r--p 000de000 08:02 376955 /usr/lib/libstdc++.so.6.0.14 004d4000-004d5000 rw-p 000e2000 08:02 376955 /usr/lib/libstdc++.so.6.0.14 004d5000-004dc000 rw-p 00000000 00:00 0 00514000-00530000 r-xp 00000000 08:02 2007058 /lib/ld-2.12.1.so 00530000-00531000 r--p 0001b000 08:02 2007058 /lib/ld-2.12.1.so 00531000-00532000 rw-p 0001c000 08:02 2007058 /lib/ld-2.12.1.so 007ee000-007f0000 r-xp 00000000 08:02 29630552 /lib/libdl-2.12.1.so 007f0000-007f1000 r--p 00001000 08:02 29630552 /lib/libdl-2.12.1.so 007f1000-007f2000 rw-p 00002000 08:02 29630552 /lib/libdl-2.12.1.so 00870000-00894000 r-xp 00000000 08:02 29630553 /lib/libm-2.12.1.so 00894000-00895000 r--p 00023000 08:02 29630553 /lib/libm-2.12.1.so 00895000-00896000 rw-p 00024000 08:02 29630553 /lib/libm-2.12.1.so 00ac7000-00ac8000 r-xp 00000000 00:00 0 [vdso] 00c62000-00c7c000 r-xp 00000000 08:02 29630492 /lib/libgcc_s.so.1 00c7c000-00c7d000 r--p 00019000 08:02 29630492 /lib/libgcc_s.so.1 00c7d000-00c7e000 rw-p 0001a000 08:02 29630492 /lib/libgcc_s.so.1 08048000-080e3000 r-xp 00000000 08:02 16278331 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:02 16278331 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09ae1000-09b46000 rw-p 00000000 00:00 0 [heap] b7200000-b7221000 rw-p 00000000 00:00 0 b7221000-b7300000 ---p 00000000 00:00 0 b73b8000-b7833000 rw-s 00000000 08:02 24608797 /var/lib/boinc-client/slots/1/138100 b7833000-b7837000 rw-p 00000000 00:00 0 b7846000-b7847000 rw-p 00000000 00:00 0 b7847000-b7848000 ---p 00000000 00:00 0 b7848000-b784b000 rw-p 00000000 00:00 0 b784b000-b784d000 rw-s 00000000 08:02 24608794 /var/lib/boinc-client/slots/1/boinc_mmap_file b784d000-b784f000 rw-p 00000000 00:00 0 bfc7c000-bfcec000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xac7400] [0xac7416] /lib/libc.so.6(gsignal+0x51)[0x192941] /lib/libc.so.6(abort+0x182)[0x195e42] /lib/libc.so.6(+0x62305)[0x1ca305] /lib/libc.so.6(+0x6c501)[0x1d4501] /lib/libc.so.6(+0x6dd70)[0x1d5d70] /lib/libc.so.6(cfree+0x6d)[0x1d8e5d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x49b441] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x49b49d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe7)[0x17ece7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
24 Nov 2011 14:18:07 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 518,400 | 973,003 | 1.8769 |
23 Nov 2011 22:38:37 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 492,480 | 924,310 | 1.8768 |
23 Nov 2011 08:22:42 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 466,560 | 875,571 | 1.8767 |
22 Nov 2011 17:26:06 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 440,640 | 826,849 | 1.8765 |
22 Nov 2011 03:37:35 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 414,720 | 778,238 | 1.8765 |
21 Nov 2011 12:49:30 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 388,800 | 729,390 | 1.8760 |
20 Nov 2011 22:20:48 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 362,880 | 680,639 | 1.8757 |
20 Nov 2011 07:47:35 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 336,960 | 631,880 | 1.8752 |
19 Nov 2011 16:50:50 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 311,040 | 583,087 | 1.8746 |
19 Nov 2011 02:32:04 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 285,120 | 534,313 | 1.8740 |
18 Nov 2011 10:59:45 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 259,200 | 485,747 | 1.8740 |
17 Nov 2011 19:03:37 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 233,280 | 437,046 | 1.8735 |
17 Nov 2011 05:07:24 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 207,360 | 388,510 | 1.8736 |
16 Nov 2011 13:30:52 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 181,440 | 339,998 | 1.8739 |
15 Nov 2011 22:09:40 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 155,520 | 291,408 | 1.8738 |
15 Nov 2011 17:34:44 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 129,600 | 242,782 | 1.8733 |
15 Nov 2011 17:34:43 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 103,680 | 194,197 | 1.8730 |
15 Nov 2011 17:34:43 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 77,760 | 145,676 | 1.8734 |
15 Nov 2011 17:34:43 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 51,840 | 97,095 | 1.8730 |
15 Nov 2011 17:34:43 | 1164855 | 13598892 | hadcm3n_u7bz_1980_40_007535429_1 | 25,920 | 48,530 | 1.8723 |
©2024 cpdn.org