 |
|
| Name | hadcm3n_o42i_1900_40_007439960_3 |
| Workunit | 7637463 |
| Created | 6 Sep 2011, 1:19:13 UTC |
| Sent | 6 Sep 2011, 1:22:52 UTC |
| Report deadline | 6 Dec 2011, 8:50:03 UTC |
| Received | 24 Sep 2011, 20:44:50 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1166797 |
| Run time | 8 days 16 hours 20 min 26 sec |
| CPU time | 8 days 12 hours 11 min 20 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 2.92 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
| Stderr | <core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:13:44 (2232): No heartbeat from core client for 30 sec - exiting 16:13:45 (2232): No heartbeat from core client for 30 sec - exiting 16:13:46 (2232): No heartbeat from core client for 30 sec - exiting 16:13:47 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:22:13 (2260): No heartbeat from core client for 30 sec - exiting 16:22:15 (2260): No heartbeat from core client for 30 sec - exiting 16:22:16 (2260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:48 (2188): No heartbeat from core client for 30 sec - exiting 06:01:50 (2188): No heartbeat from core client for 30 sec - exiting 06:01:51 (2188): No heartbeat from core client for 30 sec - exiting 06:01:52 (2188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:03:16 (2192): No heartbeat from core client for 30 sec - exiting 13:03:17 (2192): No heartbeat from core client for 30 sec - exiting 13:03:19 (2192): No heartbeat from core client for 30 sec - exiting 13:03:20 (2192): No heartbeat from core client for 30 sec - exiting 13:03:21 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:48 (2212): No heartbeat from core client for 30 sec - exiting 06:01:50 (2212): No heartbeat from core client for 30 sec - exiting 06:01:51 (2212): No heartbeat from core client for 30 sec - exiting 06:01:52 (2212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:50 (2252): No heartbeat from core client for 30 sec - exiting 06:01:52 (2252): No heartbeat from core client for 30 sec - exiting 06:01:53 (2252): No heartbeat from core client for 30 sec - exiting 06:01:54 (2252): No heartbeat from core client for 30 sec - exiting 06:01:55 (2252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:49 (2172): No heartbeat from core client for 30 sec - exiting 06:01:50 (2172): No heartbeat from core client for 30 sec - exiting 06:01:51 (2172): No heartbeat from core client for 30 sec - exiting 06:01:52 (2172): No heartbeat from core client for 30 sec - exiting 06:01:53 (2172): No heartbeat from core client for 30 sec - exiting 06:01:54 (2172): No heartbeat from core client for 30 sec - exiting 06:01:55 (2172): No heartbeat from core client for 30 sec - exiting 06:01:56 (2172): No heartbeat from core client for 30 sec - exiting 06:01:58 (2172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:18:22 (2944): No heartbeat from core client for 30 sec - exiting 11:18:24 (2944): No heartbeat from core client for 30 sec - exiting 11:18:25 (2944): No heartbeat from core client for 30 sec - exiting 11:18:26 (2944): No heartbeat from core client for 30 sec - exiting 11:18:27 (2944): No heartbeat from core client for 30 sec - exiting 11:18:28 (2944): No heartbeat from core client for 30 sec - exiting 11:18:29 (2944): No heartbeat from core client for 30 sec - exiting 11:18:30 (2944): No heartbeat from core client for 30 sec - exiting 11:18:31 (2944): No heartbeat from core client for 30 sec - exiting 11:18:32 (2944): No heartbeat from core client for 30 sec - exiting 11:18:33 (2944): No heartbeat from core client for 30 sec - exiting 11:18:35 (2944): No heartbeat from core client for 30 sec - exiting 11:18:36 (2944): No heartbeat from core client for 30 sec - exiting 11:18:37 (2944): No heartbeat from core client for 30 sec - exiting 11:18:38 (2944): No heartbeat from core client for 30 sec - exiting 11:18:39 (2944): No heartbeat from core client for 30 sec - exiting 11:18:40 (2944): No heartbeat from core client for 30 sec - exiting 11:18:41 (2944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:51:29 (2160): No heartbeat from core client for 30 sec - exiting 12:51:31 (2160): No heartbeat from core client for 30 sec - exiting 12:51:32 (2160): No heartbeat from core client for 30 sec - exiting 12:51:33 (2160): No heartbeat from core client for 30 sec - exiting 12:51:34 (2160): No heartbeat from core client for 30 sec - exiting 12:51:35 (2160): No heartbeat from core client for 30 sec - exiting 12:51:36 (2160): No heartbeat from core client for 30 sec - exiting 12:51:37 (2160): No heartbeat from core client for 30 sec - exiting 12:51:38 (2160): No heartbeat from core client for 30 sec - exiting 12:51:39 (2160): No heartbeat from core client for 30 sec - exiting 12:51:40 (2160): No heartbeat from core client for 30 sec - exiting 12:51:42 (2160): No heartbeat from core client for 30 sec - exiting 12:51:43 (2160): No heartbeat from core client for 30 sec - exiting 12:51:44 (2160): No heartbeat from core client for 30 sec - exiting 12:51:45 (2160): No heartbeat from core client for 30 sec - exiting 12:51:46 (2160): No heartbeat from core client for 30 sec - exiting 12:51:47 (2160): No heartbeat from core client for 30 sec - exiting 12:51:48 (2160): No heartbeat from core client for 30 sec - exiting 12:51:49 (2160): No heartbeat from core client for 30 sec - exiting 12:51:50 (2160): No heartbeat from core client for 30 sec - exiting 12:51:51 (2160): No heartbeat from core client for 30 sec - exiting 12:51:52 (2160): No heartbeat from core client for 30 sec - exiting 12:51:54 (2160): No heartbeat from core client for 30 sec - exiting 12:51:55 (2160): No heartbeat from core client for 30 sec - exiting 12:51:56 (2160): No heartbeat from core client for 30 sec - exiting 12:51:57 (2160): No heartbeat from core client for 30 sec - exiting 12:51:58 (2160): No heartbeat from core client for 30 sec - exiting 12:51:59 (2160): No heartbeat from core client for 30 sec - exiting 12:52:00 (2160): No heartbeat from core client for 30 sec - exiting 12:52:01 (2160): No heartbeat from core client for 30 sec - exiting 12:52:02 (2160): No heartbeat from core client for 30 sec - exiting 12:52:04 (2160): No heartbeat from core client for 30 sec - exiting 12:52:05 (2160): No heartbeat from core client for 30 sec - exiting 12:52:06 (2160): No heartbeat from core client for 30 sec - exiting 12:52:07 (2160): No heartbeat from core client for 30 sec - exiting 12:52:08 (2160): No heartbeat from core client for 30 sec - exiting 12:52:09 (2160): No heartbeat from core client for 30 sec - exiting 12:52:10 (2160): No heartbeat from core client for 30 sec - exiting 12:52:11 (2160): No heartbeat from core client for 30 sec - exiting 12:52:12 (2160): No heartbeat from core client for 30 sec - exiting 12:52:13 (2160): No heartbeat from core client for 30 sec - exiting 12:52:15 (2160): No heartbeat from core client for 30 sec - exiting 12:52:16 (2160): No heartbeat from core client for 30 sec - exiting 12:52:17 (2160): No heartbeat from core client for 30 sec - exiting 12:52:18 (2160): No heartbeat from core client for 30 sec - exiting 12:52:19 (2160): No heartbeat from core client for 30 sec - exiting 12:52:20 (2160): No heartbeat from core client for 30 sec - exiting 12:52:21 (2160): No heartbeat from core client for 30 sec - exiting 12:52:22 (2160): No heartbeat from core client for 30 sec - exiting 12:52:23 (2160): No heartbeat from core client for 30 sec - exiting 12:52:24 (2160): No heartbeat from core client for 30 sec - exiting 12:52:25 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:21:46 (2088): No heartbeat from core client for 30 sec - exiting 16:21:47 (2088): No heartbeat from core client for 30 sec - exiting 16:21:48 (2088): No heartbeat from core client for 30 sec - exiting 16:21:49 (2088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:49 (2220): No heartbeat from core client for 30 sec - exiting 06:01:50 (2220): No heartbeat from core client for 30 sec - exiting 06:01:51 (2220): No heartbeat from core client for 30 sec - exiting 06:01:52 (2220): No heartbeat from core client for 30 sec - exiting 06:01:53 (2220): No heartbeat from core client for 30 sec - exiting 06:01:55 (2220): No heartbeat from core client for 30 sec - exiting 06:01:56 (2220): No heartbeat from core client for 30 sec - exiting 06:01:57 (2220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:54:09 (2060): No heartbeat from core client for 30 sec - exiting 15:54:10 (2060): No heartbeat from core client for 30 sec - exiting 15:54:12 (2060): No heartbeat from core client for 30 sec - exiting 15:54:13 (2060): No heartbeat from core client for 30 sec - exiting 15:54:14 (2060): No heartbeat from core client for 30 sec - exiting 15:54:15 (2060): No heartbeat from core client for 30 sec - exiting 15:54:16 (2060): No heartbeat from core client for 30 sec - exiting 15:54:17 (2060): No heartbeat from core client for 30 sec - exiting 15:54:18 (2060): No heartbeat from core client for 30 sec - exiting 15:54:19 (2060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:50 (2224): No heartbeat from core client for 30 sec - exiting 06:01:51 (2224): No heartbeat from core client for 30 sec - exiting 06:01:52 (2224): No heartbeat from core client for 30 sec - exiting 06:01:53 (2224): No heartbeat from core client for 30 sec - exiting 06:01:54 (2224): No heartbeat from core client for 30 sec - exiting 06:01:55 (2224): No heartbeat from core client for 30 sec - exiting 06:01:56 (2224): No heartbeat from core client for 30 sec - exiting 06:01:57 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:02 (2196): No heartbeat from core client for 30 sec - exiting 12:45:03 (2196): No heartbeat from core client for 30 sec - exiting 12:45:04 (2196): No heartbeat from core client for 30 sec - exiting 12:45:05 (2196): No heartbeat from core client for 30 sec - exiting 12:45:06 (2196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:49 (2160): No heartbeat from core client for 30 sec - exiting 06:01:50 (2160): No heartbeat from core client for 30 sec - exiting 06:01:51 (2160): No heartbeat from core client for 30 sec - exiting 06:01:52 (2160): No heartbeat from core client for 30 sec - exiting 06:01:53 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:52:54 (2120): No heartbeat from core client for 30 sec - exiting 13:52:56 (2120): No heartbeat from core client for 30 sec - exiting 13:52:57 (2120): No heartbeat from core client for 30 sec - exiting 13:52:58 (2120): No heartbeat from core client for 30 sec - exiting 13:52:59 (2120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:49 (2160): No heartbeat from core client for 30 sec - exiting 06:01:50 (2160): No heartbeat from core client for 30 sec - exiting 06:01:51 (2160): No heartbeat from core client for 30 sec - exiting 06:01:53 (2160): No heartbeat from core client for 30 sec - exiting 06:01:54 (2160): No heartbeat from core client for 30 sec - exiting 06:01:55 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:15:39 (2244): No heartbeat from core client for 30 sec - exiting 11:15:40 (2244): No heartbeat from core client for 30 sec - exiting 11:15:41 (2244): No heartbeat from core client for 30 sec - exiting 11:15:42 (2244): No heartbeat from core client for 30 sec - exiting 11:15:43 (2244): No heartbeat from core client for 30 sec - exiting 11:15:44 (2244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:51:07 (2212): No heartbeat from core client for 30 sec - exiting 13:51:09 (2212): No heartbeat from core client for 30 sec - exiting 13:51:10 (2212): No heartbeat from core client for 30 sec - exiting 13:51:11 (2212): No heartbeat from core client for 30 sec - exiting 13:51:12 (2212): No heartbeat from core client for 30 sec - exiting 13:51:13 (2212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:50 (2120): No heartbeat from core client for 30 sec - exiting 06:01:51 (2120): No heartbeat from core client for 30 sec - exiting 06:01:53 (2120): No heartbeat from core client for 30 sec - exiting 06:01:54 (2120): No heartbeat from core client for 30 sec - exiting 06:01:55 (2120): No heartbeat from core client for 30 sec - exiting 06:01:56 (2120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:49 (2184): No heartbeat from core client for 30 sec - exiting 06:01:51 (2184): No heartbeat from core client for 30 sec - exiting 06:01:52 (2184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:15:39 (2312): No heartbeat from core client for 30 sec - exiting 10:15:40 (2312): No heartbeat from core client for 30 sec - exiting 10:15:42 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:36:54 (2232): No heartbeat from core client for 30 sec - exiting 13:36:56 (2232): No heartbeat from core client for 30 sec - exiting 13:36:57 (2232): No heartbeat from core client for 30 sec - exiting 13:36:58 (2232): No heartbeat from core client for 30 sec - exiting 13:36:59 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:09:50 (2240): No heartbeat from core client for 30 sec - exiting 14:09:51 (2240): No heartbeat from core client for 30 sec - exiting 14:09:52 (2240): No heartbeat from core client for 30 sec - exiting 14:09:54 (2240): No heartbeat from core client for 30 sec - exiting 14:09:55 (2240): No heartbeat from core client for 30 sec - exiting 14:09:56 (2240): No heartbeat from core client for 30 sec - exiting 14:09:57 (2240): No heartbeat from core client for 30 sec - exiting 14:09:58 (2240): No heartbeat from core client for 30 sec - exiting 14:09:59 (2240): No heartbeat from core client for 30 sec - exiting 14:10:00 (2240): No heartbeat from core client for 30 sec - exiting 14:10:01 (2240): No heartbeat from core client for 30 sec - exiting 14:10:02 (2240): No heartbeat from core client for 30 sec - exiting 14:10:03 (2240): No heartbeat from core client for 30 sec - exiting 14:10:05 (2240): No heartbeat from core client for 30 sec - exiting 14:10:06 (2240): No heartbeat from core client for 30 sec - exiting 14:10:07 (2240): No heartbeat from core client for 30 sec - exiting 14:10:08 (2240): No heartbeat from core client for 30 sec - exiting 14:10:09 (2240): No heartbeat from core client for 30 sec - exiting 14:10:10 (2240): No heartbeat from core client for 30 sec - exiting 14:10:11 (2240): No heartbeat from core client for 30 sec - exiting 14:10:12 (2240): No heartbeat from core client for 30 sec - exiting 14:10:13 (2240): No heartbeat from core client for 30 sec - exiting 14:10:14 (2240): No heartbeat from core client for 30 sec - exiting 14:10:15 (2240): No heartbeat from core client for 30 sec - exiting 14:10:17 (2240): No heartbeat from core client for 30 sec - exiting 14:10:18 (2240): No heartbeat from core client for 30 sec - exiting 14:10:19 (2240): No heartbeat from core client for 30 sec - exiting 14:10:20 (2240): No heartbeat from core client for 30 sec - exiting 14:10:21 (2240): No heartbeat from core client for 30 sec - exiting 14:10:22 (2240): No heartbeat from core client for 30 sec - exiting 14:10:24 (2240): No heartbeat from core client for 30 sec - exiting 14:10:25 (2240): No heartbeat from core client for 30 sec - exiting 14:10:26 (2240): No heartbeat from core client for 30 sec - exiting 14:10:27 (2240): No heartbeat from core client for 30 sec - exiting 14:10:28 (2240): No heartbeat from core client for 30 sec - exiting 14:10:29 (2240): No heartbeat from core client for 30 sec - exiting 14:10:30 (2240): No heartbeat from core client for 30 sec - exiting 14:10:31 (2240): No heartbeat from core client for 30 sec - exiting 14:10:32 (2240): No heartbeat from core client for 30 sec - exiting 14:10:33 (2240): No heartbeat from core client for 30 sec - exiting 14:10:34 (2240): No heartbeat from core client for 30 sec - exiting 14:10:36 (2240): No heartbeat from core client for 30 sec - exiting 14:10:37 (2240): No heartbeat from core client for 30 sec - exiting 14:10:38 (2240): No heartbeat from core client for 30 sec - exiting 14:10:39 (2240): No heartbeat from core client for 30 sec - exiting 14:10:40 (2240): No heartbeat from core client for 30 sec - exiting 14:10:41 (2240): No heartbeat from core client for 30 sec - exiting 14:10:42 (2240): No heartbeat from core client for 30 sec - exiting 14:10:43 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:03:27 (2236): No heartbeat from core client for 30 sec - exiting 16:03:28 (2236): No heartbeat from core client for 30 sec - exiting 16:03:29 (2236): No heartbeat from core client for 30 sec - exiting 16:03:31 (2236): No heartbeat from core client for 30 sec - exiting 16:03:32 (2236): No heartbeat from core client for 30 sec - exiting 16:03:33 (2236): No heartbeat from core client for 30 sec - exiting 16:03:34 (2236): No heartbeat from core client for 30 sec - exiting 16:03:35 (2236): No heartbeat from core client for 30 sec - exiting 16:03:36 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:51 (2172): No heartbeat from core client for 30 sec - exiting 06:01:53 (2172): No heartbeat from core client for 30 sec - exiting 06:01:54 (2172): No heartbeat from core client for 30 sec - exiting 06:01:55 (2172): No heartbeat from core client for 30 sec - exiting 06:01:56 (2172): No heartbeat from core client for 30 sec - exiting 06:01:57 (2172): No heartbeat from core client for 30 sec - exiting 06:01:58 (2172): No heartbeat from core client for 30 sec - exiting 06:01:59 (2172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:52 (2180): No heartbeat from core client for 30 sec - exiting 06:01:53 (2180): No heartbeat from core client for 30 sec - exiting 06:01:54 (2180): No heartbeat from core client for 30 sec - exiting 06:01:55 (2180): No heartbeat from core client for 30 sec - exiting 06:01:56 (2180): No heartbeat from core client for 30 sec - exiting 06:01:57 (2180): No heartbeat from core client for 30 sec - exiting 06:01:58 (2180): No heartbeat from core client for 30 sec - exiting 06:01:59 (2180): No heartbeat from core client for 30 sec - exiting 06:02:01 (2180): No heartbeat from core client for 30 sec - exiting 06:02:02 (2180): No heartbeat from core client for 30 sec - exiting 06:02:03 (2180): No heartbeat from core client for 30 sec - exiting 06:02:04 (2180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:24:05 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:01:44 (1472): No heartbeat from core client for 30 sec - exiting 06:01:45 (1472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:59:09 (2160): No heartbeat from core client for 30 sec - exiting 07:59:10 (2160): No heartbeat from core client for 30 sec - exiting 07:59:11 (2160): No heartbeat from core client for 30 sec - exiting 07:59:13 (2160): No heartbeat from core client for 30 sec - exiting 07:59:14 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:12:20 (2240): No heartbeat from core client for 30 sec - exiting 09:12:21 (2240): No heartbeat from core client for 30 sec - exiting 09:12:22 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:50 (2200): No heartbeat from core client for 30 sec - exiting 06:01:51 (2200): No heartbeat from core client for 30 sec - exiting 06:01:52 (2200): No heartbeat from core client for 30 sec - exiting 06:01:53 (2200): No heartbeat from core client for 30 sec - exiting 06:01:54 (2200): No heartbeat from core client for 30 sec - exiting 06:01:55 (2200): No heartbeat from core client for 30 sec - exiting 06:01:57 (2200): No heartbeat from core client for 30 sec - exiting 06:01:58 (2200): No heartbeat from core client for 30 sec - exiting 06:01:59 (2200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:03:26 (2136): No heartbeat from core client for 30 sec - exiting 16:03:27 (2136): No heartbeat from core client for 30 sec - exiting 16:03:28 (2136): No heartbeat from core client for 30 sec - exiting 16:03:29 (2136): No heartbeat from core client for 30 sec - exiting 16:03:30 (2136): No heartbeat from core client for 30 sec - exiting 16:03:32 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:27:39 (2160): No heartbeat from core client for 30 sec - exiting 16:27:41 (2160): No heartbeat from core client for 30 sec - exiting 16:27:42 (2160): No heartbeat from core client for 30 sec - exiting 16:27:43 (2160): No heartbeat from core client for 30 sec - exiting 16:27:44 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:54 (2556): No heartbeat from core client for 30 sec - exiting 06:01:55 (2556): No heartbeat from core client for 30 sec - exiting 06:01:56 (2556): No heartbeat from core client for 30 sec - exiting 06:01:58 (2556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Ocean Restart file copy failed on o42iko.dac02f0 Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 24 Sep 2011 19:44:35 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 518,400 | 735,072 | 1.4180 |
| 23 Sep 2011 23:40:30 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 492,480 | 698,909 | 1.4192 |
| 22 Sep 2011 23:48:35 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 466,560 | 662,694 | 1.4204 |
| 22 Sep 2011 12:26:05 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 440,640 | 626,262 | 1.4213 |
| 21 Sep 2011 16:06:37 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 414,720 | 589,555 | 1.4216 |
| 20 Sep 2011 19:51:55 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 388,800 | 552,985 | 1.4223 |
| 19 Sep 2011 14:32:11 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 362,880 | 515,745 | 1.4213 |
| 18 Sep 2011 18:15:52 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 336,960 | 479,341 | 1.4225 |
| 17 Sep 2011 22:03:03 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 311,040 | 442,999 | 1.4243 |
| 16 Sep 2011 20:18:01 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 285,120 | 405,805 | 1.4233 |
| 15 Sep 2011 18:09:53 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 259,200 | 369,100 | 1.4240 |
| 14 Sep 2011 21:36:09 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 233,280 | 332,163 | 1.4239 |
| 14 Sep 2011 11:02:41 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 207,360 | 294,695 | 1.4212 |
| 13 Sep 2011 13:54:59 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 181,440 | 257,947 | 1.4217 |
| 12 Sep 2011 15:08:58 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 155,520 | 221,076 | 1.4215 |
| 10 Sep 2011 23:46:55 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 129,600 | 184,274 | 1.4219 |
| 09 Sep 2011 18:42:09 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 103,680 | 147,620 | 1.4238 |
| 08 Sep 2011 16:07:38 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 77,760 | 110,740 | 1.4241 |
| 07 Sep 2011 17:59:32 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 51,840 | 73,919 | 1.4259 |
| 06 Sep 2011 12:51:52 | 1166797 | 13339287 | hadcm3n_o42i_1900_40_007439960_3 | 25,920 | 36,968 | 1.4262 |
©2024 cpdn.org