 |
|
| Name | hadcm3n_o78o_2020_40_008026016_4 |
| Workunit | 8181130 |
| Created | 14 Jul 2012, 17:16:31 UTC |
| Sent | 14 Jul 2012, 17:17:01 UTC |
| Report deadline | 14 Oct 2012, 0:44:12 UTC |
| Received | 13 Oct 2012, 9:52:45 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1142703 |
| Run time | 74 days 22 hours 27 min 50 sec |
| CPU time | 69 days 20 hours 46 min 31 sec |
| Validate state | Invalid |
| Credit | 12,441.60 |
| Device peak FLOPS | 0.92 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:12:58 (1744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:53 (1744): No heartbeat from core client for 30 sec - exiting 20:14:37 (1744): No heartbeat from core client for 30 sec - exiting 20:14:39 (1744): No heartbeat from core client for 30 sec - exiting 20:15:23 (1744): No heartbeat from core client for 30 sec - exiting 20:16:06 (1744): No heartbeat from core client for 30 sec - exiting 20:16:08 (1744): No heartbeat from core client for 30 sec - exiting 20:20:10 (16787): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:35 (16797): No heartbeat from core client for 30 sec - exiting 20:30:19 (16797): No heartbeat from core client for 30 sec - exiting 20:30:21 (16797): No heartbeat from core client for 30 sec - exiting 20:31:05 (16797): No heartbeat from core client for 30 sec - exiting 20:31:06 (16797): No heartbeat from core client for 30 sec - exiting 20:31:49 (16797): No heartbeat from core client for 30 sec - exiting 20:32:32 (16797): No heartbeat from core client for 30 sec - exiting 20:32:34 (16797): No heartbeat from core client for 30 sec - exiting 20:33:18 (16797): No heartbeat from core client for 30 sec - exiting 20:33:20 (16797): No heartbeat from core client for 30 sec - exiting 20:33:22 (16797): No heartbeat from core client for 30 sec - exiting 20:33:23 (16797): No heartbeat from core client for 30 sec - exiting 20:33:25 (16797): No heartbeat from core client for 30 sec - exiting 20:34:49 (16797): No heartbeat from core client for 30 sec - exiting 20:34:51 (16797): No heartbeat from core client for 30 sec - exiting 20:34:53 (16797): No heartbeat from core client for 30 sec - exiting 20:35:35 (16797): No heartbeat from core client for 30 sec - exiting 20:35:37 (16797): No heartbeat from core client for 30 sec - exiting 20:36:20 (16797): No heartbeat from core client for 30 sec - exiting 20:37:04 (16797): No heartbeat from core client for 30 sec - exiting 20:37:55 (16797): No heartbeat from core client for 30 sec - exiting 20:38:38 (16797): No heartbeat from core client for 30 sec - exiting 20:38:40 (16797): No heartbeat from core client for 30 sec - exiting 20:39:23 (16797): No heartbeat from core client for 30 sec - exiting 20:39:24 (16797): No heartbeat from core client for 30 sec - exiting 20:40:08 (16797): No heartbeat from core client for 30 sec - exiting 20:40:51 (16797): No heartbeat from core client for 30 sec - exiting 20:40:53 (16797): No heartbeat from core client for 30 sec - exiting 20:40:55 (16797): No heartbeat from core client for 30 sec - exiting 20:41:38 (16797): No heartbeat from core client for 30 sec - exiting 20:41:40 (16797): No heartbeat from core client for 30 sec - exiting 20:41:42 (16797): No heartbeat from core client for 30 sec - exiting 20:42:25 (16797): No heartbeat from core client for 30 sec - exiting 20:43:09 (16797): No heartbeat from core client for 30 sec - exiting 20:43:11 (16797): No heartbeat from core client for 30 sec - exiting 20:43:13 (16797): No heartbeat from core client for 30 sec - exiting 20:43:15 (16797): No heartbeat from core client for 30 sec - exiting 20:43:57 (16797): No heartbeat from core client for 30 sec - exiting 20:43:59 (16797): No heartbeat from core client for 30 sec - exiting 20:44:44 (16797): No heartbeat from core client for 30 sec - exiting 20:45:27 (16797): No heartbeat from core client for 30 sec - exiting 20:45:28 (16797): No heartbeat from core client for 30 sec - exiting 20:45:30 (16797): No heartbeat from core client for 30 sec - exiting 20:45:32 (16797): No heartbeat from core client for 30 sec - exiting 20:46:16 (16797): No heartbeat from core client for 30 sec - exiting 20:46:59 (16797): No heartbeat from core client for 30 sec - exiting 20:47:01 (16797): No heartbeat from core client for 30 sec - exiting 20:47:45 (16797): No heartbeat from core client for 30 sec - exiting 20:47:47 (16797): No heartbeat from core client for 30 sec - exiting 20:48:29 (16797): No heartbeat from core client for 30 sec - exiting 20:48:31 (16797): No heartbeat from core client for 30 sec - exiting 20:48:33 (16797): No heartbeat from core client for 30 sec - exiting 20:48:35 (16797): No heartbeat from core client for 30 sec - exiting 20:48:37 (16797): No heartbeat from core client for 30 sec - exiting 20:49:20 (16797): No heartbeat from core client for 30 sec - exiting 20:49:21 (16797): No heartbeat from core client for 30 sec - exiting 20:50:04 (16797): No heartbeat from core client for 30 sec - exiting 20:50:06 (16797): No heartbeat from core client for 30 sec - exiting 20:50:49 (16797): No heartbeat from core client for 30 sec - exiting 20:51:31 (16797): No heartbeat from core client for 30 sec - exiting 20:51:32 (16797): No heartbeat from core client for 30 sec - exiting 20:52:15 (16797): No heartbeat from core client for 30 sec - exiting 20:52:17 (16797): No heartbeat from core client for 30 sec - exiting 20:53:01 (16797): No heartbeat from core client for 30 sec - exiting 20:53:03 (16797): No heartbeat from core client for 30 sec - exiting 20:53:47 (16797): No heartbeat from core client for 30 sec - exiting 20:54:31 (16797): No heartbeat from core client for 30 sec - exiting 20:54:33 (16797): No heartbeat from core client for 30 sec - exiting 20:55:17 (16797): No heartbeat from core client for 30 sec - exiting 20:55:59 (16797): No heartbeat from core client for 30 sec - exiting 20:56:01 (16797): No heartbeat from core client for 30 sec - exiting 20:56:03 (16797): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:37 (16814): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:26 (16814): No heartbeat from core client for 30 sec - exiting 21:18:28 (16814): No heartbeat from core client for 30 sec - exiting 21:19:54 (16814): No heartbeat from core client for 30 sec - exiting 21:19:56 (16814): No heartbeat from core client for 30 sec - exiting 21:20:39 (16814): No heartbeat from core client for 30 sec - exiting 21:20:41 (16814): No heartbeat from core client for 30 sec - exiting 21:24:05 (16836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:51 (16836): No heartbeat from core client for 30 sec - exiting 21:24:53 (16836): No heartbeat from core client for 30 sec - exiting 21:34:29 (16844): No heartbeat from core client for 30 sec - exiting 21:35:15 (16844): No heartbeat from core client for 30 sec - exiting 21:35:57 (16844): No heartbeat from core client for 30 sec - exiting 21:35:59 (16844): No heartbeat from core client for 30 sec - exiting 21:36:41 (16844): No heartbeat from core client for 30 sec - exiting 21:36:43 (16844): No heartbeat from core client for 30 sec - exiting 21:36:45 (16844): No heartbeat from core client for 30 sec - exiting 21:36:46 (16844): No heartbeat from core client for 30 sec - exiting 21:37:30 (16844): No heartbeat from core client for 30 sec - exiting 21:37:32 (16844): No heartbeat from core client for 30 sec - exiting 21:38:15 (16844): No heartbeat from core client for 30 sec - exiting 21:38:17 (16844): No heartbeat from core client for 30 sec - exiting 21:38:19 (16844): No heartbeat from core client for 30 sec - exiting 21:38:20 (16844): No heartbeat from core client for 30 sec - exiting 21:39:44 (16844): No heartbeat from core client for 30 sec - exiting 21:39:46 (16844): No heartbeat from core client for 30 sec - exiting 21:39:48 (16844): No heartbeat from core client for 30 sec - exiting 21:40:31 (16844): No heartbeat from core client for 30 sec - exiting 21:40:33 (16844): No heartbeat from core client for 30 sec - exiting 21:40:35 (16844): No heartbeat from core client for 30 sec - exiting 21:41:18 (16844): No heartbeat from core client for 30 sec - exiting 21:41:20 (16844): No heartbeat from core client for 30 sec - exiting 21:42:03 (16844): No heartbeat from core client for 30 sec - exiting 21:42:05 (16844): No heartbeat from core client for 30 sec - exiting 21:42:07 (16844): No heartbeat from core client for 30 sec - exiting 21:42:09 (16844): No heartbeat from core client for 30 sec - exiting 21:42:11 (16844): No heartbeat from core client for 30 sec - exiting 21:42:53 (16844): No heartbeat from core client for 30 sec - exiting 21:43:36 (16844): No heartbeat from core client for 30 sec - exiting 21:43:38 (16844): No heartbeat from core client for 30 sec - exiting 21:44:22 (16844): No heartbeat from core client for 30 sec - exiting 21:44:24 (16844): No heartbeat from core client for 30 sec - exiting 21:45:06 (16844): No heartbeat from core client for 30 sec - exiting 21:45:09 (16844): No heartbeat from core client for 30 sec - exiting 21:45:51 (16844): No heartbeat from core client for 30 sec - exiting 21:45:53 (16844): No heartbeat from core client for 30 sec - exiting 21:46:36 (16844): No heartbeat from core client for 30 sec - exiting 21:46:38 (16844): No heartbeat from core client for 30 sec - exiting 21:47:21 (16844): No heartbeat from core client for 30 sec - exiting 21:47:23 (16844): No heartbeat from core client for 30 sec - exiting 21:47:25 (16844): No heartbeat from core client for 30 sec - exiting 21:47:26 (16844): No heartbeat from core client for 30 sec - exiting 21:48:51 (16844): No heartbeat from core client for 30 sec - exiting 21:48:53 (16844): No heartbeat from core client for 30 sec - exiting 21:49:37 (16844): No heartbeat from core client for 30 sec - exiting 21:50:20 (16844): No heartbeat from core client for 30 sec - exiting 21:50:22 (16844): No heartbeat from core client for 30 sec - exiting 21:51:06 (16844): No heartbeat from core client for 30 sec - exiting 21:51:47 (16844): No heartbeat from core client for 30 sec - exiting 21:51:49 (16844): No heartbeat from core client for 30 sec - exiting 21:51:51 (16844): No heartbeat from core client for 30 sec - exiting 21:51:53 (16844): No heartbeat from core client for 30 sec - exiting 21:52:37 (16844): No heartbeat from core client for 30 sec - exiting 21:52:39 (16844): No heartbeat from core client for 30 sec - exiting 21:53:21 (16844): No heartbeat from core client for 30 sec - exiting 21:53:23 (16844): No heartbeat from core client for 30 sec - exiting 21:54:17 (16844): No heartbeat from core client for 30 sec - exiting 21:54:19 (16844): No heartbeat from core client for 30 sec - exiting 21:55:03 (16844): No heartbeat from core client for 30 sec - exiting 21:55:04 (16844): No heartbeat from core client for 30 sec - exiting 21:55:47 (16844): No heartbeat from core client for 30 sec - exiting 21:55:49 (16844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:16:08 (1672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x083527f8 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6c501)[0x17c501] /lib/libc.so.6(+0x6dd70)[0x17dd70] /lib/libc.so.6(cfree+0x6d)[0x180e5d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb22441] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb2249d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe7)[0x126ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 00110000-00267000 r-xp 00000000 08:01 392534 /lib/libc-2.12.1.so 00267000-00269000 r--p 00157000 08:01 392534 /lib/libc-2.12.1.so 00269000-0026a000 rw-p 00159000 08:01 392534 /lib/libc-2.12.1.so 0026a000-0026d000 rw-p 00000000 00:00 0 00330000-00332000 r-xp 00000000 08:01 392687 /lib/libdl-2.12.1.so 00332000-00333000 r--p 00001000 08:01 392687 /lib/libdl-2.12.1.so 00333000-00334000 rw-p 00002000 08:01 392687 /lib/libdl-2.12.1.so 004da000-004f6000 r-xp 00000000 08:01 392451 /lib/ld-2.12.1.so 004f6000-004f7000 r--p 0001b000 08:01 392451 /lib/ld-2.12.1.so 004f7000-004f8000 rw-p 0001c000 08:01 392451 /lib/ld-2.12.1.so 00752000-00753000 r-xp 00000000 00:00 0 [vdso] 00972000-0098c000 r-xp 00000000 08:01 392527 /lib/libgcc_s.so.1 0098c000-0098d000 r--p 00019000 08:01 392527 /lib/libgcc_s.so.1 0098d000-0098e000 rw-p 0001a000 08:01 392527 /lib/libgcc_s.so.1 00a78000-00b57000 r-xp 00000000 08:01 1442737 /usr/lib/libstdc++.so.6.0.14 00b57000-00b5b000 r--p 000de000 08:01 1442737 /usr/lib/libstdc++.so.6.0.14 00b5b000-00b5c000 rw-p 000e2000 08:01 1442737 /usr/lib/libstdc++.so.6.0.14 00b5c000-00b63000 rw-p 00000000 00:00 0 00cb5000-00cca000 r-xp 00000000 08:01 392698 /lib/libpthread-2.12.1.so 00cca000-00ccb000 ---p 00015000 08:01 392698 /lib/libpthread-2.12.1.so 00ccb000-00ccc000 r--p 00015000 08:01 392698 /lib/libpthread-2.12.1.so 00ccc000-00ccd000 rw-p 00016000 08:01 392698 /lib/libpthread-2.12.1.so 00ccd000-00ccf000 rw-p 00000000 00:00 0 00dbe000-00de2000 r-xp 00000000 08:01 392688 /lib/libm-2.12.1.so 00de2000-00de3000 r--p 00023000 08:01 392688 /lib/libm-2.12.1.so 00de3000-00de4000 rw-p 00024000 08:01 392688 /lib/libm-2.12.1.so 08048000-080e3000 r-xp 00000000 08:01 1570209 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:01 1570209 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 082fd000-08362000 rw-p 00000000 00:00 0 [heap] b7100000-b7121000 rw-p 00000000 00:00 0 b7121000-b7200000 ---p 00000000 00:00 0 b72c8000-b7743000 rw-s 00000000 08:01 1572094 /var/lib/boinc-client/slots/2/132545 b7743000-b7747000 rw-p 00000000 00:00 0 b7751000-b7752000 rw-p 00000000 00:00 0 b7752000-b7753000 ---p 00000000 00:00 0 b7753000-b7756000 rw-p 00000000 00:00 0 b7756000-b7758000 rw-s 00000000 08:01 1571941 /var/lib/boinc-client/slots/2/boinc_mmap_file b7758000-b775a000 rw-p 00000000 00:00 0 bfdff000-bfe6f000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0x752400] [0x752416] /lib/libc.so.6(gsignal+0x51)[0x13a941] /lib/libc.so.6(abort+0x182)[0x13de42] /lib/libc.so.6(+0x62305)[0x172305] /lib/libc.so.6(+0x6c501)[0x17c501] /lib/libc.so.6(+0x6dd70)[0x17dd70] /lib/libc.so.6(cfree+0x6d)[0x180e5d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb22441] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb2249d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe7)[0x126ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 13 Oct 2012 08:52:25 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 1,036,800 | 6,036,372 | 5.8221 |
| 07 Oct 2012 17:14:46 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 1,010,880 | 5,891,017 | 5.8276 |
| 01 Oct 2012 22:24:14 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 984,960 | 5,745,808 | 5.8335 |
| 28 Sep 2012 06:15:45 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 959,040 | 5,600,245 | 5.8394 |
| 26 Sep 2012 09:53:25 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 933,120 | 5,449,218 | 5.8398 |
| 24 Sep 2012 13:51:07 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 907,200 | 5,300,208 | 5.8424 |
| 20 Sep 2012 15:18:17 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 881,280 | 5,152,349 | 5.8464 |
| 18 Sep 2012 00:03:30 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 855,360 | 5,005,215 | 5.8516 |
| 15 Sep 2012 01:10:52 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 829,440 | 4,855,054 | 5.8534 |
| 13 Sep 2012 06:16:34 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 803,520 | 4,702,310 | 5.8521 |
| 11 Sep 2012 11:16:15 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 777,600 | 4,549,217 | 5.8503 |
| 09 Sep 2012 15:41:35 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 751,680 | 4,394,399 | 5.8461 |
| 07 Sep 2012 20:22:35 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 725,760 | 4,240,240 | 5.8425 |
| 06 Sep 2012 00:46:24 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 699,840 | 4,085,544 | 5.8378 |
| 04 Sep 2012 05:35:28 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 673,920 | 3,932,306 | 5.8350 |
| 02 Sep 2012 10:51:11 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 648,000 | 3,781,515 | 5.8357 |
| 31 Aug 2012 16:22:28 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 622,080 | 3,631,362 | 5.8375 |
| 29 Aug 2012 22:08:11 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 596,160 | 3,481,310 | 5.8396 |
| 28 Aug 2012 03:24:44 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 570,240 | 3,329,578 | 5.8389 |
| 26 Aug 2012 08:50:16 | 1142703 | 14915561 | hadcm3n_o78o_2020_40_008026016_4 | 544,320 | 3,177,985 | 5.8384 |
©2024 cpdn.org