Name | hadcm3n_4a8z_1940_40_008307800_1 |
Workunit | 8458935 |
Created | 9 May 2013, 22:34:12 UTC |
Sent | 9 May 2013, 22:34:43 UTC |
Report deadline | 9 Aug 2013, 6:01:54 UTC |
Received | 2 Jun 2013, 0:30:53 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1256213 |
Run time | 11 days 3 hours 54 min 30 sec |
CPU time | 10 days 16 hours 21 min 22 sec |
Validate state | Invalid |
Credit | 8,709.12 |
Device peak FLOPS | 2.78 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:00:41 (4310): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:48 (2677): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:56 (2677): No heartbeat from core client for 30 sec - exiting 20:16:57 (2677): No heartbeat from core client for 30 sec - exiting 20:16:58 (2677): No heartbeat from core client for 30 sec - exiting 20:16:59 (2677): No heartbeat from core client for 30 sec - exiting 20:17:00 (2677): No heartbeat from core client for 30 sec - exiting 20:17:01 (2677): No heartbeat from core client for 30 sec - exiting 20:17:02 (2677): No heartbeat from core client for 30 sec - exiting 20:17:03 (2677): No heartbeat from core client for 30 sec - exiting 20:17:04 (2677): No heartbeat from core client for 30 sec - exiting 20:17:05 (2677): No heartbeat from core client for 30 sec - exiting 20:17:06 (2677): No heartbeat from core client for 30 sec - exiting 20:17:07 (2677): No heartbeat from core client for 30 sec - exiting 20:17:08 (2677): No heartbeat from core client for 30 sec - exiting 20:26:24 (4567): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:25 (4567): No heartbeat from core client for 30 sec - exiting 20:26:26 (4567): No heartbeat from core client for 30 sec - exiting 20:26:27 (4567): No heartbeat from core client for 30 sec - exiting 20:26:28 (4567): No heartbeat from core client for 30 sec - exiting 20:26:29 (4567): No heartbeat from core client for 30 sec - exiting 20:26:30 (4567): No heartbeat from core client for 30 sec - exiting 20:26:31 (4567): No heartbeat from core client for 30 sec - exiting 20:26:32 (4567): No heartbeat from core client for 30 sec - exiting 20:26:33 (4567): No heartbeat from core client for 30 sec - exiting 20:26:34 (4567): No heartbeat from core client for 30 sec - exiting 20:26:35 (4567): No heartbeat from core client for 30 sec - exiting 20:26:36 (4567): No heartbeat from core client for 30 sec - exiting 20:26:37 (4567): No heartbeat from core client for 30 sec - exiting 20:26:38 (4567): No heartbeat from core client for 30 sec - exiting 20:26:39 (4567): No heartbeat from core client for 30 sec - exiting 20:26:40 (4567): No heartbeat from core client for 30 sec - exiting 20:26:41 (4567): No heartbeat from core client for 30 sec - exiting 20:26:42 (4567): No heartbeat from core client for 30 sec - exiting 20:26:43 (4567): No heartbeat from core client for 30 sec - exiting 20:26:44 (4567): No heartbeat from core client for 30 sec - exiting 20:26:45 (4567): No heartbeat from core client for 30 sec - exiting 20:26:46 (4567): No heartbeat from core client for 30 sec - exiting 20:26:47 (4567): No heartbeat from core client for 30 sec - exiting 20:26:48 (4567): No heartbeat from core client for 30 sec - exiting 20:26:49 (4567): No heartbeat from core client for 30 sec - exiting 20:26:50 (4567): No heartbeat from core client for 30 sec - exiting 20:26:51 (4567): No heartbeat from core client for 30 sec - exiting 20:26:52 (4567): No heartbeat from core client for 30 sec - exiting 20:26:53 (4567): No heartbeat from core client for 30 sec - exiting 20:26:54 (4567): No heartbeat from core client for 30 sec - exiting 20:26:55 (4567): No heartbeat from core client for 30 sec - exiting 20:26:56 (4567): No heartbeat from core client for 30 sec - exiting 20:26:57 (4567): No heartbeat from core client for 30 sec - exiting 20:26:58 (4567): No heartbeat from core client for 30 sec - exiting 20:26:59 (4567): No heartbeat from core client for 30 sec - exiting 20:27:00 (4567): No heartbeat from core client for 30 sec - exiting 20:27:01 (4567): No heartbeat from core client for 30 sec - exiting 20:27:02 (4567): No heartbeat from core client for 30 sec - exiting 20:27:03 (4567): No heartbeat from core client for 30 sec - exiting 20:27:04 (4567): No heartbeat from core client for 30 sec - exiting 20:27:05 (4567): No heartbeat from core client for 30 sec - exiting 20:27:06 (4567): No heartbeat from core client for 30 sec - exiting 20:27:07 (4567): No heartbeat from core client for 30 sec - exiting 20:27:08 (4567): No heartbeat from core client for 30 sec - exiting 20:27:09 (4567): No heartbeat from core client for 30 sec - exiting 20:27:10 (4567): No heartbeat from core client for 30 sec - exiting 20:27:11 (4567): No heartbeat from core client for 30 sec - exiting 20:27:12 (4567): No heartbeat from core client for 30 sec - exiting 20:27:13 (4567): No heartbeat from core client for 30 sec - exiting 20:27:14 (4567): No heartbeat from core client for 30 sec - exiting 20:27:15 (4567): No heartbeat from core client for 30 sec - exiting 20:27:16 (4567): No heartbeat from core client for 30 sec - exiting 20:27:17 (4567): No heartbeat from core client for 30 sec - exiting 20:27:18 (4567): No heartbeat from core client for 30 sec - exiting 20:27:19 (4567): No heartbeat from core client for 30 sec - exiting 20:27:20 (4567): No heartbeat from core client for 30 sec - exiting 20:27:21 (4567): No heartbeat from core client for 30 sec - exiting 20:27:22 (4567): No heartbeat from core client for 30 sec - exiting 20:27:23 (4567): No heartbeat from core client for 30 sec - exiting 20:27:24 (4567): No heartbeat from core client for 30 sec - exiting 20:27:25 (4567): No heartbeat from core client for 30 sec - exiting 20:27:26 (4567): No heartbeat from core client for 30 sec - exiting 20:27:27 (4567): No heartbeat from core client for 30 sec - exiting 20:27:28 (4567): No heartbeat from core client for 30 sec - exiting 20:27:29 (4567): No heartbeat from core client for 30 sec - exiting 20:27:30 (4567): No heartbeat from core client for 30 sec - exiting 20:27:31 (4567): No heartbeat from core client for 30 sec - exiting 20:27:32 (4567): No heartbeat from core client for 30 sec - exiting 20:27:33 (4567): No heartbeat from core client for 30 sec - exiting 20:27:34 (4567): No heartbeat from core client for 30 sec - exiting 20:27:35 (4567): No heartbeat from core client for 30 sec - exiting 20:27:36 (4567): No heartbeat from core client for 30 sec - exiting 20:27:37 (4567): No heartbeat from core client for 30 sec - exiting 20:27:38 (4567): No heartbeat from core client for 30 sec - exiting 20:27:39 (4567): No heartbeat from core client for 30 sec - exiting 20:27:40 (4567): No heartbeat from core client for 30 sec - exiting 20:27:41 (4567): No heartbeat from core client for 30 sec - exiting 20:27:42 (4567): No heartbeat from core client for 30 sec - exiting 20:27:43 (4567): No heartbeat from core client for 30 sec - exiting 20:27:44 (4567): No heartbeat from core client for 30 sec - exiting 20:27:45 (4567): No heartbeat from core client for 30 sec - exiting 20:27:46 (4567): No heartbeat from core client for 30 sec - exiting 20:27:47 (4567): No heartbeat from core client for 30 sec - exiting 20:27:48 (4567): No heartbeat from core client for 30 sec - exiting 20:27:49 (4567): No heartbeat from core client for 30 sec - exiting 20:27:50 (4567): No heartbeat from core client for 30 sec - exiting 20:27:51 (4567): No heartbeat from core client for 30 sec - exiting 20:27:52 (4567): No heartbeat from core client for 30 sec - exiting 20:27:53 (4567): No heartbeat from core client for 30 sec - exiting 20:27:54 (4567): No heartbeat from core client for 30 sec - exiting 20:27:55 (4567): No heartbeat from core client for 30 sec - exiting 20:27:56 (4567): No heartbeat from core client for 30 sec - exiting 20:27:57 (4567): No heartbeat from core client for 30 sec - exiting 20:27:58 (4567): No heartbeat from core client for 30 sec - exiting 20:27:59 (4567): No heartbeat from core client for 30 sec - exiting 20:28:00 (4567): No heartbeat from core client for 30 sec - exiting 20:28:01 (4567): No heartbeat from core client for 30 sec - exiting 20:28:02 (4567): No heartbeat from core client for 30 sec - exiting 20:28:03 (4567): No heartbeat from core client for 30 sec - exiting 20:28:04 (4567): No heartbeat from core client for 30 sec - exiting 20:28:05 (4567): No heartbeat from core client for 30 sec - exiting 20:28:06 (4567): No heartbeat from core client for 30 sec - exiting 20:28:07 (4567): No heartbeat from core client for 30 sec - exiting 20:28:08 (4567): No heartbeat from core client for 30 sec - exiting 20:28:09 (4567): No heartbeat from core client for 30 sec - exiting 20:28:10 (4567): No heartbeat from core client for 30 sec - exiting 20:28:11 (4567): No heartbeat from core client for 30 sec - exiting 20:28:12 (4567): No heartbeat from core client for 30 sec - exiting 20:28:13 (4567): No heartbeat from core client for 30 sec - exiting 20:28:14 (4567): No heartbeat from core client for 30 sec - exiting 20:28:15 (4567): No heartbeat from core client for 30 sec - exiting 20:28:16 (4567): No heartbeat from core client for 30 sec - exiting 20:28:17 (4567): No heartbeat from core client for 30 sec - exiting 20:28:18 (4567): No heartbeat from core client for 30 sec - exiting 20:28:19 (4567): No heartbeat from core client for 30 sec - exiting 20:28:20 (4567): No heartbeat from core client for 30 sec - exiting 20:28:21 (4567): No heartbeat from core client for 30 sec - exiting 20:28:22 (4567): No heartbeat from core client for 30 sec - exiting 20:28:23 (4567): No heartbeat from core client for 30 sec - exiting 20:28:24 (4567): No heartbeat from core client for 30 sec - exiting 20:28:25 (4567): No heartbeat from core client for 30 sec - exiting 20:28:26 (4567): No heartbeat from core client for 30 sec - exiting 20:28:27 (4567): No heartbeat from core client for 30 sec - exiting 20:28:28 (4567): No heartbeat from core client for 30 sec - exiting 20:28:29 (4567): No heartbeat from core client for 30 sec - exiting 20:28:30 (4567): No heartbeat from core client for 30 sec - exiting 20:28:31 (4567): No heartbeat from core client for 30 sec - exiting 20:28:32 (4567): No heartbeat from core client for 30 sec - exiting 20:28:33 (4567): No heartbeat from core client for 30 sec - exiting 20:28:34 (4567): No heartbeat from core client for 30 sec - exiting 20:28:35 (4567): No heartbeat from core client for 30 sec - exiting 20:28:36 (4567): No heartbeat from core client for 30 sec - exiting 20:28:37 (4567): No heartbeat from core client for 30 sec - exiting 20:28:38 (4567): No heartbeat from core client for 30 sec - exiting 20:28:39 (4567): No heartbeat from core client for 30 sec - exiting 20:28:40 (4567): No heartbeat from core client for 30 sec - exiting 20:28:41 (4567): No heartbeat from core client for 30 sec - exiting 20:28:42 (4567): No heartbeat from core client for 30 sec - exiting 20:28:43 (4567): No heartbeat from core client for 30 sec - exiting 20:28:44 (4567): No heartbeat from core client for 30 sec - exiting 20:28:45 (4567): No heartbeat from core client for 30 sec - exiting 20:28:46 (4567): No heartbeat from core client for 30 sec - exiting 20:28:47 (4567): No heartbeat from core client for 30 sec - exiting 20:28:48 (4567): No heartbeat from core client for 30 sec - exiting 20:28:49 (4567): No heartbeat from core client for 30 sec - exiting 20:28:50 (4567): No heartbeat from core client for 30 sec - exiting 20:28:51 (4567): No heartbeat from core client for 30 sec - exiting 20:28:52 (4567): No heartbeat from core client for 30 sec - exiting 20:28:53 (4567): No heartbeat from core client for 30 sec - exiting 20:28:54 (4567): No heartbeat from core client for 30 sec - exiting 20:28:55 (4567): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 20:29:58 (5665): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:59 (5665): No heartbeat from core client for 30 sec - exiting 20:30:00 (5665): No heartbeat from core client for 30 sec - exiting 20:30:01 (5665): No heartbeat from core client for 30 sec - exiting 20:30:02 (5665): No heartbeat from core client for 30 sec - exiting 20:30:03 (5665): No heartbeat from core client for 30 sec - exiting 20:30:04 (5665): No heartbeat from core client for 30 sec - exiting 20:30:05 (5665): No heartbeat from core client for 30 sec - exiting 20:30:06 (5665): No heartbeat from core client for 30 sec - exiting 20:30:07 (5665): No heartbeat from core client for 30 sec - exiting 20:30:08 (5665): No heartbeat from core client for 30 sec - exiting 20:30:09 (5665): No heartbeat from core client for 30 sec - exiting 20:30:10 (5665): No heartbeat from core client for 30 sec - exiting 20:30:11 (5665): No heartbeat from core client for 30 sec - exiting 20:30:12 (5665): No heartbeat from core client for 30 sec - exiting 20:30:13 (5665): No heartbeat from core client for 30 sec - exiting 20:30:14 (5665): No heartbeat from core client for 30 sec - exiting 20:30:15 (5665): No heartbeat from core client for 30 sec - exiting 20:30:16 (5665): No heartbeat from core client for 30 sec - exiting 20:30:17 (5665): No heartbeat from core client for 30 sec - exiting 20:30:18 (5665): No heartbeat from core client for 30 sec - exiting 20:30:19 (5665): No heartbeat from core client for 30 sec - exiting 20:30:20 (5665): No heartbeat from core client for 30 sec - exiting 20:30:21 (5665): No heartbeat from core client for 30 sec - exiting 20:30:22 (5665): No heartbeat from core client for 30 sec - exiting SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf777b400] [0xf777b425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf756db1f] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75710b3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7558935] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5691, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf771d400] [0xf771d425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf750fb1f] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75130b3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf74fa935] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5691, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7768400] [0xf7768425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf755ab1f] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf755e0b3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7545935] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5691, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77bb400] [0xf77bb425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75adb1f] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75b10b3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7598935] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5691, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7712400] [0xf7712425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf7504b1f] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75080b3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf74ef935] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5691, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf770c400] [0xf770c425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf74feb1f] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75020b3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf74e9935] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5691, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
31 May 2013 23:10:38 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 725,760 | 919,732 | 1.2673 |
31 May 2013 12:52:51 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 699,840 | 884,012 | 1.2632 |
31 May 2013 03:04:01 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 673,920 | 849,117 | 1.2600 |
30 May 2013 17:43:30 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 648,000 | 815,574 | 1.2586 |
30 May 2013 08:03:48 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 622,080 | 782,275 | 1.2575 |
29 May 2013 19:42:56 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 596,160 | 748,667 | 1.2558 |
29 May 2013 09:43:14 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 570,240 | 713,314 | 1.2509 |
28 May 2013 21:48:27 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 544,320 | 677,039 | 1.2438 |
28 May 2013 12:25:03 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 518,400 | 643,566 | 1.2414 |
24 May 2013 18:43:13 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 492,480 | 610,358 | 1.2394 |
23 May 2013 08:53:09 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 466,560 | 577,549 | 1.2379 |
21 May 2013 23:54:55 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 440,640 | 544,713 | 1.2362 |
21 May 2013 14:25:08 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 414,720 | 511,686 | 1.2338 |
21 May 2013 05:01:40 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 388,800 | 478,808 | 1.2315 |
20 May 2013 19:31:01 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 362,880 | 446,477 | 1.2304 |
16 May 2013 12:28:40 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 336,960 | 414,818 | 1.2311 |
16 May 2013 03:45:26 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 311,040 | 383,900 | 1.2342 |
15 May 2013 12:31:52 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 285,120 | 352,892 | 1.2377 |
15 May 2013 03:13:37 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 259,200 | 320,167 | 1.2352 |
14 May 2013 18:01:23 | 1256213 | 15769717 | hadcm3n_4a8z_1940_40_008307800_1 | 233,280 | 288,215 | 1.2355 |
©2024 climateprediction.net