Task 16051278

Name	hadcm3n_o1nw_2020_40_008373288_4
Workunit	8524147
Created	30 Sep 2013, 21:53:59 UTC
Sent	30 Sep 2013, 22:30:19 UTC
Report deadline	31 Dec 2013, 5:57:30 UTC
Received	17 Oct 2013, 0:14:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1197259
Run time	10 days 23 hours 20 min 32 sec
CPU time	6 days 3 hours 6 min 27 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	3.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:16:34 (16286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:44:18 (72802): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:05 (88683): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:01:17 (89123): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:36:03 (90538): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:58:55 (11584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:01 (21327): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:04:28 (47403): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:02:40 (56476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:52 (94032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:53 (94032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:01:36 (23811): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:45:47 (18484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:46:24 (24570): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:13:42 (84868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed Oct 16 18:14:34 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x92a03000 - 0x92a04fff /usr/lib/system/libsystem_blocks.dylib 0x92d55000 - 0x92d56fff /usr/lib/system/libunc.dylib 0x9378f000 - 0x9385afff /usr/lib/system/libsystem_c.dylib 0x938b4000 - 0x938b6fff /usr/lib/system/libdyld.dylib 0x9404f000 - 0x9407dfff /usr/lib/libSystem.B.dylib 0x94e48000 - 0x94e4ffff /usr/lib/system/libsystem_notify.dylib 0x94f41000 - 0x94f46fff /usr/lib/system/libmacho.dylib 0x954d5000 - 0x954ddfff /usr/lib/system/libunwind.dylib 0x96066000 - 0x96067fff /usr/lib/system/libremovefile.dylib 0x97092000 - 0x970a0fff /usr/lib/libz.1.dylib 0x975c4000 - 0x975f3fff /usr/lib/system/libsystem_info.dylib 0x977df000 - 0x977e3fff /usr/lib/system/libsystem_network.dylib 0x977e4000 - 0x977e7fff /usr/lib/system/libmathCommon.A.dylib 0x977e8000 - 0x97806fff /usr/lib/system/libsystem_kernel.dylib 0x9780c000 - 0x9780cfff /usr/lib/system/libkeymgr.dylib 0x9780d000 - 0x9781bfff /usr/lib/system/libdispatch.dylib 0x97b64000 - 0x97b65fff /usr/lib/system/libsystem_sandbox.dylib 0x98d04000 - 0x98d0cfff /usr/lib/system/liblaunch.dylib 0x99639000 - 0x99640fff /usr/lib/system/libsystem_dnssd.dylib 0x9a11b000 - 0x9a11ffff /usr/lib/system/libcache.dylib 0x9a578000 - 0x9a58efff /usr/lib/system/libxpc.dylib 0x9a58f000 - 0x9a597fff /usr/lib/system/libcopyfile.dylib 0x9a695000 - 0x9a696fff /usr/lib/system/libquarantine.dylib 0x9b698000 - 0x9b698fff /usr/lib/system/libdnsinfo.dylib 0x9b715000 - 0x9b758fff /usr/lib/system/libcommonCrypto.dylib 0x9b928000 - 0x9b92bfff /usr/lib/system/libcompiler_rt.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=96322, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed Oct 16 18:14:40 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x92a03000 - 0x92a04fff /usr/lib/system/libsystem_blocks.dylib 0x92d55000 - 0x92d56fff /usr/lib/system/libunc.dylib 0x9378f000 - 0x9385afff /usr/lib/system/libsystem_c.dylib 0x938b4000 - 0x938b6fff /usr/lib/system/libdyld.dylib 0x9404f000 - 0x9407dfff /usr/lib/libSystem.B.dylib 0x94e48000 - 0x94e4ffff /usr/lib/system/libsystem_notify.dylib 0x94f41000 - 0x94f46fff /usr/lib/system/libmacho.dylib 0x954d5000 - 0x954ddfff /usr/lib/system/libunwind.dylib 0x96066000 - 0x96067fff /usr/lib/system/libremovefile.dylib 0x97092000 - 0x970a0fff /usr/lib/libz.1.dylib 0x975c4000 - 0x975f3fff /usr/lib/system/libsystem_info.dylib 0x977df000 - 0x977e3fff /usr/lib/system/libsystem_network.dylib 0x977e4000 - 0x977e7fff /usr/lib/system/libmathCommon.A.dylib 0x977e8000 - 0x97806fff /usr/lib/system/libsystem_kernel.dylib 0x9780c000 - 0x9780cfff /usr/lib/system/libkeymgr.dylib 0x9780d000 - 0x9781bfff /usr/lib/system/libdispatch.dylib 0x97b64000 - 0x97b65fff /usr/lib/system/libsystem_sandbox.dylib 0x98d04000 - 0x98d0cfff /usr/lib/system/liblaunch.dylib 0x99639000 - 0x99640fff /usr/lib/system/libsystem_dnssd.dylib 0x9a11b000 - 0x9a11ffff /usr/lib/system/libcache.dylib 0x9a578000 - 0x9a58efff /usr/lib/system/libxpc.dylib 0x9a58f000 - 0x9a597fff /usr/lib/system/libcopyfile.dylib 0x9a695000 - 0x9a696fff /usr/lib/system/libquarantine.dylib 0x9b698000 - 0x9b698fff /usr/lib/system/libdnsinfo.dylib 0x9b715000 - 0x9b758fff /usr/lib/system/libcommonCrypto.dylib 0x9b928000 - 0x9b92bfff /usr/lib/system/libcompiler_rt.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=96322, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed Oct 16 18:14:43 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x92a03000 - 0x92a04fff /usr/lib/system/libsystem_blocks.dylib 0x92d55000 - 0x92d56fff /usr/lib/system/libunc.dylib 0x9378f000 - 0x9385afff /usr/lib/system/libsystem_c.dylib 0x938b4000 - 0x938b6fff /usr/lib/system/libdyld.dylib 0x9404f000 - 0x9407dfff /usr/lib/libSystem.B.dylib 0x94e48000 - 0x94e4ffff /usr/lib/system/libsystem_notify.dylib 0x94f41000 - 0x94f46fff /usr/lib/system/libmacho.dylib 0x954d5000 - 0x954ddfff /usr/lib/system/libunwind.dylib 0x96066000 - 0x96067fff /usr/lib/system/libremovefile.dylib 0x97092000 - 0x970a0fff /usr/lib/libz.1.dylib 0x975c4000 - 0x975f3fff /usr/lib/system/libsystem_info.dylib 0x977df000 - 0x977e3fff /usr/lib/system/libsystem_network.dylib 0x977e4000 - 0x977e7fff /usr/lib/system/libmathCommon.A.dylib 0x977e8000 - 0x97806fff /usr/lib/system/libsystem_kernel.dylib 0x9780c000 - 0x9780cfff /usr/lib/system/libkeymgr.dylib 0x9780d000 - 0x9781bfff /usr/lib/system/libdispatch.dylib 0x97b64000 - 0x97b65fff /usr/lib/system/libsystem_sandbox.dylib 0x98d04000 - 0x98d0cfff /usr/lib/system/liblaunch.dylib 0x99639000 - 0x99640fff /usr/lib/system/libsystem_dnssd.dylib 0x9a11b000 - 0x9a11ffff /usr/lib/system/libcache.dylib 0x9a578000 - 0x9a58efff /usr/lib/system/libxpc.dylib 0x9a58f000 - 0x9a597fff /usr/lib/system/libcopyfile.dylib 0x9a695000 - 0x9a696fff /usr/lib/system/libquarantine.dylib 0x9b698000 - 0x9b698fff /usr/lib/system/libdnsinfo.dylib 0x9b715000 - 0x9b758fff /usr/lib/system/libcommonCrypto.dylib 0x9b928000 - 0x9b92bfff /usr/lib/system/libcompiler_rt.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=96322, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed Oct 16 18:14:45 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x92a03000 - 0x92a04fff /usr/lib/system/libsystem_blocks.dylib 0x92d55000 - 0x92d56fff /usr/lib/system/libunc.dylib 0x9378f000 - 0x9385afff /usr/lib/system/libsystem_c.dylib 0x938b4000 - 0x938b6fff /usr/lib/system/libdyld.dylib 0x9404f000 - 0x9407dfff /usr/lib/libSystem.B.dylib 0x94e48000 - 0x94e4ffff /usr/lib/system/libsystem_notify.dylib 0x94f41000 - 0x94f46fff /usr/lib/system/libmacho.dylib 0x954d5000 - 0x954ddfff /usr/lib/system/libunwind.dylib 0x96066000 - 0x96067fff /usr/lib/system/libremovefile.dylib 0x97092000 - 0x970a0fff /usr/lib/libz.1.dylib 0x975c4000 - 0x975f3fff /usr/lib/system/libsystem_info.dylib 0x977df000 - 0x977e3fff /usr/lib/system/libsystem_network.dylib 0x977e4000 - 0x977e7fff /usr/lib/system/libmathCommon.A.dylib 0x977e8000 - 0x97806fff /usr/lib/system/libsystem_kernel.dylib 0x9780c000 - 0x9780cfff /usr/lib/system/libkeymgr.dylib 0x9780d000 - 0x9781bfff /usr/lib/system/libdispatch.dylib 0x97b64000 - 0x97b65fff /usr/lib/system/libsystem_sandbox.dylib 0x98d04000 - 0x98d0cfff /usr/lib/system/liblaunch.dylib 0x99639000 - 0x99640fff /usr/lib/system/libsystem_dnssd.dylib 0x9a11b000 - 0x9a11ffff /usr/lib/system/libcache.dylib 0x9a578000 - 0x9a58efff /usr/lib/system/libxpc.dylib 0x9a58f000 - 0x9a597fff /usr/lib/system/libcopyfile.dylib 0x9a695000 - 0x9a696fff /usr/lib/system/libquarantine.dylib 0x9b698000 - 0x9b698fff /usr/lib/system/libdnsinfo.dylib 0x9b715000 - 0x9b758fff /usr/lib/system/libcommonCrypto.dylib 0x9b928000 - 0x9b92bfff /usr/lib/system/libcompiler_rt.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=96322, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed Oct 16 18:14:48 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x92a03000 - 0x92a04fff /usr/lib/system/libsystem_blocks.dylib 0x92d55000 - 0x92d56fff /usr/lib/system/libunc.dylib 0x9378f000 - 0x9385afff /usr/lib/system/libsystem_c.dylib 0x938b4000 - 0x938b6fff /usr/lib/system/libdyld.dylib 0x9404f000 - 0x9407dfff /usr/lib/libSystem.B.dylib 0x94e48000 - 0x94e4ffff /usr/lib/system/libsystem_notify.dylib 0x94f41000 - 0x94f46fff /usr/lib/system/libmacho.dylib 0x954d5000 - 0x954ddfff /usr/lib/system/libunwind.dylib 0x96066000 - 0x96067fff /usr/lib/system/libremovefile.dylib 0x97092000 - 0x970a0fff /usr/lib/libz.1.dylib 0x975c4000 - 0x975f3fff /usr/lib/system/libsystem_info.dylib 0x977df000 - 0x977e3fff /usr/lib/system/libsystem_network.dylib 0x977e4000 - 0x977e7fff /usr/lib/system/libmathCommon.A.dylib 0x977e8000 - 0x97806fff /usr/lib/system/libsystem_kernel.dylib 0x9780c000 - 0x9780cfff /usr/lib/system/libkeymgr.dylib 0x9780d000 - 0x9781bfff /usr/lib/system/libdispatch.dylib 0x97b64000 - 0x97b65fff /usr/lib/system/libsystem_sandbox.dylib 0x98d04000 - 0x98d0cfff /usr/lib/system/liblaunch.dylib 0x99639000 - 0x99640fff /usr/lib/system/libsystem_dnssd.dylib 0x9a11b000 - 0x9a11ffff /usr/lib/system/libcache.dylib 0x9a578000 - 0x9a58efff /usr/lib/system/libxpc.dylib 0x9a58f000 - 0x9a597fff /usr/lib/system/libcopyfile.dylib 0x9a695000 - 0x9a696fff /usr/lib/system/libquarantine.dylib 0x9b698000 - 0x9b698fff /usr/lib/system/libdnsinfo.dylib 0x9b715000 - 0x9b758fff /usr/lib/system/libcommonCrypto.dylib 0x9b928000 - 0x9b92bfff /usr/lib/system/libcompiler_rt.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=96322, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed Oct 16 18:14:51 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x92a03000 - 0x92a04fff /usr/lib/system/libsystem_blocks.dylib 0x92d55000 - 0x92d56fff /usr/lib/system/libunc.dylib 0x9378f000 - 0x9385afff /usr/lib/system/libsystem_c.dylib 0x938b4000 - 0x938b6fff /usr/lib/system/libdyld.dylib 0x9404f000 - 0x9407dfff /usr/lib/libSystem.B.dylib 0x94e48000 - 0x94e4ffff /usr/lib/system/libsystem_notify.dylib 0x94f41000 - 0x94f46fff /usr/lib/system/libmacho.dylib 0x954d5000 - 0x954ddfff /usr/lib/system/libunwind.dylib 0x96066000 - 0x96067fff /usr/lib/system/libremovefile.dylib 0x97092000 - 0x970a0fff /usr/lib/libz.1.dylib 0x975c4000 - 0x975f3fff /usr/lib/system/libsystem_info.dylib 0x977df000 - 0x977e3fff /usr/lib/system/libsystem_network.dylib 0x977e4000 - 0x977e7fff /usr/lib/system/libmathCommon.A.dylib 0x977e8000 - 0x97806fff /usr/lib/system/libsystem_kernel.dylib 0x9780c000 - 0x9780cfff /usr/lib/system/libkeymgr.dylib 0x9780d000 - 0x9781bfff /usr/lib/system/libdispatch.dylib 0x97b64000 - 0x97b65fff /usr/lib/system/libsystem_sandbox.dylib 0x98d04000 - 0x98d0cfff /usr/lib/system/liblaunch.dylib 0x99639000 - 0x99640fff /usr/lib/system/libsystem_dnssd.dylib 0x9a11b000 - 0x9a11ffff /usr/lib/system/libcache.dylib 0x9a578000 - 0x9a58efff /usr/lib/system/libxpc.dylib 0x9a58f000 - 0x9a597fff /usr/lib/system/libcopyfile.dylib 0x9a695000 - 0x9a696fff /usr/lib/system/libquarantine.dylib 0x9b698000 - 0x9b698fff /usr/lib/system/libdnsinfo.dylib 0x9b715000 - 0x9b758fff /usr/lib/system/libcommonCrypto.dylib 0x9b928000 - 0x9b92bfff /usr/lib/system/libcompiler_rt.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=96322, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Oct 2013 05:33:39	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	285,120	494,853	1.7356
15 Oct 2013 05:39:07	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	259,200	448,990	1.7322
10 Oct 2013 08:20:48	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	233,280	403,689	1.7305
09 Oct 2013 08:17:14	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	207,360	358,594	1.7293
08 Oct 2013 08:54:09	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	181,440	312,765	1.7238
07 Oct 2013 09:55:56	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	155,520	267,725	1.7215
06 Oct 2013 12:26:25	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	129,600	223,131	1.7217
05 Oct 2013 15:44:24	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	103,680	178,918	1.7257
04 Oct 2013 18:37:17	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	77,760	135,699	1.7451
03 Oct 2013 16:21:05	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	51,840	90,363	1.7431
02 Oct 2013 15:30:31	1197259	16051278	hadcm3n_o1nw_2020_40_008373288_4	25,920	44,784	1.7278