climateprediction.net home page
Task 15868321

Task 15868321

Name hadcm3n_o3sj_2140_40_008270375_4
Workunit 8425499
Created 26 Jun 2013, 22:36:33 UTC
Sent 26 Jun 2013, 23:06:43 UTC
Report deadline 26 Sep 2013, 6:33:54 UTC
Received 25 Jul 2013, 3:54:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1247118
Run time 5 days 2 hours 3 min 38 sec
CPU time 4 days 10 hours 19 min 25 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.95 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
onitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:21:24 (8626): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/1/../../switcher/switcher) is setuid or setgid
SIGABRT: abort called
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.8.4 build 12E55
Wed Jul 24 13:31:11 2013

dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
Thread 0 Crashed:

Thread 1:

dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x901a1000 - 0x901b3fff /usr/lib/system/libdispatch.dylib
0x901b4000 - 0x90271fff /usr/lib/system/libsystem_c.dylib
0x91779000 - 0x9177afff /usr/lib/system/libquarantine.dylib
0x919f8000 - 0x919f9fff /usr/lib/system/libdnsinfo.dylib
0x91eb4000 - 0x91eb5fff /usr/lib/system/libunc.dylib
0x926bf000 - 0x926c0fff /usr/lib/system/libremovefile.dylib
0x92772000 - 0x92776fff /usr/lib/system/libmacho.dylib
0x92943000 - 0x9294afff /usr/lib/system/libunwind.dylib
0x93600000 - 0x93600fff /usr/lib/system/libkeymgr.dylib
0x93601000 - 0x93601fff /usr/lib/libSystem.B.dylib
0x93bed000 - 0x93beffff /usr/lib/system/libdyld.dylib
0x94673000 - 0x9467afff /usr/lib/system/liblaunch.dylib
0x951dd000 - 0x951ebfff /usr/lib/system/libsystem_network.dylib
0x96a5c000 - 0x96a5ffff /usr/lib/system/libcompiler_rt.dylib
0x96d18000 - 0x96d20fff /usr/lib/system/libcopyfile.dylib
0x96d21000 - 0x96d3efff /usr/lib/system/libxpc.dylib
0x97624000 - 0x9763efff /usr/lib/system/libsystem_kernel.dylib
0x9763f000 - 0x9764afff /usr/lib/system/libcommonCrypto.dylib
0x97751000 - 0x9779dfff /usr/lib/system/libcorecrypto.dylib
0x98737000 - 0x98745fff /usr/lib/libz.1.dylib
0x98854000 - 0x9885efff /usr/lib/system/libsystem_notify.dylib
0x98dc8000 - 0x98dcffff /usr/lib/system/libsystem_dnssd.dylib
0x99810000 - 0x99814fff /usr/lib/system/libcache.dylib
0x99826000 - 0x99826fff /usr/lib/system/libsystem_blocks.dylib
0x99b13000 - 0x99b3ffff /usr/lib/system/libsystem_info.dylib
0x99cfa000 - 0x99cfbfff /usr/lib/system/libsystem_sandbox.dylib
0x9a50b000 - 0x9a538fff /usr/lib/system/libsystem_m.dylib


Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=52093, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.8.4 build 12E55
Wed Jul 24 13:31:15 2013

dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section
Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x901a1000 - 0x901b3fff /usr/lib/system/libdispatch.dylib
0x901b4000 - 0x90271fff /usr/lib/system/libsystem_c.dylib
0x91779000 - 0x9177afff /usr/lib/system/libquarantine.dylib
0x919f8000 - 0x919f9fff /usr/lib/system/libdnsinfo.dylib
0x91eb4000 - 0x91eb5fff /usr/lib/system/libunc.dylib
0x926bf000 - 0x926c0fff /usr/lib/system/libremovefile.dylib
0x92772000 - 0x92776fff /usr/lib/system/libmacho.dylib
0x92943000 - 0x9294afff /usr/lib/system/libunwind.dylib
0x93600000 - 0x93600fff /usr/lib/system/libkeymgr.dylib
0x93601000 - 0x93601fff /usr/lib/libSystem.B.dylib
0x93bed000 - 0x93beffff /usr/lib/system/libdyld.dylib
0x94673000 - 0x9467afff /usr/lib/system/liblaunch.dylib
0x951dd000 - 0x951ebfff /usr/lib/system/libsystem_network.dylib
0x96a5c000 - 0x96a5ffff /usr/lib/system/libcompiler_rt.dylib
0x96d18000 - 0x96d20fff /usr/lib/system/libcopyfile.dylib
0x96d21000 - 0x96d3efff /usr/lib/system/libxpc.dylib
0x97624000 - 0x9763efff /usr/lib/system/libsystem_kernel.dylib
0x9763f000 - 0x9764afff /usr/lib/system/libcommonCrypto.dylib
0x97751000 - 0x9779dfff /usr/lib/system/libcorecrypto.dylib
0x98737000 - 0x98745fff /usr/lib/libz.1.dylib
0x98854000 - 0x9885efff /usr/lib/system/libsystem_notify.dylib
0x98dc8000 - 0x98dcffff /usr/lib/system/libsystem_dnssd.dylib
0x99810000 - 0x99814fff /usr/lib/system/libcache.dylib
0x99826000 - 0x99826fff /usr/lib/system/libsystem_blocks.dylib
0x99b13000 - 0x99b3ffff /usr/lib/system/libsystem_info.dylib
0x99cfa000 - 0x99cfbfff /usr/lib/system/libsystem_sandbox.dylib
0x9a50b000 - 0x9a538fff /usr/lib/system/libsystem_m.dylib


Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=52093, iMonCtr=1
Model crash detected, will try to restart...
13:31:50 (52093): No heartbeat from core client for 30 sec - exiting
13:31:51 (52093): No heartbeat from core client for 30 sec - exiting
13:31:52 (52093): No heartbeat from core client for 30 sec - exiting
13:31:53 (52093): No heartbeat from core client for 30 sec - exiting
13:31:54 (52093): No heartbeat from core client for 30 sec - exiting
13:31:55 (52093): No heartbeat from core client for 30 sec - exiting
13:31:56 (52093): No heartbeat from core client for 30 sec - exiting
13:31:57 (52093): No heartbeat from core client for 30 sec - exiting
13:31:58 (52093): No heartbeat from core client for 30 sec - exiting
13:31:59 (52093): No heartbeat from core client for 30 sec - exiting
13:32:00 (52093): No heartbeat from core client for 30 sec - exiting
13:32:01 (52093): No heartbeat from core client for 30 sec - exiting
13:32:02 (52093): No heartbeat from core client for 30 sec - exiting
13:32:03 (52093): No heartbeat from core client for 30 sec - exiting
13:32:05 (52093): No heartbeat from core client for 30 sec - exiting
13:32:06 (52093): No heartbeat from core client for 30 sec - exiting
13:32:07 (52093): No heartbeat from core client for 30 sec - exiting
13:32:08 (52093): No heartbeat from core client for 30 sec - exiting
13:32:09 (52093): No heartbeat from core client for 30 sec - exiting
13:32:10 (52093): No heartbeat from core client for 30 sec - exiting
13:32:11 (52093): No heartbeat from core client for 30 sec - exiting
13:32:12 (52093): No heartbeat from core client for 30 sec - exiting
13:32:13 (52093): No heartbeat from core client for 30 sec - exiting
13:32:14 (52093): No heartbeat from core client for 30 sec - exiting
13:32:15 (52093): No heartbeat from core client for 30 sec - exiting
13:32:16 (52093): No heartbeat from core client for 30 sec - exiting
13:32:17 (52093): No heartbeat from core client for 30 sec - exiting
13:32:18 (52093): No heartbeat from core client for 30 sec - exiting
13:32:19 (52093): No heartbeat from core client for 30 sec - exiting
13:32:20 (52093): No heartbeat from core client for 30 sec - exiting
13:32:21 (52093): No heartbeat from core client for 30 sec - exiting
13:32:22 (52093): No heartbeat from core client for 30 sec - exiting
13:32:23 (52093): No heartbeat from core client for 30 sec - exiting
13:32:24 (52093): No heartbeat from core client for 30 sec - exiting
13:32:25 (52093): No heartbeat from core client for 30 sec - exiting
13:32:26 (52093): No heartbeat from core client for 30 sec - exiting
13:32:27 (52093): No heartbeat from core client for 30 sec - exiting
13:32:28 (52093): No heartbeat from core client for 30 sec - exiting
13:32:29 (52093): No heartbeat from core client for 30 sec - exiting
13:32:30 (52093): No heartbeat from core client for 30 sec - exiting
13:32:31 (52093): No heartbeat from core client for 30 sec - exiting
13:32:32 (52093): No heartbeat from core client for 30 sec - exiting
13:32:33 (52093): No heartbeat from core client for 30 sec - exiting
13:32:34 (52093): No heartbeat from core client for 30 sec - exiting
13:32:35 (52093): No heartbeat from core client for 30 sec - exiting
13:32:36 (52093): No heartbeat from core client for 30 sec - exiting
13:32:37 (52093): No heartbeat from core client for 30 sec - exiting
13:32:38 (52093): No heartbeat from core client for 30 sec - exiting
13:32:39 (52093): No heartbeat from core client for 30 sec - exiting
13:32:40 (52093): No heartbeat from core client for 30 sec - exiting
13:32:41 (52093): No heartbeat from core client for 30 sec - exiting
13:32:42 (52093): No heartbeat from core client for 30 sec - exiting
13:32:43 (52093): No heartbeat from core client for 30 sec - exiting
13:32:44 (52093): No heartbeat from core client for 30 sec - exiting
13:32:45 (52093): No heartbeat from core client for 30 sec - exiting
13:32:46 (52093): No heartbeat from core client for 30 sec - exiting
13:32:47 (52093): No heartbeat from core client for 30 sec - exiting
13:32:48 (52093): No heartbeat from core client for 30 sec - exiting
13:32:49 (52093): No heartbeat from core client for 30 sec - exiting
13:32:50 (52093): No heartbeat from core client for 30 sec - exiting
13:32:51 (52093): No heartbeat from core client for 30 sec - exiting
13:32:52 (52093): No heartbeat from core client for 30 sec - exiting
13:32:53 (52093): No heartbeat from core client for 30 sec - exiting
13:32:54 (52093): No heartbeat from core client for 30 sec - exiting
13:32:55 (52093): No heartbeat from core client for 30 sec - exiting
13:32:56 (52093): No heartbeat from core client for 30 sec - exiting
13:32:57 (52093): No heartbeat from core client for 30 sec - exiting
13:32:58 (52093): No heartbeat from core client for 30 sec - exiting
13:32:59 (52093): No heartbeat from core client for 30 sec - exiting
13:33:00 (52093): No heartbeat from core client for 30 sec - exiting
13:33:01 (52093): No heartbeat from core client for 30 sec - exiting
13:33:02 (52093): No heartbeat from core client for 30 sec - exiting
13:33:03 (52093): No heartbeat from core client for 30 sec - exiting
13:33:04 (52093): No heartbeat from core client for 30 sec - exiting
13:33:05 (52093): No heartbeat from core client for 30 sec - exiting
13:33:06 (52093): No heartbeat from core client for 30 sec - exiting
13:33:07 (52093): No heartbeat from core client for 30 sec - exiting
13:33:08 (52093): No heartbeat from core client for 30 sec - exiting
13:33:09 (52093): No heartbeat from core client for 30 sec - exiting
13:33:10 (52093): No heartbeat from core client for 30 sec - exiting
13:33:11 (52093): No heartbeat from core client for 30 sec - exiting
13:33:12 (52093): No heartbeat from core client for 30 sec - exiting
13:33:13 (52093): No heartbeat from core client for 30 sec - exiting
13:33:14 (52093): No heartbeat from core client for 30 sec - exiting
13:33:15 (52093): No heartbeat from core client for 30 sec - exiting
13:33:16 (52093): No heartbeat from core client for 30 sec - exiting
13:33:17 (52093): No heartbeat from core client for 30 sec - exiting
13:33:18 (52093): No heartbeat from core client for 30 sec - exiting
13:33:19 (52093): No heartbeat from core client for 30 sec - exiting
13:33:20 (52093): No heartbeat from core client for 30 sec - exiting
13:33:21 (52093): No heartbeat from core client for 30 sec - exiting
13:33:22 (52093): No heartbeat from core client for 30 sec - exiting
13:33:23 (52093): No heartbeat from core client for 30 sec - exiting
13:33:24 (52093): No heartbeat from core client for 30 sec - exiting
13:33:25 (52093): No heartbeat from core client for 30 sec - exiting
13:33:26 (52093): No heartbeat from core client for 30 sec - exiting
13:33:27 (52093): No heartbeat from core client for 30 sec - exiting
13:33:28 (52093): No heartbeat from core client for 30 sec - exiting
13:33:29 (52093): No heartbeat from core client for 30 sec - exiting
13:33:30 (52093): No heartbeat from core client for 30 sec - exiting
13:33:31 (52093): No heartbeat from core client for 30 sec - exiting
13:33:32 (52093): No heartbeat from core client for 30 sec - exiting
13:33:33 (52093): No heartbeat from core client for 30 sec - exiting
13:33:34 (52093): No heartbeat from core client for 30 sec - exiting
13:33:35 (52093): No heartbeat from core client for 30 sec - exiting
13:33:36 (52093): No heartbeat from core client for 30 sec - exiting
13:33:37 (52093): No heartbeat from core client for 30 sec - exiting
13:33:38 (52093): No heartbeat from core client for 30 sec - exiting
13:33:39 (52093): No heartbeat from core client for 30 sec - exiting
13:33:40 (52093): No heartbeat from core client for 30 sec - exiting
13:33:41 (52093): No heartbeat from core client for 30 sec - exiting
13:33:43 (52093): No heartbeat from core client for 30 sec - exiting
13:33:44 (52093): No heartbeat from core client for 30 sec - exiting
13:33:45 (52093): No heartbeat from core client for 30 sec - exiting
13:33:46 (52093): No heartbeat from core client for 30 sec - exiting
13:33:47 (52093): No heartbeat from core client for 30 sec - exiting
13:33:48 (52093): No heartbeat from core client for 30 sec - exiting
13:33:49 (52093): No heartbeat from core client for 30 sec - exiting
13:33:50 (52093): No heartbeat from core client for 30 sec - exiting
13:33:51 (52093): No heartbeat from core client for 30 sec - exiting
13:33:52 (52093): No heartbeat from core client for 30 sec - exiting
13:33:53 (52093): No heartbeat from core client for 30 sec - exiting
13:33:54 (52093): No heartbeat from core client for 30 sec - exiting
13:33:55 (52093): No heartbeat from core client for 30 sec - exiting
13:33:56 (52093): No heartbeat from core client for 30 sec - exiting
13:33:57 (52093): No heartbeat from core client for 30 sec - exiting
13:33:58 (52093): No heartbeat from core client for 30 sec - exiting
13:33:59 (52093): No heartbeat from core client for 30 sec - exiting
13:34:00 (52093): No heartbeat from core client for 30 sec - exiting
13:34:01 (52093): No heartbeat from core client for 30 sec - exiting
13:34:02 (52093): No heartbeat from core client for 30 sec - exiting
13:34:03 (52093): No heartbeat from core client for 30 sec - exiting
13:34:04 (52093): No heartbeat from core client for 30 sec - exiting
13:34:05 (52093): No heartbeat from core client for 30 sec - exiting
13:34:06 (52093): No heartbeat from core client for 30 sec - exiting
13:34:07 (52093): No heartbeat from core client for 30 sec - exiting
13:34:08 (52093): No heartbeat from core client for 30 sec - exiting
13:34:09 (52093): No heartbeat from core client for 30 sec - exiting
13:34:10 (52093): No heartbeat from core client for 30 sec - exiting
13:34:11 (52093): No heartbeat from core client for 30 sec - exiting
13:34:12 (52093): No heartbeat from core client for 30 sec - exiting
13:34:13 (52093): No heartbeat from core client for 30 sec - exiting
13:34:14 (52093): No heartbeat from core client for 30 sec - exiting
13:34:15 (52093): No heartbeat from core client for 30 sec - exiting
13:34:16 (52093): No heartbeat from core client for 30 sec - exiting
13:34:17 (52093): No heartbeat from core client for 30 sec - exiting
13:34:18 (52093): No heartbeat from core client for 30 sec - exiting
13:34:19 (52093): No heartbeat from core client for 30 sec - exiting
13:34:20 (52093): No heartbeat from core client for 30 sec - exiting
13:34:21 (52093): No heartbeat from core client for 30 sec - exiting
13:34:22 (52093): No heartbeat from core client for 30 sec - exiting
13:34:23 (52093): No heartbeat from core client for 30 sec - exiting
13:34:24 (52093): No heartbeat from core client for 30 sec - exiting
13:34:25 (52093): No heartbeat from core client for 30 sec - exiting
13:34:26 (52093): No heartbeat from core client for 30 sec - exiting
13:34:27 (52093): No heartbeat from core client for 30 sec - exiting
13:34:28 (52093): No heartbeat from core client for 30 sec - exiting
13:34:29 (52093): No heartbeat from core client for 30 sec - exiting
13:34:30 (52093): No heartbeat from core client for 30 sec - exiting
13:34:31 (52093): No heartbeat from core client for 30 sec - exiting
13:34:32 (52093): No heartbeat from core client for 30 sec - exiting
13:34:33 (52093): No heartbeat from core client for 30 sec - exiting
13:34:34 (52093): No heartbeat from core client for 30 sec - exiting
13:34:35 (52093): No heartbeat from core client for 30 sec - exiting
13:34:36 (52093): No heartbeat from core client for 30 sec - exiting
13:34:37 (52093): No heartbeat from core client for 30 sec - exiting
13:34:38 (52093): No heartbeat from core client for 30 sec - exiting
13:34:39 (52093): No heartbeat from core client for 30 sec - exiting
13:34:40 (52093): No heartbeat from core client for 30 sec - exiting
13:34:41 (52093): No heartbeat from core client for 30 sec - exiting
13:34:42 (52093): No heartbeat from core client for 30 sec - exiting
13:34:43 (52093): No heartbeat from core client for 30 sec - exiting
13:34:44 (52093): No heartbeat from core client for 30 sec - exiting
13:34:45 (52093): No heartbeat from core client for 30 sec - exiting
13:34:46 (52093): No heartbeat from core client for 30 sec - exiting
13:34:47 (52093): No heartbeat from core client for 30 sec - exiting
13:34:48 (52093): No heartbeat from core client for 30 sec - exiting
13:34:49 (52093): No heartbeat from core client for 30 sec - exiting
13:34:50 (52093): No heartbeat from core client for 30 sec - exiting
13:34:51 (52093): No heartbeat from core client for 30 sec - exiting
13:34:52 (52093): No heartbeat from core client for 30 sec - exiting
13:34:53 (52093): No heartbeat from core client for 30 sec - exiting
13:34:54 (52093): No heartbeat from core client for 30 sec - exiting
13:34:55 (52093): No heartbeat from core client for 30 sec - exiting
13:34:56 (52093): No heartbeat from core client for 30 sec - exiting
13:34:57 (52093): No heartbeat from core client for 30 sec - exiting
13:34:58 (52093): No heartbeat from core client for 30 sec - exiting
13:34:59 (52093): No heartbeat from core client for 30 sec - exiting
13:35:00 (52093): No heartbeat from core client for 30 sec - exiting
13:35:01 (52093): No heartbeat from core client for 30 sec - exiting
13:35:02 (52093): No heartbeat from core client for 30 sec - exiting
13:35:03 (52093): No heartbeat from core client for 30 sec - exiting
13:35:04 (52093): No heartbeat from core client for 30 sec - exiting
13:35:05 (52093): No heartbeat from core client for 30 sec - exiting
13:35:06 (52093): No heartbeat from core client for 30 sec - exiting
13:35:07 (52093): No heartbeat from core client for 30 sec - exiting
13:35:08 (52093): No heartbeat from core client for 30 sec - exiting
13:35:09 (52093): No heartbeat from core client for 30 sec - exiting
13:35:10 (52093): No heartbeat from core client for 30 sec - exiting
13:35:11 (52093): No heartbeat from core client for 30 sec - exiting
13:35:12 (52093): No heartbeat from core client for 30 sec - exiting
13:35:13 (52093): No heartbeat from core client for 30 sec - exiting
13:35:14 (52093): No heartbeat from core client for 30 sec - exiting
13:35:15 (52093): No heartbeat from core client for 30 sec - exiting
13:35:16 (52093): No heartbeat from core client for 30 sec - exiting
13:35:17 (52093): No heartbeat from core client for 30 sec - exiting
13:35:18 (52093): No heartbeat from core client for 30 sec - exiting
13:35:19 (52093): No heartbeat from core client for 30 sec - exiting
13:35:21 (52093): No heartbeat from core client for 30 sec - exiting
13:35:22 (52093): No heartbeat from core client for 30 sec - exiting
13:35:23 (52093): No heartbeat from core client for 30 sec - exiting
13:35:24 (52093): No heartbeat from core client for 30 sec - exiting
13:35:25 (52093): No heartbeat from core client for 30 sec - exiting
13:35:26 (52093): No heartbeat from core client for 30 sec - exiting
13:35:27 (52093): No heartbeat from core client for 30 sec - exiting
13:35:28 (52093): No heartbeat from core client for 30 sec - exiting
13:35:29 (52093): No heartbeat from core client for 30 sec - exiting
13:35:30 (52093): No heartbeat from core client for 30 sec - exiting
13:35:31 (52093): No heartbeat from core client for 30 sec - exiting
13:35:32 (52093): No heartbeat from core client for 30 sec - exiting
13:35:33 (52093): No heartbeat from core client for 30 sec - exiting
13:35:34 (52093): No heartbeat from core client for 30 sec - exiting
13:35:35 (52093): No heartbeat from core client for 30 sec - exiting
13:35:36 (52093): No heartbeat from core client for 30 sec - exiting
13:35:37 (52093): No heartbeat from core client for 30 sec - exiting
13:35:38 (52093): No heartbeat from core client for 30 sec - exiting
13:35:39 (52093): No heartbeat from core client for 30 sec - exiting
13:35:40 (52093): No heartbeat from core client for 30 sec - exiting
13:35:41 (52093): No heartbeat from core client for 30 sec - exiting
13:35:42 (52093): No heartbeat from core client for 30 sec - exiting
13:35:43 (52093): No heartbeat from core client for 30 sec - exiting
13:35:44 (52093): No heartbeat from core client for 30 sec - exiting
13:35:45 (52093): No heartbeat from core client for 30 sec - exiting
13:35:46 (52093): No heartbeat from core client for 30 sec - exiting
13:35:47 (52093): No heartbeat from core client for 30 sec - exiting
13:35:48 (52093): No heartbeat from core client for 30 sec - exiting
13:35:49 (52093): No heartbeat from core client for 30 sec - exiting
13:35:50 (52093): No heartbeat from core client for 30 sec - exiting
13:35:51 (52093): No heartbeat from core client for 30 sec - exiting
13:35:52 (52093): No heartbeat from core client for 30 sec - exiting
13:35:53 (52093): No heartbeat from core client for 30 sec - exiting
13:35:54 (52093): No heartbeat from core client for 30 sec - exiting
13:35:55 (52093): No heartbeat from core client for 30 sec - exiting
13:35:56 (52093): No heartbeat from core client for 30 sec - exiting
13:35:57 (52093): No heartbeat from core client for 30 sec - exiting
13:35:58 (52093): No heartbeat from core client for 30 sec - exiting
13:35:59 (52093): No heartbeat from core client for 30 sec - exiting
13:36:00 (52093): No heartbeat from core client for 30 sec - exiting
13:36:01 (52093): No heartbeat from core client for 30 sec - exiting
13:36:02 (52093): No heartbeat from core client for 30 sec - exiting
13:36:03 (52093): No heartbeat from core client for 30 sec - exiting
13:36:04 (52093): No heartbeat from core client for 30 sec - exiting
13:36:05 (52093): No heartbeat from core client for 30 sec - exiting
13:36:06 (52093): No heartbeat from core client for 30 sec - exiting
13:36:07 (52093): No heartbeat from core client for 30 sec - exiting
13:36:08 (52093): No heartbeat from core client for 30 sec - exiting
13:36:09 (52093): No heartbeat from core client for 30 sec - exiting
13:36:10 (52093): No heartbeat from core client for 30 sec - exiting
13:36:11 (52093): No heartbeat from core client for 30 sec - exiting
13:36:12 (52093): No heartbeat from core client for 30 sec - exiting
13:36:13 (52093): No heartbeat from core client for 30 sec - exiting
13:36:14 (52093): No heartbeat from core client for 30 sec - exiting
13:36:15 (52093): No heartbeat from core client for 30 sec - exiting
13:36:16 (52093): No heartbeat from core client for 30 sec - exiting
13:36:17 (52093): No heartbeat from core client for 30 sec - exiting
13:36:18 (52093): No heartbeat from core client for 30 sec - exiting
13:36:19 (52093): No heartbeat from core client for 30 sec - exiting
13:36:20 (52093): No heartbeat from core client for 30 sec - exiting
13:36:21 (52093): No heartbeat from core client for 30 sec - exiting
13:36:22 (52093): No heartbeat from core client for 30 sec - exiting
13:36:23 (52093): No heartbeat from core client for 30 sec - exiting
13:36:24 (52093): No heartbeat from core client for 30 sec - exiting
13:36:25 (52093): No heartbeat from core client for 30 sec - exiting
13:36:26 (52093): No heartbeat from core client for 30 sec - exiting
13:36:27 (52093): No heartbeat from core client for 30 sec - exiting
13:36:28 (52093): No heartbeat from core client for 30 sec - exiting
13:36:29 (52093): No heartbeat from core client for 30 sec - exiting
13:36:30 (52093): No heartbeat from core client for 30 sec - exiting
13:36:31 (52093): No heartbeat from core client for 30 sec - exiting
13:36:32 (52093): No heartbeat from core client for 30 sec - exiting
13:36:33 (52093): No heartbeat from core client for 30 sec - exiting
13:36:34 (52093): No heartbeat from core client for 30 sec - exiting
13:36:35 (52093): No heartbeat from core client for 30 sec - exiting
13:36:36 (52093): No heartbeat from core client for 30 sec - exiting
13:36:37 (52093): No heartbeat from core client for 30 sec - exiting
13:36:38 (52093): No heartbeat from core client for 30 sec - exiting
13:36:39 (52093): No heartbeat from core client for 30 sec - exiting
13:36:40 (52093): No heartbeat from core client for 30 sec - exiting
13:36:41 (52093): No heartbeat from core client for 30 sec - exiting
13:36:42 (52093): No heartbeat from core client for 30 sec - exiting
13:36:43 (52093): No heartbeat from core client for 30 sec - exiting
13:36:44 (52093): No heartbeat from core client for 30 sec - exiting
13:36:45 (52093): No heartbeat from core client for 30 sec - exiting
13:36:46 (52093): No heartbeat from core client for 30 sec - exiting
13:36:47 (52093): No heartbeat from core client for 30 sec - exiting
13:36:48 (52093): No heartbeat from core client for 30 sec - exiting
13:36:49 (52093): No heartbeat from core client for 30 sec - exiting
13:36:50 (52093): No heartbeat from core client for 30 sec - exiting
13:36:51 (52093): No heartbeat from core client for 30 sec - exiting
13:36:52 (52093): No heartbeat from core client for 30 sec - exiting
13:36:53 (52093): No heartbeat from core client for 30 sec - exiting
13:36:54 (52093): No heartbeat from core client for 30 sec - exiting
13:36:55 (52093): No heartbeat from core client for 30 sec - exiting
13:36:56 (52093): No heartbeat from core client for 30 sec - exiting
13:36:57 (52093): No heartbeat from core client for 30 sec - exiting
13:36:58 (52093): No heartbeat from core client for 30 sec - exiting
13:36:59 (52093): No heartbeat from core client for 30 sec - exiting
13:37:01 (52093): No heartbeat from core client for 30 sec - exiting
13:37:02 (52093): No heartbeat from core client for 30 sec - exiting
13:37:03 (52093): No heartbeat from core client for 30 sec - exiting
13:37:04 (52093): No heartbeat from core client for 30 sec - exiting
13:37:05 (52093): No heartbeat from core client for 30 sec - exiting
13:37:06 (52093): No heartbeat from core client for 30 sec - exiting
13:37:07 (52093): No heartbeat from core client for 30 sec - exiting
13:37:08 (52093): No heartbeat from core client for 30 sec - exiting
13:37:09 (52093): No heartbeat from core client for 30 sec - exiting
13:37:10 (52093): No heartbeat from core client for 30 sec - exiting
13:37:11 (52093): No heartbeat from core client for 30 sec - exiting
13:37:12 (52093): No heartbeat from core client for 30 sec - exiting
13:37:13 (52093): No heartbeat from core client for 30 sec - exiting
13:37:14 (52093): No heartbeat from core client for 30 sec - exiting
13:37:15 (52093): No heartbeat from core client for 30 sec - exiting
13:37:16 (52093): No heartbeat from core client for 30 sec - exiting
13:37:17 (52093): No heartbeat from core client for 30 sec - exiting
13:37:18 (52093): No heartbeat from core client for 30 sec - exiting
13:37:19 (52093): No heartbeat from core client for 30 sec - exiting
13:37:20 (52093): No heartbeat from core client for 30 sec - exiting
13:37:21 (52093): No heartbeat from core client for 30 sec - exiting
13:37:22 (52093): No heartbeat from core client for 30 sec - exiting
13:37:23 (52093): No heartbeat from core client for 30 sec - exiting
13:37:24 (52093): No heartbeat from core client for 30 sec - exiting
13:37:25 (52093): No heartbeat from core client for 30 sec - exiting
13:37:26 (52093): No heartbeat from core client for 30 sec - exiting
13:37:27 (52093): No heartbeat from core client for 30 sec - exiting
13:37:28 (52093): No heartbeat from core client for 30 sec - exiting
13:37:29 (52093): No heartbeat from core client for 30 sec - exiting
13:37:30 (52093): No heartbeat from core client for 30 sec - exiting
13:37:31 (52093): No heartbeat from core client for 30 sec - exiting
13:37:32 (52093): No heartbeat from core client for 30 sec - exiting
13:37:33 (52093): No heartbeat from core client for 30 sec - exiting
13:37:34 (52093): No heartbeat from core client for 30 sec - exiting
13:37:35 (52093): No heartbeat from core client for 30 sec - exiting
13:37:36 (52093): No heartbeat from core client for 30 sec - exiting
13:37:37 (52093): No heartbeat from core client for 30 sec - exiting
13:37:38 (52093): No heartbeat from core client for 30 sec - exiting
13:37:39 (52093): No heartbeat from core client for 30 sec - exiting
13:37:40 (52093): No heartbeat from core client for 30 sec - exiting
13:37:41 (52093): No heartbeat from core client for 30 sec - exiting
13:37:42 (52093): No heartbeat from core client for 30 sec - exiting
13:37:43 (52093): No heartbeat from core client for 30 sec - exiting
13:37:44 (52093): No heartbeat from core client for 30 sec - exiting
13:37:45 (52093): No heartbeat from core client for 30 sec - exiting
13:37:46 (52093): No heartbeat from core client for 30 sec - exiting
13:37:47 (52093): No heartbeat from core client for 30 sec - exiting
13:37:48 (52093): No heartbeat from core client for 30 sec - exiting
13:37:49 (52093): No heartbeat from core client for 30 sec - exiting
13:37:50 (52093): No heartbeat from core client for 30 sec - exiting
13:37:51 (52093): No heartbeat from core client for 30 sec - exiting
13:37:52 (52093): No heartbeat from core client for 30 sec - exiting
13:37:53 (52093): No heartbeat from core client for 30 sec - exiting
13:37:54 (52093): No heartbeat from core client for 30 sec - exiting
13:37:55 (52093): No heartbeat from core client for 30 sec - exiting
13:37:56 (52093): No heartbeat from core client for 30 sec - exiting
13:37:57 (52093): No heartbeat from core client for 30 sec - exiting
13:37:58 (52093): No heartbeat from core client for 30 sec - exiting
13:37:59 (52093): No heartbeat from core client for 30 sec - exiting
13:38:00 (52093): No heartbeat from core client for 30 sec - exiting
13:38:01 (52093): No heartbeat from core client for 30 sec - exiting
13:38:02 (52093): No heartbeat from core client for 30 sec - exiting
13:38:03 (52093): No heartbeat from core client for 30 sec - exiting
13:38:04 (52093): No heartbeat from core client for 30 sec - exiting
13:38:05 (52093): No heartbeat from core client for 30 sec - exiting
13:38:06 (52093): No heartbeat from core client for 30 sec - exiting
13:38:07 (52093): No heartbeat from core client for 30 sec - exiting
13:38:08 (52093): No heartbeat from core client for 30 sec - exiting
13:38:09 (52093): No heartbeat from core client for 30 sec - exiting
13:38:10 (52093): No heartbeat from core client for 30 sec - exiting
13:38:11 (52093): No heartbeat from core client for 30 sec - exiting
13:38:12 (52093): No heartbeat from core client for 30 sec - exiting
13:38:13 (52093): No heartbeat from core client for 30 sec - exiting
13:38:14 (52093): No heartbeat from core client for 30 sec - exiting
13:38:15 (52093): No heartbeat from core client for 30 sec - exiting
13:38:16 (52093): No heartbeat from core client for 30 sec - exiting
13:38:17 (52093): No heartbeat from core client for 30 sec - exiting
13:38:18 (52093): No heartbeat from core client for 30 sec - exiting
13:38:19 (52093): No heartbeat from core client for 30 sec - exiting
13:38:20 (52093): No heartbeat from core client for 30 sec - exiting
13:38:21 (52093): No heartbeat from core client for 30 sec - exiting
13:38:22 (52093): No heartbeat from core client for 30 sec - exiting
13:38:23 (52093): No heartbeat from core client for 30 sec - exiting
13:38:24 (52093): No heartbeat from core client for 30 sec - exiting
13:38:25 (52093): No heartbeat from core client for 30 sec - exiting
13:38:26 (52093): No heartbeat from core client for 30 sec - exiting
13:38:27 (52093): No heartbeat from core client for 30 sec - exiting
13:38:28 (52093): No heartbeat from core client for 30 sec - exiting
13:38:29 (52093): No heartbeat from core client for 30 sec - exiting
13:38:30 (52093): No heartbeat from core client for 30 sec - exiting
13:38:31 (52093): No heartbeat from core client for 30 sec - exiting
13:38:32 (52093): No heartbeat from core client for 30 sec - exiting
13:38:33 (52093): No heartbeat from core client for 30 sec - exiting
13:38:34 (52093): No heartbeat from core client for 30 sec - exiting
13:38:35 (52093): No heartbeat from core client for 30 sec - exiting
13:38:36 (52093): No heartbeat from core client for 30 sec - exiting
13:38:37 (52093): No heartbeat from core client for 30 sec - exiting
13:38:38 (52093): No heartbeat from core client for 30 sec - exiting
13:38:39 (52093): No heartbeat from core client for 30 sec - exiting
13:38:40 (52093): No heartbeat from core client for 30 sec - exiting
13:38:41 (52093): No heartbeat from core client for 30 sec - exiting
13:38:42 (52093): No heartbeat from core client for 30 sec - exiting
13:38:43 (52093): No heartbeat from core client for 30 sec - exiting
13:38:44 (52093): No heartbeat from core client for 30 sec - exiting
13:38:46 (52093): No heartbeat from core client for 30 sec - exiting
13:38:47 (52093): No heartbeat from core client for 30 sec - exiting
13:38:48 (52093): No heartbeat from core client for 30 sec - exiting
13:38:49 (52093): No heartbeat from core client for 30 sec - exiting
13:38:50 (52093): No heartbeat from core client for 30 sec - exiting
13:38:51 (52093): No heartbeat from core client for 30 sec - exiting
13:38:52 (52093): No heartbeat from core client for 30 sec - exiting
13:38:53 (52093): No heartbeat from core client for 30 sec - exiting
13:38:54 (52093): No heartbeat from core client for 30 sec - exiting
13:38:55 (52093): No heartbeat from core client for 30 sec - exiting
13:38:56 (52093): No heartbeat from core client for 30 sec - exiting
13:38:57 (52093): No heartbeat from core client for 30 sec - exiting
13:38:58 (52093): No heartbeat from core client for 30 sec - exiting
13:38:59 (52093): No heartbeat from core client for 30 sec - exiting
13:39:00 (52093): No heartbeat from core client for 30 sec - exiting
13:39:01 (52093): No heartbeat from core client for 30 sec - exiting
13:39:02 (52093): No heartbeat from core client for 30 sec - exiting
13:39:03 (52093): No heartbeat from core client for 30 sec - exiting
13:39:04 (52093): No heartbeat from core client for 30 sec - exiting
13:39:05 (52093): No heartbeat from core client for 30 sec - exiting
13:39:06 (52093): No heartbeat from core client for 30 sec - exiting
13:39:07 (52093): No heartbeat from core client for 30 sec - exiting
13:39:08 (52093): No heartbeat from core client for 30 sec - exiting
13:39:09 (52093): No heartbeat from core client for 30 sec - exiting
13:39:10 (52093): No heartbeat from core client for 30 sec - exiting
13:39:11 (52093): No heartbeat from core client for 30 sec - exiting
13:39:12 (52093): No heartbeat from core client for 30 sec - exiting
13:39:13 (52093): No heartbeat from core client for 30 sec - exiting
13:39:14 (52093): No heartbeat from core client for 30 sec - exiting
13:39:15 (52093): No heartbeat from core client for 30 sec - exiting
13:39:16 (52093): No heartbeat from core client for 30 sec - exiting
13:39:17 (52093): No heartbeat from core client for 30 sec - exiting
13:39:18 (52093): No heartbeat from core client for 30 sec - exiting
13:39:19 (52093): No heartbeat from core client for 30 sec - exiting
13:39:20 (52093): No heartbeat from core client for 30 sec - exiting
13:39:21 (52093): No heartbeat from core client for 30 sec - exiting
13:39:22 (52093): No heartbeat from core client for 30 sec - exiting
13:39:23 (52093): No heartbeat from core client for 30 sec - exiting
13:39:24 (52093): No heartbeat from core client for 30 sec - exiting
13:39:25 (52093): No heartbeat from core client for 30 sec - exiting
13:39:26 (52093): No heartbeat from core client for 30 sec - exiting
13:39:27 (52093): No heartbeat from core client for 30 sec - exiting
13:39:28 (52093): No heartbeat from core client for 30 sec - exiting
13:39:29 (52093): No heartbeat from core client for 30 sec - exiting
13:39:30 (52093): No heartbeat from core client for 30 sec - exiting
13:39:31 (52093): No heartbeat from core client for 30 sec - exiting
13:39:32 (52093): No heartbeat from core client for 30 sec - exiting
13:39:33 (52093): No heartbeat from core client for 30 sec - exiting
13:39:34 (52093): No heartbeat from core client for 30 sec - exiting
13:39:35 (52093): No heartbeat from core client for 30 sec - exiting
13:39:36 (52093): No heartbeat from core client for 30 sec - exiting
13:39:37 (52093): No heartbeat from core client for 30 sec - exiting
13:39:38 (52093): No heartbeat from core client for 30 sec - exiting
13:39:39 (52093): No heartbeat from core client for 30 sec - exiting
13:39:40 (52093): No heartbeat from core client for 30 sec - exiting
13:39:41 (52093): No heartbeat from core client for 30 sec - exiting
13:39:42 (52093): No heartbeat from core client for 30 sec - exiting
13:39:43 (52093): No heartbeat from core client for 30 sec - exiting
13:39:44 (52093): No heartbeat from core client for 30 sec - exiting
13:39:45 (52093): No heartbeat from core client for 30 sec - exiting
13:39:46 (52093): No heartbeat from core client for 30 sec - exiting
13:39:47 (52093): No heartbeat from core client for 30 sec - exiting
13:39:48 (52093): No heartbeat from core client for 30 sec - exiting
13:39:49 (52093): No heartbeat from core client for 30 sec - exiting
13:39:50 (52093): No heartbeat from core client for 30 sec - exiting
13:39:51 (52093): No heartbeat from core client for 30 sec - exiting
13:39:52 (52093): No heartbeat from core client for 30 sec - exiting
13:39:53 (52093): No heartbeat from core client for 30 sec - exiting
13:39:54 (52093): No heartbeat from core client for 30 sec - exiting
13:39:55 (52093): No heartbeat from core client for 30 sec - exiting
13:39:56 (52093): No heartbeat from core client for 30 sec - exiting
13:39:57 (52093): No heartbeat from core client for 30 sec - exiting
13:39:58 (52093): No heartbeat from core client for 30 sec - exiting
13:39:59 (52093): No heartbeat from core client for 30 sec - exiting
13:40:00 (52093): No heartbeat from core client for 30 sec - exiting
13:40:01 (52093): No heartbeat from core client for 30 sec - exiting
13:40:02 (52093): No heartbeat from core client for 30 sec - exiting
13:40:03 (52093): No heartbeat from core client for 30 sec - exiting
13:40:04 (52093): No heartbeat from core client for 30 sec - exiting
13:40:05 (52093): No heartbeat from core client for 30 sec - exiting
13:40:06 (52093): No heartbeat from core client for 30 sec - exiting
13:40:07 (52093): No heartbeat from core client for 30 sec - exiting
13:40:08 (52093): No heartbeat from core client for 30 sec - exiting
13:40:09 (52093): No heartbeat from core client for 30 sec - exiting
13:40:10 (52093): No heartbeat from core client for 30 sec - exiting
13:40:11 (52093): No heartbeat from core client for 30 sec - exiting
13:40:12 (52093): No heartbeat from core client for 30 sec - exiting
13:40:13 (52093): No heartbeat from core client for 30 sec - exiting
13:40:14 (52093): No heartbeat from core client for 30 sec - exiting
13:40:15 (52093): No heartbeat from core client for 30 sec - exiting
13:40:16 (52093): No heartbeat from core client for 30 sec - exiting
13:40:17 (52093): No heartbeat from core client for 30 sec - exiting
13:40:18 (52093): No heartbeat from core client for 30 sec - exiting
13:40:19 (52093): No heartbeat from core client for 30 sec - exiting
13:40:20 (52093): No heartbeat from core client for 30 sec - exiting
13:40:21 (52093): No heartbeat from core client for 30 sec - exiting
13:40:22 (52093): No heartbeat from core client for 30 sec - exiting
13:40:23 (52093): No heartbeat from core client for 30 sec - exiting
13:40:24 (52093): No heartbeat from core client for 30 sec - exiting
13:40:26 (52093): No heartbeat from core client for 30 sec - exiting
13:40:27 (52093): No heartbeat from core client for 30 sec - exiting
13:40:28 (52093): No heartbeat from core client for 30 sec - exiting
13:40:29 (52093): No heartbeat from core client for 30 sec - exiting
13:40:30 (52093): No heartbeat from core client for 30 sec - exiting
13:40:31 (52093): No heartbeat from core client for 30 sec - exiting
13:40:32 (52093): No heartbeat from core client for 30 sec - exiting
13:40:33 (52093): No heartbeat from core client for 30 sec - exiting
13:40:34 (52093): No heartbeat from core client for 30 sec - exiting
13:40:35 (52093): No heartbeat from core client for 30 sec - exiting
13:40:36 (52093): No heartbeat from core client for 30 sec - exiting
13:40:37 (52093): No heartbeat from core client for 30 sec - exiting
13:40:38 (52093): No heartbeat from core client for 30 sec - exiting
13:40:39 (52093): No heartbeat from core client for 30 sec - exiting
13:40:40 (52093): No heartbeat from core client for 30 sec - exiting
13:40:41 (52093): No heartbeat from core client for 30 sec - exiting
13:40:42 (52093): No heartbeat from core client for 30 sec - exiting
13:40:43 (52093): No heartbeat from core client for 30 sec - exiting
13:40:44 (52093): No heartbeat from core client for 30 sec - exiting
13:40:45 (52093): No heartbeat from core client for 30 sec - exiting
13:40:46 (52093): No heartbeat from core client for 30 sec - exiting
13:40:47 (52093): No heartbeat from core client for 30 sec - exiting
13:40:48 (52093): No heartbeat from core client for 30 sec - exiting
13:40:49 (52093): No heartbeat from core client for 30 sec - exiting
13:40:50 (52093): No heartbeat from core client for 30 sec - exiting
13:40:51 (52093): No heartbeat from core client for 30 sec - exiting
13:40:52 (52093): No heartbeat from core client for 30 sec - exiting
13:40:53 (52093): No heartbeat from core client for 30 sec - exiting
13:40:54 (52093): No heartbeat from core client for 30 sec - exiting
13:40:55 (52093): No heartbeat from core client for 30 sec - exiting
13:40:56 (52093): No heartbeat from core client for 30 sec - exiting
13:40:57 (52093): No heartbeat from core client for 30 sec - exiting
13:40:58 (52093): No heartbeat from core client for 30 sec - exiting
13:40:59 (52093): No heartbeat from core client for 30 sec - exiting
13:41:00 (52093): No heartbeat from core client for 30 sec - exiting
13:41:01 (52093): No heartbeat from core client for 30 sec - exiting
13:41:02 (52093): No heartbeat from core client for 30 sec - exiting
13:41:03 (52093): No heartbeat from core client for 30 sec - exiting
13:41:04 (52093): No heartbeat from core client for 30 sec - exiting
13:41:05 (52093): No heartbeat from core client for 30 sec - exiting
13:41:06 (52093): No heartbeat from core client for 30 sec - exiting
13:41:07 (52093): No heartbeat from core client for 30 sec - exiting
13:41:08 (52093): No heartbeat from core client for 30 sec - exiting
13:41:09 (52093): No heartbeat from core client for 30 sec - exiting
13:41:10 (52093): No heartbeat from core client for 30 sec - exiting
13:41:11 (52093): No heartbeat from core client for 30 sec - exiting
13:41:12 (52093): No heartbeat from core client for 30 sec - exiting
13:41:13 (52093): No heartbeat from core client for 30 sec - exiting
13:41:14 (52093): No heartbeat from core client for 30 sec - exiting
13:41:15 (52093): No heartbeat from core client for 30 sec - exiting
13:41:16 (52093): No heartbeat from core client for 30 sec - exiting
13:41:17 (52093): No heartbeat from core client for 30 sec - exiting
13:41:18 (52093): No heartbeat from core client for 30 sec - exiting
13:41:19 (52093): No heartbeat from core client for 30 sec - exiting
13:41:20 (52093): No heartbeat from core client for 30 sec - exiting
13:41:21 (52093): No heartbeat from core client for 30 sec - exiting
13:41:22 (52093): No heartbeat from core client for 30 sec - exiting
13:41:23 (52093): No heartbeat from core client for 30 sec - exiting
13:41:24 (52093): No heartbeat from core client for 30 sec - exiting
13:41:25 (52093): No heartbeat from core client for 30 sec - exiting
13:41:26 (52093): No heartbeat from core client for 30 sec - exiting
13:41:27 (52093): No heartbeat from core client for 30 sec - exiting
13:41:28 (52093): No heartbeat from core client for 30 sec - exiting
13:41:29 (52093): No heartbeat from core client for 30 sec - exiting
13:41:30 (52093): No heartbeat from core client for 30 sec - exiting
13:41:31 (52093): No heartbeat from core client for 30 sec - exiting
13:41:32 (52093): No heartbeat from core client for 30 sec - exiting
13:41:33 (52093): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/1/../../switcher/switcher) is setuid or setgid
SIGABRT: abort called
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.8.4 build 12E55
Wed Jul 24 13:42:04 2013

dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
Thread 0 Crashed:

Thread 1:

dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x901a1000 - 0x901b3fff /usr/lib/system/libdispatch.dylib
0x901b4000 - 0x90271fff /usr/lib/system/libsystem_c.dylib
0x91779000 - 0x9177afff /usr/lib/system/libquarantine.dylib
0x919f8000 - 0x919f9fff /usr/lib/system/libdnsinfo.dylib
0x91eb4000 - 0x91eb5fff /usr/lib/system/libunc.dylib
0x926bf000 - 0x926c0fff /usr/lib/system/libremovefile.dylib
0x92772000 - 0x92776fff /usr/lib/system/libmacho.dylib
0x92943000 - 0x9294afff /usr/lib/system/libunwind.dylib
0x93600000 - 0x93600fff /usr/lib/system/libkeymgr.dylib
0x93601000 - 0x93601fff /usr/lib/libSystem.B.dylib
0x93bed000 - 0x93beffff /usr/lib/system/libdyld.dylib
0x94673000 - 0x9467afff /usr/lib/system/liblaunch.dylib
0x951dd000 - 0x951ebfff /usr/lib/system/libsystem_network.dylib
0x96a5c000 - 0x96a5ffff /usr/lib/system/libcompiler_rt.dylib
0x96d18000 - 0x96d20fff /usr/lib/system/libcopyfile.dylib
0x96d21000 - 0x96d3efff /usr/lib/system/libxpc.dylib
0x97624000 - 0x9763efff /usr/lib/system/libsystem_kernel.dylib
0x9763f000 - 0x9764afff /usr/lib/system/libcommonCrypto.dylib
0x97751000 - 0x9779dfff /usr/lib/system/libcorecrypto.dylib
0x98737000 - 0x98745fff /usr/lib/libz.1.dylib
0x98854000 - 0x9885efff /usr/lib/system/libsystem_notify.dylib
0x98dc8000 - 0x98dcffff /usr/lib/system/libsystem_dnssd.dylib
0x99810000 - 0x99814fff /usr/lib/system/libcache.dylib
0x99826000 - 0x99826fff /usr/lib/system/libsystem_blocks.dylib
0x99b13000 - 0x99b3ffff /usr/lib/system/libsystem_info.dylib
0x99cfa000 - 0x99cfbfff /usr/lib/system/libsystem_sandbox.dylib
0x9a50b000 - 0x9a538fff /usr/lib/system/libsystem_m.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=52166, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.8.4 build 12E55
Wed Jul 24 13:42:08 2013

dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
Thread 0 Crashed:

Thread 1:

dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x901a1000 - 0x901b3fff /usr/lib/system/libdispatch.dylib
0x901b4000 - 0x90271fff /usr/lib/system/libsystem_c.dylib
0x91779000 - 0x9177afff /usr/lib/system/libquarantine.dylib
0x919f8000 - 0x919f9fff /usr/lib/system/libdnsinfo.dylib
0x91eb4000 - 0x91eb5fff /usr/lib/system/libunc.dylib
0x926bf000 - 0x926c0fff /usr/lib/system/libremovefile.dylib
0x92772000 - 0x92776fff /usr/lib/system/libmacho.dylib
0x92943000 - 0x9294afff /usr/lib/system/libunwind.dylib
0x93600000 - 0x93600fff /usr/lib/system/libkeymgr.dylib
0x93601000 - 0x93601fff /usr/lib/libSystem.B.dylib
0x93bed000 - 0x93beffff /usr/lib/system/libdyld.dylib
0x94673000 - 0x9467afff /usr/lib/system/liblaunch.dylib
0x951dd000 - 0x951ebfff /usr/lib/system/libsystem_network.dylib
0x96a5c000 - 0x96a5ffff /usr/lib/system/libcompiler_rt.dylib
0x96d18000 - 0x96d20fff /usr/lib/system/libcopyfile.dylib
0x96d21000 - 0x96d3efff /usr/lib/system/libxpc.dylib
0x97624000 - 0x9763efff /usr/lib/system/libsystem_kernel.dylib
0x9763f000 - 0x9764afff /usr/lib/system/libcommonCrypto.dylib
0x97751000 - 0x9779dfff /usr/lib/system/libcorecrypto.dylib
0x98737000 - 0x98745fff /usr/lib/libz.1.dylib
0x98854000 - 0x9885efff /usr/lib/system/libsystem_notify.dylib
0x98dc8000 - 0x98dcffff /usr/lib/system/libsystem_dnssd.dylib
0x99810000 - 0x99814fff /usr/lib/system/libcache.dylib
0x99826000 - 0x99826fff /usr/lib/system/libsystem_blocks.dylib
0x99b13000 - 0x99b3ffff /usr/lib/system/libsystem_info.dylib
0x99cfa000 - 0x99cfbfff /usr/lib/system/libsystem_sandbox.dylib
0x9a50b000 - 0x9a538fff /usr/lib/system/libsystem_m.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=52166, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Suspended CPDN Monitor - Suspend request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.8.4 build 12E55
Wed Jul 24 13:42:12 2013

dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
Thread 0 Crashed:

Thread 1:

dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x901a1000 - 0x901b3fff /usr/lib/system/libdispatch.dylib
0x901b4000 - 0x90271fff /usr/lib/system/libsystem_c.dylib
0x91779000 - 0x9177afff /usr/lib/system/libquarantine.dylib
0x919f8000 - 0x919f9fff /usr/lib/system/libdnsinfo.dylib
0x91eb4000 - 0x91eb5fff /usr/lib/system/libunc.dylib
0x926bf000 - 0x926c0fff /usr/lib/system/libremovefile.dylib
0x92772000 - 0x92776fff /usr/lib/system/libmacho.dylib
0x92943000 - 0x9294afff /usr/lib/system/libunwind.dylib
0x93600000 - 0x93600fff /usr/lib/system/libkeymgr.dylib
0x93601000 - 0x93601fff /usr/lib/libSystem.B.dylib
0x93bed000 - 0x93beffff /usr/lib/system/libdyld.dylib
0x94673000 - 0x9467afff /usr/lib/system/liblaunch.dylib
0x951dd000 - 0x951ebfff /usr/lib/system/libsystem_network.dylib
0x96a5c000 - 0x96a5ffff /usr/lib/system/libcompiler_rt.dylib
0x96d18000 - 0x96d20fff /usr/lib/system/libcopyfile.dylib
0x96d21000 - 0x96d3efff /usr/lib/system/libxpc.dylib
0x97624000 - 0x9763efff /usr/lib/system/libsystem_kernel.dylib
0x9763f000 - 0x9764afff /usr/lib/system/libcommonCrypto.dylib
0x97751000 - 0x9779dfff /usr/lib/system/libcorecrypto.dylib
0x98737000 - 0x98745fff /usr/lib/libz.1.dylib
0x98854000 - 0x9885efff /usr/lib/system/libsystem_notify.dylib
0x98dc8000 - 0x98dcffff /usr/lib/system/libsystem_dnssd.dylib
0x99810000 - 0x99814fff /usr/lib/system/libcache.dylib
0x99826000 - 0x99826fff /usr/lib/system/libsystem_blocks.dylib
0x99b13000 - 0x99b3ffff /usr/lib/system/libsystem_info.dylib
0x99cfa000 - 0x99cfbfff /usr/lib/system/libsystem_sandbox.dylib
0x9a50b000 - 0x9a538fff /usr/lib/system/libsystem_m.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=52166, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.8.4 build 12E55
Wed Jul 24 13:42:15 2013

dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
Thread 0 Crashed:

Thread 1:

dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x901a1000 - 0x901b3fff /usr/lib/system/libdispatch.dylib
0x901b4000 - 0x90271fff /usr/lib/system/libsystem_c.dylib
0x91779000 - 0x9177afff /usr/lib/system/libquarantine.dylib
0x919f8000 - 0x919f9fff /usr/lib/system/libdnsinfo.dylib
0x91eb4000 - 0x91eb5fff /usr/lib/system/libunc.dylib
0x926bf000 - 0x926c0fff /usr/lib/system/libremovefile.dylib
0x92772000 - 0x92776fff /usr/lib/system/libmacho.dylib
0x92943000 - 0x9294afff /usr/lib/system/libunwind.dylib
0x93600000 - 0x93600fff /usr/lib/system/libkeymgr.dylib
0x93601000 - 0x93601fff /usr/lib/libSystem.B.dylib
0x93bed000 - 0x93beffff /usr/lib/system/libdyld.dylib
0x94673000 - 0x9467afff /usr/lib/system/liblaunch.dylib
0x951dd000 - 0x951ebfff /usr/lib/system/libsystem_network.dylib
0x96a5c000 - 0x96a5ffff /usr/lib/system/libcompiler_rt.dylib
0x96d18000 - 0x96d20fff /usr/lib/system/libcopyfile.dylib
0x96d21000 - 0x96d3efff /usr/lib/system/libxpc.dylib
0x97624000 - 0x9763efff /usr/lib/system/libsystem_kernel.dylib
0x9763f000 - 0x9764afff /usr/lib/system/libcommonCrypto.dylib
0x97751000 - 0x9779dfff /usr/lib/system/libcorecrypto.dylib
0x98737000 - 0x98745fff /usr/lib/libz.1.dylib
0x98854000 - 0x9885efff /usr/lib/system/libsystem_notify.dylib
0x98dc8000 - 0x98dcffff /usr/lib/system/libsystem_dnssd.dylib
0x99810000 - 0x99814fff /usr/lib/system/libcache.dylib
0x99826000 - 0x99826fff /usr/lib/system/libsystem_blocks.dylib
0x99b13000 - 0x99b3ffff /usr/lib/system/libsystem_info.dylib
0x99cfa000 - 0x99cfbfff /usr/lib/system/libsystem_sandbox.dylib
0x9a50b000 - 0x9a538fff /usr/lib/system/libsystem_m.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=52166, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
24 Jul 2013 04:22:22 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 259,200 371,523 1.4333
23 Jul 2013 19:56:48 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 233,280 334,560 1.4342
23 Jul 2013 15:02:13 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 207,360 298,358 1.4388
23 Jul 2013 15:02:13 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 181,440 261,957 1.4438
11 Jul 2013 12:52:22 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 155,520 223,961 1.4401
09 Jul 2013 17:44:17 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 129,600 185,439 1.4309
06 Jul 2013 18:52:27 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 103,680 147,044 1.4182
03 Jul 2013 13:02:28 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 77,760 110,197 1.4171
02 Jul 2013 11:58:13 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 51,840 74,144 1.4302
28 Jun 2013 03:21:09 1247118 15868321 hadcm3n_o3sj_2140_40_008270375_4 25,920 37,074 1.4303


©2024 climateprediction.net