Task 19132034

Name	hadcm3n_xd96_198012_480_010221015_0
Workunit	10221015
Created	4 Dec 2015, 15:02:47 UTC
Sent	4 Dec 2015, 15:17:20 UTC
Report deadline	15 Nov 2016, 20:37:20 UTC
Received	27 Apr 2016, 17:35:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1378755
Run time	2 days 20 hours 11 min 54 sec
CPU time	2 days 16 hours 11 min 53 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	4.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:37:23 (1212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:04:27 (1765): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:31:41 (6087): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:14:15 (7294): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:13:38 (1967): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:59:42 (2048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 15:49:02 (2898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:27:33 (6475): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:30:41 (1300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:02:45 (1231): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:56:38 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:56:29 (4849): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:24:42 (2895): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:21:54 (4307): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:37:50 (5897): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:00:50 (896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:34 (1016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:09:03 (4491): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:02:31 (2895): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... 12:43:23 (975): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Tue Apr 26 08:20:32 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4668 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90197000 - 0x901c1fff /usr/lib/system/libdispatch.dylib 0x90339000 - 0x90342fff /usr/lib/system/libsystem_networkextension.dylib 0x904f7000 - 0x904f9fff /usr/lib/system/libsystem_secinit.dylib 0x909bd000 - 0x909c3fff /usr/lib/system/libsystem_platform.dylib 0x91422000 - 0x91433fff /usr/lib/system/libsystem_trace.dylib 0x91521000 - 0x9152bfff /usr/lib/system/libsystem_notify.dylib 0x91790000 - 0x917fefff /usr/lib/system/libsystem_network.dylib 0x92fff000 - 0x92ffffff /usr/lib/system/libkeymgr.dylib 0x93344000 - 0x933abfff /usr/lib/system/libcorecrypto.dylib 0x93fbd000 - 0x93fbdfff /usr/lib/system/liblaunch.dylib 0x93fbe000 - 0x93fd7fff /usr/lib/system/libsystem_asl.dylib 0x94b85000 - 0x94b8bfff /usr/lib/system/libunwind.dylib 0x94f41000 - 0x94f62fff /usr/lib/system/libsystem_kernel.dylib 0x95152000 - 0x95157fff /usr/lib/system/libmacho.dylib 0x9519e000 - 0x951d1fff /usr/lib/system/libsystem_m.dylib 0x9559a000 - 0x955a3fff /usr/lib/system/libcopyfile.dylib 0x9695b000 - 0x9695dfff /usr/lib/system/libquarantine.dylib 0x96f42000 - 0x96fd7fff /usr/lib/system/libsystem_c.dylib 0x97123000 - 0x97125fff /usr/lib/system/libsystem_configuration.dylib 0x975c3000 - 0x975c6fff /usr/lib/system/libdyld.dylib 0x975c7000 - 0x975defff /usr/lib/system/libsystem_coretls.dylib 0x975df000 - 0x975e4fff /usr/lib/system/libcompiler_rt.dylib 0x9781d000 - 0x97821fff /usr/lib/system/libcache.dylib 0x99144000 - 0x9916efff /usr/lib/system/libsystem_info.dylib 0x9b082000 - 0x9b08afff /usr/lib/system/libsystem_dnssd.dylib 0x9b0a2000 - 0x9b0adfff /usr/lib/system/libcommonCrypto.dylib 0x9bfa6000 - 0x9bfcefff /usr/lib/system/libxpc.dylib 0x9c284000 - 0x9c287fff /usr/lib/system/libsystem_sandbox.dylib 0x9c54d000 - 0x9c566fff /usr/lib/system/libsystem_malloc.dylib 0x9ca8f000 - 0x9ca90fff /usr/lib/system/libremovefile.dylib 0x9ca91000 - 0x9ca93fff /usr/lib/system/libsystem_coreservices.dylib 0x9cb86000 - 0x9cb8efff /usr/lib/system/libsystem_pthread.dylib 0x9cbc9000 - 0x9cbc9fff /usr/lib/system/libsystem_blocks.dylib 0x9cbca000 - 0x9cbd8fff /usr/lib/libz.1.dylib 0x9cf74000 - 0x9cf74fff /usr/lib/system/libunc.dylib 0x9cf75000 - 0x9cf76fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Tue Apr 26 08:20:37 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4668 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90197000 - 0x901c1fff /usr/lib/system/libdispatch.dylib 0x90339000 - 0x90342fff /usr/lib/system/libsystem_networkextension.dylib 0x904f7000 - 0x904f9fff /usr/lib/system/libsystem_secinit.dylib 0x909bd000 - 0x909c3fff /usr/lib/system/libsystem_platform.dylib 0x91422000 - 0x91433fff /usr/lib/system/libsystem_trace.dylib 0x91521000 - 0x9152bfff /usr/lib/system/libsystem_notify.dylib 0x91790000 - 0x917fefff /usr/lib/system/libsystem_network.dylib 0x92fff000 - 0x92ffffff /usr/lib/system/libkeymgr.dylib 0x93344000 - 0x933abfff /usr/lib/system/libcorecrypto.dylib 0x93fbd000 - 0x93fbdfff /usr/lib/system/liblaunch.dylib 0x93fbe000 - 0x93fd7fff /usr/lib/system/libsystem_asl.dylib 0x94b85000 - 0x94b8bfff /usr/lib/system/libunwind.dylib 0x94f41000 - 0x94f62fff /usr/lib/system/libsystem_kernel.dylib 0x95152000 - 0x95157fff /usr/lib/system/libmacho.dylib 0x9519e000 - 0x951d1fff /usr/lib/system/libsystem_m.dylib 0x9559a000 - 0x955a3fff /usr/lib/system/libcopyfile.dylib 0x9695b000 - 0x9695dfff /usr/lib/system/libquarantine.dylib 0x96f42000 - 0x96fd7fff /usr/lib/system/libsystem_c.dylib 0x97123000 - 0x97125fff /usr/lib/system/libsystem_configuration.dylib 0x975c3000 - 0x975c6fff /usr/lib/system/libdyld.dylib 0x975c7000 - 0x975defff /usr/lib/system/libsystem_coretls.dylib 0x975df000 - 0x975e4fff /usr/lib/system/libcompiler_rt.dylib 0x9781d000 - 0x97821fff /usr/lib/system/libcache.dylib 0x99144000 - 0x9916efff /usr/lib/system/libsystem_info.dylib 0x9b082000 - 0x9b08afff /usr/lib/system/libsystem_dnssd.dylib 0x9b0a2000 - 0x9b0adfff /usr/lib/system/libcommonCrypto.dylib 0x9bfa6000 - 0x9bfcefff /usr/lib/system/libxpc.dylib 0x9c284000 - 0x9c287fff /usr/lib/system/libsystem_sandbox.dylib 0x9c54d000 - 0x9c566fff /usr/lib/system/libsystem_malloc.dylib 0x9ca8f000 - 0x9ca90fff /usr/lib/system/libremovefile.dylib 0x9ca91000 - 0x9ca93fff /usr/lib/system/libsystem_coreservices.dylib 0x9cb86000 - 0x9cb8efff /usr/lib/system/libsystem_pthread.dylib 0x9cbc9000 - 0x9cbc9fff /usr/lib/system/libsystem_blocks.dylib 0x9cbca000 - 0x9cbd8fff /usr/lib/libz.1.dylib 0x9cf74000 - 0x9cf74fff /usr/lib/system/libunc.dylib 0x9cf75000 - 0x9cf76fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Tue Apr 26 08:20:42 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4668 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90197000 - 0x901c1fff /usr/lib/system/libdispatch.dylib 0x90339000 - 0x90342fff /usr/lib/system/libsystem_networkextension.dylib 0x904f7000 - 0x904f9fff /usr/lib/system/libsystem_secinit.dylib 0x909bd000 - 0x909c3fff /usr/lib/system/libsystem_platform.dylib 0x91422000 - 0x91433fff /usr/lib/system/libsystem_trace.dylib 0x91521000 - 0x9152bfff /usr/lib/system/libsystem_notify.dylib 0x91790000 - 0x917fefff /usr/lib/system/libsystem_network.dylib 0x92fff000 - 0x92ffffff /usr/lib/system/libkeymgr.dylib 0x93344000 - 0x933abfff /usr/lib/system/libcorecrypto.dylib 0x93fbd000 - 0x93fbdfff /usr/lib/system/liblaunch.dylib 0x93fbe000 - 0x93fd7fff /usr/lib/system/libsystem_asl.dylib 0x94b85000 - 0x94b8bfff /usr/lib/system/libunwind.dylib 0x94f41000 - 0x94f62fff /usr/lib/system/libsystem_kernel.dylib 0x95152000 - 0x95157fff /usr/lib/system/libmacho.dylib 0x9519e000 - 0x951d1fff /usr/lib/system/libsystem_m.dylib 0x9559a000 - 0x955a3fff /usr/lib/system/libcopyfile.dylib 0x9695b000 - 0x9695dfff /usr/lib/system/libquarantine.dylib 0x96f42000 - 0x96fd7fff /usr/lib/system/libsystem_c.dylib 0x97123000 - 0x97125fff /usr/lib/system/libsystem_configuration.dylib 0x975c3000 - 0x975c6fff /usr/lib/system/libdyld.dylib 0x975c7000 - 0x975defff /usr/lib/system/libsystem_coretls.dylib 0x975df000 - 0x975e4fff /usr/lib/system/libcompiler_rt.dylib 0x9781d000 - 0x97821fff /usr/lib/system/libcache.dylib 0x99144000 - 0x9916efff /usr/lib/system/libsystem_info.dylib 0x9b082000 - 0x9b08afff /usr/lib/system/libsystem_dnssd.dylib 0x9b0a2000 - 0x9b0adfff /usr/lib/system/libcommonCrypto.dylib 0x9bfa6000 - 0x9bfcefff /usr/lib/system/libxpc.dylib 0x9c284000 - 0x9c287fff /usr/lib/system/libsystem_sandbox.dylib 0x9c54d000 - 0x9c566fff /usr/lib/system/libsystem_malloc.dylib 0x9ca8f000 - 0x9ca90fff /usr/lib/system/libremovefile.dylib 0x9ca91000 - 0x9ca93fff /usr/lib/system/libsystem_coreservices.dylib 0x9cb86000 - 0x9cb8efff /usr/lib/system/libsystem_pthread.dylib 0x9cbc9000 - 0x9cbc9fff /usr/lib/system/libsystem_blocks.dylib 0x9cbca000 - 0x9cbd8fff /usr/lib/libz.1.dylib 0x9cf74000 - 0x9cf74fff /usr/lib/system/libunc.dylib 0x9cf75000 - 0x9cf76fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Tue Apr 26 08:20:46 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4668 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90197000 - 0x901c1fff /usr/lib/system/libdispatch.dylib 0x90339000 - 0x90342fff /usr/lib/system/libsystem_networkextension.dylib 0x904f7000 - 0x904f9fff /usr/lib/system/libsystem_secinit.dylib 0x909bd000 - 0x909c3fff /usr/lib/system/libsystem_platform.dylib 0x91422000 - 0x91433fff /usr/lib/system/libsystem_trace.dylib 0x91521000 - 0x9152bfff /usr/lib/system/libsystem_notify.dylib 0x91790000 - 0x917fefff /usr/lib/system/libsystem_network.dylib 0x92fff000 - 0x92ffffff /usr/lib/system/libkeymgr.dylib 0x93344000 - 0x933abfff /usr/lib/system/libcorecrypto.dylib 0x93fbd000 - 0x93fbdfff /usr/lib/system/liblaunch.dylib 0x93fbe000 - 0x93fd7fff /usr/lib/system/libsystem_asl.dylib 0x94b85000 - 0x94b8bfff /usr/lib/system/libunwind.dylib 0x94f41000 - 0x94f62fff /usr/lib/system/libsystem_kernel.dylib 0x95152000 - 0x95157fff /usr/lib/system/libmacho.dylib 0x9519e000 - 0x951d1fff /usr/lib/system/libsystem_m.dylib 0x9559a000 - 0x955a3fff /usr/lib/system/libcopyfile.dylib 0x9695b000 - 0x9695dfff /usr/lib/system/libquarantine.dylib 0x96f42000 - 0x96fd7fff /usr/lib/system/libsystem_c.dylib 0x97123000 - 0x97125fff /usr/lib/system/libsystem_configuration.dylib 0x975c3000 - 0x975c6fff /usr/lib/system/libdyld.dylib 0x975c7000 - 0x975defff /usr/lib/system/libsystem_coretls.dylib 0x975df000 - 0x975e4fff /usr/lib/system/libcompiler_rt.dylib 0x9781d000 - 0x97821fff /usr/lib/system/libcache.dylib 0x99144000 - 0x9916efff /usr/lib/system/libsystem_info.dylib 0x9b082000 - 0x9b08afff /usr/lib/system/libsystem_dnssd.dylib 0x9b0a2000 - 0x9b0adfff /usr/lib/system/libcommonCrypto.dylib 0x9bfa6000 - 0x9bfcefff /usr/lib/system/libxpc.dylib 0x9c284000 - 0x9c287fff /usr/lib/system/libsystem_sandbox.dylib 0x9c54d000 - 0x9c566fff /usr/lib/system/libsystem_malloc.dylib 0x9ca8f000 - 0x9ca90fff /usr/lib/system/libremovefile.dylib 0x9ca91000 - 0x9ca93fff /usr/lib/system/libsystem_coreservices.dylib 0x9cb86000 - 0x9cb8efff /usr/lib/system/libsystem_pthread.dylib 0x9cbc9000 - 0x9cbc9fff /usr/lib/system/libsystem_blocks.dylib 0x9cbca000 - 0x9cbd8fff /usr/lib/libz.1.dylib 0x9cf74000 - 0x9cf74fff /usr/lib/system/libunc.dylib 0x9cf75000 - 0x9cf76fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Tue Apr 26 08:20:52 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4668 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90197000 - 0x901c1fff /usr/lib/system/libdispatch.dylib 0x90339000 - 0x90342fff /usr/lib/system/libsystem_networkextension.dylib 0x904f7000 - 0x904f9fff /usr/lib/system/libsystem_secinit.dylib 0x909bd000 - 0x909c3fff /usr/lib/system/libsystem_platform.dylib 0x91422000 - 0x91433fff /usr/lib/system/libsystem_trace.dylib 0x91521000 - 0x9152bfff /usr/lib/system/libsystem_notify.dylib 0x91790000 - 0x917fefff /usr/lib/system/libsystem_network.dylib 0x92fff000 - 0x92ffffff /usr/lib/system/libkeymgr.dylib 0x93344000 - 0x933abfff /usr/lib/system/libcorecrypto.dylib 0x93fbd000 - 0x93fbdfff /usr/lib/system/liblaunch.dylib 0x93fbe000 - 0x93fd7fff /usr/lib/system/libsystem_asl.dylib 0x94b85000 - 0x94b8bfff /usr/lib/system/libunwind.dylib 0x94f41000 - 0x94f62fff /usr/lib/system/libsystem_kernel.dylib 0x95152000 - 0x95157fff /usr/lib/system/libmacho.dylib 0x9519e000 - 0x951d1fff /usr/lib/system/libsystem_m.dylib 0x9559a000 - 0x955a3fff /usr/lib/system/libcopyfile.dylib 0x9695b000 - 0x9695dfff /usr/lib/system/libquarantine.dylib 0x96f42000 - 0x96fd7fff /usr/lib/system/libsystem_c.dylib 0x97123000 - 0x97125fff /usr/lib/system/libsystem_configuration.dylib 0x975c3000 - 0x975c6fff /usr/lib/system/libdyld.dylib 0x975c7000 - 0x975defff /usr/lib/system/libsystem_coretls.dylib 0x975df000 - 0x975e4fff /usr/lib/system/libcompiler_rt.dylib 0x9781d000 - 0x97821fff /usr/lib/system/libcache.dylib 0x99144000 - 0x9916efff /usr/lib/system/libsystem_info.dylib 0x9b082000 - 0x9b08afff /usr/lib/system/libsystem_dnssd.dylib 0x9b0a2000 - 0x9b0adfff /usr/lib/system/libcommonCrypto.dylib 0x9bfa6000 - 0x9bfcefff /usr/lib/system/libxpc.dylib 0x9c284000 - 0x9c287fff /usr/lib/system/libsystem_sandbox.dylib 0x9c54d000 - 0x9c566fff /usr/lib/system/libsystem_malloc.dylib 0x9ca8f000 - 0x9ca90fff /usr/lib/system/libremovefile.dylib 0x9ca91000 - 0x9ca93fff /usr/lib/system/libsystem_coreservices.dylib 0x9cb86000 - 0x9cb8efff /usr/lib/system/libsystem_pthread.dylib 0x9cbc9000 - 0x9cbc9fff /usr/lib/system/libsystem_blocks.dylib 0x9cbca000 - 0x9cbd8fff /usr/lib/libz.1.dylib 0x9cf74000 - 0x9cf74fff /usr/lib/system/libunc.dylib 0x9cf75000 - 0x9cf76fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Tue Apr 26 08:20:56 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4668 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90197000 - 0x901c1fff /usr/lib/system/libdispatch.dylib 0x90339000 - 0x90342fff /usr/lib/system/libsystem_networkextension.dylib 0x904f7000 - 0x904f9fff /usr/lib/system/libsystem_secinit.dylib 0x909bd000 - 0x909c3fff /usr/lib/system/libsystem_platform.dylib 0x91422000 - 0x91433fff /usr/lib/system/libsystem_trace.dylib 0x91521000 - 0x9152bfff /usr/lib/system/libsystem_notify.dylib 0x91790000 - 0x917fefff /usr/lib/system/libsystem_network.dylib 0x92fff000 - 0x92ffffff /usr/lib/system/libkeymgr.dylib 0x93344000 - 0x933abfff /usr/lib/system/libcorecrypto.dylib 0x93fbd000 - 0x93fbdfff /usr/lib/system/liblaunch.dylib 0x93fbe000 - 0x93fd7fff /usr/lib/system/libsystem_asl.dylib 0x94b85000 - 0x94b8bfff /usr/lib/system/libunwind.dylib 0x94f41000 - 0x94f62fff /usr/lib/system/libsystem_kernel.dylib 0x95152000 - 0x95157fff /usr/lib/system/libmacho.dylib 0x9519e000 - 0x951d1fff /usr/lib/system/libsystem_m.dylib 0x9559a000 - 0x955a3fff /usr/lib/system/libcopyfile.dylib 0x9695b000 - 0x9695dfff /usr/lib/system/libquarantine.dylib 0x96f42000 - 0x96fd7fff /usr/lib/system/libsystem_c.dylib 0x97123000 - 0x97125fff /usr/lib/system/libsystem_configuration.dylib 0x975c3000 - 0x975c6fff /usr/lib/system/libdyld.dylib 0x975c7000 - 0x975defff /usr/lib/system/libsystem_coretls.dylib 0x975df000 - 0x975e4fff /usr/lib/system/libcompiler_rt.dylib 0x9781d000 - 0x97821fff /usr/lib/system/libcache.dylib 0x99144000 - 0x9916efff /usr/lib/system/libsystem_info.dylib 0x9b082000 - 0x9b08afff /usr/lib/system/libsystem_dnssd.dylib 0x9b0a2000 - 0x9b0adfff /usr/lib/system/libcommonCrypto.dylib 0x9bfa6000 - 0x9bfcefff /usr/lib/system/libxpc.dylib 0x9c284000 - 0x9c287fff /usr/lib/system/libsystem_sandbox.dylib 0x9c54d000 - 0x9c566fff /usr/lib/system/libsystem_malloc.dylib 0x9ca8f000 - 0x9ca90fff /usr/lib/system/libremovefile.dylib 0x9ca91000 - 0x9ca93fff /usr/lib/system/libsystem_coreservices.dylib 0x9cb86000 - 0x9cb8efff /usr/lib/system/libsystem_pthread.dylib 0x9cbc9000 - 0x9cbc9fff /usr/lib/system/libsystem_blocks.dylib 0x9cbca000 - 0x9cbd8fff /usr/lib/libz.1.dylib 0x9cf74000 - 0x9cf74fff /usr/lib/system/libunc.dylib 0x9cf75000 - 0x9cf76fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1185, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Mar 2016 17:36:37	1378755	19132034	hadcm3n_xd96_198012_480_010221015_0	233,280	211,120	0.9050
29 Feb 2016 17:53:12	1378755	19132034	hadcm3n_xd96_198012_480_010221015_0	207,360	189,091	0.9119
24 Feb 2016 17:28:54	1378755	19132034	hadcm3n_xd96_198012_480_010221015_0	181,440	166,972	0.9203
11 Feb 2016 16:29:32	1378755	19132034	hadcm3n_xd96_198012_480_010221015_0	155,520	143,152	0.9205
06 Feb 2016 19:00:15	1378755	19132034	hadcm3n_xd96_198012_480_010221015_0	129,600	120,432	0.9293
06 Feb 2016 11:07:37	1378755	19132034	hadcm3n_xd96_198012_480_010221015_0	103,680	98,255	0.9477
21 Dec 2015 19:10:51	1378755	19132034	hadcm3n_xd96_198012_480_010221015_0	77,760	74,933	0.9636
20 Dec 2015 11:38:49	1378755	19132034	hadcm3n_xd96_198012_480_010221015_0	51,840	49,548	0.9558
08 Dec 2015 20:58:36	1378755	19132034	hadcm3n_xd96_198012_480_010221015_0	25,920	24,261	0.9360