Task 17910500

Name	hadcm3n_xc3o_1940_40_009151978_2
Workunit	9282314
Created	8 Feb 2015, 15:24:23 UTC
Sent	8 Feb 2015, 15:25:42 UTC
Report deadline	10 May 2015, 22:52:53 UTC
Received	13 Feb 2015, 20:55:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1282793
Run time	4 days 7 hours 27 min 6 sec
CPU time	4 days 6 hours 21 min 31 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	3.98 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.4.26</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: severe (17): syntax error in NAMELIST input, unit 5, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xc3o_1940_40_009151978/jobs/climate.cpdc, line 393, position 19 Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003CACB0 Unknown Unknown Unknown hadcm3n_um_6.07_i 00261D1E Unknown Unknown Unknown hadcm3n_um_6.07_i 0016269A Unknown Unknown Unknown hadcm3n_um_6.07_i 00164453 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12083, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: severe (17): syntax error in NAMELIST input, unit 5, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xc3o_1940_40_009151978/jobs/climate.cpdc, line 393, position 19 Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003CACB0 Unknown Unknown Unknown hadcm3n_um_6.07_i 00261D1E Unknown Unknown Unknown hadcm3n_um_6.07_i 0016269A Unknown Unknown Unknown hadcm3n_um_6.07_i 00164453 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20939, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C109 Sat Feb 14 08:54:38 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4638 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000efff /usr/lib/system/libsystem_platform.dylib 0x915ea000 - 0x915ecfff /usr/lib/system/libsystem_configuration.dylib 0x916b9000 - 0x916bbfff /usr/lib/system/libsystem_coreservices.dylib 0x91c0b000 - 0x91c11fff /usr/lib/system/libsystem_trace.dylib 0x91c8d000 - 0x91c94fff /usr/lib/system/libunwind.dylib 0x925df000 - 0x925fefff /usr/lib/system/libsystem_kernel.dylib 0x9295b000 - 0x9295dfff /usr/lib/system/libsystem_secinit.dylib 0x92aa4000 - 0x92abbfff /usr/lib/system/libsystem_asl.dylib 0x92dbd000 - 0x92dc9fff /usr/lib/system/libcommonCrypto.dylib 0x92dca000 - 0x92dd3fff /usr/lib/system/libsystem_notify.dylib 0x9376a000 - 0x9379dfff /usr/lib/system/libsystem_m.dylib 0x94496000 - 0x9449bfff /usr/lib/system/libcompiler_rt.dylib 0x9524f000 - 0x9525dfff /usr/lib/libz.1.dylib 0x952f8000 - 0x95300fff /usr/lib/system/libsystem_pthread.dylib 0x95a3e000 - 0x95a7bfff /usr/lib/system/libsystem_network.dylib 0x96148000 - 0x961b1fff /usr/lib/system/libcorecrypto.dylib 0x961b6000 - 0x961ddfff /usr/lib/system/libdispatch.dylib 0x964df000 - 0x964dffff /usr/lib/system/libkeymgr.dylib 0x964e3000 - 0x964ecfff /usr/lib/system/libcopyfile.dylib 0x96682000 - 0x96683fff /usr/lib/system/libsystem_blocks.dylib 0x9668c000 - 0x966a5fff /usr/lib/system/libsystem_malloc.dylib 0x968e8000 - 0x968ecfff /usr/lib/system/libcache.dylib 0x96ce4000 - 0x96ce4fff /usr/lib/system/libunc.dylib 0x973e6000 - 0x973e7fff /usr/lib/system/libremovefile.dylib 0x974ee000 - 0x97517fff /usr/lib/system/libsystem_info.dylib 0x975b6000 - 0x975dcfff /usr/lib/system/libxpc.dylib 0x980d1000 - 0x98166fff /usr/lib/system/libsystem_c.dylib 0x9a091000 - 0x9a093fff /usr/lib/system/libquarantine.dylib 0x9a3f2000 - 0x9a3f3fff /usr/lib/libSystem.B.dylib 0x9a3f4000 - 0x9a3fcfff /usr/lib/system/libsystem_dnssd.dylib 0x9a408000 - 0x9a40bfff /usr/lib/system/libdyld.dylib 0x9a40c000 - 0x9a412fff /usr/lib/system/libsystem_networkextension.dylib 0x9abc2000 - 0x9abc7fff /usr/lib/system/libmacho.dylib 0x9afaf000 - 0x9afc0fff /usr/lib/system/libsystem_coretls.dylib 0x9aff4000 - 0x9aff4fff /usr/lib/system/liblaunch.dylib 0x9b8e2000 - 0x9b8e4fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=49921, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C109 Sat Feb 14 08:54:43 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4638 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000efff /usr/lib/system/libsystem_platform.dylib 0x915ea000 - 0x915ecfff /usr/lib/system/libsystem_configuration.dylib 0x916b9000 - 0x916bbfff /usr/lib/system/libsystem_coreservices.dylib 0x91c0b000 - 0x91c11fff /usr/lib/system/libsystem_trace.dylib 0x91c8d000 - 0x91c94fff /usr/lib/system/libunwind.dylib 0x925df000 - 0x925fefff /usr/lib/system/libsystem_kernel.dylib 0x9295b000 - 0x9295dfff /usr/lib/system/libsystem_secinit.dylib 0x92aa4000 - 0x92abbfff /usr/lib/system/libsystem_asl.dylib 0x92dbd000 - 0x92dc9fff /usr/lib/system/libcommonCrypto.dylib 0x92dca000 - 0x92dd3fff /usr/lib/system/libsystem_notify.dylib 0x9376a000 - 0x9379dfff /usr/lib/system/libsystem_m.dylib 0x94496000 - 0x9449bfff /usr/lib/system/libcompiler_rt.dylib 0x9524f000 - 0x9525dfff /usr/lib/libz.1.dylib 0x952f8000 - 0x95300fff /usr/lib/system/libsystem_pthread.dylib 0x95a3e000 - 0x95a7bfff /usr/lib/system/libsystem_network.dylib 0x96148000 - 0x961b1fff /usr/lib/system/libcorecrypto.dylib 0x961b6000 - 0x961ddfff /usr/lib/system/libdispatch.dylib 0x964df000 - 0x964dffff /usr/lib/system/libkeymgr.dylib 0x964e3000 - 0x964ecfff /usr/lib/system/libcopyfile.dylib 0x96682000 - 0x96683fff /usr/lib/system/libsystem_blocks.dylib 0x9668c000 - 0x966a5fff /usr/lib/system/libsystem_malloc.dylib 0x968e8000 - 0x968ecfff /usr/lib/system/libcache.dylib 0x96ce4000 - 0x96ce4fff /usr/lib/system/libunc.dylib 0x973e6000 - 0x973e7fff /usr/lib/system/libremovefile.dylib 0x974ee000 - 0x97517fff /usr/lib/system/libsystem_info.dylib 0x975b6000 - 0x975dcfff /usr/lib/system/libxpc.dylib 0x980d1000 - 0x98166fff /usr/lib/system/libsystem_c.dylib 0x9a091000 - 0x9a093fff /usr/lib/system/libquarantine.dylib 0x9a3f2000 - 0x9a3f3fff /usr/lib/libSystem.B.dylib 0x9a3f4000 - 0x9a3fcfff /usr/lib/system/libsystem_dnssd.dylib 0x9a408000 - 0x9a40bfff /usr/lib/system/libdyld.dylib 0x9a40c000 - 0x9a412fff /usr/lib/system/libsystem_networkextension.dylib 0x9abc2000 - 0x9abc7fff /usr/lib/system/libmacho.dylib 0x9afaf000 - 0x9afc0fff /usr/lib/system/libsystem_coretls.dylib 0x9aff4000 - 0x9aff4fff /usr/lib/system/liblaunch.dylib 0x9b8e2000 - 0x9b8e4fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=49921, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C109 Sat Feb 14 08:54:48 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4638 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000efff /usr/lib/system/libsystem_platform.dylib 0x915ea000 - 0x915ecfff /usr/lib/system/libsystem_configuration.dylib 0x916b9000 - 0x916bbfff /usr/lib/system/libsystem_coreservices.dylib 0x91c0b000 - 0x91c11fff /usr/lib/system/libsystem_trace.dylib 0x91c8d000 - 0x91c94fff /usr/lib/system/libunwind.dylib 0x925df000 - 0x925fefff /usr/lib/system/libsystem_kernel.dylib 0x9295b000 - 0x9295dfff /usr/lib/system/libsystem_secinit.dylib 0x92aa4000 - 0x92abbfff /usr/lib/system/libsystem_asl.dylib 0x92dbd000 - 0x92dc9fff /usr/lib/system/libcommonCrypto.dylib 0x92dca000 - 0x92dd3fff /usr/lib/system/libsystem_notify.dylib 0x9376a000 - 0x9379dfff /usr/lib/system/libsystem_m.dylib 0x94496000 - 0x9449bfff /usr/lib/system/libcompiler_rt.dylib 0x9524f000 - 0x9525dfff /usr/lib/libz.1.dylib 0x952f8000 - 0x95300fff /usr/lib/system/libsystem_pthread.dylib 0x95a3e000 - 0x95a7bfff /usr/lib/system/libsystem_network.dylib 0x96148000 - 0x961b1fff /usr/lib/system/libcorecrypto.dylib 0x961b6000 - 0x961ddfff /usr/lib/system/libdispatch.dylib 0x964df000 - 0x964dffff /usr/lib/system/libkeymgr.dylib 0x964e3000 - 0x964ecfff /usr/lib/system/libcopyfile.dylib 0x96682000 - 0x96683fff /usr/lib/system/libsystem_blocks.dylib 0x9668c000 - 0x966a5fff /usr/lib/system/libsystem_malloc.dylib 0x968e8000 - 0x968ecfff /usr/lib/system/libcache.dylib 0x96ce4000 - 0x96ce4fff /usr/lib/system/libunc.dylib 0x973e6000 - 0x973e7fff /usr/lib/system/libremovefile.dylib 0x974ee000 - 0x97517fff /usr/lib/system/libsystem_info.dylib 0x975b6000 - 0x975dcfff /usr/lib/system/libxpc.dylib 0x980d1000 - 0x98166fff /usr/lib/system/libsystem_c.dylib 0x9a091000 - 0x9a093fff /usr/lib/system/libquarantine.dylib 0x9a3f2000 - 0x9a3f3fff /usr/lib/libSystem.B.dylib 0x9a3f4000 - 0x9a3fcfff /usr/lib/system/libsystem_dnssd.dylib 0x9a408000 - 0x9a40bfff /usr/lib/system/libdyld.dylib 0x9a40c000 - 0x9a412fff /usr/lib/system/libsystem_networkextension.dylib 0x9abc2000 - 0x9abc7fff /usr/lib/system/libmacho.dylib 0x9afaf000 - 0x9afc0fff /usr/lib/system/libsystem_coretls.dylib 0x9aff4000 - 0x9aff4fff /usr/lib/system/liblaunch.dylib 0x9b8e2000 - 0x9b8e4fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=49921, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C109 Sat Feb 14 08:54:52 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4638 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000efff /usr/lib/system/libsystem_platform.dylib 0x915ea000 - 0x915ecfff /usr/lib/system/libsystem_configuration.dylib 0x916b9000 - 0x916bbfff /usr/lib/system/libsystem_coreservices.dylib 0x91c0b000 - 0x91c11fff /usr/lib/system/libsystem_trace.dylib 0x91c8d000 - 0x91c94fff /usr/lib/system/libunwind.dylib 0x925df000 - 0x925fefff /usr/lib/system/libsystem_kernel.dylib 0x9295b000 - 0x9295dfff /usr/lib/system/libsystem_secinit.dylib 0x92aa4000 - 0x92abbfff /usr/lib/system/libsystem_asl.dylib 0x92dbd000 - 0x92dc9fff /usr/lib/system/libcommonCrypto.dylib 0x92dca000 - 0x92dd3fff /usr/lib/system/libsystem_notify.dylib 0x9376a000 - 0x9379dfff /usr/lib/system/libsystem_m.dylib 0x94496000 - 0x9449bfff /usr/lib/system/libcompiler_rt.dylib 0x9524f000 - 0x9525dfff /usr/lib/libz.1.dylib 0x952f8000 - 0x95300fff /usr/lib/system/libsystem_pthread.dylib 0x95a3e000 - 0x95a7bfff /usr/lib/system/libsystem_network.dylib 0x96148000 - 0x961b1fff /usr/lib/system/libcorecrypto.dylib 0x961b6000 - 0x961ddfff /usr/lib/system/libdispatch.dylib 0x964df000 - 0x964dffff /usr/lib/system/libkeymgr.dylib 0x964e3000 - 0x964ecfff /usr/lib/system/libcopyfile.dylib 0x96682000 - 0x96683fff /usr/lib/system/libsystem_blocks.dylib 0x9668c000 - 0x966a5fff /usr/lib/system/libsystem_malloc.dylib 0x968e8000 - 0x968ecfff /usr/lib/system/libcache.dylib 0x96ce4000 - 0x96ce4fff /usr/lib/system/libunc.dylib 0x973e6000 - 0x973e7fff /usr/lib/system/libremovefile.dylib 0x974ee000 - 0x97517fff /usr/lib/system/libsystem_info.dylib 0x975b6000 - 0x975dcfff /usr/lib/system/libxpc.dylib 0x980d1000 - 0x98166fff /usr/lib/system/libsystem_c.dylib 0x9a091000 - 0x9a093fff /usr/lib/system/libquarantine.dylib 0x9a3f2000 - 0x9a3f3fff /usr/lib/libSystem.B.dylib 0x9a3f4000 - 0x9a3fcfff /usr/lib/system/libsystem_dnssd.dylib 0x9a408000 - 0x9a40bfff /usr/lib/system/libdyld.dylib 0x9a40c000 - 0x9a412fff /usr/lib/system/libsystem_networkextension.dylib 0x9abc2000 - 0x9abc7fff /usr/lib/system/libmacho.dylib 0x9afaf000 - 0x9afc0fff /usr/lib/system/libsystem_coretls.dylib 0x9aff4000 - 0x9aff4fff /usr/lib/system/liblaunch.dylib 0x9b8e2000 - 0x9b8e4fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=49921, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (17): syntax error in NAMELIST input, unit 5, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xc3o_1940_40_009151978/jobs/climate.cpdc, line 393, position 19 Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003CACB0 Unknown Unknown Unknown hadcm3n_um_6.07_i 00261D1E Unknown Unknown Unknown hadcm3n_um_6.07_i 0016269A Unknown Unknown Unknown hadcm3n_um_6.07_i 00164453 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=49921, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (17): syntax error in NAMELIST input, unit 5, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xc3o_1940_40_009151978/jobs/climate.cpdc, line 393, position 19 Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003CACB0 Unknown Unknown Unknown hadcm3n_um_6.07_i 00261D1E Unknown Unknown Unknown hadcm3n_um_6.07_i 0016269A Unknown Unknown Unknown hadcm3n_um_6.07_i 00164453 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=49921, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Feb 2015 15:56:14	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	440,640	355,194	0.8061
13 Feb 2015 10:04:51	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	414,720	334,417	0.8064
13 Feb 2015 00:47:05	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	388,800	313,691	0.8068
12 Feb 2015 16:24:08	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	362,880	292,852	0.8070
12 Feb 2015 09:32:10	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	336,960	271,940	0.8070
11 Feb 2015 23:41:42	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	311,040	250,064	0.8040
11 Feb 2015 16:48:54	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	285,120	229,285	0.8042
11 Feb 2015 11:06:58	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	259,200	208,759	0.8054
11 Feb 2015 03:48:13	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	233,280	187,534	0.8039
10 Feb 2015 18:59:44	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	207,360	166,836	0.8046
10 Feb 2015 13:08:06	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	181,440	145,884	0.8040
10 Feb 2015 06:31:17	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	155,520	124,312	0.7993
10 Feb 2015 00:47:36	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	129,600	103,706	0.8002
09 Feb 2015 16:22:52	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	103,680	83,288	0.8033
09 Feb 2015 10:23:50	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	77,760	62,591	0.8049
09 Feb 2015 04:16:41	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	51,840	41,839	0.8071
08 Feb 2015 22:02:05	1282793	17910500	hadcm3n_xc3o_1940_40_009151978_2	25,920	20,862	0.8049