Task 19331596

Name	hadcm3n_saak_198012_480_352_010335007_1
Workunit	10335007
Created	14 Mar 2016, 16:34:05 UTC
Sent	14 Mar 2016, 16:34:10 UTC
Report deadline	24 Feb 2017, 21:54:10 UTC
Received	2 Apr 2016, 6:13:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1311998
Run time	15 days 15 hours 6 min 43 sec
CPU time	14 days 23 hours 52 min 43 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/saakko.pji2c10 is not a valid UM file. Error converting file to netcdf: dataout/saakko.pji2c10 Error: Input file: dataout/saakko.pii2c10 is not a valid UM file. Error converting file to netcdf: dataout/saakko.pii2c10 Error: Input file: dataout/saakko.pfi2c10 is not a valid UM file. Error converting file to netcdf: dataout/saakko.pfi2c10 Error: Input file: dataout/saakka.phi2c10 is not a valid UM file. Error converting file to netcdf: dataout/saakka.phi2c10 Error: Input file: dataout/saakka.pgi2c10 is not a valid UM file. Error converting file to netcdf: dataout/saakka.pgi2c10 Error: Input file: dataout/saakka.pei2c10 is not a valid UM file. Error converting file to netcdf: dataout/saakka.pei2c10 Error: Input file: dataout/saakka.pdi2c10 is not a valid UM file. Error converting file to netcdf: dataout/saakka.pdi2c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x6000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x6001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x6001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x8800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x8800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x8800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x8800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x8800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x8800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x8800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x8800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41046,0xa04e21d4) malloc: * error for object 0x8804e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1713 Sat Apr 2 00:13:08 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f938 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/5/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90124000 - 0x9012afff /usr/lib/system/libsystem_trace.dylib 0x90609000 - 0x9060cfff /usr/lib/system/libdyld.dylib 0x90c41000 - 0x90c4afff /usr/lib/system/libsystem_notify.dylib 0x90c4b000 - 0x90c9efff /usr/lib/libstdc++.6.dylib 0x91191000 - 0x911a2fff /usr/lib/system/libsystem_coretls.dylib 0x912bc000 - 0x912c4fff /usr/lib/system/libsystem_pthread.dylib 0x912c5000 - 0x912cbfff /usr/lib/system/libsystem_platform.dylib 0x942aa000 - 0x94316fff /usr/lib/system/libcorecrypto.dylib 0x9434b000 - 0x9434cfff /usr/lib/system/libsystem_blocks.dylib 0x94825000 - 0x9482dfff /usr/lib/system/libsystem_dnssd.dylib 0x95579000 - 0x9557afff /usr/lib/libSystem.B.dylib 0x95f70000 - 0x95f76fff /usr/lib/system/libsystem_networkextension.dylib 0x96599000 - 0x96599fff /usr/lib/system/libunc.dylib 0x96eb6000 - 0x96ebbfff /usr/lib/system/libcompiler_rt.dylib 0x96fd7000 - 0x96feefff /usr/lib/system/libsystem_asl.dylib 0x97604000 - 0x97604fff /usr/lib/system/libkeymgr.dylib 0x97718000 - 0x97737fff /usr/lib/system/libsystem_kernel.dylib 0x97738000 - 0x97741fff /usr/lib/system/libcopyfile.dylib 0x97742000 - 0x97744fff /usr/lib/system/libsystem_configuration.dylib 0x9838c000 - 0x98398fff /usr/lib/system/libcommonCrypto.dylib 0x983f3000 - 0x9841afff /usr/lib/system/libdispatch.dylib 0x98afc000 - 0x98b03fff /usr/lib/system/libunwind.dylib 0x98fed000 - 0x99006fff /usr/lib/system/libsystem_malloc.dylib 0x9995a000 - 0x9995bfff /usr/lib/system/libremovefile.dylib 0x99a1e000 - 0x99a47fff /usr/lib/system/libsystem_info.dylib 0x99aaa000 - 0x99aaffff /usr/lib/system/libmacho.dylib 0x99ab8000 - 0x99abafff /usr/lib/system/libsystem_secinit.dylib 0x99c20000 - 0x99c22fff /usr/lib/system/libsystem_sandbox.dylib 0x99e76000 - 0x99e84fff /usr/lib/libz.1.dylib 0x99e85000 - 0x99e87fff /usr/lib/system/libsystem_coreservices.dylib 0x9a282000 - 0x9a286fff /usr/lib/system/libcache.dylib 0x9a56b000 - 0x9a56dfff /usr/lib/system/libquarantine.dylib 0x9b950000 - 0x9b98dfff /usr/lib/system/libsystem_network.dylib 0x9b98e000 - 0x9ba23fff /usr/lib/system/libsystem_c.dylib 0x9baa4000 - 0x9bacafff /usr/lib/libc++abi.dylib 0x9bad4000 - 0x9bad4fff /usr/lib/system/liblaunch.dylib 0x9bb81000 - 0x9bbb4fff /usr/lib/system/libsystem_m.dylib 0x9bcd7000 - 0x9bcfdfff /usr/lib/system/libxpc.dylib Exiting... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=76566, selfPID=76566, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Apr 2016 05:19:09	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	777,600	1,295,555	1.6661
01 Apr 2016 14:03:20	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	751,680	1,250,674	1.6638
31 Mar 2016 21:18:19	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	725,760	1,207,847	1.6643
31 Mar 2016 08:59:19	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	699,840	1,166,028	1.6661
30 Mar 2016 19:29:51	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	673,920	1,122,597	1.6658
30 Mar 2016 05:40:14	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	648,000	1,081,068	1.6683
29 Mar 2016 17:06:01	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	622,080	1,038,612	1.6696
29 Mar 2016 04:19:10	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	596,160	994,509	1.6682
28 Mar 2016 15:10:53	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	570,240	948,999	1.6642
27 Mar 2016 23:11:08	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	544,320	906,640	1.6656
27 Mar 2016 08:56:50	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	518,400	864,554	1.6677
26 Mar 2016 17:32:29	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	492,480	821,640	1.6684
26 Mar 2016 03:20:31	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	466,560	777,156	1.6657
25 Mar 2016 14:40:00	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	440,640	733,470	1.6646
25 Mar 2016 01:39:20	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	414,720	688,919	1.6612
24 Mar 2016 13:02:52	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	388,800	645,119	1.6593
23 Mar 2016 07:33:15	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	362,880	602,646	1.6607
22 Mar 2016 20:07:44	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	336,960	561,225	1.6656
22 Mar 2016 06:19:08	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	311,040	520,044	1.6720
21 Mar 2016 16:23:55	1311998	19331596	hadcm3n_saak_198012_480_352_010335007_1	285,120	477,066	1.6732