Task 16295786

Name	hadcm3n_86yu_1980_40_008515533_0
Workunit	8663045
Created	26 Feb 2014, 16:12:42 UTC
Sent	26 Feb 2014, 16:49:46 UTC
Report deadline	29 May 2014, 0:16:57 UTC
Received	15 Mar 2014, 18:37:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1316971
Run time	14 days 19 hours 2 min 14 sec
CPU time	14 days 11 hours 22 min 59 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.39</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/86yuko.pjj6c10 is not a valid UM file. Error converting file to netcdf: dataout/86yuko.pjj6c10 Error: Input file: dataout/86yuko.pij6c10 is not a valid UM file. Error converting file to netcdf: dataout/86yuko.pij6c10 Error: Input file: dataout/86yuko.pfj6c10 is not a valid UM file. Error converting file to netcdf: dataout/86yuko.pfj6c10 Error: Input file: dataout/86yuka.phj6c10 is not a valid UM file. Error converting file to netcdf: dataout/86yuka.phj6c10 Error: Input file: dataout/86yuka.pgj6c10 is not a valid UM file. Error converting file to netcdf: dataout/86yuka.pgj6c10 Error: Input file: dataout/86yuka.pej6c10 is not a valid UM file. Error converting file to netcdf: dataout/86yuka.pej6c10 Error: Input file: dataout/86yuka.pdj6c10 is not a valid UM file. Error converting file to netcdf: dataout/86yuka.pdj6c10 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(67202,0xa17de1a8) malloc: * error for object 0xd344004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(67202,0xa17de1a8) malloc: * error for object 0xd344000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(67202,0xa17de1a8) malloc: * error for object 0xb54204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(67202,0xa17de1a8) malloc: * error for object 0xb54200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(67202,0xa17de1a8) malloc: * error for object 0xb54204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(67202,0xa17de1a8) malloc: * error for object 0xb54200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(67202,0xa17de1a8) malloc: * error for object 0xb54204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(67202,0xa17de1a8) malloc: * error for object 0xb54200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(67202,0xa17de1a8) malloc: * error for object 0xb54200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.2 build 13C64 Sat Mar 15 13:33:57 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fae8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/4/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x900b1000 - 0x900bcfff /usr/lib/system/libcommonCrypto.dylib 0x90b9b000 - 0x90ba3fff /usr/lib/system/libsystem_dnssd.dylib 0x90dab000 - 0x90dcffff /usr/lib/system/libxpc.dylib 0x9198f000 - 0x91990fff /usr/lib/system/libsystem_blocks.dylib 0x91991000 - 0x9199ffff /usr/lib/libz.1.dylib 0x9223e000 - 0x9225bfff /usr/lib/system/libsystem_kernel.dylib 0x9225c000 - 0x92262fff /usr/lib/system/libunwind.dylib 0x922d4000 - 0x92305fff /usr/lib/system/libsystem_m.dylib 0x9281a000 - 0x92845fff /usr/lib/system/libsystem_network.dylib 0x92847000 - 0x92848fff /usr/lib/libSystem.B.dylib 0x92c18000 - 0x92c1cfff /usr/lib/system/libcache.dylib 0x9374f000 - 0x93753fff /usr/lib/system/libmacho.dylib 0x93795000 - 0x93797fff /usr/lib/system/libquarantine.dylib 0x94333000 - 0x94336fff /usr/lib/system/libdyld.dylib 0x94fdf000 - 0x94fe8fff /usr/lib/system/libsystem_notify.dylib 0x953e2000 - 0x953fafff /usr/lib/system/libsystem_malloc.dylib 0x95400000 - 0x95401fff /usr/lib/system/libunc.dylib 0x95459000 - 0x9545bfff /usr/lib/system/libsystem_configuration.dylib 0x95461000 - 0x95462fff /usr/lib/system/libremovefile.dylib 0x961cb000 - 0x9625dfff /usr/lib/system/libsystem_c.dylib 0x969c3000 - 0x969c8fff /usr/lib/system/libcompiler_rt.dylib 0x97875000 - 0x978c5fff /usr/lib/system/libcorecrypto.dylib 0x98323000 - 0x98374fff /usr/lib/libstdc++.6.dylib 0x98376000 - 0x9838efff /usr/lib/system/libdispatch.dylib 0x983eb000 - 0x983ebfff /usr/lib/system/libkeymgr.dylib 0x983ec000 - 0x98410fff /usr/lib/libc++abi.dylib 0x98618000 - 0x9862afff /usr/lib/system/libsystem_asl.dylib 0x99319000 - 0x9931afff /usr/lib/system/libsystem_sandbox.dylib 0x9931c000 - 0x99324fff /usr/lib/system/libcopyfile.dylib 0x997c5000 - 0x997ccfff /usr/lib/system/libsystem_pthread.dylib 0x9a0ff000 - 0x9a107fff /usr/lib/system/liblaunch.dylib 0x9b2a1000 - 0x9b2c9fff /usr/lib/system/libsystem_info.dylib 0x9b2ca000 - 0x9b2cffff /usr/lib/system/libsystem_platform.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Mar 2014 18:39:13	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	777,600	1,250,572	1.6082
15 Mar 2014 01:54:34	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	751,680	1,209,192	1.6087
14 Mar 2014 14:36:05	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	725,760	1,169,432	1.6113
14 Mar 2014 02:37:53	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	699,840	1,129,195	1.6135
13 Mar 2014 13:54:26	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	673,920	1,088,420	1.6151
13 Mar 2014 01:56:38	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	648,000	1,047,667	1.6168
12 Mar 2014 14:23:56	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	622,080	1,007,180	1.6191
12 Mar 2014 02:21:21	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	596,160	966,151	1.6206
11 Mar 2014 13:21:29	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	570,240	925,254	1.6226
11 Mar 2014 01:47:27	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	544,320	884,671	1.6253
10 Mar 2014 14:18:05	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	518,400	843,976	1.6280
10 Mar 2014 01:58:17	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	492,480	803,564	1.6317
09 Mar 2014 15:13:30	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	466,560	763,095	1.6356
09 Mar 2014 01:18:34	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	440,640	721,690	1.6378
08 Mar 2014 12:15:56	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	414,720	679,099	1.6375
07 Mar 2014 22:01:08	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	388,800	636,426	1.6369
07 Mar 2014 08:43:07	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	362,880	594,275	1.6377
06 Mar 2014 19:44:01	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	336,960	552,094	1.6385
06 Mar 2014 07:27:04	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	311,040	509,887	1.6393
05 Mar 2014 18:06:58	1316971	16295786	hadcm3n_86yu_1980_40_008515533_0	285,120	467,458	1.6395