Task 17352004

Name	hadcm3n_x0fv_1940_40_009147838_0
Workunit	9278174
Created	6 Nov 2014, 12:23:58 UTC
Sent	9 Nov 2014, 11:26:32 UTC
Report deadline	8 Feb 2015, 18:53:43 UTC
Received	29 Dec 2014, 17:24:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1123890
Run time	29 days 9 hours 24 min 31 sec
CPU time	28 days 12 hours 37 min 17 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.17 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:32:22 (2484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:29:55 (2768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:41:54 (1210): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:14:25 (428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:09 (27952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0x381f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0x381f600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0x2822c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xa81fa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0x5837a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0x1030c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0x1030c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0x701f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0x701f600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0xb801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20644,0xa0c4f1d4) malloc: * error for object 0x401c400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x9827604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x820604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x3020604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x3020600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x801f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x801f600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1530,0xa08581d4) malloc: * error for object 0x7804e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.1 build 14B25 Mon Dec 29 12:23:00 2014 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fc08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/21/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90f13000 - 0x90fa8fff /usr/lib/system/libsystem_c.dylib 0x9159d000 - 0x9159ffff /usr/lib/system/libsystem_sandbox.dylib 0x915a0000 - 0x915a9fff /usr/lib/system/libsystem_notify.dylib 0x915aa000 - 0x915b0fff /usr/lib/system/libsystem_platform.dylib 0x9192d000 - 0x9196afff /usr/lib/system/libsystem_network.dylib 0x9196b000 - 0x9196ffff /usr/lib/system/libcache.dylib 0x91ab7000 - 0x91ad6fff /usr/lib/system/libsystem_kernel.dylib 0x91ba3000 - 0x91ba5fff /usr/lib/system/libsystem_configuration.dylib 0x91fdb000 - 0x91fe0fff /usr/lib/system/libmacho.dylib 0x9234a000 - 0x92370fff /usr/lib/system/libxpc.dylib 0x92464000 - 0x92466fff /usr/lib/system/libsystem_coreservices.dylib 0x929ec000 - 0x929eefff /usr/lib/system/libquarantine.dylib 0x92fab000 - 0x92fabfff /usr/lib/system/liblaunch.dylib 0x93102000 - 0x93107fff /usr/lib/system/libcompiler_rt.dylib 0x93fcd000 - 0x93fcefff /usr/lib/system/libremovefile.dylib 0x94188000 - 0x94190fff /usr/lib/system/libsystem_pthread.dylib 0x941c3000 - 0x941c3fff /usr/lib/system/libunc.dylib 0x941c9000 - 0x941f0fff /usr/lib/system/libdispatch.dylib 0x95647000 - 0x9564afff /usr/lib/system/libdyld.dylib 0x95b7a000 - 0x95b7afff /usr/lib/system/libkeymgr.dylib 0x96769000 - 0x9677afff /usr/lib/system/libsystem_coretls.dylib 0x96784000 - 0x967b7fff /usr/lib/system/libsystem_m.dylib 0x96b8f000 - 0x96b91fff /usr/lib/system/libsystem_secinit.dylib 0x96b92000 - 0x96b9bfff /usr/lib/system/libcopyfile.dylib 0x96b9c000 - 0x96bb5fff /usr/lib/system/libsystem_malloc.dylib 0x97a62000 - 0x97a70fff /usr/lib/libz.1.dylib 0x98b89000 - 0x98b8ffff /usr/lib/system/libsystem_networkextension.dylib 0x98ef7000 - 0x98ef8fff /usr/lib/libSystem.B.dylib 0x991f8000 - 0x99221fff /usr/lib/system/libsystem_info.dylib 0x9a506000 - 0x9a51dfff /usr/lib/system/libsystem_asl.dylib 0x9b35f000 - 0x9b360fff /usr/lib/system/libsystem_blocks.dylib 0x9b54c000 - 0x9b552fff /usr/lib/system/libsystem_trace.dylib 0x9b568000 - 0x9b58efff /usr/lib/libc++abi.dylib 0x9b703000 - 0x9b70bfff /usr/lib/system/libsystem_dnssd.dylib 0x9b70c000 - 0x9b775fff /usr/lib/system/libcorecrypto.dylib 0x9b77f000 - 0x9b786fff /usr/lib/system/libunwind.dylib 0x9c096000 - 0x9c0a2fff /usr/lib/system/libcommonCrypto.dylib 0x9c0a3000 - 0x9c0f6fff /usr/lib/libstdc++.6.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Dec 2014 19:57:00	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	518,400	2,394,207	4.6185
27 Dec 2014 07:18:36	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	492,480	2,269,115	4.6075
25 Dec 2014 18:49:42	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	466,560	2,143,617	4.5945
16 Dec 2014 06:38:13	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	440,640	2,018,130	4.5800
14 Dec 2014 18:56:23	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	414,720	1,894,165	4.5673
13 Dec 2014 07:32:51	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	388,800	1,770,214	4.5530
09 Dec 2014 16:27:07	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	362,880	1,645,759	4.5353
01 Dec 2014 02:23:21	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	336,960	1,524,711	4.5249
29 Nov 2014 15:15:17	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	311,040	1,407,131	4.5240
28 Nov 2014 06:32:28	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	285,120	1,293,414	4.5364
26 Nov 2014 19:49:20	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	259,200	1,173,936	4.5291
25 Nov 2014 08:13:41	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	233,280	1,052,959	4.5137
22 Nov 2014 14:57:28	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	207,360	933,508	4.5019
21 Nov 2014 02:12:52	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	181,440	812,596	4.4786
19 Nov 2014 15:26:39	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	155,520	691,071	4.4436
18 Nov 2014 04:37:01	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	129,600	569,272	4.3925
16 Nov 2014 14:05:40	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	103,680	454,613	4.3848
15 Nov 2014 04:24:51	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	77,760	341,510	4.3918
13 Nov 2014 19:23:19	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	51,840	227,539	4.3893
12 Nov 2014 11:17:36	1123890	17352004	hadcm3n_x0fv_1940_40_009147838_0	25,920	113,854	4.3925