Task 12753292

Name	hadcm3n_o6p8_1900_40_007204015_2
Workunit	7402295
Created	29 Mar 2011, 0:00:34 UTC
Sent	29 Mar 2011, 2:44:39 UTC
Report deadline	28 Jun 2011, 10:11:50 UTC
Received	23 Apr 2011, 21:16:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	922469
Run time
CPU time	8 days 15 hours 46 min 31 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.99 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.2.18</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:25:27 (4315): No heartbeat from core client for 30 sec - exiting 20:25:28 (4315): No heartbeat from core client for 30 sec - exiting 20:25:29 (4315): No heartbeat from core client for 30 sec - exiting 20:25:30 (4315): No heartbeat from core client for 30 sec - exiting 20:25:31 (4315): No heartbeat from core client for 30 sec - exiting 20:25:32 (4315): No heartbeat from core client for 30 sec - exiting 20:25:33 (4315): No heartbeat from core client for 30 sec - exiting 20:25:34 (4315): No heartbeat from core client for 30 sec - exiting 20:25:35 (4315): No heartbeat from core client for 30 sec - exiting 20:25:36 (4315): No heartbeat from core client for 30 sec - exiting 20:25:37 (4315): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4316, selfPID=4316, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L31a Sat Apr 23 08:09:28 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. 0 hadcm3n_6.07_i686-apple-darwin 0x00074953 version + 61229 1 hadcm3n_6.07_i686-apple-darwin 0x0006a936 version + 20240 2 libSystem.B.dylib 0x950482bb _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 hadcm3n_6.07_i686-apple-darwin 0x00020602 ncx_getn_float_float + 34 5 hadcm3n_6.07_i686-apple-darwin 0x00027264 fill_NC_var + 17204 6 hadcm3n_6.07_i686-apple-darwin 0x000294e3 fill_NC_var + 26035 7 hadcm3n_6.07_i686-apple-darwin 0x0002f733 nc_get_var_float + 355 8 hadcm3n_6.07_i686-apple-darwin 0x0000b927 _Z12annual_cyclePKSt6vectorISsSaISsEEPKcii + 3177 9 hadcm3n_6.07_i686-apple-darwin 0x0000d36b _Z12decadalMeansiPKc + 957 10 hadcm3n_6.07_i686-apple-darwin 0x000067ff _Z9doCM3Procv + 185 11 hadcm3n_6.07_i686-apple-darwin 0x0000791c _Z8mainLoopv + 410 12 hadcm3n_6.07_i686-apple-darwin 0x000087c7 _Z6workerv + 2989 13 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 14 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x950108c2 ecx: 0xbff9036c edx: 0x94fdc266 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff903a8 esp: 0xbff9036c ss: 0x0000001f efl: 0x00000206 eip: 0x94fdc266 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/0/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x92f92000 - 0x92f96fff /usr/lib/system/libmathCommon.A.dylib 0x94a0b000 - 0x94a68fff /usr/lib/libstdc++.6.dylib 0x94fdb000 - 0x95142fff /usr/lib/libSystem.B.dylib 0x95516000 - 0x9551dfff /usr/lib/libgcc_s.1.dylib 0x96d56000 - 0x96d64fff /usr/lib/libz.1.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Apr 2011 15:12:46	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	518,400	747,988	1.4429
22 Apr 2011 02:39:51	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	492,480	709,748	1.4412
20 Apr 2011 19:52:11	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	466,560	672,110	1.4406
20 Apr 2011 19:52:11	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	440,640	634,826	1.4407
20 Apr 2011 19:52:11	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	414,720	597,611	1.4410
20 Apr 2011 19:52:11	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	388,800	560,039	1.4404
20 Apr 2011 19:52:11	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	362,880	522,246	1.4392
13 Apr 2011 12:57:25	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	336,960	484,336	1.4374
12 Apr 2011 09:08:24	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	311,040	446,452	1.4354
12 Apr 2011 09:04:40	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	285,120	408,753	1.4336
08 Apr 2011 08:37:53	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	259,200	371,595	1.4336
07 Apr 2011 00:30:31	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	233,280	334,421	1.4336
06 Apr 2011 02:47:56	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	207,360	297,269	1.4336
04 Apr 2011 05:35:47	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	181,440	259,332	1.4293
03 Apr 2011 05:19:05	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	155,520	221,899	1.4268
02 Apr 2011 07:11:04	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	129,600	184,573	1.4242
01 Apr 2011 09:00:01	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	103,680	147,585	1.4235
31 Mar 2011 11:41:24	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	77,760	110,618	1.4226
30 Mar 2011 12:52:35	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	51,840	73,804	1.4237
29 Mar 2011 18:57:35	922469	12753292	hadcm3n_o6p8_1900_40_007204015_2	25,920	36,799	1.4197