Task 12736734

Name	hadcm3n_o1vv_1900_40_007197774_1
Workunit	7396054
Created	28 Mar 2011, 14:01:41 UTC
Sent	1 Apr 2011, 11:16:12 UTC
Report deadline	1 Jul 2011, 18:43:23 UTC
Received	23 May 2011, 2:13:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	852721
Run time
CPU time	5 days 15 hours 19 min 42 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.11 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>5.10.45</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... 16:45:58 (55465): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L31a Mon May 23 02:53:11 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. 0 hadcm3n_6.07_i686-apple-darwin 0x00074953 version + 61229 1 hadcm3n_6.07_i686-apple-darwin 0x0006a936 version + 20240 2 libSystem.B.dylib 0x925052bb _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 hadcm3n_6.07_i686-apple-darwin 0x00020602 ncx_getn_float_float + 34 5 hadcm3n_6.07_i686-apple-darwin 0x00027264 fill_NC_var + 17204 6 hadcm3n_6.07_i686-apple-darwin 0x000294e3 fill_NC_var + 26035 7 hadcm3n_6.07_i686-apple-darwin 0x0002f733 nc_get_var_float + 355 8 hadcm3n_6.07_i686-apple-darwin 0x0000b927 _Z12annual_cyclePKSt6vectorISsSaISsEEPKcii + 3177 9 hadcm3n_6.07_i686-apple-darwin 0x0000d36b _Z12decadalMeansiPKc + 957 10 hadcm3n_6.07_i686-apple-darwin 0x000067ff _Z9doCM3Procv + 185 11 hadcm3n_6.07_i686-apple-darwin 0x0000791c _Z8mainLoopv + 410 12 hadcm3n_6.07_i686-apple-darwin 0x000087c7 _Z6workerv + 2989 13 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 14 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x924cd8c2 ecx: 0xbff9033c edx: 0x92499266 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff90378 esp: 0xbff9033c ss: 0x0000001f efl: 0x00000206 eip: 0x92499266 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/61/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90741000 - 0x90745fff /usr/lib/system/libmathCommon.A.dylib 0x90b3d000 - 0x90b4bfff /usr/lib/libz.1.dylib 0x92498000 - 0x925fffff /usr/lib/libSystem.B.dylib 0x92600000 - 0x9265dfff /usr/lib/libstdc++.6.dylib 0x95c58000 - 0x95c5ffff /usr/lib/libgcc_s.1.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 May 2011 00:54:13	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	777,600	487,178	0.6265
22 May 2011 07:01:21	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	751,680	482,107	0.6414
21 May 2011 18:23:03	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	725,760	466,606	0.6429
21 May 2011 05:13:32	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	699,840	446,609	0.6382
20 May 2011 17:33:58	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	673,920	448,861	0.6660
20 May 2011 06:19:09	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	648,000	449,702	0.6940
19 May 2011 18:34:34	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	622,080	439,678	0.7068
19 May 2011 07:02:11	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	596,160	401,071	0.6728
18 May 2011 18:09:12	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	570,240	392,536	0.6884
18 May 2011 05:32:09	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	544,320	374,248	0.6876
17 May 2011 17:19:37	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	518,400	415,548	0.8016
17 May 2011 04:37:39	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	492,480	372,949	0.7573
16 May 2011 15:51:57	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	466,560	350,521	0.7513
16 May 2011 04:29:53	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	440,640	338,539	0.7683
15 May 2011 17:10:23	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	414,720	381,086	0.9189
15 May 2011 06:15:07	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	388,800	343,388	0.8832
14 May 2011 18:07:52	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	362,880	335,315	0.9240
14 May 2011 06:32:48	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	336,960	308,551	0.9157
13 May 2011 18:43:51	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	311,040	340,256	1.0939
13 May 2011 07:28:15	852721	12736734	hadcm3n_o1vv_1900_40_007197774_1	285,120	302,228	1.0600