Task 12390460

Name	famous_vj9h_1599_200_006710731_6
Workunit	6913984
Created	17 Dec 2010, 12:55:15 UTC
Sent	17 Dec 2010, 12:55:20 UTC
Report deadline	18 Mar 2011, 20:22:31 UTC
Received	19 Dec 2010, 11:18:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1086332
Run time	1 days 0 hours 24 min 43 sec
CPU time	22 hours 3 min 13 sec
Validate state	Invalid
Credit	1,297.11
Device peak FLOPS	2.57 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Sat Dec 18 17:37:57 2010 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x998e146b 3 0xffffffff 4 0x013596b3 5 0x0135844f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc38c edx: 0x9987b0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc3c8 esp: 0xbfffc38c ss: 0x0000001f efl: 0x00000206 eip: 0x9987b0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12b4000 - 0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libsvml.dylib 0x1327000 - 0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libifcoremt.dylib 0x1407000 - 0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libimf.dylib 0x1674000 - 0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libirc.dylib 0x981a1000 - 0x981affff /usr/lib/libz.1.dylib 0x9909b000 - 0x9909efff /usr/lib/system/libmathCommon.A.dylib 0x9987a000 - 0x99a21fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18908, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Sat Dec 18 18:37:53 2010 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x998e146b 3 0xffffffff 4 0x013596b3 5 0x0135844f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc38c edx: 0x9987b0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc3c8 esp: 0xbfffc38c ss: 0x0000001f efl: 0x00000206 eip: 0x9987b0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12b4000 - 0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libsvml.dylib 0x1327000 - 0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libifcoremt.dylib 0x1407000 - 0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libimf.dylib 0x1674000 - 0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libirc.dylib 0x981a1000 - 0x981affff /usr/lib/libz.1.dylib 0x9909b000 - 0x9909efff /usr/lib/system/libmathCommon.A.dylib 0x9987a000 - 0x99a21fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19429, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Sat Dec 18 20:38:15 2010 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x998e146b 3 0xffffffff 4 0x013596b3 5 0x0135844f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc38c edx: 0x9987b0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc3c8 esp: 0xbfffc38c ss: 0x0000001f efl: 0x00000206 eip: 0x9987b0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12b4000 - 0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libsvml.dylib 0x1327000 - 0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libifcoremt.dylib 0x1407000 - 0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libimf.dylib 0x1674000 - 0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libirc.dylib 0x981a1000 - 0x981affff /usr/lib/libz.1.dylib 0x9909b000 - 0x9909efff /usr/lib/system/libmathCommon.A.dylib 0x9987a000 - 0x99a21fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20477, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Sun Dec 19 03:38:24 2010 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x998e146b 3 0xffffffff 4 0x013596b3 5 0x0135844f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc38c edx: 0x9987b0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc3c8 esp: 0xbfffc38c ss: 0x0000001f efl: 0x00000206 eip: 0x9987b0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12b4000 - 0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libsvml.dylib 0x1327000 - 0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libifcoremt.dylib 0x1407000 - 0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libimf.dylib 0x1674000 - 0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vj9h_1599_200_006710731/lib/libirc.dylib 0x981a1000 - 0x981affff /usr/lib/libz.1.dylib 0x9909b000 - 0x9909efff /usr/lib/system/libmathCommon.A.dylib 0x9987a000 - 0x99a21fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24200, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (24769): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Dec 2010 11:25:48	1086332	12390460	famous_vj9h_1599_200_006710731_6	393,146	78,004	0.1984
19 Dec 2010 11:25:48	1086332	12390460	famous_vj9h_1599_200_006710731_6	383,786	76,137	0.1984
19 Dec 2010 11:25:48	1086332	12390460	famous_vj9h_1599_200_006710731_6	374,426	74,272	0.1984
19 Dec 2010 11:25:48	1086332	12390460	famous_vj9h_1599_200_006710731_6	365,066	72,409	0.1983
19 Dec 2010 11:25:48	1086332	12390460	famous_vj9h_1599_200_006710731_6	355,706	70,542	0.1983
19 Dec 2010 00:36:18	1086332	12390460	famous_vj9h_1599_200_006710731_6	346,346	68,677	0.1983
19 Dec 2010 00:08:25	1086332	12390460	famous_vj9h_1599_200_006710731_6	336,986	66,814	0.1983
18 Dec 2010 23:26:24	1086332	12390460	famous_vj9h_1599_200_006710731_6	327,626	64,945	0.1982
18 Dec 2010 22:53:53	1086332	12390460	famous_vj9h_1599_200_006710731_6	318,266	63,083	0.1982
18 Dec 2010 22:17:20	1086332	12390460	famous_vj9h_1599_200_006710731_6	308,906	61,218	0.1982
18 Dec 2010 21:35:35	1086332	12390460	famous_vj9h_1599_200_006710731_6	299,546	59,355	0.1981
18 Dec 2010 21:03:42	1086332	12390460	famous_vj9h_1599_200_006710731_6	290,186	57,491	0.1981
18 Dec 2010 20:25:39	1086332	12390460	famous_vj9h_1599_200_006710731_6	280,826	55,623	0.1981
18 Dec 2010 19:54:25	1086332	12390460	famous_vj9h_1599_200_006710731_6	271,466	53,757	0.1980
18 Dec 2010 19:27:44	1086332	12390460	famous_vj9h_1599_200_006710731_6	262,106	51,889	0.1980
18 Dec 2010 19:25:00	1086332	12390460	famous_vj9h_1599_200_006710731_6	252,746	50,023	0.1979
18 Dec 2010 19:22:10	1086332	12390460	famous_vj9h_1599_200_006710731_6	243,386	48,158	0.1979
18 Dec 2010 19:17:21	1086332	12390460	famous_vj9h_1599_200_006710731_6	234,026	46,291	0.1978
18 Dec 2010 16:51:04	1086332	12390460	famous_vj9h_1599_200_006710731_6	224,666	44,424	0.1977
18 Dec 2010 16:14:41	1086332	12390460	famous_vj9h_1599_200_006710731_6	215,306	42,554	0.1976