Task 11650106

Name	famous_u9p4_999_200_006645411_5
Workunit	6848783
Created	10 Aug 2010, 20:55:57 UTC
Sent	10 Aug 2010, 21:41:44 UTC
Report deadline	10 Nov 2010, 5:08:55 UTC
Received	15 Aug 2010, 16:27:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	930049
Run time	1 days 11 hours 44 min 15 sec
CPU time	1 days 2 hours 4 min 37 sec
Validate state	Invalid
Credit	401.55
Device peak FLOPS	2.26 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.57</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library famous_se_6.11_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (5043): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Aug 2010 16:07:28	930049	11650106	famous_u9p4_999_200_006645411_5	121,706	93,353	0.7670
15 Aug 2010 07:43:37	930049	11650106	famous_u9p4_999_200_006645411_5	112,346	86,765	0.7723
14 Aug 2010 17:32:19	930049	11650106	famous_u9p4_999_200_006645411_5	102,986	79,241	0.7694
14 Aug 2010 10:38:39	930049	11650106	famous_u9p4_999_200_006645411_5	93,626	71,454	0.7632
14 Aug 2010 02:40:40	930049	11650106	famous_u9p4_999_200_006645411_5	84,266	64,446	0.7648
13 Aug 2010 16:14:55	930049	11650106	famous_u9p4_999_200_006645411_5	74,906	56,879	0.7593
13 Aug 2010 07:56:45	930049	11650106	famous_u9p4_999_200_006645411_5	65,546	48,926	0.7464
13 Aug 2010 04:37:34	930049	11650106	famous_u9p4_999_200_006645411_5	56,186	42,585	0.7579
12 Aug 2010 18:23:02	930049	11650106	famous_u9p4_999_200_006645411_5	46,826	35,258	0.7530
12 Aug 2010 11:38:03	930049	11650106	famous_u9p4_999_200_006645411_5	37,466	27,324	0.7293
12 Aug 2010 03:33:07	930049	11650106	famous_u9p4_999_200_006645411_5	28,106	20,063	0.7138
11 Aug 2010 20:56:32	930049	11650106	famous_u9p4_999_200_006645411_5	18,746	13,424	0.7161
11 Aug 2010 09:03:17	930049	11650106	famous_u9p4_999_200_006645411_5	9,386	6,845	0.7293