Task 11756158

Name	famous_vafb_1799_200_006699277_4
Workunit	6902530
Created	26 Aug 2010, 16:33:35 UTC
Sent	5 Dec 2010, 14:08:40 UTC
Report deadline	6 Mar 2011, 21:35:51 UTC
Received	11 Dec 2010, 12:33:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	967198
Run time	23 hours 42 min
CPU time	22 hours 44 min 27 sec
Validate state	Invalid
Credit	525.07
Device peak FLOPS	2.40 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... (5304): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Signal 15 received, exiting... (9993): called boinc_finish Signal 15 received, exiting... (12009): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (13486): called boinc_finish Signal 15 received, exiting... (4169): called boinc_finish Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (5697): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Dec 2010 11:39:25	967198	11756158	famous_vafb_1799_200_006699277_4	159,146	78,830	0.4953
11 Dec 2010 10:27:12	967198	11756158	famous_vafb_1799_200_006699277_4	149,786	74,343	0.4963
11 Dec 2010 09:31:36	967198	11756158	famous_vafb_1799_200_006699277_4	140,426	69,885	0.4977
11 Dec 2010 09:31:36	967198	11756158	famous_vafb_1799_200_006699277_4	131,066	65,419	0.4991
10 Dec 2010 22:07:02	967198	11756158	famous_vafb_1799_200_006699277_4	121,706	60,941	0.5007
10 Dec 2010 20:48:24	967198	11756158	famous_vafb_1799_200_006699277_4	112,346	56,289	0.5010
10 Dec 2010 19:29:58	967198	11756158	famous_vafb_1799_200_006699277_4	102,986	51,809	0.5031
10 Dec 2010 18:11:58	967198	11756158	famous_vafb_1799_200_006699277_4	93,626	47,350	0.5057
09 Dec 2010 21:30:42	967198	11756158	famous_vafb_1799_200_006699277_4	84,266	42,880	0.5089
09 Dec 2010 20:13:00	967198	11756158	famous_vafb_1799_200_006699277_4	74,906	38,382	0.5124
06 Dec 2010 19:50:35	967198	11756158	famous_vafb_1799_200_006699277_4	65,546	33,833	0.5162
06 Dec 2010 18:33:12	967198	11756158	famous_vafb_1799_200_006699277_4	56,186	29,333	0.5221
05 Dec 2010 21:20:32	967198	11756158	famous_vafb_1799_200_006699277_4	46,826	24,345	0.5199
05 Dec 2010 19:46:01	967198	11756158	famous_vafb_1799_200_006699277_4	37,466	19,092	0.5096
05 Dec 2010 18:31:03	967198	11756158	famous_vafb_1799_200_006699277_4	28,106	14,583	0.5189
05 Dec 2010 17:07:09	967198	11756158	famous_vafb_1799_200_006699277_4	18,746	10,069	0.5371
05 Dec 2010 15:48:33	967198	11756158	famous_vafb_1799_200_006699277_4	9,386	5,523	0.5884